Rifusión: Generate music with text prompts

Imagine being able to generate music with just text input, choosing your favorite styles, instruments like saxophone or violin, modifiers like Arabic or Jamaican, genres like jazz or gospel, sounds like church bells or rain, or any combination your imagination allows. Don't waste any more time and try Riffusion today! Experiment with your creativity and let your music speak for itself! It's easy, fun, and affordable! Satisfy your passion for music with Riffusion!

What is Riffusion?

Riffusion is a revolutionary tool that allows anyone, regardless of their musical experience, to create unique and exciting pieces. How? Simply type in what you want to hear, wait a few seconds, and it will generate an MP3.

How Riffusion Works

Riffusion's magic lies in its ability to convert spectrograms into audio clips. It uses the unmodified Stable Diffusion model v1.5, fine-tuned to spectrogram images paired with text. Audio processing occurs downstream of the model, allowing for infinite variations of an ad by varying the seed.

Stable Diffusion

Have you heard of Stable Diffusion, the open-source AI model that generates images from text? Riffusion builds on this concept, fine-tuning the model to generate spectrogram images that are then converted into audio.

Quick guide

Initial image

The app performs frame-by-frame conditioning, and the initial image used for conditioning blocks out the BPM and overall atmosphere of the ad. You can change the initial image to explore this effect.

Noise removal

The greater the noise removal, the more creative the results will be, but the less they will resemble the seed image. Adjustments allow you to increase the noise removal, which can result in chaotic transitions and tempos.

Prompt

Get creative with your prompts! Try your favorite styles, instruments like saxophone or violin, modifiers like Arabic or Jamaican, genres like jazz or rock, and sounds like church bells or rain.

Reweighting of notices

We support weighting tokens in an ad to emphasize certain words more than others. An example syntax for boosting a word is (voices: 1,2), which applies a 1.2x multiplier.

Experiment with Riffusion

Don't wait any longer! Immerse yourself in the world of music and explore your creativity with Riffusion. It's a unique experience that will allow you to express yourself in a completely new way.

Conclusion

Riffusion is more than a tool; it's a gateway to a world of musical possibilities. No matter your skill level, Riffusion gives you the freedom to create, experiment, and enjoy music in ways never before possible.

Frequently Asked Questions

1. What is Riffusion? Riffusion is a tool that allows you to generate music from text and images.
2. How does Riffusion work? It uses an AI model to convert spectrograms into audio clips.
3. Is Riffusion difficult to use? No, Riffusion is easy to use and requires no prior musical experience.
4. Can I customize my music with Riffusion? Yes, you can experiment with different styles, instruments, genres, and more.
5. Where can I try Riffusion? You can try Riffusion on their official website and start making music today.