Riffusion

Home · AIs · Audio · Riffusion

What is the purpose of this AI?

Riffusion is an app that allows you to create audio content quickly and in real time in an interactive way by typing commands. The end result is audio content that is generated automatically and with an amazing quality.

Capabilities

This AI is able to Create audio content,

Try Riffusion now

How does Riffusion work?

Riffusion uses a broadcast model that allows you to create audio content from a series of commands. Once the commands are entered, the app instantly starts generating audio content. In addition, it is possible to visualize the spectrogram of the generated content in 3D, which makes the experience even more interesting.

One of the most interesting features of Riffusion is that, when entering new commands, the audio transitions smoothly to the new content, making the experience very fluid. In case a new command is not entered, the app will generate audio content from different seeds of the same command. In this way, it is possible to generate audio content infinitely.

How to use Riffusion?

To get the best results in Riffusion, it is necessary to follow some basic tips:

Select a reference image that allows you to “condition” the audio generation. The reference image defines the rhythm and general tone of the content to be generated.
Use of the “denoising” function, which allows to control the creativity of the generated content. By raising the denoising level, the generated content will be more creative, but less similar to the reference image.
As for the commands, it is recommended to use creativity to the maximum. It is possible to use different styles, instruments, modifiers, genres and sounds to create unique content. In addition, the app is able to associate words with similar semantics, so it is possible to get good results with unconventional commands.
Adjust the weight of the tokens of a command. This allows to give more importance to certain words than others, which can be useful in some cases.

Examples of content generated with Riffusion

To show the possibilities of Riffusion, the app provides some examples of commands that work well. In addition, it is possible to share the generated content across different platforms. Among the examples offered by Riffusion are: