Creating music with words: How Google's AI is changing the game

Delhi : In a similar manner to how systems like DALL-E generate images from written prompts, Google researchers have developed an AI that can generate minutes-long musical pieces from text prompts and even transform a whistled or hummed melody into other instruments.

The model, according to the source, is known as MusicLM, and although you can't experiment with it on your own, the business has uploaded a number of samples that it created using the model.

Impressive instances may be found. There are five-minute compositions produced from only one or two phrases like "melodic techno," as well as 30-second samples that sound like entire songs and are formed from paragraph-long descriptions that prescribe a genre, feel, and even specific instruments.

On the demo site, you can hear examples of the music the model creates when you ask it to create 10-second clips of instruments like the cello or maracas, eight-second clips of a particular genre, music that would fit a prison break, or even the difference between the sounds of a beginner and an experienced pianist. According to The Verge, it also offers interpretations of terms like "futuristic club" and "accordion death metal."

Even though MusicLM can replicate human vocals and seems to get the pitch and general sound of voices right, there is unmistakably an off-putting element to them.

Artificial intelligence (AI) systems have been credited for creating hit songs, reproducing Bach more accurately than a person could in the 1990s, and composing music to go with live performances.