/* ---- Google Analytics Code Below */

Tuesday, January 31, 2023

Google’s new AI turns Text into Music

Have not followed this up as yet, but quite interesting, will.  Note this is not yet publicly released/supported, but a demo for 'future research'.   (Added: Apparently due to copyright challenges) 

Google’s new AI turns text into music   From TheVerge

The examples the company has shared are music to my ears.

By Mitchell Clark

Song of the bots. Illustration: The Verge

Google researchers have made an AI that can generate minutes-long musical pieces from text prompts, and can even transform a whistled or hummed melody into other instruments, similar to how systems like DALL-E generate images from written prompts (via TechCrunch). The model is called MusicLM, and while you can’t play around with it for yourself, the company has uploaded a bunch of samples that it produced using the model.

The examples are impressive. There are 30-second snippets of what sound like actual songs created from paragraph-long descriptions that prescribe a genre, vibe, and even specific instruments, as well as five-minute-long pieces generated from one or two words like “melodic techno.” Perhaps my favorite is a demo of “story mode,” where the model is basically given a script to morph between prompts. For example, this prompt:   ...  (more at the link above) 

No comments: