Adobe’s project music GenAI: Revolutionising music creation with AI-Powered editing

Adobe, a trailblazer in creative software, has introduced its latest foray into the realm of generative AI with Project Music GenAI Control. Described as the “Photoshop of music-making and editing,” this prototype tool seeks to empower individuals to create and customise music, even in the absence of professional audio expertise. 

Project Music GenAI Control operates seamlessly, allowing users to generate music through simple text prompts and subsequently edit the audio without the need for dedicated editing software. The process begins with users inputting a text description specifying the desired musical style, such as “happy dance” or “sad jazz.” Adobe’s integrated editing controls then empower users to customize the generated music by adjusting repeating patterns, tempo, intensity, and structure.

A noteworthy feature of this prototype tool is its capacity to remix sections of music and generate audio as a repeating loop, catering to those in need of backing tracks or background music for various creative endeavors. Additionally, the tool can modify the generated audio based on a reference melody and extend the length of audio clips, accommodating requirements such as fixed animations or podcast segments.

While similar tools, like Google’s MusicLM and Meta’s AudioCraft, are already in existence or under development, Project Music GenAI Control distinguishes itself by not only enabling users to generate audio through text prompts but also providing robust support for editing the music output. 

This eliminates the need for repetitive generation until desired results are achieved or manual edits are made using external audio editing software.

Nicholas Bryan, a senior research scientist at Adobe Research, expressed excitement about the tool, highlighting its capacity to offer creators a level of control akin to Photoshop but for music. This granular control allows for shaping, tweaking, and editing audio at a pixel level, presenting a new frontier in music creation.

Developed in collaboration with the University of California and the School of Computer Science at Carnegie Mellon University, Project Music GenAI is in its early stages. While there’s anticipation for these features to be integrated into Adobe’s existing editing tools like Audition and Premiere Pro, the tool is not yet available to the public, and no official release date has been disclosed. The development of Project Music GenAI is eagerly anticipated by those eager to explore the innovative possibilities it promises in the world of music creation and editing.