Nvidia unveils new AI model Fugatto for music and audio generation

Nvidia unveiled a new artificial intelligence model named Fugatto on Monday, designed specifically for the generation of music and audio. This innovative technology is aimed at audio producers across various fields, including music, film, and video game industries. The announcement was made in Santa Clara, California, where Nvidia, the leading supplier of chips and software for AI systems, showcased the model’s capabilities.

Fugatto, short for Foundational Generative Audio Transformer Opus 1, can create sound effects and music based on textual descriptions. For instance, it has the unique ability to generate novel sounds, such as simulating a trumpet that barks like a dog. This capability distinguishes it from existing AI technologies, particularly its advanced feature to modify pre-existing audio. For example, it can convert a piano melody into a tune sung by a human voice or alter a spoken word recording to reflect different accents or emotional tones.

Bryan Catanzaro, vice president of applied deep learning research at Nvidia, commented on the potential impact of generative AI, stating that it is poised to enhance creative avenues in music, video games, and for everyday creators. He remarked, “If we think about synthetic audio over the past 50 years, music sounds different now because of computers, because of synthesizers. I think that generative AI is going to bring new capabilities to music, to video games and to ordinary folks that want to create things.”

Despite these advancements, Nvidia announced it does not have immediate plans to publicly release Fugatto. The company is still deliberating over how and when to make the model available, especially in light of concerns regarding the potential misuse of generative technologies. Catanzaro emphasised the importance of caution, stating that “any generative technology always carries some risks, because people might use that to generate things that we would prefer they don’t.” He noted that safeguarding against the generation of misinformation or the infringement of copyrights remains a complex challenge for creators of generative AI models.

Nvidia joins a growing number of companies, including startups like Runway and larger enterprises such as Meta Platforms, that are developing technologies capable of generating audio and video content from text prompts. The relationship between technology firms and the Hollywood entertainment industry remains nuanced, particularly following controversies surrounding the use of AI in imitating voices, which has drawn criticism from high-profile figures like actress Scarlett Johansson.

As the conversation around AI in creative arts continues to evolve, industry leaders are grappling with the ethical implications of these advancements and the necessity for frameworks to mitigate potential abuses. For now, the future of Fugatto and similar technologies remains on the horizon, as creators, businesses, and industries consider their next steps in integrating these transformative tools into their operations.

Source: Noah Wire Services