Meta Platforms, the parent company of Facebook, has unveiled an exciting new tool for music production and sound effects called AudioCraft. Powered by artificial intelligence (AI) technology, AudioCraft allows users to create music and sound effects solely through generative AI. What sets this tool apart is that it is open-source, meaning that researchers, AI practitioners, and musicians can access and train their own models using this technology.
AudioCraft comprises three AI models: MusicGen, AudioGen, and EnCodec. MusicGen enables users to create music simply by inputting text prompts. This model was trained on an impressive 20,000 hours of music owned by Meta or specifically licensed for this purpose. AudioGen, on the other hand, enables users to produce various sound effects, including footsteps and dog barks, using written prompts. Lastly, the enhanced version of Meta’s EnCodec decoder allows users to create sounds with fewer artifacts, providing a better user experience.
By making these three models open-source, Meta aims to foster innovation and growth in the field of AI-generated audio. Researchers and practitioners can utilize these models to train their own AI models, pushing the boundaries of what is possible in AI-generated music and sound effects. Meta even envisions its MusicGen model becoming a new type of instrument, akin to the revolution that synthesizers ignited when they first appeared.
Meta’s launch of AudioCraft follows in the footsteps of other tech giants like Google, who have also explored the fusion of music and AI. Google’s MusicLM, a similar product generating music based on written text prompts, is currently limited to researchers. However, Meta’s open-source approach with AudioCraft allows for broader access and collaborative opportunities.
In addition to AudioCraft, Meta is reportedly working on developing AI chatbots that embody the personalities of historical figures such as Abraham Lincoln. This further demonstrates the company’s commitment to leveraging AI technology across various domains.
Meta’s confidence in AI is reflected in its financial success and growing ad revenues. The company recently reported better-than-expected earnings and revenue for the second quarter of 2023, largely driven by its successful AI-powered advertising campaign. As a result, Meta’s stock price has soared by over 150% since the beginning of the year, with shares trading at $316.64 at the time of writing.
The launch of AudioCraft cements Meta’s position as one of the leading players harnessing the power of AI to revolutionize industries. With its open-source approach and commitment to collaborative innovation, Meta is paving the way for exciting developments in AI-generated music and sound effects. As researchers and musicians continue to explore the possibilities of AudioCraft, we can expect to see even more remarkable creations in the world of AI-generated audio.
