What Is OpenAI’s Jukebox and What Can You Do With It? AI tools have been used in music production for quite a while, but how about music generated solely through AI? That is now a reality thanks to OpenAI’s Jukebox, an AI music-making model created to generate raw audio.
OpenAI is the same company that brought us the AI art generator called Dall-E and the AI chatbot ChatGPT. At the moment, there is no user-friendly web app for Jukebox just yet, but the code can be accessed on the OpenAI website that also includes an explanation of the model’s encoding and decoding process. The results of using the model aren’t of the best quality, as just a minute of audio can generate up to around 9 hours of rendering.
A Sample Explorer has been posted so that users can check out experiments of songs created to look like Ella Fitzgerald or 2Pac. To be clear, AI music tools already exist that help to generate music, but they’re limited to combining pre-recorded samples with digital synthesizers.
The model’s creation of music is recognizable, but strange. It is clear what genre it belongs too and the shape of the song, but the quality isn’t of the best, as it feels like listening to some of the earliest recorded music. Despite this, users have expressed delight in its eerie beauty and monstrous nature.
Lastly, OpenAI’s Jukebox is trained on 1.2 million songs from LyricWiki, but this number is still far from enough to represent the diversity of human music. Because of this, at this stage, it can’t replace songs created by humans, and it’s best used to explore novel artists and styles or as audio samples.
OpenAI is a company that focuses on creating AI technology. Founded in 2015 by Sam Altman, Elon Musk, and Greg Brockman, the company is well known for its chatbot ChatGPT and its AI art generator, Dall-E. It is a nonprofit research lab that aims to promote safe AI development and benefit the human race, and has become well known for the advancement and development of AI technology.
Ella Fitzgerald is one of the most iconic singers in the jazz genre of all time. An American singer and songwriter, her career spanned for more than 50 years and she was acclaimed for her vocal style, range and to this day is described as a leader in the jazz revolution. OpenAI was able to use her music as an inspiration for Jukebox and generate similar results.
2Pac, more commonly known as Tupac, is a rapper from the United States and has achieved tremendous success in the rap and hip-hop scene. His career was cut short due to his passing, but his impact on the culture lives on. OpenAI used Tupac’s music to test out the same music generation of Jukebox, and was able to create results similar to what Tupac had released.
