Language models have the potential to do much more than just communicate. Nvidia, along with Caltech professor and director of machine learning Anima Anandkumar, developed Voyager, a Minecraft bot that utilizes language model GPT-4 to navigate the game. The bot reads the game state and generates objectives that help it explore and improve its gameplay skills over time. One unique aspect of the project is the code that GPT-4 generates to add behaviors to Voyager. If the code isn’t perfect, the bot will refine it using error messages and game feedback. Over time, Voyager learns to make increasingly complex items and explore more of the game, much more efficiently than other AI agents. This approach may be adapted for a virtual assistant to automate various tasks via the operating system on a PC or phone.
Nvidia is a technology company that creates high-performance computing products for gaming, data center, professional visualization, and artificial intelligence markets.
Linxi Jim Fan is an AI researcher at Nvidia who worked with colleagues to develop Voyager, a Minecraft-playing bot that utilizes language model GPT-4 to navigate the game. Fan states that the approach may be used to automate several routine office tasks, creating one of the technology’s most significant economic impacts.
