Nvidia Enhances AI’s Minecraft Proficiency with GPT-4

Nvidia has developed a lifelong learning agent that uses GPT-4 to enhance AI‘s ability to play Minecraft. Named Voyager, the program has an AI system that uses the popular computer game to enhance its language understanding and refine its approaches. It uses GPT-4 to take the inventory of possessions in Minecraft and generate a new challenge via natural language queries. The AI program then inputs this challenge and generates code to make the next move in Minecraft, and each bit of code is tested before feedback is fed back to GPT-4 to refine the code. The authors describe this trial-and-error process as iterative prompting. Voyager stores successful bits of code in the library, which it uses as suggestions for new actions. The program’s superiority is evident in its ability to consistently make new strides faster.