A particularly inventive modder has taken things to the next level by using OpenAI’s powerful language model called ChatGPT to give non-player characters (NPCs) in Skyrim’s VR edition some truly remarkable abilities, as reported by PC Gamer. Now, with the use of a text-to-speech modulator called xVASynth and OpenAI’s own speech-to-text tool, Whisper, NPCs can come up with new dialogue and even have a dynamic conversation with the player.
This revolutionary development has been credited to the modder Art From The Machine. In one video demonstration, they had an NPC called Ulfberth War-Bear describe a sword and even find out when a store in the game’s unique town, Whiterun, was closing. Most remarkably, this NPC has been given a basic memory system that records the conversations between it and the player, so it can even recall the events and discussions from the past.
It is thought that this is only the start of the possibilities, as the modder intends to implement Langchain in the future. This sophisticated tool allows AI components to be used with more complex memory management, potentially resulting in NPCs with greater and more detailed conversational capabilities.
This leads to the exciting possibility of AI chatbots being used to extend and improve the conversations we have within virtual worlds. As AI methods and technology continues to improve, it promises to completely revolutionize the way we play video games.
OpenAI is a team of artificial intelligence experts led by the technology company, Microsoft. The company works on a large range of projects, from chatbots and machine learning to healthcare and applications that seek to accelerate human progress.
Art From The Machine is the modder responsible for ChatGPT, a mod that is taking NPCs in VR Skyrim to the next level. Their ingenious approach has resulted in an immersive experience with interactive and dynamic conversations that were not previously possible. Art From The Machine continues to improve the mod prior to public release, and is thus setting a whole new standard for what players can expect from video games.