OpenAI, a research organization dedicated to advancing artificial intelligence (AI) technology, is intensifying its efforts to prevent the emergence of rogue AI systems. With concerns about the potential disempowerment or even extinction of humanity due to the power of superintelligence, OpenAI has decided to invest significant resources and establish a specialized research team known as the Superalignment team.
In a recent blog post, OpenAI stated its aim to develop a human-level AI alignment researcher capable of addressing the risks posed by superintelligent AI. As part of this mission, the company plans to dedicate 20% of its computing power over the next four years. The ultimate goal is to find a solution for steering and controlling potentially superintelligent AI to prevent it from going rogue.
Ilya Sutskever, OpenAI’s co-founder and chief scientist, will lead the newly formed team tasked with aligning superintelligent AI with human values. The company plans to share its research findings widely and actively engage with experts from various fields to address broader societal concerns.
Interestingly, OpenAI’s chatGPT, a language model that can generate realistic human-like responses, has faced criticism for being woke. Microsoft Corporation’s Bing AI, which uses the same OpenAI technology, has also been accused of going rogue. These examples highlight the challenges involved in developing AI systems that adhere to societal norms and values.
OpenAI’s announcement about preventing rogue AI comes at a time when discussions surrounding strict regulations and governance for AI technology are gaining momentum. OpenAI’s CEO, Sam Altman, testified before Congress in May and emphasized the importance of proactive measures, stating, If this technology goes wrong, it can go quite wrong. And we want to be vocal about that.
As OpenAI continues its research endeavors and prioritizes the prevention of rogue AI, it seeks to contribute to the responsible development and deployment of AI systems. By actively addressing the potential risks and engaging with experts and the wider community, OpenAI aims to create a future where superintelligent AI aligns with human values without jeopardizing humanity’s welfare.
For more information on the latest developments in consumer technology, you can follow Benzinga’s coverage through this link.
