More than 350 AI researchers and policymakers have signed a statement warning that Artificial Intelligence (AI) could bring about the end of human civilization if greater focus is not placed on ensuring its proper use. The brief statement, which was organized and published by the Center for AI Safety (CAIS), emphasizes that mitigating the risk of extinction from AI must become a global priority alongside other societal-scale risks such as pandemics and nuclear war. The letter was signed by many big names in the AI industry, including Sam Altman, co-founder of OpenAI, and Google’s DeepMind AI project. The Tuesday CAIS statement aims to open up discussion on the threats posed by AI to create common knowledge about the growing number of experts and public figures who take severe risks associated with advanced AI seriously. Despite the many benefits of AI, it poses a risk of discriminatory practices and misuse, leading policymakers and regulatory agencies to search for ways to constrain its development.
Sam Altman, a co-founder of OpenAI, is one of the big names in the AI industry who signed the CAIS statement, warning about the risks of extending AI. Earlier this month, Altman testified before Congress about some of the risks he sees with AI tools. This testimony included a safety report that OpenAI authored on its ChatGPT-4 model, which demonstrated how large language model chatbots may help harmful actors to develop, acquire, or disperse weapons. The report also highlighted Risky Emergent Behaviors shown by AI models, such as the ability of AI to create and act on long-term plans, to accrue power and resources and to exhibit behaviour that is increasingly ‘agentic.’
The Center for AI Safety (CAIS) is a non-profit organization whose primary mission is to understand and mitigate the risks posed by AI to society. CAIS focuses on four main areas: foundational research in AI safety, technical safety engineering support, policy and stakeholder engagement, and education and outreach. The organization aims to promote a safe and beneficial AI through a multidisciplinary approach involving technical and social scientists, policymakers, and stakeholders.
While AI presents several benefits, it also poses a risk of discriminatory practices and misuse, leading policymakers and regulatory agencies to search for ways to constrain its development. The signing of the Tuesday CAIS statement is another strong indication of the importance of maintaining AI’s safety and the need for a regulatory framework to mitigate its possible risks.
