AI Tools Could Trigger Catastrophes, Not Extinction, Warns Scientist

Date:

AI Tools May Not Trigger Extinction, but Could Lead to Catastrophes, Warns Scientist

Artificial intelligence (AI) tools like ChatGPT may not bring about human extinction, but they could potentially cause international catastrophes, according to leading cognitive scientist Gary Marcus. While there has been speculation about the probability of a human extinction-level event due to the rapid advancement of AI, Marcus believes that these apocalyptic predictions are unlikely. Instead, he predicts that AI tools could pose a series of catastrophic risks stemming from deepfakes and market manipulation.

Marcus introduced the term p(catastrophe) to describe the chance of an incident that could result in the death of one percent or more of the population. He believes that this term is more appropriate than p(doom), which refers to the probability of AI causing the extinction of the human species. These catastrophes, Marcus explains, would not be existential threats but rather risks that could lead to significant societal damage.

The cognitive scientist emphasizes that these AI-related catastrophes would be initiated by humans themselves. Marcus highlights the growing use of AI-generated deepfakes and their potential to deceive voters and defraud individuals through impersonations of others’ voices. He warns that AI-generated misinformation poses a genuine threat to democracy and that current measures to combat it are insufficient.

This concern about the disruptive potential of deepfakes has also been echoed by Microsoft founder Bill Gates. He believes that deepfakes and AI-generated misinformation could undermine political processes worldwide. Gates warns that AI-generated deepfakes could be deployed to sway election outcomes, casting doubt on legitimate winners.

See also  Nvidia Surpasses Expectations with $16 Billion Q3 Revenue, US

To illustrate the potential danger, Marcus references an AI-generated video posted on X.com in April, which falsely depicted former US Secretary of State Hillary Clinton endorsing Florida Governor Ron DeSantis for president. The video was later identified as a deepfake, with no evidence that Clinton ever made such an endorsement.

However, Marcus acknowledges that human beings are a resilient species and suggests that predictions of AI doomsday scenarios are overly extreme. He signed a letter last year supporting a moratorium on the development of further generative AI models, specifically focusing on the unreliability and potential problems associated with GPT5. He clarifies that the signatories were not calling for a halt to all AI advancements but rather for the creation of AI systems that are more trustworthy, reliable, and less likely to cause harm.

Marcus also raises concerns about the current design of AI systems, referring to them as black boxes that lack transparency and understanding of their internal workings. This lack of transparency makes it challenging to debug the systems and provide guarantees around their behavior, raising further risks and uncertainties.

In conclusion, while the complete extinction of the human species due to AI is deemed unlikely by Gary Marcus, he warns of the potential for catastrophic events arising from AI tools, particularly in the form of deepfakes and market manipulation. As the use of AI continues to evolve, it is crucial to prioritize the development of trustworthy and reliable AI systems to mitigate these risks and safeguard against unintended consequences.

Frequently Asked Questions (FAQs) Related to the Above News

What concerns does cognitive scientist Gary Marcus have regarding AI tools?

Gary Marcus is concerned about the potential for catastrophic events arising from AI tools, particularly in the form of deepfakes and market manipulation. He emphasizes the risks posed by AI-generated misinformation and its potential to deceive voters and defraud individuals.

Does Gary Marcus believe that AI tools could lead to human extinction?

No, Gary Marcus does not believe that AI tools will bring about human extinction. He introduced the term p(catastrophe) to describe the chance of incidents that could result in significant societal damage, rather than existential threats to the human species.

What examples are given to illustrate the potential danger of deepfakes?

Gary Marcus references an AI-generated video that falsely depicted former US Secretary of State Hillary Clinton endorsing Florida Governor Ron DeSantis for president. It was later identified as a deepfake, with no evidence that Clinton ever made such an endorsement. This highlights the potential for deepfakes to spread false information and mislead the public.

What does Bill Gates warn about regarding deepfakes and AI-generated misinformation?

Bill Gates warns that deepfakes and AI-generated misinformation have the potential to undermine political processes worldwide. He believes that they could be used to sway election outcomes and cast doubt on legitimate winners.

What did Gary Marcus and other signatories support last year?

Gary Marcus and other signatories supported a moratorium on the development of further generative AI models, specifically focusing on concerns and potential problems associated with GPT5. The aim was to encourage the creation of more trustworthy, reliable, and less harmful AI systems.

What concerns does Gary Marcus raise about the current design of AI systems?

Gary Marcus highlights that current AI systems are often considered black boxes, lacking transparency and understanding of their internal workings. This lack of transparency makes it difficult to debug these systems and provide guarantees about their behavior, leading to increased risks and uncertainties.

What is Gary Marcus' suggestion to mitigate the risks associated with AI?

Gary Marcus suggests prioritizing the development of trustworthy and reliable AI systems to mitigate the risks posed by AI tools. This involves creating AI systems that are more transparent, understandable, and less likely to cause harm.

Is Gary Marcus advocating for a complete halt to AI advancements?

No, Gary Marcus is not advocating for a complete halt to all AI advancements. He is calling for the creation of AI systems that are more trustworthy and reliable, rather than stopping all progress in the field.

Please note that the FAQs provided on this page are based on the news article published. While we strive to provide accurate and up-to-date information, it is always recommended to consult relevant authorities or professionals before making any decisions or taking action based on the FAQs or the news article.

Share post:

Subscribe

Popular

More like this
Related

Apple in Talks with Meta for Generative AI Integration: Wall Street Journal

Apple in talks with Meta for generative AI integration, a strategic move to catch up with AI rivals. Stay updated with Wall Street Journal.

IBM Stock Surges as Analyst Forecasts $200 Price Target Amid AI Shift

IBM shares surge as Goldman Sachs initiates buy rating at $200 target, highlighting Generative AI potential. Make informed investment decisions.

NVIDIA Partners with Ooredoo for AI Deployment in Middle East

NVIDIA partners with Ooredoo to deploy AI solutions in Middle East, paving the way for cutting-edge technology advancements.

IBM Shares Surge as Goldman Sachs Initiates Buy Rating at $200 Target, Highlights Generative AI Potential

IBM shares surge as Goldman Sachs initiates buy rating at $200 target, highlighting Generative AI potential. Make informed investment decisions.