RSS GitHub
The Ledger A sourced historical record of AI

Center for AI Safety Publishes One-Sentence Statement Putting AI Extinction Risk Alongside Pandemics and Nuclear War

A ledger entry in the safety archive, dated 2023-05-30.

References

Summary

On May 30, 2023, the Center for AI Safety, a nonprofit research and advocacy group, published a single-sentence statement: "Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war." Its signatories included Geoffrey Hinton and Yoshua Bengio and the chief executives of OpenAI, Google DeepMind and Anthropic. The statement made the possibility of human extinction from AI a position that the leaders of the main frontier labs had put their names to, and it drew criticism from researchers who said it distracted from harms AI was already causing.

What Happened

The Center for AI Safety posted the statement on its website with a short preamble. The preamble said that AI experts, journalists and policymakers were discussing "a broad spectrum of important and urgent risks from AI," but that "it can be difficult to voice concerns about some of advanced AI's most severe risks," and that the statement was "meant to create common knowledge of the growing number of experts and public figures who also take some of advanced AI's most severe risks seriously." The statement itself was one sentence long and proposed no specific policy.

The first names on the signatory list were Geoffrey Hinton, then emeritus professor at the University of Toronto, and Yoshua Bengio of the University of Montreal and Mila, followed by Demis Hassabis of Google DeepMind, Sam Altman of OpenAI and Dario Amodei of Anthropic. OpenAI chief scientist Ilya Sutskever also signed. BBC News reported the statement on May 30, noting that some experts considered fears of AI wiping out humanity unrealistic and a distraction from problems such as bias in systems already in use.

In its newsletter of June 6, the center wrote that hundreds of AI scientists and public figures had signed "last week," including signatories from more than two dozen countries. The newsletter reported that UK Prime Minister Rishi Sunak had retweeted the statement and said, "The government is looking very carefully at this."

Why It Matters

The Future of Life Institute's letter in March had asked labs to stop; this statement asked nothing of them, which is why the heads of the labs could sign it. By doing so, the chief executives of the three leading frontier developers put on record that their own industry's products could pose a risk on the scale of nuclear war, while continuing to build them. That combination shaped the politics of the rest of 2023: governments that had treated AI mainly as a question of competition and consumer protection began to treat frontier models as a security issue, and in November the UK hosted the Bletchley Park summit on frontier AI risk.

The statement also hardened a divide that ran through later debates. Critics argued that framing AI risk as extinction moved attention away from documented harms and toward speculative ones that favored the companies building the systems. Supporters argued that the statement established that concern about catastrophic risk was held by leading researchers, not only by outsiders.

§ How to read the metadata
Landmark
Fundamentally alters the trajectory; 2–5 per year.
Major
Meaningfully shifts the landscape; 2–4 per month.
Notable
Worth documenting; significance can be upgraded later.
Confidence
High = primary sources corroborate. Medium = credible secondary only. Low = provisional. Disputed = credible sources disagree.
Contestation
Uncontested = no formal challenge. Contested = at least one challenge filed and not resolved by a correction. Corrected = a challenge was upheld and the entry corrected; see its revision history. Superseded = replaced by a later entry. Unresolved = dispute still open.

References

  1. Statement on AI Risk , Center for AI Safety () primary document archived copy
  2. AI Safety Newsletter #9 , Center for AI Safety () primary document archived copy
  3. Artificial intelligence could lead to extinction, experts warn , BBC News () secondary reporting archived copy

See also