Blumify
Public transcript

Anthropic CEO Amodei warns UN Security Council on AI risks

Length
5 min
Language
English
Text from
the video's captions
Transcribed
13 October 2026
Notes in English.

Summary

Anthropic CEO Dario Amodei addresses the UN Security Council, warning that AI is advancing rapidly toward a "country of geniuses in the data center" within 1-2 years. He describes two main risks: misuse of AI models, such as by bioterrorists, and loss of control over accelerating model capabilities. He calls for global cooperation on narrow agreements, evaluation and verification systems, and common testing standards for AI safety.

Key points

  • Amodei says AI may reach a "country of geniuses in the data center" in 1 or 2 years, maybe less.
  • Anthropic announced a Claude-led discovery of a new molecular machine that may be a new gene-editing mechanism.
  • He identifies two main risks: misuse of AI models (such as biological weapons) and loss of control.
  • Anthropic tests every model for dangerous capabilities in cybersecurity and biology and publishes risk reports of hundreds of pages.
  • On September 12th he called for a collaborative effort to pace the frontier, including embedding external evaluators inside Anthropic with employee-like access.
  • He proposes narrow agreements like a ban on using AI to make biological weapons, evaluation and verification systems, and common global standards for testing AI models.
  • He calls AI the most important global security issue facing the world today and says no nation can manage it alone.

Questions it answers

00:00Opening and AI progress

How fast is AI advancing and what can it do today?

Amodei says AI went from barely writing code or solving high school math four years ago to writing most of the code at Anthropic and solving world-famous unsolved math problems. He estimates 1 or 2 years, maybe less, to reach a "country of geniuses in the data center."

  • AI writes most of the code at Anthropic today.
  • A "country of geniuses in the data center" may be 1-2 years away.

00:30Benefits: Claude-led discovery

What benefits of AI does Amodei highlight?

Anthropic announced a Claude-led discovery of a new molecular machine that may constitute a new gene-editing mechanism with gene therapy applications. Claude led the literature review, theorizing, and experimental design, while humans ran and verified the experiments.

  • The finding is preliminary but may be a new gene-editing mechanism.
  • Amodei expects such applications to accelerate progress on diseases that have plagued humanity for millennia.

01:10Two main risks

What risks does Amodei warn the council about?

He names two main categories: misuse of AI models, such as by bioterrorists to create biological weapons, and loss of control, where model capabilities accelerate beyond developers' ability to control them. He says if managed poorly, AI could be a risk to humanity as a whole.

  • Misuse includes bioterrorists creating biological weapons.
  • Loss of control means capabilities outpacing developers' control.

01:25Anthropic's safety record

What does Anthropic do to manage AI risks?

Anthropic tests every model for dangerous capabilities in cybersecurity and biology, puts strong safeguards on its most capable models, publishes its work, and releases risk reports of hundreds of pages. Amodei says the company will slow down as much as necessary to keep releases safe.

  • Anthropic pioneered mechanistic interpretability and alignment science research.
  • Amodei says managing these risks is bigger than any one company.

02:56Call to pace the frontier

What did Amodei call for on September 12th?

He called for a collaborative effort to pace the frontier, not to stop AI progress. It had three parts: embedding external evaluators inside Anthropic with employee-like access, industry cooperation on standards and pace, and global cooperation between governments on international standards.

  • External evaluators would have employee-like access, similar to a food inspector.
  • Some companies have already agreed to adopt the evaluator measure.

03:46Three ideas for the council

What three ideas does Amodei offer the Security Council?

First, narrow agreements every member can support, such as a ban on using AI to make biological weapons. Second, evaluation and verification systems so states can see frontier model capability and verify commitments. Third, common global standards for testing models for loss of control and misuse risks, plus a notification system for significant AI incidents.

  • He calls this the most important global security issue facing the world today.
  • No leader, company, or nation can manage AI risks alone.

Notes

Context

  • Amodei thanks France for convening the UN Security Council meeting and speaks as CEO of Anthropic.
  • He frames AI risks as grave enough to belong before the Security Council, not just economic or ICT ministries.

Rapid AI Progress

  • Four years ago AI could barely write a line of code or solve a high school math problem; today it writes most of the code at Anthropic and solves world-famous unsolved math problems.
  • He estimates the trajectory needs only 1 or 2 years, maybe less, to reach a "country of geniuses in the data center."
  • Anthropic announced a Claude-led discovery of a new molecular machine, a preliminary finding that may be a new gene-editing mechanism with gene therapy applications; Claude led literature review, theorizing, and experimental design while humans ran and verified experiments.

Two Categories of Risk

  • Misuse of AI models, for example by bioterrorists to create biological weapons.
  • Loss of control, meaning model capabilities accelerating beyond developers' ability to control them.
  • If managed poorly, Amodei believes AI could be a risk to humanity as a whole.

Anthropic's Safety Practices

  • Anthropic tests every model for dangerous capabilities in areas like cybersecurity and biology.
  • It puts strong safeguards on its most capable models and publishes its work.
  • It has pioneered mechanistic interpretability and alignment science research.
  • It releases risk reports running to hundreds of pages.
  • Amodei says Anthropic will slow down as much as necessary to ensure each release is safe.

Call to Pace the Frontier (September 12th)

  • Embed external evaluators inside Anthropic with employee-like access, similar to a food inspector; other companies have agreed to adopt this.
  • Cooperate across the industry to set standards and modulate the pace of progress.
  • Cooperate globally between governments to set international standards.

Three Ideas for the Security Council

  • Begin with narrow agreements every member can support, such as a ban on using AI to make biological weapons.
  • Build evaluation and verification systems so states have visibility into frontier model capability and can verify each other's commitments.
  • Establish common global standards for testing AI models for loss of control and misuse risks, plus a notification system for AI incidents significant to global security.

Conclusion

  • Amodei calls this the most important global security issue facing the world today and urges members to set aside differences; no leader, company, or nation can manage it alone.

Text from the video's own captions. Summary and notes written by AI from the transcript, so check anything important against the recording.

Transcribe another link

A YouTube video or a podcast episode becomes a page like this one.

  • YouTube
  • Spotify
  • Apple Podcasts
  • Audio or video link
No captions? We transcribe the audio.
Anthropic CEO Amodei warns UN Security Council on AI risks — transcript & summary · Blumify