We're Not Ready for Superintelligence

Our second video is now out!

So is this one-sentence open letter: It calls for a ban on superintelligence until it’s demonstrably safe. A lot of you have been wondering how to take action after watching this video; if that’s you, you might want to consider adding your name. It takes about 30 seconds, and signatories so far include writers like Yuval Noah Harari, actors like Joseph Gordon-Levitt and Sir Stephen Fry, and the world’s two most cited scientists.
===
AI 2027 depicts a possible future where artificial intelligence radically transforms the world in just a few intense years. It’s based on detailed expert forecasts — but how much of it will actually happen? Are we really racing towards a choice between a planet controlled by the elite, or one where humans have lost control entirely?

My takeaway? Loss of control, racing scenarios, and concentration of power are all concerningly plausible, and among the most pressing issues the world faces.

Check out the video and the resources below, judge the scenario for yourself, and let me know in the comments: how realistic is this? What are you still confused about? What makes you feel skeptical? What do you think we can actually do about this?

*Where to find me, Aric Floyd*
Subscribe to AI in Context to get up to speed and join the conversation about AI. There’s a lot to figure out, and we might have less time than you think. It’s time to jump in.

You can also follow for skits and explainers on YouTube Shorts as well as:
TikTok:
Instagram:

This video is a production of 80,000 Hours. Find us at and subscribe to our main YouTube channel here: @eightythousandhours

*What you can do next*
To read more about what you might be able to do to help, or get involved, check out:

You can also check out the 80,000 Hours job board at

Or see what the authors of AI 2027 suggest doing next:

Or take a 2-hour course on the Future of AI:

You can tell your US or UK representatives you care about this issue in 60 seconds using this tool:

And if you just want some practical recommendations for how you and your family can get more prepared:

*Further reading and watching*
About AI 2027
Full report:
By Daniel Kokotajlo, Scott Alexander, Thomas Larsen, Eli Lifland, Romeo Dean
Update on their model:
The lead author’s change in median forecast to 2028:

For more videos about AI risk, check out:
Previous video about AI 2027:
Could AI wipe out humanity? | Most pressing problems:
Intro to AI Safety by Rob Miles:
Me on Computerphile:
For more on what it means for an AI to “seek reward”, check out my short video:

To read more about misalignment and AI risk:

To read more about why AGI by 2030 is plausible

*Chapters*
0:00 Introduction
1:15 The World in 2025
3:53 The Scenario Begins
6:07 Sidebar: Feedback Loops
7:21 China Wakes Up
10:11 Sidebar: Chain of Thought
10:52 Better-than-human Coders
11:46 Sidebar: Misalignment in the Real World
12:08 Agent-3 Deceives
15:18 Sidebar: How Misalignment Happens
17:53 The Choice
20:07 Ending A: The Race
24:08 Ending B: Slowdown
26:30 Zooming Out
29:04 The Implications
31:19 What Do We Do?
33:30 Conclusions and Resources

*Credits*
Directed and Produced by Phoebe Brooks:

Written by Phoebe Brooks and Aric Floyd

Editing, Graphics and Animation by Phoebe Brooks, Sam Watkins and Daniel Recinto:

Executive Produced by Chana Messinger

Production assistance from Charlotte Maxwell, Jack Worrall, David Erwood and Jake Morris

With special thanks to Daniel Kokotajlo, Ryan Greenblatt, Nate Soares, Max Harms, Katja Grace, Mark Beall, Seán Ó Héigeartaigh and Eli Lifland

And thanks to Bella Forristal, Arden Koehler, Ailbhe Treacy, Rob Wiblin, Sean Riley, Siliconversations, Mathematicanese, Valerie Richmond, Daria Ivanova, Sloane Siegel, Brendan Hurst, Katy Moore, Mark DeVries, Ines Fernandez, Francesca Forristal, Rob Miles, Elizabeth Cox, Drew Spartz, Petr Lebedev, Mithuna Yoganathan, Conor Barnes

source