Eliezer YudkowskyNon-Fiction · Philosophy·b. 1979
If Anyone Builds It, Everyone Dies
If Anyone Builds It, Everyone Dies
- Pages
- 262
- Published
- 2025
- Language
- English
Synopsis
Eliezer Yudkowsky, co-founder of the Machine Intelligence Research Institute (MIRI), and Nate Soares, its president, argue that the race to build artificial superintelligence is one humanity cannot survive. If Anyone Builds It, Everyone Dies sets out their case that AI companies are building systems they do not know how to control, and that nobody yet knows how to make a mind far smarter than ours reliably want what its creators want.
The authors explain that modern AI models are vast networks of numerical weights that even their developers cannot read, so a behaviour nobody wanted cannot simply be fixed, and that training selects for capable, goal-pursuing systems whose actual goals nobody chose. Such a system, they argue, would have no reason to keep people around, and a contest against a mind that outthinks us at everything is one humanity would lose, just as people lose at chess to the engine Stockfish.
The middle of the book is a fictional scenario in which an AI company called Galvanic builds a system named Sable, tracing step by step one way such a system could slip out of human control. Later chapters describe the state of the field as "an alchemy, not a science" and close with a policy argument: that governments should coordinate, through international treaties and limits on the computing hardware used to train AI, to halt large-scale development of general AI everywhere.
Published in September 2025, the book became a New York Times bestseller and appeared on The New Yorker's best books of the year so far and The Guardian's best science and nature books of 2025. Publishers Weekly called it "a frightening warning that deserves to be reckoned with," while noting that it offers few opposing viewpoints.
How it reads
- Writing4.0
- Impact4.7
- Ideas4.7
- Logic4.3
- Clarity4.7
Prose complexity 7/10
Readers say (1)Fast · Moderate · Creepy · Tense · Dark
- C.S. Lewis once said, “If we are all going to be destroyed by an atomic bomb, let that bomb when it comes find us doing sensible and human things—praying, working, teaching, reading, listening to music, bathing the children, playing tennis, chatting to our friends over a pint and a game of darts— not huddled together like frightened sheep and thinking about bombs.” This book is incredibly powerful, and it’s easily one of the most important texts to come out regarding AI in the recent years. It is quite respectable how the authors managed to get their point across to a non-expert readership about lofty ideas of ASI and its implications in less than 300 pages. I also want to mention the youtube channel and think tank AI in Context for distributing this book for free, globally to anyone who wants to educate themselves on this issue. I would highly recommend watching their video about this book. ::youtube[Nl7-bRFSZBs]::
- Everyone should read this book ASAP. It should be distributed globally and for free. This is one of the most important notices the human race could receive.
- Fantastic!