ABAB Pedia

Nate Soares

Nate Soares is an AI safety researcher and president of the Machine Intelligence Research Institute (MIRI). He works on decision theory and AI alignment and co-authored If Anyone Builds It, Everyone Dies with Eliezer YudkowskyEliezer YudkowskyEliezer Yudkowsky is an American AI researcher and writer who in 2000 founded the organization later renamed the Machine Intelligence Research Institute (MIRI) and is regarded as an early founder of the field of AI alignment; he has long warned that superintelligence could cause human extinction and calls for a worldwide halt to large AI training runs, views that many researchers dispute.Open the full entry.

Contents17 sections
Key facts

Early Years: Upbringing and Reading

In an interview with Max Raskin, Soares recalled growing up in rural Vermont and reading science fiction including Ender’s Game and works by Vernor Vinge.⁠[1]

Education: Computer Science and Economics

He earned a BS in computer science and economics from George Washington University.⁠[2]

Early Career: Software and Research

Before joining MIRI, he worked as a software engineer at Google and Microsoft, a research associate at the National Institute of Standards and Technology (NIST), and a contractor for the US Department of Defense.⁠[3]

Joining MIRI Research

While working at GoogleGoogleGoogle is an American technology company founded by Larry Page and Sergey Brin and incorporated in 1998. It became an Alphabet subsidiary in 2015. Its businesses include internet search, advertising, software platforms, cloud computing, and artificial intelligence.Open the full entry, Soares attended his first MIRI workshop in December 2013 and joined its research team in 2014. His 2015 introduction described his work on the research agenda and technical papers.⁠[4]

Corrigibility Research

With Benja Fallenstein, Eliezer Yudkowsky and Stuart Armstrong, he co-authored Corrigibility, examining how AI systems could accept human correction or shutdown without trying to prevent or cause shutdown. The paper was accepted by the AI and Ethics workshop at AAAI 2015.⁠[5]

Becoming Executive Director

In June 2015, he succeeded Luke Muehlhauser as MIRI’s executive director. Before taking the role, he identified growing the research team as a top priority.⁠[4]

Idealized Decision Theory

He and Benja Fallenstein co-authored Toward Idealized Decision Theory, discussing limitations of conventional decision theories concerning policy selection and logical counterfactuals and identifying problems for further formalization.⁠[6]

Logical Induction

He co-authored Logical Induction, which studies how a computationally limited reasoner can assign probabilities to mathematical statements before they are proved or disproved and refine those judgments as reasoning progresses.⁠[7]

Functional Decision Theory

With Eliezer Yudkowsky, he proposed functional decision theory, treating decisions as outputs of mathematical functions and comparing the approach with causal and evidential decision theories. The work concerns formal decision theory.⁠[8]

Transition to President

On October 10, 2023, MIRI announced a leadership restructuring: Malo Bourgon became CEO, while Soares moved from executive director to president and remained a board member. Soares focused on strategy and research as MIRI increased its emphasis on public communication.⁠[9]

Book on AI Risk

On September 16, 2025, his book with Eliezer Yudkowsky, If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All, was published. The authors argue that superhuman AI poses an irreversible existential danger and that its development should be prevented; this is their position.⁠[10]

Critical Reception

In The Atlantic, Adam Becker challenged the book’s assumptions about superintelligence and argued that doomsday narratives distract from present AI harms.⁠[11]

Survey of Risk Perceptions

Risk Forecast and Personal Choices

In an October 24 interview post, Nicholas Thompson said Soares considered AI-driven human extinction by 2036 more likely than not and was not currently saving for retirement. These were Soares’s subjective risk assessment and personal choice, not an established prediction of future events.⁠[13]

Machine Consciousness

On November 1, Soares responded to Mustafa SuleymanMustafa SuleymanMustafa Suleyman is a British AI entrepreneur and CEO of Microsoft AI who co-founded DeepMind and Inflection AI.Open the full entry’s discussion of AI consciousness. He agreed that humanity was unprepared for conscious machines but expressed less confidence that none had already been built.⁠[14]

Personal Writing: Minding Our Way

He writes the personal blog Minding Our Way, including the Replacing Guilt series, and states that the blog does not represent MIRI’s views.⁠[15]

Sources

  1. Interview with Nate Soares (opens in a new window)
  2. Nate Soares: we are doomed (probably) (opens in a new window)
  3. Nate Soares (opens in a new window)
  4. Introductions (opens in a new window)
  5. New paper: “Corrigibility” (opens in a new window)
  6. Toward Idealized Decision Theory (opens in a new window)
  7. Logical Induction (opens in a new window)
  8. Functional Decision Theory: A New Theory of Instrumental Rationality (opens in a new window)
  9. Announcing MIRI’s new CEO and leadership team (opens in a new window)
  10. If Anyone Builds It, Everyone Dies (opens in a new window)
  11. The Useful Idiots of AI Doomsaying (opens in a new window)
  12. Views on AI Existential Risk Before and After a Public Event at Harvard University (opens in a new window)
  13. Nicholas Thompson on X (October 24, 2026) (opens in a new window)
  14. Nate Soares on X (November 1, 2026) (opens in a new window)
  15. About Me (opens in a new window)