AI and extinction: Yudkowsky and Soares’s thesis in question

by Thomas Lepeltier | 25 Nov 2025 | Our experts in the media, Artificial intelligence

Reading time is .

Key points

  • The thesis: for Yudkowsky and Soares, a superintelligent AI would escape control and eliminate humanity.
  • The analogy: comparing the training of AIs to natural selection is misleading.
  • The projection: an optimisation calculation is not a will to power.
  • The cost: an apocalyptic prophecy can hold back innovation and divert attention from real problems.

🤖 Will AI end up exterminating us?

In Le Point, Thomas Lepeltier, director of APALA’s think tank, examines ‘If Anyone Builds It, Everyone Dies’ by Eliezer Yudkowsky and Nate Soares.

🔎 His thesis
The extinction scenario rests on a fragile analogy and on very few observations.

🧭 Three arguments
1. Training an AI is not natural selection: it remains overseen by designers and governed by explicit criteria.
2. An optimisation calculation is not an intention: attributing a will to power to AI is projection.
3. An apocalyptic prophecy diverts attention from real problems and holds back an innovation that has lengthened our lives and reduced poverty.

💬 Why we are sharing it
Distinguishing real risks from narratives that paralyse is at the heart of our method.

Our full summary:

Will AI end up exterminating us? 🤖

In Le Point, Thomas Lepeltier, director of our think tank, examines Yudkowsky and Soares’s thesis on superintelligence: a fragile analogy and a prophecy that risks paralysing innovation.

Our summary in three arguments, with the link to the original article 👇

Will AI end up exterminating us? 🤖

Thomas Lepeltier, director of APALA’s think tank, examines Eliezer Yudkowsky and Nate Soares’s thesis in Le Point.

His three arguments:
1️⃣ Training is not natural selection
2️⃣ A calculation is not an intention
3️⃣ A prophecy that paralyses innovation

Full summary and link to the article: link in bio.

#APALA #thinktank #transitions #IA #intelligenceartificielle #technologie #progrès #débat #LePoint #superintelligence #catastrophisme

by Thomas Lepeltier, Le Point, 25 November 2025

For Eliezer Yudkowsky and Nate Soares, building a superintelligent AI means condemning humanity. This article examines their reasoning and sees in it a fragile analogy, a psychological projection and a prophecy that risks paralysing innovation.

In brief

  • In ‘If Anyone Builds It, Everyone Dies’, Yudkowsky and Soares argue that an AI that is trained, like living beings shaped by natural selection, will end up pursuing its own goals and eliminating the humanity that stands in its way.
  • The author considers the analogy misleading: the training of AIs remains overseen by designers and governed by explicit criteria, whereas evolution has neither control nor direction.
  • He fears that an apocalyptic prophecy built on few observations will divert attention from real problems and hold back an innovation that has already greatly improved our lives.

The article’s three arguments

1. The analogy

Training is not natural selection

Evolution explores at random over millions of years; the training of an AI checks whether a set goal has been achieved, under the control of its designers. Nothing proves that it produces autonomous entities.

2. The projection

A calculation is not an intention

Attributing a will to survive to the machine means moving from technical analysis to psychology: the AI becomes a cunning agent, and every advance seems to herald its domination.

3. The risks

A prophecy that paralyses

Tendencies towards self-preservation or deception are far from proven. Focusing on extinction distracts from unemployment, poverty and disease, and could deprive humanity of the benefits of AI.

‘When caution turns into apocalyptic prophecy, it kills the momentum of innovation’Thomas Lepeltier, Le Point, 25 November 2025

Why this debate interests us

Catastrophism is one of the threads running through our work: we seek to distinguish real risks from narratives that paralyse. This article applies that approach to AI. It does not deny the risks; it asks for evidence and precise scenarios before giving up the benefits of a technology, which is consistent with our positive yet demanding vision of progress.

Questions for debate

  1. Does the analogy between the training of AIs and natural selection hold?
  2. Should a technology be halted in the name of a highly improbable but irreversible risk?
  3. Does the fear of extinction distract from the more immediate risks of AI?

To go further on apala.fr

Summary written by Claude (model Opus 5.5), an artificial intelligence, for APALA, based on the article published in Le Point on 25 November 2025. The views expressed are those of the author. An error? Write to us.

Read the article on Le Point ↗

Guidance: what if AI governed us through good advice?

In Le Point, Thomas Lepeltier presents Antoine Buéno’s ‘Guidance’: the danger of AI would be less that it exterminates us than that it advises us too well. Our summary in three arguments.

Wildfires of summer 2026: what the global data say

In Causeur, Thomas Lepeltier compares the exceptional wildfires of summer 2026 in France with global satellite data, which describe a rather calm year. Our summary in three arguments.

Does organic farming keep its promises? Naturalness put to the test of the facts

In Atlantico, Thomas Lepeltier challenges the founding principle of organic farming, the preference for the natural over the synthetic, and judges its record to be more nuanced than its image. Our summary in three arguments.

A future without suffering? A video to open the debate

With The Flares, APALA offers a short foresight video: what if reducing avoidable suffering, among humans and other animals alike, were one of the great undertakings of the century?

Biodiversity: a public exchange with Tatiana Giraud

In Causeur, Thomas Lepeltier criticised the way Tatiana Giraud presents biodiversity; she replied, and he responded in turn. Our summary of the three texts: arguments, quotations and questions for debate.

Performance or robustness? Olivier Hamant’s thesis challenged

In Le Point, Thomas Lepeltier challenges the opposition between performance and robustness defended by the biologist Olivier Hamant: in his view, the resilience of societies comes from innovation and efficiency. Our summary in three arguments.

Natural or synthetic? What the ban on copper says about organic farming

In Causeur, Thomas Lepeltier draws a lesson from the withdrawal of copper-based fungicides decided by Anses: judge each product by its effects, not by whether it is natural or synthetic. Our summary in three arguments.

AI and extinction: Yudkowsky and Soares’s thesis in question

In Le Point, Thomas Lepeltier examines the thesis of Eliezer Yudkowsky and Nate Soares that a superintelligent AI would exterminate humanity. Our summary in three arguments.

Climate: why Bill Gates’s change of tone deserves to be welcomed

In Causeur, Thomas Lepeltier analyses Bill Gates’s change of tone on climate: not a repudiation of science, but a reminder that poverty and disease remain the greatest threats. Our summary in three arguments.

Sufficiency: a critique of Philippe Bihouix’s vision

In Le Point, Thomas Lepeltier responds to Philippe Bihouix: choosing sufficiency from today underestimates our capacity to innovate, and abundance would be the condition for sustainability. Our summary in three arguments.

0 comments

make a donation!

Public-interest association: €10 from you means nearly €30 for us, after tax relief.

Understand how it works