The Biggest Questions About AI
The map · 5 Humanity · 5.5 Moral status and civilizational choice · 5.5.5

Desirable end state

Is the goal better tools, universal prosperity, scientific abundance, human enhancement, coexistence with digital minds, expansion beyond Earth, or something else?

The optimistic end states themselves disagree: Amodei's compressed-progress vision of solved diseases and extended lives, versus Bostrom's 'deep utopia' problem — what is left to strive for in a solved world?

View on the map → · Open in Browse →

What changed
October 2025–August 2026 · swept August 3, 2026 · editorial review pending
01

The debate about what we are aiming for sharpened around its most radical pole: 'successionism,' the view that AI should replace humanity as the morally relevant thing. New essays dissect it — separating the claim that AI should decide from the claim that AI should succeed us, and arguing the position spreads because it resolves builders' cognitive dissonance rather than because it is true. On the constructive side, several pieces map positive post-AGI visions and argue superintelligence need not require centralized control.

Recent thinking
5 featured from 6 tracked · October 2025–August 2026 · all 6 chronologically →
Rudolf Laine · No Set Gauge · 22 Jun 2026 essay
Alignment & Succession: The Ideology of Successionism
The core of both types of successionism is the idea that moral value is something abstract and divorced from anything as worldly or parochial as an ape-descended hominid.

The sharpest 2026 dissection of 'successionism': distinguishes control successionism (AI should decide) from experiential successionism (AI should replace us as the morally relevant beings) and traces both to a neo-Pythagorean view of value.

Jan Kulveit · LessWrong · 28 Oct 2025 essay
The Memetics of AI Successionism
those ideas may spread, regardless of their long-term utility for humans or truth value.

Argues successionist ideologies gain ground not because true but because they resolve the cognitive dissonance of the people building AI — a memetic-evolution account of why replacement narratives are becoming culturally successful.

Ben Norman · EA Forum · 23 Jun 2026 essay
Mapping Positive Visions of Post-AGI Futures
The question of what we should actually be aiming for has received comparatively little attention.

Organizes the scattered field of positive post-AGI visions into clusters — abundance, liberal pluralism, waypoints, cosmic bargains, preference extrapolation — arguing far more effort goes into what to avoid than what to aim for.

Boaz Barak · Windows On Theory · 16 Jul 2026 essay
All Watched Over
We could go down the path of centralized control but we don't have to do so.

Rejects the premise that superintelligence requires centralized control, arguing for a decentralized, personal-computing-style distribution of AI power as the preferable end-state — a value choice framed against the concentration discourse.

Olle Häggström · Crunch Time for Humanity · 5 Dec 2025 essay
Those who welcome the end of the human race
Personally, I would immediately say no

Catalogs the roughly five justifications AI successionists offer for accepting human extinction given a worthy successor, and argues for engaging them seriously rather than dismissing — a measured map of the pro-replacement position.

Additional relevant discussion (1)
A nightwatchman on every probe: Superintelligent surveillance to prevent galactic anarchy — Oscar Delaney and Mia Taylor · Forethought · 1 Sep 2026
Foundational reading (2)Machines of Loving GraceDario Amodei · 2024Deep Utopia: Life and Meaning in a Solved WorldNick Bostrom · 2024
Previous5.5.4 Value lock-in