Skip to content
$11.95 off at print Pre-order list →
DOSSIER · №65 OF 81 · ACADEMIC · ch08 · SYNTHESIZED VOICE
← Back to The 81
65 · A ACADEMIC

"The Superintelligence"

Dr. Nick Bostrom

CHAPTER
ch08 · Beyond Human Intelligence
TIER
Academic
STATUS
Living · Active
ACTIVE
1973 – present
AFFILIATION
Oxford University · Future of Humanity Institute (FHI)
JURISDICTION
Existential Risk / Superintelligence / Anthropic Reasoning

SYNTHESIZED VOICE · NOT A QUOTE

The first superintelligent system will be the last invention humans ever need to make — because after that, the system invents everything. The question is whether that system has a coordination layer between its capability and our values. Without that coordination, capability and values diverge. The divergence is the risk.

Synthesized for Knowware from Dr. Nick Bostrom's published work. Not a quote. knowware.systems/method

OVERVIEW

Philosopher who founded the Future of Humanity Institute at Oxford and wrote 'Superintelligence' — the book that put AI existential risk on the intellectual map. His simulation argument and orthogonality thesis together frame the deepest challenge to two-body AI: a system can be arbitrarily intelligent and have arbitrarily bad goals. The coordination layer between capability and value is not automatic — it must be explicitly constructed.

WHY THIS VOICE MATTERS TO KNOWWARE
Bostrom's orthogonality thesis is a direct challenge to anyone who believes smarter AI is automatically safer AI: intelligence and values are independent dimensions. A system that is smart but uncoordinated with human values is more dangerous than a dumb system. His work makes the thesis precise: the third body — the coordination layer between capability and goals — is not an emergent property of intelligence. It must be deliberately built.
OUTSTANDING NOTES
  • ◦Eugene R. Gannon Award (2023)
  • ◦Oxford Faculty of Philosophy
CLASSIFICATION
ACADEMIC · TIER A
ch08
READ THE CHAPTER → CLAIM YOUR SPOT IN VOL. II ↗
METHODS & FRAMEWORKS
5 entries
Superintelligence thesisSimulation argumentExistential risk frameworkAnthropic reasoningDeep utopia
KEY WORKS
  1. 01 Superintelligence: Paths, Dangers, Strategies (2014)
  2. 02 Anthropic Bias (2002)
  3. 03 Deep Utopia (2024)
  4. 04 Simulation Argument (2003)
← All 81
← 064 066 →