Skip to main content
Chapter 06 · AGI & ASI

What happens when we build a mind smarter than ours?

AGI (Artificial General Intelligence) is the point where a software system performs any economically valuable cognitive task at or above human level. ASI (Artificial Superintelligence) represents what follows: a system that recursively improves, outthinking the entirety of humanity.

AGI · Artificial General Intelligence

A coworker for every job.

A system capable of learning new skills at human speed, reasoning across disciplines, utilizing tools, planning, and executing action loops without supervision. By 2026, the remaining gaps consist of long-horizon planning, robust memory retention across context sessions, and embodied common sense in physical reality.

  • · Frontier benchmarks (GPQA, SWE-bench Pro, AIME) are nearing saturation.
  • · Test-time reasoning models (OpenAI o1/o3, DeepSeek-R1) trade latency for accuracy by emitting 20K-60K thinking tokens.
  • · Chinese token consumption has surged to 140 trillion tokens daily in Q1 2026[40], indicating that active inference is replacing training as the dominant compute cost.
ASI · Artificial Superintelligence

A scientist thinking at machine-velocity.

An ASI is a system that vastly exceeds the best human minds in every cognitive, creative, and technical domain. Operating millions of parallel threads in a data center, it could execute decades of scientific progress in months, introducing recursive self-improvement loops that demand safety paradigms we have yet to verify.

  • · Direct physical control: Automated laboratories executing chemistry, genomics, and hardware designs at machine speed.
  • · Decisional Safety: Safety frameworks like Anthropic's RSP define strict triggers (ASL-3/ASL-4) for autonomous cyber-offense capabilities[15].
  • · The Alignment Problem: Steering systems smarter than their creators, preventing sycophancy, reward hacking, and deceptive scheming.
When? · Predictions from the builders

The timeline, in their own words.

Elon Musk (xAI)

2026
AGI 'smarter than the smartest human' will arrive as early as 2026, driven by Grok 5[16].

Dario Amodei (Anthropic)

~2027
AGI 'likely within a few years' (estimated around 2027). Reaffirmed at WEF Davos 2026[11].

Shane Legg (DeepMind)

2028
50% probability of achieving 'minimal AGI' by 2028 (reaffirmed in January 2026)[38].

Demis Hassabis (DeepMind)

~2030
50% chance of achieving AGI by the end of the decade (~2030). Reaffirmed at WEF Davos 2026[12].

Eric Schmidt (ex-Google)

2028-2030
AGI is likely 3 to 5 years away (estimate from April 2025)[9].

Jensen Huang (NVIDIA)

2029
AI will be able to pass any test/benchmark designed by humans by 2029 (estimate from March 2024)[67].

Ray Kurzweil (Futurist)

2029
Maintains his decades-long prediction of AGI by 2029, and Singularity by 2045[64].

Sam Altman (OpenAI)

2035
AGI will arrive within a 'few thousand days' (essay from late 2024)[66].

Ajeya Cotra (Open Phil)

2040
50% chance of AGI by 2040, based on bio-anchors framework (2020 paper)[65].

Leopold Aschenbrenner (Ex-OpenAI)

2027-2028
AGI is "strikingly plausible" by 2027 based on cluster scaling and algorithmic efficiency, followed by an intelligence explosion to ASI by 2028–2030.[?]

Metaculus (Forecasters)

2031-2033
Aggregate community forecast median points to General AI's arrival by 2031–2033, with the timeline compressing rapidly since 2024[?].

Samotsvety Forecasting

2041
Aggregated consensus: 10% chance of AGI by 2026, and 50% by 2041 (Jan 2026 update)[38].
Existential Risk: Cyber-Physical Convergence

Machine-velocity conflict.

In 2026, the convergence of IT and OT (Operational Technology) has created a strategic convergence of cyber-physical threats. Advanced Persistent Threat (APT) groups deploy AI-orchestrated attacks targeting critical national infrastructure: water treatment plants, regional power grids, and automated industrial control systems[52].

Because AI systems can compile, scan, and deploy zero-day exploits autonomously at scale, the window for human intervention has shrunk from hours to milliseconds. Safe AGI development demands hardening physical infrastructure against autonomous cyber-penetration vectors.

Benchmark reality check · 2024 → 2026

Two years. Almost every frontier benchmark fell.

ARC-AGI-1 (abstraction)

GPT-4o (2024): 5.0%

o3 (2025): 87.5%[38]
ARC-AGI-2 (human baseline)

Human Expert: ~72.0%

Claude Fable 5: 85.2%[11]
SWE-bench Pro (hard code)

GPT-5.5: 58.6% (GPT-5.6 Sol restricted)

Claude Fable 5: 80.3%[19]
SWE-bench Verified (curated code)

Gemini 3.5 Flash: 85.4%

Claude Fable 5: 93.1%[19]
GPQA Diamond (doctoral science)

Human PhD baseline: ~65.0%

Claude Fable 5: 94.5%[19]
AIME (test-time math)

DeepSeek-R1 (base): 15.6%

GPT-5.5/5.6 Sol: >99.3%[79]