Dwarkesh Podcast

Dwarkesh Patel

139 - Reiner Pope – The math behind how LLMs are trained and served

Deeply researched interviews

www.dwarkesh.com

139 - Reiner Pope – The math behind how LLMs are trained and served

00:00

Deeply researched interviews

www.dwarkesh.com

Episodios

mié., 29 abr. 2026

mié., 15 abr. 2026

mar., 07 abr. 2026

vie., 20 mar. 2026

vie., 13 mar. 2026

mié., 11 mar. 2026

vie., 06 mar. 2026

vie., 13 feb. 2026

jue., 05 feb. 2026

mar., 30 dic. 2025

mar., 23 dic. 2025

vie., 19 dic. 2025

mar., 25 nov. 2025

mié., 12 nov. 2025

vie., 31 oct. 2025

vie., 17 oct. 2025

vie., 10 oct. 2025

sáb., 04 oct. 2025

vie., 26 sep. 2025

vie., 12 sep. 2025

vie., 05 sep. 2025

jue., 21 ago. 2025

vie., 15 ago. 2025

jue., 07 ago. 2025

vie., 25 jul. 2025

jue., 10 jul. 2025

jue., 03 jul. 2025

jue., 26 jun. 2025

jue., 19 jun. 2025

jue., 12 jun. 2025

jue., 29 mayo 2025

jue., 22 mayo 2025

jue., 01 mayo 2025

mar., 29 abr. 2025

jue., 24 abr. 2025

jue., 17 abr. 2025

jue., 03 abr. 2025

mar., 25 mar. 2025

mié., 12 mar. 2025

mié., 05 mar. 2025

mié., 19 feb. 2025

mié., 12 feb. 2025

jue., 30 ene. 2025

jue., 23 ene. 2025

jue., 16 ene. 2025

jue., 09 ene. 2025

jue., 26 dic. 2024

mié., 13 nov. 2024

mié., 02 oct. 2024

mié., 18 sep. 2024

Dwarkesh Podcast

Episodios

Reiner Pope – The math behind how LLMs are trained and served

Jensen Huang – TPU competition, why we should sell chips to China, & Nvidia’s supply chain moat

Michael Nielsen – How science actually progresses

Terence Tao – Kepler, Newton, and the true nature of mathematical discovery

Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI compute

The most important question nobody's asking about AI

Why Leonardo was a saboteur, Gutenberg went broke, and Florence was weird – Ada Palmer

Dario Amodei — "We are near the end of the exponential"

Elon Musk — "In 36 months, the cheapest place to put AI will be space”

Adam Marblestone — AI is missing something fundamental about the brain

Thoughts on AI progress (Dec 2025)

Sarah Paine — Why Russia Lost the Cold War

Ilya Sutskever — We're moving from the age of scaling to the age of research

Satya Nadella — How Microsoft is preparing for AGI

Sarah Paine — How Russia sabotaged China's rise

Andrej Karpathy — AGI is still a decade away

Nick Lane – Life as we know it is chemically inevitable

Some thoughts on the Sutton interview

Richard Sutton – Father of RL thinks LLMs are a dead end

Fully autonomous robots are much closer than you think – Sergey Levine

How Hitler almost starved Britain – Sarah Paine

Evolution designed us to die fast; we can change that — Jacob Kimmel

China is killing the US on energy. Does that mean they’ll win AGI? — Casey Handmer

Artificial meat is harder than artificial intelligence — Lewis Bollard

Sarah Paine — How Imperial Japan defeated Tsarist Russia & Qing China

Stephen Kotkin — How Stalin became the most powerful dictator in history

Why I don’t think AGI is right around the corner

A billion years of evolution in a single afternoon — George Church

Why China's manufacturing economy is dominating — Arthur Kroeber

"China is digging out of a crisis. And America’s luck is wearing thin." — Ken Rogoff

Xi Jinping’s paranoid approach to AGI, debt crisis, & Politburo politics — Victor Shih

Is RL + LLMs enough for AGI? — Sholto Douglas & Trenton Bricken

What will automated firms look like?

Mark Zuckerberg — AI will write most Meta code in 18 months

Why Rome actually fell: plagues, slavery, & ice age — Kyle Harper

AGI is still 30 years away — Ege Erdil & Tamay Besiroglu

AI 2027: month-by-month model of intelligence explosion — Scott Alexander & Daniel Kokotajlo

AMA: career advice given AGI, how I research ft. Sholto & Trenton

Joseph Henrich — Humans defeated smarter species with cultural evolution

Notes on China

Satya Nadella — Microsoft’s AGI plan & quantum breakthrough

Jeff Dean & Noam Shazeer — 25 years at Google: from PageRank to AGI

Sarah Paine — How Mao conquered China (lecture & interview)

Sarah Paine — Why Japan lost WWII (lecture & interview)

Sarah Paine — The war for India (lecture & interview)

Tyler Cowen — The #1 bottleneck to AI progress is humans

Adam Brown — Bubble universes, space elevators, & AdS/CFT

Gwern — Anonymous writer who predicted AI trajectory on $12K/year salary

@Asianometry & Dylan Patel — How the semiconductor industry actually works

Daniel Yergin — Oil destroyed Hitler, fracking destroyed Putin