Read the full transcript here.
What are the world’s leading AI companies actually trying to build when they talk about superintelligence? Is the goal merely better chatbots, or systems that could outperform all humans across every cognitive task? Why would such a system be so alluring if it could accelerate medicine, science, education, abundance, and human flourishing? Why would it also create an unprecedented concentration of power for whoever controlled it? If intelligence includes not only abstract reasoning but persuasion, strategy, manipulation, planning, and technological invention, what happens when those capacities are automated at superhuman scale? How seriously should we take AI CEOs when they say the technology could go catastrophically wrong, and how should we interpret the tension between their public concern and their continued participation in the race? If we cannot reliably inspect their goals, motives, reasoning, or learned objectives, how could we know whether apparent obedience is real safety or just surface behavior? Even if alignment were solved, who should be trusted to steer a superintelligence? Could compute governance, chip tracking, training thresholds, inspections, and a US-China agreement buy time before the frontier moves further? What do nuclear weapons, nuclear power, chemical weapons, and germline engineering teach us about the possibility and limits of technological restraint? Is resignation itself part of the danger, and could a credible movement for coordination make a saner future more possible? averages? And when injustice affects both men and women differently, what framework avoids turning that into a zero-sum argument?
Links:
MIRI
Malo Bourgon leads the Machine Intelligence Research Institute. Before becoming CEO, Malo served as a program management analyst and then as COO, helping implement many of MIRI’s current systems, processes, and program activities. Malo joined MIRI in 2012 shortly after completing a master’s degree in engineering at the University of Guelph.
Staff
Spencer Greenberg — Host + Director
Ryan Kessler — Producer + Technical Lead
WeAmplify — Transcriptionists
Igor Scaldini — Marketing Consultant
Music
Broke for Free
Josh Woodward
Lee Rosevere
Quiet Music for Tiny Robots
wowamusic
zapsplat.com
Affiliates
Clearer Thinking
GuidedTrack
Mind Ease
Positly
UpLift
[Read more]