On the limits of idealized values

Joe Carlsmith Audio

#Society #Philosophy #Joe

26:46

For many travelers, Antarctica is a bucket-list destination, a once-in-a-lifetime opportunity to touch all seven continents. In 2023, a record-breaking 100,000 tourists made the trip. But the journey begs a fundamental question: What do we risk by traveling to a place that is supposed to be uninhabited by humans? And as the climate warms, should we really be going to Antarctica in the first place? SHOW NOTES: Kara Weller: The Impossible Dilemma of a Polar Guide Marilyn Raphael: A twenty-first century structural change in Antarctica’s sea ice system Karl Watson: First Time in Antarctica Jeb Brooks : 7 Days in Antarctica (Journey to the South Pole) Metallica - Freeze 'Em All: Live in Antarctica Learn about your ad choices: dovetail.prx.org/ad-choices…

for 2 år siden 1:00:14

MP3•Episode hjem

Contra some meta-ethical views, you can't forever aim to approximate the self you would become in idealized conditions. You have to actively create yourself, often in the here and now.
Originally published in 2021. Text version here: https://joecarlsmith.com/2021/06/21/on-the-limits-of-idealized-values

63 episoder

On the limits of idealized values

Joe Carlsmith Audio

published for 2 år siden

Del

MP3•Episode hjem

63 episoder

#Society #Philosophy #Joe

Alle episoder

Joe Carlsmith Audio

1
AI for AI safety 27:51

for 5 weeks siden27:51

27:51

We should try extremely hard to use AI labor to help address the alignment problem. Text version here: https://joecarlsmith.com/2025/03/14/ai-for-ai-safety

Joe Carlsmith Audio

1
Paths and waystations in AI safety 18:07

for 6 weeks siden18:07

18:07

On the structure of the path to safe superintelligence, and some possible milestones along the way. Text version here: https://joecarlsmith.substack.com/p/paths-and-waystations-in-ai-safety

Joe Carlsmith Audio

1
When should we worry about AI power-seeking? 46:54

for 9 weeks siden46:54

46:54

Examining the conditions required for rogue AI behavior. Text version here: https://joecarlsmith.substack.com/p/when-should-we-worry-about-ai-power

Joe Carlsmith Audio

1
What is it to solve the alignment problem? 40:13

for 10 weeks siden40:13

40:13

Also: to avoid it? Handle it? Solve it forever? Solve it completely? Text version here: https://joecarlsmith.substack.com/p/what-is-it-to-solve-the-alignment

Joe Carlsmith Audio

1
How do we solve the alignment problem? 8:43

for 10 weeks siden8:43

8:43

Introduction to a series of essays about paths to safe and useful superintelligence. Text version here: https://joecarlsmith.substack.com/p/how-do-we-solve-the-alignment-problem

Joe Carlsmith Audio

1
Fake thinking and real thinking 1:18:47

for 12 weeks siden1:18:47

1:18:47

When the line pulls at your hand. Text version here: https://joecarlsmith.com/2025/01/28/fake-thinking-and-real-thinking/.

Joe Carlsmith Audio

1
Takes on "Alignment Faking in Large Language Models" 1:27:54

for 18 weeks siden1:27:54

1:27:54

What can we learn from recent empirical demonstrations of scheming in frontier models? Text version here: https://joecarlsmith.com/2024/12/18/takes-on-alignment-faking-in-large-language-models/

Joe Carlsmith Audio

1
(Part 2, AI takeover) Extended audio from my conversation with Dwarkesh Patel 2:07:33

for 29 weeks siden2:07:33

2:07:33

Extended audio from my conversation with Dwarkesh Patel. This part focuses on the basic story about AI takeover. Transcript available on my website here: https://joecarlsmith.com/2024/09/30/part-2-ai-takeover-extended-audio-transcript-from-my-conversation-with-dwarkesh-patel

Joe Carlsmith Audio

1
(Part 1, Otherness) Extended audio from my conversation with Dwarkesh Patel 3:58:38

for 29 weeks siden3:58:38

3:58:38

Extended audio from my conversation with Dwarkesh Patel. This part focuses on my series "Otherness and control in the age of AGI." Transcript available on my website here: https://joecarlsmith.com/2024/09/30/part-1-otherness-extended-audio-transcript-from-my-conversation-with-dwarkesh-patel/

Joe Carlsmith Audio

1
Introduction and summary for "Otherness and control in the age of AGI" 12:23

for 43 weeks siden12:23

12:23

This is the introduction and summary for my series "Otherness and control in the age of AGI." Text version here: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

Joe Carlsmith Audio

1
Second half of full audio for "Otherness and control in the age of AGI" 4:11:02

for 44 weeks siden4:11:02

4:11:02

Second half of the full audio for my series on how agents with different values should relate to one another, and on the ethics of seeking and sharing power. First half here: https://joecarlsmithaudio.buzzsprout.com/2034731/15266490-first-half-of-full-audio-for-otherness-and-control-in-the-age-of-agi PDF of the full series here: https://jc.gatspress.com/pdf/otherness_full.pdf Summary of the series here: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi…

Joe Carlsmith Audio

1
First half of full audio for "Otherness and control in the age of AGI" 3:07:29

for 44 weeks siden3:07:29

3:07:29

First half of the full audio for my series on how agents with different values should relate to one another, and on the ethics of seeking and sharing power. Second half here: https://joecarlsmithaudio.buzzsprout.com/2034731/15272132-second-half-of-full-audio-for-otherness-and-control-in-the-age-of-agi PDF of the full series here: https://jc.gatspress.com/pdf/otherness_full.pdf Summary of the series here: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi…

Joe Carlsmith Audio

1
Loving a world you don't trust 1:03:54

for 44 weeks siden1:03:54

1:03:54

Garden, campfire, healing water. Text version here: https://joecarlsmith.com/2024/06/18/loving-a-world-you-dont-trust This essay is part of a series I'm calling "Otherness and control in the age of AGI." I'm hoping that individual essays can be read fairly well on their own, but see here for brief text summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi…

Joe Carlsmith Audio

1
On attunement 44:14

for 1 year siden44:14

44:14

Examining a certain kind of meaning-laden receptivity to the world. Text version here: https://joecarlsmith.com/2024/03/25/on-attunement This essay is part of a series I'm calling "Otherness and control in the age of AGI." I'm hoping that individual essays can be read fairly well on their own, but see here for brief text summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi (Though: note that I haven't put the summary post on the podcast yet.)…

Joe Carlsmith Audio

1
On green 1:15:13

for 1 year siden1:15:13