Artwork

Indhold leveret af IVANCAST PODCAST. Alt podcastindhold inklusive episoder, grafik og podcastbeskrivelser uploades og leveres direkte af IVANCAST PODCAST eller deres podcastplatformspartner. Hvis du mener, at nogen bruger dit ophavsretligt beskyttede værk uden din tilladelse, kan du følge processen beskrevet her https://da.player.fm/legal.
Player FM - Podcast-app
Gå offline med appen Player FM !

Physics of AI: Unlocking the Laws Behind Next-Token Prediction

17:46
 
Del
 

Manage episode 457078592 series 3351512
Indhold leveret af IVANCAST PODCAST. Alt podcastindhold inklusive episoder, grafik og podcastbeskrivelser uploades og leveres direkte af IVANCAST PODCAST eller deres podcastplatformspartner. Hvis du mener, at nogen bruger dit ophavsretligt beskyttede værk uden din tilladelse, kan du følge processen beskrevet her https://da.player.fm/legal.

Welcome to another episode of the SHIFTERLABS Podcast, where we transform cutting-edge research into accessible insights using Google Notebook LM. This time, we explore the fascinating intersection of physics and AI through the groundbreaking paper Physics in Next-Token Prediction.

What if intelligence in auto-regressive models like ChatGPT was simply a transfer of information governed by physical laws? Discover the First and Second Laws of Information Capacity, which reveal how data compression, entropy, and energy consumption shape the emergence of intelligence. We’ll also dive into the practical implications of these laws, from optimizing AI training to understanding the limits of energy efficiency in computing.

Join us as we demystify the principles that connect physics and AI, bringing clarity to the science behind next-token prediction. Get ready for a thought-provoking journey into the mechanics of intelligence itself!

  continue reading

100 episoder

Artwork
iconDel
 
Manage episode 457078592 series 3351512
Indhold leveret af IVANCAST PODCAST. Alt podcastindhold inklusive episoder, grafik og podcastbeskrivelser uploades og leveres direkte af IVANCAST PODCAST eller deres podcastplatformspartner. Hvis du mener, at nogen bruger dit ophavsretligt beskyttede værk uden din tilladelse, kan du følge processen beskrevet her https://da.player.fm/legal.

Welcome to another episode of the SHIFTERLABS Podcast, where we transform cutting-edge research into accessible insights using Google Notebook LM. This time, we explore the fascinating intersection of physics and AI through the groundbreaking paper Physics in Next-Token Prediction.

What if intelligence in auto-regressive models like ChatGPT was simply a transfer of information governed by physical laws? Discover the First and Second Laws of Information Capacity, which reveal how data compression, entropy, and energy consumption shape the emergence of intelligence. We’ll also dive into the practical implications of these laws, from optimizing AI training to understanding the limits of energy efficiency in computing.

Join us as we demystify the principles that connect physics and AI, bringing clarity to the science behind next-token prediction. Get ready for a thought-provoking journey into the mechanics of intelligence itself!

  continue reading

100 episoder

Alle episoder

×
 
Loading …

Velkommen til Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Hurtig referencevejledning

Lyt til dette show, mens du udforsker
Afspil