Training Large Language Models To Reason In Continuous Latent Space Deep Papers podcast

Artwork

Science Tech Math Business Arize AI

Indhold leveret af Arize AI. Alt podcastindhold inklusive episoder, grafik og podcastbeskrivelser uploades og leveres direkte af Arize AI eller deres podcastplatformspartner. Hvis du mener, at nogen bruger dit ophavsretligt beskyttede værk uden din tilladelse, kan du følge processen beskrevet her https://da.player.fm/legal.

Deep Papers « »
Training Large Language Models to Reason in Continuous Latent Space

3M ago 24:58

Del

MP3•Episode hjem

Indhold leveret af Arize AI. Alt podcastindhold inklusive episoder, grafik og podcastbeskrivelser uploades og leveres direkte af Arize AI eller deres podcastplatformspartner. Hvis du mener, at nogen bruger dit ophavsretligt beskyttede værk uden din tilladelse, kan du følge processen beskrevet her https://da.player.fm/legal.

LLMs have typically been restricted to reason in the "language space," where chain-of-thought (CoT) is used to solve complex reasoning problems. But a new paper argues that language space may not always be the best for reasoning. In this paper read, we cover an exciting new technique from a team at Meta called Chain of Continuous Thought—also known as "Coconut." In the paper, "Training Large Language Models to Reason in a Continuous Latent Space" explores the potential of allowing LLMs to reason in an unrestricted latent space instead of being constrained by natural language tokens.
Read a full breakdown of Coconut on our blog

Learn more about AI observability and evaluation, join the Arize AI Slack community or get the latest on LinkedIn and X.

… continue reading

46 episoder

#Science #Tech #Math #Business #Arize AI

Artwork

Training Large Language Models to Reason in Continuous Latent Space

22 subscribers

published 3M ago

Del

MP3•Episode hjem

Indhold leveret af Arize AI. Alt podcastindhold inklusive episoder, grafik og podcastbeskrivelser uploades og leveres direkte af Arize AI eller deres podcastplatformspartner. Hvis du mener, at nogen bruger dit ophavsretligt beskyttede værk uden din tilladelse, kan du følge processen beskrevet her https://da.player.fm/legal.

LLMs have typically been restricted to reason in the "language space," where chain-of-thought (CoT) is used to solve complex reasoning problems. But a new paper argues that language space may not always be the best for reasoning. In this paper read, we cover an exciting new technique from a team at Meta called Chain of Continuous Thought—also known as "Coconut." In the paper, "Training Large Language Models to Reason in a Continuous Latent Space" explores the potential of allowing LLMs to reason in an unrestricted latent space instead of being constrained by natural language tokens.
Read a full breakdown of Coconut on our blog

Learn more about AI observability and evaluation, join the Arize AI Slack community or get the latest on LinkedIn and X.

… continue reading

46 episoder

#Science #Tech #Math #Business #Arize AI

Alle episoder

×

Velkommen til Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

Lyt til 500+ emner

Lyt til dette show, mens du udforsker