Artwork

Indhold leveret af Igor Melnyk. Alt podcastindhold inklusive episoder, grafik og podcastbeskrivelser uploades og leveres direkte af Igor Melnyk eller deres podcastplatformspartner. Hvis du mener, at nogen bruger dit ophavsretligt beskyttede værk uden din tilladelse, kan du følge processen beskrevet her https://da.player.fm/legal.
Player FM - Podcast-app
Gå offline med appen Player FM !

Linearizing Large Language Models

13:19
 
Del
 

Manage episode 418027466 series 3524393
Indhold leveret af Igor Melnyk. Alt podcastindhold inklusive episoder, grafik og podcastbeskrivelser uploades og leveres direkte af Igor Melnyk eller deres podcastplatformspartner. Hvis du mener, at nogen bruger dit ophavsretligt beskyttede værk uden din tilladelse, kan du følge processen beskrevet her https://da.player.fm/legal.

Linear transformers offer a subquadratic-time alternative to softmax attention, but face scaling issues. SUPRA proposes uptraining existing large transformers into RNNs for cost-effective performance.

https://arxiv.org/abs//2405.06640

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

  continue reading

1137 episoder

Artwork
iconDel
 
Manage episode 418027466 series 3524393
Indhold leveret af Igor Melnyk. Alt podcastindhold inklusive episoder, grafik og podcastbeskrivelser uploades og leveres direkte af Igor Melnyk eller deres podcastplatformspartner. Hvis du mener, at nogen bruger dit ophavsretligt beskyttede værk uden din tilladelse, kan du følge processen beskrevet her https://da.player.fm/legal.

Linear transformers offer a subquadratic-time alternative to softmax attention, but face scaling issues. SUPRA proposes uptraining existing large transformers into RNNs for cost-effective performance.

https://arxiv.org/abs//2405.06640

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

  continue reading

1137 episoder

Todos os episódios

×
 
Loading …

Velkommen til Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Hurtig referencevejledning