How Apache Kafka Got Faster By Switching Ext4 To XFS The Backend Engineering Show With Hussein Nasser podcast

Artwork

Hussein Nasser Engineering Business Industries Open Source Programming Tech Software Development

Indhold leveret af Hussein Nasser. Alt podcastindhold inklusive episoder, grafik og podcastbeskrivelser uploades og leveres direkte af Hussein Nasser eller deres podcastplatformspartner. Hvis du mener, at nogen bruger dit ophavsretligt beskyttede værk uden din tilladelse, kan du følge processen beskrevet her https://da.player.fm/legal.

The Backend Engineering Show with Hussein Nasser « »
How Apache Kafka got faster by switching ext4 to XFS

1+ y ago 33:52

Del

M4A•Episode hjem

Indhold leveret af Hussein Nasser. Alt podcastindhold inklusive episoder, grafik og podcastbeskrivelser uploades og leveres direkte af Hussein Nasser eller deres podcastplatformspartner. Hvis du mener, at nogen bruger dit ophavsretligt beskyttede værk uden din tilladelse, kan du følge processen beskrevet her https://da.player.fm/legal.

https://oscourse.win

Allegro improved their Kafka produce tail latency by over 80% when they switched from ext4 to xfs. What I enjoyed most about this article is the detailed analysis and tweaking the team made to ext4 before considering switching to xfs. This is a classic case of how a good tech blog looks like in my opinion.

0:00 Intro

0:30 Summary

2:35 How Kafka Works?

5:00 Producers Writes are Slow

7:10 Tracing Kafka Protocol

12:00 Tracing Kernel System Calls

16:00 Journaled File Systems

21:00 Improving ext4

26:00 Switching to XFS

Blog

https://blog.allegro.tech/2024/03/kafka-performance-analysis.html

… continue reading

536 episoder

#Hussein Nasser #Engineering #Business #Industries #Open Source #Programming #Tech #Software Development

Artwork

How Apache Kafka got faster by switching ext4 to XFS

The Backend Engineering Show with Hussein Nasser

215 subscribers

published 1+ y ago

Del

M4A•Episode hjem

Indhold leveret af Hussein Nasser. Alt podcastindhold inklusive episoder, grafik og podcastbeskrivelser uploades og leveres direkte af Hussein Nasser eller deres podcastplatformspartner. Hvis du mener, at nogen bruger dit ophavsretligt beskyttede værk uden din tilladelse, kan du følge processen beskrevet her https://da.player.fm/legal.

https://oscourse.win

Allegro improved their Kafka produce tail latency by over 80% when they switched from ext4 to xfs. What I enjoyed most about this article is the detailed analysis and tweaking the team made to ext4 before considering switching to xfs. This is a classic case of how a good tech blog looks like in my opinion.

0:00 Intro

0:30 Summary

2:35 How Kafka Works?

5:00 Producers Writes are Slow

7:10 Tracing Kafka Protocol

12:00 Tracing Kernel System Calls

16:00 Journaled File Systems

21:00 Improving ext4

26:00 Switching to XFS

Blog

https://blog.allegro.tech/2024/03/kafka-performance-analysis.html

… continue reading

536 episoder

#Hussein Nasser #Engineering #Business #Industries #Open Source #Programming #Tech #Software Development

すべてのエピソード

×

Velkommen til Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

Lyt til 500+ emner

Lyt til dette show, mens du udforsker