Revolutionizing Automotive AI with Small Language Models with Alok Ranjan of BOSCH

EDGE AI POD

Send us a text

Unlock the future of automotive AI with insights from Ashutosh and Guru Prashad of BOSS India, as they unravel the transformative potential of Small Language Models (SLMs) in vehicles. Discover how these compact powerhouses are reshaping the landscape of vehicular edge systems by offering customization and performance reliability, all while keeping data privacy at the forefront. Dive into the captivating interplay between SLMs and their larger counterparts, Large Language Models (LLMs), and learn how they together address domain-specific tasks and complex computations in the cloud. This episode promises to equip you with a deeper understanding of why SLMs are the secret sauce for advancing automotive AI in this data-sensitive era.
We also spotlight the remarkable optimization journey of the Tiny Llama 1.1 model. Learn about the fine-tuning process that brought about an astounding 700% improvement in throughput and a drastic reduction in model size. Uncover the fascinating world of edge deployment using devices like Pi 4B and Jetson Oren Nano, and explore the audio and chat functionalities that are setting new standards in vehicular AI. Finally, imagine the future of personalized interactions in cars, where generative AI transforms the way we communicate and engage with our vehicles and surroundings. This episode is a treasure trove of forward-thinking solutions and innovative ideas, perfect for anyone eager to explore the cutting edge of automotive AI.

Support the show

Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

Kapitler

1. Revolutionizing Automotive AI with Small Language Models with Alok Ranjan of BOSCH (00:00:00)

2. Leveraging Small Language Models in Automotive (00:00:24)

3. Automotive AI Model Benchmarking and Optimization (00:13:26)

4. Future Applications of Small Language Models (00:29:31)