Flash Forward is a show about possible (and not so possible) future scenarios. What would the warranty on a sex robot look like? How would diplomacy work if we couldn’t lie? Could there ever be a fecal transplant black market? (Complicated, it wouldn’t, and yes, respectively, in case you’re curious.) Hosted and produced by award winning science journalist Rose Eveleth, each episode combines audio drama and journalism to go deep on potential tomorrows, and uncovers what those futures might re ...
…
continue reading
Indhold leveret af Arize AI. Alt podcastindhold inklusive episoder, grafik og podcastbeskrivelser uploades og leveres direkte af Arize AI eller deres podcastplatformspartner. Hvis du mener, at nogen bruger dit ophavsretligt beskyttede værk uden din tilladelse, kan du følge processen beskrevet her https://da.player.fm/legal.
Minder om Deep Papers
DNA science. Artificial intelligence. Smartphones and 3D printers. Science and technology have transformed the world we live in. But how did we get here? It wasn’t by accident. Well, sometimes it was. It was also the result of hard work, teamwork, and competition. And incredibly surprising moments. Hosted by bestselling author Steven Johnson (“How We Got To Now”), American Innovations uses immersive scenes to tell the stories of the scientists, engineers, and ordinary people behind the great ...
…
continue reading
A myriad of AI, science, and technology experts explore the real challenges and enormous opportunities facing entrepreneurs who are building the future of health. Raising Health, a podcast by a16z Bio + Health, dives deep into the heart of biotechnology and healthcare innovation. Join veteran company builders, operators, and investors Vineeta Agarwala, Julie Yoo, and Jorge Conde, along with distinguished guests like Mark Cuban, Greg Verdine, Fei-Fei Li, and Suchi Saria, as they explore the i ...
…
continue reading
Big tech is transforming every aspect of our world. But how, and at what cost? This season of Land of the Giants – The Disney Dilemma – focuses on Disney’s ability to weather the ups and downs of the business cycle and changing tastes and explores what has kept it successful for over 100 years. The entertainment giant has leveraged nostalgia and its intellectual property to build a beloved brand, but after an acquisition spree that included Marvel, Lucasfilm, and 20th Century Fox, can it sus ...
…
continue reading
The Village Global podcast takes you inside the world of venture capital and technology, featuring enlightening interviews with entrepreneurs, investors and tech industry leaders. Learn more at www.villageglobal.vc.
…
continue reading
Whether the topic is popcorn or particle physics, you can count on BrainStuff to explore -- and explain -- the everyday science in the world around us.
…
continue reading
When you hear the words Alzheimer's disease, what do you think of? The truth is, the picture most of us have of the disease is incomplete. Alzheimer's disease doesn't start when someone starts to lose their memory. It actually starts years – sometimes decades – earlier. The Rethinking Alzheimer's Disease Podcast is an engaging, narrative-style podcast miniseries for those curious or motivated to learn about Alzheimer’s disease. Perhaps you have a family member with Alzheimer’s disease, or ca ...
…
continue reading
Audio home of The Jimquisition, featuring its lovely little podcast, Podquisition - starring Jim Sterling, Laura Kate, and Conrad Zimmerman!
…
continue reading
Alessandro Bogliari, CEO and Co-Founder of The Influencer Marketing Factory, a global influencer marketing agency, talks with great guests about influencer marketing, social media, the creator economy, social commerce and much more.
…
continue reading
Tim Harford explains - and sometimes debunks - the numbers and statistics used in political debate, the news and everyday life
…
continue reading
Player FM - Podcast-app
Gå offline med appen Player FM !
Gå offline med appen Player FM !
))
Agent-as-a-Judge: Evaluate Agents with Agents
Manage episode 451551751 series 3448051
Indhold leveret af Arize AI. Alt podcastindhold inklusive episoder, grafik og podcastbeskrivelser uploades og leveres direkte af Arize AI eller deres podcastplatformspartner. Hvis du mener, at nogen bruger dit ophavsretligt beskyttede værk uden din tilladelse, kan du følge processen beskrevet her https://da.player.fm/legal.
This week, we break down the “Agent-as-a-Judge” framework—a new agent evaluation paradigm that’s kind of like getting robots to grade each other’s homework. Where typical evaluation methods focus solely on outcomes or demand extensive manual work, this approach uses agent systems to evaluate agent systems, offering intermediate feedback throughout the task-solving process. With the power to unlock scalable self-improvement, Agent-as-a-Judge could redefine how we measure and enhance agent performance. Let's get into it!
Learn more about AI observability and evaluation, join the Arize AI Slack community or get the latest on LinkedIn and X.
59 episoder
Del
Manage episode 451551751 series 3448051
Indhold leveret af Arize AI. Alt podcastindhold inklusive episoder, grafik og podcastbeskrivelser uploades og leveres direkte af Arize AI eller deres podcastplatformspartner. Hvis du mener, at nogen bruger dit ophavsretligt beskyttede værk uden din tilladelse, kan du følge processen beskrevet her https://da.player.fm/legal.
This week, we break down the “Agent-as-a-Judge” framework—a new agent evaluation paradigm that’s kind of like getting robots to grade each other’s homework. Where typical evaluation methods focus solely on outcomes or demand extensive manual work, this approach uses agent systems to evaluate agent systems, offering intermediate feedback throughout the task-solving process. With the power to unlock scalable self-improvement, Agent-as-a-Judge could redefine how we measure and enhance agent performance. Let's get into it!
Learn more about AI observability and evaluation, join the Arize AI Slack community or get the latest on LinkedIn and X.
59 episoder
Alle episoder
×
Velkommen til Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.
Minder om Deep Papers
Flash Forward is a show about possible (and not so possible) future scenarios. What would the warranty on a sex robot look like? How would diplomacy work if we couldn’t lie? Could there ever be a fecal transplant black market? (Complicated, it wouldn’t, and yes, respectively, in case you’re curious.) Hosted and produced by award winning science journalist Rose Eveleth, each episode combines audio drama and journalism to go deep on potential tomorrows, and uncovers what those futures might re ...
…
continue reading
DNA science. Artificial intelligence. Smartphones and 3D printers. Science and technology have transformed the world we live in. But how did we get here? It wasn’t by accident. Well, sometimes it was. It was also the result of hard work, teamwork, and competition. And incredibly surprising moments. Hosted by bestselling author Steven Johnson (“How We Got To Now”), American Innovations uses immersive scenes to tell the stories of the scientists, engineers, and ordinary people behind the great ...
…
continue reading
A myriad of AI, science, and technology experts explore the real challenges and enormous opportunities facing entrepreneurs who are building the future of health. Raising Health, a podcast by a16z Bio + Health, dives deep into the heart of biotechnology and healthcare innovation. Join veteran company builders, operators, and investors Vineeta Agarwala, Julie Yoo, and Jorge Conde, along with distinguished guests like Mark Cuban, Greg Verdine, Fei-Fei Li, and Suchi Saria, as they explore the i ...
…
continue reading
Big tech is transforming every aspect of our world. But how, and at what cost? This season of Land of the Giants – The Disney Dilemma – focuses on Disney’s ability to weather the ups and downs of the business cycle and changing tastes and explores what has kept it successful for over 100 years. The entertainment giant has leveraged nostalgia and its intellectual property to build a beloved brand, but after an acquisition spree that included Marvel, Lucasfilm, and 20th Century Fox, can it sus ...
…
continue reading
The Village Global podcast takes you inside the world of venture capital and technology, featuring enlightening interviews with entrepreneurs, investors and tech industry leaders. Learn more at www.villageglobal.vc.
…
continue reading
Whether the topic is popcorn or particle physics, you can count on BrainStuff to explore -- and explain -- the everyday science in the world around us.
…
continue reading
When you hear the words Alzheimer's disease, what do you think of? The truth is, the picture most of us have of the disease is incomplete. Alzheimer's disease doesn't start when someone starts to lose their memory. It actually starts years – sometimes decades – earlier. The Rethinking Alzheimer's Disease Podcast is an engaging, narrative-style podcast miniseries for those curious or motivated to learn about Alzheimer’s disease. Perhaps you have a family member with Alzheimer’s disease, or ca ...
…
continue reading
Audio home of The Jimquisition, featuring its lovely little podcast, Podquisition - starring Jim Sterling, Laura Kate, and Conrad Zimmerman!
…
continue reading
Alessandro Bogliari, CEO and Co-Founder of The Influencer Marketing Factory, a global influencer marketing agency, talks with great guests about influencer marketing, social media, the creator economy, social commerce and much more.
…
continue reading
Tim Harford explains - and sometimes debunks - the numbers and statistics used in political debate, the news and everyday life
…
continue reading
Player FM - Podcast-app
Gå offline med appen Player FM !
Gå offline med appen Player FM !
