Google DeepMind Research Director Dr. Martin Riedmiller

How AI Happens

Martin shares what reinforcement learning does differently in executing complex tasks, overcoming feedback loops in reinforcement learning, the pitfalls of typical agent-based learning methods, and how being a robotic soccer champion exposed the value of deep learning. We unpack the advantages of deep learning over modeling agent approaches, how finding a solution can inspire a solution in an unrelated field, and why he is currently focusing on data efficiency. Gain insights into the trade-offs between exploration and exploitation, how Google DeepMind is leveraging large language models for data efficiency, the potential risk of using large language models, and much more.

Key Points From This Episode:

• What it is like being a five times world robotic soccer champion.
• The process behind training a winning robotic soccer team.
• Why standard machine learning tools could not train his team effectively.
• Discover the challenges AI and machine learning are currently facing.
• Explore the various exciting use cases of reinforcement learning.
• Details about Google DeepMind and the role of him and his team.
• Learn about Google DeepMind’s overall mission and its current focus.
• Hear about the advantages of being a scientist in the AI industry.
• Martin explains the benefits of exploration to reinforcement learning.
• How data mining using large language models for training is implemented.
• Ways reinforcement learning will impact people in the tech industry.
• Unpack how AI will continue to disrupt industries and drive innovation.

Quotes:

“You really want to go all the way down to learn the direct connections to actions only via learning [for training AI].” — Martin Riedmiller [0:07:55]

“I think engineers often work with analogies or things that they have learned from different [projects].” — Martin Riedmiller [0:11:16]

“[With reinforcement learning], you are spending the precious real robots time only on things that you don’t know and not on the things you probably already know.” — Martin Riedmiller [0:17:04]

“We have not achieved AGI (Artificial General Intelligence) until we have removed the human completely out of the loop.” — Martin Riedmiller [0:21:42]

Links Mentioned in Today’s Episode:

Martin Riedmiller

Martin Riedmiller on LinkedIn

Google DeepMind

RoboCup

How AI Happens

Sama