August 23, 2024
27
min LISTEN

Google DeepMind Research Director Dr. Martin Riedmiller

Martin is a former University Professor and renowned Research Scientist at Google DeepMind. His work focuses on advancing the field of artificial intelligence through deep reinforcement learning. We discuss what reinforcement learning does differently in executing complex tasks, overcoming feedback loops in reinforcement learning, the pitfalls of typical agent-based learning methods, and how being a robotic soccer champion exposed the value of deep learning. We unpack the advantages of deep learning over modeling agent approaches, how finding a solution can inspire a solution in an unrelated field, and why he is currently focusing on data efficiency.

Listen and Subscribe

<iframe height="200px" width="100%" frameborder="no" scrolling="no" seamless src="https://player.simplecast.com/0d606250-cc8a-481e-a6c5-7ab6b2224f6c?dark=true"></iframe>

Episode Notes

Martin shares what reinforcement learning does differently in executing complex tasks, overcoming feedback loops in reinforcement learning, the pitfalls of typical agent-based learning methods, and how being a robotic soccer champion exposed the value of deep learning. We unpack the advantages of deep learning over modeling agent approaches, how finding a solution can inspire a solution in an unrelated field, and why he is currently focusing on data efficiency. Gain insights into the trade-offs between exploration and exploitation, how Google DeepMind is leveraging large language models for data efficiency, the potential risk of using large language models, and much more.

Key Points From This Episode:

  • What it is like being a five times world robotic soccer champion.
  • The process behind training a winning robotic soccer team.
  • Why standard machine learning tools could not train his team effectively.
  • Discover the challenges AI and machine learning are currently facing.
  • Explore the various exciting use cases of reinforcement learning.
  • Details about Google DeepMind and the role of him and his team.
  • Learn about Google DeepMind’s overall mission and its current focus.
  • Hear about the advantages of being a scientist in the AI industry.
  • Martin explains the benefits of exploration to reinforcement learning.
  • How data mining using large language models for training is implemented.
  • Ways reinforcement learning will impact people in the tech industry.
  • Unpack how AI will continue to disrupt industries and drive innovation.

Quotes:

“You really want to go all the way down to learn the direct connections to actions only via learning [for training AI].” — Martin Riedmiller [0:07:55]

“I think engineers often work with analogies or things that they have learned from different [projects].” — Martin Riedmiller [0:11:16]

“[With reinforcement learning], you are spending the precious real robots time only on things that you don’t know and not on the things you probably already know.” — Martin Riedmiller [0:17:04]

“We have not achieved AGI (Artificial General Intelligence) until we have removed the human completely out of the loop.” — Martin Riedmiller [0:21:42]

Links Mentioned in Today’s Episode:

Martin Riedmiller

Martin Riedmiller on LinkedIn

Google DeepMind

RoboCup

How AI Happens

RESOURCES

Related Podcast Episodes

PODCAST
29
MIN LISTEN

Google Cloud's VP Global AI Business Philip Moyer

Whether you’re an individual or an organization, the recent advancements in AI are bound to have left you with a few mixed feelings: from concerns over the unanticipated harms that could arise with this new technology, to excitement for all the opportunities it could bring. Joining us today to explore this topic is Philip Moyer, VP of Google Cloud's Global AI Business.

Listen Now
PODCAST
MIN LISTEN

Making AI Development Global with Google’s Laurence Moroney

Listen Now
PODCAST
22
MIN LISTEN

Meta VP of AI Research Joelle Pineau

Joelle explains how she ended up at Meta and what her role as VP of AI Research entails before telling us what fascinated her most about AI robotics, why elegance is a key factor in her work, how asking the right questions opens the right doors, and the FRESCO philosophy that forms the foundation off of which Joelle makes all her business decisions.

Listen Now
PODCAST
MIN LISTEN

Sama CEO Wendy Gonzalez on Upskilling Talent from Developing Nations

Listen Now