Google reveals Gemini Robotics 2.0, promising improved

What happened

Robots powered by Google’s Gemini AI models are now more capable. With the debut of Gemini Robotics 2, these physical bots can now accomplish more complex tasks, continuously analyze changing environments, and collaborate with other robots. This is thanks to a trio of new sub-models, one of which is publicly available for developers starting today.

Understanding is only the first step—getting the robot to move around in the physical world is the purview of another model. After mapping out the task, the vision language model hands things over to an upgraded vision-language-action known simply as Gemini Robotics 2. This AI model generates robot actions from those instructions in the same way other generative systems create text or images.

There’s also a low-latency offline version of this called Gemini Robotics On-Device 2. These models are currently limited to a small group of testers. Google says the new action models are much more accurate and efficient. Even the smaller on-device version can adapt to new robot designs with just a few hours of movement data, or around 200 examples.

The issues with AI hallucinations are well known at this point, but the potential harm from mistakes when the AI has a physical embodiment sharing space with humans could be much greater. With each release of Gemini Robotics, Google DeepMind has stressed that it takes this risk seriously. ” With the release of Gemini Robotics 2, there’s a new safety benchmark called ASIMOV-Agentic.

Why it matters

Videos of robots running, dancing, and backflipping have been a staple of the Internet for years, but these machines were programmed to perform these very narrow tasks. The goal of Gemini robotics is to create a generalist robot, one that can do anything a human could do. ” Essentially, you tell a robot what to do, and it does it.

0 release, Google says its robotics AI can control an entire humanoid robot with improved dexterity, even for machines with complex humanoid hands. 6 release. It’s integrated with the Gemini Live API, giving developers the opportunity to experience that supposed leap forward. Gemini Robotics ER 2 is what’s known as a vision language model (VLM). It’s designed to understand instructions and the world around it.

The big upgrade here is that ER 2 can process live video feeds from the robot’s cameras, allowing the system to track progress as the robot lumbers from one step to the next. Google notes that Gemini Robotics ER 2 can classify video frame completeness with almost 60 percent accuracy. 6 release or what you can get with the visual understanding of competing AI models.

Finding specific moments in video feeds is also key to completing a task correctly. When you ask a robot to pour a cup of coffee, you definitely want it to know when to stop pouring. ER 2 apparently does this much better, identifying key moments with almost 90 percent accuracy. As the robots execute multi-step tasks, the embodied reasoning model allows them to understand failures in real time.

The system can then attempt that single step again rather than going back to the start. For example, the robot can just readjust its hand position and motion if a ball it’s trying to pick up rolls away or someone moves a container. The new embodied reasoning release is also what gives Google DeepMind’s upgraded robot AI the ability to collaborate.

The video demos show Apptronik’s Apollo 2 and the simpler Franka F3 Duo working together on a task without getting in each other’s way. While the test robots still can’t match the speed or grace of a human, the video demos include plenty of real-time footage of the robots in action, and they do seem much less hesitant than they were in past tests.

What to watch

This test evaluates models across a variety of safety factors. It can assess whether an embodied reasoning agent will refuse unsafe tool calls from a VLA. It can also determine whether a given task is possible to complete safely, as well as whether the model is able to call for human assistance if it’s unsure about safety.

Google DeepMind notes that Gemini Robotics ER 2 is the team’s safest model yet, showing robust ability to understand safety and halt actions when a human is too close to the robot. Google’s new safety benchmark is available in its entirety on Hugging Face.