Introducing Gemini 2.0: A New Generation of Robotics

Since its launch last year, Gemini 2.0 has been successfully integrated into various Google products, including a new AI Mode chatbot. Now, Google DeepMind is leveraging this technology to develop innovative robotics solutions. On Wednesday, the AI lab announced two new Gemini-based models designed to "lay the foundation for a new generation of helpful robots."

Gemini Robotics: Enhancing Robot Capabilities

The first model, Gemini Robotics, was created to facilitate direct control of robots. According to DeepMind, AI systems for robots need to excel in three key areas: generality, interactivity, and dexterity. Generality refers to a robot’s ability to adapt to novel situations, while interactivity encompasses its capacity to respond to people and the environment. Dexterity, on the other hand, involves fine motor skills that are challenging for robots to master.

Advancements in Robotics

DeepMind claims that Gemini Robotics represents a significant step forward in performance on all three axes, bringing us closer to truly general-purpose robots. For instance, with Gemini Robotics powering it, DeepMind’s ALOHA 2 robot can fold origami, close a Ziploc bag, and understand instructions given in natural language. The two-armed robot can even complete tasks despite encountering obstacles, such as when the researcher moves around the Tupperware it was asked to place fruit inside.

Partnerships and Future Developments

Google is collaborating with Apptronik, the company behind the Apollo bipedal robot, to build the next generation of humanoid robots. Additionally, DeepMind is releasing Gemini Robotics-ER (embodied reasoning), which will enable roboticists to run their own programs using Gemini’s advanced reasoning abilities. The company is providing "trusted testers," including former Google subsidiary Boston Dynamics, with access to the system.

As seen in the video shared by Google, the ALOHA 2 robot demonstrates its capabilities in a real-world setting, showcasing the potential of Gemini Robotics in enhancing robot capabilities and paving the way for a new generation of helpful robots.