Gemini Live Gets Smarter with Visual Guidance and Deeper Google App Integrations for a More Natural, Helpful Assistant Experience

Gemini Live is evolving into a more helpful, natural, and visually aware assistant, designed to be a seamless part of your daily life. Our vision is for Gemini to become a universal AI assistant that understands your world, helps you complete tasks, and supports your curiosity—anytime, anywhere. Launched last year with the Pixel 9, Gemini Live enables natural, back-and-forth conversations that feel intuitive and fluid. Since its debut, we’ve been rapidly enhancing Gemini Live with new languages, expanded global availability, and deeper integration with your favorite apps. Now, we’re taking it a step further with powerful new upgrades that make Gemini more visually aware, expressive, and connected to the tools you use every day. One of the most significant improvements is real-time visual guidance. When you share your camera or screen with Gemini Live, it doesn’t just see what’s in front of you—it can now highlight and point out specific elements directly on your display. This visual feedback transforms how you learn and solve problems together. For example, if you're fixing a piece of furniture, Gemini can guide you by circling the correct screw or showing where to place a part, all in real time. This feature will debut on the Pixel 10 series when they launch on August 28 and will roll out to other Android devices starting that week. iOS support will follow in the coming weeks. Gemini Live is also becoming more deeply integrated with Google’s ecosystem. A true AI assistant doesn’t just answer questions—it helps you manage your life. Now, Gemini can interact with your apps in a natural, conversational way. Need to plan your week? Talk to Gemini about your Google Calendar, and ask it to create a reminder in Google Tasks to pick up your prescription before the pharmacy closes. Planning dinner? Ask Gemini to add all the ingredients to a new shopping list in Google Keep. These integrations with Calendar, Keep, and Tasks are available now. Upcoming updates will bring in Messages, Phone, and Clock, along with enhanced capabilities in Google Maps. For instance, if you’re brainstorming birthday gift ideas with Gemini and find the perfect one, you can say, “That’s it! Call Dad so I can ask him to pick it up.” Gemini will make the call for you. Similarly, while navigating your commute, if you realize you’re running late, you can interrupt Gemini and say, “This route works. Send a message to Alex that I’m about 10 minutes behind.” Gemini will draft the message, and you can continue focusing on your journey. With these advancements, Gemini Live is no longer just a conversational AI—it’s a proactive partner that helps you stay on track, connect with others, and get things done, all through natural, context-aware interactions.