Google Launches Guided Vision in Gemini Live for Accessibility

Google has officially launched Guided Vision within Gemini Live, a new accessibility feature designed to deliver voice-driven, real-time visual interpretation for blind, low-vision, and mobility-challenged users across compatible Android devices. The rollout transforms the Gemini app into an interactive visual companion that aids daily navigation and environmental interaction, marking a significant step forward in conversational AI accessibility. The capability was developed in close partnership with the accessibility community, notably through a strategic collaboration with Aira. Training data was refined over tens of thousands of hours, with more than 1,000 members of Aira’s Trusted Tester network stress-testing the model across routine scenarios. Aira specialists also co-developed safety guardrails to ensure reliable and context-aware responses. Users activate Guided Vision by sharing their camera feed during a Gemini Live session, enabling the AI to provide spoken descriptions of surroundings, answer follow-up queries, and issue proactive verbal cues to optimize framing. Guided Vision addresses practical, everyday challenges by offering intuitive visual verification. The system assists users in reading fine print on nutrition labels or appliance dials, locating misplaced items like earbuds in cluttered spaces, and analyzing object attributes such as color, pattern, or shape. It also generates descriptive overviews of unfamiliar layouts or tabletop arrangements. To accommodate global user bases, the feature supports multilingual interactions, with extensive testing conducted across India, Brazil, Singapore, Indonesia, Japan, and other regions to ensure culturally and linguistically natural responses. Beyond the core accessibility demographic, the functionality also benefits older adults and individuals with low literacy or visual strain in low-light conditions. Integration into the Android ecosystem prioritizes minimal friction, requiring only that devices run Android 9 or higher and operate within supported geographic and language markets. Both the Gemini application and underlying system software must be updated to the latest versions to activate the feature. Google emphasizes that Guided Vision remains an assistive utility rather than a certified medical device or replacement for traditional mobility aids. The company explicitly advises against using the tool for safe-travel guidance or obstacle detection, reinforcing that users should continue relying on established navigation practices and physical assistance tools. The launch underscores a broader strategic push by Google to expand digital and physical accessibility across the Android platform, leveraging generative AI to bridge visual information gaps while maintaining responsible deployment standards.