• Home
• Technology

Google has expanded the accessibility capabilities of Gemini Live with a new feature called Guided Vision, designed to help blind and visually impaired people interpret information captured by their smartphone cameras.
The feature provides real-time spoken descriptions that can help users read small text, identify objects and understand details in their immediate surroundings.

Guided Vision Turns the Smartphone Camera Into an AI Assistant

Starting October 3, 2026, Guided Vision is available on compatible Android devices that support Gemini Live.
Users can share their camera view with Gemini and ask the AI to describe objects in front of them, identify nearby items or provide specific details about something visible through the camera.
The feature also supports follow-up questions. For instance, after Gemini helps a user locate a particular product, the user can ask it to read information such as the product’s expiration date.

Audio Guidance Helps Locate Objects Outside the Camera View

Guided Vision can also assist when an object is not currently visible within the camera frame.
In such cases, Gemini can provide spoken directions to help the user move the phone toward the location where the object is positioned.
The feature is also integrated with Google TalkBack, Android’s accessibility service, allowing users to access it through the system’s accessibility settings.
On devices running Android 9 or later, users can also configure a shortcut for quicker access through the Settings application.

Google’s Feature Mirrors Existing Accessibility Technology

Guided Vision follows a concept similar to Apple’s VoiceOver Live Recognition on iPhone, offering AI-powered assistance for people with visual impairments by helping them interpret objects and information around them.
The technology can also be useful in specific situations where users need additional assistance understanding their immediate environment.

Google Sets Limits on Guided Vision’s Use

Google cautions users against depending on Guided Vision for navigation, safe-travel instructions or detecting obstacles.
The company states that the feature should not be considered a substitute for a white cane or other mobility assistance tools, highlighting the importance of using established mobility aids for safe movement.