• Home
• Technology

Harvard researchers are working to make everyday navigation more accessible for people with visual impairments through Mobilio, a new application that transforms an ordinary smartphone into an intelligent navigation assistant.

The system combines artificial intelligence with smartphone cameras and motion sensors to interpret surrounding environments, identify potential obstacles and provide users with personalized audio directions as they move.

Research Highlights Improvements in Navigation Performance

Testing results published in Nature Biomedical Engineering showed that 14 participants using Mobilio with a mobility cane completed navigation tasks 13% faster. Indoor collisions also decreased by 41% compared with using a cane alongside Google Maps.

According to the researchers, standard mapping applications do not always provide the level of environmental detail needed by blind and visually impaired pedestrians.

Built on Research Into Everyday Mobility Challenges

Before developing the application, the team examined the experiences of more than 100 people with visual impairments.

Their research identified three important features for an effective navigation tool: consistent instructions when walking straight, immediate guidance at turning points, and dependable detection of nearby obstacles.

To improve its understanding of pedestrian environments, Mobilio also draws on scene-analysis datasets captured from the viewpoint of people walking, rather than images primarily designed for road traffic.

Turning an Ordinary Smartphone Into a Navigation Assistant

The application brings together several smartphone technologies, including the camera, GPS and motion sensors. It can also use LiDAR capabilities on supported phones.

Its computer vision system analyzes live camera footage and combines visual information with location and movement data to determine an appropriate route. Users then receive adjustable audio signals designed to match their pace and movements.

The researchers highlighted that running the technology on standard smartphones could make it more accessible than solutions requiring costly, specialized hardware.

Harvard Team Prepares for More Field Trials

Researchers at Harvard's John A. Paulson School of Engineering and Applied Sciences intend to expand testing into different real-world settings.

These trials will help determine how the application performs during everyday activities and how well it can accommodate individual routines and navigation preferences.