A team at the University of Technology Sydney has developed an innovative assistive technology for blind people and those with low vision. The technology consists of glasses equipped with a camera that uses computer vision to identify objects in the wearer’s surroundings. It then provides audible cues to the wearer, such as the sound of rustling leaves or a bark to indicate the presence of a dog. This technology has the potential to provide additional information about the environment to low vision wearers and assist them with daily tasks.
Technological advancements aimed at aiding individuals who are blind or have low vision are rapidly progressing. These systems have the potential to empower such individuals, reduce their reliance on others for assistance, and enhance their independence and confidence.
The newly developed technology is akin to the echolocation used by bats, but it relies on computer vision rather than soundwaves to identify nearby objects. However, sound icons are still used to communicate the identity of the viewed objects.
“Smart glasses typically use computer vision and sensory information to translate the wearer’s surroundings into computer-synthesized speech,” said Chin-Teng Lin, one of the creators of the new system. “However, acoustic touch technology sonifies objects, creating unique sound representations as they enter the device’s field of view. For example, the sound of rustling leaves might signify a plant, or a buzzing sound might represent a mobile phone.”
The researchers have tested the glasses with 14 participants, half of whom were blind or had low vision and the other half were fully sighted but wore a blindfold during the tests. The glasses enabled the wearers to successfully identify and grasp objects within the system’s field of view.
“The auditory feedback empowers users to identify and reach for objects with remarkable accuracy,” said Howe Zhu, another researcher involved in the study. “Our findings indicate that acoustic touch has the potential to offer a wearable and effective method of sensory augmentation for the visually impaired community.”
Study in journal PLOS ONE: An investigation into the effectiveness of using acoustic touch to assist people who are blind
Via: University of Technology Sydney
