AI Empowers Visually Impaired

New AI-powered smart glasses are transforming the lives of visually impaired individuals, offering unprecedented independence in daily tasks. While still evolving, these assistive technologies are hailed as game-changers, despite some expert caution.

The world, once a maze of unseen obstacles, is slowly but surely revealing its contours to those who navigate it without sight, thanks to a quiet revolution powered by artificial intelligence.

For Chris Donahue, a resident of Brighton Heights, this revolution arrived in the form of a pair of unassuming glasses, transforming everyday moments into acts of effortless discovery.

Imagine opening your door to let your beloved dog out, only to be met by a void where the playful animal bounds.

This was Chris Donahue’s reality.

Blind, the world outside his immediate reach remained a mystery.

Until now.

“Meta, I am blind,” Donahue, 48, might utter, his voice a quiet command to the sleek frames perched on his nose.

A moment later, a voice, calm and precise, whispers back through the speaker nestled in the glass frame: “There is a dog in the middle of the yard chewing on a stick.”

It’s not magic; it’s the Ray-Ban AI Glasses, a conduit to the Meta AI app on his phone, a Bluetooth bridge to a sighted world.

A simple voice command activates a camera, capturing the scene and relaying a vivid description, painting a picture Donahue’s eyes cannot perceive.

These aren’t just vision aids; they are gateways to autonomy.

Donahue uses them to decipher labels on pantry shelves, understand microwave instructions, or even identify a product name on a box.

Beyond the mundane, the glasses have unlocked profound moments.

On a dinner date, when his wife forgot her reading glasses, Donahue, the blind partner, became the one to “read” the menu aloud.

His independence has blossomed, extending even to his work, where he uses the glasses to operate a sewing machine, crafting aprons for a government contract through VisAbility Pittsburgh’s industries division.

“This is the best invention I have ever seen,” declares Bruce Story, an access technology instructor at VisAbility Pittsburgh, who dedicates his efforts to equipping clients with the latest innovations.

“It’s a game-changer.”

Erika Petach, president of VisAbility Pittsburgh, echoes this sentiment, emphasizing that such advancements align with their core mission: “Smartphone apps help create a more accessible world.

Our clients can do anything we can do, except drive a vehicle.”

A poignant exception, perhaps, but even that barrier is beginning to crumble with the advent of self-driving cars, some already navigating the very streets of Pittsburgh.

The overarching goal, Petach asserts, is not to dwell on disabilities but to “focus on everyone’s abilities.”

Leslie Montgomery, chief operating officer at VisAbility Pittsburgh, encapsulates this ethos perfectly: “Limitations shouldn’t be put on you because you can’t see.”

Yet, as with any nascent technology promising to reshape human experience, a healthy dose of skepticism and caution tempers the boundless enthusiasm.

Tim Miller, executive director of the Westmoreland County Blind Association, himself legally blind, expresses a measured apprehension.

“I am a little apprehensive about this stuff,” he admits, pointing out that the technology is so fresh it requires time to mature and refine.

He also notes that these glasses are not exclusively for the visually impaired; their utility extends to anyone seeking an enhanced interaction with their environment.

While intrigued by Elon Musk’s Neuralink – a brain chip implant currently in clinical trials with a stated aim to restore vision – Miller remains pragmatic.

“These things take time,” he cautions.

“It’s a supply and demand kind of thing.

If more people in the world were blind, there would be more time and money invested in this technology.

It is all good stuff, I am sure, but it is just in the starting phases, so it’s best to give it time and see where it goes.”

This sentiment resonates with Lee Nasehi, president and CEO of VisionServe Alliance, a consortium of organizations serving the blind and low-vision communities across North America.

While acknowledging the potential, Nasehi stresses the importance of foundational skills.

“It is best to learn the skills without a device and then use the device to enhance the quality of life,” she advises, highlighting a crucial point: AI, for all its sophistication, synthesizes information from cyberspace, which can include misconceptions.

Moreover, the reliance on connectivity raises the pertinent question: “What happens if the internet is down?”

It’s a reminder that even the most cutting-edge tools are part of a larger ecosystem, vulnerable to its limitations.

The quest for independence through AI extends beyond the personal assistant in a pair of glasses.

Imagine navigating a bustling airport with a suitcase that acts as your personal guide.

This is the vision behind the Cabot Project, or “Carry on Robot,” conceived by Chieko Asakawa, a blind computer scientist and IBM researcher.

This innovative suitcase, equipped with 360-degree LiDAR technology similar to that used in autonomous vehicles, calculates distances and guides its user through vibrations in its handle.

Programmed via a mobile phone app, it can lead a traveler to their gate, a restaurant, or baggage claim, even identifying friends nearby through facial recognition.

Currently being mapped in controlled environments like Carnegie Mellon University and Pittsburgh International Airport, the Cabot Project represents another leap towards truly independent travel.

“An airport is a huge open space and there are lots of things and people,” Asakawa noted via email.

“It acts as your eyes,” says Daisuke Sato, a senior project scientist at CMU, whose work since 2005 has focused on bringing such accessibility research into real-world applications.

The suitcase, though currently weighing a hefty 30 pounds and leaving no room for clothing, is a testament to the boundless ambition of AI in transforming mobility.

The American Foundation for the Blind, in a recent study, lauded the expanding capabilities of AI while urging caution.

AI systems, they noted, can exude confidence even when delivering inaccurate image descriptions, making it challenging for visually impaired users to discern truth from error.

Miller, reflecting on using AI to read prescription bottle labels, points out the practical hurdles: “It might be more difficult to read the text on the bottle because it’s not flat or if the text is a smaller font size.”

This underscores the critical need for AI to not just “see” but to “understand” context and nuance.

Despite these caveats and the inherent imperfections of nascent technologies, the profound impact on individuals like Chris Donahue is undeniable.

He readily acknowledges that AI is not flawless, but the tangible improvements to his daily life are monumental.

“It is by far the largest advancement in tech I have seen,” Donahue asserts, his voice radiating genuine excitement.

“It helps me do so many things.”

Including, of course, the simple yet profound act of finding his dog, a small miracle woven into the fabric of everyday life by the threads of artificial intelligence.

The journey towards a truly accessible world is long, but with each innovation, each cautious step forward, the horizon grows clearer, promising a future where limitations are not defined by sight, but by ingenuity.