🧑‍🦯 Be My Eyes introduces AI app to help the visually impaired

🧑‍🦯 Be My Eyes introduces AI app to help the visually impaired

Be My Eyes' new AI Virtual Volunteer brings instant visual help, making daily tasks easier and boosting independence for visually impaired users.

Warp Editorial Staff
Warp Editorial Staff

Share this story!

Be My Eyes, an app that connects blind and low vision users with sighted volunteers to assist with everyday tasks, is introducing a "virtual volunteer" feature powered by artificial intelligence (AI).

Integrating GPT-4's multimodal capability

The new version of the app is the first to integrate GPT-4's multimodal capability, allowing it to not only chat intelligibly but also inspect and understand images.

Users can send images via the app to an AI-powered Virtual Volunteer, which will answer any question about the image and provide instantaneous visual assistance for various tasks.

Context-aware AI assistance

What sets the Virtual Volunteer tool apart from other image-to-text technology available today is context, with a deeper level of understanding and conversational ability not yet seen in the digital assistant field.

The tool can offer suggestions for recipes based on the contents of a user's refrigerator, for example, and provide a step-by-step guide on how to make them.

Human volunteers remain essential

If and when the tool is unable to answer a question, it will automatically offer users the option to be connected via the app to a sighted volunteer for assistance. Human volunteers will continue to play an essential role in the Be My Eyes app.

Expanding accessibility for businesses

The new feature also aims to offer a way for businesses to better serve their customers by prioritizing accessibility. Be My Eyes plans to begin beta testing the feature with corporate customers in the coming weeks, with broader availability later this year.

Closed beta testing and future development

Currently in a closed beta, the feature is being tested for feedback among a small subset of users. The team at Be My Eyes is working closely with its community and OpenAI to define and guide the tool's capabilities as its development continues.

Read more:

GPT-4’s new capabilities power a ‘virtual volunteer’ for the visually impaired
Be My Eyes, an app that lets blind folks ask people to describe what they see, is getting a ‘virtual volunteer’ for AI-powered help any time.
TechCrunchDevin Coldewey
Introducing Our Virtual Volunteer Tool for People who are Blind or Have Low Vision, Powered by OpenAI’s GPT-4
We are thrilled to announce Be My Eyes Virtual Volunteer™, the first-ever digital visual assistant powered by OpenAI’s new GPT-4 language model.
Blog Article,
Be My Eyes
Be My Eyes uses GPT-4 to transform visual accessibility.
🧠 Artificial Intelligence

You might also like

Mathias Sundin 5 min read

🎵 Now there's a ChatGPT for making music (my three-year-old son and I made an opera)

I sing out of tune and can't play any instrument. My son is three years old. Yet, we have made an opera together. This has been made possible thanks to the latest developments in generative AI.

Mathias Sundin 3 min read

💡 Musings of the Angry Optimist: Is a revolution underway?

Usually, when writing an opinion piece, it carries a thesis or a message. Not this one. It ends with an open question. That question is based on the notion that something big is underway. Something revolutionary.

Mathias Sundin 2 min read

🚘 Autonomous vehicles take a step forward

Within a couple of weeks, three companies have announced important steps in the quest for self-driving cars. Tesla launched a beta test of their autonomous technology. Waymo opens up its driverless taxi service to the public in Phoenix, Arizona. And Cruise is doing the same thing in San Francisco.