Visual assistance apps, sometimes called visual interpreting apps, are tools that connect users who are blind or visually impaired with people or technology that can help them to get information about something that they would not be able to see otherwise. Visual assistance apps for blind and low vision users are a category of high-tech assistive technology applications that can be installed on a smartphone or tablet. By streaming video from the device’s back camera or uploading a file, visual assistance apps recognize text and other objects, providing a transcript of text or visual description of items such as objects, colors, people, and more.
Below is an overview of popular visual assistance applications for visually impaired users available on Android, Apple/iOS, and other mainstream operating systems. It’s worth noting that no single app is “perfect”, and it’s very common to download multiple visual assistance apps for blind and low vision so that users can choose the app that best fits their needs for a given task.
AI visual assistance apps vs Human visual assistance apps
AI visual assistance applications use machine learning and artificial intelligence to recognize text and images, allowing users to get descriptions or transcriptions of text in a matter of seconds. While there can be some errors with AI descriptions, users may prefer visual assistance apps powered by artificial intelligence because they can be used independently and don’t require the user to ask someone else for help, and may also offer support for multiple languages.
Visual assistance applications that use human visual interpreters allow users to stream one-way video and two-way audio to read text or get descriptions of objects from a visual interpreter or sighted person. Some applications require users to verbally communicate with visual interpreters, while others allow for typing questions or recording voice messages. Human visual assistance apps are often slower than AI-powered apps, but may provide enhanced accuracy for specific tasks such as getting a description of surrounding areas.
It’s worth noting that some visual assistance apps have started taking on a hybrid model, offering some AI options in addition to visual interpreters.
Characteristics of visual assistance apps
Some of the most common features for visual assistance apps include:
- Self-voicing descriptions. Users do not have to enable a screen reader, many visual assistance apps use a synthesized voice to provide descriptions
- In addition to having descriptions read out loud, many apps also have descriptions display in large print on a simplified display.
- Gallery upload. Users can upload an image, screenshot, or other file type to their visual assistance app to get a transcription of text or other visual information
- Multiple languages supported. All applications listed in this post support multiple languages, including English, Spanish, French, and more.
- Text recognition. This may be broken up into two categories for shorter amounts of text, like a sign or poster, and longer text/documents
- Option to save images taken with the visual assistance app onto the camera roll
Microsoft Seeing AI
Cost
Free
Platforms supported
Seeing AI is available for iOS and Android. Requires iOS 12 or later/Android 6.0 or later
Age requirement/account requirement
Users must be at least 13 years old to access Seeing AI. No account is required to use the app.
Functions/Features
- Read short amounts of text as well as longer documents
- Identify products via barcode
- Identify currency from multiple countries, including US, Canada, UK, India, and more
- Detect light and identify colors
- Recognize faces and describe what a person looks like
- Provide a scene description of objects in view of the camera
- Recognize handwriting
- Ability to upload images and have text/visual details recognized
Unique feature
Interactive image recognition feature allows users to explore images by touch, listening to different parts of an image.
Related links
- Microsoft Seeing AI And Low Vision
- Recognizing Images With Seeing AI
- Seeing AI on the App Store (apple.com)
- Seeing AI on Google Play
Google Lens
Cost
Free
Platforms supported
Google Lens is built-in to Android phones and also available as a standalone app, requiring Android 6.0 or later. Google Lens functionality is also available on the Google Search app for iOS.
Age requirement/account requirement
No age requirement is listed for Google Lens, though a free Google account is required.
Functions/Features
- Scan text and have it read out loud or copy/paste text into another application.
- Translate text from one language to another, with the option to copy/paste translated text
- Visual search- take a picture of an object to identify it and receive related search results
- Scan barcodes and QR codes to identify products
- Homework- take a picture of a homework question
Unique feature
Visual search provides options for identifying plants and animals, as well as specific breeds/types of animals.
Related links
- Google Lens Review For Low Vision
- How I Use Google Assistant While Traveling
- Google lens – Android Apps on Google Play
Google Lookout
Cost
Free
Platforms supported
Google Lookout is available for Android, requiring Android 6.0 or later.
Age requirement/account requirement
No age requirement is listed for Google Lookout, though a free Google account is required.
Functions/Features
- Read short amounts of text and longer documents
- Explore mode (default) can identify objects that are in front of the camera, and provide information about their distance or location
- Identify currency from multiple countries
- Identify products by barcode
- Upload image from gallery
Unique feature
Food mode can scan product labels and barcodes to identify various items, with support for multiple countries.
Related links
Envision AI
Cost
Free, smart glasses available for additional purchase
Platforms supported
Envision is available for iOS and Android. Requires iOS 14 or later/Android 5.0 or later.
Age requirement/account requirement
Per terms of service, users must be 18 years or older to use Envision. A free Envision account is required.
Functions/Features
- Read short amounts of text and longer documents
- Scan and import documents and other files
- Scan barcodes for product identification
- Identify people and objects within view of the camera
- Find specific objects, i.e cat or water bottle
- Detect colors
Unique feature
Extensive support for viewing and translating text in over 100 languages, including several endangered and dead languages.
Related links
- Using The Envision App With Low Vision
- Envision AI on the App Store (apple.com)
- Envision – Apps on Google Play
Be My Eyes
Cost
Free
Platforms supported
Be My Eyes is available for iOS and Android. Requires iOS 13.6 or later/Android 5.0 or later.
Age requirement/account requirement
Per terms of service, users must be 17 years or older to use Be My Eyes. A free account is required.
Functions/Features
- Connects visually impaired (inclusive of low vision/blind) to visual interpreters using one way video and two-way audio
- Visual interpreters are volunteers who answer help requests for visually impaired users to help with various tasks
- Examples of tasks that interpreters can help with include reading text, identifying objects and where they are located, reading product labels, and providing other visual descriptions
- Available 24 hours a day, 7 days a week, with support for multiple languages
Unique feature
Specialized help connects users with accessibility support contacts for various companies, ranging from tech companies like Microsoft to food companies like Barilla pasta.
Related links
- How I Use Be My Eyes With Low Vision
- Using The Microsoft Disability Answer Desk With Be My Eyes
- Be My Eyes on the App Store (apple.com)
- Be My Eyes – Apps on Google Play
Aira
Cost
App is free with options for free access at Aira Access locations. Other services require a paid Aira plan with a set amount of minutes every month.
Platforms supported
Aira is available for iOS and Android. Requires iOS 14 or later/Android 7.0 or later.
Age requirement/account requirement
Per terms of service, users must be 18 years or older, though an Aira employee confirmed that younger users can join the service with parental permission. A free Aira account is required.
Functions/Features
- Connects blind and low vision users with professional trained visual interpreters
- Users can speak with a visual interpreter using one-way video and two-way audio, or use the Chat feature to get text-based support
- Interpreters can read handwritten and typed text, either in the form of short text or longer documents
- Identify objects and their location, as well as answer questions about objects such as size, color, distance, etc
- Assist with other visual tasks such as filling out forms, accessing websites, navigating crowded environments, finding items in a store, etc.
Unique feature
Can provide directions for navigating indoor and outdoor spaces and has customization options for people that use mobility aids such as blindness canes or guide dogs. Visual interpreters have access to indoor and outdoor maps for various locations around the world.
Related links
- Using Aira With Low Vision
- Aira Explorer on the App Store (apple.com)
- Aira Explorer – Apps on Google Play
Additional resources for visual assistance applications
- Looking for applications that provide GPS directions for getting from one place to another? Check out Smartphone Apps For Orientation and Mobility
- I share more about how I use visual assistance apps as a college student with low vision in the post Ways To Use Visual Assistance Apps For Virtual Classes
- Need tips on how to be a helpful visual interpreter, or want to be a volunteer for Be My Eyes? I share my favorite tips in the post Tips For Be My Eyes Volunteers From A User With Low Vision
- Learn more about assistive technology for low vision in A to Z of Assistive Technology For Low Vision
