Microsoft brings its free Seeing AI app to 3 billion people

Microsoft Seeing AI app
Microsoft's Seeing AI app is now available for Android as well as iOS. (Image credit: Microsoft)

What you need to know

  • Microsoft just released its Seeing AI app onto Android, expanding the app's reach to an additional 3 billion people.
  • Seeing AI uses artificial intelligence to help the blind and low vision community.
  • The app can perform tasks such as identifying currency, reading handwriting, describing a scene, and guiding a person through a document.

Microsoft first worked on its Seeing AI app as a research project in 2017. It has since evolved into a fully featured app available to the public. Up until now, Seeing AI has only been available for iOS, but it is now available on Android as well. With over 3 billion Android users on the planet, the rollout greatly expands the app's reach.

Seeing AI uses artificial intelligence to help the blind and low vision community. It can perform daily tasks such as guiding someone through a document or menu, recognizing currency notes, and identifying images. To use the app, you can either point its camera or take a photo.

Seeing AI supports 18 languages at the moment, but that number will increase to 36 in 2024.

The following features made their way to the iOS version of Seeing AI and are also on the newly released Android version:

  • Richer Descriptions of photos: In addition to providing a brief summary of photos on the Scene channel, you can now tap ‘more info’ and a rich description will be generated, including far greater detail about what is in the image. 
  • Chat to your documents: After scanning a document, in addition to hearing it read aloud, you can also chat to Seeing AI to ask questions, such as about items on a menu, the price of an item on a receipt, or to summarize an article. 
Seeing AI | Free at Google Play | Free at App Store

Seeing AI | Free at Google Play | Free at App Store

This app uses artificial intelligence to narrate the world. It's built for the blind and low vision community and can perform tasks such as guiding a person through a document, describe a scene, identify people, and recognize currency notes.

Microsoft also highlighted some of Seeing AI's key features for those unfamiliar with the app:

  • Short Text: Speaks text as soon as it appears in front of the camera. 
  • Documents: Provides audio guidance to capture a printed page, and reads the content aloud, along with its original formatting. Chat with Seeing AI to quickly find information. 
  • Products: Scans barcodes, using audio beeps to guide you; hear the name, and package information when available. 
  • Scenes: Hear a description of the scene captured and tap ‘more info’ to generate a rich description. Explore the photo by moving your finger over the screen to hear the location of different objects. 
  • People: Identify friends around you. 
  • Currency: Recognizes currency notes. 
  • Colors: Identifies the perceived color. 
  • Handwriting: Reads handwritten text like in greeting cards (available in a subset of languages). 
  • Light: Generates an audible tone corresponding to the brightness in the surroundings. 
  • Images in other apps: Share a photo with Seeing AI to recognize it. 

The video below is from four years ago, but it shows the general concept of Seeing AI.

CATEGORIES
Sean Endicott
News Writer and apps editor

Sean Endicott is a tech journalist at Windows Central, specializing in Windows, Microsoft software, AI, and PCs. He's covered major launches, from Windows 10 and 11 to the rise of AI tools like ChatGPT. Sean's journey began with the Lumia 740, leading to strong ties with app developers. Outside writing, he coaches American football, utilizing Microsoft services to manage his team. He studied broadcast journalism at Nottingham Trent University and is active on X @SeanEndicott_ and Threads @sean_endicott_. 

Read more
Photos app on Windows 11
Windows 11's Photos app is about to get a big update, and it's all about AI
Samsung Galaxy Book4 Edge and Galaxy S24 Ultra.
What is Galaxy AI, and why is it important for Galaxy phone and PC users?
The updated Copilot app for Android on the Samsung Galaxy Z Fold6 (2024).
Microsoft makes OpenAI's "truly magical" paywalled Think Deeper and Voice features FREE without caps for all Copilot users: "We know many of you have been hitting limits"
Satya Nadella contemplating during the annual Microsoft shareholders meeting.
Microsoft CEO Satya Nadella touts DeepSeek's open-source AI as "super impressive": "We should take the developments out of China very, very seriously"
Microsoft Copilot on a TV mock up
Samsung and LG TVs are set to get Microsoft Copilot AI, but it's going to just be a link to the website again
DeepSeek logo on a smartphone in front of a PC screen with the same logo.
Is AI all hype? DeepSeek tumbles to #51 on Apple's App Store, weeks after dethroning ChatGPT as the most downloaded free AI app in the US — OpenAI CEO Sam Altman already promised to "obviously deliver better models"
Latest in Software Apps
Professor Sir Roger Penrose, physicist, mathematician and cosmologist
Nobel laureate claims "AI will not be conscious" and shouldn't be considered intelligent — Until it develops its own ideas
In this photo illustration OpenAI ChatGPT icon is displayed on a mobile phone screen in Ankara, Turkiye on August 13, 2024.
OpenAI says an excessive dependency on ChatGPT can lead to loneliness and a "loss of confidence" in decision-making
Microsoft 365 app on Windows 11 with shortcuts to create documents in Word, PowerPoint, Excel, and other Microsoft 365 applictions.
This Microsoft 365 feature will nudge users to save files to OneDrive
Photos app on Windows 11
Windows 11's Photos app is about to get a big update, and it's all about AI
Windows Update
Microsoft begins testing next phase of Windows 11 — Dev Channel to flight new platform changes
Windows 11 Search
Copilot+ PCs' first must-have feature is just around the corner
Latest in News
Professor Sir Roger Penrose, physicist, mathematician and cosmologist
Nobel laureate claims "AI will not be conscious" and shouldn't be considered intelligent — Until it develops its own ideas
UGreen x Genshin Impact charging accessories: image shows magnetic wireless charger, power bank, GaN charger and USB-C cable
UGreen drops a stunning Genshin Impact collection of charging accessories AND it's all on sale
Lies of P boss
Grab these must-play games at killer deal prices during the CDKeys Spring Festival
In this photo illustration OpenAI ChatGPT icon is displayed on a mobile phone screen in Ankara, Turkiye on August 13, 2024.
OpenAI says an excessive dependency on ChatGPT can lead to loneliness and a "loss of confidence" in decision-making
Alienware Area-51 laptops (2025)
Dell revives Alienware Area-51 with powerful new gaming PCs
The First Berserker: Khazan
The First Berserker: Khazan review and Metacritic score roundup — this stylish Soulslike sounds like a must-play action RPG