Microsoft's new APIs allow developers to give their apps a 'human side'

Build 2016 is a developer conference so it's only right we should see some cool new toys for the folks who build your favorite apps to play with. Microsoft's new cognitive set of 22 APIs fit that bill and will allow developers to give their apps a more human touch.

A result of years of AI and machine learning, apps will be able to include vision, emotion, video understanding, language, speech, knowledge, Bing search and more. And web app developers will also be able to take advantage.

One example shown off was the vision API and how it can recognize objects in an image and offer up a confidence score of its accuracy. It can also figure ou the relationship between objects in the image and provide a text based description of what you're seeing.

Another example is speech-to-text, and how its able to isolate background noise and even understand awkward speech, such as that from a child.

We also got to see a pretty amazing example of how these APIs can be put to real, life changing use. The Pivot Head Sunglasses can read moods and the photo app can guide its user to position the camera correctly and analyze documents for blind people. Pretty cool stuff.

For more from Build 2016 be sure to keep it locked to our dedicated page here

CATEGORIES
Richard Devine
Managing Editor - Tech, Reviews

Richard Devine is a Managing Editor at Windows Central with over a decade of experience. A former Project Manager and long-term tech addict, he joined Mobile Nations in 2011 and has been found on Android Central and iMore as well as Windows Central. Currently, you'll find him steering the site's coverage of all manner of PC hardware and reviews. Find him on Mastodon at mstdn.social/@richdevine

Latest in Microsoft
Steve Ballmer and Bill Gates, former CEOs of Microsoft.
Bill Gates says Satya Nadella almost missed the cut for CEO of Microsoft — Even with Steve Ballmer's support
Microsoft Majorana 1 chip designed for quantum computing
Microsoft dismisses quantum computing skepticism: "There is a century-old scientific process established by the American Physical Society for resolving disputes"
The Microsoft logo on a smartphone and laptop arranged in Crockett, California, US, on Friday, Dec. 29, 2023.
"Would you say there is a reasonable balance between what you contribute to Microsoft and what you get in return?" Two-thirds of Microsoft employees say YES — as AI engineers get preferential compensation packages.
Like a Dragon Pirate Yakuza in Hawaii screenshot
Microsoft blocks (some) Windows 11 pirates while Lenovo steals the show at Mobile World Congress
Satya Nadella with Sam Altman at a conference
Salesforce CEO Marc Benioff's prediction about Microsoft and OpenAI's partnership may have just manifested — and it's not a pretty look for the ChatGPT maker
Age of Empires II with retail box
I ranked 7 of the best Microsoft games of all time to celebrate its 50th anniversary — disagree with these classics if you dare
Latest in News
Professor Sir Roger Penrose, physicist, mathematician and cosmologist
Nobel laureate claims "AI will not be conscious" and shouldn't be considered intelligent — Until it develops its own ideas
UGreen x Genshin Impact charging accessories: image shows magnetic wireless charger, power bank, GaN charger and USB-C cable
UGreen drops a stunning Genshin Impact collection of charging accessories AND it's all on sale
Lies of P boss
Grab these must-play games at killer deal prices during the CDKeys Spring Festival
In this photo illustration OpenAI ChatGPT icon is displayed on a mobile phone screen in Ankara, Turkiye on August 13, 2024.
OpenAI says an excessive dependency on ChatGPT can lead to loneliness and a "loss of confidence" in decision-making
Alienware Area-51 laptops (2025)
Dell revives Alienware Area-51 with powerful new gaming PCs
The First Berserker: Khazan
The First Berserker: Khazan review and Metacritic score roundup — this stylish Soulslike sounds like a must-play action RPG