Microsoft launched a portal that leverages an algorithm to identify people and objects within images. CaptionBot ( this is the name of the portal ) allows users to upload and analyze an image by identifying what objects are in it. Users can subsequently comment on the analysis performed, allowing the algorithm to identify any flaws and thus evolve over time.
The algorithm was created by the team Microsoft Cognitive Services and is able to detect a huge amount of objects and people. The algorithm uses several sub-algorithms and services developed by Microsoft:
- Computer Vision: identifies objects
- Bing Image Search: search for details through the search engine
- Emotion detects the emotions of the faces present