We’re pretty used to Microsoft unveiling image detection bots by now; so far we’ve seen How Old, Twins Or Not, and Project Oxford the emotion-detection bot – but its latest one is by far the least successful at detecting images.
Called the CaptionBot, the tool looks at the image you’ve uploaded to describe what it sees in the picture. It’s similar to what Microsoft demonstrated in its Seeing AI video, during which a bot helps a blind person describe what’s around him.
Ever been to a tech festival?
TNW Conference won best European Event 2016 for our festival vibe. See what's in store for 2017.
But if this AI is to believed, we’re rather worried for that blind Microsoft developer.
I assure you, I am fully female and possess only one body, and despite spending a lot of time on the computer for my job, I do make it to the gym occasionally.
CaptionBot gets it right (or decently close) a lot of the time, but in some cases it can’t even figure out what’s in the photo despite what we think seems rather obvious.
Also, when the answers for the following images aren’t “Your deepest darkest nightmares,” you know this AI’s got problems.
It wouldn’t totally surprise us if Microsoft deliberately designed CaptionBot to be terrible, so we can all share its many misinterpreted photos. Still, you gotta hand it to the team for sharing something so stupidly entertaining, in hopes of actually being great in the long run.
— Stephanie Melnick (@stephmelnick96) April 14, 2016
Captionbot's failures are more entertaining than its successes. pic.twitter.com/BLgFRdfeeR
— Joel Bernstein (@CastIrony) April 13, 2016
captionbot.ai nailed it pic.twitter.com/BROvlNbgIT
— Jeff Atwood (@codinghorror) April 13, 2016
— Mike Murphy (@mcwm) April 14, 2016
— Peter Oomsels (@Peteroomsels) April 14, 2016
— Jim Wightman (@jimlizardking) April 14, 2016
Have a go at it yourself here. Spoiler alert, it will block any photo it deems inappropriate, so don’t bother trying to get CaptionBot to say something risque.