We’re pretty used to Microsoft unveiling image detection bots by now; so far we’ve seen How Old, Twins Or Not, and Project Oxford the emotion-detection bot – but its latest one is by far the least successful at detecting images.
Called the CaptionBot, the tool looks at the image you’ve uploaded to describe what it sees in the picture. It’s similar to what Microsoft demonstrated in its Seeing AI video, during which a bot helps a blind person describe what’s around him.
But if this AI is to believed, we’re rather worried for that blind Microsoft developer.
The <3 of EU tech
The latest rumblings from the EU tech scene, a story from our wise ol' founder Boris, and some questionable AI art. It's free, every week, in your inbox. Sign up now!
I assure you, I am fully female and possess only one body, and despite spending a lot of time on the computer for my job, I do make it to the gym occasionally.
CaptionBot gets it right (or decently close) a lot of the time, but in some cases it can’t even figure out what’s in the photo despite what we think seems rather obvious.
Also, when the answers for the following images aren’t “Your deepest darkest nightmares,” you know this AI’s got problems.
It wouldn’t totally surprise us if Microsoft deliberately designed CaptionBot to be terrible, so we can all share its many misinterpreted photos. Still, you gotta hand it to the team for sharing something so stupidly entertaining, in hopes of actually being great in the long run.
I'm going to crush the rebellion… but first, let me take a selfie. #captionbot pic.twitter.com/Zr6x9n0m1T
— Stephanie Melnick (@unicornsteph96) April 14, 2016
Captionbot's failures are more entertaining than its successes. pic.twitter.com/BLgFRdfeeR
— Joel Bernstein (@CastIrony) April 13, 2016
captionbot.ai nailed it pic.twitter.com/BROvlNbgIT
— Jeff Atwood (@codinghorror) April 13, 2016
Can’t even identify its own kind #captionbot pic.twitter.com/m7eMmLhCEr
— Mike Murphy (@mcwm) April 14, 2016
Today I got body-shamed by Microsoft's #captionbot :-( pic.twitter.com/WWizc0sQ6W
— Peter Oomsels (@Peteroomsels) April 14, 2016
Just love captionbot.ai – here's #Kanye eating a donut (allegedly) #captionbot pic.twitter.com/nHpfcAvAVu
— Jim Wightman (@jimlizardking) April 14, 2016
Have a go at it yourself here. Spoiler alert, it will block any photo it deems inappropriate, so don’t bother trying to get CaptionBot to say something risque.
Get the TNW newsletter
Get the most important tech news in your inbox each week.