Facebook App Answers Questions About Photos

Yann LeCun A new experimental mobile app developed by Facebook’s artificial intelligence researchers can answer spoken queries about the content of photos. Yann LeCun, director of Facebook’s artificial intelligence research group, showed off the app, which could one day help visually impaired people, in a talk at MIT Technology Review’s EmTech conference in Cambridge, Massachusetts. He showed the app answering a series of questions about several photos. In one, a cat was sniffing a large bunch of unripe bananas. The app correctly answered spoken queries asking whether there was a cat in the image, what it was doing, what the bananas were on, and about the color of the bananas (green) and the cat (black and white). In another example a dog held a toy in its mouth. When asked…


Link to Full Article: Facebook App Answers Questions About Photos