Yahoo Opens Up Flickr Deep Learning

Yahoo is making CaffeOnSpark available for use by open-source developers. The deep learning software is used by Yahoo to gain intelligence from massive amounts of online data. CaffeOnSpark has been used by Yahoo internally for some time, including to improve the image recognition accuracy of Flickr. The Flickr teams used CaffeOnSpark to train Flickr using millions of photos from the Yahoo Webscope Flickr Creative Commons 100M dataset on Hadoop clusters. CaffeOnSpark is a Spark deep learning package that fills a gap in the Spark MLib, supporting dataframes to make it easier to interface with Spark-generated training dataset, and to extract predictions from the model as results or for data analysis using MLLib or SQL. MLlib is Spark’s machine learning (ML) library, consisting of common learning algorithms and utilities, including classification,…


Link to Full Article: Yahoo Opens Up Flickr Deep Learning