Yahoo open-sources CaffeOnSpark deep learning framework for Hadoop

Yahoo today is releasing some key artificial intelligence software (AI) under an open-source license. The company last year built a library called CaffeOnSpark to perform a popular type of AI called “deep learning” on the vast swaths of data kept in its Hadoop open-source file system for storing big data. Now it’s becoming available for anyone to use under an open-source Apache license on GitHub. Written primarily in C++, CaffeOnSpark was developed in order to take advantage of the Spark data processing engine that can outperform Hadoop for certain computations. Spark has the MLlib machine learning library, but it can’t do deep learning, which involves training artificial neural nets on large quantities of data and then getting them make inferences on new data. But like any other big technology company,…


Link to Full Article: Yahoo open-sources CaffeOnSpark deep learning framework for Hadoop