LinkedIn Open-Sources Spark-Based Machine Learning Library

LinkedIn continues its strategy of developing hot technology and open-sourcing it, this time a machine learning library for Spark called Photon ML. LinkedIn announced that it has open-sourced its machine learning library for Apache Spark, known as Photon ML.Apache Spark is an open-source cluster computing framework used for processing and analyzing big data. The open-source data processing engine was built for speed, ease of use and sophisticated analytics. Spark is designed to perform both batch processing and new workloads like streaming, interactive queries and machine learning.In a blog post about the open-sourcing of Photon ML, Paul Ogilvie, engineering manager of the LinkedIn Machine Learning Algorithms team, noted that machine learning is a key component of LinkedIn’s relevance-driven products, and the company uses machine learning to train the ranking algorithms for…


Link to Full Article: LinkedIn Open-Sources Spark-Based Machine Learning Library