IBM announces new Spark-based Data Science Experience

IBM has launched an Apache Spark-based development environment called Data Science Experience on its Bluemix cloud platform. Data Science Experience is “an interactive, collaborative, cloud-based environment where data scientists can use multiple tools to activate their insights”, according to product manager Armand Ruiz. Related articles Apache Spark speeds up the development of iterative and machine-learning-type applications because the data is in memory. It is frequently used together with Hadoop as it is quicker for many jobs than MapReduce, but it can also be used with other storage back-ends. IBM is a big investor in Spark, ploughing $300m into projects such as the machine learning library SparkML and libraries for the R programming language and SparkSQL querying. The latest offering is understood to be additional to this investment programme. The idea…


Link to Full Article: IBM announces new Spark-based Data Science Experience