Spark Summit keynote explores structured streaming, innovation in deep learning | #SparkSummit

Spark Summit 2016 opened today at the Hilton San Francisco Union Square with Matei Zaharia, chief technology officer at Databricks, Inc. and creator of Spark, revealing the latest version of Spark 2.0, the company’s largest release to date, which will be coming this month. For those developers who want a sneak peek, there is an unstable preview release at spark.apache.org, where you can take it for a test drive.  Zaharia explained that the new release will remain highly compatible with Apache Spark 1.X, fixes issues with dependencies and has over 2000 patches from 280 contributors. The focus of upgrading Spark 2.0 was led by three key ideas. The goals were to create a unified engine that will support end-to-end applications; high-level APIs that are easy to use and enables rich optimizations;…


Link to Full Article: Spark Summit keynote explores structured streaming, innovation in deep learning | #SparkSummit