Apache Spark Gets IBM Mainframe Connection

IBM’s recent embrace of Apache Spark is beginning to generate dividends in the form of open source contributions for a mainframe big data link to Spark.Big data software vendor Syncsort, Woodcliff Lake, N.J., said Tuesday (Sept. 1) it is contributing an IBM z System mainframe connector for Apache Spark that would allow easier access to mainframe data using Spark’s analytics and Spark SQL. The company described its latest mainframe connector as being similar to the Apache Sqoop link it released as open source software last year. That connector allows Hadoop users to import and analyze data coming from the z System mainframe environment. The new Spark connector is designed to ease specifying the location of multiple datasets and associated metadata. It also automatically transfers datasets via a secure connection into…


Link to Full Article: Apache Spark Gets IBM Mainframe Connection