Spark Makes Hadoop Mainstream, Cloudera Jumps In

September 9, 2015 Timothy Prickett Morgan It is probably a good thing that Doug Cutting, the creator of Hadoop, named the batch-mode data analytics product he created at Yahoo after his child’s stuffed animal rather than something specific like MapReduce Engine. Because in the long run, at least according to his current employer, commercial Hadoop distributor Cloudera, the Spark framework for in-memory and streaming processing, will be the standard data processing engine for the Hadoop stack. Spark, which traces its roots back to the AMPLab at the University of California at Berkeley just like the Mesos cluster controller does, is a distributed computing framework that solves many of the same kinds of problems that the MapReduce technology originally created by Google along with its Google File System did a decade…


Link to Full Article: Spark Makes Hadoop Mainstream, Cloudera Jumps In