Sahara/SparkPlugin
< Sahara
Revision as of 08:35, 22 October 2013 by Daniele Venzano (talk | contribs) (Created page with "== Introduction == [http://spark.incubator.apache.org/ Spark] is an in-memory implementation of MapReduce written in Scala. [https://blueprints.launchpad.net/savanna/+spec/sp...")
Introduction
Spark is an in-memory implementation of MapReduce written in Scala. This blueprint proposes to build and integrate a Spark plugin in Savanna to add the ability to launch and resize Spark clusters and run EDP jobs.
Requirements
We are targeting version 0.8.0 of Spark and later, since it has relaxed dependencies on Hadoop and HDFS library versions.
Implementation Notes
TBD
