Difference between revisions of "Sahara/SparkPlugin"
< Sahara
(Created page with "== Introduction == [http://spark.incubator.apache.org/ Spark] is an in-memory implementation of MapReduce written in Scala. [https://blueprints.launchpad.net/savanna/+spec/sp...") |
m (→Requirements) |
||
| Line 5: | Line 5: | ||
== Requirements == | == Requirements == | ||
| − | + | Support for version 0.8.0 of Spark and later is planned, since it has relaxed dependencies on Hadoop and HDFS library versions. | |
== Implementation Notes == | == Implementation Notes == | ||
Revision as of 08:40, 22 October 2013
Introduction
Spark is an in-memory implementation of MapReduce written in Scala. This blueprint proposes to build and integrate a Spark plugin in Savanna to add the ability to launch and resize Spark clusters and run EDP jobs.
Requirements
Support for version 0.8.0 of Spark and later is planned, since it has relaxed dependencies on Hadoop and HDFS library versions.
Implementation Notes
TBD
