Jump to: navigation, search

Difference between revisions of "Sahara/Roadmap"

(Phase 3 - Analytics as a Service (October, 15 - planned))
(Version 1.0 (TBD - December))
Line 27: Line 27:
 
* More implementations of plugins
 
* More implementations of plugins
  
==== Further Roadmap (completion - TBD) ====
+
==== Version 1.0 (TBD - December) ====
  
* HDFS and Swift integration
+
* Havanna support
** Caching of Swift data on HDFS
+
* Code hardening
** Avoid issues with Swift eventual consistency while running job
 
 
* HBase support
 
* HBase support
 +
* Performance testing

Revision as of 13:02, 20 June 2013

Version 0.1 - Basic Cluster Provisioning (April, 10 - released)

  • Cluster provisioning
  • Deployment Engine implementation for pre-installed images
  • Templates for Hadoop cluster configuration
  • REST API for cluster startup and operations
  • UI integrated into Horizon

Version 0.2 - Cluster Operations (July, 15 - work in progress)

  • Manual cluster scaling (add/remove nodes)
  • Hadoop cluster topology configuration parameters
    • Data node placement control
    • HDFS location
    • Swift integration
  • Plugin mechanism for integration with different Hadoop distributions
  • Plugins implementation:
    • Vanilla Apache Hadoop with pre-build image
    • Hortonworks Data Platform using Ambari
  • Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios)

Version 0.3 - Analytics as a Service (October, 15 - planned)

  • API to execute Map/Reduce jobs without exposing details of underlying infrastructure (similar to AWS EMR)
  • User-friendly UI for ad-hoc analytics queries based on Hive or Pig
  • Network configuration support, integration with Quantum
  • More implementations of plugins

Version 1.0 (TBD - December)

  • Havanna support
  • Code hardening
  • HBase support
  • Performance testing