Jump to: navigation, search

Difference between revisions of "Sahara/Roadmap"

(Version 0.3 - Analytics as a Service (October, 15 - planned))
(Version 0.3 - Analytics as a Service (October, 15 - planned))
Line 21: Line 21:
 
==== Version 0.3 - Analytics as a Service (October, 15 - planned) ====
 
==== Version 0.3 - Analytics as a Service (October, 15 - planned) ====
  
* API to execute Map/Reduce jobs without exposing details of underlying infrastructure (similar to AWS EMR)
+
* API to execute Map/Reduce jobs without exposing details of underlying infrastructure (similar to AWS EMR) /[https://blueprints.launchpad.net/savanna?searchtext=edp all blueprints]/
* User-friendly UI for ad-hoc analytics queries based on Hive or Pig
+
* User-friendly UI for ad-hoc analytics queries based on Hive or Pig /[https://blueprints.launchpad.net/savanna/+spec/edp-savanna-dashboard-ui blueprint]/
* Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum)
+
* Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum) /[https://blueprints.launchpad.net/savanna/+spec/add-neutron-support blueprint]/
 
* More implementations of plugins
 
* More implementations of plugins
* Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios)
+
* Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios) /[https://blueprints.launchpad.net/savanna/+spec/vanilla-hadoop-monitoring blueprint]/
* Client libraries and tools
+
* Client libraries and tools /[https://blueprints.launchpad.net/savanna?searchtext=python-savannaclient python-savannaclient]/
* Enhanced scalability through scale-out architecture
+
* Enhanced scalability through scale-out architecture /[https://blueprints.launchpad.net/savanna?searchtext=ng- blueprints]/
  
 
==== Version 1.0 (TBD, targeted for Official OpenStack Incubation) ====
 
==== Version 1.0 (TBD, targeted for Official OpenStack Incubation) ====

Revision as of 10:14, 13 August 2013

Version 0.1 - Basic Cluster Provisioning (April, 10 - released)

  • Cluster provisioning
  • Deployment Engine implementation for pre-installed images
  • Templates for Hadoop cluster configuration
  • REST API for cluster startup and operations
  • UI integrated into Horizon

Version 0.2 - Cluster Operations (July, 15 - released)

  • Manual cluster scaling (add/remove nodes)
  • Hadoop cluster topology configuration parameters
    • Data node placement control
    • HDFS location
    • Swift integration
  • Plugin mechanism for integration with different Hadoop distributions
  • Plugins implementation:
    • Vanilla Apache Hadoop with pre-build image
    • Hortonworks Data Platform using Ambari

Version 0.3 - Analytics as a Service (October, 15 - planned)

  • API to execute Map/Reduce jobs without exposing details of underlying infrastructure (similar to AWS EMR) /all blueprints/
  • User-friendly UI for ad-hoc analytics queries based on Hive or Pig /blueprint/
  • Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum) /blueprint/
  • More implementations of plugins
  • Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios) /blueprint/
  • Client libraries and tools /python-savannaclient/
  • Enhanced scalability through scale-out architecture /blueprints/

Version 1.0 (TBD, targeted for Official OpenStack Incubation)

  • Havana support
  • Code hardening
  • HBase support
  • Performance testing
  • Enhanced EDP functionality (ongoing effort)
  • Enhanced scalability (ongoing effort)
  • Hadoop 2.x support
  • Fedora/Ubuntu integration
  • GlusterFS integration
  • RDO integration