Jump to: navigation, search

Difference between revisions of "Sahara/Roadmap"

(Version 1.0 (TBD, targeted for Official OpenStack Incubation))
Line 26: Line 26:
 
* Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum) // [https://blueprints.launchpad.net/savanna/+spec/add-neutron-support blueprint]
 
* Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum) // [https://blueprints.launchpad.net/savanna/+spec/add-neutron-support blueprint]
 
* More implementations of plugins //
 
* More implementations of plugins //
* Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios) // [https://blueprints.launchpad.net/savanna/+spec/vanilla-hadoop-monitoring blueprint]
 
 
* Client libraries and tools // [https://blueprints.launchpad.net/savanna?searchtext=python-savannaclient python-savannaclient]
 
* Client libraries and tools // [https://blueprints.launchpad.net/savanna?searchtext=python-savannaclient python-savannaclient]
* Enhanced scalability through scale-out architecture // [https://blueprints.launchpad.net/savanna?searchtext=ng- blueprints]
 
  
 
==== Version 1.0 (TBD, targeted for Official OpenStack Incubation) ====
 
==== Version 1.0 (TBD, targeted for Official OpenStack Incubation) ====
Line 35: Line 33:
 
* Heat integration // [https://wiki.openstack.org/wiki/Savanna/HeatIntegration details]
 
* Heat integration // [https://wiki.openstack.org/wiki/Savanna/HeatIntegration details]
 
* Performance testing
 
* Performance testing
* Enhanced EDP functionality (ongoing effort)
+
* Enhanced EDP functionality // ongoing effort
* Enhanced scalability (ongoing effort)
+
* Enhanced scalability through scale-out architecture // [https://blueprints.launchpad.net/savanna?searchtext=ng- blueprints] // ongoing effort
 
* Hadoop 2.x support // [https://blueprints.launchpad.net/savanna/+spec/vanilla-plugin-hadoop-2 blueprint]
 
* Hadoop 2.x support // [https://blueprints.launchpad.net/savanna/+spec/vanilla-plugin-hadoop-2 blueprint]
 
* Fedora/Ubuntu integration
 
* Fedora/Ubuntu integration
 
* GlusterFS integration
 
* GlusterFS integration
 
* RDO integration
 
* RDO integration
 +
* Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios) // [https://blueprints.launchpad.net/savanna/+spec/vanilla-hadoop-monitoring blueprint]

Revision as of 11:41, 1 October 2013

Version 0.1 - Basic Cluster Provisioning (April, 10 - released)

  • Cluster provisioning
  • Deployment Engine implementation for pre-installed images
  • Templates for Hadoop cluster configuration
  • REST API for cluster startup and operations
  • UI integrated into Horizon

Version 0.2 - Cluster Operations (July, 15 - released)

  • Manual cluster scaling (add/remove nodes)
  • Hadoop cluster topology configuration parameters
    • Data node placement control
    • HDFS location
    • Swift integration
  • Plugin mechanism for integration with different Hadoop distributions
  • Plugins implementation:
    • Vanilla Apache Hadoop with pre-build image
    • Hortonworks Data Platform using Ambari

Version 0.3 - Analytics as a Service (October, 17 - planned)

  • Havana support
  • API to execute Map/Reduce jobs without exposing details of underlying infrastructure (similar to AWS EMR) // blueprints
  • User-friendly UI for ad-hoc analytics queries based on Hive or Pig // blueprint
  • Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum) // blueprint
  • More implementations of plugins //
  • Client libraries and tools // python-savannaclient

Version 1.0 (TBD, targeted for Official OpenStack Incubation)

  • Code hardening
  • Heat integration // details
  • Performance testing
  • Enhanced EDP functionality // ongoing effort
  • Enhanced scalability through scale-out architecture // blueprints // ongoing effort
  • Hadoop 2.x support // blueprint
  • Fedora/Ubuntu integration
  • GlusterFS integration
  • RDO integration
  • Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios) // blueprint