Jump to: navigation, search

Difference between revisions of "Sahara/Roadmap"

(Version 0.3 - Analytics as a Service (October, 15 - planned))
(Version 0.3 - Analytics as a Service (October, 15 - planned))
Line 21: Line 21:
 
==== Version 0.3 - Analytics as a Service (October, 15 - planned) ====
 
==== Version 0.3 - Analytics as a Service (October, 15 - planned) ====
  
* API to execute Map/Reduce jobs without exposing details of underlying infrastructure (similar to AWS EMR) /[https://blueprints.launchpad.net/savanna?searchtext=edp all blueprints]/
+
* API to execute Map/Reduce jobs without exposing details of underlying infrastructure (similar to AWS EMR) / [https://blueprints.launchpad.net/savanna?searchtext=edp all blueprints]  
* User-friendly UI for ad-hoc analytics queries based on Hive or Pig /[https://blueprints.launchpad.net/savanna/+spec/edp-savanna-dashboard-ui blueprint]/
+
* User-friendly UI for ad-hoc analytics queries based on Hive or Pig / [https://blueprints.launchpad.net/savanna/+spec/edp-savanna-dashboard-ui blueprint]
* Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum) /[https://blueprints.launchpad.net/savanna/+spec/add-neutron-support blueprint]/
+
* Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum) / [https://blueprints.launchpad.net/savanna/+spec/add-neutron-support blueprint]
 
* More implementations of plugins
 
* More implementations of plugins
* Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios) /[https://blueprints.launchpad.net/savanna/+spec/vanilla-hadoop-monitoring blueprint]/
+
* Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios) / [https://blueprints.launchpad.net/savanna/+spec/vanilla-hadoop-monitoring blueprint]
* Client libraries and tools /[https://blueprints.launchpad.net/savanna?searchtext=python-savannaclient python-savannaclient]/
+
* Client libraries and tools / [https://blueprints.launchpad.net/savanna?searchtext=python-savannaclient python-savannaclient]
* Enhanced scalability through scale-out architecture /[https://blueprints.launchpad.net/savanna?searchtext=ng- blueprints]/
+
* Enhanced scalability through scale-out architecture / [https://blueprints.launchpad.net/savanna?searchtext=ng- blueprints]
  
 
==== Version 1.0 (TBD, targeted for Official OpenStack Incubation) ====
 
==== Version 1.0 (TBD, targeted for Official OpenStack Incubation) ====

Revision as of 10:15, 13 August 2013

Version 0.1 - Basic Cluster Provisioning (April, 10 - released)

  • Cluster provisioning
  • Deployment Engine implementation for pre-installed images
  • Templates for Hadoop cluster configuration
  • REST API for cluster startup and operations
  • UI integrated into Horizon

Version 0.2 - Cluster Operations (July, 15 - released)

  • Manual cluster scaling (add/remove nodes)
  • Hadoop cluster topology configuration parameters
    • Data node placement control
    • HDFS location
    • Swift integration
  • Plugin mechanism for integration with different Hadoop distributions
  • Plugins implementation:
    • Vanilla Apache Hadoop with pre-build image
    • Hortonworks Data Platform using Ambari

Version 0.3 - Analytics as a Service (October, 15 - planned)

  • API to execute Map/Reduce jobs without exposing details of underlying infrastructure (similar to AWS EMR) / all blueprints
  • User-friendly UI for ad-hoc analytics queries based on Hive or Pig / blueprint
  • Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum) / blueprint
  • More implementations of plugins
  • Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios) / blueprint
  • Client libraries and tools / python-savannaclient
  • Enhanced scalability through scale-out architecture / blueprints

Version 1.0 (TBD, targeted for Official OpenStack Incubation)

  • Havana support
  • Code hardening
  • HBase support
  • Performance testing
  • Enhanced EDP functionality (ongoing effort)
  • Enhanced scalability (ongoing effort)
  • Hadoop 2.x support
  • Fedora/Ubuntu integration
  • GlusterFS integration
  • RDO integration