Jump to: navigation, search

Difference between revisions of "Sahara/Roadmap"

(Version 0.3 - Analytics as a Service (October, 15 - planned))
 
(30 intermediate revisions by 6 users not shown)
Line 1: Line 1:
==== Version 0.1 - Basic Cluster Provisioning (April, 10 - released) ====
+
== This page is outdated, take a look at our specs repo for plans: http://specs.openstack.org/openstack/sahara-specs/ ==
 +
 
 +
 
 +
 
 +
 
 +
=== Version 0.1 - Basic Cluster Provisioning (April, 10 - released) ===
  
 
* Cluster provisioning
 
* Cluster provisioning
Line 7: Line 12:
 
* UI integrated into Horizon
 
* UI integrated into Horizon
  
==== Version 0.2 - Cluster Operations (July, 15 - work in progress) ====
+
=== Version 0.2 - Cluster Operations (July, 15 - released) ===
  
 
* Manual cluster scaling (add/remove nodes)
 
* Manual cluster scaling (add/remove nodes)
Line 18: Line 23:
 
** Vanilla Apache Hadoop with pre-build image
 
** Vanilla Apache Hadoop with pre-build image
 
** Hortonworks Data Platform using Ambari
 
** Hortonworks Data Platform using Ambari
* Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios)
 
  
==== Version 0.3 - Analytics as a Service (October, 15 - planned) ====
+
=== Version 0.3 - Analytics as a Service (October, 17 - released) ===
 +
 
 +
* Havana support
 +
* API to execute Map/Reduce jobs without exposing details of underlying infrastructure (similar to AWS EMR) // [https://blueprints.launchpad.net/savanna?searchtext=edp blueprints]
 +
* User-friendly UI for ad-hoc analytics queries based on Hive or Pig // [https://blueprints.launchpad.net/savanna/+spec/edp-savanna-dashboard-ui blueprint]
 +
* Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum) // [https://blueprints.launchpad.net/savanna/+spec/add-neutron-support blueprint]
 +
* More implementations of plugins //
 +
* Client libraries and tools // [https://blueprints.launchpad.net/savanna?searchtext=python-savannaclient python-savannaclient]
 +
* Fedora/RDO integration
 +
 
 +
=== Icehouse - Graduation and Improvements (April, 17 - released) ===
  
* API to execute Map/Reduce jobs without exposing details of underlying infrastructure (similar to AWS EMR)
+
==== Incubation graduation related ====
* User-friendly UI for ad-hoc analytics queries based on Hive or Pig
 
* Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum)
 
* More implementations of plugins
 
  
==== Version 1.0 (TBD - December) ====
+
* CI/CD - devstack, tempest, devstack-gate
 +
* Heat for resources orchestration [https://wiki.openstack.org/wiki/Sahara/HeatIntegration details]
  
* Havanna support
+
==== Other stuff ====
 +
 
 +
* Hadoop 2.x support // [https://blueprints.launchpad.net/sahara/+spec/vanilla-plugin-hadoop-2 blueprint]
 +
* CLI in python-saharaclient
 +
* EDP improvements // ongoing effort
 +
* UI / UX improvements
 
* Code hardening
 
* Code hardening
* HBase support
+
 
 +
You can find more details in [[Sahara/ReleaseNotes/Icehouse|release notes]].
 +
 
 +
=== Further version ===
 +
 
 +
* Implement v2 REST API - polished and based on Pecan/WSME
 +
* Guest agents instead of ssh/http calls from controller
 
* Performance testing
 
* Performance testing
 +
* Integration w/ Ceilometer
 +
* Distributed architecture  // [https://blueprints.launchpad.net/sahara?searchtext=ng- blueprints] // ongoing effort
 +
* Enhanced scalability through scale-out architecture
 +
* Ubuntu integration
 +
* GlusterFS integration
 +
* Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios) // [https://blueprints.launchpad.net/sahara/+spec/vanilla-hadoop-monitoring blueprint]

Latest revision as of 16:54, 18 February 2015

This page is outdated, take a look at our specs repo for plans: http://specs.openstack.org/openstack/sahara-specs/

Version 0.1 - Basic Cluster Provisioning (April, 10 - released)

  • Cluster provisioning
  • Deployment Engine implementation for pre-installed images
  • Templates for Hadoop cluster configuration
  • REST API for cluster startup and operations
  • UI integrated into Horizon

Version 0.2 - Cluster Operations (July, 15 - released)

  • Manual cluster scaling (add/remove nodes)
  • Hadoop cluster topology configuration parameters
    • Data node placement control
    • HDFS location
    • Swift integration
  • Plugin mechanism for integration with different Hadoop distributions
  • Plugins implementation:
    • Vanilla Apache Hadoop with pre-build image
    • Hortonworks Data Platform using Ambari

Version 0.3 - Analytics as a Service (October, 17 - released)

  • Havana support
  • API to execute Map/Reduce jobs without exposing details of underlying infrastructure (similar to AWS EMR) // blueprints
  • User-friendly UI for ad-hoc analytics queries based on Hive or Pig // blueprint
  • Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum) // blueprint
  • More implementations of plugins //
  • Client libraries and tools // python-savannaclient
  • Fedora/RDO integration

Icehouse - Graduation and Improvements (April, 17 - released)

Incubation graduation related

  • CI/CD - devstack, tempest, devstack-gate
  • Heat for resources orchestration details

Other stuff

  • Hadoop 2.x support // blueprint
  • CLI in python-saharaclient
  • EDP improvements // ongoing effort
  • UI / UX improvements
  • Code hardening

You can find more details in release notes.

Further version

  • Implement v2 REST API - polished and based on Pecan/WSME
  • Guest agents instead of ssh/http calls from controller
  • Performance testing
  • Integration w/ Ceilometer
  • Distributed architecture // blueprints // ongoing effort
  • Enhanced scalability through scale-out architecture
  • Ubuntu integration
  • GlusterFS integration
  • Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios) // blueprint