Difference between revisions of "Sahara/Roadmap"
< Sahara
(→Phase 3 - Analytics as a Service (October, 15 - planned)) |
|||
(36 intermediate revisions by 6 users not shown) | |||
Line 1: | Line 1: | ||
− | ==== | + | == This page is outdated, take a look at our specs repo for plans: http://specs.openstack.org/openstack/sahara-specs/ == |
+ | |||
+ | |||
+ | |||
+ | |||
+ | === Version 0.1 - Basic Cluster Provisioning (April, 10 - released) === | ||
* Cluster provisioning | * Cluster provisioning | ||
Line 7: | Line 12: | ||
* UI integrated into Horizon | * UI integrated into Horizon | ||
− | === | + | === Version 0.2 - Cluster Operations (July, 15 - released) === |
* Manual cluster scaling (add/remove nodes) | * Manual cluster scaling (add/remove nodes) | ||
Line 14: | Line 19: | ||
** HDFS location | ** HDFS location | ||
** Swift integration | ** Swift integration | ||
− | * | + | * Plugin mechanism for integration with different Hadoop distributions |
− | * | + | * Plugins implementation: |
+ | ** Vanilla Apache Hadoop with pre-build image | ||
+ | ** Hortonworks Data Platform using Ambari | ||
+ | |||
+ | === Version 0.3 - Analytics as a Service (October, 17 - released) === | ||
+ | |||
+ | * Havana support | ||
+ | * API to execute Map/Reduce jobs without exposing details of underlying infrastructure (similar to AWS EMR) // [https://blueprints.launchpad.net/savanna?searchtext=edp blueprints] | ||
+ | * User-friendly UI for ad-hoc analytics queries based on Hive or Pig // [https://blueprints.launchpad.net/savanna/+spec/edp-savanna-dashboard-ui blueprint] | ||
+ | * Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum) // [https://blueprints.launchpad.net/savanna/+spec/add-neutron-support blueprint] | ||
+ | * More implementations of plugins // | ||
+ | * Client libraries and tools // [https://blueprints.launchpad.net/savanna?searchtext=python-savannaclient python-savannaclient] | ||
+ | * Fedora/RDO integration | ||
+ | |||
+ | === Icehouse - Graduation and Improvements (April, 17 - released) === | ||
+ | |||
+ | ==== Incubation graduation related ==== | ||
+ | |||
+ | * CI/CD - devstack, tempest, devstack-gate | ||
+ | * Heat for resources orchestration [https://wiki.openstack.org/wiki/Sahara/HeatIntegration details] | ||
+ | |||
+ | ==== Other stuff ==== | ||
− | + | * Hadoop 2.x support // [https://blueprints.launchpad.net/sahara/+spec/vanilla-plugin-hadoop-2 blueprint] | |
+ | * CLI in python-saharaclient | ||
+ | * EDP improvements // ongoing effort | ||
+ | * UI / UX improvements | ||
+ | * Code hardening | ||
− | + | You can find more details in [[Sahara/ReleaseNotes/Icehouse|release notes]]. | |
− | |||
− | |||
− | + | === Further version === | |
− | * | + | * Implement v2 REST API - polished and based on Pecan/WSME |
− | ** | + | * Guest agents instead of ssh/http calls from controller |
− | ** | + | * Performance testing |
− | * | + | * Integration w/ Ceilometer |
+ | * Distributed architecture // [https://blueprints.launchpad.net/sahara?searchtext=ng- blueprints] // ongoing effort | ||
+ | * Enhanced scalability through scale-out architecture | ||
+ | * Ubuntu integration | ||
+ | * GlusterFS integration | ||
+ | * Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios) // [https://blueprints.launchpad.net/sahara/+spec/vanilla-hadoop-monitoring blueprint] |
Latest revision as of 16:54, 18 February 2015
Contents
- 1 This page is outdated, take a look at our specs repo for plans: http://specs.openstack.org/openstack/sahara-specs/
This page is outdated, take a look at our specs repo for plans: http://specs.openstack.org/openstack/sahara-specs/
Version 0.1 - Basic Cluster Provisioning (April, 10 - released)
- Cluster provisioning
- Deployment Engine implementation for pre-installed images
- Templates for Hadoop cluster configuration
- REST API for cluster startup and operations
- UI integrated into Horizon
Version 0.2 - Cluster Operations (July, 15 - released)
- Manual cluster scaling (add/remove nodes)
- Hadoop cluster topology configuration parameters
- Data node placement control
- HDFS location
- Swift integration
- Plugin mechanism for integration with different Hadoop distributions
- Plugins implementation:
- Vanilla Apache Hadoop with pre-build image
- Hortonworks Data Platform using Ambari
Version 0.3 - Analytics as a Service (October, 17 - released)
- Havana support
- API to execute Map/Reduce jobs without exposing details of underlying infrastructure (similar to AWS EMR) // blueprints
- User-friendly UI for ad-hoc analytics queries based on Hive or Pig // blueprint
- Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum) // blueprint
- More implementations of plugins //
- Client libraries and tools // python-savannaclient
- Fedora/RDO integration
Icehouse - Graduation and Improvements (April, 17 - released)
- CI/CD - devstack, tempest, devstack-gate
- Heat for resources orchestration details
Other stuff
- Hadoop 2.x support // blueprint
- CLI in python-saharaclient
- EDP improvements // ongoing effort
- UI / UX improvements
- Code hardening
You can find more details in release notes.
Further version
- Implement v2 REST API - polished and based on Pecan/WSME
- Guest agents instead of ssh/http calls from controller
- Performance testing
- Integration w/ Ceilometer
- Distributed architecture // blueprints // ongoing effort
- Enhanced scalability through scale-out architecture
- Ubuntu integration
- GlusterFS integration
- Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios) // blueprint