Jump to: navigation, search

Difference between revisions of "Sahara/RoadmapNew"

(Created page with "==== Version 0.1 - Basic Cluster Provisioning (April, 10 - released) ==== === Cluster provisioning === === Deployment Engine implementation for pre-installed images === === T...")
 
Line 1: Line 1:
==== Version 0.1 - Basic Cluster Provisioning (April, 10 - released) ====
+
=== Version 0.3 - Analytics as a Service (October, 15 - planned) ===
  
=== Cluster provisioning ===
+
==== EDP:  MapReduce jobs exec ====
=== Deployment Engine implementation for pre-installed images ===
+
API to execute MapReduce jobs without exposing details of underlying infrastructure (similar to AWS EMR)
=== Templates for Hadoop cluster configuration ===
 
=== REST API for cluster startup and operations ===
 
=== UI integrated into Horizon ===
 
  
==== Version 0.2 - Cluster Operations (July, 15 - released) ====
+
* bp 1
 +
* bp 2
 +
* etc.
  
* Manual cluster scaling (add/remove nodes)
+
==== EDP: Pig/Hive support  ====
* Hadoop cluster topology configuration parameters
+
User-friendly UI for ad-hoc analytics queries based on Hive or Pig
** Data node placement control
 
** HDFS location
 
** Swift integration
 
* Plugin mechanism for integration with different Hadoop distributions
 
* Plugins implementation:
 
** Vanilla Apache Hadoop with pre-build image
 
** Hortonworks Data Platform using Ambari
 
  
==== Version 0.3 - Analytics as a Service (October, 15 - planned) ====
+
* bp 1
 +
* bp 2
 +
* etc.
  
* API to execute Map/Reduce jobs without exposing details of underlying infrastructure (similar to AWS EMR)
+
==== Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum) ====
* User-friendly UI for ad-hoc analytics queries based on Hive or Pig
+
==== More implementations of plugins ====
* Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum)
+
==== Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios) ====
* More implementations of plugins
+
==== Client libraries and tools ====
* Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios)
+
==== Enhanced scalability through scale-out architecture ====
* Client libraries and tools
 
* Enhanced scalability through scale-out architecture
 
 
 
==== Version 1.0 (TBD, targeted for Official OpenStack Incubation) ====
 
 
 
* Havana support
 
* Code hardening
 
* HBase support
 
* Performance testing
 
* Enhanced EDP functionality (ongoing effort)
 
* Enhanced scalability (ongoing effort)
 
* Hadoop 2.x support
 
* Fedora/Ubuntu integration
 
* GlusterFS integration
 
* RDO integration
 

Revision as of 18:02, 8 August 2013

Version 0.3 - Analytics as a Service (October, 15 - planned)

EDP: MapReduce jobs exec

API to execute MapReduce jobs without exposing details of underlying infrastructure (similar to AWS EMR)

  • bp 1
  • bp 2
  • etc.

EDP: Pig/Hive support

User-friendly UI for ad-hoc analytics queries based on Hive or Pig

  • bp 1
  • bp 2
  • etc.

Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum)

More implementations of plugins

Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios)

Client libraries and tools

Enhanced scalability through scale-out architecture