Jump to: navigation, search

Sahara/Roadmap

This page is outdated, take a look at our specs repo for plans: http://specs.openstack.org/openstack/sahara-specs/

Version 0.1 - Basic Cluster Provisioning (April, 10 - released)

  • Cluster provisioning
  • Deployment Engine implementation for pre-installed images
  • Templates for Hadoop cluster configuration
  • REST API for cluster startup and operations
  • UI integrated into Horizon

Version 0.2 - Cluster Operations (July, 15 - released)

  • Manual cluster scaling (add/remove nodes)
  • Hadoop cluster topology configuration parameters
    • Data node placement control
    • HDFS location
    • Swift integration
  • Plugin mechanism for integration with different Hadoop distributions
  • Plugins implementation:
    • Vanilla Apache Hadoop with pre-build image
    • Hortonworks Data Platform using Ambari

Version 0.3 - Analytics as a Service (October, 17 - released)

  • Havana support
  • API to execute Map/Reduce jobs without exposing details of underlying infrastructure (similar to AWS EMR) // blueprints
  • User-friendly UI for ad-hoc analytics queries based on Hive or Pig // blueprint
  • Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum) // blueprint
  • More implementations of plugins //
  • Client libraries and tools // python-savannaclient
  • Fedora/RDO integration

Icehouse - Graduation and Improvements (April, 17 - released)

Incubation graduation related

  • CI/CD - devstack, tempest, devstack-gate
  • Heat for resources orchestration details

Other stuff

  • Hadoop 2.x support // blueprint
  • CLI in python-saharaclient
  • EDP improvements // ongoing effort
  • UI / UX improvements
  • Code hardening

You can find more details in release notes.

Further version

  • Implement v2 REST API - polished and based on Pecan/WSME
  • Guest agents instead of ssh/http calls from controller
  • Performance testing
  • Integration w/ Ceilometer
  • Distributed architecture // blueprints // ongoing effort
  • Enhanced scalability through scale-out architecture
  • Ubuntu integration
  • GlusterFS integration
  • Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios) // blueprint