Sahara/Roadmap
Contents
Version 0.1 - Basic Cluster Provisioning (April, 10 - released)
- Cluster provisioning
- Deployment Engine implementation for pre-installed images
- Templates for Hadoop cluster configuration
- REST API for cluster startup and operations
- UI integrated into Horizon
Version 0.2 - Cluster Operations (July, 15 - released)
- Manual cluster scaling (add/remove nodes)
- Hadoop cluster topology configuration parameters
- Data node placement control
- HDFS location
- Swift integration
- Plugin mechanism for integration with different Hadoop distributions
- Plugins implementation:
- Vanilla Apache Hadoop with pre-build image
- Hortonworks Data Platform using Ambari
Version 0.3 - Analytics as a Service (October, 17 - released)
- Havana support
- API to execute Map/Reduce jobs without exposing details of underlying infrastructure (similar to AWS EMR) // blueprints
- User-friendly UI for ad-hoc analytics queries based on Hive or Pig // blueprint
- Network configuration support, integration with Neutron (OpenStack Networking, earlier Quantum) // blueprint
- More implementations of plugins //
- Client libraries and tools // python-savannaclient
- Fedora/RDO integration
Icehouse - Graduation and Improvements (April, 17 - released)
- CI/CD - devstack, tempest, devstack-gate
- Heat for resources orchestration details
Other stuff
- Hadoop 2.x support // blueprint
- CLI in python-saharaclient
- EDP improvements // ongoing effort
- UI / UX improvements
- Code hardening
You can find more details in release notes.
Further version
- Implement v2 REST API - polished and based on Pecan/WSME
- Guest agents instead of ssh/http calls from controller
- Performance testing
- Integration w/ Ceilometer
- Distributed architecture // blueprints // ongoing effort
- Enhanced scalability through scale-out architecture
- Ubuntu integration
- GlusterFS integration
- Monitoring support - integration with 3rd-party monitoring tools (Zabbix, Nagios) // blueprint