Sahara/CDHPlugin

Introduction

The CDH plugin allows Sahara to configure Hadoop clusters on OpenStack clouds by using Cloudera Manager through the API.

Requirements

Vanilla OS images with cloud-init that are supported by Cloudera Manager:

http://www.cloudera.com/content/cloudera-content/cloudera-docs/CM4Ent/latest/Cloudera-Manager-Installation-Guide/cmig_cm_requirements.html

An OpenStack Grizzly or newer private or public cloud.

Implementation Notes

TODO

Work in progress branch on GitHub:

https://github.com/andreisavu/savanna/compare/bp;cdh-plugin

Relevant documentation pages:

• https://savanna.readthedocs.org/en/latest/devref/plugins.html
• https://savanna.readthedocs.org/en/latest/devref/plugin.spi.html

Related Resources

Python API client for Cloudera Manager:

• https://pypi.python.org/pypi/cm-api
• http://cloudera.github.io/cm_api/
• http://cloudera.github.io/cm_api/apidocs/v4/index.html
• http://blog.cloudera.com/blog/2012/09/automating-your-cluster-with-cloudera-manager-api/

Similar work in Apache Whirr:

• https://github.com/cloudera/whirr-cm
• http://whirr.apache.org/

Similar work in Dell Crowbar:

• http://blog.cloudera.com/blog/2013/08/how-to-deploy-hadoop-clusters-automatically-with-dell-crowbar-and-cloudera-manager/