Sahara/SaharaCI

Sahara CI

Sahara CI infrastructure

Sahara CI contains Jenkins, Zuul, Nodepool and server with Devstack, where running Jenkins slaves. Jenkins is controlled for the most part by Zuul which determines what jobs are run when. Nodepool deploys and manages a pool of slaves images on a Devstack server for use in Jenkins jobs.

Jenkins is available by address: https://sahara.mirantis.com/jenkins
Zuul status is available by address: https://sahara.mirantis.com/zuul
Auth using launchpad.net SSO.

For installing Sahara CI use Puppet scripts, which are placed in repo: https://github.com/savanna-project/savanna-ci/tree/master/config/deploy-ci
During installation you must specify some parameters for Jenkins, Zuul and Nodepool (see: https://github.com/savanna-project/savanna-ci/blob/master/config/deploy-ci/README.rst). After that will be run Puppet scripts, which install Jenkins, Zuul and Nodepool.

Sahara CI configuration

All configuration files and scripts are placed in repo: http://github.com/stackforge/sahara-ci-config

For configuring Jenkins jobs uses Jenkins Job Builder system with YAML files. Jobs should be created and reconfigured through Jenkins Job Builder to avoid conflicts and unexpected changes. JJB is installed in virtual environment on Sahara Jenkins server.

For Zuul and Nodepool use settings, which configured to VM with Devstack.

Zuul triggers

Zuul triggers jobs on patch sets to the next repos:
- http://github.com/openstack/sahara
- http://github.com/openstack/sahara-dashboard
- http://github.com/openstack/python-saharaclient
- http://github.com/openstack/sahara-image-elements

For openstack/sahara and openstack/python-saharaclient repos will be triggered next jobs with integration tests for all Sahara plugins:
- gate-sahara-integration-hdp1 / gate-saharaclient-integration-hdp1
- gate-sahara-integration-hdp2 / gate-saharaclient-integration-hdp2
- gate-sahara-integration-vanilla-1 / gate-saharaclient-integration-vanilla-1
- gate-sahara-integration-vanilla-2.3 / gate-saharaclient-integration-vanilla-2.3
- gate-sahara-integration-vanilla-2.4 / gate-saharaclient-integration-vanilla-2.4
- gate-sahara-integration-transient / gate-saharaclient-integration-transient
- gate-sahara-integration-heat_transient / gate-saharaclient-integration-heat_transient
- gate-sahara-integration-spark / gate-saharaclient-integration-spark
- gate-sahara-integration-cdh-centos / gate-saharaclient-integration-cdh-centos
- gate-sahara-integration-cdh-ubuntu / gate-saharaclient-integration-cdh-ubuntu

Sahara CI testing matrix:

Job name	Sahara run mode	Infrastructure engine	Network provider
integration-hdp1	Stand alone	Direct	Nova-network
integration-hdp2	Distributed	Heat	Nova-network
integration-vanilla-1	Stand alone	Direct	Neutron
integration-vanilla-2.3	Stand alone	Direct	Neutron
integration-vanilla-2.4	Distributed	Heat	Neutron
integration-spark	Stand alone	Direct	Neutron
integration-transient	Stand alone	Direct	Neutron
integration-heat_transient	Stand alone	Heat	Neutron
integration-cdh-centos	Stand alone	Direct	Nova-network
integration-cdh-ubuntu	Stand alone	Direct	Nova-network

Sahara Dashboard is integrated into Horizon now. So, for openstack/horizon repo will be triggered job:
- gate-ui-tests
For openstack/sahara-dashboard repo will be triggered job with UI tests:
- gate-uitests-tests

For openstack/sahara-image-elements repo will be triggered jobs, which build image using disk-image-builder for each Sahara plugin at first and then run integration tests:
- diskimage-integration-hdp1
- diskimage-integration-hdp2
- diskimage-integration-spark
- diskimage-integration-vanilla-centos-1
- diskimage-integration-vanilla-fedora-1
- diskimage-integration-vanilla-ubuntu-1
- diskimage-integration-vanilla-centos-2.3
- diskimage-integration-vanilla-fedora-2.3
- diskimage-integration-vanilla-ubuntu-2.3
- diskimage-integration-vanilla-centos-2.4
- diskimage-integration-vanilla-fedora-2.4
- diskimage-integration-vanilla-ubuntu-2.4
- diskimage-integration-cdh-centos
- diskimage-integration-cdh-ubuntu

Additionally, openstackgerrit bot writes info about changes in gerrit to #savanna channel at freenode.