Meetings/TechnicalCommittee/Heat Gap Coverage
< Meetings | TechnicalCommittee
Revision as of 23:41, 6 August 2014 by Steve Baker (talk | contribs) (→Improved functional testing)
The following issues were identified as part of the Heat Gap Analysis that was discussed by the Technical Committee on 15 July 2014.
Mission statement
Heat has a mission statement on its wiki page, but it needs to be proposed formally to the governance repo.
- Owner: zaneb
- Milestone: juno-3
Upgrade testing with Grenade
In order to verify upgradability to new versions of Heat, we need to add it to the Grenade test suite. A patch has already been proposed, and work is ongoing to get it ready to be merged.
- Owner: shardy
- Milestone: juno-3
Improved functional testing
Progress on writing heat functional tests has been slow for a few reasons including:
- Review bandwidth for tempest changes
- The challenge of building a custom full OS in the gate environment
The high-level plan for closing this gap is:
- Move the existing tempest orchestration scenario tests into the heat tree to be the first heat functional tests. The tests will depend on heatclient and a working OpenStack cloud (usually devstack)
- Core team members will write functional tests for existing features
- New features will receive a -1 until they are accompanied with functional tests
- Building a custom OS during a gate run will make it possible to write functional tests that interact with more configuration tools
- Rackspace QE will contribute some of their tests to the heat functional tests
- HP developers will work partly on Tempest tests as they get up to speed on Heat
- When tempest-lib is ready, move the existing tempest orchestration API tests into the heat functional tests
Specific changes which are ready for review now:
- https://review.openstack.org/#/c/111087/ Define *-heat-dsvm-functional job
- https://review.openstack.org/#/q/status:open+project:openstack/heat+topic:bp/functional-tests,n,z Initial heat functional tests
- https://review.openstack.org/#/q/status:open+topic:dib-gate,n,z Build a heat functional tests custom image during a devstack run during gate
- Owner: stevebaker
- Milestone: juno-3