Jump to: navigation, search

Cinder/tested-3rdParty-drivers

< Cinder
Revision as of 19:42, 28 July 2014 by John-griffith (talk | contribs) (Driver 3rd party testing)

Driver Testing

Testing for current Icehouse release

The idea of requiring drivers to run functional tests is new to the Icehouse release. To get started with this process we've implemented a simple wrapper around the tempest volume.api tests at https://github.com/openstack-dev/devstack/tree/master/driver_certs . The process currently is for each vendor to run this test against their backend driver in their own environment. The wrapper is very simple, it just does a fresh clone of the cinder and tempest repos and restarts services, then runs the tempest volume.api tagged tests in the tempest suites and collects the output to a temporary log file.

This is far from extensive or ideal, however it's already uncovered a number of issues with existing drivers and has proven to be a beneficial process. Currently this is a manual process that we'd like to see run/updated at each milestone and at each RC for Icehouse. The current list of the most recent run of the tests and a link to the resultant log files is included in the table found at the bottom of this wiki page.

Testing requirements for upcoming Juno release

To be designated as compatible, a third-party plugin and/or driver code must implement external third party testing. The testing should be Tempest executed against a Devstack build with the proposed code changes. The environment managed by the vendor should be configured to incorporate the plugin and/or driver solution. The OpenStack Infrastructure team has provided details on how to integrate 3rd party testing at:

http://ci.openstack.org/third_party.html

and Tempest can be found at:

https://github.com/openstack/tempest

The Cinder team expects that the third party testing will provide a +/-1 verify vote for all changes to any cinder code. In addition, the Cinder team expects that the third party test will also vote on all code submissions by the jenkins user. The jenkins user regularly submits requirements changes and the Cinder team hopes to catch any possible regressions as early as possible. More information on drivers, the Cinder CI policy and additional links to setting up a CI system at:

https://wiki.openstack.org/wiki/Cinder/how-to-contribute-a-driver

Most Recent Results for Icehouse

Driver Name Pass/Fail Link to Log Files Date of Test Run
SolidFire Pass https://s3.amazonaws.com/solidfire-cert-results/tmp.wsfgEXbccC Feb 13, 2014
IBM XIV Pass https://bugs.launchpad.net/cinder/+bug/1281119 Mar 20, 2014
IBM GPFS Pass https://bugs.launchpad.net/cinder/+bug/1280482 Feb 14, 2014
NetApp 7-Mode (iSCSI) Pass https://bugs.launchpad.net/cinder/+bug/1298023 Mar 26, 2014
NetApp 7-Mode (NFS) Pass https://bugs.launchpad.net/cinder/+bug/1298035 Mar 26, 2014
NetApp C-Mode (iSCSI) Pass https://bugs.launchpad.net/cinder/+bug/1293728 Mar 17, 2014
NetApp C-Mode (NFS) Pass https://bugs.launchpad.net/cinder/+bug/1294733 Mar 19, 2014
NetApp E-Series (iSCSI) Pass https://launchpadlibrarian.net/166301064/eseries_cinder_certification.log Feb 14, 2014
IBM NAS (SONAS & Storwize V7000 Unified) Pass https://launchpadlibrarian.net/166535360/tmp.Q9QyLRIqGx Feb 15, 2014
HP 3PAR StoreServ(FC) Pass https://bugs.launchpad.net/cinder/+bug/1278575 Feb 5, 2014
HP 3PAR StoreServ(ISCSI) Pass https://bugs.launchpad.net/cinder/+bug/1278577 Feb 5, 2014
HP LeftHand StoreVirtual Pass https://bugs.launchpad.net/cinder/+bug/1276809 Feb 3, 2014
HP MSA (FC) Pass https://bugs.launchpad.net/cinder/+bug/1282628 Feb 20, 2014
IBM Storwize/SVC (FC) Pass https://bugs.launchpad.net/cinder/+bug/1280736 Feb 16, 2014
IBM Storwize/SVC (iSCSI) Pass https://bugs.launchpad.net/cinder/+bug/1279252 Feb 12, 2014
EMC SMI-S (FC) Pass https://bugs.launchpad.net/cinder/+bug/1286529 Mar 1, 2014
EMC SMI-S (iSCSI) Pass https://bugs.launchpad.net/cinder/+bug/1286529 Mar 1, 2014
Dell EqualLogic Pass https://bugs.launchpad.net/cinder/+bug/1289061 Mar 6, 2014
EMC VNX Direct (iSCSI) Pass https://bugs.launchpad.net/cinder/+bug/1283507 Mar 4, 2014
VMware Vmdk Driver Pass https://bugs.launchpad.net/cinder/+bug/1295544 Mar 21, 2014
Nimble Storage (iSCSI) Pass https://bugs.launchpad.net/cinder/+bug/1308624 Jun 25, 2014
Zadara Storage Pass https://bugs.launchpad.net/cinder/+bug/1346692 Jul 22, 2014
Example Example Example Example