Jump to: navigation, search

Difference between revisions of "Networking-vpp/test-plan"

(Networking-VPP test plan document)
 
 
(3 intermediate revisions by one other user not shown)
Line 1: Line 1:
 
{| class="wikitable"
 
{| class="wikitable"
! style="background:yellow;"| '''Unit Tests''' !!  !!  !!  !! style="background:yellow;"|'''Run Cadence''' !! style="background:yellow;"|'''Run Location''' !!  !!  !!  !!
+
! style="background:yellow;"| '''Unit Tests''' !! style="background:yellow;"|'''Run Cadence''' !! style="background:yellow;"|'''Run Location'''
 
|-
 
|-
| VPPMechanismDriver || style="background:green;"| Shriram ||  ||  || Every Review || Codebase || ||  || style="background:green; width:20px"| ||  Complete
+
| VPPMechanismDriver || Every Review || Codebase || !! style="background:green;"|  
 
|-
 
|-
| EtcdAgentCommunicator || style="background:green;"| Shriram ||  ||  || Every Review || Codebase || ||  || style="background:orange;"| ||  Code Complete
+
| EtcdAgentCommunicator || Every Review || Codebase || !! style="background:green;"|  
 
|-
 
|-
| VPPForwarder || style="background:orange;"|Shriram ||  ||  || Every Review || Codebase || ||  || style="background:green; border: 3px solid black"| ||Running/Passed
+
| VPPForwarder || Every Review || Codebase || !! style="background:green;"|  
 
|-
 
|-
| EtcdListener ||  ||  ||  || Every Review || Codebase || ||  || style="background:red; border: 3px solid black"| || Running/Failed
+
| EtcdListener || Every Review || Codebase || !! style="background:green;"|  
 
|-
 
|-
| EtcdHelper ||  ||  ||  || Every Review || Codebase || ||  ||  ||  
+
| EtcdHelper || Every Review || Codebase || !! style="background:green;"|  
 
|-
 
|-
| VPPInterface ||  ||  ||  || Every Review || Codebase || ||  |||
+
| VPPInterface || Every Review || Codebase || !! style="background:green;"|   
 
|-
 
|-
| VPPRestart ||  ||  ||  || Every Review || Codebase || ||  ||  ||  
+
| VPPRestart || Every Review || Codebase || !! style="background:green;"|  
 
|-
 
|-
! style="background:yellow;"|'''Functional Testing''' !! style="background:yellow;"|'''Openstack/Devstack''' !! style="background:yellow;"|'''Mercury''' !!  !!  !!  !!  !!  !!  !! style="background:yellow;"|'''Additional Notes'''
+
! style="background:yellow;"|'''Functional Testing''' || ||
 
|-
 
|-
! '''Single Node Scenarios''' !!  !!  !!  !!  !!  !!  !!  !!  !! Auto-file bugs
+
! style="background:yellow;"| '''Single Node Scenarios''' || ||
 
|-
 
|-
| Add port ||  ||  ||  || Every Review || Openstack CI || ||  ||  ||  
+
| DSVM Tempest Full || Every Review || Openstack CI || !! style="background:orange;"|  
 
|-
 
|-
| Delete port || ||  ||  || Every Review || Openstack CI ||  ||  ||  ||  
+
! style="background:yellow;"|'''Multi Node Scenarios''' || ||
 
|-
 
|-
| || || ||  ||  ||  ||  ||  ||  ||  
+
| LISP-GPE/Layer 3 || Every Patchset || 3rd Party CI (Openstack Cloud) ||  
 
|-
 
|-
| VPP Agent Restart ||  ||  || || Every Review || Openstack CI ||  ||  ||  ||
+
! style="background:yellow;"|'''Negative Testing''' !! !!
 
|-
 
|-
| Etcd Restart ||  ||  || || Every Review || Openstack CI ||  ||  ||  ||  
+
|  ||  || 3rd Party CI (Openstack Cloud) ||
 
|-
 
|-
||  ||  ||  ||  ||  ||  ||  ||  ||
+
! style="background:yellow;"|'''Compatibility Testing''' !! !!
 
|-
 
|-
| || || ||  ||  ||  ||  ||  ||  ||  
+
| Liberty || Every Patchset || 3rd Party CI (Openstack Cloud) ||
 
|-
 
|-
! style="background:yellow;"|'''Multi Node Scenarios''' !!  !!  !!  !!  !!  !!  !!  !!  !!
+
| Mitaka || Every Patchset || 3rd Party CI (Openstack Cloud) ||
 
|-
 
|-
| (Tim/Alec) ||  ||  ||  || || (Alec) ||  ||  ||  ||  
+
| Newton || Every Patchset || 3rd Party CI (Openstack Cloud) ||
 
|-
 
|-
| || ||  ||  ||  ||  ||  ||  ||  ||
+
| Ocata || Every Patchset || 3rd Party CI (Openstack Cloud) ||
|-
 
! style="background:yellow;"|'''Performance Testing (CSIT)''' !! style="background:yellow;"| '''Openstack/Devstack''' !!style="background:yellow;"| '''Mercury''' !!  !!  !!  !!  !!  !!  !!
 
|-
 
! '''Single Node Scenario''' !!  !!  !!  !!  !!  !!  !!  !!  !!
 
|-
 
| 2p1nic-eth-l2bdbase-eth-2vhost-1vm ||  ||  ||  || CSIT Cadence || FD.io Infra ||  ||  ||  ||
 
|-
 
| 2p1nic-dot1q-l2bdbase-eth-2vhost-1vm ||  ||  ||  || CSIT Cadence || FD.io Infra ||  ||  ||  ||
 
|-
 
| 2p1nic-ethip4-ip4base-eth-2vhost-1vm ||  ||  ||  || CSIT Cadence || FD.io Infra ||  ||  ||  ||
 
|-
 
| 2p1nic-eth-l2xcbase-eth-2vhost-1vm ||  ||  ||  || CSIT Cadence || FD.io Infra ||  ||  ||  ||
 
|-
 
| 2p1nic-dot1q-l2xcbase-eth-2vhost-1vm ||  ||  ||  || CSIT Cadence || FD.io Infra ||  ||  ||  ||
 
|-
 
| 2p1nic-ethip4vxlan-l2bdbase-eth-2vhost-1vm ||  ||  ||  || CSIT Cadence || FD.io Infra ||  ||  ||  ||
 
|-
 
|  ||  ||  ||  ||  ||  ||  ||  ||  ||
 
|-
 
! '''Multi Node Scenario''' !!  !!  !!  !!  !!  !!  !!  !!  !!
 
|-
 
| (Tim/Alec) ||  ||  ||  ||  ||  ||  ||  ||  ||
 
|-
 
|  ||  ||  ||  ||  ||  ||  ||  ||  ||
 
|-
 
! style="background:yellow;"|'''Tempest Testing''' !! style="background:yellow;"|'''Openstack/Devstack''' !! style="background:yellow;"|'''Mercury''' !!  !! style="background:yellow;"|'''(Third Party CI)''' !!  !!  !!  !!  !!
 
|-
 
| Tempest Smoke Serial (Colorado 3.0) ||  ||  ||  || Every Commit/Not Gating || Innovation Pod ||  ||  ||  ||
 
|-
 
| '''Standard Suite''' ||  ||  ||  ||  ||  ||  ||  ||  ||
 
|-
 
| '''Additional Scenarios''' ||  ||  ||  ||  ||  ||  ||  ||  ||
 
|-
 
|  ||  ||  ||  ||  ||  ||  ||  ||  ||
 
|-
 
! style="background:yellow;"|'''System Integration''' !!  !!  !!  !!  !!  !!  !!  !!  !!
 
|-
 
| VPP Version || Latest Release ||  ||  ||  ||  ||  ||  ||  ||
 
|-
 
| Openstack Version ||  ||  ||  ||  ||  ||  ||  ||  ||
 
|-
 
| Networking-vpp Version || TOT ||  ||  ||  ||  ||  ||  ||  ||
 
|-
 
| Etcd Version ||  ||  ||  ||  ||  ||  ||  ||  ||  
 
 
|}
 
|}

Latest revision as of 18:59, 19 June 2017

Unit Tests Run Cadence Run Location
VPPMechanismDriver Every Review Codebase
EtcdAgentCommunicator Every Review Codebase
VPPForwarder Every Review Codebase
EtcdListener Every Review Codebase
EtcdHelper Every Review Codebase
VPPInterface Every Review Codebase
VPPRestart Every Review Codebase
Functional Testing
Single Node Scenarios
DSVM Tempest Full Every Review Openstack CI
Multi Node Scenarios
LISP-GPE/Layer 3 Every Patchset 3rd Party CI (Openstack Cloud)
Negative Testing
3rd Party CI (Openstack Cloud)
Compatibility Testing
Liberty Every Patchset 3rd Party CI (Openstack Cloud)
Mitaka Every Patchset 3rd Party CI (Openstack Cloud)
Newton Every Patchset 3rd Party CI (Openstack Cloud)
Ocata Every Patchset 3rd Party CI (Openstack Cloud)