Jump to: navigation, search

Difference between revisions of "Networking-vpp/test-plan"

 
Line 1: Line 1:
 
{| class="wikitable"
 
{| class="wikitable"
−
! style="background:yellow;"| '''Unit Tests''' !!  !!  !!  !! style="background:yellow;"|'''Run Cadence''' !! style="background:yellow;"|'''Run Location''' !!  !!  !!  !!
+
! style="background:yellow;"| '''Unit Tests''' !! style="background:yellow;"|'''Run Cadence''' !! style="background:yellow;"|'''Run Location'''
 
|-
 
|-
−
| VPPMechanismDriver || style="background:green;"| Shriram ||  ||  || Every Review || Codebase || ||  || style="background:green; width:20px"| ||  Complete
+
| VPPMechanismDriver || Every Review || Codebase || !! style="background:green;"|  
 
|-
 
|-
−
| EtcdAgentCommunicator || style="background:green;"| Shriram ||  ||  || Every Review || Codebase || ||  || style="background:orange;"| ||  Code Complete
+
| EtcdAgentCommunicator || Every Review || Codebase || !! style="background:green;"|  
 
|-
 
|-
−
| VPPForwarder || style="background:orange;"|Shriram ||  ||  || Every Review || Codebase || ||  || style="background:green; border: 3px solid black"| ||Running/Passed
+
| VPPForwarder || Every Review || Codebase || !! style="background:green;"|  
 
|-
 
|-
−
| EtcdListener ||  ||  ||  || Every Review || Codebase || ||  || style="background:red; border: 3px solid black"| || Running/Failed
+
| EtcdListener || Every Review || Codebase || !! style="background:green;"|  
 
|-
 
|-
−
| EtcdHelper ||  ||  ||  || Every Review || Codebase || ||  ||  ||  
+
| EtcdHelper || Every Review || Codebase || !! style="background:green;"|  
 
|-
 
|-
−
| VPPInterface ||  ||  ||  || Every Review || Codebase || ||  ||  ||
+
| VPPInterface || Every Review || Codebase || !! style="background:green;"|   
 
|-
 
|-
−
| VPPRestart ||  ||  ||  || Every Review || Codebase || ||  ||  ||  
+
| VPPRestart || Every Review || Codebase || !! style="background:green;"|  
 
|-
 
|-
−
! style="background:yellow;"|'''Functional Testing''' !! style="background:yellow;"|'''Openstack/Devstack''' !! style="background:yellow;"|'''Mercury''' !!  !!  !!  !!  !!  !!  !! style="background:yellow;"|'''Additional Notes'''
+
! style="background:yellow;"|'''Functional Testing''' || ||
 
|-
 
|-
−
! '''Single Node Scenarios''' !!  !!  !!  !!  !!  !!  !!  !!  !! Auto-file bugs
+
! style="background:yellow;"| '''Single Node Scenarios''' || ||
 
|-
 
|-
−
| Add port ||  ||  ||  || Every Review || Openstack CI || ||  ||  ||  
+
| DSVM Tempest Full || Every Review || Openstack CI || !! style="background:orange;"|  
 
|-
 
|-
−
| Delete port || ||  ||  || Every Review || Openstack CI ||  ||  ||  ||  
+
! style="background:yellow;"|'''Multi Node Scenarios''' || ||
 
|-
 
|-
−
| || || ||  ||  ||  ||  ||  ||  ||  
+
| LISP-GPE/Layer 3 || Every Patchset || 3rd Party CI (Openstack Cloud) ||  
 
|-
 
|-
−
| VPP Agent Restart ||  ||  || || Every Review || Openstack CI ||  ||  ||  ||
+
! style="background:yellow;"|'''Negative Testing''' !! !!
 
|-
 
|-
−
| Etcd Restart ||  ||  || || Every Review || Openstack CI ||  ||  ||  ||  
+
|  ||  || 3rd Party CI (Openstack Cloud) ||
 
|-
 
|-
−
|  ||  ||  ||  ||  ||  ||  ||  ||  ||
+
! style="background:yellow;"|'''Compatibility Testing''' !! !!
 
|-
 
|-
−
| || || ||  ||  ||  ||  ||  ||  ||  
+
| Liberty || Every Patchset || 3rd Party CI (Openstack Cloud) ||
 
|-
 
|-
−
! style="background:yellow;"|'''Multi Node Scenarios''' !!  !!  !!  !!  !!  !!  !!  !!  !!
+
| Mitaka || Every Patchset || 3rd Party CI (Openstack Cloud) ||
 
|-
 
|-
−
| (Tim/Alec) ||  ||  ||  || || (Alec) ||  ||  ||  ||  
+
| Newton || Every Patchset || 3rd Party CI (Openstack Cloud) ||
 
|-
 
|-
−
| || ||  ||  ||  ||  ||  ||  ||  ||
+
| Ocata || Every Patchset || 3rd Party CI (Openstack Cloud) ||
−
|-
 
−
! style="background:yellow;"|'''Performance Testing (CSIT)''' !! style="background:yellow;"| '''Openstack/Devstack''' !!style="background:yellow;"| '''Mercury''' !!  !!  !!  !!  !!  !!  !!
 
−
|-
 
−
! '''Single Node Scenario''' !!  !!  !!  !!  !!  !!  !!  !!  !!
 
−
|-
 
−
| 2p1nic-eth-l2bdbase-eth-2vhost-1vm ||  ||  ||  || CSIT Cadence || FD.io Infra ||  ||  ||  || not an openstack use case
 
−
|-
 
−
| 2p1nic-dot1q-l2bdbase-eth-2vhost-1vm ||  ||  ||  || CSIT Cadence || FD.io Infra ||  ||  ||  || openstack VLAN 2pnic PVP (uncommon)
 
−
|-
 
−
| 2p1nic-ethip4-ip4base-eth-2vhost-1vm ||  ||  ||  || CSIT Cadence || FD.io Infra ||  ||  ||  || not an openstack use case
 
−
|-
 
−
| 2p1nic-eth-l2xcbase-eth-2vhost-1vm ||  ||  ||  || CSIT Cadence || FD.io Infra ||  ||  ||  || not an openstack use case
 
−
|-
 
−
| 2p1nic-dot1q-l2xcbase-eth-2vhost-1vm ||  ||  ||  || CSIT Cadence || FD.io Infra ||  ||  ||  || not an openstack use case
 
−
|-
 
−
| 2p1nic-ethip4vxlan-l2bdbase-eth-2vhost-1vm ||  ||  ||  || CSIT Cadence || FD.io Infra ||  ||  ||  || openstack VxLAN 2pnic PVP (uncommon)
 
−
|-
 
−
| 1p1nic-dot1q-l2bdbase-eth-2vhost-1vm ||  || nfvbench ML2/vpp  ||  || CSIT Cadence || FD.io Infra ||  ||  ||  || openstack VLAN 1pnic PVP (common)
 
−
|-
 
−
| 1p1nic-ethip4vxlan-l2bdbase-eth-2vhost-1vm ||  ||  nfvbench VTS ||  || CSIT Cadence || FD.io Infra ||  ||  ||  || openstack VxLAN 1pnic PVP (common)
 
−
|-
 
−
| 1p1nic-dot1q-l2bdbase-eth-4vhost-2vm ||  || nfvbench ML2/VPP||  || CSIT Cadence || FD.io Infra ||  ||  ||  || openstack VLAN 1pnic PVVP intra-node (common)
 
−
|-
 
−
| 1p1nic-ethip4vxlan-l2bdbase-eth-4vhost-2vm||  || nfvbench VTS||  || CSIT Cadence || FD.io Infra ||  ||  ||  || openstack VxLAN 1pnic PVVP intra-node (common)
 
−
|-
 
−
| 1p1nic-dot1q-l2bdbase-eth-2vhost-1vm * 10 ||  || nfvbench  ML2/VPP||  || CSIT Cadence || FD.io Infra ||  ||  ||  || openstack VLAN 1pnic 10*PVP (full box deployment)
 
−
|-
 
−
| 1p1nic-ethip4vxlan-l2bdbase-eth-2vhost-1vm * 10 ||  ||  nfvbench VTS ||  || CSIT Cadence || FD.io Infra ||  ||  ||  || openstack VxLAN 1pnic 10*PVP (full box deployment)
 
−
|-
 
−
|  ||  ||  ||  ||  ||  ||  ||  ||  ||
 
−
|-
 
−
! '''Multi Node Scenario''' !!  !!  !!  !!  !!  !!  !!  !!  !!
 
−
|-
 
−
| 1p1nic-dot1q-l2bdbase-eth-2vhost-1vm * 2 ||  || nfvbench ML2/VPP ||  || CSIT Cadence || FD.io Infra ||  ||  ||  || openstack VLAN 1pnic PVVP inter-node (common)
 
−
|-
 
−
| 1p1nic-ethip4vxlan-l2bdbase-eth-2vhost-1vm * 2||  || nfvbench VTS ||  || CSIT Cadence || FD.io Infra ||  ||  ||  || openstack VxLAN 1pnic PVVP inter-node (common)
 
−
|-
 
−
|  ||  ||  ||  ||  ||  ||  ||  ||  ||
 
−
|-
 
−
! style="background:yellow;"|'''Tempest Testing''' !! style="background:yellow;"|'''Openstack/Devstack''' !! style="background:yellow;"|'''Mercury''' !!  !! style="background:yellow;"|'''(Third Party CI)''' !!  !!  !!  !!  !!
 
−
|-
 
−
| Tempest Smoke Serial (Colorado 3.0) ||  ||  ||  || Every Commit/Not Gating || Innovation Pod ||  ||  ||  ||
 
−
|-
 
−
| '''Standard Suite''' ||  ||  ||  ||  ||  ||  ||  ||  ||
 
−
|-
 
−
| '''Additional Scenarios''' ||  ||  ||  ||  ||  ||  ||  ||  ||
 
−
|-
 
−
|  ||  ||  ||  ||  ||  ||  ||  ||  ||
 
−
|-
 
−
! style="background:yellow;"|'''System Integration''' !!  !!  !!  !!  !!  !!  !!  !!  !!
 
−
|-
 
−
| VPP Version || Latest Release ||  ||  ||  ||  ||  ||  ||  ||
 
−
|-
 
−
| Openstack Version ||  ||  ||  ||  ||  ||  ||  ||  ||
 
−
|-
 
−
| Networking-vpp Version || TOT ||  ||  ||  ||  ||  ||  ||  ||
 
−
|-
 
−
| Etcd Version ||  ||  ||  ||  ||  ||  ||  ||  ||  
 
 
|}
 
|}

Latest revision as of 18:59, 19 June 2017

Unit Tests Run Cadence Run Location
VPPMechanismDriver Every Review Codebase
EtcdAgentCommunicator Every Review Codebase
VPPForwarder Every Review Codebase
EtcdListener Every Review Codebase
EtcdHelper Every Review Codebase
VPPInterface Every Review Codebase
VPPRestart Every Review Codebase
Functional Testing
Single Node Scenarios
DSVM Tempest Full Every Review Openstack CI
Multi Node Scenarios
LISP-GPE/Layer 3 Every Patchset 3rd Party CI (Openstack Cloud)
Negative Testing
3rd Party CI (Openstack Cloud)
Compatibility Testing
Liberty Every Patchset 3rd Party CI (Openstack Cloud)
Mitaka Every Patchset 3rd Party CI (Openstack Cloud)
Newton Every Patchset 3rd Party CI (Openstack Cloud)
Ocata Every Patchset 3rd Party CI (Openstack Cloud)
Retrieved from "https://wiki.openstack.org/w/index.php?title=Networking-vpp/test-plan&oldid=154767"