Jump to: navigation, search

Difference between revisions of "StarlingX/Test"

Line 40: Line 40:
  
 
===Latest ISO image Sanity Summary===
 
===Latest ISO image Sanity Summary===
*ISO: stx-2018-08-30-97.iso
 
*ISO: stx-2018-08-31-98.iso
 
*ISO: stx-2018-09-01-99.iso
 
 
*ISO: stx-2018-09-02-100.iso
 
*ISO: stx-2018-09-02-100.iso
 
*ISO: stx-2018-09-03-101.iso
 
*ISO: stx-2018-09-03-101.iso
Line 56: Line 53:
 
*ISO: stx-2018-09-13-113.iso
 
*ISO: stx-2018-09-13-113.iso
 
*ISO: stx-2018-09-13-114.iso
 
*ISO: stx-2018-09-13-114.iso
 +
*ISO: stx-2018-09-15-115.iso
 +
*ISO: stx-2018-09-16-116.iso
 +
*ISO: stx-2018-09-17-117.iso
 +
*ISO: stx-2018-09-18-120.iso
 +
*ISO: stx-2018-09-19-121.iso
  
*Installation [PASS]: 3 TCs Passed, 1 TCs Failed.
+
*Installation [PASS]: 4 TCs Passed, 0 TCs Failed.
** Failed during config_controller, in step "06/08: Applying controller manifest ... Failed to execute controller manifest"
+
*Provisioning [FAIL]: 2 TCs Passed, 4 TCs Failed.
** In '/var/log/puppet/latest/puppet.log' found:
+
** After configured storage and added LVM storage backend to Controller-0, the Controller-0 stays in "Config out-of-date" state and storage backend stays in "configuring" state.
*** Error: failed: apply_network_config.sh returned 1 instead of one of [0]
+
** Controller-0 cannot be unlocked since: "Lvm is configuring. All storage backends must be configured before operation is allowed."
** Such error causes a fail in the rest of tests.
+
** Based on Wind River feedback, framework was modified to wait for 30 min and for 60 min since state will change to "configured" eventually,  but controller and storage states never change.
** Debugging issue.
+
** Issue in Launchpad will be open.
*Provisioning [FAIL]: 0 TCs Passed, 6 TCs Failed.
+
*Sanity [FAIL]: 9 TCs Paseed, 11 TCs Failed.
*Sanity [FAIL]: 0 TCs Paseed, 19 TCs Failed.
+
*Total: 29 TCs Executed, 15 TCs Passed, 15 TCs Failed.
*Total: 29 TCs Executed, 3 TCs Passed, 26 TCs Failed.
 
 
*More details regarding results, please contact elio.martinez.monroy@intel.com and juan.carlos.alonso@intel.com
 
*More details regarding results, please contact elio.martinez.monroy@intel.com and juan.carlos.alonso@intel.com
  

Revision as of 16:46, 20 September 2018

StarlingX Test Sub-project

Team Information

  • Project Lead: Ada Cabrales <ada.cabrales@intel.com>
  • Technical Lead: Jose Perez <jose.perez.carranza@intel.com>
  • Quality Assurance Engineer: Elio Martinez <elio.martinez.monroy@intel.com>
  • Contributors:

Team Objective / Priorities

  • Responsible for verification of StarlingX, including automated and manual testing

Project calls

Bi-weekly meetings on Tuesdays at 9:00am PDT / 1600 UTC

Agenda and meeting minutes are in this etherpad

Story Board Tags

All story board stories created for this team should use the tag "stx.test" and the prefix [Test]

Team Work Items

Latest ISO image Sanity Summary

  • ISO: stx-2018-09-02-100.iso
  • ISO: stx-2018-09-03-101.iso
  • ISO: stx-2018-09-04-102.iso
  • ISO: stx-2018-09-05-103.iso
  • ISO: stx-2018-09-06-104.iso
  • ISO: stx-2018-09-07-106.iso
  • ISO: stx-2018-09-08-107.iso
  • ISO: stx-2018-09-09-108.iso
  • ISO: stx-2018-09-10-110.iso
  • ISO: stx-2018-09-11-111.iso
  • ISO: stx-2018-09-12-112.iso
  • ISO: stx-2018-09-13-113.iso
  • ISO: stx-2018-09-13-114.iso
  • ISO: stx-2018-09-15-115.iso
  • ISO: stx-2018-09-16-116.iso
  • ISO: stx-2018-09-17-117.iso
  • ISO: stx-2018-09-18-120.iso
  • ISO: stx-2018-09-19-121.iso
  • Installation [PASS]: 4 TCs Passed, 0 TCs Failed.
  • Provisioning [FAIL]: 2 TCs Passed, 4 TCs Failed.
    • After configured storage and added LVM storage backend to Controller-0, the Controller-0 stays in "Config out-of-date" state and storage backend stays in "configuring" state.
    • Controller-0 cannot be unlocked since: "Lvm is configuring. All storage backends must be configured before operation is allowed."
    • Based on Wind River feedback, framework was modified to wait for 30 min and for 60 min since state will change to "configured" eventually, but controller and storage states never change.
    • Issue in Launchpad will be open.
  • Sanity [FAIL]: 9 TCs Paseed, 11 TCs Failed.
  • Total: 29 TCs Executed, 15 TCs Passed, 15 TCs Failed.
  • More details regarding results, please contact elio.martinez.monroy@intel.com and juan.carlos.alonso@intel.com