Jump to: navigation, search

Difference between revisions of "Meetings/InfraTeamMeeting"

(Agenda for next meeting)
(Agenda for next meeting)
Line 18: Line 18:
 
** Zuul-launcher migration(corvus 20240910)
 
** Zuul-launcher migration(corvus 20240910)
 
*** Mixed provider nodesets are impacting some jobs
 
*** Mixed provider nodesets are impacting some jobs
**** corvus was able to run down a couple of bugs around that, but some jobs (periodic jobs from provided examples) still occasionally see mixed providers
+
**** The bugfixes seem to have this under control. clarkb hasn't seen any recent complaints about this.
*** Image build gnutls errors continue to be a problem when image builds update git repos
+
*** Image uploads may be overwhelming rax-flex sjc3 swift proxies
**** Current workaround is dib has been updated to retry those git repo updates
+
**** Python requests/urllib3 is returning a 499 error code which can happen when proxies timeout connections to the backend and pass that along to the client.
**** Looking at haproxy logs clarkb sees initial updates come from ipv4 addresses, then ipv6 addresses, then the failure occurs and things move back to ipv4 before finally using ipv6 and completing.
+
**** May need to sync up with rackspace on this as there may need to be updates to their proxies
**** https://zuul.opendev.org/t/opendev/build/2f4200f24ae4492295d5c43307e93038/log/job-output.txt#4353-4357 That behavior was seen with this build
+
**** May also consider a different swift location?
**** One theory is that nodes are not booting with working ipv6 so use ipv4, then get get an RA or similar that causes ipv6 to work. Then something breaks ipv6 causing a fallback to ipv4.
+
*** New Images for Trixie, Centos 10 Stream, and Rocky Linux 10
 +
*** Ubuntu Bionic Arm64 is the last label still provided by Nodepool
 +
**** Job cleanup branches off from https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/954761/
 
** Gerrit 3.11 Upgrade Planning (clarkb 20250401)
 
** Gerrit 3.11 Upgrade Planning (clarkb 20250401)
 
*** https://www.gerritcodereview.com/3.11.html
 
*** https://www.gerritcodereview.com/3.11.html
 
*** Please check this for any concerns with the way we use Gerrit.
 
*** Please check this for any concerns with the way we use Gerrit.
*** Automated testing is currently testing this generally works for us.
+
*** Omnibus update to Gerrit images planned for Friday or Monday to incorporate several updates (zuul status plugin, CLA removals, and quay.io image hosting)
*** https://review.opendev.org/c/opendev/system-config/+/882900 Host Gerrit images on quay.io
+
**** https://review.opendev.org/c/opendev/system-config/+/882900 Host Gerrit images on quay.io
 +
**** https://review.opendev.org/c/opendev/system-config/+/954376 CLA file removal
 +
**** Needs to be done after CLA usage is removed from project ACLs
 
*** Need to hold new test nodes. Perhaps that is best for after the container images move?
 
*** Need to hold new test nodes. Perhaps that is best for after the container images move?
 
*** Shutting down Gerrit can race the indexing of new changes. If this happens we can have new changes created that are not indexed leading to multiple changes with the same changeid later. To mitigate this we can/should reindex changes on Gerrit startup.
 
*** Shutting down Gerrit can race the indexing of new changes. If this happens we can have new changes created that are not indexed leading to multiple changes with the same changeid later. To mitigate this we can/should reindex changes on Gerrit startup.
Line 41: Line 45:
 
*** On the easy list we've got refstack and eavesdrop servers remaining.
 
*** On the easy list we've got refstack and eavesdrop servers remaining.
 
*** Remember to use launch-node's --config-drive flag when booting new Noble nodes in Rax Classic
 
*** Remember to use launch-node's --config-drive flag when booting new Noble nodes in Rax Classic
** EL10 Test Nodes (clarkb 20250708)
 
*** https://review.opendev.org/c/opendev/zuul-providers/+/953460 CentOS 10 Stream
 
*** https://review.opendev.org/c/opendev/zuul-providers/+/954265 Rocky Linux 10
 
** Adding Debian Trixie Test Nodes (clarkb 20250708)
 
*** https://review.opendev.org/c/opendev/zuul-providers/+/951471
 
 
** Working through our TODO list (clarkb 20250107)
 
** Working through our TODO list (clarkb 20250107)
 
*** https://etherpad.opendev.org/p/opendev-january-2025-meetup
 
*** https://etherpad.opendev.org/p/opendev-january-2025-meetup
 
** OFTC Matrix bridge no longer supporting new users (clarkb 20250520)
 
** OFTC Matrix bridge no longer supporting new users (clarkb 20250520)
*** Clarkb to write a spec explaining the motivation for a move to matrix for opendev comms.
+
*** https://review.opendev.org/c/opendev/infra-specs/+/954826 Spec outlining the motivation and plan for Matrix trialing
*** Then idea is to do a bit of a trial and see if it does help users who primarily rely on matrix for IRC as well as new users.
 
 
** Pre PTG Planning (clarkb 20250624)
 
** Pre PTG Planning (clarkb 20250624)
 
*** https://etherpad.opendev.org/p/opendev-preptg-october-2025 Planning happening in this document
 
*** https://etherpad.opendev.org/p/opendev-preptg-october-2025 Planning happening in this document

Revision as of 21:52, 14 July 2025

Weekly Project Infrastructure team meeting

The OpenDev Team holds public weekly meetings in #opendev-meeting on OFTC, Tuesdays at 1900 UTC. Everyone interested in infrastructure and process surrounding automated testing and deployment is encouraged to attend.

Please feel free to add agenda items (and your IRC nick in parenthesis).

Agenda for next meeting

  • Announcements
  • Actions from last meeting
  • Specs Review
  • Open discussion

Upcoming Project Renames

(any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit) Changes should have their topic set to project-rename.

Previous meetings

Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/