Revision as of 13:04, 5 August 2025

Weekly Project Infrastructure team meeting

The OpenDev Team holds public weekly meetings in #opendev-meeting on OFTC, Tuesdays at 1900 UTC. Everyone interested in infrastructure and process surrounding automated testing and deployment is encouraged to attend.

Please feel free to add agenda items (and your IRC nick in parenthesis).

Agenda for next meeting

• Announcements
  • Clarkb out Monday August 4

• Actions from last meeting

• Specs Review

• Topics
  • Zuul-launcher migration(corvus 20240910)
    • Mixed provider nodesets should only be possible now if the only way to fulfill the requests is through different providers (think openstack vm label and k8s pod label in one nodeset).
    • Replaced gitea-lb02 with gitea-lb03 as IPv6 issues on gitea-lb02 were impacting image build jobs
    • Also updated load balancer health checks to hopefully get a more accurate picture of when gitea is running properly on each node.
    • Nodepool is gone.
  • Gerrit 3.11 Upgrade Planning (clarkb 20250401)
    • https://www.gerritcodereview.com/3.11.html
    • Please check this for any concerns with the way we use Gerrit.
    • Held nodes for these two builds:
      • https://zuul.opendev.org/t/openstack/build/f1ca0d1f2e054829a4506ececb58bed3
      • https://zuul.opendev.org/t/openstack/build/588723b923e94901af3065143d9df818
    • There is discussion about replication and reindexing bugs in 3.11.4/3.12.1 that don't affect us yet due to being on 3.10. We should try to test these problems to see if they affect us.
    • Shutting down Gerrit can race the indexing of new changes. If this happens we can have new changes created that are not indexed leading to multiple changes with the same changeid later. To mitigate this we can/should reindex changes on Gerrit startup.
    • https://etherpad.opendev.org/p/gerrit-upgrade-3.11 Planning Document for the eventual Upgrade
    • Will need to select a date once we know more about the upgrade itself.
  • Upgrading Old Servers (clarkb 20230627)
    • https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
    • https://etherpad.opendev.org/p/opendev-focal-server-upgrades
    • https://etherpad.opendev.org/p/opendev-server-replacement-sprint
      • wiki.openstack.org: https://etherpad.opendev.org/p/opendev-mediawiki-upgrade
      • tonyb looking at cacti after wiki
    • On the easy list we've got refstack and eavesdrop servers remaining.
    • Eavesdrop stores data on a cinder volume. We will need a downtime to stop bots on the old server long enough to copy/move data to the new server before starting services there. Is there a particularly good time for doing this?
    • https://review.opendev.org/c/opendev/system-config/+/955544/ prep step for eavesdrop move to Noble
    • Remember to use launch-node's --config-drive flag when booting new Noble nodes in Rax Classic
  • Vexxhost backup server inaccessible (clarkb 20250729)
    • The backup server running in vexxhost has become unreachable but Nova considers it to be up. We probably need to ask Nova to reboot it.
    • Keep an eye out for similar issues going forward. Might be worth noting what tipped fungi off to this as well.
  • Working through our TODO list (clarkb 20250107)
    • https://etherpad.opendev.org/p/opendev-january-2025-meetup
  • Moving OpenDev Synchronous Communication to Matrix (clarkb 20250520)
    • https://review.opendev.org/c/opendev/infra-specs/+/954826 Spec outlining the motivation and plan for Matrix trialing
  • Pre PTG Planning (clarkb 20250624)
    • https://etherpad.opendev.org/p/opendev-preptg-october-2025 Planning happening in this document
  • Service Coordinator Election Planning (clarkb 20250729)
    • Proposal: Nomination Period open from August 5, 2025 to August 19, 2025. If necessary we will hold an election from August 20, 2025 to August 27, 2025. All date ranges and times will be in UTC.
    • Clarkb is more than happy to support someone new in the role. Please reach out if there are questions or interest.
  • Loss of upstream Debian bullseye-backports mirror (fungi 20250805)
    • https://review.opendev.org/956497 temporarily ignore undefinedtarget
    • the workaround isn't too bad, but we need to make a longer-term decision about our mirror contents and the configure-mirrors role

• Open discussion

Upcoming Project Renames

(any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit) Changes should have their topic set to project-rename.

• Rename example/foo -> example/bar: https://review.opendev.org/c/openstack/project-config/+/123456

Previous meetings

Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/