Revision as of 06:39, 5 July 2024

Weekly Project Infrastructure team meeting

The OpenDev Team holds public weekly meetings in #opendev-meeting on OFTC, Tuesdays at 1900 UTC. Everyone interested in infrastructure and process surrounding automated testing and deployment is encouraged to attend.

Please feel free to add agenda items (and your IRC nick in parenthesis).

Agenda for next meeting

• Announcements
  • Holiday at the end of the week for some of us.

• Actions from last meeting

• Specs Review

• Topics
  • Upgrading Old Servers (clarkb 20230627)
    • https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
      • wiki.openstack.org: https://etherpad.opendev.org/p/opendev-mediawiki-upgrade
      • tonyb looking at cacti after wiki
    • https://etherpad.opendev.org/p/opendev-focal-server-upgrades
      • tonyb expects to try a simple focal -> noble upgrade this week
  • AFS Mirror cleanups (clarkb 20240220)
    • Ubuntu Xenial cleanups are starting to show up under topic:drop-ubuntu-xenial
    • CentOS 8 Stream EOLd and jobs can no longer successfully run there. Cleanup is happening under topic:drop-centos-8-stream
      • Projects like glance are still holding onto these old jobs despite no hope of them ever succeeding. Do we want to say Monday July 8 we're force merging cleanups on our side and projects will have to deal with the fallout since they aren't fixing things now?
    • Can followup with webserver log processing to determine which other mirrors may be dead.
  • Gitea 1.22 Upgrade Planning (clarkb 20240528)
    • There is a Gitea 1.22.0 release now. Once we have the general upgrade working we can test the doctor tool to fixup the DB case sensitivity.
    • https://review.opendev.org/c/opendev/system-config/+/920580
  • OpenMetal Cloud Rebuild (clarkb 20240604)
    • Waiting on a response from OpenMetal about the best way to proceed. I don't want to try and fix things and step on their toes or vice versa.
  • Testing Rackspace's New Cloud Offering (clarkb 20240604)
    • Clarkb is still waiting to hear back from rax on whether or not a meeting works to discuss this further and if so when.
  • Nodepool in Zuul (corvus 20240702)
    • Nodepool in Zuul work is proceeding
    • Creating Opendev image build jobs
    • Running zuul-launcher in shadow mode
  • Collating backlog items from $everyone (tonyb 20240107)
    • Review of approved specs: https://docs.opendev.org/opendev/infra-specs/latest/ Seems like that could do with some love
    • Would it be helpful to have a '#noteit' IRC action that'd record the timestamp for context and add it to an editable list?
    • There is a pretty solid risk of this becoming long and write only :/
  • zuul db performance issues (frickler 20240705)
    • https://zuul.opendev.org/t/openstack/buildsets times out without showing results
    • https://zuul.opendev.org/t/openstack/buildsets?pipeline=gate takes 20-30s
    • Makes investigating gate status more complicated
    • Not sure if our deployment is reaching its limits or Zuul needs some more query optimization?
  • Reconsider queue depth for integrated gate (frickler 20240705)
    • During the rush to get fixes for the recent CVE merged, a lot of gate failures happened
    • Chances that patch #20 in the pipeline gets merged without any issue in the 19 patches before it seems neglegible
    • Suggestion: Reduce depth to 10 for now, which still seems pretty optimistic

• Open discussion

Upcoming Project Renames

(any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit) Changes should have their topic set to project-rename.

• Rename example/foo -> example/bar: https://review.opendev.org/c/openstack/project-config/+/123456

Previous meetings

Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/