Revision as of 21:37, 21 August 2023

Weekly Project Infrastructure team meeting

The OpenDev Team holds public weekly meetings in #opendev-meeting on OFTC, Tuesdays at 1900 UTC. Everyone interested in infrastructure and process surrounding automated testing and deployment is encouraged to attend.

Please feel free to add agenda items (and your IRC nick in parenthesis).

Agenda for next meeting

• Announcements

• Actions from last meeting

• Specs Review

• Topics
  • Service Coordinator Election (clarkb 20230822)
    • Nomination period ends today (the day of the meeting)
  • Bastion host (ianw 20230627)
    • https://review.opendev.org/q/topic:prod-bastion-group Remaining changes are part of parallel ansible runs on bridge
    • https://review.opendev.org/q/topic:bridge-backups
  • Mailman 3 (clarkb 20230627)
    • https://etherpad.opendev.org/p/mm3migration
    • Need to change site domains
  • Gerrit updates (clarkb 20230718)
    • Replication task file leaks.
      • https://review.opendev.org/c/opendev/system-config/+/880672 Workaround "leaked" replication tasks on disk.
      • https://bugs.chromium.org/p/gerrit/issues/detail?id=16867
      • https://bugs.chromium.org/p/gerrit/issues/detail?id=16868
      • https://review.opendev.org/c/opendev/system-config/+/884779 Revert bind mounts for Gerrit plugin data
  • Upgrading Bionic servers to Focal/Jammy (clarkb 20230627)
    • https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
    • Next up mirrors and meetpad.
    • Clarkb needs to look into cleaning up the old CI registry node.
  • Rax IAD image upload struggles (clarkb 20230822)
    • The Rax IAD region has struggled to upload images within the image upload timeout. This seems to get worse the more images you upload
      • Almost like images are processed serially and we create a queue that gets backed up.
    • An issue has been filed with rax but we haven't seen a resolution yet.
  • Fedora cleanup (clarkb 20230627)
    • Need changes to remove the label and nodeset from Zuul/Nodepool
  • Gitea 1.20 (clarkb 20230627)
    • https://review.opendev.org/c/opendev/system-config/+/886993
      • Ready to go if we are happy with the resulting behaviors.
    • We disable oauth2 but need to configure multiple oauth2 jwt settings in order to avoid startup errors.
      • Need to update prod secrets with the oauth2 jwt settings before merging.
    • https://github.com/go-gitea/gitea/issues/25377
  • Zuul changes and updates (clarkb 20230822)
    • Ansible 8 now availalble. We should convert the OpenDev tenant. Notify openstack tenant that we will switch them after the upcoming release
    • Stdout and stderr to be uncombined in Zuul Ansible. Currently this is a job setting for testing purposes. We'll need to start looking at how this impacts us.
    • Early failure detection regexes should arrive soon. This is potentially useful for our users?
  • Python container updates (tonyb 20230718)
    • Some moderate progress in the first round
    • https://review.opendev.org/q/topic:bookworm-python and https://review.opendev.org/q/topic:force-base-image-build
    • I noticed that https://opendev.org/openstack/python-openstackclient/src/branch/master/Dockerfile is using a 3.9 tag which is buster
      • We should stick to the explicit debian release + explicit python release versions for things. We can delete the old tags to force errors that indicate people should update the tags they use.
    • We should write a tool to find and clean leaked tags on docker hub (and quay.io?)

• Open discussion

Upcoming Project Renames

(any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit) Changes should have their topic set to project-rename.

• Rename foo/example -> bar/example: https://review.opendev.org/123456

Previous meetings

Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/