Meetings/InfraTeamMeeting
< Meetings
Contents
Weekly Project Infrastructure team meeting
The OpenDev Team holds public weekly meetings in #opendev-meeting
on OFTC, Tuesdays at 1900 UTC. Everyone interested in infrastructure and process surrounding automated testing and deployment is encouraged to attend.
Please feel free to add agenda items (and your IRC nick in parenthesis).
Agenda for next meeting
- Announcements
- Actions from last meeting
- Specs Review
- Topics
- Service Coordinator Election (clarkb 20230822)
- Nomination period ends today (the day of the meeting)
- Bastion host (ianw 20230627)
- https://review.opendev.org/q/topic:prod-bastion-group Remaining changes are part of parallel ansible runs on bridge
- https://review.opendev.org/q/topic:bridge-backups
- Mailman 3 (clarkb 20230627)
- https://etherpad.opendev.org/p/mm3migration
- Need to change site domains
- Gerrit updates (clarkb 20230718)
- Replication task file leaks.
- https://review.opendev.org/c/opendev/system-config/+/880672 Workaround "leaked" replication tasks on disk.
- https://bugs.chromium.org/p/gerrit/issues/detail?id=16867
- https://bugs.chromium.org/p/gerrit/issues/detail?id=16868
- https://review.opendev.org/c/opendev/system-config/+/884779 Revert bind mounts for Gerrit plugin data
- Replication task file leaks.
- Upgrading Bionic servers to Focal/Jammy (clarkb 20230627)
- https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
- Next up mirrors and meetpad.
- Clarkb needs to look into cleaning up the old CI registry node.
- Rax IAD image upload struggles (clarkb 20230822)
- The Rax IAD region has struggled to upload images within the image upload timeout. This seems to get worse the more images you upload
- Almost like images are processed serially and we create a queue that gets backed up.
- No issue has been filed with rax yet, but we're testing incremental unpausing of images to get more data.
- We also have hundreds of leaked images in the other two regions (there were well over a thousand in IAD but those have been cleaned up manually now).
- The Rax IAD region has struggled to upload images within the image upload timeout. This seems to get worse the more images you upload
- Fedora cleanup (clarkb 20230627)
- Need changes to remove the label and nodeset from Zuul/Nodepool
- Gitea 1.20 (clarkb 20230627)
- https://review.opendev.org/c/opendev/system-config/+/886993
- Ready to go if we are happy with the resulting behaviors.
- We disable oauth2 but need to configure multiple oauth2 jwt settings in order to avoid startup errors.
- Need to update prod secrets with the oauth2 jwt settings before merging.
- https://github.com/go-gitea/gitea/issues/25377
- https://review.opendev.org/c/opendev/system-config/+/886993
- Zuul changes and updates (clarkb 20230822)
- Ansible 8 now availalble. We should convert the OpenDev tenant. Notify openstack tenant that we will switch them after the upcoming release
- Stdout and stderr to be uncombined in Zuul Ansible. Currently this is a job setting for testing purposes. We'll need to start looking at how this impacts us.
- Early failure detection regexes should arrive soon. This is potentially useful for our users?
- Python container updates (tonyb 20230718)
- Some moderate progress in the first round
- https://review.opendev.org/q/topic:bookworm-python and https://review.opendev.org/q/topic:force-base-image-build
- I noticed that https://opendev.org/openstack/python-openstackclient/src/branch/master/Dockerfile is using a 3.9 tag which is buster
- We should stick to the explicit debian release + explicit python release versions for things. We can delete the old tags to force errors that indicate people should update the tags they use.
- We should write a tool to find and clean leaked tags on docker hub (and quay.io?)
- Service Coordinator Election (clarkb 20230822)
- Open discussion
Upcoming Project Renames
(any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit) Changes should have their topic set to project-rename.
- Rename foo/example -> bar/example: https://review.opendev.org/123456
Previous meetings
Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/