Revision as of 13:38, 17 April 2024

Weekly Project Infrastructure team meeting

The OpenDev Team holds public weekly meetings in #opendev-meeting on OFTC, Tuesdays at 1900 UTC. Everyone interested in infrastructure and process surrounding automated testing and deployment is encouraged to attend.

Please feel free to add agenda items (and your IRC nick in parenthesis).

Agenda for next meeting

Announcements

Actions from last meeting

Specs Review

Topics
- Upgrading Bionic servers to Focal/Jammy (clarkb 20230627)
  - https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
  - https://review.opendev.org/q/topic:jitsi_meet-jammy-update
  - Started looking at the wiki there are rough notes at: https://etherpad.opendev.org/p/opendev-bionic-server-upgrades#L58
- MariaDB Upgrades (clarkb 20240220)
  - Relying on the container image MARIADB_AUTO_UPGRADE flag
  - Etherpad, Gitea, Gerrit, and Mailman could use upgrades.
  - https://review.opendev.org/c/opendev/system-config/+/911000 Upgrade etherpad mariadb to 10.11
  - https://review.opendev.org/c/opendev/system-config/+/915183 Upgrade mailman3 mariadb to 10.11
- AFS Mirror cleanups (clarkb 20240220)
  - Ubuntu Xenial is next but currently busy with PTG, Release, and other tasks.
  - Can followup with webserver log processing to determine which other mirrors may be dead.
- Building Ubuntu Noble Nodes (clarkb 20240416)
  - https://review.opendev.org/c/opendev/glean/+/915907 Glean updates for python3.12 support
  - Appears we will need a debootstrap from debian unstable to build noble
- Review02 had an oops last night (clarkb 20240326)
  - Found the server was shutdown. After giving it a few minutes to potentially resolve itself (mostly worried about cloud action) clarkb proceeded to manually start the instance then start the containers.
  - mnaser reports it may have been an OOM event on the hosting side.
- Project Renames (clarkb 20240227)
  - https://review.opendev.org/c/opendev/system-config/+/911622 Move gerrit replication queue aside during project renames.
  - Need to set a hard time for the 19th and send an announcement.
- Etherpad 2.0.x Upgrade planning (clarkb 20240416)
  - https://review.opendev.org/c/opendev/system-config/+/914119
  - Etherpad 2.0.2 removes the old APIKEY API auth method and now uses Oauth2.0 client_credentials instead. This new system is not yet released, but we are working to determine how to use it pre release.
- Add reference to the project-team-guide in the fail ci msg (fungi 20240423)
  - https://review.opendev.org/914189

Open discussion

Upcoming Project Renames

(any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit) Changes should have their topic set to project-rename.

Rename vexxhost/ansible-role-frrouting > openstack/ansible-role-frrouting: https://review.opendev.org/c/openstack/project-config/+/910018

Previous meetings

Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/

@@ Line 12: / Line 12: @@
 * Actions from last meeting
+* Specs Review
 * Topics
-** Mailman Ansible and Server Upgrades (clarkb 20210914)
+** Upgrading Bionic servers to Focal/Jammy (clarkb 20230627)
-*** lists.openstack.org is running focal now
+*** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
-**** Number of manual edits made to services captured in https://review.opendev.org/c/opendev/system-config/+/808570
+*** https://review.opendev.org/q/topic:jitsi_meet-jammy-update
-**** Ran into issues with Xen being able to boot lz4 compressed kernels
+*** Started looking at the wiki there are rough notes at: https://etherpad.opendev.org/p/opendev-bionic-server-upgrades#L58
-**** We decompressed the kernel but that still failed
+** MariaDB Upgrades (clarkb 20240220)
-**** We installed grub-xen then set up a chainload situation to a xen specific grub preloader via /boot/grub/menu.lst
+*** Relying on the container image MARIADB_AUTO_UPGRADE flag
-**** This chainload situation may not need a compressed kernel? If it doesn't this server may be viable long term and we can document things.
+*** Etherpad, Gitea, Gerrit, and Mailman could use upgrades.
-**** We should consider replacing the server to get away from Xen PV weirdness and to maybe use a floating IP which can be moved between upgraded instances in the future.
+*** https://review.opendev.org/c/opendev/system-config/+/911000 Upgrade etherpad mariadb to 10.11
-** Improving OpenDev's CD throughput (clarkb 20210914)
+*** https://review.opendev.org/c/opendev/system-config/+/915183 Upgrade mailman3 mariadb to 10.11
-*** We can run many of our jobs in parallel in all of our CD pipelines. But this requires we properly document/address dependencies
+** AFS Mirror cleanups (clarkb 20240220)
-**** Need to understand our job dependencies and properly note them in Zuul config or address them by combining jobs.
+*** Ubuntu Xenial is next but currently busy with PTG, Release, and other tasks.
-***** Example 1: Combine service-gitea-lb and service-gitea jobs.
+*** Can followup with webserver log processing to determine which other mirrors may be dead.
-***** Example 2: Combine letsencrypt and nameserver jobs
+** Building Ubuntu Noble Nodes (clarkb 20240416)
-***** Example 3: Have all jobs with webserver config express a dependency on the letsencrypt job
+*** https://review.opendev.org/c/opendev/glean/+/915907 Glean updates for python3.12 support
-**** Suggest we document the known job dependencies in a human readable format, then encode this into zuul, then we can switch to parallel runs.
+*** Appears we will need a debootstrap from debian unstable to build noble
-**** https://review.opendev.org/c/opendev/system-config/+/807672/ starts to sketch this out.
+** Review02 had an oops last night (clarkb 20240326)
-** Gerrit Account cleanups (clarkb 20210914)
+*** Found the server was shutdown. After giving it a few minutes to potentially resolve itself (mostly worried about cloud action) clarkb proceeded to manually start the instance then start the containers.
-*** 33 conflicts remain. Clarkb has written notes on proposed plans for each user in the comments of review02:~clarkb/gerrit_user_cleanups/audit-results-annotated.yaml
+*** mnaser reports it may have been an OOM event on the hosting side.
-** OpenDev logo hosting (clarkb 20210914)
+** Project Renames (clarkb 20240227)
-*** Next up would be updating paste and gerrit. Then we can safely upgrade the gitea server without impacting theming on other services.
+*** https://review.opendev.org/c/opendev/system-config/+/911622 Move gerrit replication queue aside during project renames.
-** Working with InMotion Friday to increase IP addr allocation and scale up (clarkb 20210914)
+*** Need to set a hard time for the 19th and send an announcement.
-*** Will try to debug instance launch failures there prior to Friday.
+** Etherpad 2.0.x Upgrade planning (clarkb 20240416)
-** Scheduling Gerrit project renames (clarkb 20210914)
+*** https://review.opendev.org/c/opendev/system-config/+/914119
-*** We've got a few of these showing up now. We should look at a calendar and pencil in some plans.
+*** Etherpad 2.0.2 removes the old APIKEY API auth method and now uses Oauth2.0 client_credentials instead. This new system is not yet released, but we are working to determine how to use it pre release.
+** Add reference to the project-team-guide in the fail ci msg (fungi 20240423)
+*** https://review.opendev.org/914189
 * Open discussion
@@ Line 43: / Line 47: @@
 == Upcoming Project Renames ==
 (any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit)
+Changes should have their topic set to project-rename.
-* Venus project (below repos) moving from inspur to openstack namespace: https://review.opendev.org/808149
+* Rename vexxhost/ansible-role-frrouting > openstack/ansible-role-frrouting: https://review.opendev.org/c/openstack/project-config/+/910018
-** inspur/python-venusclient -> openstack/python-venusclient
-** inspur/venus -> openstack/venus
-** inspur/venus-specs -> openstack/venus-specs
-** inspur/venus-tempest-plugin -> openstack/venus-tempest-plugin
-** inspur/venus-dashboard -> openstack/venus-dashboard
-* osf to openinfra namespace move: https://review.opendev.org/808479
-* ansible-role-refstack-client from x to openinfra: https://review.opendev.org/765787
 == Previous meetings ==
 Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/

Difference between revisions of "Meetings/InfraTeamMeeting"

Revision as of 13:38, 17 April 2024

Contents

Weekly Project Infrastructure team meeting

Agenda for next meeting

Upcoming Project Renames

Previous meetings