Jump to: navigation, search

Difference between revisions of "Meetings/InfraTeamMeeting"

(Agenda for next meeting)
(Agenda for next meeting)
(233 intermediate revisions by 12 users not shown)
Line 10: Line 10:
  
 
* Announcements
 
* Announcements
** OpenInfra Summit CFP needs your input: https://openinfra.dev/summit/
 
** Service Coordinator nomination time has begun. You have until February 8, 2022
 
  
 
* Actions from last meeting
 
* Actions from last meeting
Line 18: Line 16:
  
 
* Topics
 
* Topics
** Improving OpenDev's CD throughput (clarkb 20220201)
+
** Upgrading Bionic servers to Focal/Jammy (clarkb 20230627)
*** Bootstrapping bridge via Zuul is now a complicated subject. Can use zuul secrets to make it happen. Are we comfortable with this?
+
*** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
*** https://review.opendev.org/c/opendev/infra-specs/+/821645 -- spec outlining some of the issues with secrets
+
*** https://review.opendev.org/q/topic:jitsi_meet-jammy-update
*** https://review.opendev.org/c/opendev/system-config/+/821155 -- sample of secret writing; more info in changelog
+
*** Started looking at the wiki there are rough notes at: https://etherpad.opendev.org/p/opendev-bionic-server-upgrades#L58
** Container maintenance (clarkb 20220201)
+
** MariaDB Upgrades (clarkb 20240220)
*** https://etherpad.opendev.org/p/opendev-container-maintenance
+
*** Relying on the container image MARIADB_AUTO_UPGRADE flag
*** Running container with dedicated users. Next up all the ircbots.
+
*** Etherpad and mailman are done. Gerrit and Gitea are all that remain.
*** Upgrading Zookeeper
+
** AFS Mirror cleanups (clarkb 20240220)
*** Upgrading MariaDB
+
*** Ubuntu Xenial is next but currently busy with PTG, Release, and other tasks.
*** Eventually convert MariaDB container's from uid 999 to something that makes more sense on the system.
+
*** Can followup with webserver log processing to determine which other mirrors may be dead.
** Spring cleaning our Nodepool images (clarkb 20220201)
+
** Building Ubuntu Noble Nodes (clarkb 20240416)
*** http://lists.opendev.org/pipermail/service-announce/2021-December/000029.html cleanup announcement
+
*** https://review.opendev.org/c/opendev/glean/+/915907 Glean updates for python3.12 support
*** Changes to remove CentOS 8 are up. Are we ready to go ahead with this? In order they should be merged:
+
*** Appears we will need a debootstrap from debian unstable to build noble
**** https://review.opendev.org/c/openstack/project-config/+/827183
+
** Etherpad 2.0.x Upgrade planning (clarkb 20240416)
**** https://review.opendev.org/c/opendev/base-jobs/+/827181
+
*** https://review.opendev.org/c/opendev/system-config/+/914119
**** https://review.opendev.org/c/openstack/project-config/+/827184
+
*** Etherpad 2.0.2 removes the old APIKEY API auth method and now uses Oauth2.0 client_credentials instead. This new system is not yet released, but we are working to determine how to use it pre release.
**** https://review.opendev.org/c/opendev/system-config/+/827186
+
** Add reference to the project-team-guide in the fail ci msg (fungi 20240423)
** Spring cleaning for old reviews? (frickler 20220201)
+
*** https://review.opendev.org/914189
*** system-config has >300 open reviews, most of them in merge-conflict and >1y old
+
** Gerrit 3.9 Upgrade Planning (clarkb 20240423)
*** Do we see value in keeping those or could we run some script to auto-abandon those with a helpful comment?
+
*** https://www.gerritcodereview.com/3.9.html Release Notes
*** Neutron has a script that could be easily adopted for this task
+
*** Downgrade is possible with an offline reindex using the old war.
**** https://opendev.org/openstack/neutron/src/branch/master/tools/abandon_old_reviews.sh
+
*** Need to compile an upgrade checklist (go over breaking changes and also test the downgrade).
*** Clarkb to produce a list of repos that can be retired. We can then retire the repos and abandon their open reviews as step 0
+
*** Server could stand to be upgraded as well but I think it is probably best to decouple these concerns.
** Gerrit mergeabilityComputationBehavior (frickler 20220127)
+
** Wiki SSL Cert Renewal (clarkb 20240423)
*** https://gerrit-documentation.storage.googleapis.com/Documentation/3.5.0/config-gerrit.html#change.mergeabilityComputationBehavior
+
*** We have just under 4 weeks to renew the cert. This is one of the last (maybe the only) manually managed ssl cert.
*** This was disabled while upgrading to 3.4.0 since the default is "NEVER"
+
*** Will probably delay until we have less than a week left before processing it.
*** We could set the option to "API_REF_UPDATED_AND_CHANGE_REINDEX" to restore the previous behavior
 
*** It doesn't look like we have to have any concerns in regard to CPU load http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=70348&rra_id=all
 
** Gerrit bugs/issues that we are tracking (clarkb 20220201)
 
*** ACLs for pushing signed tags are ignored. Should be fixed in 3.4 now. https://review.opendev.org/c/opendev/system-config/+/827153 will update our images.
 
*** URL substititions for gitweb urls does not properly include the hash which is needed by gitea. https://bugs.chromium.org/p/gerrit/issues/detail?id=15589
 
*** Backlog of ssh git pulls against Gerrit slows Zuul down.
 
  
 
* Open discussion
 
* Open discussion
Line 57: Line 49:
 
Changes should have their topic set to project-rename.
 
Changes should have their topic set to project-rename.
  
* Rename foo/example -> bar/example: https://review.opendev.org/123456
+
* Rename example/foo -> example/bar: https://review.opendev.org/c/openstack/project-config/+/123456
  
 
== Previous meetings ==
 
== Previous meetings ==
 
Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/
 
Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/

Revision as of 22:13, 22 April 2024

Weekly Project Infrastructure team meeting

The OpenDev Team holds public weekly meetings in #opendev-meeting on OFTC, Tuesdays at 1900 UTC. Everyone interested in infrastructure and process surrounding automated testing and deployment is encouraged to attend.

Please feel free to add agenda items (and your IRC nick in parenthesis).

Agenda for next meeting

  • Announcements
  • Actions from last meeting
  • Specs Review
  • Topics
    • Upgrading Bionic servers to Focal/Jammy (clarkb 20230627)
    • MariaDB Upgrades (clarkb 20240220)
      • Relying on the container image MARIADB_AUTO_UPGRADE flag
      • Etherpad and mailman are done. Gerrit and Gitea are all that remain.
    • AFS Mirror cleanups (clarkb 20240220)
      • Ubuntu Xenial is next but currently busy with PTG, Release, and other tasks.
      • Can followup with webserver log processing to determine which other mirrors may be dead.
    • Building Ubuntu Noble Nodes (clarkb 20240416)
    • Etherpad 2.0.x Upgrade planning (clarkb 20240416)
    • Add reference to the project-team-guide in the fail ci msg (fungi 20240423)
    • Gerrit 3.9 Upgrade Planning (clarkb 20240423)
      • https://www.gerritcodereview.com/3.9.html Release Notes
      • Downgrade is possible with an offline reindex using the old war.
      • Need to compile an upgrade checklist (go over breaking changes and also test the downgrade).
      • Server could stand to be upgraded as well but I think it is probably best to decouple these concerns.
    • Wiki SSL Cert Renewal (clarkb 20240423)
      • We have just under 4 weeks to renew the cert. This is one of the last (maybe the only) manually managed ssl cert.
      • Will probably delay until we have less than a week left before processing it.
  • Open discussion

Upcoming Project Renames

(any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit) Changes should have their topic set to project-rename.

Previous meetings

Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/