Jump to: navigation, search

Difference between revisions of "Meetings/InfraTeamMeeting"

(Agenda for next meeting)
(Agenda for next meeting)
 
(94 intermediate revisions by 5 users not shown)
Line 16: Line 16:
  
 
* Topics
 
* Topics
** Zuul-launcher migration(corvus 20240910)
 
*** Auto hold functionality is rolling out
 
*** Are there any other required features before all OpenDev tenants switch to use zuul launcher managed resources?
 
** Gerrit shutdown problems (clarkb 20250527)
 
*** After successfully using SIGINT to shutdown gerrit a few weeks ago the recent restart last week failed to shutdown and timed out to SIGKILL
 
*** https://review.opendev.org/c/opendev/system-config/+/950595 One theory is that h2 compaction time may be slowing down shutdown enough to time out
 
*** Another theory is that SIGINT just doesn't work as expected and we need to use SIGHUP (which podman blocks by default)
 
*** Proposal: When convenient time for a restart we land 950595. Since that won't apply until the next restart we manually issue a kill -HUP against the gerrit process to see if that works better. Then once h2 compaction cleanup is in place the restart after can try SIGINT again.
 
** Gerrit 3.11 Upgrade Planning (clarkb 20250401)
 
*** https://www.gerritcodereview.com/3.11.html
 
*** Please check this for any concerns with the way we use Gerrit.
 
*** Automated testing is currently testing this generally works for us.
 
*** 104.130.253.194 is a held Gerrit 3.11 node for testing purposes.
 
*** https://review.opendev.org/c/opendev/system-config/+/882900 Host Gerrit images on quay.io
 
*** Shutting down Gerrit can race the indexing of new changes. If this happens we can have new changes created that are not indexed leading to multiple changes with the same changeid later. To mitigate this we can/should reindex changes on Gerrit startup.
 
*** https://etherpad.opendev.org/p/gerrit-upgrade-3.11 Planning Document for the eventual Upgrade
 
*** Will need to select a date once we know more about the upgrade itself.
 
 
** Upgrading Old Servers (clarkb 20230627)
 
** Upgrading Old Servers (clarkb 20230627)
*** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
+
*** https://etherpad.opendev.org/p/opendev-server-upgrade-planning Central tracking document which may link to more host specific documents
*** https://etherpad.opendev.org/p/opendev-focal-server-upgrades
+
*** Next on the list are graphite and backup servers
*** https://etherpad.opendev.org/p/opendev-server-replacement-sprint
+
*** backup03.ca-ymq-1.vexxhost.opendev.org has been launched and is being backed up too
**** wiki.openstack.org: https://etherpad.opendev.org/p/opendev-mediawiki-upgrade
+
**** https://review.opendev.org/c/opendev/system-config/+/995420 Starting backup02 removal here
**** tonyb looking at cacti after wiki
 
*** On the easy list we've got refstack, mirror-update, eavesdrop, zuul schedulers, and zookeeper servers remaining.
 
*** clarkb is in the process of rolling out a new mirror-update with new zookeepers to follow
 
*** corvus is replacing zuul servers over the next week or two
 
 
*** Remember to use launch-node's --config-drive flag when booting new Noble nodes in Rax Classic
 
*** Remember to use launch-node's --config-drive flag when booting new Noble nodes in Rax Classic
** Working through our TODO list (clarkb 20250107)
+
** Deploying a Prometheus for Server Metrics (clarkb 20260331)
*** https://etherpad.opendev.org/p/opendev-january-2025-meetup
+
*** https://review.opendev.org/c/opendev/system-config/+/980840
** OFTC Matrix bridge no longer supporting new users (clarkb 20250520)
+
*** This change and its child deploy prometheus with node exporter to collect server metrics
*** Clarkb to write a spec explaining the motivation for a move to matrix for opendev comms.
+
*** These two changes simplify the setup and testing of prometheus and node exporter
*** Then idea is to do a bit of a trial and see if it does help users who primarily rely on matrix for IRC as well as new users.
+
**** https://review.opendev.org/c/zuul/zuul-jobs/+/994564 manage /etc/hosts with public IPs
** Adding CentOS 10 Stream Support to Glean, DIB, and Nodepool (clarkb 20250527)
+
**** https://review.opendev.org/c/opendev/system-config/+/994565 Use public IPs in system-config-run jobs
*** https://review.opendev.org/c/openstack/diskimage-builder/+/949942 DIB functional testing without Nodepool
+
** Dealing with alien zuul config errors in the openstack tenant (frickler 20260617)
**** This will allow us to have greater control of the devstack environment allowing us to configure cpu features that CentOS 10 Stream requires
+
*** clarkb reached out to starlingx and airship about this
*** https://review.opendev.org/c/openstack/diskimage-builder/+/934045 DIB support for CentOS 10 Stream
+
**** Someone from airship is in the opendev matrix room now and their zuul tenant config errors appear to be gone
** projects.yaml normalization
+
**** https://lists.starlingx.io/archives/list/starlingx-discuss@lists.starlingx.io/thread/YQVACUR4OCX74ZULHAJ4AD44MHGY37YI/
*** a (possibly intentional) regression in ruamel.yaml has started adding spaces to the end of wrapped strings, akin to format=flowed E-mail wrapping
+
** Gitea 1.26.4 Upgrade (clarkb 20260622)
**** https://sourceforge.net/p/ruamel-yaml/tickets/546/
+
*** https://review.opendev.org/c/opendev/system-config/+/994326 Upgrade Gitea to 1.26.4
*** this is impacting our normalization job output
+
*** Its time to upgrade to the next Gitea bugfix release
**** https://review.opendev.org/952006
+
** Bump Anubis difficult to 5 (clarkb 20260630)
 +
*** There is some evidence that bots are regularly solving the Anubis challenge
 +
*** The challenges are slowing them down enough that services continue to be mostly responsive
 +
*** Should we increase the difficulty one level to slow them down even futher?
 +
*** This will impact regular users too which is likely the primary consideration we should make.
 +
*** https://review.opendev.org/c/opendev/system-config/+/995096
 +
** Planning Gerrit Project Renames (clarkb 20260622)
 +
*** We have a request to rename x/cursive to openstack/cursive
 +
*** Any concern with project ownership doing that? The current group membership includes people from Johns Hopkins University and OpenStack Barbican
 +
*** Aiming for July 9 at ~2100 UTC
 +
**** Clarkb is unlikely to make this time
 +
*** https://etherpad.opendev.org/p/opendev-project-renames-20260709
 +
** Matrix Meetbot Porting (clarkb 20260707)
 +
*** Anil has started a port of the IRC meetbot to Matrix
 +
*** https://review.opendev.org/c/opendev/system-config/+/995755 stack starts here
 +
** OpenMetal Cloud Offline (clarkb 20260707)
 +
*** Zuul had errors talking to this cloud so the cloud was disabled
 +
*** `openstack server list` reports HTTP 500 errors
  
 
* Open discussion
 
* Open discussion
Line 64: Line 60:
 
Changes should have their topic set to project-rename.
 
Changes should have their topic set to project-rename.
  
* Rename example/foo -> example/bar: https://review.opendev.org/c/openstack/project-config/+/123456
+
* Rename x/cursive -> openstack/cursive: https://review.opendev.org/c/openstack/project-config/+/990122 (stephenfin, fungi)
  
 
== Previous meetings ==
 
== Previous meetings ==
 
Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/
 
Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/

Latest revision as of 01:52, 7 July 2026

Weekly Project Infrastructure team meeting

The OpenDev Team holds public weekly meetings in #opendev-meeting on OFTC, Tuesdays at 1900 UTC. Everyone interested in infrastructure and process surrounding automated testing and deployment is encouraged to attend.

Please feel free to add agenda items (and your IRC nick in parenthesis).

Agenda for next meeting

  • Announcements
  • Actions from last meeting
  • Specs Review
  • Open discussion

Upcoming Project Renames

(any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit) Changes should have their topic set to project-rename.

Previous meetings

Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/