Jump to: navigation, search

Difference between revisions of "Meetings/InfraTeamMeeting"

(→‎Agenda for next meeting)
(→‎Agenda for next meeting)
 
(57 intermediate revisions by 5 users not shown)
Line 16: Line 16:
  
 
* Topics
 
* Topics
−
** Gerrit 3.11 Upgrade Planning (clarkb 20250401)
 
−
*** Gerrit 3.13 has been released so we should really try to upgrade to 3.11 and then 3.12 soon.
 
−
*** https://www.gerritcodereview.com/3.11.html
 
−
*** Please check this for any concerns with the way we use Gerrit.
 
−
*** https://review.opendev.org/c/opendev/system-config/+/966083 Fix container bind mounts for Gerrit
 
−
*** https://review.opendev.org/c/opendev/system-config/+/966084 Update to Gerrit 3.10.9 and 3.11.7
 
−
*** There is discussion about replication and reindexing bugs in 3.11.4/3.12.1 that don't affect us yet due to being on 3.10. We should try to test these problems to see if they affect us.
 
−
**** Clarkb tested this with held notes on admittedly trivial test data sets but was unable to reproduce the problems
 
−
*** Shutting down Gerrit can race the indexing of new changes. If this happens we can have new changes created that are not indexed leading to multiple changes with the same changeid later. To mitigate this we can/should reindex changes on Gerrit startup.
 
−
*** Gerrit shutdown remain plagued by large h2 cache files. Seems removing our long timeout was not enough to prevent shutdowns timing out.
 
−
*** https://etherpad.opendev.org/p/gerrit-upgrade-3.11 Planning Document for the eventual Upgrade
 
−
*** Will need to select a date once we know more about the upgrade itself.
 
 
** Upgrading Old Servers (clarkb 20230627)
 
** Upgrading Old Servers (clarkb 20230627)
−
*** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
+
*** https://etherpad.opendev.org/p/opendev-server-upgrade-planning Central tracking document which may link to more host specific documents
−
*** https://etherpad.opendev.org/p/opendev-focal-server-upgrades
 
−
*** https://etherpad.opendev.org/p/opendev-server-replacement-sprint
 
−
**** wiki.openstack.org: https://etherpad.opendev.org/p/opendev-mediawiki-upgrade
 
−
**** tonyb looking at cacti after wiki
 
 
*** Next on the list are graphite and backup servers
 
*** Next on the list are graphite and backup servers
−
*** Can probably spin up new backup servers alongside the old ones then migrate the old volumes off the old servers to the new ones and finally delete the old servers. Just need to double check borg version support matrix details and also what adding new backup servers will do to our cron job setups for backups.
+
*** backup03.ca-ymq-1.vexxhost.opendev.org has been launched and is being backed up too
 +
**** https://review.opendev.org/c/opendev/system-config/+/995420 Starting backup02 removal here
 
*** Remember to use launch-node's --config-drive flag when booting new Noble nodes in Rax Classic
 
*** Remember to use launch-node's --config-drive flag when booting new Noble nodes in Rax Classic
−
** Moving OpenDev Synchronous Communication to Matrix (clarkb 20250520)
+
** Deploying a Prometheus for Server Metrics (clarkb 20260331)
−
*** The spec (954826) has merged.
+
*** https://review.opendev.org/c/opendev/system-config/+/980840
−
*** clarkb will start working on this as soon as time permits.
+
*** This change and its child deploy prometheus with node exporter to collect server metrics
−
** Gitea 1.25.1 Upgrade (clarkb 20251028)
+
*** These two changes simplify the setup and testing of prometheus and node exporter
−
*** https://review.opendev.org/c/opendev/system-config/+/965960 Upgrade Gitea to 1.25.1
+
**** https://review.opendev.org/c/zuul/zuul-jobs/+/994564 manage /etc/hosts with public IPs
−
** Gitea Performance (clarkb 20251028)
+
**** https://review.opendev.org/c/opendev/system-config/+/994565 Use public IPs in system-config-run jobs
−
*** All traffic should be through the load balancer now
+
** Dealing with alien zuul config errors in the openstack tenant (frickler 20260617)
−
*** Memcached size limits have been increased
+
*** clarkb reached out to starlingx and airship about this
−
*** We should monitor and determine if these changes have improved performance
+
**** Someone from airship is in the opendev matrix room now and their zuul tenant config errors appear to be gone
−
** Raxflex DFW3 Disabled (clarkb 20251104)
+
**** https://lists.starlingx.io/archives/list/starlingx-discuss@lists.starlingx.io/thread/YQVACUR4OCX74ZULHAJ4AD44MHGY37YI/
−
*** We discovered the raxflex dfw3 mirror had afs cache errors. fs flushall appeared to get stuck and the kernel oopsed. After forcing a shutdown via openstack the server refuses to boot
+
** Gitea 1.26.4 Upgrade (clarkb 20260622)
−
*** We've asked dan_with what our next steps should be via IRC
+
*** https://review.opendev.org/c/opendev/system-config/+/994326 Upgrade Gitea to 1.26.4
−
*** Worst case we rebuild the mirror with a new cinder volume and replace the whole thing.
+
*** Its time to upgrade to the next Gitea bugfix release
 +
** Bump Anubis difficult to 5 (clarkb 20260630)
 +
*** There is some evidence that bots are regularly solving the Anubis challenge
 +
*** The challenges are slowing them down enough that services continue to be mostly responsive
 +
*** Should we increase the difficulty one level to slow them down even futher?
 +
*** This will impact regular users too which is likely the primary consideration we should make.
 +
*** https://review.opendev.org/c/opendev/system-config/+/995096
 +
** Planning Gerrit Project Renames (clarkb 20260622)
 +
*** We have a request to rename x/cursive to openstack/cursive
 +
*** Any concern with project ownership doing that? The current group membership includes people from Johns Hopkins University and OpenStack Barbican
 +
*** Aiming for July 9 at ~2100 UTC
 +
**** Clarkb is unlikely to make this time
 +
*** https://etherpad.opendev.org/p/opendev-project-renames-20260709
 +
** Matrix Meetbot Porting (clarkb 20260707)
 +
*** Anil has started a port of the IRC meetbot to Matrix
 +
*** https://review.opendev.org/c/opendev/system-config/+/995755 stack starts here
 +
** OpenMetal Cloud Offline (clarkb 20260707)
 +
*** Zuul had errors talking to this cloud so the cloud was disabled
 +
*** `openstack server list` reports HTTP 500 errors
  
 
* Open discussion
 
* Open discussion
Line 57: Line 60:
 
Changes should have their topic set to project-rename.
 
Changes should have their topic set to project-rename.
  
−
* Rename example/foo -> example/bar: https://review.opendev.org/c/openstack/project-config/+/123456
+
* Rename x/cursive -> openstack/cursive: https://review.opendev.org/c/openstack/project-config/+/990122 (stephenfin, fungi)
  
 
== Previous meetings ==
 
== Previous meetings ==
 
Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/
 
Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/

Latest revision as of 01:52, 7 July 2026

Weekly Project Infrastructure team meeting

The OpenDev Team holds public weekly meetings in #opendev-meeting on OFTC, Tuesdays at 1900 UTC. Everyone interested in infrastructure and process surrounding automated testing and deployment is encouraged to attend.

Please feel free to add agenda items (and your IRC nick in parenthesis).

Agenda for next meeting

  • Announcements
  • Actions from last meeting
  • Specs Review
  • Open discussion

Upcoming Project Renames

(any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit) Changes should have their topic set to project-rename.

Previous meetings

Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/

Retrieved from "https://wiki.openstack.org/w/index.php?title=Meetings/InfraTeamMeeting&oldid=187739"