Jump to: navigation, search

Difference between revisions of "Meetings/InfraTeamMeeting"

(Agenda for next meeting)
(Agenda for next meeting)
 
(79 intermediate revisions by 5 users not shown)
Line 16: Line 16:
  
 
* Topics
 
* Topics
** Gerrit 3.11 Upgrade Planning (clarkb 20250401)
 
*** https://www.gerritcodereview.com/3.11.html
 
*** Please check this for any concerns with the way we use Gerrit.
 
*** Held nodes for these two builds:
 
**** https://zuul.opendev.org/t/openstack/build/f1ca0d1f2e054829a4506ececb58bed3
 
**** https://zuul.opendev.org/t/openstack/build/588723b923e94901af3065143d9df818
 
*** There is discussion about replication and reindexing bugs in 3.11.4/3.12.1 that don't affect us yet due to being on 3.10. We should try to test these problems to see if they affect us.
 
**** Clarkb tested this with held notes on admittedly trivial test data sets but was unable to reproduce the problems
 
*** Shutting down Gerrit can race the indexing of new changes. If this happens we can have new changes created that are not indexed leading to multiple changes with the same changeid later. To mitigate this we can/should reindex changes on Gerrit startup.
 
*** https://etherpad.opendev.org/p/gerrit-upgrade-3.11 Planning Document for the eventual Upgrade
 
*** Will need to select a date once we know more about the upgrade itself.
 
 
** Upgrading Old Servers (clarkb 20230627)
 
** Upgrading Old Servers (clarkb 20230627)
*** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
+
*** https://etherpad.opendev.org/p/opendev-server-upgrade-planning Central tracking document which may link to more host specific documents
*** https://etherpad.opendev.org/p/opendev-focal-server-upgrades
+
*** Next on the list are graphite and backup servers
*** https://etherpad.opendev.org/p/opendev-server-replacement-sprint
+
*** backup03.ca-ymq-1.vexxhost.opendev.org has been launched and is being backed up too
**** wiki.openstack.org: https://etherpad.opendev.org/p/opendev-mediawiki-upgrade
+
**** https://review.opendev.org/c/opendev/system-config/+/995420 Starting backup02 removal here
**** tonyb looking at cacti after wiki
 
*** Fungi announced refstack removal and cleanup: https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/WNI4PE2TZ3G52C3U5FT2YNVRUAJB3CMO/
 
*** Need to cleanup the eavesdrop01 server and its DNS records.
 
 
*** Remember to use launch-node's --config-drive flag when booting new Noble nodes in Rax Classic
 
*** Remember to use launch-node's --config-drive flag when booting new Noble nodes in Rax Classic
** Working through our TODO list (clarkb 20250107)
+
** Deploying a Prometheus for Server Metrics (clarkb 20260331)
*** https://etherpad.opendev.org/p/opendev-running-todo-list
+
*** https://review.opendev.org/c/opendev/system-config/+/980840
** Moving OpenDev Synchronous Communication to Matrix (clarkb 20250520)
+
*** This change and its child deploy prometheus with node exporter to collect server metrics
*** https://review.opendev.org/c/opendev/infra-specs/+/954826 Spec outlining the motivation and plan for Matrix trialing
+
*** These two changes simplify the setup and testing of prometheus and node exporter
** Pre PTG Planning (clarkb 20250624)
+
**** https://review.opendev.org/c/zuul/zuul-jobs/+/994564 manage /etc/hosts with public IPs
*** https://etherpad.opendev.org/p/opendev-preptg-october-2025 Planning happening in this document
+
**** https://review.opendev.org/c/opendev/system-config/+/994565 Use public IPs in system-config-run jobs
*** Clarkb has added a number of topic Ideas. Please add more.
+
** Dealing with alien zuul config errors in the openstack tenant (frickler 20260617)
*** Proposed times: Tuesday October 7 1800-2000 UTC, Wednesday October 8 1500-1700 UTC, Thursday October 9 1500-1700
+
*** clarkb reached out to starlingx and airship about this
*** The Tuesday time block would effectively replace our weekly IRC meeting.
+
**** Someone from airship is in the opendev matrix room now and their zuul tenant config errors appear to be gone
** Service Coordinator Election Planning (clarkb 20250729)
+
**** https://lists.starlingx.io/archives/list/starlingx-discuss@lists.starlingx.io/thread/YQVACUR4OCX74ZULHAJ4AD44MHGY37YI/
*** Nomination Period open from August 5, 2025 to August 19, 2025. If necessary we will hold an election from August 20, 2025 to August 27, 2025. All date ranges and times will be in UTC.
+
** Gitea 1.26.4 Upgrade (clarkb 20260622)
*** https://lists.opendev.org/archives/list/service-discuss@lists.opendev.org/thread/YXRD23ZWJGDPZ3WESBNZNEYO7NBCXFT4/
+
*** https://review.opendev.org/c/opendev/system-config/+/994326 Upgrade Gitea to 1.26.4
*** Clarkb is more than happy to support someone new in the role. Please reach out if there are questions or interest.
+
*** Its time to upgrade to the next Gitea bugfix release
*** One week left in the nomination period.
+
** Bump Anubis difficult to 5 (clarkb 20260630)
** Loss of upstream Debian bullseye-backports mirror (fungi 20250805)
+
*** There is some evidence that bots are regularly solving the Anubis challenge
*** https://review.opendev.org/956497 temporarily ignore undefinedtarget
+
*** The challenges are slowing them down enough that services continue to be mostly responsive
*** the workaround isn't too bad, but we need to make a longer-term decision about our mirror contents and the configure-mirrors role
+
*** Should we increase the difficulty one level to slow them down even futher?
** Adding Ansible 11 to Zuul (corvus 20250805)
+
*** This will impact regular users too which is likely the primary consideration we should make.
*** Zuul is growing support for Ansible 11 and dropping Ansible 8
+
*** https://review.opendev.org/c/opendev/system-config/+/995096
*** What is our rollout plan for OpenDev's Zuul deployment and its tenants?
+
** Planning Gerrit Project Renames (clarkb 20260622)
** Etherpad 2.4.2 Upgrade (clarkb 20250805)
+
*** We have a request to rename x/cursive to openstack/cursive
*** https://github.com/ether/etherpad-lite/blob/v2.4.2/CHANGELOG.md
+
*** Any concern with project ownership doing that? The current group membership includes people from Johns Hopkins University and OpenStack Barbican
*** Theming updates have broken the no-skin and custom skin themes. We use no-skin. https://github.com/ether/etherpad-lite/issues/7065
+
*** Aiming for July 9 at ~2100 UTC
*** We could consider switching to Colibris skin which does work. This skin presents etherpads in a google docs piece of paper manner.
+
**** Clarkb is unlikely to make this time
** Cleaning Up the Old voip.ms Account (clarkb 20250812)
+
*** https://etherpad.opendev.org/p/opendev-project-renames-20260709
*** The foundation noticed a small charge on our voip.ms account recently. We haven't used it since asterisk went away.
+
** Matrix Meetbot Porting (clarkb 20260707)
*** Fungi and I would like to clean that up. If we configure meetpad to interface with POTS we can reconfigure SIP and set up a new account or resurrect the old one.
+
*** Anil has started a port of the IRC meetbot to Matrix
*** Any concerns with this plan?
+
*** https://review.opendev.org/c/opendev/system-config/+/995755 stack starts here
** Moving OpenDev's python-base/python-builder/uwsig-base Images to Quay (clarkb 20250812)
+
** OpenMetal Cloud Offline (clarkb 20260707)
*** All of our containers that are build from these base images are now running on Noble nodes with podman
+
*** Zuul had errors talking to this cloud so the cloud was disabled
*** It should be safe for us to move the base images then rebuild everything using quay as the source.
+
*** `openstack server list` reports HTTP 500 errors
*** Concerns
 
**** Projects outside of OpenDev use these base images (zuul and vexxhost for example). Do we need to coordinate with them or just do our best to get everything updated in a short span of time?
 
**** Image builds that are built using docker as the underlying build system may still fail to speculatively fetch images from Quay. I believe that using buildx/buildkit which is now docker's default fixes this; however, I am unsure if we need to make updates to our build jobs to make that work.
 
  
 
* Open discussion
 
* Open discussion
Line 77: Line 60:
 
Changes should have their topic set to project-rename.
 
Changes should have their topic set to project-rename.
  
* Rename example/foo -> example/bar: https://review.opendev.org/c/openstack/project-config/+/123456
+
* Rename x/cursive -> openstack/cursive: https://review.opendev.org/c/openstack/project-config/+/990122 (stephenfin, fungi)
  
 
== Previous meetings ==
 
== Previous meetings ==
 
Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/
 
Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/

Latest revision as of 01:52, 7 July 2026

Weekly Project Infrastructure team meeting

The OpenDev Team holds public weekly meetings in #opendev-meeting on OFTC, Tuesdays at 1900 UTC. Everyone interested in infrastructure and process surrounding automated testing and deployment is encouraged to attend.

Please feel free to add agenda items (and your IRC nick in parenthesis).

Agenda for next meeting

  • Announcements
  • Actions from last meeting
  • Specs Review
  • Open discussion

Upcoming Project Renames

(any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit) Changes should have their topic set to project-rename.

Previous meetings

Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/