Jump to: navigation, search

Difference between revisions of "Meetings/InfraTeamMeeting"

(Agenda for next meeting)
(Agenda for next meeting)
 
(185 intermediate revisions by 10 users not shown)
Line 10: Line 10:
  
 
* Announcements
 
* Announcements
 +
** clarkb out June 14-19. Will miss the June 18 meeting if we have one.
  
 
* Actions from last meeting
 
* Actions from last meeting
Line 16: Line 17:
  
 
* Topics
 
* Topics
** Bastion host (ianw 20220913)
+
** Upgrading Old Servers (clarkb 20230627)
*** worth moving ansible/openstacksdk to a venv?  system-config jobs first then production
 
*** c.f. https://review.opendev.org/c/opendev/system-config/+/847700
 
*** bastion host OS upgrade.  prioin-place?  new host?  wait until have time to return to some of the bootstrapping/parallel job work?
 
*** https://review.opendev.org/c/zuul/zuul/+/855309/
 
*** https://review.opendev.org/c/opendev/system-config/+/855472
 
** Upgrading Bionic servers to Focal/Jammy (clarkb 20220913)
 
 
*** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
 
*** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
** Mailman 3 (clarkb 20220913)
+
**** wiki.openstack.org: https://etherpad.opendev.org/p/opendev-mediawiki-upgrade
*** https://review.opendev.org/c/opendev/system-config/+/851248 Worthy of review at this point
+
**** tonyb looking at cacti after wiki
*** https://etherpad.opendev.org/p/mm3migration
+
*** https://etherpad.opendev.org/p/opendev-focal-server-upgrades
*** Bulk migration identified a few things that have since been updated. Need another pass to check.
+
**** tonyb expects to try a simple focal -> noble upgrade this week
*** Pipermail redirects need testing on held node.
+
** AFS Mirror cleanups (clarkb 20240220)
** Jaeger tracing server (for Zuul) (corvus 20220913)
+
*** Ubuntu Xenial cleanups are starting to show up under topic:drop-ubuntu-xenial
*** https://review.opendev.org/c/opendev/system-config/+/855983 Adds ansible and docker deployment for Jaeger
+
*** Can followup with webserver log processing to determine which other mirrors may be dead.
** Fedora 36 Rollout (clarkb 20220913)
+
** Gitea 1.22 Upgrade Planning (clarkb 20240528)
*** https://review.opendev.org/c/zuul/nodepool/+/853914 Remove fedora 35 testing from nodepool
+
*** There is a Gitea 1.22.0 release now. Once we have the general upgrade working we can test the doctor tool to fixup the DB case sensitivity.
** Jitsi Meet Updates for Meetpad (clarkb 20220913)
+
*** https://review.opendev.org/c/opendev/system-config/+/920580
*** https://review.opendev.org/c/opendev/system-config/+/856553 Update to use colibri websockets and scale out JVBs
+
** Fixing Cloud Launcher Ansible (clarkb 20240604)
*** Not sure if the java keystore in use by the JVBs need to share a CA or otherwise be trusted by something else.
+
*** Git updates broke our cloud launcher playbook even after Frickler addressed security group redundancy errors
** Stability of Zuul reboot playbook (clarkb 20220913)
+
*** https://review.opendev.org/c/opendev/system-config/+/921685 workaround the Git issue
*** New instability identified caused by race between container shutdown and docker exec for graceful command
+
*** We should know on the day of the meeting if this is working again.
*** https://review.opendev.org/c/opendev/system-config/+/857209 Fix for this race
+
** Improving mailman email throughput (clarkb 20240604)
** Python container image updates (clarkb 20220913)
+
*** We've noticed slowness delivering emails for openstack-discuss
*** https://review.opendev.org/c/opendev/system-config/+/856537
+
*** Increasing the number of out runners hasn't alleviated this issue (it should prevent openstack-discuss from holding up other lists though)
*** Updates to latest python point releases.
+
*** Next we need to modify the mailman email batch count and exim verp queue sizes.
*** This pulls in newer glibc allowing us to remove the backport in Zuul images
+
** OpenMetal Cloud Rebuild (clarkb 20240604)
** Improving Ansible task runtime (clarkb 20220913)
+
*** The old cloud is gone and the new cloud is getting configured.
*** Ansible tasks can be slow on some test nodes.
+
*** https://etherpad.opendev.org/p/openmetal-cloud-bootstrapping captures out todo list for bootstrapping the new cloud
*** Particularly problematic when loops are used that serially process a large set of items
+
** Testing Rackspace's New Cloud Offering (clarkb 20240604)
*** https://review.opendev.org/c/zuul/zuul-jobs/+/857228
+
*** Rax reached out via a ticket to our nodepool account indicating we can test out their new offering. They are specifically looking for feedback
*** https://review.opendev.org/c/opendev/system-config/+/857232
+
*** Probably need to reach out to rax and find out a bit more information before determining if we are the target audience, but if so this is a good opportunity for more test nodes and improved clouds.
*** Be on the lookout for problematic tasks and updates to speed them up.
 
  
 
* Open discussion
 
* Open discussion
Line 56: Line 50:
 
Changes should have their topic set to project-rename.
 
Changes should have their topic set to project-rename.
  
* Rename foo/example -> bar/example: https://review.opendev.org/123456
+
* Rename example/foo -> example/bar: https://review.opendev.org/c/openstack/project-config/+/123456
  
 
== Previous meetings ==
 
== Previous meetings ==
 
Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/
 
Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/

Latest revision as of 21:03, 10 June 2024

Weekly Project Infrastructure team meeting

The OpenDev Team holds public weekly meetings in #opendev-meeting on OFTC, Tuesdays at 1900 UTC. Everyone interested in infrastructure and process surrounding automated testing and deployment is encouraged to attend.

Please feel free to add agenda items (and your IRC nick in parenthesis).

Agenda for next meeting

  • Announcements
    • clarkb out June 14-19. Will miss the June 18 meeting if we have one.
  • Actions from last meeting
  • Specs Review
  • Topics
    • Upgrading Old Servers (clarkb 20230627)
    • AFS Mirror cleanups (clarkb 20240220)
      • Ubuntu Xenial cleanups are starting to show up under topic:drop-ubuntu-xenial
      • Can followup with webserver log processing to determine which other mirrors may be dead.
    • Gitea 1.22 Upgrade Planning (clarkb 20240528)
    • Fixing Cloud Launcher Ansible (clarkb 20240604)
    • Improving mailman email throughput (clarkb 20240604)
      • We've noticed slowness delivering emails for openstack-discuss
      • Increasing the number of out runners hasn't alleviated this issue (it should prevent openstack-discuss from holding up other lists though)
      • Next we need to modify the mailman email batch count and exim verp queue sizes.
    • OpenMetal Cloud Rebuild (clarkb 20240604)
    • Testing Rackspace's New Cloud Offering (clarkb 20240604)
      • Rax reached out via a ticket to our nodepool account indicating we can test out their new offering. They are specifically looking for feedback
      • Probably need to reach out to rax and find out a bit more information before determining if we are the target audience, but if so this is a good opportunity for more test nodes and improved clouds.
  • Open discussion

Upcoming Project Renames

(any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit) Changes should have their topic set to project-rename.

Previous meetings

Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/