Jump to: navigation, search

Difference between revisions of "Meetings/InfraTeamMeeting"

(Agenda for next meeting)
(Agenda for next meeting)
 
(108 intermediate revisions by 7 users not shown)
Line 10: Line 10:
  
 
* Announcements
 
* Announcements
 +
** clarkb out June 14-19. Will miss the June 18 meeting if we have one.
  
 
* Actions from last meeting
 
* Actions from last meeting
Line 16: Line 17:
  
 
* Topics
 
* Topics
** Bastion host (ianw 20230627)
+
** Upgrading Old Servers (clarkb 20230627)
*** https://review.opendev.org/q/topic:prod-bastion-group Remaining changes are part of parallel ansible runs on bridge
 
*** https://review.opendev.org/q/topic:bridge-backups
 
** Mailman 3 (clarkb 20230627)
 
*** https://etherpad.opendev.org/p/mm3migration
 
*** Need to change site domains
 
** Gerrit replication leaked tasks (clarkb 20230627)
 
*** https://review.opendev.org/c/opendev/system-config/+/880672 Workaround "leaked" replication tasks on disk.
 
**** https://bugs.chromium.org/p/gerrit/issues/detail?id=16867
 
**** https://bugs.chromium.org/p/gerrit/issues/detail?id=16868
 
**** https://review.opendev.org/c/opendev/system-config/+/884779 Revert bind mounts for Gerrit plugin data
 
** Gerrit reject implict merge changes (clarkb 20230627)
 
*** We merged a revert of a change on branch foo to branch bar which implicitly merged foo into bar
 
*** Gerrit project config receive.rejectImplicitMerges can be set to true to prevent this changes from being pushed
 
*** Should we go ahead and set that on All-Projects? The default value is to inherit from the parent config.
 
** Upgrading Bionic servers to Focal/Jammy (clarkb 20230627)
 
 
*** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
 
*** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
*** CI registry is done. (Cleanup of old host still needs to be done).
+
**** wiki.openstack.org: https://etherpad.opendev.org/p/opendev-mediawiki-upgrade
*** Next up mirrors, meetpad, and ci registry.
+
**** tonyb looking at cacti after wiki
*** Please grab a node or two.
+
*** https://etherpad.opendev.org/p/opendev-focal-server-upgrades
*** Zuul installation being updated as Jammy enables use of Podman
+
**** tonyb expects to try a simple focal -> noble upgrade this week
** Fedora cleanup (clarkb 20230627)
+
** AFS Mirror cleanups (clarkb 20240220)
*** Proposed the removal of Fedora mirrors and/or images https://lists.opendev.org/archives/list/service-discuss@lists.opendev.org/thread/IOYIYWGTZW3TM4TR2N47XY6X7EB2W2A6/
+
*** Ubuntu Xenial cleanups are starting to show up under topic:drop-ubuntu-xenial
**** Tonyb has been looking at moving existing fedora test nodes off of our mirrors. Not straightforward as it requires zuul-jobs role updates.
+
*** Can followup with webserver log processing to determine which other mirrors may be dead.
** Quo vadis storyboard (frickler 20230627)
+
** Gitea 1.22 Upgrade Planning (clarkb 20240528)
*** ML thread https://lists.opendev.org/pipermail/service-discuss/2022-October/000370.html
+
*** There is a Gitea 1.22.0 release now. Once we have the general upgrade working we can test the doctor tool to fixup the DB case sensitivity.
*** Some projects decided to move back to launchpad at the most recent PTG
+
*** https://review.opendev.org/c/opendev/system-config/+/920580
** Gitea 1.20 (clarkb 20230627)
+
** Fixing Cloud Launcher Ansible (clarkb 20240604)
*** https://review.opendev.org/c/opendev/system-config/+/886993
+
*** Git updates broke our cloud launcher playbook even after Frickler addressed security group redundancy errors
*** https://github.com/go-gitea/gitea/issues/25377
+
*** https://review.opendev.org/c/opendev/system-config/+/921685 workaround the Git issue
** Etherpad 1.9.1 (clarkb 20230627)
+
*** We should know on the day of the meeting if this is working again.
*** https://review.opendev.org/c/opendev/system-config/+/887006
+
** Improving mailman email throughput (clarkb 20240604)
*** There were issues with user name and color settings. Resyncing our config to use null values instead of false boolean values seems to address this. But further testing on a held node is required.
+
*** We've noticed slowness delivering emails for openstack-discuss
** Python container updates (tonyb 20230718)
+
*** Increasing the number of out runners hasn't alleviated this issue (it should prevent openstack-discuss from holding up other lists though)
*** Some moderate progress in the first round
+
*** Next we need to modify the mailman email batch count and exim verp queue sizes.
*** https://review.opendev.org/q/topic:bookworm-python and https://review.opendev.org/q/topic:force-base-image-build
+
** OpenMetal Cloud Rebuild (clarkb 20240604)
*** I noticed that https://opendev.org/openstack/python-openstackclient/src/branch/master/Dockerfile is using a 3.9 tag which is buster
+
*** The old cloud is gone and the new cloud is getting configured.
*** Should we update those tags?
+
*** https://etherpad.opendev.org/p/openmetal-cloud-bootstrapping captures out todo list for bootstrapping the new cloud
*** Should we remove the old tags similare to change_789650_3.9 ?
+
** Testing Rackspace's New Cloud Offering (clarkb 20240604)
 +
*** Rax reached out via a ticket to our nodepool account indicating we can test out their new offering. They are specifically looking for feedback
 +
*** Probably need to reach out to rax and find out a bit more information before determining if we are the target audience, but if so this is a good opportunity for more test nodes and improved clouds.
  
 
* Open discussion
 
* Open discussion
Line 62: Line 50:
 
Changes should have their topic set to project-rename.
 
Changes should have their topic set to project-rename.
  
* Rename foo/example -> bar/example: https://review.opendev.org/123456
+
* Rename example/foo -> example/bar: https://review.opendev.org/c/openstack/project-config/+/123456
  
 
== Previous meetings ==
 
== Previous meetings ==
 
Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/
 
Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/

Latest revision as of 21:03, 10 June 2024

Weekly Project Infrastructure team meeting

The OpenDev Team holds public weekly meetings in #opendev-meeting on OFTC, Tuesdays at 1900 UTC. Everyone interested in infrastructure and process surrounding automated testing and deployment is encouraged to attend.

Please feel free to add agenda items (and your IRC nick in parenthesis).

Agenda for next meeting

  • Announcements
    • clarkb out June 14-19. Will miss the June 18 meeting if we have one.
  • Actions from last meeting
  • Specs Review
  • Topics
    • Upgrading Old Servers (clarkb 20230627)
    • AFS Mirror cleanups (clarkb 20240220)
      • Ubuntu Xenial cleanups are starting to show up under topic:drop-ubuntu-xenial
      • Can followup with webserver log processing to determine which other mirrors may be dead.
    • Gitea 1.22 Upgrade Planning (clarkb 20240528)
    • Fixing Cloud Launcher Ansible (clarkb 20240604)
    • Improving mailman email throughput (clarkb 20240604)
      • We've noticed slowness delivering emails for openstack-discuss
      • Increasing the number of out runners hasn't alleviated this issue (it should prevent openstack-discuss from holding up other lists though)
      • Next we need to modify the mailman email batch count and exim verp queue sizes.
    • OpenMetal Cloud Rebuild (clarkb 20240604)
    • Testing Rackspace's New Cloud Offering (clarkb 20240604)
      • Rax reached out via a ticket to our nodepool account indicating we can test out their new offering. They are specifically looking for feedback
      • Probably need to reach out to rax and find out a bit more information before determining if we are the target audience, but if so this is a good opportunity for more test nodes and improved clouds.
  • Open discussion

Upcoming Project Renames

(any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit) Changes should have their topic set to project-rename.

Previous meetings

Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/