Jump to: navigation, search

Difference between revisions of "Meetings/InfraTeamMeeting"

(Upcoming Project Renames)
(Agenda for next meeting)
 
(331 intermediate revisions by 14 users not shown)
Line 3: Line 3:
 
= Weekly Project Infrastructure team meeting =
 
= Weekly Project Infrastructure team meeting =
  
The OpenDev Team holds public weekly meetings in <code><nowiki>#opendev-meeting</nowiki></code>, Tuesdays at 1900 UTC. Everyone interested in infrastructure and process surrounding automated testing and deployment is encouraged to attend.
+
The OpenDev Team holds public weekly meetings in <code><nowiki>#opendev-meeting</nowiki></code> on OFTC, Tuesdays at 1900 UTC. Everyone interested in infrastructure and process surrounding automated testing and deployment is encouraged to attend.
  
 
Please feel free to add agenda items (and your IRC nick in parenthesis).
 
Please feel free to add agenda items (and your IRC nick in parenthesis).
Line 10: Line 10:
  
 
* Announcements
 
* Announcements
** Clark out during May 11 meeting time. Need a volunteer chair or can cancel that meeting.
+
** clarkb out June 14-19. Will miss the June 18 meeting if we have one.
  
 
* Actions from last meeting
 
* Actions from last meeting
  
* Specs approval
+
* Specs Review
  
* Priority Efforts (Standing meeting agenda items. Please expand if you have subtopics.)
+
* Topics
** [http://specs.openstack.org/openstack-infra/infra-specs/specs/update-config-management.html Update Config Management]
+
** Upgrading Old Servers (clarkb 20230627)
*** topic:update-cfg-mgmt
+
*** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
*** Zuul as CD engine
+
**** wiki.openstack.org: https://etherpad.opendev.org/p/opendev-mediawiki-upgrade
** OpenDev
+
**** tonyb looking at cacti after wiki
*** Gerrit account inconsistencies
+
*** https://etherpad.opendev.org/p/opendev-focal-server-upgrades
**** All preferred emails lack external ids issues have been corrected. All group loops have been corrected.
+
**** tonyb expects to try a simple focal -> noble upgrade this week
**** Workaround is we can stop Gerrit, push to external ids directly, reindex accounts (and groups?), start gerrit, then clear accounts caches (and groups caches?)
+
** AFS Mirror cleanups (clarkb 20240220)
**** Next steps
+
*** Ubuntu Xenial cleanups are starting to show up under topic:drop-ubuntu-xenial
***** More "dangerous" list has been generated. Should still be safe-ish particularly if we disable the accounts first.
+
*** Can followup with webserver log processing to determine which other mirrors may be dead.
*** Configuration tuning
+
** Gitea 1.22 Upgrade Planning (clarkb 20240528)
**** Reduce the number of ssh threads. Possibly create bot/batch user groups and thread counts as part of this.
+
*** There is a Gitea 1.22.0 release now. Once we have the general upgrade working we can test the doctor tool to fixup the DB case sensitivity.
**** https://groups.google.com/g/repo-discuss/c/BQKxAfXBXuo Upstream conversation with people struggling with similar problems.
+
*** https://review.opendev.org/c/opendev/system-config/+/920580
*** Update our base job's nodeset
+
** Fixing Cloud Launcher Ansible (clarkb 20240604)
**** https://review.opendev.org/789098
+
*** Git updates broke our cloud launcher playbook even after Frickler addressed security group redundancy errors
*** Gerrit global config simplification
+
*** https://review.opendev.org/c/opendev/system-config/+/921685 workaround the Git issue
**** https://review.opendev.org/789383
+
*** We should know on the day of the meeting if this is working again.
 
+
** Improving mailman email throughput (clarkb 20240604)
* General topics
+
*** We've noticed slowness delivering emails for openstack-discuss
** Picking up steam on Puppet -> Ansible rewrites (clarkb 20210504)
+
*** Increasing the number of out runners hasn't alleviated this issue (it should prevent openstack-discuss from holding up other lists though)
*** Enable Xenial -> Bionic/Focal system upgrades
+
*** Next we need to modify the mailman email batch count and exim verp queue sizes.
*** https://etherpad.opendev.org/p/infra-puppet-conversions-and-xenial-upgrades Start capturing TODO list here
+
** OpenMetal Cloud Rebuild (clarkb 20240604)
*** Zuul service host updates in progress now. Zuul scheduler is last remaining server that needs an upgrade in the zuul cluster.
+
*** The old cloud is gone and the new cloud is getting configured.
** openEuler patches (ianw 20210504)
+
*** https://etherpad.opendev.org/p/openmetal-cloud-bootstrapping captures out todo list for bootstrapping the new cloud
*** TC level, or being too officious
+
** Testing Rackspace's New Cloud Offering (clarkb 20240604)
** InMotion Cloud reorganization (clarkb 20210504)
+
*** Rax reached out via a ticket to our nodepool account indicating we can test out their new offering. They are specifically looking for feedback
*** Currently limited by number of IP addresses available
+
*** Probably need to reach out to rax and find out a bit more information before determining if we are the target audience, but if so this is a good opportunity for more test nodes and improved clouds.
*** We could deploy an executor in the cloud then set up test nodes without direct external access
 
*** Any held nodes would need floating IPs attached to them to be accessible
 
** Removing registration requirement from our IRC channels (clarkb 20210504)
 
*** TheJulia asks if we think this is still necessary.
 
*** Looking at the last month or so of eavesdrop logs it seems we had ~1.5 spam attempts in the unregistered channel
 
** Switching artifact signing keys from RSA to ECC
 
*** https://review.opendev.org/789062
 
  
 
* Open discussion
 
* Open discussion
Line 55: Line 48:
 
== Upcoming Project Renames ==
 
== Upcoming Project Renames ==
 
(any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit)
 
(any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit)
 +
Changes should have their topic set to project-rename.
  
* (lajoskatona) x/tap-as-a-service -> openstack/tap-as-a-service: https://review.opendev.org/c/openstack/project-config/+/790093
+
* Rename example/foo -> example/bar: https://review.opendev.org/c/openstack/project-config/+/123456
* foo/example -> bar/example: https://review.opendev.org/#/c/123456
 
  
 
== Previous meetings ==
 
== Previous meetings ==
 
Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/
 
Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/

Latest revision as of 21:03, 10 June 2024

Weekly Project Infrastructure team meeting

The OpenDev Team holds public weekly meetings in #opendev-meeting on OFTC, Tuesdays at 1900 UTC. Everyone interested in infrastructure and process surrounding automated testing and deployment is encouraged to attend.

Please feel free to add agenda items (and your IRC nick in parenthesis).

Agenda for next meeting

  • Announcements
    • clarkb out June 14-19. Will miss the June 18 meeting if we have one.
  • Actions from last meeting
  • Specs Review
  • Topics
    • Upgrading Old Servers (clarkb 20230627)
    • AFS Mirror cleanups (clarkb 20240220)
      • Ubuntu Xenial cleanups are starting to show up under topic:drop-ubuntu-xenial
      • Can followup with webserver log processing to determine which other mirrors may be dead.
    • Gitea 1.22 Upgrade Planning (clarkb 20240528)
    • Fixing Cloud Launcher Ansible (clarkb 20240604)
    • Improving mailman email throughput (clarkb 20240604)
      • We've noticed slowness delivering emails for openstack-discuss
      • Increasing the number of out runners hasn't alleviated this issue (it should prevent openstack-discuss from holding up other lists though)
      • Next we need to modify the mailman email batch count and exim verp queue sizes.
    • OpenMetal Cloud Rebuild (clarkb 20240604)
    • Testing Rackspace's New Cloud Offering (clarkb 20240604)
      • Rax reached out via a ticket to our nodepool account indicating we can test out their new offering. They are specifically looking for feedback
      • Probably need to reach out to rax and find out a bit more information before determining if we are the target audience, but if so this is a good opportunity for more test nodes and improved clouds.
  • Open discussion

Upcoming Project Renames

(any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit) Changes should have their topic set to project-rename.

Previous meetings

Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/