Jump to: navigation, search

Difference between revisions of "Meetings/InfraTeamMeeting"

(add twitter topic)
(Agenda for next meeting)
 
(169 intermediate revisions by 10 users not shown)
Line 16: Line 16:
  
 
* Topics
 
* Topics
** Bastion host (ianw 20221108)
+
** Upgrading Old Servers (clarkb 20230627)
*** https://review.opendev.org/q/topic:prod-bastion-group
 
*** https://review.opendev.org/q/topic:bridge-ansible-venv
 
*** https://review.opendev.org/c/opendev/system-config/+/863564
 
*** https://review.opendev.org/c/opendev/system-config/+/863568
 
** Upgrading Bionic servers to Focal/Jammy (clarkb 20221101)
 
 
*** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
 
*** https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
** Mailman 3 (clarkb 20221108)
+
**** wiki.openstack.org: https://etherpad.opendev.org/p/opendev-mediawiki-upgrade
*** https://review.opendev.org/c/opendev/system-config/+/851248 Worthy of review at this point
+
**** tonyb looking at cacti after wiki
*** https://etherpad.opendev.org/p/mm3migration
+
*** https://etherpad.opendev.org/p/opendev-focal-server-upgrades
*** https://review.opendev.org/c/opendev/system-config/+/860157 Forking the upstream images due to lack of attention on issues and PRs we've filed
+
**** tonyb expects to try a simple focal -> noble upgrade this week
** Updating base python docker images to use `pip wheel` (clarkb 20221108)
+
** AFS Mirror cleanups (clarkb 20240220)
*** Pip changed how it addresses wheels in its wheel cache which broke our assemble script's ability to build packages on our image builds.
+
*** Ubuntu Xenial cleanups are starting to show up under topic:drop-ubuntu-xenial
*** I've filed a bug against pip for this and pushed a PR to fix it. However, upstream pip says we shouldn't rely on the wheel cache like this and should use `pip wheel` instead.
+
*** Can followup with webserver log processing to determine which other mirrors may be dead.
*** https://github.com/pypa/pip/issues/11527
+
** Gerrit 3.9 Upgrade Planning (clarkb 20240423)
*** https://github.com/pypa/pip/pull/11538
+
*** Gerrit has been upgraded
*** https://review.opendev.org/c/opendev/system-config/+/862152
+
*** https://review.opendev.org/c/opendev/system-config/+/920938 is ready when we think we won't revert to 3.8
** Etherpad docker container logs growth (clarkb 20221101)
+
**** Followup changes to ^ add 3.10 image builds and testing
*** Need change to log to syslog instead similar to other services.
+
** Gitea 1.22 Upgrade Planning (clarkb 20240528)
** Quo vadis storyboard (frickler 20221107)
+
*** There is a Gitea 1.22.0 release now. Once we have the general upgrade working we can test the doctor tool to fixup the DB case sensitivity.
*** ML thread https://lists.opendev.org/pipermail/service-discuss/2022-October/000370.html
+
*** https://review.opendev.org/c/opendev/system-config/+/920580
*** Many people interested in moving away from storyboard
+
** Fixing Cloud Launcher Ansible (clarkb 20240604)
*** No volunteers to update our installation
+
*** Git updates broke our cloud launcher playbook even after Frickler addressed security group redundancy errors
*** How long can we/do we want to commit to running an outdated installation on an EOL OS?
+
*** https://review.opendev.org/c/opendev/system-config/+/921061 workaround the Git issue
** Nova server rescue behavior in vexxhost (clarkb 20221108)
+
** Increase Mailman 3 Out Runner Count (clarkb 20240604)
*** Clarkb has tested this and the behaviors are surprising
+
*** We've seen outbound mail delivery for large lists take noticeable amounts of time
*** Rescuing a normal disk instance results in the instance boot with the rescue image kernel and the rescued instance's root device mounted on / instead of the rescue image mounted to /.
+
*** https://review.opendev.org/c/opendev/system-config/+/920765 Increase the number of out runners to speed up outbound mail delivery
*** Rescuing a BFV instance fails. First with the default microversion because old Nova API doesn't support this. When using microversion 2.88 it also fails, but only after attempting to rescue.
+
** OpenMetal Cloud Rebuild (clarkb 20240604)
**** The instance goes into an error state due to "cannot be rescued: Driver Error: Cannot access storage file"
+
*** Yuriys has been in touch via email indicating things are ready on their side to rebuild this cloud on their new platform
**** Attempting to unrescue the instance also fails because you cannot unrescue an instance that is in an error state
+
*** We need to gracefully shutdown and remove the existing cloud resources from Nodepool
** Goodbye birdsite, hello tooters? (frickler 20221115)
+
*** OpenMetal will work with us to build the new cloud, then we can add a mirror node and add the new cloud to Nodepool
*** Twitter seems to be on a downward spiral and we should consider stopping using it
+
*** https://review.opendev.org/c/openstack/project-config/+/921072 Nodepool cleanups
*** OIF already has an account on fosstodon.org, also ianw and frickler
+
*** https://review.opendev.org/c/opendev/system-config/+/921075 System-config cleanups
*** Do we want to move the opendevinfra acc there, too?
+
** Testing Rackspace's New Cloud Offering (clarkb 20240604)
*** How much work is needed in terms of tooling? Any volunteers?
+
*** Rax reached out via a ticket to our nodepool account indicating we can test out their new offering. They are specifically looking for feedback
 +
*** Probably need to reach out to rax and find out a bit more information before determining if we are the target audience, but if so this is a good opportunity for more test nodes and improved clouds.
  
 
* Open discussion
 
* Open discussion
Line 58: Line 54:
 
Changes should have their topic set to project-rename.
 
Changes should have their topic set to project-rename.
  
* Rename foo/example -> bar/example: https://review.opendev.org/123456
+
* Rename example/foo -> example/bar: https://review.opendev.org/c/openstack/project-config/+/123456
  
 
== Previous meetings ==
 
== Previous meetings ==
 
Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/
 
Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/

Latest revision as of 20:56, 3 June 2024

Weekly Project Infrastructure team meeting

The OpenDev Team holds public weekly meetings in #opendev-meeting on OFTC, Tuesdays at 1900 UTC. Everyone interested in infrastructure and process surrounding automated testing and deployment is encouraged to attend.

Please feel free to add agenda items (and your IRC nick in parenthesis).

Agenda for next meeting

  • Announcements
  • Actions from last meeting
  • Specs Review
  • Open discussion

Upcoming Project Renames

(any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit) Changes should have their topic set to project-rename.

Previous meetings

Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/