Revision as of 21:45, 18 July 2022

Weekly Project Infrastructure team meeting

The OpenDev Team holds public weekly meetings in #opendev-meeting on OFTC, Tuesdays at 1900 UTC. Everyone interested in infrastructure and process surrounding automated testing and deployment is encouraged to attend.

Please feel free to add agenda items (and your IRC nick in parenthesis).

Agenda for next meeting

• Announcements

• Actions from last meeting

• Specs Review

• Topics
  • Improving OpenDev's CD throughput (clarkb 20220719)
    • Bootstrapping bridge via Zuul is now a complicated subject. Can use zuul secrets to make it happen. Are we comfortable with this?
    • https://review.opendev.org/c/opendev/infra-specs/+/821645 -- spec outlining some of the issues with secrets
    • https://review.opendev.org/c/opendev/system-config/+/821155 -- sample of secret writing; more info in changelog
  • Improving Grafana management tooling (clarkb 20220719)
    • Grafyaml doesn't properly support setting the color thresholds on graphs anymore (this makes failed states show red and happy states show green, we always seen green now)
    • https://lists.opendev.org/pipermail/service-discuss/2022-July/000342.html
    • https://review.opendev.org/q/topic:grafana-json
  • Bastion host (ianw 20220719)
    • worth moving ansible/openstacksdk to a venv? system-config jobs first then production
    • c.f. https://review.opendev.org/c/opendev/system-config/+/847700
    • bastion host OS upgrade. prioin-place? new host? wait until have time to return to some of the bootstrapping/parallel job work?
  • Upgrading Bionic servers to Focal/Jammy (clarkb 20220719)
    • https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
  • Zuul + Ansible v5 + Glibc deadlock (clarkb 20220719)
    • Using backported Debian testing glibc on Zuul images now.
  • Zuul job POST_FAILURES (clarkb 20220719)
    • TripleO and OSA are both seeing a higher than usual number of POST_FAILURES
    • https://review.opendev.org/c/opendev/base-jobs/+/848881 Add remote log store location debug info to prod base job.
  • New Gerrit 3.5 caches (clarkb 20220719)
    • Gerrit 3.5 added some new caches that consume a fair bit more disk space.
    • We've grown the disk for Gerrit to accommodate this change with newer Gerrit.
    • https://review.opendev.org/c/opendev/system-config/+/849886 is our fallback which will disable the caches should their growth continue to be unsustainable.

• Open discussion

Upcoming Project Renames

(any additions should mention original->new full names and link to the corresponding project-config rename change in Gerrit) Changes should have their topic set to project-rename.

• Rename foo/example -> bar/example: https://review.opendev.org/123456

Previous meetings

Previous meetings, with their notes and logs, can be found at http://eavesdrop.openstack.org/meetings/infra/ and earlier at http://eavesdrop.openstack.org/meetings/ci/