Jump to: navigation, search

Difference between revisions of "Meetings/CyborgTeamMeeting"

Line 17: Line 17:
=== Agenda ===
=== Agenda ===
* Jun 24, 2021
# tempest failure: both cyborg and cyborg tempest plugin have bugs, can we fix them in one time.
# vgpu support
## nova had discussed about it, need more review.
## env setup status
# doc improvement
* Jun 17, 2021
* Jun 17, 2021
# doc improvement: tempest test down, need look into it.
# doc improvement: tempest test down, need look into it.

Revision as of 15:25, 23 June 2021

Weekly IRC Cyborg team meeting

  • Where: #openstack-cyborg IRC channel
  • When: Every Thursday at UTC 0200 (China @10 am Thu; US West Coast @7 pm Wed)

If you are not familiar with IRC, please read https://wiki.openstack.org/wiki/IRC .

If you want attend the meeting, please join us at https://www.irccloud.com/irc/oftc/channel/openstack-cyborg

If you want to attend but the time is not friendly to you, please post an email message in openstack-discuss.

Previous meeting logs at: http://eavesdrop.openstack.org/irclogs/%23openstack-cyborg/


  • Jun 24, 2021
  1. tempest failure: both cyborg and cyborg tempest plugin have bugs, can we fix them in one time.
  2. vgpu support
    1. nova had discussed about it, need more review.
    2. env setup status
  3. doc improvement
  4. AoB
  • Jun 17, 2021
  1. doc improvement: tempest test down, need look into it.
  2. vgpu support:
    1. reproposed spec in nova, need more review to merge.
  3. pmem support in cyborg: 2 blueprints submitted.
  • Jan 27, 2021:
  1. pending patches:
    1. vgpu implementation
    2. ssd driver
    3. x710 driver
  • Jan 21, 2021:
  1. Project schedule: python-cyborgclient cycle-with-intermediary release, cyborg-spec freeze.
  2. vGPU update(spec and patch)
  3. Drivers: x710, NVMe driver spec/patch
  4. Cyborg-Nova: shelve/unshelve support
  • Jan 7,2021:
  1. vGPU update: vGPU driver code has been submitted, need a real env to test it. https://review.opendev.org/c/openstack/cyborg/+/769482 Test steps: 1)test discover with patch 769482 and 764450, 2)test instance boot based on 1) and another patch(to be submitted)
  2. do we really need host_ip in [api] part of cyborg.conf: host_apihttps://review.opendev.org/c/openstack/cyborg/+/766629
  • Dec 31,2020:
  1. Yumeng changed her company and work priority, so she is going to step down from the PTL position and look for new people to take over the role
  2. Agreed to switch back to launchpad in the next release. (Brin) will run this switch and update https://review.opendev.org/c/openstack/cyborg/+/764603 after finish the switch.
  • Dec 17, 2020:
  1. review status
  • Dec 3,2020:
  1. pay attention to nova-spec review deadline: Jan 18 - Jan 22: Wallaby-2 milestone, nova spec freeze, nova spec-review round2: http://lists.openstack.org/pipermail/openstack-discuss/2020-November/018932.html
  2. status update: smartnic https://review.opendev.org/c/openstack/nova-specs/+/742785, vgpu nova-spec https://review.opendev.org/c/openstack/nova-specs/+/750116
  3. patch needs review : vgpu cyborg conf https://review.opendev.org/c/openstack/cyborg/+/764450,
  4. doc patch needs review: https://review.opendev.org/c/openstack/cyborg/+/764603
  5. CLl doc page needs update https://review.opendev.org/c/openstack/python-openstackclient/+/751986
  • Nov 26,2020:
  1. vgpu support: when do we create mdev UUID? at the time we generate attach_handle or bind arq?
  • Nov 19, 2020:
  1. spec status review
  • Nov 12,2020:
  1. .propose Wenping as a core reviewer
  2. .spec review
  3. .ping nova about vGPU and smartnic
  4. .other reviews
  • Nov 05,2020:
  1. Wallaby Goals and Schedules: https://wiki.openstack.org/wiki/Cyborg/Wallaby_Release_Schedule
  2. Reiterate call: 1)Use storyboard, don't forget to create a story. 2) add tags when you create a story, otherwise, it won't be automatically tracked by the board page:https://storyboard.openstack.org/#!/board/224
  3. spec review for R-22: vGPU spec: https://review.opendev.org/#/c/750116/, https://review.opendev.org/#/c/758925/; smart nic spec; Attribute API support specs; CLI DOC: https://review.opendev.org/#/c/751986/1
  • Oct 15, 2020:
  1. Victoria Release has been officially released! https://docs.openstack.org/releasenotes/cyborg/victoria.html, http://lists.openstack.org/pipermail/openstack-announce/2020-October/002041.html
  2. (Oct 26-30)Wallaby PTG topics: https://etherpad.opendev.org/p/cyborg-wallaby-goals
  3. (Oct 23-25)Changsha Hackathon for Chinese contributors and vendors: https://etherpad.opendev.org/p/cyborg-changsha-hackathon
  • Oct 08,2020: canceled due to holidays
  • Sep 17, 2020:
  1. Code freeze is Oct 05 - Oct 09, but we actually may just have 13 days to go before RC cut because of the Chinese National Holiday(Oct 01 - Oct 08).
  2. program API patch: https://review.opendev.org/#/c/698190/
  3. What to do next week? review and merge docs, release note, bug fix, and necessary enhancement patches mainly for Victoria delivery.
  4. what is not good with the current doc page? what we can do in the next few days? https://docs.openstack.org/cyborg/latest/
  5. Re the above Q(Yumeng):lack of CLI doc is a problem:https://docs.openstack.org/python-cyborgclient/latest/cli/index.html, https://docs.openstack.org/cyborg/latest/cli/index.html
  • Sep 10,2020:
  1. Sep 07 - Sep 11 is the Victoria-3 milestone, Feature Freeze. We will not add new features after tomorrow. The deadline for Last release candidates is Oct 05 - Oct 09.
  2. What features are we going to merge in this release? policy-popup, program API, new driver https://review.opendev.org/#/q/status:open+project:openstack/cyborg+branch:master+topic:policy-popup
  3. program API: https://review.opendev.org/#/c/698190/ need to pull and fix the merge conflicts
  4. PTG etherpad: https://etherpad.opendev.org/p/cyborg-wallaby-goals
  • Sep 03,2020:
  1. pls check PTG schedule and etherpad: https://ethercalc.openstack.org/7xp2pcbh1ncb https://etherpad.opendev.org/p/cyborg-wallaby-goals (Please add your availability to the doodle if the scheduled time does not fit your time https://doodle.com/poll/mrudbrn87vh48ayq)
  2. do we need to add micro-version doc as nova does? https://docs.openstack.org/api-guide/compute/microversions.html
  3. patch review: deployable_name unique: https://review.opendev.org/#/c/748366/3 ,
  4. review programming API: https://review.opendev.org/#/c/698190/
  5. other reviews:
  • August 27,2020:
  1. review priority this week:
  2. microversion change and add arq-instance-project_id: https://review.opendev.org/#/q/status:open+project:openstack/cyborg+branch:master+topic:arq-instance-project-id
  3. programming API https://review.opendev.org/#/c/698190/
  4. drivers: 1) where should we put driver report? 2) VENDOR_MAPS format of GPU,FPGA are different, should we keep consistent?
  5. Intel QAT: https://review.opendev.org/#/c/725821/, Inspur FPGA: https://review.opendev.org/#/c/729852/
  6. Virtual PTG for wallaby will be held from October 26th to October 30th, 2020: http://lists.openstack.org/pipermail/openstack-discuss/2020-August/016424.html
  7. Team signup is done, we need to pool the time to choose a time slot on the schedule: https://ethercalc.openstack.org/7xp2pcbh1ncb
  • August 20, 2020:
  1. microversion usage: https://review.opendev.org/#/c/746282/ and its usage in programming API https://review.opendev.org/#/c/698190/
  • August13,2020:
  1. Release countdown for Victoria-3 milestone(Sep 07 - Sep 11): Development Focus review
  2. highest review priority this week: cyborg evacuate support: https://review.opendev.org/#/c/715326/, https://review.opendev.org/#/c/726564/6
  3. secondary high review priority this week: new drivers support: https://review.opendev.org/#/c/729852/, https://review.opendev.org/#/c/725821/
  4. policy refresh and programming API patches are under development
  5. China OpenInfra Days will be held on Aug 16-17, we will have two cyborg related sessions.
  • August6,2020:
  1. policy patch got comments from Ghanshyam(high priority): https://review.opendev.org/#/c/740542/
  2. nova operations support patches(high priority) need review: https://review.opendev.org/#/c/715326/, https://review.opendev.org/#/c/729563/
  3. programme API need refresh(high priority): https://review.opendev.org/#/c/698190/
  4. Maillist discussion on SRIOV SmartNic Support Spec: http://lists.openstack.org/pipermail/openstack-discuss/2020-August/016339.html , https://review.opendev.org/#/c/742785/
  5. how to better review our patches? should we set high priority patches for each week?
  • July30,2020:

Victoria-milestone2 retrospective

  1. merge specs for Intel QAT driver and Inspur FPGA driver: https://review.opendev.org/#/c/728014/ and https://review.opendev.org/#/c/730760/
  2. review policy refresh and API Programming support: https://review.opendev.org/#/c/740542/ and https://review.opendev.org/#/c/698190/
  3. nova operations support?
  4. (nova-neutron-cyborg integration) SmartNic Support spec: https://review.opendev.org/#/c/742785/
  5. microversion api support for cyborg program api and project_id in api ? https://review.opendev.org/#/c/743722/ http://eavesdrop.openstack.org/irclogs/%23openstack-nova/%23openstack-nova.2020-07-28.log.html#t2020-07-28T09:29:21
  • July23,2020:
  1. policy refresh is ready for review: https://review.opendev.org/#/c/740542/
  2. Programming support ready for review: https://review.opendev.org/#/c/698190/
  3. Intel QAT driver ready for review:https://review.opendev.org/#/c/728014/
  4. Inspur FPGA driver ready for review: https://review.opendev.org/#/c/730760/
  • July16,2020:

features review:

  1. policy refresh:https://review.opendev.org/#/c/740542/ (Needs fix tempest failure)
  2. Programming support (v2 Deployable API): https://review.opendev.org/#/c/698190/ (Needs update)

specs review:

  1. Add Attribute API specification: https://review.opendev.org/#/c/738331/
  2. Inspur FPGA DRIVER: https://review.opendev.org/#/c/730760/
  3. Add Intel QAT driver specification: https://review.opendev.org/#/c/728014/ (Needs update)

other reviews are also needed

  • July 9,2020:
  1. CNTT community supports cyborg: http://lists.openstack.org/pipermail/openstack-discuss/2020-July/015774.html
  • July 2,2020:
  1. real third-party CI for new drivers or other possible ways?
  2. Agree we support async program or not?
  • Jun 25,2020: Meeting cancelled due to the Dragon Boat Festival.
  • Jun 18,2020:
  1. nova-cyborg-interaction(server operations): https://review.opendev.org/#/q/project:openstack/nova+status:open+message:cyborg+message:instance
  2. smartnic integration update: http://lists.openstack.org/pipermail/openstack-discuss/2020-June/015400.html
  3. Release schedule and storyboard update http://lists.openstack.org/pipermail/openstack-discuss/2020-June/015486.html
  4. Added a new community goal:http://lists.openstack.org/pipermail/openstack-discuss/2020-June/015459.html
  5. Please review and merge 'remove OPAE dependency' patches and ussuri legacy patches before milestone1 on Jun 19! (patch topics like: unittest.mock, drop_future_imports, drop_mock,reset_conf, tox etc.)https://review.opendev.org/#/q/status:open+project:openstack/cyborg+branch:master+topic:unittest.mock https://review.opendev.org/#/q/status:open+project:openstack/cyborg++topic:devstack-remove-opae
  6. Wiki page review and give feedback:https://wiki.openstack.org/wiki/Cyborg
  • Jun 11,2020:
  1. Smart NIC ideas
  2. Left topics from PTG: http://lists.openstack.org/pipermail/openstack-discuss/2020-June/015322.html
  3. New Cyborg Storyboard usage guide:https://wiki.openstack.org/wiki/Cyborg/CyborgStoryboard
  4. New Storyboard board page for victoria release: https://storyboard.openstack.org/#!/board/216
  5. We should match each story with the patch so that the storyboard can automatically track the status of a patch. For merged patch, manually add a patch link to its story page and update its status to 'merged'. For ongoing and new patches, add 'story:story-id' and 'task:task-id' to your commit message, so storyboard can automatically track
  6. Set Milestones for Victoria features: set a deadline by adding milestone tags
  7. New Wiki page In progress: https://wiki.openstack.org/wiki/Cyborg
  • May 21, 2020:
  1. Victorial PTG schedule and preparations: http://lists.openstack.org/pipermail/openstack-discuss/2020-May/014958.html
  2. Victoria PTG Topics Preview: https://etherpad.opendev.org/p/cyborg-victoria-goals
  3. Cross-project discussion: shaohe will give an introduction about the nova-neutron-cyborg topic, shall we make a zoom meeting(one hour?) and record this introduction? if yes, which time is good for you? Tomorrow(Friday 2020/05/22)or another time better before next Tuesday(so that we can discuss with neutron and nova)?
  4. Patches review(feel free to add here), I would recommend that we focus on specs patches or some important patches for PTG discussion.
  • May 07, 2020:

Victoria PTG planning:

  1. Fill out the doodle poll: https://doodle.com/poll/wdw5cyeucayzhu9k
  2. Add PTG goals: https://etherpad.opendev.org/p/cyborg-victoria-goals
  3. PTG Sign up at https://www.eventbrite.com/e/virtual-project-teams-gathering-june-2020-tickets-103456996662
  4. Cross-project discussion: nova-neutron-cyborg?
  • March 26, 2020:
  1. Victoria release planning: Sign up at https://etherpad.openstack.org/p/Virtual_PTG_Planning

  • March 19, 2020:
  1. Doc improvements
  • Feb 12, 2020:
  1. UT patch: https://review.opendev.org/#/c/702807
  2. Installers: Kolla is important. RDO is best effort. LOCI? Others?
  3. Move spec for instance ops with accelerators as a doc.
  • Jan 9, 2020:
  1. Patch reviews: Policy default, Bump openstackdocs theme
  2. Mailing list: http://lists.openstack.org/pipermail/openstack-discuss/2020-January/011802.html
  • Dec 25, 2019:
  1. Cyborg Policy Refresh (Yumeng)
    1. Please help to review and merge specs: https://review.opendev.org/#/c/699099/. We've got a +1 from keystone PTL
  • Dec 18, 2019:
  1. Policy popup team (cmurphy)
    1. How does the cyborg team want to organize and track the work?
    2. Any questions I can help with at this time?
  • Dec 11, 2019:
  1. Secure_Default_Policies_Popup_Team
  2. Devstack conf table for multinode
  3. Functional testing
  4. Programming API proposal review, Shogo's programming patch
  5. Storyboard, Cyborg client patches, tempest patches, main patches
  • Dec 4, 2019:
  1. Functional testing
  2. Patches
  • Nov 27, 2019:
  1. Decide whether to drop v1 API.
  2. Programming API proposal review: https://etherpad.openstack.org/p/cyborg-ussuri-programming-apis
  3. Functional tests update
  4. Storyboard review and update
  • Nov 20, 2019:
  1. Nova status update: reviews needed
  2. General update: Devstack py3 (https://review.opendev.org/#/c/649097) merged
  3. Programming APi proposal: https://etherpad.openstack.org/p/cyborg-ussuri-programming-apis
  4. Review Who's Doing What, storyboard, patches
  • Oct 31, 2019:
  1. Summit/PTG prep: move to official etherpad?, project onboarding in PTG, update in summit, demo
  2. tempest parallel tests: device profile names uniqueness, fake driver has only 1 resource, self.instance?
  3. Remove Justin Kilpatrick as core reviewer?
  4. Reviews: https://review.opendev.org/#/c/685542/
  • Oct 30, 2019:
  1. Py2 -> Py3 migration: Do we care? If so, we need a grenade job.
  2. Followup: Document use cases and usage models (e.g. reserve devices for non-VM usage, enable/disable devices)
  • Oct 23, 2019:
  1. Project updates: clarification
  2. Reviews: Doc patches merged and new, Glance API servers
  3. PTG:
    1. will consolidate planning etherpad into final etherpad
    2. tables in a room
    3. Team photo shoot on Thu afternoon 2 pm
  • Oct 16, 2019:
  1. PTG Etherpad: add topics
  2. Team dinner date/time
  3. Project updates: Not at Summit, but in etherpad. Slides/etherpad due after the Summit.
  • Aug 28
  1. Python 3, RBAC, client
  2. Code reviews
  3. ARQ states and transitions
  4. Nova functional tests
  5. Rm cyborg devstack job once the tempest job is introduced?
  • Aug 21 (Thu in China, Wed in US):
  1. Python 3
  2. Close patch series by this week: other stuff depends on it.
  • Aug 13:
  1. Meeting time; os-acc discontinuance
  2. Python-cyborgclient support, Python 3
  3. Do we need fake driver-based tempest for Cyborg patches?
  4. Storyboard tasks: RBAC, Cyborg functional tests, Nova functional tests that mock Cyborg API
  • Aug 6, 2019:
  1. Bindep: packages for in-tree drivers?
  2. Drivers: Specs (use cases, CI, etc.), test plans
  3. Checking fake driver with Nova
  4. Storyboard tasks
  • July 23, 2019: Spec/patch reviews.
  • July 9, 2019:
  1. Fix https://opendev.org/openstack/cyborg-specs/src/branch/master/specs/train/cyborg-accelerator-driver.rst : location, content
  2. Spec review
  • July 2, 2019: Spec review
  • June 25, 2019: Spec review.
  • June 18, 2019
  1. Device profile: unique names.
  2. Format for controlpath_id and attach_handles.
  3. Need to close specs. See Train milestones. Past Milestone 1.
  4. Zoom meeting tomorrow: use the time to review specs.
  • June 11, 2019
  1. Cyborg-Nova CI: Fake driver (tempest), Fake Cyborg API (Nova functional test fixture)
  2. Python cyborg client, Python 3 migration: any opens or questions?
  3. Cyborg specs and patches
  • June 4/5, 2019:
  1. Python cyborg client decision: http://lists.openstack.org/pipermail/openstack-discuss/2019-May/006543.html
  2. Cyborg APi fixtures in Nova: need an owner. See Line 409
  3. Cyborg specs: discovery spec, specs/index.rst, device-profiles, Instance-ops
  4. Cyborg patches: Why not asserts, control path id; walk through all patches
  5. Zoom call tomorrow for scrubbing patches/specs?
  • May 28/29, 2019:
  1. Nova spec update (https://review.opendev.org/#/c/603955/)
  2. Python cyborg client update
  3. Communication updates: have default IRC 'hangout times'?
  4. Cyborg spec, code reviews
  • May 21/22, 2019:
  1. Cyborg spec reviews
  2. Nova spec review
  3. Merge plan and Nova notification patch status
  4. Python 3 transition
  5. Any topics for Zoom meeting tomorrow?
  • May 14/15, 2019:
  1. Cyborg Spec reviews
  2. Nova spec review
  3. Pilot merge plan: split into smaller patches for review?, db schema change (reference)
  4. Python 3 transition (time permitting. Trying to start early in cycle because there could be surprises.)

Flexible Cyborg Engineers' Zoom Meeting

  • Where: Zoom https://zoom.us/j/7680202060 [New Zoom URL for Victoria]
  • When: Usually Friday at UTC 0230 (China @10:30 am FRI; US West Coast @7:30 pm THUR)

This is engineering-focused and includes presentations to discuss blueprints and its solutions etc. This meeting usually intends to discuss the topics listed below:

  1. discuss cross-project topics internally before the PTG at the beginning of a cycle
  2. discuss long-term goals during a cycle
  3. cyborg discussion where a video record is necessary


  • May 21/22,2020: Internal discussion for PTG Nova-Neutron-Cyborg cross-project topic
  1. Smartnic support via cyborg and neutron? shaohe from Intel will introduce and share solutions https://etherpad.opendev.org/p/cyborg-victoria-goals
  2. Shelve/unshelve and bind/unbind operations support in Nova?

  • June 26/27, 2019: Cancelled after agreement in IRC.
  • June 19/20: We will have a session. We will use the session to review specs.
  • June 12/13, 2019: No session. Please review specs.
  • June 5/6, 2019:
  1. Cyborg API fixture or fake Cyborg driver?
  2. Cyborg specs and patches
  • May 22/23, 2019: Cancelled
  • May 15/16, 2019: Not scheduled (will start from May 21/22 with new Zoom account)