Jump to: navigation, search

Difference between revisions of "Watcher Meeting Agenda"

(07/03/2019)
 
(30 intermediate revisions by 2 users not shown)
Line 2: Line 2:
  
 
Please feel free to add items to the Agenda under Open Discussion
 
Please feel free to add items to the Agenda under Open Discussion
 +
 +
===09/02/2020===
 +
* Announcements
 +
* Review Action Items
 +
** [https://review.opendev.org/#/c/743158/ Add Watcher image build] needs review
 +
** [https://review.opendev.org/#/c/720140/ Initial watcher helm chart] needs review
 +
* Discussion
 +
** Difficulty supporting Ceilometer datasource
 +
 +
===05/20/2020===
 +
* Announcements
 +
** schedule for victoria: https://releases.openstack.org/victoria/schedule.html
 +
* Review Action Items
 +
** [https://review.opendev.org/#/c/729503/ Victoria Project Priorities for Watcher] needs review
 +
** [https://review.opendev.org/#/c/726877/ Improve logs of Workload Stabilization strategy] needs review
 +
** [https://review.opendev.org/#/c/728397/ Monkey patch original current_thread _active] needs review
 +
** [https://review.opendev.org/#/c/728141/ Remove translation sections from setup.cfg] needs review
 +
* Discussion
 +
 +
===04/22/2020===
 +
* Announcements
 +
 +
* Review Action Items
 +
** [https://review.opendev.org/#/c/721028/ Use unittest.mock instead of third party mock] needs review
 +
** [https://review.opendev.org/#/c/718125/ Use unittest.mock instead of third party mock] needs review
 +
** [https://review.opendev.org/#/c/718122 Use unittest.mock instead of third party mock] needs review
 +
** [https://review.opendev.org/#/c/721007 Use unittest.mock instead of third party mock] needs review
 +
** [https://review.opendev.org/#/c/720140/ Initial watcher helm chart] needs review
 +
** [https://review.opendev.org/#/c/721612/ Remove six] needs review
 +
* Discussion
 +
** questions from Jatinder Singh(Orange Labs & Networks)
 +
*** 1.  is there vm scheduling optimize use-case tested with watcher ?
 +
*** 2.  is it feasible to develop a common strategy for Watcher with AI to achieve optimization at pre scheduling VM and post scheduling or any discussion on this ?
 +
*** 3.  could we optimize VNFs that installed on NOVA with cpu-pinning environment ?
 +
 +
===04/08/2020===
 +
* Announcements
 +
** Ussuri-3 milestone
 +
* Review Action Items
 +
** [https://review.opendev.org/#/c/717541/ Cleanup py27 support] needs review
 +
** [https://review.opendev.org/#/c/718075/ Cleanup py27 support] needs review
 +
** [https://review.opendev.org/#/c/717540/ Cleanup py27 support] needs review
 +
** [https://review.opendev.org/#/c/717962/ Block Sphinx 3.0.0] needs review
 +
* Discussion
 +
 +
===03/11/2020===
 +
* Announcements
 +
 +
* Review Action Items
 +
 +
* Discussion
 +
 +
===02/26/2020===
 +
* Announcements
 +
**  Watcher helm charts progress update
 +
* Review Action Items
 +
** [https://review.opendev.org/#/c/709914/ [watcher] Transition Rocky to EM] needs review
 +
** [https://review.opendev.org/#/c/707779/ Add config option enable_webhooks_auth] needs review
 +
** [https://review.opendev.org/#/c/691806/ rollback mechanism] needs review
 +
* Discussion
 +
** Watcher event based audit authentication
 +
** Time series analysis for strategies
 +
 +
===02/12/2020===
 +
*Announcements
 +
** Watcher helm charts progress update
 +
* Discussion
 +
** Watcher event based audit authentication
 +
** Time series analysis for strategies
 +
 +
===01/08/2020===
 +
* Review Action Items
 +
** Watcher Dashboard
 +
*** [https://review.opendev.org/#/c/700941/ Drop Django 1.11 support] needs review
 +
** Watcher specs
 +
*** [https://review.opendev.org/#/c/691806/ rollback mechanism] needs new patch
 +
*** [https://review.opendev.org/#/q/topic:bp/event-driven-optimization-based Support event based audit] needs review
 +
 +
===12/18/2019===
 +
* Review Action Items
 +
** Watcher
 +
*** [https://review.opendev.org/#/c/698764/ Remove use of deprecated config options for volume API selection] needs review
 +
*** [https://review.opendev.org/#/c/698993/ [ussuri][goal] Drop python 2.7 support] needs review
 +
*** [https://review.opendev.org/#/c/698841/ Add audit type: event] needs review
 +
*** [https://review.opendev.org/#/c/698842/ Support audit type event] needs review
 +
** Watcher specs
 +
*** [https://review.opendev.org/#/c/691806/ rollback mechanism] needs review
 +
*** [https://review.opendev.org/#/c/695646/ Support event based audit] needs review
 +
 +
===11/20/2019===
 +
* Review Action Items
 +
** Watcher
 +
*** [https://review.opendev.org/#/c/695097/ Migrate grenade jobs to py3] needs review
 +
*** [https://review.opendev.org/#/c/692020 [ussuri][goal] Drop python 2.7 support and testing] needs review
 +
*** [https://review.opendev.org/#/c/693516/ Documentation on concurrency for contributors] some comments need to be confirmed
 +
*** [https://review.opendev.org/#/c/688119/ General purpose threadpool for decision engine] needs review
 +
*** [https://review.opendev.org/#/c/690524/ Use threadpool when building compute data model] needs review
 +
** Watcher specs
 +
*** [https://review.opendev.org/#/c/691806/ rollback mechanism] needs review
 +
*** [https://review.opendev.org/#/c/692258/ Add Ussuri priorities] needs review
 +
 +
===10/09/2019===
 +
*Announcements
 +
** Train release
 +
*Review Action Items
 +
**[https://review.opendev.org/#/c/686110/ Fix issues on stable/rocky] needs review
 +
**[https://review.opendev.org/#/c/686888/ Use Horizon project template for django jobs] needs review
 +
* Discussion
 +
** Send Watcher thesis on mailing list
 +
** Helm chart for Watcher and accompanying docker.io image
 +
 +
===09/25/2019===
 +
*Announcements
 +
** RC1 target week
 +
*Review Action Items
 +
**release request for watcher
 +
***[https://review.opendev.org/#/c/684113/ Auto release request for watcher]
 +
***[https://review.opendev.org/#/c/684112/ Auto release request for watcher-dashboard]
 +
***[https://review.opendev.org/#/c/684023/ Auto release request for watcher-tempest-plugin]
 +
 +
=== 09/11/2019 ===
 +
* Announcements
 +
** Train-3 milestone
 +
* Review Action Items
 +
** Watcher specs
 +
*** [https://review.opendev.org/#/c/675871/ node resource consolidation spec] needs review
 +
*** [https://review.opendev.org/#/c/679827/ General purpose threadpool for the decision engine] needs review
 +
*** [https://review.opendev.org/#/c/677437/ Update show-datamodel-api spec] needs review
 +
** Watcher
 +
*** [https://review.opendev.org/#/c/679402/ node resource consolidation] needs review
 +
*** [https://review.opendev.org/#/c/677407/ Add releasenote about bp show-datamodel-api] needs review
 +
*** [https://review.opendev.org/#/c/563477/ Watcher Planner Selector] needs review
 +
** Watcher tempest
 +
*** [https://review.opendev.org/#/c/680288/ https://review.opendev.org/#/c/680288/] needs review
 +
 +
=== 08/28/2019 ===
 +
* Review Action Items
 +
** Watcher
 +
*** [https://review.opendev.org/#/c/678189/ add audit parameter to do_execute] needs review
 +
*** [https://review.opendev.org/#/c/677407/ Add releasenote about bp show-datamodel-api] needs review
 +
*** [https://review.opendev.org/#/c/677658/ Add api-ref doc for data model api] needs review
 +
*** [https://review.opendev.org/#/c/676884/ Implement watcher datamodel list in watcher-decision-engine] needs review
 +
*** [https://review.opendev.org/#/c/677189/ Implement watcher datamodel list in watcher-api] needs review
 +
** Watcher specs
 +
*** [https://review.opendev.org/#/c/675871/ node resource consolidation spec] needs review
 +
*** [https://review.opendev.org/#/c/677437/ Update show-datamodel-api spec] needs review
 +
** Watcher dashboard
 +
*** [https://review.opendev.org/#/c/593282/ Add test 'node_modules' in gitignore] needs review
 +
** WatcherClient
 +
*** [https://review.opendev.org/#/c/676883/ Implement watcher datamodel list in watcherclient] needs review
 +
*** [https://review.opendev.org/#/c/677672/ Add datamodel doc in watcherclient] needs review
 +
 +
=== 08/14/2019 ===
 +
* Announcements
 +
** Shanghai Project Update
 +
* Review Action Items
 +
** Watcher
 +
*** [https://review.opendev.org/#/c/676103/ Don't revert Migrate action] needs review
 +
*** [https://review.opendev.org/#/c/676110/ Add Python 3 Train unit tests] needs review
 +
*** [https://review.opendev.org/#/c/675871/ node resource consolidation spec] needs review
 +
** Watcher tempest plugin
 +
*** [https://review.opendev.org/670936 rollback node status] needs review
 +
* Discussion
 +
** Parallelism implementations threadpool vs taskflow
 +
 +
=== 07/17/2019 ===
 +
* Announcements
 +
** Proof of concept threadpool achieves 90% performance improvement with 16 threads [https://review.opendev.org/#/c/671094/ DNM: Abuse the ThreadPool to build the datamodel]
 +
* Review Action Items
 +
** Watcher
 +
*** [https://review.opendev.org/#/c/668598/ Improve Compute Data Model] needs  review
 +
*** [https://review.opendev.org/#/c/670366/ Baseclass for ModelBuilder with audit scope] needs review
 +
*** [https://review.opendev.org/#/c/670386/ Add call_retry for ModelBuilder for error recovery] needs review
 +
*** [https://review.opendev.org/#/c/670453/ Move datasources folder into decision_engine] needs review
 +
*** [https://review.opendev.org/#/c/671014/ Remove useless _opts.py] needs review
 +
*** [https://review.opendev.org/#/c/669611/ Replace human_id with name in grafana doc] needs review
 +
*** [https://review.opendev.org/#/c/669087/ remove id field from CDM] needs review
 +
*** [https://review.opendev.org/#/c/669786/ Add reource_name for save_energy in action input parameter field] needs review
 +
*** [https://review.opendev.org/#/c/669528/ Add Python 3 Train unit tests] needs review
 +
** Watcher tempest plugin
 +
*** [https://review.opendev.org/#/c/670936/ rollback node status] needs review
 +
** Watcher dashboard
 +
*** [https://review.opendev.org/#/c/669529/ Add Python 3 Train unit tests] needs review
 +
* Discussion
 +
** Global threadpool proposal for decision-engine
  
 
=== 07/03/2019 ===
 
=== 07/03/2019 ===

Latest revision as of 09:30, 26 August 2020

Weekly Meetings

Please feel free to add items to the Agenda under Open Discussion

Contents

09/02/2020

05/20/2020

04/22/2020

  • Announcements

04/08/2020

03/11/2020

  • Announcements
  • Review Action Items
  • Discussion

02/26/2020

02/12/2020

  • Announcements
    • Watcher helm charts progress update
  • Discussion
    • Watcher event based audit authentication
    • Time series analysis for strategies

01/08/2020

12/18/2019

11/20/2019

10/09/2019

09/25/2019

09/11/2019

08/28/2019

08/14/2019

07/17/2019

07/03/2019

06/19/2019

06/05/2019

05/22/2019

05/08/2019

04/24/2019

04/10/2019

12/19/2018

  • Discussion Topics
    • My responsibilities may be changed in the coming couple of months and I won't re-elect for Train release. I'm not leaving the project and will stay as core reviewer and contributor.
    • To store datetime in UTC is a good practice. Relating user experience, should operator set audit start/end time in UTC or local time?
    • Should we remove inactive core reviewers?

12/07/2018

  • Announcements
  • Discussion Topics
    • I'm working on Grenade tests that would allow to get us upgrade tag.
    • Ceilometer Datasource is proposed to be deprecated.
    • Allow Watcher to execute more than one action plan at the same time.
    • Some of Nova Scheduler filters are pretty difficult to implement.


09/26/2018

08/15/2018

07/18/2018

06/20/2018

06/06/2018

05/23/2018

05/09/2018

04/25/2018

04/18/2018

04/11/2018

04/04/2018

03/28/2018

03/21/2018

03/14/2018

02/21/2018

02/14/2018

02/07/2018

  • Announcements
    • Project Update has been requested.
    • This is rc1 week, bugs should be reviewed ASAP.
    • We are still working on adding PTG topics here. Please, add something you'd like to discuss.
    • New weekly meeting time has been proposed: 8:00 UTC. Should we set it on either even or odd week?
    • Bug list on Launchpad should be reviewed during PTG.
  • Review Action Items

01/31/2018

01/24/2018

01/17/2018

01/10/2018

12/20/2017

12/13/2017

12/06/2017

11/29/2017

11/22/2017

11/15/2017

11/01/2017

10/25/2017

10/18/2017

  • Roll Call
  • Announcements
    • Queens-1 milestone 19 oct
    • We have completed 1 out 7 blueprints, 2 has good progress.

10/11/2017

10/04/2017

09/27/2017

09/20/2017

  • Roll Call
  • Blueprint Review
    • compute-cdm-include-all-instances
    • display-parameter-of-each-strategy-in-strategy-list
    • exclude-locked-instances
    • feedback-metrics-to-ceilometer
    • implementing-watcher-dashboard-in-angularjs
    • replace-voplutuous-with-jsonschema
    • replace-cold-migrate-to-use-nova-migration-api
    • update-bare-metal-data-model-by-ironic-notifications

09/13/2017

  • Roll Call
  • Blueprint Review
    • query-list-of-auditable-resource-types-for-a-goal
    • soft-delete-goals
    • trigger-action-plan-via-notification
    • trigger-audit-via-notification
    • add-name-for-audit
    • cluster-maintaining
    • watcher-multi-datasource
    • action-plans-consolidation
    • multiple-global-efficacy-indicator

09/06/2017

  • Roll Call
  • Blueprint Review
    • watcher-strategy-selector
    • workload-characterization-qos
    • storage-workload-balance
    • check-strategy-requirements
    • max-aggressiveness-level
    • audit-scope-exclude-project
    • audit-scoper-for-storage-data-model
    • policy-and-docs-in-code
    • zone-migration-strategy

08/30/2017

  • Roll Call
  • Announcements
    • Watcher has reached final Pike release with 1.4.1 version.
    • We should set priorities to Watcher blueprints especially for new ones.
  • Blueprint Review
    • workload-characterization-grammar
    • build-baremetal-data-model-in-watcher
    • event-driven-optimization-based
    • neutron-model-integration
    • notifications-actionplan-cancel
    • extend-node-status
    • add-name-for-audit-in-watcher-dashboard
    • api-validation
    • audit-scope-exclude-project
    • audit-scoper-for-storage-data-model
    • storage-workload-balance

08/23/2017

08/16/2017

08/09/2017

08/02/2017

07/26/2017

07/19/2017

07/12/2017

07/05/2017

06/28/2017

06/21/2017

06/14/2017

06/07/2017

05/31/2017

05/24/2017

05/17/2017

05/03/2017

04/26/2017

04/19/2017

04/12/2017

04/05/2017

03/29/2017

03/22/2017

03/15/2017

03/08/2017

03/01/2017

02/15/2017

02/08/2017

02/01/2017

01/25/2017

01/18/2017

01/11/2017

01/04/2017

12/21/2016

12/14/2016

12/07/2016

11/30/2016

11/23/2016

11/16/2016

11/09/2016

10/19/2016

10/12/2016

10/04/2016

09/28/2016

09/21/2016

09/14/2016

09/07/2016

08/31/2016

08/24/2016

08/17/2016

08/10/2016

08/03/2016

  • Open Discussion

07/27/2016

  • Open Discussion

07/13/2016

07/05/2016

06/29/2016

06/22/2016

  • Blueprint/Bug Review and Discussion
  • Open Discussion
    • Global Requirement: is watcher-dashboard project automatically sync with OS Global Requirements ?

06/15/2016

06/08/2016

06/01/2016

05/25/2016

05/18/2016

05/11/2016

05/04/2016

04/20/2016

04/13/2016

04/06/2016

  • Roll Call
  • Open Discussion
    • We need to retarget blueprints from Mitaka to Newton (watcher-specs)
    • regarding the Openstack Summit in AUSTIN, we should run a battery of tests on watcher to be sure that everything is working (Watcher and the available strategies).

03/30/2016

03/23/2016

03/16/2016

03/09/2016

03/02/2016

02/24/2016

02/17/2016

02/10/2016

01/27/2016

01/20/2016

01/13/2016

01/06/2016

  • Roll Call
  • Announcements
    • Mid-cycle details available on [94]
    • Invitation email sent to the community [95]
    • INTEL POC related to outlet temperature optimization has been demonstrated
    • Watcher UI video is now available [96]
  • Review Action Items
    • Watcher
      • most of the reviews have been merged or adandonned before end of year thanks to jed56 & vincentfrancoise [97]
      • outlet temperature based migration strategy has been merged [98] but need improvements (see comments)
      • we need an updated status on reviews [99], [100], [101]
      • devstack plugin is still in review [102]
    • Watcher specs
      • could we merge this review [103] as it is related to POC already merged ?
      • we need reviews on [104] to start implementation asap
      • specs from cdupont & michele must be reviewed asap [105] & [106]
  • Blueprint/Bug Review and Discussion
    • implementing custom actions require changes in the data model, should we provide a migration of the data model ?
    • we would like to start integrating taskflow in Watcher applier, do we need a spec for [107] ?
    • can we update the state of [108] ?
    • Is [109] related to improvement of INTEL POC ?
    • we need someone to handle multiple versions of OpenStack components API [110] targeted for mitaka-2
    • we need an updated status on BPs [111] & [112]
  • Open Discussion
    • Proposed talks for OpenStack Summit in Austin [113] (deadline February 1st)
    • Agenda for the mid-cycle must be completed [114]

12/16/2015

  • Roll Call
  • Announcements
    • Mid-cycle details available on [115]
    • mitaka-1 milestone has been released
    • Watcher UI video available on [116]
  • Review Action Items
    • Watcher
      • Watcher plugin for devstack [117]
      • i18n translation [118]
      • Rename command audit [119]
      • Intel Thermal PoC [120]
    • Watcher specs
      • a review is on progress on dynamic definition of action [121]
      • A review is always in progress on thermal optimization specs [122]
  • Blueprint/Bug Review and Discussion
  • Open Discussion

12/9/2015

  • Roll Call
  • Announcements
    • Mid-cycle details available on Eventbrite [125], you can already register
    • more info on accommodations and agenda coming later
    • Watcher code has been tagged 0.21.0 (mitaka-1) and python-watcherclient as 0.20.0 (mitaka-1)
    • Doc is up-to-date on [126]
  • Review Action Items
    • Watcher
      • Glossary has been merged for mitaka-1 [127]
      • A lot of current reviews are related to code refactoring [128]
      • tpeoples has submitted devstack integration code [129]
      • A big thank you to Darren Shaw & Gábor Antal for there patches & bug fixes
    • Watcher specs
      • A review is in progress on thermal optimization specs [130]
      • A move to implemented state for telemetry integration [131]
  • Blueprint/Bug Review and Discussion
    • tpeoples should split [132]
    • Specs are in progress for [133] & [134]
    • bcom submitted BPs on an efficacy indicator [135] and Watcher UI [136]
    • ZHAW submitted a BP for a rudimentary cloud consolidation algorithm [137]
    • Any update from Michele on [138] or Alex on [139] ?
  • Open Discussion
    • regarding functional tests, there is an approved BP available here [140]
    • there is also an available blueprint on translation [141]

12/2/2015

  • Roll Call
  • Announcements
    • mid-cycle meetup details
    • versionning added to launchpad (mitaka-1 : today, mitaka-2 : 01/21/16, mitaka-3 : 03/03/16)
    • as we are using commonly etherpad, I started a new one to reference all of them [142]
  • Review Action Items
    • Documentation :
      • a Glossary has been added to the Watcher documentation and MUST now be reviewed [143] before code refactoring
      • an architecture page has been updated with the current architecture diagram [144]
      • do we need to put this diagram in watcher-specs to work on Watcher v2 architecture ? (or we wait for the mid-cycle ?)
  • Blueprint/Bug Review and Discussion
  • Open Discussion
    • how to deal with integration tests in the future ?
    • DevStack plugin is mostly done but having some keystone conf issues to work through. Should have up for review by end of week (tpeoples)

11/25/2015

  • Roll Call
  • Announcements
    • mid-cycle meetup details
    • wiki page related to Watcher architecture v2 is live [150]
    • WIP rule on reviews (using -1 on workflow if it is a work in progress)
  • Review Action Items
    • Ceilometer integration : specs [151] / code [152] -> merged
    • Loading optimization Strategies dynamically with Stevedore [153] -> merged
    • Documentation :
      • a Glossary has been added to the Watcher documentation and MUST now be reviewed [154] before code refactoring
      • we will use Dia [155], the same tool as the Nova team, to update our current architecture diagrams
  • Blueprint/Bug Review and Discussion
    • we should define series for Watcher on Launchpad (for blueprints deadline), should we use the current OpenStack versionning (Mitaka-N every 2 months) ?
    • Intel should split this BP [156] before writing associated specs
    • this BP [157] should probably be split for each Watcher component
    • bcom has some refactoring to do [158] after merging the glossary so please review it asap [159]
    • bcom will submit a BP to have a performance indicator associated with the action plan (like 10% reduction of energy consumption)
    • could create-net submit a BP regarding the "consolidation rule" modeling ?
    • we should set priority for BP [160]
  • Open Discussion

11/18/2015

  • Roll Call
  • Announcements
    • regular meeting started targeting a POC for thermal optimization using Watcher
    • ad-hoc meeting with ICCLab and Create-Net on thursday
  • Review Action Items
    • Developments for Ceilometer integration [161]
    • Development for loading optimization Strategies dynamically with Stevedore [162]
    • Specification for blueprint telemetry-integration has been written in watcher-specs and can be reviewed [163]
    • Documentation :
      • a Glossary has been added to the Watcher documentation and is currently being reviewed [164]
      • writing some UML diagrams with an Ascii description : testing of the tool used in Nova, named Jia.
    • Intel is working on the spec for the energy minimization PoC and it should be up for review soon.
  • Blueprint/Bug Review and Discussion
  • Open Discussion

11/11/2015

11/4/2015

10/21/2015

10/14/2015

10/07/2015


09/30/2015

Announcements

  • Tokyo summit actions
    • [jwcroppe, sballe, acabot] Prepare slides for Watcher talk (still in 'standby' mode)
    • [sballe] Figure out a place where we can do an ad-hoc talk
    • Talk to Nova, Ceilometer, etc. PTLs to inform them of the project
    • [acabot, jwcroppe, sballe] Consider a Nova unconference session to introduce Watcher
    • [sballe] Setup a meeting with Monty Taylor to introduce him to Watcher
    • [sballe, acabot, jwcroppe] Evangelize Watcher with other folks (e.g., jaypipes, bauzas, Perry Myers from Red Hat, folks from Rackspace, Julien Danjou from Red Hat)

Brief progress reports

Open Discussion