Watcher Meeting Agenda
Weekly Meetings
Contents
- 1 03/30/2016
- 2 03/23/2016
- 3 03/16/2016
- 4 03/09/2016
- 5 03/02/2016
- 6 02/24/2016
- 7 02/17/2016
- 8 02/10/2016
- 9 01/27/2016
- 10 01/20/2016
- 11 01/13/2016
- 12 01/06/2016
- 13 12/16/2015
- 14 12/9/2015
- 15 12/2/2015
- 16 11/25/2015
- 17 11/18/2015
- 18 11/11/2015
- 19 11/4/2015
- 20 10/21/2015
- 21 10/14/2015
- 22 10/07/2015
- 23 09/30/2015
03/30/2016
- Roll Call
- Announcements
- Contributing wiki page updated with BP & bugs policies defined in previous meetings
- Final slides set for the OpenStack summit
- Review Action Items
- Watcher specs
- Achieved goal should be returned by each strategy has been merged
- Add Overload standard deviation strategy spec & Add specification for Watcher Scoring Module need additional reviews
- Provide efficacy indicators can be merged as the license issue is not blocking
- WIP: Cluster model objects wrapper needs additions (work items)
- Watcher
- Integrated consolidation strategy with watcher has been merged
- A lot of code has been released by vincentfrancoise on The achieved goal should be returned by each strategy
- Enable strategy parameters needs reviews
- Workload balance migration strategy implementation needs a new PS and reviews
- Watcher client
- Enable strategy parameter needs reviews
- Updated CLI for new goals/strategies API needs reviews
- Watcher dashboard
- Watcher-dashboard will be impacted by The achieved goal should be returned by each strategy implementation in Watcher, we need a contributor to work on it
- Watcher specs
- Blueprint/Bug Review and Discussion
- RC-Final target 5 BPs & 9 bugs and is due on April 1st
- Open Discussion
- We need many code reviewers for the next 3 days to have a complete rc-final version
- Should we split in different repos the framework code and the available strategies ?
03/23/2016
- Roll Call
- Announcements
- watcher RC-1 (v0.25) & python-watcherclient RC-1 (v0.21.1) have been released on March 22nd
- First draft of slides for Austin talk are open for comments
- PTL election - acabot is the only candidate so he will be the PTL for Newton
- first patch to fix our tempest gate received a +2
- Accept multiple hosts when calling live migration received a -1
- jwcroppe and tpeoples were presenting Watcher to IBM teams last week
- Review Action Items
- Watcher specs
- Achieved goal should be returned by each strategy must be reviewed and implemented asap as we discovered dependencies with Allow specification of threshold defining when optimization is needed & Provide a scoring module for Watcher
- Add Overload standard deviation strategy spec needs a new PS
- WIP: Cluster model objects wrapper needs reviews
- Add specification for Watcher Scoring Module needs reviews
- Provide efficacy indicators lock on licences discussion
- Watcher
- 7 bugs fixed until last meeting / all unfixed rc-1 bugs are re-targeted for rc-final
- Watcher client
- Rename TRIGGERED state as PENDING was not applied on python-watcherclient
- Watcher dashboard
- Watcher specs
- Blueprint/Bug Review and Discussion
- 9 BPs & 18 open bugs targeted for RC-final (April 1st) - we need to postpone BPs (and probably bugs) to Newton
- Open Discussion
- What is the good practice to re-assign a bug to someone ?
03/16/2016
- Roll Call
- Announcements
- PTL election is now open to candidacy on the ML
- First draft of slides for Austin talk are open for comments
- Review Action Items
- Watcher specs
- a lot of specs are open and need reviews
- Add Overload standard deviation strategy spec is waiting for review
- workload balance migration strategy spec has been merged
- Watcher
- purge DB command has been implemented
- Integrated consolidation strategy with watcher has been submitted for reviews
- Workload balance migration strategy implementation has been submitted for reviews
- Watcher client
- Watcher dashboard
- Watcher specs
- Blueprint/Bug Review and Discussion
- Open Discussion
- we need to fix our tempest gate
- should we continue to use the term "hypervisor" when we talk about Nova metrics ?
03/09/2016
- Roll Call
- Announcements
- Mitaka-3 version of Watcher has been released on pypi & launchpad (v0.24)
- Our talk about Watcher has been accepted for the OpenStack summit and will take place on Thursday 2.20pm
- Our proposition of hands-on lab has been rejected
- PTL elections will start on friday
- WSME is not being actively maintained and used in Watcher
- Watcher stated as a ported to Python 3 project on RDO blog
- RC-1 & RC-final milestones created on launchpad
- Review Action Items
- Watcher specs
- workload balance migration strategy spec needs a +1 on workload to be merged
- Add Overload standard deviation strategy spec needs reviews
- Provide efficacy indicators needs reviews
- WIP: Cluster model objects wrapper needs reviews
- Add specification for Watcher Scoring Module needs reviews
- Provide a way to filter available hosts that can be targeted for a migration needs a spec
- Watcher
- Watcher client
- Watcher dashboard
- Watcher specs
- Blueprint/Bug Review and Discussion
- Open Discussion
03/02/2016
- Roll Call
- Announcements
- Mitaka-3 is expected tomorrow !
- Do we define RC milestones or we set the next target to Newton-1 ? Mitaka official schedule
- Review Action Items
- Watcher specs
- Added specification for ZHAW load consolidation has been merged
- optimization threshold spec has been merged
- Define the scope of an Audit as pool of resources has been merged
- workload balance migration strategy spec needs review since last PS
- Provide efficacy indicators needs a new PS
- Add Overload standard deviation strategy spec has been submitted, can we start reviewing ?
- Cluster model objects wrapper is a WIP but tpeoples wants feedback
- we need specs for Provide a scoring module for Watcher & Provide a way to filter available hosts that can be targeted for a migration
- Watcher
- reviews needed on Purge soft-deleted Watcher objects
- a couple of bugs fixed and merged since our last meeting
- implementation of optimization threshold & ZHAW load consolidation should now start
- Watcher client
- Watcher dashboard
- Watcher specs
- Blueprint/Bug Review and Discussion
- we need a BP to be able to register new actions without having to change code in the default planner
- Open Discussion
02/24/2016
- Roll Call
- Announcements
- Review Action Items
- Watcher specs
- Provide efficacy indicators has been merged very fast but needs additions https://review.openstack.org/#/c/283449/
- Can we merge Added specification for ZHAW load consolidation & workload balance migration strategy spec ?
- optimization threshold spec needs additional reviews
- Specs needed for :
- Watcher
- Improve DevStack documentation for beginners experienced by tomasz
- 17 bug fixes are in review https://review.openstack.org/#/q/project:openstack/watcher+status:open
- Watcher client
- Watcher dashboard
- initial commit merged
- launchpad set-up needed https://launchpad.net/watcher-dashboard
- Watcher specs
- Blueprint/Bug Review and Discussion
- Mitaka-3 high priority BPs https://launchpad.net/watcher/+milestone/mitaka-3
- we need to start implementing Workload balance migration strategy for summit hands-on lab
- we need a spec for Provide a scoring module for Watcher
- Open Discussion
02/17/2016
- Roll Call
- Announcements
- Review Action Items
- Watcher specs
- Purge soft-deleted Watcher objects merged
- Reviews needed on :
- Specs needed for :
- Watcher
- Delete related actions when deleting an action plan implemented
- imports clean-up (https://review.openstack.org/#/c/277369/)
- bug fixes in review
- Watcher client
- Watcher dashboard
- initial commit still in review
- Watcher specs
- Blueprint/Bug Review and Discussion
- SSL support
- bugs identified in devstack (https://bugs.launchpad.net/devstack/+bug/1544932 & https://bugs.launchpad.net/devstack/+bug/1544903)
- one bug open on Watcher (https://bugs.launchpad.net/watcher/+bug/1545012)
- SSL support
- Open Discussion
- share a review of actions from our mid-cycle on the ML
02/10/2016
- Roll Call
- Announcements
- Watcher mid-cycle etherpad
- use cases refresh
- review priorities for Mitaka
- big tent checklist
- next summit actions
- specs for Accept multiple hosts when calling live migration have been submitted for Newton by edleafe
- talks are open to votes
- Watcher mid-cycle etherpad
- Review Action Items
- Watcher specs
- Airflow balance migration strategy spec needs reviews
- Added specification for ZHAW load consolidation needs a new PS after jwcroppe comments
- Define the scope of an Audit as pool of resources needs reviews
- Provide a scoring module for Watcher needs a description update and a drafted spec
- Provides a wrapper to deal with cluster model objects needs a drafted spec
- Provide a way to filter available hosts that can be targeted for a migration needs a drafted spec
- Watcher Overload (cpu, ram) algorithm needs reviews
- Watcher
- Watcher client
- Watcher dashboard
- New repository available https://github.com/openstack/watcher-dashboard
- Watcher Dashboard - Initial commit needs reviews but code base is very large
- Watcher specs
- Blueprint/Bug Review and Discussion
- we need a BP for ability to merge multiple action plans into a single one (tmetsch)
- we need a Nova BP to add a Nova API call to return all acceptable migration target hosts for a given instance, paginating if necessary (edleafe)
- 24 bugs open for mitaka-3 https://launchpad.net/watcher/+milestone/mitaka-3
- Open Discussion
- Watcher SSL support
- next mid-cycle in Boston area on week 30
- meeting with Congress
01/27/2016
- Roll Call
- Announcements
- Mitaka-2 Watcher released on 25th of January (9 BPs & 37 bugs targeted)
- Mitaka-3 is our new target for 3rd of March
- gzhai from Intel is now core contributor
- Review Action Items
- Watcher specs
- specification for ZHAW load consolidation is now open for reviews
- Provide an efficacy indicator is open for reviews
- Specs for Define the scope of an Audit as a pool of resources will be on review in the coming days
- We need specs for Watcher Overload (cpu, ram) algorithm
- Watcher
- Add Voluptuous to validate the action parameters needs review
- Addition of tempest scenarios
- Watcher client
- Mitaka-2 version released
- Global openstack/requirements changes need to be merged before proposing Watcher to projects list
- Reviews / testing? needed for OpenStack convenience class for consuming different API versions
- Email sent to ML regarding DevStack plugin (http://markmail.org/message/e6gf45mpqgdvgnvk)
- Watcher specs
- Blueprint/Bug Review and Discussion
- Many new BPs added that needs specs (please assign yourself if you start working on one of them) :
- Support Description For Dynamic Action
- Audit parameters should be persistent in Db
- Define policies for accessing Watcher components
- Query the list of auditable resource types for a given goal
- Uniform airflow migration strategy
- Uniform outlet temperature migration strategy
- Workload balance migration strategy
- we will prioritize them during the mid-cycle meetup / please add your blueprints before EOW
- Many new BPs added that needs specs (please assign yourself if you start working on one of them) :
- Open Discussion
- cross-project liaison
- final agenda for the mid-cycle
- Experimental job for running tempest tests
- What does it take to get this to be an automatic non-voting job (eventually voting gate job)?
01/20/2016
- Roll Call
- Announcements
- mitaka-2 release target is 22nd January with 10 BPs implemented and 41 bugs fixed (17 still in progress) mitaka-2
- Review Action Items
- Watcher specs
- status for Allow specification of threshold defining when optimization is needed
- Provide a gain indicator associated with the actions plan specs are in review [1]
- Watcher
- doc updates before mitaka-2 in review Add diagrams to the architecture doc page & Re-organize the Wacher documentation Home Page
- Add a dynamic loading of Actions handlers in the Watcher Applier feature is now available in Watcher but we need to add schema to declare the contract of an action and oslo configuration of actions
- Tempest basic set up needs reviews
- 13 bugs fixed since our last meeting
- External API versioning is in progress, hoping to finish up and test by Thursday (tpeoples)
- Watcher client
- Make watcherclient use graduated oslo lib & Support translation merged
- a review in progress on Sync Action resource fields
- Watcher specs
- Blueprint/Bug Review and Discussion
- Open Discussion
- Do we need to appoint a cross-project liaison? See http://docs.openstack.org/project-team-guide/cross-project.html#cross-project-specification-liaisons
01/13/2016
- Roll Call
- Announcements
- first draft of mid-cycle agenda available [2]
- Review Action Items
- Watcher specs
- outlet Temperature based migration strategy spec has been merged
- 2 new blueprints have been created to handle latest comments Allow specification of threshold defining when optimization is needed & provide an helper to call Nova select_destinations() from the scheduler's API
- Provide a more dynamic Actions management solution merged and implementation is in progress
- reviews needed on Define an api to allow the description in Watcher of constraints & first draft of watcher-consolidation-grammar
- Watcher
- Many reviews [3] are related to Provide a more dynamic Actions management solution and need to be merged together
- Implement DevStack plugin merged
- Do we want to send out a note to the ML?
- Watcher client
- Launchpad page has been set up
- Make watcherclient use graduated oslo lib implemented but needs reviews [4]
- Watcher specs
- Blueprint/Bug Review and Discussion
- Please update the delivery field on Watcher launchpad to your assigned BPs
- we need an updated status on BPs Watcher Overload (cpu, ram) algorithm & Add new client commands to control cluster balancing
- Provide a plug-in for Horizon will need a dedicated git repo, could we call it "watcher-dashboard" ?
- bug status for mitaka-2
- Open Discussion
- Proposed talks for OpenStack Summit in Austin [5] (deadline February 1st)
- [Susanne] Talk submission is open now. Please add the emails you want me to register you with on the etherpad and I'll submit them soon
- Agenda for the mid-cycle 1st draft [6]
- Moving to use global openstack/requirements will require us to use master instead of liberty (https://bugs.launchpad.net/watcher/+bug/1533282)
- Look into what harlowja's super scheduler is aiming to do (https://review.openstack.org/#/c/210549/)
- Proposed talks for OpenStack Summit in Austin [5] (deadline February 1st)
01/06/2016
- Roll Call
- Announcements
- Review Action Items
- Watcher
- most of the reviews have been merged or adandonned before end of year thanks to jed56 & vincentfrancoise [10]
- outlet temperature based migration strategy has been merged [11] but need improvements (see comments)
- we need an updated status on reviews [12], [13], [14]
- devstack plugin is still in review [15]
- Watcher specs
- Watcher
- Blueprint/Bug Review and Discussion
- implementing custom actions require changes in the data model, should we provide a migration of the data model ?
- we would like to start integrating taskflow in Watcher applier, do we need a spec for [20] ?
- can we update the state of [21] ?
- Is [22] related to improvement of INTEL POC ?
- we need someone to handle multiple versions of OpenStack components API [23] targeted for mitaka-2
- we need an updated status on BPs [24] & [25]
- Open Discussion
12/16/2015
- Roll Call
- Announcements
- Review Action Items
- Blueprint/Bug Review and Discussion
- Open Discussion
12/9/2015
- Roll Call
- Announcements
- Review Action Items
- Watcher
- Watcher specs
- Blueprint/Bug Review and Discussion
- Open Discussion
12/2/2015
- Roll Call
- Announcements
- mid-cycle meetup details
- versionning added to launchpad (mitaka-1 : today, mitaka-2 : 01/21/16, mitaka-3 : 03/03/16)
- as we are using commonly etherpad, I started a new one to reference all of them [55]
- Review Action Items
- Documentation :
- a Glossary has been added to the Watcher documentation and MUST now be reviewed [56] before code refactoring
- an architecture page has been updated with the current architecture diagram [57]
- do we need to put this diagram in watcher-specs to work on Watcher v2 architecture ? (or we wait for the mid-cycle ?)
- Documentation :
- Blueprint/Bug Review and Discussion
- we should merge all stable code for mitaka-1 and tag the current version
- Intel split up this BP [58] before writing associated specs
- Please review:
- Taylor split up this BP [59] - still a TODO, will have done by 12/3
- bcom has some refactoring to do [60] after merging the glossary [61] -> should be done today
- bcom will submit a BP to have a performance indicator associated with the action plan (like 10% reduction of energy consumption)
- could create-net submit a BP regarding the "consolidation rule" modeling ?
- we should set priority for BP [62]
- Open Discussion
- how to deal with integration tests in the future ?
- DevStack plugin is mostly done but having some keystone conf issues to work through. Should have up for review by end of week (tpeoples)
11/25/2015
- Roll Call
- Announcements
- mid-cycle meetup details
- wiki page related to Watcher architecture v2 is live [63]
- WIP rule on reviews (using -1 on workflow if it is a work in progress)
- Review Action Items
- Blueprint/Bug Review and Discussion
- we should define series for Watcher on Launchpad (for blueprints deadline), should we use the current OpenStack versionning (Mitaka-N every 2 months) ?
- Intel should split this BP [69] before writing associated specs
- this BP [70] should probably be split for each Watcher component
- bcom has some refactoring to do [71] after merging the glossary so please review it asap [72]
- bcom will submit a BP to have a performance indicator associated with the action plan (like 10% reduction of energy consumption)
- could create-net submit a BP regarding the "consolidation rule" modeling ?
- we should set priority for BP [73]
- Open Discussion
11/18/2015
- Roll Call
- Announcements
- regular meeting started targeting a POC for thermal optimization using Watcher
- ad-hoc meeting with ICCLab and Create-Net on thursday
- Review Action Items
- Developments for Ceilometer integration [74]
- Development for loading optimization Strategies dynamically with Stevedore [75]
- Specification for blueprint telemetry-integration has been written in watcher-specs and can be reviewed [76]
- Documentation :
- a Glossary has been added to the Watcher documentation and is currently being reviewed [77]
- writing some UML diagrams with an Ascii description : testing of the tool used in Nova, named Jia.
- Intel is working on the spec for the energy minimization PoC and it should be up for review soon.
- Blueprint/Bug Review and Discussion
- New blueprint added with the following title : Add new actions in Watcher that can be used in Action Plan produced by a strategy.
- Open Discussion
11/11/2015
- Roll Call
- 11/11 is a day off in France so we will have a limited french team for today
- Announcements
- ICCLab@ZHAW first participation - short intro
- University Applied Research Lab focused on cloud computing, ~30 people, considering many different aspects energy, storage, networking, paas, serivce lifecycles, etc - http://blog.zhaw.ch/icclab/
- Energy related activities mainly in Openstack context funded by EU project GEYSER - http://www.geyser-project.eu/
- Have developed basic energy monitoring tool (kwapi based), deferred workload tool integrated with Horizon (working on more complex scheduler), rudimentary load consolidation mechanism
- Strong open source philosophy; would be happy to work with others on this topic
- ICCLab@ZHAW first participation - short intro
- Review Action Items
- watcher-specs is now ready
- devstack plugin for Watcher (https://blueprints.launchpad.net/watcher/+spec/devstack-plugin)
- mid-cycle meetup details
- bug triage
- enquiry to change the weekly meeting time
- Blueprint/Bug Review and Discussion
- Open Discussion
- Topic - ways of integration nova lb with watcher
- https://goo.gl/NnW77j — overload
- https://goo.gl/t7MhWP — suspend/unsuspend
- https://goo.gl/13nJ9p — lb-rules
- Topic - ways of integration nova lb with watcher
11/4/2015
- Roll Call
- Announcements
- Remark from ttx, do not use the name "OpenStack Watcher"
- Review Action Items
- Actions from Tokyo (https://etherpad.openstack.org/p/watcher-tokyo-architecture-session)
- @jwcroppe init watcher specs repo and add rights to core contrib
- @tpeoples look into getting devstack plugin for watcher working
- @acabot & @sballe schedule the mid-cycle meetup
- @dtardivel move all current bugs to launchpad
- Actions from Tokyo (https://etherpad.openstack.org/p/watcher-tokyo-architecture-session)
- Blueprint/Bug Review and Discussion
- Open Discussion
- Discuss use of ceilosca or ceilometer to collect metrics
- How to deal with diagram on wiki ? Should we host them in specs repo ?
- Integrating OpenStack Nova LoadBalancer into Watcher project (discussed at Tokyo Summit)
10/21/2015
- Roll Call
- Announcements
- Review Action Items
- mailing intro on openstack-dev mailing list
- Code migration from Stackforge
- create Watcher specs repo
- Watcher tools repo
- Tokyo Agenda
- Blueprint/Bug Review and Discussion
- Open Discussion
- Discuss opnfv doctor
10/14/2015
- Roll Call
- remember our meeting will take place on #openstack-meeting-3
- Announcements
- recording everyday success
- Review Action Items
- write down the mailing intro for Watcher
- Tokyo Agenda
- create Watcher specs repo
- Blueprint/Bug Review and Discussion
- Open Discussion
10/07/2015
- review the talk proposal for Tokyo (still in standby mode) https://docs.google.com/presentation/d/1gdb3PcC8KnKvs9PmblludTAqXmBI92t3zxTsX0BmPE0/edit?usp=sharing
- Intel & IBM status on resources for Watcher
- all blueprints wrote down on launchpad https://launchpad.net/watcher
- Watcher wiki update
- Weekly IRC meeting
- When do we want to have these meetings?
- tpeoples> sballe: if we want to keep 1500 UTC the only day that is available is Friday. There is a slot open for 1400 UTC on Tuesday, Wednesday. Slots open for Wednesday at 1600. i uploaded the ical into google calendar: https://www.google.com/calendar/render?pli=1#main_7%7Cweek-2+23371+23377+23373
- Mailing list creation
- Quick comment: OpenStack doesn;t run seperrate mailing lists. We should use the openstack-dev@lists.openstack.org mailing list with "[watcher]" in the subject.
- Tokyo summit actions
09/30/2015
Announcements
- Re: OpenStack Watcher repos: The Stackforge in this list: https://wiki.openstack.org/wiki/Stackforge_Namespace_Retirement will be moved automatically to OpenStack repos. Watcher is on the list so we do not have to do anything.
- These changes are scheduled to occur on October 17, 2015.
- review the OpenStack Watcher vision document https://docs.google.com/document/d/1PAEK3eYi9Et2lpc6pT1JU2AoVSaivMmeHmj62qajqm8/edit#
- review the current architecture https://docs.google.com/presentation/d/1-AEqDPAOaLva4N9PkBhvQ070SxhSFPiNnLiUFKiSJj0/edit#slide=id.gca3d12c11_2_52
- review the actions list from our last workshop https://etherpad.openstack.org/p/watcher-workshop-rennes
- [sballe] Setup cadence for weekly meetings - work out an acceptable time for the group
- [acabot] Send out email to introducing Watcher to mailing lists (pre-requisites would be to have the wiki upadated, vision doc, etc.)
- [acabot] Clean up wiki document, including alignment with the Watcher vision document
- [sballe] Set up Git repositories on openstack.org
- [JeD56] Transfer code from existing StackForge repositories to Gerrit (after sballe gets the repositories configured)
- [jwcroppe] Create initial mission statement and vision doc and send out to team (jwcroppe: done - see "Watcher Vision Doc" in the "Key Links" section)
- [dtardivel] Add a link to the API generated doc in Watcher wiki
- [all] Write down blueprints in LaunchPad from the use cases list
- Tokyo summit actions
- [jwcroppe, sballe, acabot] Prepare slides for Watcher talk (still in 'standby' mode)
- [sballe] Figure out a place where we can do an ad-hoc talk
- Talk to Nova, Ceilometer, etc. PTLs to inform them of the project
- [acabot, jwcroppe, sballe] Consider a Nova unconference session to introduce Watcher
- [sballe] Setup a meeting with Monty Taylor to introduce him to Watcher
- [sballe, acabot, jwcroppe] Evangelize Watcher with other folks (e.g., jaypipes, bauzas, Perry Myers from Red Hat, folks from Rackspace, Julien Danjou from Red Hat)
Brief progress reports
Open Discussion