Revision as of 14:24, 9 December 2015

Meetings

Weekly on Wednesday at 1500 UTC
IRC channel: #openstack-meeting-alt on freenode
Chair: Brian Haley (haleyb), Swaminathan Vasudevan (Swami)
Meetings, with their notes and logs, will be found under http://eavesdrop.openstack.org/meetings/neutron_dvr

Agenda

Meeting December 2nd, 2015

Announcements (haleyb)

Bugs (Swami)

New Bugs this week

Did not see any tagged with l3-dvr-backlog

Bugs from last week

https://bugs.launchpad.net/neutron/+bug/1521815 - intermittent failure, hard to reproduce
https://bugs.launchpad.net/neutron/+bug/1521846 - metering failure, fixed
https://bugs.launchpad.net/neutron/+bug/1521524 - metadata failure, fixed
https://bugs.launchpad.net/neutron/+bug/1521820 - "leaking" of FIP namespace in tests, fixed

High Priority in-progress

https://bugs.launchpad.net/neutron/+bug/1462154 With DVR Pings to floating IPs replied with fixed-ips
- https://review.openstack.org/246855
- https://review.openstack.org/246894
- Doesn't seem to be making progress?
https://bugs.launchpad.net/neutron/+bug/1505575 Fatal memory consumption by neutron-server with DVR at scale
- https://review.openstack.org/#/c/234067/ (sync in chunks)
https://bugs.launchpad.net/neutron/+bug/1513678 At scale router scheduling takes a long time with DVR routers with multiple compute nodes hosting thousands of VMs
- https://review.openstack.org/241843 already merged
- two other related changes

Other in-progress

https://bugs.launchpad.net/neutron/+bug/1508869 - handle port host change (live migration)
- https://review.openstack.org/#/c/238478/

https://bugs.launchpad.net/neutron/+bug/1456073 - Live Migration Bug
- related bug https://bugs.launchpad.net/neutron/+bug/1414559 with fixes:
  - in neutron https://review.openstack.org/#/c/246898/
  - and nova https://review.openstack.org/#/c/246910/

Discuss a plan to address the gate failures

Current failure rate: https://goo.gl/L1WODG
- Multinode was broken by https://review.openstack.org/#/c/233711/ and fixed by https://review.openstack.org/#/c/245697/
- All the jobs except multinode-dvr appear to have stabalized at similar failure rates. regXboi to consult with armax, mestery and dougwig about returning these jobs to voting next week.
Debug the gate in the current failure state (Identify owners who can own this)
https://bugs.launchpad.net/neutron/+bug/1515360 - Tempest "SSHTimeout" failures
- https://review.openstack.org/#/c/247748/ (add debugging code to l3-agent)
https://drive.google.com/file/d/0B4kh-7VVPWlPMkdrQWFFdjNsSnM/view?usp=sharing - Logstash failures captured. Any logstash errors can be captured here.

Performance/Scalability (obondarev)

https://blueprints.launchpad.net/neutron/+spec/improve-dvr-l3-agent-binding

Open Discussion

Meeting commands

/join #openstack-meeting-alt
#startmeeting neutron_dvr
#topic Announcements
#undo topic
#link https://wiki.openstack.org/wiki/Meetings/Neutron-DVR
#action haleyb will get something specific done this week
#chair Swami
...
#endmeeting

@@ Line 15: / Line 15: @@
 == New Bugs this week ==
+* Did not see any tagged with l3-dvr-backlog
-* https://bugs.launchpad.net/neutron/+bug/1521815
+== Bugs from last week ==
-* https://bugs.launchpad.net/neutron/+bug/1521846
-* https://bugs.launchpad.net/neutron/+bug/1521524
-** on review https://review.openstack.org/#/c/251718/
-* https://bugs.launchpad.net/neutron/+bug/1521820
-** https://review.openstack.org/#/c/252139/
-* (old? from last week)
+* https://bugs.launchpad.net/neutron/+bug/1521815 - intermittent failure, hard to reproduce
-** https://bugs.launchpad.net/neutron/+bug/1456073 - Live Migration Bug
+* https://bugs.launchpad.net/neutron/+bug/1521846 - metering failure, fixed
-*** related bug https://bugs.launchpad.net/neutron/+bug/1414559 with fixes:
+* https://bugs.launchpad.net/neutron/+bug/1521524 - metadata failure, fixed
-**** in neutron https://review.openstack.org/#/c/246898/
+* https://bugs.launchpad.net/neutron/+bug/1521820 - "leaking" of FIP namespace in tests, fixed
-**** and nova https://review.openstack.org/#/c/246910/
-* Needs more discussion
-** https://bugs.launchpad.net/neutron/+bug/1508869 - Live Migration related Bug
 ====High Priority in-progress====
@@ Line 36: / Line 29: @@
 ** https://review.openstack.org/246855
 ** https://review.openstack.org/246894
+** Doesn't seem to be making progress?
 * https://bugs.launchpad.net/neutron/+bug/1505575 Fatal memory consumption by neutron-server with DVR at scale
 ** https://review.openstack.org/#/c/234067/ (sync in chunks)
 * https://bugs.launchpad.net/neutron/+bug/1513678 At scale router scheduling takes a long time with DVR routers with multiple compute nodes hosting thousands of VMs
-** https://review.openstack.org/241843 merged yesterday
+** https://review.openstack.org/241843 already merged
 ** two other related changes
-* https://bugs.launchpad.net/neutron/+bug/1515360 - Tempest "SSHTimeout" failures
-** https://review.openstack.org/#/c/247748/ (add debugging code to l3-agent)
+====Other in-progress====
+* https://bugs.launchpad.net/neutron/+bug/1508869 - handle port host change (live migration)
+** https://review.openstack.org/#/c/238478/
+* https://bugs.launchpad.net/neutron/+bug/1456073 - Live Migration Bug
+** related bug https://bugs.launchpad.net/neutron/+bug/1414559 with fixes:
+*** in neutron https://review.openstack.org/#/c/246898/
+*** and nova https://review.openstack.org/#/c/246910/
 === Discuss a plan to address the gate failures ===
@@ Line 49: / Line 51: @@
 ** All the jobs except multinode-dvr appear to have stabalized at similar failure rates.  regXboi to consult with armax, mestery and dougwig about returning these jobs to voting next week.
 * Debug the gate in the current failure state (Identify owners who can own this)
-* https://review.openstack.org/#/c/247748/5 - Patch that addresses the debug options for SSHTimeout - Need some reviews.
+* https://bugs.launchpad.net/neutron/+bug/1515360 - Tempest "SSHTimeout" failures
-** given the -2, what is the plan for this?
+** https://review.openstack.org/#/c/247748/ (add debugging code to l3-agent)
 *https://drive.google.com/file/d/0B4kh-7VVPWlPMkdrQWFFdjNsSnM/view?usp=sharing - Logstash failures captured. Any logstash errors can be captured here.

Difference between revisions of "Meetings/Neutron-DVR"