Revision as of 14:57, 6 January 2016

Meetings

• Weekly on Wednesday at 1500 UTC
• IRC channel: #openstack-meeting-alt on freenode
• Chair: Brian Haley (haleyb), Swaminathan Vasudevan (Swami)
• Meetings, with their notes and logs, will be found under http://eavesdrop.openstack.org/meetings/neutron_dvr

Agenda

Meeting January 6th, 2016

Announcements (haleyb)

Topics for Discussion

Topic: Live Migration issues with DVR, Swami

• We have started a discussion on the live migration issue with DVR and how to address it from the neutron side. As a team we need to

get concensus on this ideas before we work with the Nova team on this issue. I would like to discuss this today in our team meeting to get everyone upto the same page.

• • https://bugs.launchpad.net/neutron/+bug/1456073 ( discussion thread)

Bugs (Swami)

New Bugs this week

• https://bugs.launchpad.net/neutron/+bug/1530179 - get_subnet_for_dvr() returns wrong gateway mac
  • https://review.openstack.org/#/c/262574/
• https://bugs.launchpad.net/neutron/+bug/1531065 - duplicate fetch subnet_id in get_subnet_for_dvr
  • https://review.openstack.org/#/c/263563/

Bugs from last week

• https://bugs.launchpad.net/neutron/+bug/1524908 - Router may be removed from SNAT agent by accident.
• https://bugs.launchpad.net/neutron/+bug/1526175 - L3 HA routers end up in DVR Node (medium)
  • https://review.openstack.org/#/c/257849/ (Related Patch)

• https://bugs.launchpad.net/neutron/+bug/1522824 - test_shelve_instance test failure
  • https://review.openstack.org/#/c/253569/ - Set PENDING_BUILD status for ports after update in DB - needs another +2

Categorized Bugs

Gate Test Failures

• https://bugs.launchpad.net/neutron/+bug/1522824 (High)
• https://bugs.launchpad.net/neutron/+bug/1450604 (Medium)
• https://bugs.launchpad.net/neutron/+bug/1521815 (Low)- intermittent failure, hard to reproduce
• https://bugs.launchpad.net/neutron/+bug/1521820 (Fixed)- "leaking" of FIP namespace in tests, fixed (related fix)

Existing Functionality Broken Bugs

• https://bugs.launchpad.net/neutron/+bug/1456073 (High)
• https://bugs.launchpad.net/neutron/+bug/1462154 (High)
• https://bugs.launchpad.net/neutron/+bug/1508869 (Low)
• https://bugs.launchpad.net/neutron/+bug/1445255 (Low)
• https://bugs.launchpad.net/neutron/+bug/1499785 (Low)
• https://bugs.launchpad.net/neutron/+bug/1499787 (Low)
• https://bugs.launchpad.net/neutron/+bug/1447227 (Low)
• https://bugs.launchpad.net/neutron/+bug/1510796 (Low)
• https://bugs.launchpad.net/neutron/+bug/1424096 (Undecided) - Oleg has a patch for this bug.

Scale and Performance Impact Bugs

• https://bugs.launchpad.net/neutron/+bug/1513678 (High)
• https://bugs.launchpad.net/neutron/+bug/1524020 (Medium)

New Features Bugs

• https://bugs.launchpad.net/neutron/+bug/1365473 (High) - (DVR SNAT HA - Server Side) (Should change this to HIGH) Right now it is WishList.
  • https://review.openstack.org/#/c/143169/ (Needs core blessings)
• https://bugs.launchpad.net/neutron/+bug/1450067 (Low)

Refactor or Cleanup Bugs

• https://bugs.launchpad.net/neutron/+bug/1524291 (Low) - Code duplication
• https://bugs.launchpad.net/neutron/+bug/1524020(Medium) - DVR ARP update call count can be reduced

WishList Bugs

• https://bugs.launchpad.net/neutron/+bug/1450067 (Low)
• https://bugs.launchpad.net/neutron/+bug/1504039 (Linux bridge support for DVR)
• https://bugs.launchpad.net/neutron/+bug/1518819 - Ability to specify a gateway when adding a subnet without cidr
• https://bugs.launchpad.net/neutron/+bug/1529439 - unify validate_agent_router_combination exceptions for dvr agent_mode

WatchList Bugs

• https://bugs.launchpad.net/neutron/+bug/1444014 (StaleDataError) - on Watch.

High Priority in-progress

• https://bugs.launchpad.net/neutron/+bug/1462154 With DVR Pings to floating IPs replied with fixed-ips
  • https://review.openstack.org/246855
  • https://review.openstack.org/246894
  • Doesn't seem to be making progress?
• https://bugs.launchpad.net/neutron/+bug/1505575 Fatal memory consumption by neutron-server with DVR at scale
  • https://review.openstack.org/#/c/234067/ (sync in chunks)
• https://bugs.launchpad.net/neutron/+bug/1513678 At scale router scheduling takes a long time with DVR routers with multiple compute nodes hosting thousands of VMs
  • https://review.openstack.org/241843 already merged
  • two other related changes

Other in-progress

• https://bugs.launchpad.net/neutron/+bug/1508869 - handle port host change (live migration)
  • https://review.openstack.org/#/c/238478/

• https://bugs.launchpad.net/neutron/+bug/1456073 - Live Migration Bug
  • related bug https://bugs.launchpad.net/neutron/+bug/1414559 with fixes:
    • in neutron https://review.openstack.org/#/c/246898/
    • and nova https://review.openstack.org/#/c/246910/

Discuss a plan to address the gate failures

• Current failure rate: https://goo.gl/L1WODG
  • Multinode was broken by https://review.openstack.org/#/c/233711/ and fixed by https://review.openstack.org/#/c/245697/
  • All the jobs except multinode-dvr appear to have stabilized at similar failure rates. Reviews sent to re-enable gate jobs
    • https://review.openstack.org/#/c/255325/ (make single-node DVR job voting again)
    • https://review.openstack.org/#/c/212058/ (make neutron multi-node job voting again)
• Debug the gate in the current failure state (Identify owners who can own this)
• https://bugs.launchpad.net/neutron/+bug/1515360 - Tempest "SSHTimeout" failures
  • https://review.openstack.org/#/c/247748/ (add debugging code to l3-agent)
• https://drive.google.com/file/d/0B4kh-7VVPWlPMkdrQWFFdjNsSnM/view?usp=sharing - Logstash failures captured. Any logstash errors can be captured here.

Performance/Scalability (obondarev)

• https://blueprints.launchpad.net/neutron/+spec/improve-dvr-l3-agent-binding
  • Started https://review.openstack.org/#/c/254837/

Open Discussion

Meeting commands

/join #openstack-meeting-alt
#startmeeting neutron_dvr
#topic Announcements
#undo topic
#link https://wiki.openstack.org/wiki/Meetings/Neutron-DVR
#action haleyb will get something specific done this week
#chair Swami
...
#endmeeting