Jump to: navigation, search

Difference between revisions of "StructuredStateManagement"

(Summary)
(Summary)
Line 25: Line 25:
 
# https://bugs.launchpad.net/nova/+bug/1082414
 
# https://bugs.launchpad.net/nova/+bug/1082414
 
# ...
 
# ...
 +
 +
 +
=== Connected blueprints ===
 +
 +
# https://blueprints.launchpad.net/nova/+spec/structured-state-management
 +
  
 
=== Requirements ===
 
=== Requirements ===

Revision as of 21:54, 24 April 2013

Summary

Move away from ad-hoc states and state transitions to a more concrete organized structured state management in nova.

What problems does this solve

  • Increases the [stability, extendability, reliability] of nova.
  • Makes it easier to [debug, test, understand, verify, review] nova code.
  • Removes hard to discover state-transition dependencies and interactions with clearly defined state-transition dependencies and interactions.
  • Ensures state transitions are done reliably and correctly by isolating those transitions to a single place.
  • Removes the need for periodic tasks to cleanup garbage left by nova's ad-hoc states.
  • Fixes a variety of problems that previously had piecemeal like patches applied.
  • Eliminates the inherent fragility of a ad-hoc workflow.
  • Creates the path for smart resource scheduling.
  • Makes it possible to do [resizing, live migration] in a more secure and manageable manner.
  • Makes it possible to audit & track the state transitions performed on a given resource.
  • Makes it possible for nova to have multi-stage booting where an instances and its dependent resources are first reserved, the resources configured, the instance configured, and then finally the instance is powered-on (thus completing the instance provisioning process).
  • Addresses the underlying key point of http://www.slideshare.net/harlowja/nova-states-summit/9 where states will now be fully recovered from on cutting.

Issues that would likely not have happened with a better state management system

  1. https://blueprints.launchpad.net/nova/+spec/compute-instance-cleanup-service
  2. https://bugs.launchpad.net/nova/+bug/1050979
  3. https://bugs.launchpad.net/nova/+bug/1061024
  4. https://bugs.launchpad.net/nova/+bug/1082414
  5. ...


Connected blueprints

  1. https://blueprints.launchpad.net/nova/+spec/structured-state-management


Requirements

https://etherpad.openstack.org/task-system

Discussions

https://etherpad.openstack.org/the-future-of-orch

Plan of record

  1. Create prototype.
  2. Get feedback from summit session.
  3. Get more feedback from email list & heat folks about common library.
  4. Adjust prototype as needed from feedback.
  5. Split prototype into small chunks.
  6. Adjust tests for each small chunks.
  7. Start to submit prototype chunks into http://review.openstack.org (disabling whole/pieces component until ready to turn on?).

Prototype

https://github.com/Yahoo/NovaOrc

Design

New-arch.png



Design details

In order to implement of this new orchestration layer the following key concepts must be built into the design from the start.

  1. A set of atomic tasks that can be organized into a workflow.
  2. Task resumption.
  3. Task rollback.
  4. Task tracking.
  5. Resource locking.
  6. Workflow sharding/ownership.
  7. Simplicity (allowing for extension and verifiability).
  8. Tolerant to upgrades.

Atomic tasks

Why it matters
How it will be addressed

Task resumption

Why it matters
How it will be addressed

Task rollback

Why it matters
How it will be addressed

Task tracking

Why it matters
How it will be addressed

Resource locking

Why it matters
How it will be addressed

Workflow sharding/ownership

Why it matters
How it will be addressed

Simplicity

Why it matters
How it will be addressed

Tolerant to upgrades

Why it matters
How it will be addressed