Jump to: navigation, search

Difference between revisions of "SwiftQuotas"

(Updates after Summit session)
Line 6: Line 6:
 
== Summary ==
 
== Summary ==
  
In some deployment scenarios, such as a private cloud, the provider may want to limit the tenants (accounts)/users to a maximum allowable amount of storage via a quota.
+
In some deployment scenarios, such as a private cloud, the provider may want to limit the tenants (accounts) to a maximum allowable amount of storage via a quota.
  
 
== Release Note ==
 
== Release Note ==
  
A storage quota prevents accounts/users from using more than their allowed storage.
+
A storage quota prevents accounts from using more than their allowed storage.
  
A storage quota of 0 indicates unlimited storage for an account/user.
+
A storage quota of -1 indicates unlimited storage for an account (-1 also indicates unlimited in Nova quotas).
  
 
== Rationale ==
 
== Rationale ==
  
 
This is necessary for providers that cannot simply add disk at will as storage usage grows. There are any number of factors that may prevent a provider from being able to easily add disk.
 
This is necessary for providers that cannot simply add disk at will as storage usage grows. There are any number of factors that may prevent a provider from being able to easily add disk.
 +
 +
== Assumptions ==
 +
 +
The quota values are stored per account.
 +
All values are in bytes.
  
 
== User stories ==
 
== User stories ==
  
 +
User stories
 
Account: <quota>
 
Account: <quota>
* User1: <quota> (<derived quota>)
 
* User2: <quota> (<derived quota>)
 
  
'''1. User Quota Storage'''
+
'''Account Unlimited Storage'''
 +
Account: -1
 +
When the quota has a -1 value, storage is unlimited.
  
 +
'''Account Blacklist'''
 
Account: 0
 
Account: 0
* User1: 0
+
When the account has a 0 value, storage is not allowed.
* User2: 6
 
 
 
When the account has a zero value, the quota is determined strictly by the user value.
 
  
'''2. Evenly Distributed Storage'''
+
'''Account Limited Storage'''
 +
Account: >1
 +
When the account has a >1 value, storage is limited to that value.
  
Account: 6
+
'''Account goes over-quota'''
* User1: 0 (3)
+
Error code returned from middleware and the client is responsible for the actual notification (email/sms/whatever)
* User2: 0 (3)
 
  
When an account has a non-zero value and all users in that account have a zero value, the account storage is evenly distributed amongst the users.
+
If an account goes over-quota, it will go into an Over-Quota Mode. Below are just examples, the middleware should be generic enough to be easily tweakable (pluggable?) to add different modes. The only mode to be implemented as part of this spec is the Read/Delete-only mode.
  
'''3. Evenly Distributed Remainder Storage'''
+
Over-Quota Mode:
 +
* Read/Delete-only mode
 +
* Auto-increase quota
 +
* All stop
 +
* Specific rate-limiting (degraded service for an over quota account)
  
Account: 6
+
'''Account goes under-quota'''
* User1: 0 (2)
+
Business as usual
* User2: 0 (2)
 
* User3: 2
 
 
 
When an account has a non-zero value and some (not all) users in that account have a zero value, the remainder of the account storage is evenly distributed amongst the users with a zero value.
 
 
 
'''4. Sum Total Storage'''
 
 
 
Account: 6
 
* User1: 4
 
* User2: 2
 
 
 
When the sum of all of the user values totals to the account value, the quota is determined strictly by the user value.
 
 
 
'''5. Under-Sum Total Storage'''
 
 
 
Account: 6
 
* User1: 2
 
* User2: 2
 
 
 
When the sum of all of the user values is less than the account value, the quota is determined strictly by the user value.
 
 
 
'''6. Over-Sum Total Storage'''
 
 
 
Account: 6
 
* User1: 4
 
* User2: 4
 
 
 
When the sum of all of the user values is greater than the account value, this is a counter example and should not be allowed.
 
 
 
'''Note:''' After writing out all of these use cases I could easily be convinced that really only cases 1 and 2 are allowed (at least to begin with).
 
 
 
== Assumptions ==
 
 
 
The quota values is stored per account and per user. All values are in GBs.
 
  
 
== Design ==
 
== Design ==
Line 85: Line 60:
 
== Implementation ==
 
== Implementation ==
  
TBD
+
# get auth token
 +
# get usage
 +
# get quota
 +
# filter in Swift middleware
 +
 
 +
Quotas could live outside of Swift and be part of Auth as they are account (tenant) level info.
 +
 
 +
Where does the usage data come from?
 +
* HEAD on the account (RFE: number of bytes transferred since XXX) HEADs are cheap and caching will keep this performant, returns billable bytes, not raw bytes
 +
* slogging (for rolled-up storage and bandwidth )
  
 
=== UI Changes ===
 
=== UI Changes ===
  
The Swift CLI will need to be able to CRUD quotas for accounts and users.
+
The Swift CLI will need to be able to CRUD quotas for accounts.
 +
You should be able to view quota usage in Horizon.
  
 
=== Code Changes ===
 
=== Code Changes ===

Revision as of 19:27, 1 May 2012

  • Launchpad Entry: SwiftSpec:storage-quotas
  • Created: 1 Mar 2012
  • Contributors: Everett Toews

Summary

In some deployment scenarios, such as a private cloud, the provider may want to limit the tenants (accounts) to a maximum allowable amount of storage via a quota.

Release Note

A storage quota prevents accounts from using more than their allowed storage.

A storage quota of -1 indicates unlimited storage for an account (-1 also indicates unlimited in Nova quotas).

Rationale

This is necessary for providers that cannot simply add disk at will as storage usage grows. There are any number of factors that may prevent a provider from being able to easily add disk.

Assumptions

The quota values are stored per account. All values are in bytes.

User stories

User stories Account: <quota>

Account Unlimited Storage Account: -1 When the quota has a -1 value, storage is unlimited.

Account Blacklist Account: 0 When the account has a 0 value, storage is not allowed.

Account Limited Storage Account: >1 When the account has a >1 value, storage is limited to that value.

Account goes over-quota Error code returned from middleware and the client is responsible for the actual notification (email/sms/whatever)

If an account goes over-quota, it will go into an Over-Quota Mode. Below are just examples, the middleware should be generic enough to be easily tweakable (pluggable?) to add different modes. The only mode to be implemented as part of this spec is the Read/Delete-only mode.

Over-Quota Mode:

  • Read/Delete-only mode
  • Auto-increase quota
  • All stop
  • Specific rate-limiting (degraded service for an over quota account)

Account goes under-quota Business as usual

Design

TBD

Implementation

  1. get auth token
  2. get usage
  3. get quota
  4. filter in Swift middleware

Quotas could live outside of Swift and be part of Auth as they are account (tenant) level info.

Where does the usage data come from?

  • HEAD on the account (RFE: number of bytes transferred since XXX) HEADs are cheap and caching will keep this performant, returns billable bytes, not raw bytes
  • slogging (for rolled-up storage and bandwidth )

UI Changes

The Swift CLI will need to be able to CRUD quotas for accounts. You should be able to view quota usage in Horizon.

Code Changes

Code changes should include an overview of what needs to change, and in some cases even the specific details.

Migration

Include:

  • data migration, if any
  • redirects from old URLs to new ones, if any
  • how users will be pointed to the new way of doing things, if necessary.

Test/Demo Plan

This need not be added or completed until the specification is nearing beta.

Unresolved issues

This should highlight any issues that should be addressed in further specifications, and not problems with the specification itself; since any specification with problems cannot be approved.

BoF agenda and discussion

Use this section to take notes during the BoF; if you keep it in the approved spec, use it for summarising what was discussed and note any options that were rejected.