Jump to: navigation, search

Difference between revisions of "Swift/ideas"

(Ideas)
 
(6 intermediate revisions by 4 users not shown)
Line 11: Line 11:
 
* '''Small file optimization''' -- [[Swift/ideas/small files]]
 
* '''Small file optimization''' -- [[Swift/ideas/small files]]
 
** '''Small files experimentations''' [[Swift/ideas/small files/experimentations]]
 
** '''Small files experimentations''' [[Swift/ideas/small files/experimentations]]
** '''Small files implementation''' [[Swift/ideas/small files/implementation]]
+
** '''Small files implementation''' [[Swift/ideas/small files/implementation]] -- [https://docs.google.com/document/d/1KoLsqWiXv9u2rnMZ5Rh73Js-lwP5h2qRj9CuFJ2IJJc LOSF Design doc]
 
* '''Reduce memcache lookups''' -- [[Swift/ideas/memoize lookups]]
 
* '''Reduce memcache lookups''' -- [[Swift/ideas/memoize lookups]]
 
* '''Improve internal network security''' -- [[Swift/ideas/network_security]]
 
* '''Improve internal network security''' -- [[Swift/ideas/network_security]]
 
* '''Metrics around rate-limiting''' -- [[Swift/ideas/ratelimiting_metrics]]
 
* '''Metrics around rate-limiting''' -- [[Swift/ideas/ratelimiting_metrics]]
 
* '''Hierarchical keymaster''' -- [[Swift/ideas/hierarchical_keymaster]]
 
* '''Hierarchical keymaster''' -- [[Swift/ideas/hierarchical_keymaster]]
* '''Container Sharding''' -- [https://docs.google.com/document/d/1-0wUnaRf2TTA0KQGk301BPR8-5wzuyA1r4tLSEh-cbw/edit?usp=sharing container-sharding.odt] [https://etherpad.openstack.org/p/container-sharding-SAT-2016 Etherpad notes] [https://trello.com/b/z6oKKI4Q/container-sharding trello] [https://docs.google.com/document/d/16rPdDrT-4G6hcen_6no8cr8KbxUqbcvsSkOfxxu0EBE/edit?usp=sharing Initial locking db shard approach idea] [https://docs.google.com/document/d/1dsROCHrgM0S_95bNp1BqD9DUUuQbkuoBxKkrhsNNeX0/edit?usp=sharing Sharder 2.0]
+
* '''Container sharding improvements''' - https://etherpad.openstack.org/p/sharding-improvements [https://etherpad.openstack.org/p/swift-auto-sharding auto-sharding-thoughts] [https://docs.google.com/document/d/15yG9zOatwPyXCA3YLNLdNIue9qDR4wLyMPIbypcbALc/edit?usp=sharing auto sharding 2.0]
** https://etherpad.openstack.org/p/deep-containers
 
* '''Container sharding improvements''' - https://etherpad.openstack.org/p/sharding-improvements [https://etherpad.openstack.org/p/swift-auto-sharding auto-sharding-thoughts]
 
 
* '''High-latency media / Tape support for Swift''' -- [[Swift/HighLatencyMedia]]
 
* '''High-latency media / Tape support for Swift''' -- [[Swift/HighLatencyMedia]]
 
* '''The Archival Storage extension to the Swift API''' -- [https://etherpad.openstack.org/p/high-latency-storage-policy]
 
* '''The Archival Storage extension to the Swift API''' -- [https://etherpad.openstack.org/p/high-latency-storage-policy]
Line 30: Line 28:
 
* '''More disks in saio''' -- https://etherpad.openstack.org/p/more-disks-in-saio
 
* '''More disks in saio''' -- https://etherpad.openstack.org/p/more-disks-in-saio
 
* '''Update python-swiftclient with Keystone session support''' -- [[Swift/ideas/swiftclient-keystone-session]]
 
* '''Update python-swiftclient with Keystone session support''' -- [[Swift/ideas/swiftclient-keystone-session]]
* '''Enable object path obfuscation in logs e.g. replace with hash''' - suggested here https://etherpad.openstack.org/p/BOS-Swift-ops-feedback-session
 
 
* '''Enable 'atime' for objects''' -- https://etherpad.openstack.org/p/atime_for_Swift
 
* '''Enable 'atime' for objects''' -- https://etherpad.openstack.org/p/atime_for_Swift
 
* '''Probe tests with more devices''' -- [[Swift/ideas/more-testing-devices]]
 
* '''Probe tests with more devices''' -- [[Swift/ideas/more-testing-devices]]
Line 36: Line 33:
 
* '''Object copy directly between object-servers''' -- [[Swift/ideas/object-copy-between-object-servers]]
 
* '''Object copy directly between object-servers''' -- [[Swift/ideas/object-copy-between-object-servers]]
 
* '''Account quota for number of files''' -- [[Swift/ideas/account-quota-files]]
 
* '''Account quota for number of files''' -- [[Swift/ideas/account-quota-files]]
 
+
* '''Use SO_REUSEPORT''' -- https://etherpad.openstack.org/p/PDumlTZ8uX
 
+
* '''Third party transfers between Swift installations''' -- [[Swift/ideas/third-party-transfers]]
 +
* '''Add domains in ACLs''' -- [[Swift/ideas/acl-domains]]
 
Done:
 
Done:
  
Line 44: Line 42:
 
</s>
 
</s>
 
* <s>'''Symlinks''' -- https://etherpad.openstack.org/p/swift_symlinks</s>
 
* <s>'''Symlinks''' -- https://etherpad.openstack.org/p/swift_symlinks</s>
 +
* <s>'''Container Sharding''' -- [https://docs.google.com/document/d/1-0wUnaRf2TTA0KQGk301BPR8-5wzuyA1r4tLSEh-cbw/edit?usp=sharing container-sharding.odt] [https://etherpad.openstack.org/p/container-sharding-SAT-2016 Etherpad notes] [https://trello.com/b/z6oKKI4Q/container-sharding trello] [https://docs.google.com/document/d/16rPdDrT-4G6hcen_6no8cr8KbxUqbcvsSkOfxxu0EBE/edit?usp=sharing Initial locking db shard approach idea] [https://docs.google.com/document/d/1dsROCHrgM0S_95bNp1BqD9DUUuQbkuoBxKkrhsNNeX0/edit?usp=sharing Sharder 2.0]
 +
** https://etherpad.openstack.org/p/deep-containers</s>
 +
* <s>'''Enable object path obfuscation in logs e.g. replace with hash''' - suggested here https://etherpad.openstack.org/p/BOS-Swift-ops-feedback-session</s>
 +
** Implemented in https://github.com/openstack/swift/commit/a4cc353375264e4bcd8f9aef2f0701ae800e0e73
  
 
----
 
----
  
 
[[Category:ObjectStorage]]
 
[[Category:ObjectStorage]]

Latest revision as of 20:42, 3 November 2019

Ideas for OpenStack Swift

This page is a collection of "brain dumps" for ideas about features in OpenStack Swift. If you're working on something, it's a very good idea to write down what you're thinking about. This lets others get up to speed, helps you collaborate, and serves as a great record for future reference. Write down your thoughts somewhere and put a link to it here. It doesn't matter what form your thoughts are in; use whatever is best for you. Your document should include why your idea is needed and your thoughts on particular design choices and tradeoffs. Please include some contact information (ideally, your IRC nick) so that people can collaborate with you.

Historic "specs" are available at https://specs.openstack.org/openstack/swift-specs/

Ideas

Format: Idea -- link to your brain dump

Done: