https://wiki.openstack.org/w/api.php?action=feedcontributions&feedformat=atom&user=Prashanthr 2026-06-30T21:16:24Z User contributions MediaWiki 1.28.2 https://wiki.openstack.org/w/index.php?title=Redis_Storage_Driver_Design_(Zaqar)&diff=60169 2014-08-11T13:52:36Z

<p>Prashanthr: </p> <hr /> <div>=== Objective ===<br /> <br /> Redis is an in memory key-value datastore which can organize data as strings, hashes, lists, sets, sorted sets, bitmaps and hyperloglogs. Being In-memory makes it in ideal candidate for high load, low latency messages. Redis is distributed under the BSD license and is henceforth unbounded by any licensing constraints as in the case of mongodb.<br /> <br /> ==== Use Cases ====<br /> <br /> 1. High-throughput (2K+ messages/sec per queue)&lt;br /&gt;<br /> <br /> 2. Lots of small messages (&lt;= 1K)&lt;br /&gt;<br /> <br /> 3. Messages are short-lived (minutes, not hours)&lt;br /&gt;<br /> <br /> 4. High durability is optional (2 copies, RAM only)&lt;br /&gt;<br /> <br /> 5. HA is still very important&lt;br /&gt;<br /> <br /> <br /> === Components of the basic driver ===<br /> <br /> The basic driver includes support for a single instance redis store as a data backend. <br /> &lt;br /&gt;<br /> <br /> The driver supports 6 main required functions of a marconi storage driver which are:<br /> <br /> ==== Message Controller ====<br /> Helps organize messages scoped by every queue.<br /> &lt;br /&gt;<br /> ===== Organization of Data =====<br /> ====== Message id's list ( Redis Sorted Set ) ======<br /> &lt;br /&gt;<br /> Each queue in the system has a set of message ids currently in the queue. The list is sorted based on a ranking which is incremented atomically using the counter(MESSAGE_RANK_COUNTER_SUFFIX) also stored in the database for every queue.<br /> &lt;br /&gt;<br /> <br /> ====== Messages(Redis Hash) ======<br /> &lt;br /&gt;<br /> <br /> Each message is stored using the UUID of the message as the redis key. The datastructure has the following information. <br /> &lt;br /&gt;<br /> NOTE: This datastructure is serialized using msgpack.<br /> &lt;br /&gt;<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | id || id<br /> |-<br /> | created iso || cr_iso<br /> |-<br /> | ttl || t<br /> |-<br /> | expires || e<br /> |-<br /> | body || b<br /> |-<br /> | claim || c<br /> |-<br /> | claim expiry time || c.e<br /> |-<br /> | client uuid || u<br /> |-<br /> | created time || cr<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== Queue Controller ====<br /> &lt;br /&gt;<br /> <br /> Queues are scoped by project, which is prefixed to the queue name.<br /> <br /> ===== Data Organization =====<br /> <br /> ====== Queues ( Redis Sorted Set ) ======<br /> &lt;br /&gt;<br /> Id: queues_set<br /> &lt;br /&gt;<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | name || &lt;project-id.queue-name&gt;<br /> |}<br /> The set helps faster existence checks, while the list helps paginated retrieval of queues.<br /> &lt;br /&gt;<br /> <br /> ====== Queue Information (Redis Hash) ======<br /> &lt;br /&gt;<br /> <br /> This Data structure holds all meta information about a queue.<br /> &lt;br /&gt;<br /> <br /> Scope: &lt;project-id_q-name&gt;<br /> <br /> &lt;br /&gt;<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | count(size) || c<br /> |-<br /> | claimed || cl<br /> |-<br /> | metadata || m<br /> |-<br /> | creation time || t<br /> |}<br /> <br /> ==== Claims Controller ====<br /> &lt;br /&gt;<br /> <br /> ===== Data Organization =====<br /> <br /> ======Claims list ( Redis Set ) ======<br /> <br /> contains claim ids active for a queue.<br /> &lt;br /&gt;<br /> <br /> Redis ID: &lt;project-id_q-name&gt;<br /> &lt;br /&gt;<br /> <br /> ====== Claim info(Redis Hash) ======<br /> &lt;br /&gt;<br /> <br /> Contains the metadata information for a particular claim.<br /> &lt;br /&gt;<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | ttl || t<br /> |-<br /> | grace || g<br /> |-<br /> | id || if<br /> |-<br /> | claim || c<br /> |-<br /> | client UUID || u<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== Catalogue Controller ====<br /> TBD<br /> &lt;br /&gt;<br /> <br /> <br /> ==== Pools Controller ====<br /> TBD<br /> &lt;br /&gt;<br /> <br /> === Current Status ===<br /> <br /> The basic driver is a &quot;Work in Progress&quot; and is expected to be a part of the code base by Juno-3 deadline (Sept 4th 2014). The clustering and persistence extension is expected to be developed before the end of Kilo. It is also one of the requirements for the graduation of Marconi.<br /> <br /> === Blueprints ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint URL !! Functionality<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative] || Redis as an alternative driver for MongoDB<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver] || Redis Storage Driver for Marconi<br /> |}<br /> <br /> === Submitted Patches ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Patch URL !! Implemented Feature<br /> |-<br /> | [https://review.openstack.org/#/c/97178/] || Messages and Queue Controllers<br /> |-<br /> | [https://review.openstack.org/104055] || Claims Controller<br /> |-<br /> | [https://review.openstack.org/#/c/104058/] || Pools and Catalog Controllers<br /> |}<br /> <br /> === Future Work ===<br /> 1. Support Async connections to the redis database.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=Redis_Storage_Driver_Design_(Zaqar)&diff=60141 2014-08-09T05:10:36Z

<p>Prashanthr: </p> <hr /> <div>=== Objective ===<br /> <br /> Redis is an in memory key-value datastore which can organize data as strings, hashes, lists, sets, sorted sets, bitmaps and hyperloglogs. Being In-memory makes it in ideal candidate for high load, low latency messages. <br /> <br /> ==== Use Cases ====<br /> <br /> 1. High-throughput (2K+ messages/sec per queue)&lt;br /&gt;<br /> <br /> 2. Lots of small messages (&lt;= 1K)&lt;br /&gt;<br /> <br /> 3. Messages are short-lived (minutes, not hours)&lt;br /&gt;<br /> <br /> 4. High durability is optional (2 copies, RAM only)&lt;br /&gt;<br /> <br /> 5. HA is still very important&lt;br /&gt;<br /> <br /> <br /> === Components of the basic driver ===<br /> <br /> The basic driver includes support for a single instance redis store as a data backend. <br /> &lt;br /&gt;<br /> <br /> The driver supports 6 main required functions of a marconi storage driver which are:<br /> <br /> ==== Message Controller ====<br /> Helps organize messages scoped by every queue.<br /> &lt;br /&gt;<br /> ===== Organization of Data =====<br /> ====== Message id's list ( Redis Sorted Set ) ======<br /> &lt;br /&gt;<br /> Each queue in the system has a set of message ids currently in the queue. The list is sorted based on a ranking which is incremented atomically using the counter(MESSAGE_RANK_COUNTER_SUFFIX) also stored in the database for every queue.<br /> &lt;br /&gt;<br /> <br /> ====== Messages(Redis Hash) ======<br /> &lt;br /&gt;<br /> <br /> Each message is stored using the UUID of the message as the redis key. The datastructure has the following information. <br /> &lt;br /&gt;<br /> NOTE: This datastructure is serialized using msgpack.<br /> &lt;br /&gt;<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | id || id<br /> |-<br /> | created iso || cr_iso<br /> |-<br /> | ttl || t<br /> |-<br /> | expires || e<br /> |-<br /> | body || b<br /> |-<br /> | claim || c<br /> |-<br /> | claim expiry time || c.e<br /> |-<br /> | client uuid || u<br /> |-<br /> | created time || cr<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== Queue Controller ====<br /> &lt;br /&gt;<br /> <br /> Queues are scoped by project, which is prefixed to the queue name.<br /> <br /> ===== Data Organization =====<br /> <br /> ====== Queues ( Redis Sorted Set ) ======<br /> &lt;br /&gt;<br /> Id: queues_set<br /> &lt;br /&gt;<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | name || &lt;project-id.queue-name&gt;<br /> |}<br /> The set helps faster existence checks, while the list helps paginated retrieval of queues.<br /> &lt;br /&gt;<br /> <br /> ====== Queue Information (Redis Hash) ======<br /> &lt;br /&gt;<br /> <br /> This Data structure holds all meta information about a queue.<br /> &lt;br /&gt;<br /> <br /> Scope: &lt;project-id_q-name&gt;<br /> <br /> &lt;br /&gt;<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | count(size) || c<br /> |-<br /> | claimed || cl<br /> |-<br /> | metadata || m<br /> |-<br /> | creation time || t<br /> |}<br /> <br /> ==== Claims Controller ====<br /> &lt;br /&gt;<br /> <br /> ===== Data Organization =====<br /> <br /> ======Claims list ( Redis Set ) ======<br /> <br /> contains claim ids active for a queue.<br /> &lt;br /&gt;<br /> <br /> Redis ID: &lt;project-id_q-name&gt;<br /> &lt;br /&gt;<br /> <br /> ====== Claim info(Redis Hash) ======<br /> &lt;br /&gt;<br /> <br /> Contains the metadata information for a particular claim.<br /> &lt;br /&gt;<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | ttl || t<br /> |-<br /> | grace || g<br /> |-<br /> | id || if<br /> |-<br /> | claim || c<br /> |-<br /> | client UUID || u<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== Catalogue Controller ====<br /> TBD<br /> &lt;br /&gt;<br /> <br /> <br /> ==== Pools Controller ====<br /> TBD<br /> &lt;br /&gt;<br /> <br /> === Current Status ===<br /> <br /> The basic driver is a &quot;Work in Progress&quot; and is expected to be a part of the code base by Juno-3 deadline (Sept 4th 2014). The clustering and persistence extension is expected to be developed before the end of Kilo. It is also one of the requirements for the graduation of Marconi.<br /> <br /> === Blueprints ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint URL !! Functionality<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative] || Redis as an alternative driver for MongoDB<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver] || Redis Storage Driver for Marconi<br /> |}<br /> <br /> === Submitted Patches ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Patch URL !! Implemented Feature<br /> |-<br /> | [https://review.openstack.org/#/c/97178/] || Messages and Queue Controllers<br /> |-<br /> | [https://review.openstack.org/104055] || Claims Controller<br /> |-<br /> | [https://review.openstack.org/#/c/104058/] || Pools and Catalog Controllers<br /> |}<br /> <br /> === Future Work ===<br /> 1. Support Async connections to the redis database.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=Redis_Storage_Driver_Design_(Zaqar)&diff=60140 2014-08-09T05:08:01Z

<p>Prashanthr: </p> <hr /> <div>=== Objective ===<br /> <br /> Redis is an in memory key-value datastore which can organize data as strings, hashes, lists, sets, sorted sets, bitmaps and hyperloglogs. Being In-memory makes it in ideal candidate for high load, low latency messages. <br /> <br /> The main use cases of the driver are listed below:<br /> <br /> 1. High-throughput (2K+ messages/sec per queue)&lt;br /&gt;<br /> <br /> 2. Lots of small messages (&lt;= 1K)&lt;br /&gt;<br /> <br /> 3. Messages are short-lived (minutes, not hours)&lt;br /&gt;<br /> <br /> 4. High durability is optional (2 copies, RAM only)&lt;br /&gt;<br /> <br /> 5. HA is still very important&lt;br /&gt;<br /> <br /> <br /> === Components of the basic driver ===<br /> <br /> The basic driver includes support for a single instance redis store as a data backend. <br /> &lt;br /&gt;<br /> <br /> The driver supports 6 main required functions of a marconi storage driver which are:<br /> <br /> ==== Message Controller ====<br /> Helps organize messages scoped by every queue.<br /> &lt;br /&gt;<br /> ===== Organization of Data =====<br /> Message id's list ( Redis Sorted Set )<br /> &lt;br /&gt;<br /> Each queue in the system has a set of message ids currently in the queue. The list is sorted based on a ranking which is incremented atomically using the counter(MESSAGE_RANK_COUNTER_SUFFIX) also stored in the database for every queue.<br /> &lt;br /&gt;<br /> <br /> Messages(Redis Hash):<br /> &lt;br /&gt;<br /> <br /> Each message is stored using the UUID of the message as the redis key. The datastructure has the following information. <br /> &lt;br /&gt;<br /> NOTE: This datastructure is serialized using msgpack.<br /> &lt;br /&gt;<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | id || id<br /> |-<br /> | created iso || cr_iso<br /> |-<br /> | ttl || t<br /> |-<br /> | expires || e<br /> |-<br /> | body || b<br /> |-<br /> | claim || c<br /> |-<br /> | claim expiry time || c.e<br /> |-<br /> | client uuid || u<br /> |-<br /> | created time || cr<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== Queue Controller ====<br /> &lt;br /&gt;<br /> <br /> Queues are scoped by project, which is prefixed to the queue name.<br /> <br /> Queues ( Redis Sorted Set ):<br /> &lt;br /&gt;<br /> Id: queues_set<br /> &lt;br /&gt;<br /> <br /> Id <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | name || &lt;project-id.queue-name&gt;<br /> |}<br /> The set helps faster existence checks, while the list helps paginated retrieval of queues.<br /> &lt;br /&gt;<br /> <br /> Queue Information (Redis Hash):<br /> &lt;br /&gt;<br /> <br /> This Data structure holds all meta information about a queue.<br /> &lt;br /&gt;<br /> <br /> Scope: &lt;project-id_q-name&gt;<br /> <br /> &lt;br /&gt;<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | count(size) || c<br /> |-<br /> | claimed || cl<br /> |-<br /> | metadata || m<br /> |-<br /> | creation time || t<br /> |}<br /> <br /> ==== Claims Controller ====<br /> &lt;br /&gt;<br /> <br /> Claims list ( Redis Set ) contains claim ids active for a queue.<br /> &lt;br /&gt;<br /> <br /> Redis ID: &lt;project-id_q-name&gt;<br /> &lt;br /&gt;<br /> <br /> Claim info(Redis Hash):<br /> &lt;br /&gt;<br /> <br /> Contains the metadata information for a particular claim.<br /> &lt;br /&gt;<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | ttl || t<br /> |-<br /> | grace || g<br /> |-<br /> | id || if<br /> |-<br /> | claim || c<br /> |-<br /> | client UUID || u<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== Catalogue Controller ====<br /> TBD<br /> &lt;br /&gt;<br /> <br /> <br /> ==== Pools Controller ====<br /> TBD<br /> &lt;br /&gt;<br /> <br /> === Current Status ===<br /> <br /> The basic driver is a &quot;Work in Progress&quot; and is expected to be a part of the code base by Juno-3 deadline (Sept 4th 2014). The clustering and persistence extension is expected to be developed before the end of Kilo. It is also one of the requirements for the graduation of Marconi.<br /> <br /> === Blueprints ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint URL !! Functionality<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative] || Redis as an alternative driver for MongoDB<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver] || Redis Storage Driver for Marconi<br /> |}<br /> <br /> === Submitted Patches ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Patch URL !! Implemented Feature<br /> |-<br /> | [https://review.openstack.org/#/c/97178/] || Messages and Queue Controllers<br /> |-<br /> | [https://review.openstack.org/104055] || Claims Controller<br /> |-<br /> | [https://review.openstack.org/#/c/104058/] || Pools and Catalog Controllers<br /> |}<br /> <br /> ==== Future Work ====<br /> 1. Support Async connections to the redis database.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=Redis_Storage_Driver_Design_(Zaqar)&diff=60139 2014-08-09T05:04:42Z

<p>Prashanthr: /* Current Status */</p> <hr /> <div>=== Objective ===<br /> <br /> Redis is an in memory key-value datastore which can organize data as strings, hashes, lists, sets, sorted sets, bitmaps and hyperloglogs. Being In-memory makes it in ideal candidate for high load, low latency messages. <br /> <br /> The main use cases of the driver are listed below:<br /> <br /> 1. High-throughput (2K+ messages/sec per queue)&lt;br /&gt;<br /> <br /> 2. Lots of small messages (&lt;= 1K)&lt;br /&gt;<br /> <br /> 3. Messages are short-lived (minutes, not hours)&lt;br /&gt;<br /> <br /> 4. High durability is optional (2 copies, RAM only)&lt;br /&gt;<br /> <br /> 5. HA is still very important&lt;br /&gt;<br /> <br /> <br /> === Components of the basic driver ===<br /> <br /> The basic driver includes support for a single instance redis store as a data backend. <br /> &lt;br /&gt;<br /> <br /> The driver supports 6 main required functions of a marconi storage driver which are:<br /> <br /> ==== Message Controller ====<br /> Helps organize messages scoped by every queue.<br /> &lt;br /&gt;<br /> ===== Organization of Data =====<br /> Message id's list ( Redis Sorted Set )<br /> &lt;br /&gt;<br /> Each queue in the system has a set of message ids currently in the queue. The list is sorted based on a ranking which is incremented atomically using the counter(MESSAGE_RANK_COUNTER_SUFFIX) also stored in the database for every queue.<br /> &lt;br /&gt;<br /> <br /> Messages(Redis Hash):<br /> &lt;br /&gt;<br /> <br /> Each message is stored using the UUID of the message as the redis key. The datastructure has the following information. <br /> &lt;br /&gt;<br /> NOTE: This datastructure is serialized using msgpack.<br /> &lt;br /&gt;<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | id || id<br /> |-<br /> | created iso || cr_iso<br /> |-<br /> | ttl || t<br /> |-<br /> | expires || e<br /> |-<br /> | body || b<br /> |-<br /> | claim || c<br /> |-<br /> | claim expiry time || c.e<br /> |-<br /> | client uuid || u<br /> |-<br /> | created time || cr<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== Queue Controller ====<br /> &lt;br /&gt;<br /> <br /> Queues are scoped by project, which is prefixed to the queue name.<br /> <br /> Queues ( Redis Sorted Set ):<br /> &lt;br /&gt;<br /> Id: queues_set<br /> &lt;br /&gt;<br /> <br /> Id <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | name || &lt;project-id.queue-name&gt;<br /> |}<br /> The set helps faster existence checks, while the list helps paginated retrieval of queues.<br /> &lt;br /&gt;<br /> <br /> Queue Information (Redis Hash):<br /> &lt;br /&gt;<br /> <br /> This Data structure holds all meta information about a queue.<br /> &lt;br /&gt;<br /> <br /> Scope: &lt;project-id_q-name&gt;<br /> <br /> &lt;br /&gt;<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | count(size) || c<br /> |-<br /> | claimed || cl<br /> |-<br /> | metadata || m<br /> |-<br /> | creation time || t<br /> |}<br /> <br /> ==== Claims Controller ====<br /> &lt;br /&gt;<br /> <br /> Claims list ( Redis Set ) contains claim ids active for a queue.<br /> &lt;br /&gt;<br /> <br /> Redis ID: &lt;project-id_q-name&gt;<br /> &lt;br /&gt;<br /> <br /> Claim info(Redis Hash):<br /> &lt;br /&gt;<br /> <br /> Contains the metadata information for a particular claim.<br /> &lt;br /&gt;<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | ttl || t<br /> |-<br /> | grace || g<br /> |-<br /> | id || if<br /> |-<br /> | claim || c<br /> |-<br /> | client UUID || u<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== Catalogue Controller ====<br /> TBD<br /> &lt;br /&gt;<br /> <br /> <br /> ==== Pools Controller ====<br /> TBD<br /> &lt;br /&gt;<br /> <br /> === Current Status ===<br /> <br /> The basic driver is a &quot;Work in Progress&quot; and is expected to be a part of the code base by Juno-3 deadline (Sept 4th 2014). The clustering and persistence extension is expected to be developed before the end of Kilo. It is also one of the requirements for the graduation of Marconi.<br /> <br /> === Blueprints ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint URL !! Functionality<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative] || Redis as an alternative driver for MongoDB<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver] || Redis Storage Driver for Marconi<br /> |}<br /> <br /> === Submitted Patches ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Patch URL !! Implemented Feature<br /> |-<br /> | [https://review.openstack.org/#/c/97178/] || Messages and Queue Controllers<br /> |-<br /> | [https://review.openstack.org/104055] || Claims Controller<br /> |-<br /> | [https://review.openstack.org/#/c/104058/] || Pools and Catalog Controllers<br /> |}</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=Redis_Storage_Driver_Design_(Zaqar)&diff=60138 2014-08-09T05:03:40Z

<p>Prashanthr: /* Components of the basic driver */</p> <hr /> <div>=== Objective ===<br /> <br /> Redis is an in memory key-value datastore which can organize data as strings, hashes, lists, sets, sorted sets, bitmaps and hyperloglogs. Being In-memory makes it in ideal candidate for high load, low latency messages. <br /> <br /> The main use cases of the driver are listed below:<br /> <br /> 1. High-throughput (2K+ messages/sec per queue)&lt;br /&gt;<br /> <br /> 2. Lots of small messages (&lt;= 1K)&lt;br /&gt;<br /> <br /> 3. Messages are short-lived (minutes, not hours)&lt;br /&gt;<br /> <br /> 4. High durability is optional (2 copies, RAM only)&lt;br /&gt;<br /> <br /> 5. HA is still very important&lt;br /&gt;<br /> <br /> <br /> === Components of the basic driver ===<br /> <br /> The basic driver includes support for a single instance redis store as a data backend. <br /> &lt;br /&gt;<br /> <br /> The driver supports 6 main required functions of a marconi storage driver which are:<br /> <br /> ==== Message Controller ====<br /> Helps organize messages scoped by every queue.<br /> &lt;br /&gt;<br /> ===== Organization of Data =====<br /> Message id's list ( Redis Sorted Set )<br /> &lt;br /&gt;<br /> Each queue in the system has a set of message ids currently in the queue. The list is sorted based on a ranking which is incremented atomically using the counter(MESSAGE_RANK_COUNTER_SUFFIX) also stored in the database for every queue.<br /> &lt;br /&gt;<br /> <br /> Messages(Redis Hash):<br /> &lt;br /&gt;<br /> <br /> Each message is stored using the UUID of the message as the redis key. The datastructure has the following information. <br /> &lt;br /&gt;<br /> NOTE: This datastructure is serialized using msgpack.<br /> &lt;br /&gt;<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | id || id<br /> |-<br /> | created iso || cr_iso<br /> |-<br /> | ttl || t<br /> |-<br /> | expires || e<br /> |-<br /> | body || b<br /> |-<br /> | claim || c<br /> |-<br /> | claim expiry time || c.e<br /> |-<br /> | client uuid || u<br /> |-<br /> | created time || cr<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== Queue Controller ====<br /> &lt;br /&gt;<br /> <br /> Queues are scoped by project, which is prefixed to the queue name.<br /> <br /> Queues ( Redis Sorted Set ):<br /> &lt;br /&gt;<br /> Id: queues_set<br /> &lt;br /&gt;<br /> <br /> Id <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | name || &lt;project-id.queue-name&gt;<br /> |}<br /> The set helps faster existence checks, while the list helps paginated retrieval of queues.<br /> &lt;br /&gt;<br /> <br /> Queue Information (Redis Hash):<br /> &lt;br /&gt;<br /> <br /> This Data structure holds all meta information about a queue.<br /> &lt;br /&gt;<br /> <br /> Scope: &lt;project-id_q-name&gt;<br /> <br /> &lt;br /&gt;<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | count(size) || c<br /> |-<br /> | claimed || cl<br /> |-<br /> | metadata || m<br /> |-<br /> | creation time || t<br /> |}<br /> <br /> ==== Claims Controller ====<br /> &lt;br /&gt;<br /> <br /> Claims list ( Redis Set ) contains claim ids active for a queue.<br /> &lt;br /&gt;<br /> <br /> Redis ID: &lt;project-id_q-name&gt;<br /> &lt;br /&gt;<br /> <br /> Claim info(Redis Hash):<br /> &lt;br /&gt;<br /> <br /> Contains the metadata information for a particular claim.<br /> &lt;br /&gt;<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | ttl || t<br /> |-<br /> | grace || g<br /> |-<br /> | id || if<br /> |-<br /> | claim || c<br /> |-<br /> | client UUID || u<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== Catalogue Controller ====<br /> TBD<br /> &lt;br /&gt;<br /> <br /> <br /> ==== Pools Controller ====<br /> TBD<br /> &lt;br /&gt;<br /> <br /> === Current Status ===<br /> <br /> The basic driver is a &quot;Work in Progress&quot; and is expected to be a part of the code base by Juno-3 deadline (Sept 4th 2014). The clustering and persistence extension is expected to be developed before the end of Kilo.<br /> <br /> === Blueprints ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint URL !! Functionality<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative] || Redis as an alternative driver for MongoDB<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver] || Redis Storage Driver for Marconi<br /> |}<br /> <br /> === Submitted Patches ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Patch URL !! Implemented Feature<br /> |-<br /> | [https://review.openstack.org/#/c/97178/] || Messages and Queue Controllers<br /> |-<br /> | [https://review.openstack.org/104055] || Claims Controller<br /> |-<br /> | [https://review.openstack.org/#/c/104058/] || Pools and Catalog Controllers<br /> |}</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=Redis_Storage_Driver_Design_(Zaqar)&diff=60137 2014-08-09T04:50:42Z

<p>Prashanthr: /* Organization of Data */</p> <hr /> <div>=== Objective ===<br /> <br /> Redis is an in memory key-value datastore which can organize data as strings, hashes, lists, sets, sorted sets, bitmaps and hyperloglogs. Being In-memory makes it in ideal candidate for high load, low latency messages. <br /> <br /> The main use cases of the driver are listed below:<br /> <br /> 1. High-throughput (2K+ messages/sec per queue)&lt;br /&gt;<br /> <br /> 2. Lots of small messages (&lt;= 1K)&lt;br /&gt;<br /> <br /> 3. Messages are short-lived (minutes, not hours)&lt;br /&gt;<br /> <br /> 4. High durability is optional (2 copies, RAM only)&lt;br /&gt;<br /> <br /> 5. HA is still very important&lt;br /&gt;<br /> <br /> <br /> === Components of the basic driver ===<br /> <br /> The basic driver includes support for a single instance redis store as a data backend. <br /> &lt;br /&gt;<br /> <br /> The driver supports 6 main required functions of a marconi storage driver which are:<br /> <br /> ==== Message Controllers ====<br /> Helps organize messages scoped by every queue.<br /> &lt;br /&gt;<br /> ===== Organization of Data =====<br /> Message id's list ( Redis Sorted Set )<br /> &lt;br /&gt;<br /> Each queue in the system has a set of message ids currently in the queue. The list is sorted based on a ranking which is incremented atomically using the counter(MESSAGE_RANK_COUNTER_SUFFIX) also stored in the database for every queue.<br /> &lt;br /&gt;<br /> <br /> Messages(Redis Hash):<br /> &lt;br /&gt;<br /> <br /> Each message is stored using the UUID of the message as the redis key. The datastructure has the following information.<br /> &lt;br /&gt;<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | id || id<br /> |-<br /> | created iso || cr_iso<br /> |-<br /> | ttl || t<br /> |-<br /> | expires || e<br /> |-<br /> | body || b<br /> |-<br /> | claim || c<br /> |-<br /> | claim expiry time || c.e<br /> |-<br /> | client uuid || u<br /> |-<br /> | created time || cr<br /> |}<br /> &lt;br /&gt;<br /> <br /> 2. Queue Controller&lt;br /&gt;<br /> <br /> 3. Claims Controller&lt;br /&gt;<br /> <br /> 4. Catalogue Controller&lt;br /&gt;<br /> <br /> 5. Pools Controller&lt;br /&gt;<br /> <br /> 2. Queue Controller<br /> 3. Claims Controller<br /> 4. Catalogue Controller<br /> 5. Pools Controller<br /> <br /> === Current Status ===<br /> <br /> The basic driver is a &quot;Work in Progress&quot; and is expected to be a part of the code base by Juno-3 deadline (Sept 4th 2014). The clustering and persistence extension is expected to be developed before the end of Kilo.<br /> <br /> === Blueprints ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint URL !! Functionality<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative] || Redis as an alternative driver for MongoDB<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver] || Redis Storage Driver for Marconi<br /> |}<br /> <br /> === Submitted Patches ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Patch URL !! Implemented Feature<br /> |-<br /> | [https://review.openstack.org/#/c/97178/] || Messages and Queue Controllers<br /> |-<br /> | [https://review.openstack.org/104055] || Claims Controller<br /> |-<br /> | [https://review.openstack.org/#/c/104058/] || Pools and Catalog Controllers<br /> |}</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=Redis_Storage_Driver_Design_(Zaqar)&diff=60136 2014-08-09T04:49:04Z

<p>Prashanthr: /* Organization of Data */</p> <hr /> <div>=== Objective ===<br /> <br /> Redis is an in memory key-value datastore which can organize data as strings, hashes, lists, sets, sorted sets, bitmaps and hyperloglogs. Being In-memory makes it in ideal candidate for high load, low latency messages. <br /> <br /> The main use cases of the driver are listed below:<br /> <br /> 1. High-throughput (2K+ messages/sec per queue)&lt;br /&gt;<br /> <br /> 2. Lots of small messages (&lt;= 1K)&lt;br /&gt;<br /> <br /> 3. Messages are short-lived (minutes, not hours)&lt;br /&gt;<br /> <br /> 4. High durability is optional (2 copies, RAM only)&lt;br /&gt;<br /> <br /> 5. HA is still very important&lt;br /&gt;<br /> <br /> <br /> === Components of the basic driver ===<br /> <br /> The basic driver includes support for a single instance redis store as a data backend. <br /> &lt;br /&gt;<br /> <br /> The driver supports 6 main required functions of a marconi storage driver which are:<br /> <br /> ==== Message Controllers ====<br /> Helps organize messages scoped by every queue.<br /> &lt;br /&gt;<br /> ===== Organization of Data =====<br /> Message id's list ( Redis Sorted Set )<br /> &lt;br /&gt;<br /> Each queue in the system has a set of message ids currently in the queue. The list is sorted based on a ranking which is incremented atomically using the counter(MESSAGE_RANK_COUNTER_SUFFIX) also stored in the database for every queue.<br /> &lt;br /&gt;<br /> <br /> Messages(Redis Hash):<br /> &lt;br /&gt;<br /> Each message is stored using the UUID of the message as the redis key. The datastructure has the following information.<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | id || id<br /> |-<br /> | created iso || cr_iso<br /> |-<br /> | ttl || t<br /> Each message is stored using the UUID of the message as the redis key. The datastructure has the following information.<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | id || id<br /> |-<br /> | created iso || cr_iso<br /> |-<br /> | ttl || t<br /> |-<br /> | expires || e<br /> |-<br /> | body || b<br /> |-<br /> | claim || c<br /> |-<br /> | claim expiry time || c.e<br /> |-<br /> | client uuid || u<br /> |-<br /> | created time || cr<br /> |}<br /> &lt;br /&gt;<br /> <br /> 2. Queue Controller&lt;br /&gt;<br /> <br /> 3. Claims Controller&lt;br /&gt;<br /> <br /> 4. Catalogue Controller&lt;br /&gt;<br /> <br /> 5. Pools Controller&lt;br /&gt;<br /> <br /> <br /> |-<br /> | expires || e<br /> |-<br /> | body || b<br /> |-<br /> | claim || c<br /> |-<br /> | claim expiry time || c.e<br /> |-<br /> | client uuid || u<br /> |-<br /> | created time || cr<br /> |}<br /> <br /> 2. Queue Controller<br /> 3. Claims Controller<br /> 4. Catalogue Controller<br /> 5. Pools Controller<br /> <br /> === Current Status ===<br /> <br /> The basic driver is a &quot;Work in Progress&quot; and is expected to be a part of the code base by Juno-3 deadline (Sept 4th 2014). The clustering and persistence extension is expected to be developed before the end of Kilo.<br /> <br /> === Blueprints ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint URL !! Functionality<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative] || Redis as an alternative driver for MongoDB<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver] || Redis Storage Driver for Marconi<br /> |}<br /> <br /> === Submitted Patches ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Patch URL !! Implemented Feature<br /> |-<br /> | [https://review.openstack.org/#/c/97178/] || Messages and Queue Controllers<br /> |-<br /> | [https://review.openstack.org/104055] || Claims Controller<br /> |-<br /> | [https://review.openstack.org/#/c/104058/] || Pools and Catalog Controllers<br /> |}</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=Redis_Storage_Driver_Design_(Zaqar)&diff=60135 2014-08-09T04:48:27Z

<p>Prashanthr: /* Components of the basic driver */</p> <hr /> <div>=== Objective ===<br /> <br /> Redis is an in memory key-value datastore which can organize data as strings, hashes, lists, sets, sorted sets, bitmaps and hyperloglogs. Being In-memory makes it in ideal candidate for high load, low latency messages. <br /> <br /> The main use cases of the driver are listed below:<br /> <br /> 1. High-throughput (2K+ messages/sec per queue)&lt;br /&gt;<br /> <br /> 2. Lots of small messages (&lt;= 1K)&lt;br /&gt;<br /> <br /> 3. Messages are short-lived (minutes, not hours)&lt;br /&gt;<br /> <br /> 4. High durability is optional (2 copies, RAM only)&lt;br /&gt;<br /> <br /> 5. HA is still very important&lt;br /&gt;<br /> <br /> <br /> === Components of the basic driver ===<br /> <br /> The basic driver includes support for a single instance redis store as a data backend. <br /> &lt;br /&gt;<br /> <br /> The driver supports 6 main required functions of a marconi storage driver which are:<br /> <br /> ==== Message Controllers ====<br /> Helps organize messages scoped by every queue.<br /> &lt;br /&gt;<br /> ===== Organization of Data =====<br /> Message id's list ( Redis Sorted Set )<br /> &lt;br /&gt;<br /> Each queue in the system has a set of message ids currently in the queue. The list is sorted based on a ranking which is incremented atomically using the counter(MESSAGE_RANK_COUNTER_SUFFIX) also stored in the database for every queue.<br /> <br /> Messages(Redis Hash):<br /> Each message is stored using the UUID of the message as the redis key. The datastructure has the following information.<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Name !! Field<br /> |-<br /> | id || id<br /> |-<br /> | created iso || cr_iso<br /> |-<br /> | ttl || t<br /> |-<br /> | expires || e<br /> |-<br /> | body || b<br /> |-<br /> | claim || c<br /> |-<br /> | claim expiry time || c.e<br /> |-<br /> | client uuid || u<br /> |-<br /> | created time || cr<br /> |}<br /> <br /> 2. Queue Controller<br /> 3. Claims Controller<br /> 4. Catalogue Controller<br /> 5. Pools Controller<br /> <br /> === Current Status ===<br /> <br /> The basic driver is a &quot;Work in Progress&quot; and is expected to be a part of the code base by Juno-3 deadline (Sept 4th 2014). The clustering and persistence extension is expected to be developed before the end of Kilo.<br /> <br /> === Blueprints ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint URL !! Functionality<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative] || Redis as an alternative driver for MongoDB<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver] || Redis Storage Driver for Marconi<br /> |}<br /> <br /> === Submitted Patches ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Patch URL !! Implemented Feature<br /> |-<br /> | [https://review.openstack.org/#/c/97178/] || Messages and Queue Controllers<br /> |-<br /> | [https://review.openstack.org/104055] || Claims Controller<br /> |-<br /> | [https://review.openstack.org/#/c/104058/] || Pools and Catalog Controllers<br /> |}</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=Redis_Storage_Driver_Design_(Zaqar)&diff=60134 2014-08-09T04:37:51Z

<p>Prashanthr: /* Current Status */</p> <hr /> <div>=== Objective ===<br /> <br /> Redis is an in memory key-value datastore which can organize data as strings, hashes, lists, sets, sorted sets, bitmaps and hyperloglogs. Being In-memory makes it in ideal candidate for high load, low latency messages. <br /> <br /> The main use cases of the driver are listed below:<br /> <br /> 1. High-throughput (2K+ messages/sec per queue)&lt;br /&gt;<br /> <br /> 2. Lots of small messages (&lt;= 1K)&lt;br /&gt;<br /> <br /> 3. Messages are short-lived (minutes, not hours)&lt;br /&gt;<br /> <br /> 4. High durability is optional (2 copies, RAM only)&lt;br /&gt;<br /> <br /> 5. HA is still very important&lt;br /&gt;<br /> <br /> <br /> === Components of the basic driver ===<br /> <br /> <br /> === Current Status ===<br /> <br /> The basic driver is a &quot;Work in Progress&quot; and is expected to be a part of the code base by Juno-3 deadline (Sept 4th 2014). The clustering and persistence extension is expected to be developed before the end of Kilo.<br /> <br /> === Blueprints ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint URL !! Functionality<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative] || Redis as an alternative driver for MongoDB<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver] || Redis Storage Driver for Marconi<br /> |}<br /> <br /> === Submitted Patches ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Patch URL !! Implemented Feature<br /> |-<br /> | [https://review.openstack.org/#/c/97178/] || Messages and Queue Controllers<br /> |-<br /> | [https://review.openstack.org/104055] || Claims Controller<br /> |-<br /> | [https://review.openstack.org/#/c/104058/] || Pools and Catalog Controllers<br /> |}</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=Redis_Storage_Driver_Design_(Zaqar)&diff=60133 2014-08-09T04:35:57Z

<p>Prashanthr: /* Blueprints */</p> <hr /> <div>=== Objective ===<br /> <br /> Redis is an in memory key-value datastore which can organize data as strings, hashes, lists, sets, sorted sets, bitmaps and hyperloglogs. Being In-memory makes it in ideal candidate for high load, low latency messages. <br /> <br /> The main use cases of the driver are listed below:<br /> <br /> 1. High-throughput (2K+ messages/sec per queue)&lt;br /&gt;<br /> <br /> 2. Lots of small messages (&lt;= 1K)&lt;br /&gt;<br /> <br /> 3. Messages are short-lived (minutes, not hours)&lt;br /&gt;<br /> <br /> 4. High durability is optional (2 copies, RAM only)&lt;br /&gt;<br /> <br /> 5. HA is still very important&lt;br /&gt;<br /> <br /> <br /> === Components of the basic driver ===<br /> <br /> <br /> === Current Status ===<br /> <br /> <br /> === Blueprints ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint URL !! Functionality<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative] || Redis as an alternative driver for MongoDB<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver] || Redis Storage Driver for Marconi<br /> |}<br /> <br /> === Submitted Patches ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Patch URL !! Implemented Feature<br /> |-<br /> | [https://review.openstack.org/#/c/97178/] || Messages and Queue Controllers<br /> |-<br /> | [https://review.openstack.org/104055] || Claims Controller<br /> |-<br /> | [https://review.openstack.org/#/c/104058/] || Pools and Catalog Controllers<br /> |}</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=Redis_Storage_Driver_Design_(Zaqar)&diff=60132 2014-08-09T04:30:35Z

<p>Prashanthr: /* Submitted Patches */</p> <hr /> <div>=== Objective ===<br /> <br /> Redis is an in memory key-value datastore which can organize data as strings, hashes, lists, sets, sorted sets, bitmaps and hyperloglogs. Being In-memory makes it in ideal candidate for high load, low latency messages. <br /> <br /> The main use cases of the driver are listed below:<br /> <br /> 1. High-throughput (2K+ messages/sec per queue)&lt;br /&gt;<br /> <br /> 2. Lots of small messages (&lt;= 1K)&lt;br /&gt;<br /> <br /> 3. Messages are short-lived (minutes, not hours)&lt;br /&gt;<br /> <br /> 4. High durability is optional (2 copies, RAM only)&lt;br /&gt;<br /> <br /> 5. HA is still very important&lt;br /&gt;<br /> <br /> <br /> === Components of the basic driver ===<br /> <br /> <br /> === Current Status ===<br /> <br /> <br /> === Blueprints ===<br /> <br /> <br /> === Submitted Patches ===<br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Patch URL !! Implemented Feature<br /> |-<br /> | [https://review.openstack.org/#/c/97178/] || Messages and Queue Controllers<br /> |-<br /> | [https://review.openstack.org/104055] || Claims Controller<br /> |-<br /> | [https://review.openstack.org/#/c/104058/] || Pools and Catalog Controllers<br /> |}</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=Redis_Storage_Driver_Design_(Zaqar)&diff=60131 2014-08-09T04:27:51Z

<p>Prashanthr: </p> <hr /> <div>=== Objective ===<br /> <br /> Redis is an in memory key-value datastore which can organize data as strings, hashes, lists, sets, sorted sets, bitmaps and hyperloglogs. Being In-memory makes it in ideal candidate for high load, low latency messages. <br /> <br /> The main use cases of the driver are listed below:<br /> <br /> 1. High-throughput (2K+ messages/sec per queue)&lt;br /&gt;<br /> <br /> 2. Lots of small messages (&lt;= 1K)&lt;br /&gt;<br /> <br /> 3. Messages are short-lived (minutes, not hours)&lt;br /&gt;<br /> <br /> 4. High durability is optional (2 copies, RAM only)&lt;br /&gt;<br /> <br /> 5. HA is still very important&lt;br /&gt;<br /> <br /> <br /> === Components of the basic driver ===<br /> <br /> <br /> === Current Status ===<br /> <br /> <br /> === Blueprints ===<br /> <br /> <br /> === Submitted Patches ===</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=Redis_Storage_Driver_Design_(Zaqar)&diff=60130 2014-08-09T04:27:09Z

<p>Prashanthr: </p> <hr /> <div>=== Objective ===<br /> <br /> Redis is an in memory key-value datastore which can organize data as strings, hashes, lists, sets, sorted sets, bitmaps and hyperloglogs. Being In-memory makes it in ideal candidate for high load, low latency messages. <br /> <br /> The main use cases of the driver are listed below:<br /> <br /> 1. High-throughput (2K+ messages/sec per queue)<br /> 2. Lots of small messages (&lt;= 1K)<br /> 3. Messages are short-lived (minutes, not hours)<br /> 4. High durability is optional (2 copies, RAM only)<br /> 5. HA is still very important<br /> <br /> === Components of the basic driver ===<br /> <br /> <br /> === Current Status ===<br /> <br /> <br /> === Blueprints ===<br /> <br /> <br /> === Submitted Patches ===</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=60126 2014-08-09T00:31:59Z

<p>Prashanthr: </p> <hr /> <div>&lt;br /&gt;<br /> <br /> ==== About Me ====<br /> &lt;br /&gt;<br /> <br /> Hi, This is Prashanth Raghu a Masters by computing student at the National University of Singapore. I worked as an IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before proceeding to Singapore. I completed my undergraduation in Computer Science from PES Institute of Technology, Bangalore. During my master's program, I was selected to be a part of the Marconi(now known as Zaqar) team for the Google Summer of Code'14 with Fei Long Wang and Alejandro Cabrera as my assigned mentors.<br /> <br /> As a part of this program I am currently developing a reliable and persistant redis backend store to support the messaging API. This driver aims to be a primary alternative for the currently bundled mongodb driver which is limited by AGPL requirements. The driver is under active development and a single redis instance storage backend is expected to be fully functional at the end of August'14. This driver will be extended to support redis clusters to provide reliability and persistence to the user data.<br /> <br /> My other open source interests include Jquery, python and wikipedia editing.On wikipedia I actively contribute towards Sports, Indian Cinema &amp; Politics and Music.<br /> <br /> Python and javascript are the two tools of my coding armory raring to go out to find and hack interesting problems. You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> &lt;br /&gt;<br /> <br /> ==== Blueprints I currently work on ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver Redis Storage Driver]<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative MongoDB alternate]<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== My Wishlist ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/oslo/+spec/cache-redis-backend Oslo Redis Cache backend]<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== Design Document for the Redis Driver ====<br /> https://wiki.openstack.org/wiki/Redis_Storage_Driver_Design_(Zaqar)<br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Some Additional Information: ====<br /> <br /> 1. Google Summer of Code Proposal ( Prashanth Raghu ) 2014 - [https://github.com/PrashanthRaghu/prashanthraghu.github.io/blob/master/GSOC2014Proposal-PrashanthRaghu-Final.pdf?raw=true Download]. Feel free to download it if you need it as a reference for your proposals.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=60097 2014-08-08T15:12:34Z

<p>Prashanthr: /* About Me */</p> <hr /> <div>&lt;br /&gt;<br /> <br /> ==== About Me ====<br /> &lt;br /&gt;<br /> <br /> Hi, This is Prashanth Raghu a Masters by computing student at the National University of Singapore. I worked as a IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before proceeding to Singapore. I completed my undergraduation in Computer Science PES Institute of Technology, Bangalore. During my master's program, I was selected to be a part of the Marconi(now known as Zaqar) team for the Google Summer of Code'14 with Fei Long Wang and Alejandro Cabrera as my assigned mentors.<br /> <br /> As a part of this program I am currently developing a reliable and persistant redis backend store to support the messaging API. This driver aims to be a primary alternative for the currently bundled mongodb driver which is limited by AGPL requirements. The driver is under active development and a single redis instance storage backend is expected to be fully functional at the end of August'14. This driver will be extended to support redis clusters to provide reliability and persistence to the user data.<br /> <br /> My other open source interests include Jquery, python and wikipedia editing.On wikipedia I actively contribute towards Sports, Indian Cinema &amp; Politics and Music.<br /> <br /> Python and javascript are the two tools of my coding armory raring to go out to find and hack interesting problems. You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> &lt;br /&gt;<br /> <br /> ==== Blueprints I currently work on ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver Redis Storage Driver]<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative MongoDB alternate]<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== My Wishlist ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/oslo/+spec/cache-redis-backend Oslo Redis Cache backend]<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== Design Document for the Redis Driver ====<br /> https://wiki.openstack.org/wiki/Redis_Storage_Driver_Design_(Zaqar)<br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Some Additional Information: ====<br /> <br /> 1. Google Summer of Code Proposal ( Prashanth Raghu ) 2014 - [https://github.com/PrashanthRaghu/prashanthraghu.github.io/blob/master/GSOC2014Proposal-PrashanthRaghu-Final.pdf?raw=true Download]. Feel free to download it if you need it as a reference for your proposals.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=60096 2014-08-08T15:11:24Z

<p>Prashanthr: /* About Me */</p> <hr /> <div>&lt;br /&gt;<br /> <br /> ==== About Me ====<br /> &lt;br /&gt;<br /> <br /> Hi, This is Prashanth Raghu a Masters by computing student at the National University of Singapore. I worked as a IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before proceeding to Singapore. I completed bachelor's in engineering from PES Institute of Technology, Bangalore. I was selected to be a part of the Marconi(now known as Zaqar) team for the Google Summer of Code'14 with Fei Long Wang and Alejandro Cabrera as my assigned mentors.<br /> <br /> As a part of this program I am currently developing a reliable and persistant redis backend store to support the messaging API. This driver aims to be a primary alternative for the currently bundled mongodb driver which is limited by AGPL requirements. The driver is under active development and a single redis instance storage backend is expected to be fully functional at the end of August'14. This driver will be extended to support redis clusters to provide reliability and persistence to the user data.<br /> <br /> My other open source interests include Jquery, python and wikipedia editing.On wikipedia I actively contribute towards Sports, Indian Cinema &amp; Politics and Music.<br /> <br /> Python and javascript are the two tools of my coding armory raring to go out to find and hack interesting problems. You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> &lt;br /&gt;<br /> <br /> ==== Blueprints I currently work on ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver Redis Storage Driver]<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative MongoDB alternate]<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== My Wishlist ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/oslo/+spec/cache-redis-backend Oslo Redis Cache backend]<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== Design Document for the Redis Driver ====<br /> https://wiki.openstack.org/wiki/Redis_Storage_Driver_Design_(Zaqar)<br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Some Additional Information: ====<br /> <br /> 1. Google Summer of Code Proposal ( Prashanth Raghu ) 2014 - [https://github.com/PrashanthRaghu/prashanthraghu.github.io/blob/master/GSOC2014Proposal-PrashanthRaghu-Final.pdf?raw=true Download]. Feel free to download it if you need it as a reference for your proposals.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=60095 2014-08-08T15:11:10Z

<p>Prashanthr: /* My Wishlist */</p> <hr /> <div>&lt;br /&gt;<br /> <br /> ==== About Me ====<br /> &lt;br /&gt;<br /> <br /> Hi, This is Prashanth Raghu a Masters by computing student at the National University of Singapore. I worked as a IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before proceeding to Singapore. I completed bachelor's in engineering from PES Institute of Technology, Bangalore. I was selected to be a part of the Marconi(now known as Zaqar) team for the Google Summer of Code'14 with Fei Long Wang and Alejandro Cabrera as my assigned mentors.<br /> <br /> As a part of this program I am currently developing a reliable and persistant redis backend store to support the messaging API. This driver aims to be a primary alternative for the currently bundled mongodb driver which is limited by AGPL requirements. The driver is under active development and a single redis instance storage backend is expected to be fully functional at the end of August'14. This driver will be extended to support redis clusters to provide reliability and persistence to the user data.<br /> <br /> My other open source interests include Jquery, python and wikipedia editing.On wikipedia I actively contribute towards Sports, Indian Cinema &amp; Politics and Music.<br /> <br /> Python and javascript are the two tools of my coding armory raring to go out to find and hack interesting problems. You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Blueprints I currently work on ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver Redis Storage Driver]<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative MongoDB alternate]<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== My Wishlist ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/oslo/+spec/cache-redis-backend Oslo Redis Cache backend]<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== Design Document for the Redis Driver ====<br /> https://wiki.openstack.org/wiki/Redis_Storage_Driver_Design_(Zaqar)<br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Some Additional Information: ====<br /> <br /> 1. Google Summer of Code Proposal ( Prashanth Raghu ) 2014 - [https://github.com/PrashanthRaghu/prashanthraghu.github.io/blob/master/GSOC2014Proposal-PrashanthRaghu-Final.pdf?raw=true Download]. Feel free to download it if you need it as a reference for your proposals.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=60094 2014-08-08T15:10:56Z

<p>Prashanthr: /* Design Document for the Redis Driver */</p> <hr /> <div>&lt;br /&gt;<br /> <br /> ==== About Me ====<br /> &lt;br /&gt;<br /> <br /> Hi, This is Prashanth Raghu a Masters by computing student at the National University of Singapore. I worked as a IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before proceeding to Singapore. I completed bachelor's in engineering from PES Institute of Technology, Bangalore. I was selected to be a part of the Marconi(now known as Zaqar) team for the Google Summer of Code'14 with Fei Long Wang and Alejandro Cabrera as my assigned mentors.<br /> <br /> As a part of this program I am currently developing a reliable and persistant redis backend store to support the messaging API. This driver aims to be a primary alternative for the currently bundled mongodb driver which is limited by AGPL requirements. The driver is under active development and a single redis instance storage backend is expected to be fully functional at the end of August'14. This driver will be extended to support redis clusters to provide reliability and persistence to the user data.<br /> <br /> My other open source interests include Jquery, python and wikipedia editing.On wikipedia I actively contribute towards Sports, Indian Cinema &amp; Politics and Music.<br /> <br /> Python and javascript are the two tools of my coding armory raring to go out to find and hack interesting problems. You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Blueprints I currently work on ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver Redis Storage Driver]<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative MongoDB alternate]<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== My Wishlist ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/oslo/+spec/cache-redis-backend Oslo Redis Cache backend]<br /> |}<br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Design Document for the Redis Driver ====<br /> https://wiki.openstack.org/wiki/Redis_Storage_Driver_Design_(Zaqar)<br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Some Additional Information: ====<br /> <br /> 1. Google Summer of Code Proposal ( Prashanth Raghu ) 2014 - [https://github.com/PrashanthRaghu/prashanthraghu.github.io/blob/master/GSOC2014Proposal-PrashanthRaghu-Final.pdf?raw=true Download]. Feel free to download it if you need it as a reference for your proposals.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=60093 2014-08-08T15:10:27Z

<p>Prashanthr: </p> <hr /> <div>&lt;br /&gt;<br /> <br /> ==== About Me ====<br /> &lt;br /&gt;<br /> <br /> Hi, This is Prashanth Raghu a Masters by computing student at the National University of Singapore. I worked as a IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before proceeding to Singapore. I completed bachelor's in engineering from PES Institute of Technology, Bangalore. I was selected to be a part of the Marconi(now known as Zaqar) team for the Google Summer of Code'14 with Fei Long Wang and Alejandro Cabrera as my assigned mentors.<br /> <br /> As a part of this program I am currently developing a reliable and persistant redis backend store to support the messaging API. This driver aims to be a primary alternative for the currently bundled mongodb driver which is limited by AGPL requirements. The driver is under active development and a single redis instance storage backend is expected to be fully functional at the end of August'14. This driver will be extended to support redis clusters to provide reliability and persistence to the user data.<br /> <br /> My other open source interests include Jquery, python and wikipedia editing.On wikipedia I actively contribute towards Sports, Indian Cinema &amp; Politics and Music.<br /> <br /> Python and javascript are the two tools of my coding armory raring to go out to find and hack interesting problems. You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Blueprints I currently work on ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver Redis Storage Driver]<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative MongoDB alternate]<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== My Wishlist ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/oslo/+spec/cache-redis-backend Oslo Redis Cache backend]<br /> |}<br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Design Document for the Redis Driver ====<br /> https://wiki.openstack.org/wiki/Redis_Storage_Driver_Design_(Zaqar)<br /> <br /> ==== Some Additional Information: ====<br /> <br /> 1. Google Summer of Code Proposal ( Prashanth Raghu ) 2014 - [https://github.com/PrashanthRaghu/prashanthraghu.github.io/blob/master/GSOC2014Proposal-PrashanthRaghu-Final.pdf?raw=true Download]. Feel free to download it if you need it as a reference for your proposals.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=60091 2014-08-08T15:07:28Z

<p>Prashanthr: /* Blueprints I am currently work on */</p> <hr /> <div>&lt;br /&gt;<br /> <br /> ==== About Me ====<br /> &lt;br /&gt;<br /> <br /> Currently pursuing my Masters by computing course at the National University of Singapore. I worked as a IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before coming to Singapore. I completed bachelor's in engineering from PES Institute of Technology,Bangalore. I was selected to be a part of the Marconi team for the Google Summer of Code'14 with Fei Long Wang and Alejandro Cabrera as my assigned mentors.<br /> <br /> As a part of this program I am currently developing a reliable and persistant redis backend store to support the messaging API. This driver aims to be a primary alternative for the currently bundled mongodb driver which is limited by AGPL requirements. The driver is under active development and a single redis instance storage backend is expected to be fully functional at the end of August'14. This driver will later be extended to support redis clusters to provide reliability and persistence to the user data.<br /> <br /> My other open source interests include Jquery, python and wikipedia editing.On wikipedia I actively contribute towards Sports, Indian Cinema &amp; Politics and Music.<br /> <br /> Python and javascript are the two tools of my coding armory raring to go out to find and hack interesting problems. You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Blueprints I currently work on ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver Redis Storage Driver]<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative MongoDB alternate]<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== My Wishlist ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/oslo/+spec/cache-redis-backend Oslo Redis Cache backend]<br /> |}<br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Some Additional Information: ====<br /> <br /> 1. Google Summer of Code Proposal ( Prashanth Raghu ) 2014 - [https://github.com/PrashanthRaghu/prashanthraghu.github.io/blob/master/GSOC2014Proposal-PrashanthRaghu-Final.pdf?raw=true Download]. Feel free to download it if you need it as a reference for your proposals.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=60090 2014-08-08T15:07:10Z

<p>Prashanthr: /* Blueprints I am currently working on */</p> <hr /> <div>&lt;br /&gt;<br /> <br /> ==== About Me ====<br /> &lt;br /&gt;<br /> <br /> Currently pursuing my Masters by computing course at the National University of Singapore. I worked as a IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before coming to Singapore. I completed bachelor's in engineering from PES Institute of Technology,Bangalore. I was selected to be a part of the Marconi team for the Google Summer of Code'14 with Fei Long Wang and Alejandro Cabrera as my assigned mentors.<br /> <br /> As a part of this program I am currently developing a reliable and persistant redis backend store to support the messaging API. This driver aims to be a primary alternative for the currently bundled mongodb driver which is limited by AGPL requirements. The driver is under active development and a single redis instance storage backend is expected to be fully functional at the end of August'14. This driver will later be extended to support redis clusters to provide reliability and persistence to the user data.<br /> <br /> My other open source interests include Jquery, python and wikipedia editing.On wikipedia I actively contribute towards Sports, Indian Cinema &amp; Politics and Music.<br /> <br /> Python and javascript are the two tools of my coding armory raring to go out to find and hack interesting problems. You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Blueprints I am currently work on ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver Redis Storage Driver]<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative MongoDB alternate]<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== My Wishlist ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/oslo/+spec/cache-redis-backend Oslo Redis Cache backend]<br /> |}<br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Some Additional Information: ====<br /> <br /> 1. Google Summer of Code Proposal ( Prashanth Raghu ) 2014 - [https://github.com/PrashanthRaghu/prashanthraghu.github.io/blob/master/GSOC2014Proposal-PrashanthRaghu-Final.pdf?raw=true Download]. Feel free to download it if you need it as a reference for your proposals.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=60089 2014-08-08T15:06:44Z

<p>Prashanthr: /* About Me */</p> <hr /> <div>&lt;br /&gt;<br /> <br /> ==== About Me ====<br /> &lt;br /&gt;<br /> <br /> Currently pursuing my Masters by computing course at the National University of Singapore. I worked as a IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before coming to Singapore. I completed bachelor's in engineering from PES Institute of Technology,Bangalore. I was selected to be a part of the Marconi team for the Google Summer of Code'14 with Fei Long Wang and Alejandro Cabrera as my assigned mentors.<br /> <br /> As a part of this program I am currently developing a reliable and persistant redis backend store to support the messaging API. This driver aims to be a primary alternative for the currently bundled mongodb driver which is limited by AGPL requirements. The driver is under active development and a single redis instance storage backend is expected to be fully functional at the end of August'14. This driver will later be extended to support redis clusters to provide reliability and persistence to the user data.<br /> <br /> My other open source interests include Jquery, python and wikipedia editing.On wikipedia I actively contribute towards Sports, Indian Cinema &amp; Politics and Music.<br /> <br /> Python and javascript are the two tools of my coding armory raring to go out to find and hack interesting problems. You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Blueprints I am currently working on ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver Redis Storage Driver]<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative MongoDB alternate]<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== My Wishlist ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/oslo/+spec/cache-redis-backend Oslo Redis Cache backend]<br /> |}<br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Some Additional Information: ====<br /> <br /> 1. Google Summer of Code Proposal ( Prashanth Raghu ) 2014 - [https://github.com/PrashanthRaghu/prashanthraghu.github.io/blob/master/GSOC2014Proposal-PrashanthRaghu-Final.pdf?raw=true Download]. Feel free to download it if you need it as a reference for your proposals.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=Redis_Storage_Driver_Design_(Zaqar)&diff=60087 2014-08-08T14:56:58Z

<p>Prashanthr: Creating the page</p> <hr /> <div>Creating this page.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=Programming_style_guide_(Zaqar)&diff=60085 2014-08-08T14:53:44Z

<p>Prashanthr: Creating the page</p> <hr /> <div>Page to be filled up</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=59808 2014-08-06T07:54:00Z

<p>Prashanthr: </p> <hr /> <div>&lt;br /&gt;<br /> <br /> ==== About Me ====<br /> &lt;br /&gt;<br /> <br /> Currently pursuing my Masters by computing course at the National University of Singapore. I worked as a IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before coming to Singapore. I completed bachelor's in engineering from PES Institute of Technology,Bangalore. I was selected to be a part of the Marconi team as a part of Google Summer of Code'14. My mentors for this project are Fei Long Wang and Alejandro Cabrera.<br /> <br /> My open source interests include Jquery, python and wikipedia editing.On wikipedia I contribute actively towards Summer Olympics 2012, Indian Cinema &amp; Sports , Indian Politics. <br /> <br /> My favorite coding tools are python and javascript, and they are always ready to get out of the armory. You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> Currently I am developing a redis back end as a reliable back end store for the messaging API.<br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Blueprints I am currently working on ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver Redis Storage Driver]<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative MongoDB alternate]<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== My Wishlist ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/oslo/+spec/cache-redis-backend Oslo Redis Cache backend]<br /> |}<br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Some Additional Information: ====<br /> <br /> 1. Google Summer of Code Proposal ( Prashanth Raghu ) 2014 - [https://github.com/PrashanthRaghu/prashanthraghu.github.io/blob/master/GSOC2014Proposal-PrashanthRaghu-Final.pdf?raw=true Download]. Feel free to download it if you need it as a reference for your proposals.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=59807 2014-08-06T07:53:47Z

<p>Prashanthr: </p> <hr /> <div>&lt;br /&gt;<br /> <br /> ==== About Me ====<br /> <br /> Currently pursuing my Masters by computing course at the National University of Singapore. I worked as a IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before coming to Singapore. I completed bachelor's in engineering from PES Institute of Technology,Bangalore. I was selected to be a part of the Marconi team as a part of Google Summer of Code'14. My mentors for this project are Fei Long Wang and Alejandro Cabrera.<br /> <br /> My open source interests include Jquery, python and wikipedia editing.On wikipedia I contribute actively towards Summer Olympics 2012, Indian Cinema &amp; Sports , Indian Politics. <br /> <br /> My favorite coding tools are python and javascript, and they are always ready to get out of the armory. You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> Currently I am developing a redis back end as a reliable back end store for the messaging API.<br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Blueprints I am currently working on ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver Redis Storage Driver]<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative MongoDB alternate]<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== My Wishlist ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/oslo/+spec/cache-redis-backend Oslo Redis Cache backend]<br /> |}<br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Some Additional Information: ====<br /> <br /> 1. Google Summer of Code Proposal ( Prashanth Raghu ) 2014 - [https://github.com/PrashanthRaghu/prashanthraghu.github.io/blob/master/GSOC2014Proposal-PrashanthRaghu-Final.pdf?raw=true Download]. Feel free to download it if you need it as a reference for your proposals.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=59806 2014-08-06T07:53:31Z

<p>Prashanthr: </p> <hr /> <div>&lt;br /&gt;<br /> <br /> ==== About Me ====<br /> <br /> Currently pursuing my Masters by computing course at the National University of Singapore. I worked as a IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before coming to Singapore. I completed bachelor's in engineering from PES Institute of Technology,Bangalore. I was selected to be a part of the Marconi team as a part of Google Summer of Code'14. My mentors for this project are Fei Long Wang and Alejandro Cabrera.<br /> <br /> My open source interests include Jquery, python and wikipedia editing.On wikipedia I contribute actively towards Summer Olympics 2012, Indian Cinema &amp; Sports , Indian Politics. <br /> <br /> My favorite coding tools are python and javascript, and they are always ready to get out of the armory. You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> Currently I am developing a redis back end as a reliable back end store for the messaging API.<br /> &lt;br /&gt;<br /> <br /> ==== Blueprints I am currently working on ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver Redis Storage Driver]<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative MongoDB alternate]<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== My Wishlist ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/oslo/+spec/cache-redis-backend Oslo Redis Cache backend]<br /> |}<br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Some Additional Information: ====<br /> <br /> 1. Google Summer of Code Proposal ( Prashanth Raghu ) 2014 - [https://github.com/PrashanthRaghu/prashanthraghu.github.io/blob/master/GSOC2014Proposal-PrashanthRaghu-Final.pdf?raw=true Download]. Feel free to download it if you need it as a reference for your proposals.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=59805 2014-08-06T07:52:32Z

<p>Prashanthr: </p> <hr /> <div>&lt;br /&gt;<br /> <br /> ==== About Me ====<br /> <br /> Currently pursuing my Masters by computing course at the National University of Singapore. I worked as a IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before coming to Singapore. I completed bachelor's in engineering from PES Institute of Technology,Bangalore. I was selected to be a part of the Marconi team as a part of Google Summer of Code'14. My mentors for this project are Fei Long Wang and Alejandro Cabrera.<br /> <br /> My open source interests include Jquery, python and wikipedia editing.On wikipedia I contribute actively towards Summer Olympics 2012, Indian Cinema &amp; Sports , Indian Politics. <br /> <br /> My favorite coding tools are python and javascript, and they are always ready to get out of the armory. <br /> <br /> You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> I actively contribute towards the [https://wiki.openstack.org/wiki/Marconi Marconi] project.<br /> <br /> Currently I am developing a redis back end as a reliable back end store for the messaging API.<br /> &lt;br /&gt;<br /> <br /> ==== Blueprints I currently work on ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver Redis Storage Driver]<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative MongoDB alternate]<br /> |}<br /> &lt;br /&gt;<br /> <br /> ==== My Wishlist ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/oslo/+spec/cache-redis-backend Oslo Redis Cache backend]<br /> |}<br /> &lt;br /&gt;<br /> &lt;br /&gt;<br /> <br /> ==== Some Additional Information: ====<br /> <br /> 1. Google Summer of Code Proposal ( Prashanth Raghu ) 2014 - [https://github.com/PrashanthRaghu/prashanthraghu.github.io/blob/master/GSOC2014Proposal-PrashanthRaghu-Final.pdf?raw=true Download]. Feel free to download it if you need it as a reference for your proposals.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=59804 2014-08-06T07:51:39Z

<p>Prashanthr: </p> <hr /> <div><br /> ==== About Me ====<br /> <br /> Currently pursuing my Masters by computing course at the National University of Singapore. I worked as a IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before coming to Singapore. I completed bachelor's in engineering from PES Institute of Technology,Bangalore. I was selected to be a part of the Marconi team as a part of Google Summer of Code'14. My mentors for this project are Fei Long Wang and Alejandro Cabrera.<br /> <br /> My open source interests include Jquery, python and wikipedia editing.On wikipedia I contribute actively towards Summer Olympics 2012, Indian Cinema &amp; Sports , Indian Politics. <br /> <br /> My favorite coding tools are python and javascript, and they are always ready to get out of the armory. <br /> <br /> You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> I actively contribute towards the [https://wiki.openstack.org/wiki/Marconi Marconi] project.<br /> <br /> Currently I am developing a redis back end as a reliable back end store for the messaging API.<br /> <br /> ==== Blueprints I currently work on ====<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver Redis Storage Driver]<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative MongoDB alternate]<br /> |}<br /> <br /> Wishlist I would love to work on:<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/oslo/+spec/cache-redis-backend Oslo Redis Cache backend]<br /> |}<br /> <br /> ==== Some Additional Information: ====<br /> <br /> 1. Google Summer of Code Proposal ( Prashanth Raghu ) 2014 - [https://github.com/PrashanthRaghu/prashanthraghu.github.io/blob/master/GSOC2014Proposal-PrashanthRaghu-Final.pdf?raw=true Download]. Feel free to download it if you need it as a reference for your proposals.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=59803 2014-08-06T07:45:55Z

<p>Prashanthr: </p> <hr /> <div>Hi I am Prashanth Raghu,<br /> <br /> Currently pursuing my Masters by computing course at the National University of Singapore. I worked as a IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before coming to Singapore. I completed bachelor's in engineering from PES Institute of Technology,Bangalore. <br /> <br /> My open source interests include Jquery, python and wikipedia editing.On wikipedia I contribute actively towards Summer Olympics 2012, Indian Cinema &amp; Sports , Indian Politics. <br /> <br /> My favorite coding tools are python and javascript, and they are always ready to get out of the armory. <br /> <br /> You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> I actively contribute towards the [https://wiki.openstack.org/wiki/Marconi Marconi] project.<br /> <br /> Currently I am developing a redis backend as a reliable backend store for the messaging API.<br /> <br /> Blueprints I currently work on:<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver Redis Storage Driver]<br /> |-<br /> | [https://blueprints.launchpad.net/marconi/+spec/mongodb-alternative MongoDB alternate]<br /> |}<br /> <br /> Wishlist I would love to work on:<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> ! Blueprint Name<br /> |-<br /> | [https://blueprints.launchpad.net/oslo/+spec/cache-redis-backend Oslo Redis Cache backend]<br /> |}</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=59802 2014-08-06T07:41:34Z

<p>Prashanthr: </p> <hr /> <div>Hi I am Prashanth Raghu,<br /> <br /> Currently pursuing my Masters by computing course at the National University of Singapore. I worked as a IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before coming to Singapore. I completed bachelor's in engineering from PES Institute of Technology,Bangalore. <br /> <br /> My open source interests include Jquery, python and wikipedia editing.On wikipedia I contribute actively towards Summer Olympics 2012, Indian Cinema &amp; Sports , Indian Politics. <br /> <br /> My favorite coding tools are python and javascript, and they are always ready to get out of the armory. <br /> <br /> You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> I am looking forward to contribute towards the [https://wiki.openstack.org/wiki/Marconi Marconi] and Gantt projects.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=59801 2014-08-06T07:40:54Z

<p>Prashanthr: </p> <hr /> <div>Hi I am Prashanth Raghu,<br /> <br /> Currently pursuing my Masters by computing course at the National University of Singapore. I worked as a IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before coming to Singapore. I completed bachelor's in engineering from PES Institute of Technology,Bangalore. <br /> <br /> My open source interests include Jquery, python and wikipedia editing.On wikipedia I contribute actively towards Summer Olympics 2012, Indian Cinema &amp; Sports , Indian Politics. <br /> <br /> My favorite coding tools are python and javascript, and they are always ready to get out of the armory. <br /> <br /> You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> I am looking forward to contribute towards the [Marconi] and Gantt projects.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=Meetings/Zaqar&diff=54519 2014-06-02T14:40:11Z

<p>Prashanthr: /* Extra Stuff */</p> <hr /> <div><br /> = Weekly Marconi (queuing) Team Meeting =<br /> <br /> The [https://launchpad.net/marconi Marconi] project team holds a weekly team meeting in &lt;code&gt;&lt;nowiki&gt;#openstack-meeting-alt&lt;/nowiki&gt;&lt;/code&gt;:<br /> <br /> * Tuesdays at [http://www.timeanddate.com/worldclock/fixedtime.html?hour=15&amp;min=0&amp;sec=0 1500 UTC]<br /> <br /> == Next meeting ==<br /> <br /> * 3 June 2014 (15:00 UTC )<br /> <br /> ==== Agenda ====<br /> <br /> The blueprints that are used as a basis for the [https://launchpad.net/marconi Marconi project] can be found at https://blueprints.launchpad.net/marconi<br /> <br /> ===== Extra Stuff =====<br /> <br /> * Using the mailing list to offload meeting time (kgriffs)<br /> * Renaming the project: https://etherpad.openstack.org/p/marconi-scratch<br /> * Healthier Community: Let's Adopt a Code of Conduct (alcabrera)<br /> ** See also: [[Your_First_Patch_(Marconi)#Professional_Conduct|Professional conduct]] (kgriffs)<br /> * Adopt spec in Marconi? (malini)<br /> ** See example here https://github.com/openstack/qa-specs<br /> * AMQP in Marconi: What Version(s) to Support? (alcabrera, vkmc)<br /> * v1.1 - Postpone changes around getting messages by ID to v2.0? (kgriffs)<br /> * [http://markmail.org/message/2w7xzjq6i7mfcpez#query:+page:1+mid:7afzhoztzla4jgr3+state:results FYI: Keystone token changes] (kgriffs)<br /> * Discuss [https://bugs.launchpad.net/marconi/+bug/1243752 GET messages on a non existing queue returns 204] (vkmc, alcabrera)<br /> * Supporting Redis as a cache in marconi. (prashanthr_, alcabrera)<br /> <br /> ===== Usual Stuff =====<br /> <br /> * Review actions from last time<br /> * Updates on blueprints <br /> * Updates on bugs <br /> * Open discussion (time permitting)<br /> <br /> ==== Discuss Later ====<br /> <br /> * Several asks for a Kafka driver lately; a prototype would be cool, but we are short on people and could use a new contributor to take this on... (kgriffs)<br /> * Proposal to support claim delay to posted messages in v1.1 (kgriffs)<br /> * Renaming the program: https://etherpad.openstack.org/p/marconi-scratch<br /> * Notifications for MagnetoDB (malini, kgriffs)<br /> ** See https://wiki.openstack.org/wiki/MagnetoDB/notification &amp; http://www.mail-archive.com/openstack-dev@lists.openstack.org/msg25038.html<br /> * Remove bulk delete by id, also get/delete by a single id in v1.1 or v2.0 of the API? (kgriffs)<br /> * Preflight Checklist for releases, including milestones (kgriffs)<br /> * Blueprint review process (kgriffs)<br /> * Concurrency strategy for client (flaper87)<br /> * When people say they want polling what they often mean is... (kgriffs)<br /> <br /> == Previous meetings ==<br /> * Meeting #53 | Remove get message by id endpoints, blueprints for J1 | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-05-27-15.02.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-05-27-15.02.html summary]<br /> * Meeting #52 | Summit Retro, AMQP Driver | [http://eavesdrop.openstack.org/meetings/marconi_team_meeting/2014/marconi_team_meeting.2014-05-20-15.01.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi_team_meeting/2014/marconi_team_meeting.2014-05-20-15.01.html summary]<br /> * Meeting #51 | Summit Planning, OSSG, Write the Docs! | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-05-06-15.01.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-05-06-15.01.html summary]<br /> * Meeting #50 | Summit: Planning, Prizes, Events | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-04-29-15.01.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-04-29-15.01.html summary]<br /> * Meeting #49 | New Interns, Summit -Sessions &amp; Planning, POP Vote | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-04-22-15.01.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-04-22-15.01.html summary]<br /> * Meeting #48 | Blocking Issues, Gate Fixing, Summit Planning | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-04-15-15.00.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-04-15-15.00.html summary]<br /> * Meeting #47 | Pop Semantics, Deprecating Queue Metadata | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-04-08-15.01.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-04-08-15.01.html summary]<br /> * Meeting #46 | Oslo Liaison, Unified Guest Agent + Marconi | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-04-01-15.01.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-04-01-15.01.html summary]<br /> * Meeting #45 | Graduation Reflections, Pop Semantics | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-03-25-15.00.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-03-25-15.00.html summary]<br /> * Meeting #44 | Pecan Evaluation | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-03-18-15.01.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-03-18-15.01.html summary]<br /> * Meeting #43 | Queues -&gt; Topics, v1.1/v2.0 Plans | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-03-11-15.00.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-03-11-15.00.html summary]<br /> * Meeting #42 | SqlAlchemy is Done, Pecan Evaluation Objectives | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-03-04-15.00.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-03-04-15.00.html summary]<br /> * Meeting #41 | SqlAlchemy is Near, Pecan Evaluation Pt. 1 | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-02-18-15.04.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-02-18-15.04.html summary]<br /> * Meeting #40 | Summit Planning, SQL, API v1.1 | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-02-11-15.01.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-02-11-15.01.html summary]<br /> * Meeting #39 | SQL Driver, Towards Icehouse | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-02-04-15.00.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-02-04-15.00.html summary]<br /> * Meeting #38 | Actions for Everyone | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-01-28-15.00.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-01-28-15.00.html summary]<br /> * Meeting #37 | Preparing to Cut Icehouse-2 Release | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-01-21-15.03.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-01-21-15.03.html summary]<br /> * Meeting #36 | Push-based Messaging and Updates | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-01-14-15.01.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2014/marconi.2014-01-14-15.01.html summary]<br /> * Meeting #35 | Graduation Catchup | [http://eavesdrop.openstack.org/meetings/marconi_team/2014/marconi_team.2014-01-07-15.11.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi_team/2014/marconi_team.2014-01-07-15.11.html summary]<br /> * Meeting #34 | Towards Graduation | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-12-17-15.11.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-12-17-15.11.html summary]<br /> * Meeting #33 | Setting Priorities | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-12-10-15.05.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-12-10-15.05.html summary]<br /> * Meeting #32 | Marconi Notifications: Goals, Features, Payloads, Elephants, Workers | [http://eavesdrop.openstack.org/meetings/marconi_notifications_brainstorm/2013/marconi_notifications_brainstorm.2013-12-03-15.05.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi_notifications_brainstorm/2013/marconi_notifications_brainstorm.2013-12-03-15.05.html summary] | [https://etherpad.openstack.org/p/marconi-notifications-brainstorm etherpad]<br /> * Meeting #31 | JSON-Homedoc and Documentation | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-12-02-15.05.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-12-02-15.05.html summary]<br /> * Meeting #30 | Summit Retro, Sharding | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-11-18-16.09.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-11-18-16.09.html summary]<br /> * Meeting #29 | Sharding, Triage, and API Next | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-10-28-16.04.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-10-28-16.04.html summary]<br /> * Meeting #28 | Sharding and Versioning! | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-10-21-16.03.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-10-21-16.03.html summary]<br /> * Meeting #27 | v1 API is now frozen! | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-10-07-16.03.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-10-07-16.03.html summary]<br /> * Meeting #26 | API reviews: marconi-proxy, marconi-queues | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-09-30-16.04.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-09-30-16.04.html summary]<br /> * Meeting #25 | Finishing up marconi-proxy, status of Pecan/Falcon discussion | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-09-23-16.19.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-09-23-16.19.html summary]<br /> * Meeting #24 | Proxy progress, bug triage | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-09-16-16.05.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-09-16-16.05.html summary]<br /> * Meeting #23 | SQL driver, tsung, performance | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-09-09-16.06.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-09-09-16.06.html summary]<br /> * Meeting #22 | Core team organization, performance | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-08-26-16.07.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-08-26-16.07.html summary]<br /> * Meeting #21 | Deleting claimed messages, incubation, client reboot | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-08-19-16.03.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-08-19-16.03.html summary]<br /> * Meeting #20 | Trello no more, bp and bug triage for H3 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-08-12-16.04.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-08-12-16.04.html summary]<br /> * Meeting #19 | Testing refactoring | 2 August 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-08-02-16.02.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-08-02-16.02.html summary]<br /> * Meeting #18 | Queue metadata | 18 July 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-07-18-19.05.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-07-18-19.05.html summary]<br /> * Meeting #17 | Rebooting python-marconiclient, perf testing results | 11 July 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-07-11-19.03.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-07-11-19.03.html summary]<br /> * Meeting #16 | Stats, limits, incubation; oh my! | 27 June 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-06-27-19.05.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-06-27-19.05.html summary]<br /> * Meeting #15 | Incubation application, memcache and haproxy, client integration with Swift | 20 June 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-06-20-19.06.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-06-20-19.06.html summary]<br /> * Meeting #14 | Community feedback, incubation prep, salty tests | 13 June 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-06-13-19.06.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-06-13-19.06.html summary]<br /> * Meeting #13 | Handling storage connection errors, python-marconiclient, milestones | 6 June 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-06-06-19.14.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-06-06-19.14.html summary]<br /> * Meeting #12 | Bug triage, QA/ref cluster progress and hardening | 23 May 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-05-23-19.10.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-05-23-19.10.html summary]<br /> * Meeting #11 | Blueprint target, test update, apiclient, zmq | 16 May 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-05-16-19.00.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-05-16-19.00.txt summary]<br /> * Meeting #10 | System and perf testing, blueprint triage | 9 May 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-05-09-19.07.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-05-09-19.07.html summary]<br /> * Meeting #9 | Alignment with Havana milestones, FIFO, saved by grace | 2 May 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-05-02-19.20.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-05-02-19.20.html summary]<br /> * Meeting #8 | Portland Demo, Auth, Claims, Routing | 4 April 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-04-04-19.05.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-04-04-19.05.html summary]<br /> * Meeting #7 | State of the project, claiming messages | 21 Mar 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-03-21-19.04.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-03-21-19.04.html summary]<br /> * Meeting #6 | Posting messages, queue metadata | 7 Mar 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-03-07-19.05.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-03-07-19.05.html summary]<br /> * Meeting #5 | Claiming messages, dev kickoff | 21 Feb 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-02-21-19.06.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-02-21-19.06.html summary]<br /> * Meeting #4 | GET and POST messages | 14 Feb 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-02-14-19.05.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-02-14-19.05.html summary]<br /> * Meeting #3 | PUT vs. PATCH, JSON vs. XML, and other discussions re the API draft. | 7 Feb 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-02-07-19.01.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-02-07-19.01.html summary]<br /> * Meeting #2 | Concrete queues, no tags, locking semantics, unified queue types or ? | 24 Jan 2013 | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-01-24-19.05.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-01-24-19.05.html summary]<br /> * Meeting #1 | Kickoff |17 Jan 2013 | [http://eavesdrop.openstack.org/meetings/marconi_project_team/2013/marconi_project_team.2013-01-17-19.01.log.html log] | [http://eavesdrop.openstack.org/meetings/marconi_project_team/2013/marconi_project_team.2013-01-17-19.01.html summary]<br /> <br /> == Meeting organizers ==<br /> <br /> * Publish the agenda 24h in advance<br /> * Mail the agenda to the list and invite participants<br /> * Ask each person responsible for an action from the previous meeting to prepare a line of the form, for each action item: . #info nickname description of the action link to the diff / mailing list thread etc. describing the implementation of the action<br /> * Use http://meetbot.debian.net/Manual.html to get an automatic summary<br /> * Prepare an outline for the meeting to speed things up (see http://eavesdrop.openstack.org/meetings/openstack-meeting/2012/openstack-meeting.2012-05-10-16.00.log.html for an actual example)<br /> * Record decisions and commitments; review in the next meeting</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=User:Prashanthr&diff=45735 2014-03-18T05:01:21Z

<p>Prashanthr: User Page : Prashanth</p> <hr /> <div>Hi I am Prashanth Raghu,<br /> <br /> Currently pursuing my Masters by computing course at the National University of Singapore. I worked as a IT solutions architect at Citrix R&amp;D India in Bangalore between July 2011 and July 2013 before coming to Singapore. I completed bachelor's in engineering from PES Institute of Technology,Bangalore. <br /> <br /> My open source interests include Jquery, python and wikipedia editing.On wikipedia I contribute actively towards Summer Olympics 2012, Indian Cinema &amp; Sports , Indian Politics. <br /> <br /> My favorite coding tools are python and javascript, and they are always ready to get out of the armory. <br /> <br /> You can find me on twitter [http://twitter.com/prashanthraghu @prashanthraghu]. <br /> <br /> I am looking forward to contribute towards the Marconi and Gantt projects.</div>

Prashanthr https://wiki.openstack.org/w/index.php?title=GSoC2014&diff=44441 2014-03-06T05:34:37Z

<p>Prashanthr: /* Students */</p> <hr /> <div>== Google Summer of Code 2014 ==<br /> <br /> [http://www.openstack.org/software/ OpenStack] is applying as a mentoring organization for the [http://www.google-melange.com/gsoc/homepage/google/gsoc2014 2014 Google Summer of Code]. Check [https://developers.google.com/open-source/soc/ Google Developers site] for more information on how the program works.<br /> We need to get in this time!<br /> <br /> Link to call for participation: [http://google-opensource.blogspot.com/2014/02/mentoring-organization-applications-now.html here]<br /> <br /> Link to FAQs: [http://www.google-melange.com/gsoc/document/show/gsoc_program/google/gsoc2014/help_page here]<br /> <br /> <br /> === What is Openstack? ===<br /> <br /> [http://www.openstack.org/software/ Openstack] is an open-source IaaS cloud computing platform. Its mission is to provide a flexible solution for both public and private clouds of any size, and for this matter two basic requirements are considered: clouds must be simple to implement and massively scalable. <br /> <br /> To meet these principles OpenStack is divided into different components that work together. It's [http://www.openstack.org/software/openstack-compute/ computing], [http://www.openstack.org/software/openstack-storage/ storage], [http://www.openstack.org/software/openstack-networking/ networking], and all the other bits that help make this project, '''The Cloud'''.<br /> <br /> OpenStack is [http://i.imgur.com/gAyoiF8.png continuously growing] and new and exciting projects are being discussed everyday.<br /> <br /> We encourage new contributors to participate and help us make OpenStack the most complete, reliable and flexible open-source cloud service!<br /> <br /> <br /> === Mentors ===<br /> <br /> If you're interested in mentoring for this round, please add your name, email, IRC handle and the kind of projects you're interested in mentoring below. Please ensure that the projects are official projects in OpenStack and are registered in the [https://github.com/openstack/governance/blob/master/reference/programs.yaml governance projects.yaml]<br /> <br /> * Davanum Srinivas - dims - Nova, Oslo<br /> * Debo Dutta - dedutta - Nova, Ceilometer<br /> * [[User:Alejandro_Cabrera|Alejandro Cabrera]] - alcabrera - Marconi, Oslo<br /> * Yathiraj Udupi - Yathi - Nova, Ceilometer<br /> * Fei Long Wang - flwang- Glance<br /> * Boris Pavlovic - boris-42 - Rally<br /> * [[User:Sergey_Lukjanov|Sergey Lukjanov]] - SergeyLukjanov - Savanna (proxy to help find mentor in Savanna community)<br /> * [[User:colinmcnamara|Colin McNamara]] - colinmcnamara - OpenStack Docs, OpenStack Training and ToolChains<br /> * [[User:sriramhere|Sriram Subramanian]] - Fuzz Testing, OpenStack Security<br /> * Balint Kovacs - blint@balabit.hu - Zorp<br /> * Szilard Pfeiffer - floss@pfeifferszilard.hu - Zorp<br /> * Arnaud Legendre - arnaud, alegendre@vmware.com - Oslo<br /> * Joshua Hesketh - jhesketh, joshua.hesketh@rackspace.com - OpenStack Infrastructure<br /> <br /> === Students ===<br /> <br /> Students application period opens March 10 and ends on March 21.<br /> <br /> If you'd like to get started on your proposal early, go ahead and add your name, location, e-mail, IRC handle and the project you are interested in (if you already know about that!) here:<br /> *[[https://launchpad.net/~krishna1256 Sai Krishna]],India,krishna1256@gmail.com,saikrishna_,[[[GSoC2014/Queues/Storage|https://wiki.openstack.org/wiki/GSoC2014/Queues/Storage]]][Add a New Backend to Oslo.Cache]<br /> * Shalmali Sahasrabudhe, India, shalmali.sahasrabudhe@gmail.com [Common Scheduler (Gantt) ]<br /> *Manishanker Talusani,India,shanker.mani0@gmail.com[Project not selected yet]<br /> *Saket Sinha, India, saket.sinha89@gmail.com [project not selected yet]<br /> * Adnan Khan, Canada, khnd06@gmail.com [project not selected yet]<br /> * [[https://launchpad.net/~andronat-asf Anastasios Andronidis]], Greece, andronat_asf@hotmail.com. Proposed: [https://docs.google.com/document/d/1mWWSyftZYXxfXKzOBVeVma8KJbQRmYNPnns3oixHVMk/edit?usp=sharing Glance Scalable Image Precaching]<br /> * Artem Shepelev, Russia, e-mail: shepelev.artem@gmail.com, ashepelev at irc.freenode.net, [[GSoC2014/Scheduler/CrossServicesScheduler|OpenStack/Gantt Cross-services Scheduler]].<br /> * Fabio Morais, Brazil, fabio.jorge@gmail.com [Ceilometer; Proposed: [[GSoC2014/Ceilometer/UnderstandingBurstsLifecycle|Applying OpenStack telemetry to understand the bursts lifecycle in resource usage]]]<br /> * [[User:Vkmc|Victoria Martínez de la Cruz]] - Argentina - victoria@vmartinezdelacruz.com - vkmc - OpenStack Message Queuing (Marconi)<br /> * [[User:Damon_Wang|Wei Wang]], China, damon.devops@gmail.com, Neutron &amp; Keystone<br /> * Kumar Rishabh, India, email: shailrishabh@gmail.com [would fill more details later]<br /> * Marc Solanas Tarre, US, email: marc@solanas.cat, mst89, [Monitoring and Telemetry how to detect network anomalies from telemetry data within Openstack]<br /> * Pengfei Zhang, US, lalasjtu@gmail.com, Sparky, [Monitoring and Telemetry Monitoring &amp; Tuning network for QoS within Openstack]<br /> * RobberPhex, China, robberphex@gmail.com, Rally<br /> * Rodrigo Duarte, Brazil, rodrigodsousa@gmail.com, rodrigods at irc.freenode.net [Gantt]<br /> * Rishi Raj Singh, India, rishiraj.devel@gmail.com, [project not selected yet]<br /> * [[User:Telles Nobrega|Telles Nóbrega]], Brazil, tellesnobrega@gmail.com, tellesnobrega at irc.freenode.net [Keystone, Nova, Savanna, Ceilometer]<br /> * Md Ali Ahsan Rana, Canada, aliahsanrana@gmail.com, [Oslo, Rally]<br /> * George Ebbinason, India, ebbinason@hotmail.com, [OpenStack Networking (Neutron) - Implement an application-level FWaaS driver]<br /> * Masaru Nomura, UK, massa.nomura@gmail.com, [OpenStack Incubator (Oslo) - Implement a re-usable shared library for vmware (oslo.vmware)]<br /> * Santosh Iyer, US, mails2santosh@gmail.com, [Nova, Ceilometer, Savanna]<br /> * Chenchong Qin, China, qinchenchong@gmail.com, chenchong at irc.freenode.net, [[GSoC2014/Scheduler/CrossServicesScheduler|OpenStack/Gantt Cross-services Scheduler]]<br /> * Andrew Chul, Russia, andymitrich@gmail.com, [project not selected yet]<br /> * Fang Zhen, China, fz1989fz@gmail.com, fz1989 at irc.freenode.net, [[GSoC2014/Scheduler/CrossServicesScheduler|OpenStack/Gantt Cross-services Scheduler]]<br /> * Abhinav Saxena, India, abhinav.saxena.57@gmail.com [project not yet selected]<br /> * Pranav Singh, India, singh.pranavkumar10@gmail.com, purple_haze, [project not yet selected]<br /> * Demontiê dos Santos, Brazil, demontiejunior@gmail.com, dsantos_ at irc.freenode.net, [Nova]<br /> * [[User:Danielbrunos|Daniel Bruno]], Brazil, danielbrunos@gmail.com, danielbruno, [Heat, Savanna, Nova, Neutron]<br /> * Dániel Csubák, Hungary, cyrrian@gmail.com, [OpenStack Networking (Neutron) - Implement an application-level FWaaS driver]<br /> * Bruno Criado, Brazil, brunocriado@gmail.com, dropped at irc.freenode.net, [Implement a Fuzz testing framework that can be run on Tempest or a similar framework]<br /> * Ondra Machacek, Czech Republic machacek.ondra@gmail.com, omachace [infra]<br /> * Tzanetos Balitsaris, Greece, tzabal AT it DOT teithe DOT gr, tzabal, [Rally]<br /> * Junfeng Shen, China, yokoloki7@gmail.com, [OpenStack Networking (Neutron) - Implement an application-level FWaaS driver]<br /> * Jeremy Henriques, India, jeremyh28@gmail.com, [OpenStack Message Queuing Service (Marconi)]<br /> * [[User:prashanthr|Prashanth Raghu]],India,pisprashanth@gmail.com, [OpenStack Message Queuing Service (Marconi)]<br /> <br /> === Communication ===<br /> <br /> Get in touch with mentors and students through the [http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev openstack-dev mailing list].<br /> <br /> Also, you can find us at IRC in #openstack-gsoc at irc.freenode.org.<br /> <br /> Then, let's start to write your proposal! A proposal template can be seen at [[GSoC2014/StudentApplicationTemplate|GSoC2014/StudentApplicationTemplate]].<br /> <br /> === Ideas ===<br /> <br /> Here are some project suggestions students can choose for their applications. This doesn't mean students have to stick strictly to this list; don't hesitate in propose projects by your own. For the latter, it would be great if you could submit a draft proposal and a estimated timeline.<br /> <br /> When writing your proposal, try to estimate your timeline to fit the 4 month period of GSoC coding. Also, take into account that '''GSoC does not consider other projects than coding''', so other ideas (like community tasks or i18n efforts) are not suitable for this internship.<br /> <br /> '''Click on the proposed project that caught your attention to get the details about the assumed knowledge, the project goals and more details related to it.'''<br /> <br /> <br /> ==== Fuzz Testing (various projects) ====<br /> <br /> Fuzz testing or fuzzing is a software testing technique, often automated or semi-automated, that involves providing invalid, unexpected, or random data to the inputs of a computer program. The program is then monitored for exceptions such as crashes, or failing built-in code assertions or for finding potential memory leaks. Fuzzing is commonly used to test for security problems in software or computer systems.<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> | Difficulty || Hard<br /> |-<br /> | Topics || testing, tempest<br /> |-<br /> | Mentor || Sriram Subramanian<br /> |}<br /> <br /> Proposed ideas,<br /> <br /> * [[GSoC2014/Testing/Fuzz|Implement a Fuzz testing framework that can be run on Tempest or a similar framework]]<br /> <br /> <br /> ==== Common Scheduler (Gantt) ====<br /> <br /> Gantt provides a common scheduler framework for use by various OpenStack components.<br /> <br /> Check out more details about [https://github.com/openstack/gantt Gantt]!<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> | Difficulty || Medium<br /> |-<br /> | Topics || schedulers, python, gantt<br /> |-<br /> | Mentor || Debo<br /> |}<br /> <br /> Proposed ideas,<br /> <br /> * [[GSoC2014/Scheduler/StandAloneScheduler|Implement a stand-alone scheduler based on the scheduler forklift code]]<br /> * [[GSoC2014/Scheduler/ScalableScheduler|Implement a scalable scheduler]] <br /> * [[GSoC2014/Scheduler/CrossServicesScheduler|Implement a cross-services scheduler]]<br /> <br /> <br /> ==== OpenStack Monitoring and Telemetry (Ceilometer) ====<br /> <br /> Ceilometer aims to deliver a unique point of contact for billing systems to acquire all counters they need to establish customer billing, across all current and future OpenStack components. The delivery of counters must be traceable and auditable. The counters must be easily extensible to support new projects, and agents doing data collections should be independent of the overall system.<br /> <br /> For more details about Ceilometer project, check out the [[Ceilometer#OpenStack_Telemetry_.28Ceilometer.29|wiki]]<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> | Difficulty || Medium<br /> |-<br /> | Topics || ceilometer, data science<br /> |-<br /> | Mentor || Debo<br /> |}<br /> <br /> Proposed ideas,<br /> <br /> * [[GSoC2014/Scheduler/NetworkAnomalyDetection|How to detect network anomalies from telemetry data within Openstack]]<br /> * [[Monitoring &amp; Tuning network for QoS within Openstack]]<br /> * [[GSoC2014/Ceilometer/UnderstandingBurstsLifecycle|Applying OpenStack telemetry to understand the bursts lifecycle in resource usage]]<br /> <br /> ==== OpenStack Message Queuing Service (Marconi) ====<br /> <br /> Openstack Message Queuing Service (Marconi) provides a distributed queue. The basic concept is simple:<br /> <br /> * Create a queue<br /> * Post messages<br /> * Read them or claim them<br /> <br /> <br /> For full details on Marconi project, check out the [https://wiki.openstack.org/wiki/Marconi wiki]!<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> | Difficulty || Medium<br /> |-<br /> | Topics || storage, python, marconi<br /> |-<br /> | Mentor || Alejandro Cabrera<br /> |}<br /> <br /> Proposed ideas,<br /> <br /> * [[GSoC2014/Queues/Storage | Add a New Storage Backend]]<br /> <br /> <br /> ==== OpenStack Common Libraries (Oslo) ====<br /> <br /> The Oslo program produces a set of python libraries containing infrastructure code shared by OpenStack projects. The APIs provided by these libraries should be high quality, stable, consistent and generally useful.<br /> <br /> Check out more details about Oslo project on the [https://wiki.openstack.org/wiki/oslo wiki]<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> | Difficulty || Medium - Hard<br /> |-<br /> | Topics || storage, python, oslo<br /> |-<br /> | Mentor || Alejandro Cabrera, Davanum Srinivas<br /> |}<br /> <br /> Proposed ideas,<br /> <br /> * [[GSoC2014/Incubator/Storage|Add a new backend to oslo.cache]]<br /> * [[GSoC2014/Incubator/SharedLib|Implement a re-usable shared library for vmware (oslo.vmware) to be consumed by various OpenStack projects like Nova, Cinder or Glance]]<br /> * [[GSoC2014/Incubator/Plugin|Define a new layer/abstraction in Nova for plugging-in vCenter and ovirt (since they span multiple hosts)]] (WIP)<br /> <br /> ==== Benchmarking System (Rally) ====<br /> <br /> OpenStack QA team mostly works on CI/CD that ensures that new patches don't break specific single node installation of OpenStack. On the other hand it's clear that such CI/CD is only an indication and does not cover all cases (e.g. if cloud works well on single node installation it doesn't mean that it will work good as well on 1k servers installation under high load).. Rally aims to fix this and help us to get answer on question &quot;How OpenStack works at scale&quot;. To make it possible we are going to automate and unify all steps that are required for benchmarking OpenStack at scale: multi node OS deployment, verification, benchmarking &amp; profiling.<br /> <br /> [[File:Rally-Actions.png|500px|center]]<br /> <br /> * Deploy is not yet another deployer of OpenStack it is just a plugable mechanism that allows to unify &amp; simplify work with different deployers like: DevStack, Fuel, Anvil on hardware/VMs that you have.<br /> * Verify - (work in progress) Use tempest to verify functionality of deployed openstack. In future Rally will support other OS verifiers.<br /> * Benchmark - Smart combination of Framework, Load generation &amp; Big repository of benchmarks.<br /> <br /> <br /> For more details about Rally project, check out [https://wiki.openstack.org/wiki/rally wiki]<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> | Difficulty || Medium<br /> |-<br /> | Topics || rally, benchmarks, deploying, python, tempest,<br /> |-<br /> | Mentor || Boris Pavlovic<br /> |}<br /> <br /> Proposed ideas,<br /> <br /> * Benchmarking OpenStack<br /> * Writing new benchmarks<br /> * Integration of Rally &amp; Tempest <br /> * Processing Results <br /> * Improving Rally deploying system<br /> <br /> <br /> ==== OpenStack Networking (Neutron) ====<br /> <br /> Neutron is an OpenStack project to provide Networking-as-a-Service between interface devices (e.g., vNICs) managed by other Openstack services (e.g., Nova).<br /> <br /> For full details about Neutron, check out the [https://wiki.openstack.org/wiki/Neutron wiki]<br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> | Difficulty || Medium<br /> |-<br /> | Topics || drivers, python, networking, fwaas, neutron<br /> |-<br /> | Mentor || Balint Kovacs, Szilard Pfeiffer<br /> |}<br /> <br /> Proposed ideas,<br /> <br /> * [[GSoC2014/Network/Driver|Implement an application-level FWaaS driver]] ([https://github.com/balabit/zorp/wiki/zorp Zorp])<br /> <br /> <br /> ==== OpenStack Data Processing (Savanna) ====<br /> <br /> Savanna aims to provide users with simple means to provision a Hadoop cluster by specifying several parameters like Hadoop version, cluster topology, nodes hardware details and a few more. The aim of this project is to enable users provision and management of Hadoop clusters on OpenStack.<br /> <br /> Check out the [https://wiki.openstack.org/wiki/Savanna wiki] to learn more about Savanna <br /> <br /> {| class=&quot;wikitable&quot;<br /> |-<br /> | Difficulty ||<br /> |-<br /> | Topics || plugins, hadoop provision, savanna<br /> |-<br /> | Mentor ||<br /> |}<br /> <br /> Proposed ideas,<br /> <br /> * [[GSoC2014/DataProcessing/Plugin|Develop a new plugin for Savanna to extend savanna.plugins.provisioning:ProvisioningPluginBase class and implement all the required methods.]] (WIP)<br /> <br /> ==== OpenStack Infrastructure (infra) ====<br /> <br /> The project infrastructure encompasses all of the systems that are used in the day to day operation of the OpenStack project as a whole. This includes development, testing, and collaboration tools. All of the software that we run is open source, and its configuration is public. The project still uses a number of systems that do not yet fall under this umbrella (notably, the main website), but we’re working to incorporate them so that people may just as easily contribute to those areas. All new services used by the project should begin as part of the infrastructure project to ensure easy collaboration from the start.<br /> <br /> Proposed ideas,<br /> <br /> * [[GSoC2014/ReplaceJenkins|Replace Jenkins with a more scalable solution based on the zuul-gearman protocol]]<br /> <br /> <br /> === Projects ===<br /> <br /> Current mentors are willing to supervise students in the following projects:<br /> <br /> * [https://wiki.openstack.org/wiki/Nova Openstack Compute (Nova)]<br /> * [https://wiki.openstack.org/wiki/Climate Resource Reservation (Climate)]<br /> * [https://github.com/openstack/gantt Common Scheduler (Gantt)]<br /> * [https://wiki.openstack.org/wiki/Marconi OpenStack Message Queuing (Marconi)]<br /> * [https://wiki.openstack.org/wiki/Oslo OpenStack Common Libraries (Oslo)]<br /> * [https://wiki.openstack.org/wiki/Neutron OpenStack Networking (Neutron)]<br /> * [https://wiki.openstack.org/wiki/Swift OpenStack Object Storage (Swift)]<br /> * [https://wiki.openstack.org/wiki/Cinder OpenStack Block Storage (Cinder)]<br /> * [https://wiki.openstack.org/wiki/Heat OpenStack Orchestration (Heat)]<br /> * [https://wiki.openstack.org/wiki/Savanna OpenStack Data Processing (Savanna)]<br /> * [https://wiki.openstack.org/wiki/Ceilometer OpenStack Telemetry (Ceilometer)]<br /> * [https://wiki.openstack.org/wiki/Rally Benchmarking System (Rally) ]</div>

Prashanthr