Difference between revisions of "Trove"
Dror-kagan (talk | contribs) (→Design) |
Dror-kagan (talk | contribs) |
||
| Line 3: | Line 3: | ||
Reddwarf is Database as a Service for Openstack. It's designed to run entirely on [[OpenStack]], with the goal of allowing users to quickly and easily utilize the features of a relational database without the burden of handling complex administrative tasks. Cloud users and database administrators can provision and manage multiple database instances as needed. Initially, the service will focus on providing resource isolation at high performance while automating complex administrative tasks including deployment, configuration, patching, backups, restores, and monitoring. | Reddwarf is Database as a Service for Openstack. It's designed to run entirely on [[OpenStack]], with the goal of allowing users to quickly and easily utilize the features of a relational database without the burden of handling complex administrative tasks. Cloud users and database administrators can provision and manage multiple database instances as needed. Initially, the service will focus on providing resource isolation at high performance while automating complex administrative tasks including deployment, configuration, patching, backups, restores, and monitoring. | ||
| − | |||
[[File:wb.jpg|200px|thumb|left|System Diagram]] | [[File:wb.jpg|200px|thumb|left|System Diagram]] | ||
| Line 15: | Line 14: | ||
| + | |||
| + | |||
| + | = Design = | ||
Reddwarf is designed to support a single-tenant database within a Nova instance. There will be no restrictions on how Nova is configured, since Reddwarf interacts with other [[OpenStack]] components purely through the API. | Reddwarf is designed to support a single-tenant database within a Nova instance. There will be no restrictions on how Nova is configured, since Reddwarf interacts with other [[OpenStack]] components purely through the API. | ||
== reddwarf-api == | == reddwarf-api == | ||
The '''reddwarf-api''' service provides a RESTful API that supports JSON and XML to provision and manage Reddwarf instances. | The '''reddwarf-api''' service provides a RESTful API that supports JSON and XML to provision and manage Reddwarf instances. | ||
| + | * A REST-ful component | ||
| + | * Entry point - Reddwarf/bin/reddwarf-api | ||
| + | * Uses a WSGI launcher configured by Reddwarf/etc/reddwarf/api-paste.ini | ||
| + | ** Defines the pipeline of filters; tokenauth, ratelimit, etc. | ||
| + | ** Defines the app_factory for the reddwarfapp as reddwarf.common.api:app_factory | ||
| + | * The API class (a wsgi Router) wires the REST paths to the appropriate Controllers | ||
| + | ** Implementation of the Controllers are under the relevant module (versions/instance/flavor/limits), in the service.py module | ||
| + | * Controllers usually redirect implementation to a class in the models.py module | ||
| + | * At this point, an api module of another component (TaskManager, GuestAgent, etc.) is used to send the request onwards through RabbitMQ | ||
== reddwarf-taskmanager == | == reddwarf-taskmanager == | ||
The '''reddwarf-taskmanager''' service does the heavy lifting as far as provisioning instances, managing the lifecycle of instances, and performing operations on the Database instance. | The '''reddwarf-taskmanager''' service does the heavy lifting as far as provisioning instances, managing the lifecycle of instances, and performing operations on the Database instance. | ||
| + | * A service that listens on a RabbitMQ topic | ||
| + | * Entry point - Reddwarf/bin/reddwarf-taskmanager | ||
| + | * Runs as a RpcService configured by Reddwarf/etc/reddwarf/reddwarf-taskmanager.conf.sample which defines reddwarf.taskmanager.manager.Manager as the manager - basically this is the entry point for requests arriving through the queue | ||
| + | * As described above, requests for this component are pushed to MQ from another component using the TaskManager's api module using _cast() or _call() (sync/a-sync) and putting the method's name as a parameter | ||
| + | * Reddwarf/openstack/common/rpc/dispatcher.py- RpcDispatcher.dispatch() invokes the proper method in the Manager by some equivalent to reflection | ||
| + | * The Manager then redirect the handling to an object from the models.py module. It loads an object from the relevant class with the context and instance_id | ||
| + | * Actual handling is usually done in the models.py module | ||
== reddwarf-guestagent == | == reddwarf-guestagent == | ||
The '''guestagent''' is a service that runs within the guest instance, responsible for managing and performing operations on the Database itself. The Guest Agent listens for RCP messages through the message bus and performs the requested operation. | The '''guestagent''' is a service that runs within the guest instance, responsible for managing and performing operations on the Database itself. The Guest Agent listens for RCP messages through the message bus and performs the requested operation. | ||
| + | * Similar to TaskManager in the sense of running as a service that listens on a RabbitMQ topic | ||
| + | * GuestAgent runs on every DB instance, and a dedicated MQ topic is used (identified as the instance's id) | ||
| + | * Entry point - Reddwarf/bin/reddwarf-guestagent | ||
| + | * Runs as a RpcService configured by Reddwarf/etc/reddwarf/reddwarf-guestagent.conf.sample which defines reddwarf.guestagent.manager.Manager as the manager - basically this is the entry point for requests arriving through the queue | ||
| + | * As described above, requests for this component are pushed to MQ from another component using the GuestAgent's api module using _cast() or _call() (sync/a-sync) and putting the method's name as a parameter | ||
| + | * Reddwarf/openstack/common/rpc/dispatcher.py- RpcDispatcher.dispatch() invokes the proper method in the Manager by some equivalent to reflection | ||
| + | * The Manager then redirect the handling to an object (usually) from the dbaas.py module. | ||
| + | * Actual handling is usually done in the dbaas.py module | ||
= Installation and Deployment = | = Installation and Deployment = | ||
Revision as of 07:37, 27 March 2013
Contents
Description
Reddwarf is Database as a Service for Openstack. It's designed to run entirely on OpenStack, with the goal of allowing users to quickly and easily utilize the features of a relational database without the burden of handling complex administrative tasks. Cloud users and database administrators can provision and manage multiple database instances as needed. Initially, the service will focus on providing resource isolation at high performance while automating complex administrative tasks including deployment, configuration, patching, backups, restores, and monitoring.
Design
Reddwarf is designed to support a single-tenant database within a Nova instance. There will be no restrictions on how Nova is configured, since Reddwarf interacts with other OpenStack components purely through the API.
reddwarf-api
The reddwarf-api service provides a RESTful API that supports JSON and XML to provision and manage Reddwarf instances.
- A REST-ful component
- Entry point - Reddwarf/bin/reddwarf-api
- Uses a WSGI launcher configured by Reddwarf/etc/reddwarf/api-paste.ini
- Defines the pipeline of filters; tokenauth, ratelimit, etc.
- Defines the app_factory for the reddwarfapp as reddwarf.common.api:app_factory
- The API class (a wsgi Router) wires the REST paths to the appropriate Controllers
- Implementation of the Controllers are under the relevant module (versions/instance/flavor/limits), in the service.py module
- Controllers usually redirect implementation to a class in the models.py module
- At this point, an api module of another component (TaskManager, GuestAgent, etc.) is used to send the request onwards through RabbitMQ
reddwarf-taskmanager
The reddwarf-taskmanager service does the heavy lifting as far as provisioning instances, managing the lifecycle of instances, and performing operations on the Database instance.
- A service that listens on a RabbitMQ topic
- Entry point - Reddwarf/bin/reddwarf-taskmanager
- Runs as a RpcService configured by Reddwarf/etc/reddwarf/reddwarf-taskmanager.conf.sample which defines reddwarf.taskmanager.manager.Manager as the manager - basically this is the entry point for requests arriving through the queue
- As described above, requests for this component are pushed to MQ from another component using the TaskManager's api module using _cast() or _call() (sync/a-sync) and putting the method's name as a parameter
- Reddwarf/openstack/common/rpc/dispatcher.py- RpcDispatcher.dispatch() invokes the proper method in the Manager by some equivalent to reflection
- The Manager then redirect the handling to an object from the models.py module. It loads an object from the relevant class with the context and instance_id
- Actual handling is usually done in the models.py module
reddwarf-guestagent
The guestagent is a service that runs within the guest instance, responsible for managing and performing operations on the Database itself. The Guest Agent listens for RCP messages through the message bus and performs the requested operation.
- Similar to TaskManager in the sense of running as a service that listens on a RabbitMQ topic
- GuestAgent runs on every DB instance, and a dedicated MQ topic is used (identified as the instance's id)
- Entry point - Reddwarf/bin/reddwarf-guestagent
- Runs as a RpcService configured by Reddwarf/etc/reddwarf/reddwarf-guestagent.conf.sample which defines reddwarf.guestagent.manager.Manager as the manager - basically this is the entry point for requests arriving through the queue
- As described above, requests for this component are pushed to MQ from another component using the GuestAgent's api module using _cast() or _call() (sync/a-sync) and putting the method's name as a parameter
- Reddwarf/openstack/common/rpc/dispatcher.py- RpcDispatcher.dispatch() invokes the proper method in the Manager by some equivalent to reflection
- The Manager then redirect the handling to an object (usually) from the dbaas.py module.
- Actual handling is usually done in the dbaas.py module
Installation and Deployment
- How to install reddwarf as part of devstack: reddwarf-installation
- How to set up a testing environment and run redstack tests after installation: reddwarf-redstack-testing
- How to set up your Mac dev environment to debug: reddwarf-dev-env
- Releasing python-reddwarfclient release-python-reddwarfclient
Development
- Quota Management is currently in development: reddwarf-quotas
- Security Groups is currently in design/development: reddwarf-security-groups
- Snapshot Design: snapshot-design
- Versions and Types Design: Reddwarf-versions-types
- Diagrams: Reddwarf-Diagrams
