Jump to: navigation, search

Difference between revisions of "MagnetoDB/specs/monitoring-api"

(Work Items)
m (MagnetoDB monitoring api)
Line 4: Line 4:
  
 
The API for exposing usage statistic for users, external monitoring or billing tools.
 
The API for exposing usage statistic for users, external monitoring or billing tools.
 
=== Problem Description ===
 
 
As a magnetodb user I need to know how much data I have in table
 
As a magnetodb administrator I need to know now much space is used with user's table
 
As a accountant department I need to know how big user's table is in order to create a bill
 
  
 
=== Proposed Change ===
 
=== Proposed Change ===
Line 18: Line 12:
 
Response:
 
Response:
 
{size: 1003432; item_count: 3000}
 
{size: 1003432; item_count: 3000}
 
==== Alternatives ====
 
 
Implement as part of data API. However it gives access to data itself for monitoring tools.
 
  
 
==== Security Impact ====
 
==== Security Impact ====
  
* authorization is performed by user's token
+
* secure communication with MQ should be configured
* authorization can be performed by token with specific role
 
  
 
==== Notifications Impact ====
 
==== Notifications Impact ====
Line 35: Line 24:
 
Now we have POC for count items in table (https://review.openstack.org/#/c/118557/) but this implementation is very expensive (we scan all our data to get one counter). So we need change concept and use Cassandra JMX to get approximate number of items and also size of CF on disk.
 
Now we have POC for count items in table (https://review.openstack.org/#/c/118557/) but this implementation is very expensive (we scan all our data to get one counter). So we need change concept and use Cassandra JMX to get approximate number of items and also size of CF on disk.
  
==== Other Deployer Impact ====
+
==== Deployment Impact ====
 
None
 
None
 
==== Developer Impact ====
 
==== Developer Impact ====
Line 56: Line 45:
  
 
===== Dependencies =====
 
===== Dependencies =====
[http://www.jolokia.org Jolokia]
+
[https://wiki.openstack.org/wiki/Oslo/Messaging Oslo.Messaging]
  
 
==== Documentation Impact ====
 
==== Documentation Impact ====
Monitoring API section should be added here http://magnetodb.readthedocs.org/en/latest/api_reference.html
+
Magnetodb Schema Processor deployment should be added to corresponding doc (TBD)
 
==== References ====
 
==== References ====
 
None
 
None

Revision as of 14:25, 18 September 2014

MagnetoDB monitoring api

Launchpad: monitoring-api

The API for exposing usage statistic for users, external monitoring or billing tools.

Proposed Change

  1. Introduce monitoring API available on the same port as data API by path /moninoting/*
  2. implement REST method for list of tables /moninoting/{tenant_id}/tables
  3. table usage details /moninoting/{tenant_id}/table/{table_name}

Response: {size: 1003432; item_count: 3000}

Security Impact

  • secure communication with MQ should be configured

Notifications Impact

None

Other End User Impact

TBD

Performance Impact

Now we have POC for count items in table (https://review.openstack.org/#/c/118557/) but this implementation is very expensive (we scan all our data to get one counter). So we need change concept and use Cassandra JMX to get approximate number of items and also size of CF on disk.

Deployment Impact

None

Developer Impact

None

Implementation

Current concept: at Cassandra node we run JMX-HTTP bridge agent (Jolokia). Client goes to MagnetoDB with REST-like interface (.../moninoting/{tenant_id}/table/{table_name}), MagnetoDB goes to Jolokia agent via HTTP, get JMX-metrics from Cassanra and returns them to client. If you have any suggestions about implementation - welcome to our IRC-channel at Freenode #magnetodb.

Assignee(s)

Primary assignee:

 <ominakov>

Other contributors:

 <None>


Work Items
  1. Define Monitoring API on wiki.
  2. Write interface for API.
  3. Implement calls from MagnetoDB to Jolokia agent.
Dependencies

Oslo.Messaging

Documentation Impact

Magnetodb Schema Processor deployment should be added to corresponding doc (TBD)

References

None