Jump to: navigation, search

Difference between revisions of "Glance-tasks-api"

m (Task Schema)
(updated JSON schemas)
Line 20: Line 20:
 
An task entity has an identifier (id) that is guaranteed to be unique within the endpoint to which it belongs. The id is used as a token in request URIs to interact with that specific task.
 
An task entity has an identifier (id) that is guaranteed to be unique within the endpoint to which it belongs. The id is used as a token in request URIs to interact with that specific task.
  
An task is always guaranteed to have the following attributes: id, task_type, task_status, and self. The other attributes defined in the task schema below are guaranteed to be defined, but will only be returned with a task entity if they have been explicitly set.
+
An task is always guaranteed to have the following attributes: id, type, status, and self. The other attributes defined in the task schema below are guaranteed to be defined, but will only be returned with a task entity if they have been explicitly set.
  
 
<div style="background-color: yellow">
 
<div style="background-color: yellow">
Line 29: Line 29:
 
(no ordering, just using the numerals to keep count)
 
(no ordering, just using the numerals to keep count)
 
# id
 
# id
# owner
+
# type
# task_type
+
# status
# task_status
+
# owner : this is whatever is being used as the image owner in this glance installation
 +
# input : task "parameters"
 +
# result
 +
# created_at
 +
# updated_at
 
# expires_at
 
# expires_at
 
# message
 
# message
Line 46: Line 50:
 
             "description": "An identifier for the task",  
 
             "description": "An identifier for the task",  
 
             "pattern": "^([0-9a-fA-F]){8}-([0-9a-fA-F]){4}-([0-9a-fA-F]){4}-([0-9a-fA-F]){4}-([0-9a-fA-F]){12}$",  
 
             "pattern": "^([0-9a-fA-F]){8}-([0-9a-fA-F]){4}-([0-9a-fA-F]){4}-([0-9a-fA-F]){4}-([0-9a-fA-F]){12}$",  
             "type": "string"
+
             "type": "string",
 +
            "required": true
 
         },
 
         },
 
         "owner": {
 
         "owner": {
            /* not sure if we really need this property */
 
 
             "description": "An identifier for the owner of this task",  
 
             "description": "An identifier for the owner of this task",  
             "type": "string"          
+
             "type": "string",
 +
            "required": true   
 
         },
 
         },
         "task_type" : {
+
         "type" : {
 
             "description": "The type of task represented by this content",
 
             "description": "The type of task represented by this content",
 
             "enum": [
 
             "enum": [
Line 60: Line 65:
 
                 "clone"
 
                 "clone"
 
             ],
 
             ],
             "type": "string"
+
             "type": "string",
 +
            "required": true
 
         },
 
         },
         "task_status" : {
+
         "status" : {
 
             "description": "The current status of this task.",  
 
             "description": "The current status of this task.",  
 
             "enum": [
 
             "enum": [
Line 70: Line 76:
 
                 "failure"
 
                 "failure"
 
             ],
 
             ],
             "type": "string"
+
             "type": "string",
 +
            "required": true
 +
        },
 +
        "created_at": {
 +
            "description": "Datetime when this resource was created",
 +
            "type": "string",
 +
            "required": true
 +
        },
 +
        "updated_at": {
 +
            "description": "Datetime when this resource was most recently updated",
 +
            "type": "string",
 +
            "required": true
 
         },
 
         },
 
         "expires_at": {
 
         "expires_at": {
 
             "description": "Datetime when this resource is subject to removal",
 
             "description": "Datetime when this resource is subject to removal",
             "type": "string",
+
             "type": "string"
            "required" : false
 
 
         },
 
         },
        "message": {
+
      "message": {
 
           "description": "Human-readable informative message only included when appropriate (usually on failure)",
 
           "description": "Human-readable informative message only included when appropriate (usually on failure)",
 
           "type": "string",
 
           "type": "string",
           "required" : false,
+
        },
        }
+
        "input": {
 +
          "description": "The input parameters for this task",
 +
          "type": "object",
 +
           "required": true
 +
        },
 +
      "result": {
 +
          "description": "Informatic results of this task",
 +
          "type": "object",
 +
      },
 
     },
 
     },
 
     "links": [
 
     "links": [
Line 97: Line 121:
 
         }
 
         }
 
     ],  
 
     ],  
 
 
}
 
}
 
</pre>
 
</pre>
 
Actually, it may be better to just use this as a proto-schema and define a specific one for each task type, available at, e.g.,
 
* /v2/schemas/tasks/import
 
* /v2/schemas/tasks/export
 
* /v2/schemas/tasks/clone
 
 
<div style="background:yellow">
 
OK, you've got the basic idea.  I realized I'm doing this backwards.  The decision about whether each task gets its own schema or whether they can be combined into a single schema, or a single schema that references another schema to give the details for that kind of task should wait until after we've figured out what each task looks like.  Same deal with the requests/responses.
 
</div>
 
  
 
== Task Request Body ==
 
== Task Request Body ==
The basic tasks request will be <tt>Content-type: application/json</tt> and will look something like this:
+
The basic tasks request will be <tt>Content-type: application/json</tt> and is defined by the following JSON schema.
 
<pre>
 
<pre>
 
{
 
{
     "task-type": "{task-name}",
+
     "name": "task",
    "task-info": {
+
    "properties": {
        /* content will depend on the task type */
+
        "type": {
 +
            "description": "The type of task represented by this content",
 +
            "enum": [
 +
                "import",
 +
                "export",
 +
                "clone"
 +
            ],
 +
            "type": "string",
 +
            "required": true
 +
        },
 +
        "input": {
 +
            "description": "The input parameters for this task",
 +
            "type": "object",
 +
            "required": true
 +
        }
 
     }  
 
     }  
 
}
 
}
 
</pre>
 
</pre>
<div style="background-color:yellow">
+
 
Or there may be a different one for each task, still working on this.
 
</div>
 
  
 
== Task Response Body ==
 
== Task Response Body ==
Line 180: Line 206:
 
* original blueprint proposal <ref>https://blueprints.launchpad.net/glance/+spec/upload-download-workflow</ref>
 
* original blueprint proposal <ref>https://blueprints.launchpad.net/glance/+spec/upload-download-workflow</ref>
 
* mailing list discussion of original proposal <ref>http://lists.openstack.org/pipermail/openstack-dev/2013-May/009385.html</ref>
 
* mailing list discussion of original proposal <ref>http://lists.openstack.org/pipermail/openstack-dev/2013-May/009385.html</ref>
 +
* mailing list discussion of this proposal <ref>http://lists.openstack.org/pipermail/openstack-dev/2013-August/012866.html</ref>
 +
* etherpad of further discussion refining this proposal <ref>https://etherpad.openstack.org/LG39UnQA7z</ref>
  
 
== References ==
 
== References ==
 
<references />
 
<references />

Revision as of 17:29, 20 August 2013

Overview

This proposal unifies the new upload workflow [1], new download workflow [2], and image cloning [3] blueprints in an extensible, consistent, and easy-to-learn way.

General Workflow

  1. User posts a request to /v2/tasks
  2. Glance returns a 201 with Location: /v2/tasks/{task-uuid}
    • The resource at /v2/tasks/{task-uuid} will be an expirable entity
  3. User polls /v2/tasks/{task-uuid} for status information on the requested task
  4. Eventually, when the task is completed, the resource will contain
    • task result information, e.g.,
      • if the task was successful, the location of the result of the task
        • for import or clone tasks, this will be an /images resource
        • for export, it will be a location where the exported item may be retrieved
      • if the task was not successful, an informative message
    • the expiration datetime of the tasks resource itself

Task Entities

An task entity is represented by a JSON-encoded data structure.

An task entity has an identifier (id) that is guaranteed to be unique within the endpoint to which it belongs. The id is used as a token in request URIs to interact with that specific task.

An task is always guaranteed to have the following attributes: id, type, status, and self. The other attributes defined in the task schema below are guaranteed to be defined, but will only be returned with a task entity if they have been explicitly set.

Note: the task entity will need to have an "owner" field (whether or not it's exposed in the response) so that we can make sure that users can't see each other's tasks.

Task Properties

(no ordering, just using the numerals to keep count)

  1. id
  2. type
  3. status
  4. owner : this is whatever is being used as the image owner in this glance installation
  5. input : task "parameters"
  6. result
  7. created_at
  8. updated_at
  9. expires_at
  10. message

Task Schema

A json-schema for the task entity will be available at the URI /v2/schemas/tasks

And it goes a little something like this:

{
    "name": "task",
    "properties": {
        "id": {
            "description": "An identifier for the task", 
            "pattern": "^([0-9a-fA-F]){8}-([0-9a-fA-F]){4}-([0-9a-fA-F]){4}-([0-9a-fA-F]){4}-([0-9a-fA-F]){12}$", 
            "type": "string",
            "required": true
         },
        "owner": {
            "description": "An identifier for the owner of this task", 
            "type": "string",
            "required": true     
        },
        "type" : {
            "description": "The type of task represented by this content",
            "enum": [
                "import",
                "export",
                "clone"
            ],
            "type": "string",
            "required": true
        },
        "status" : {
            "description": "The current status of this task.", 
            "enum": [
                "pending",
                "processing",
                "success",
                "failure"
            ],
            "type": "string",
            "required": true
        },
        "created_at": {
            "description": "Datetime when this resource was created",
            "type": "string",
            "required": true
        },
         "updated_at": {
            "description": "Datetime when this resource was most recently updated",
            "type": "string",
            "required": true
        },
        "expires_at": {
            "description": "Datetime when this resource is subject to removal",
            "type": "string"
        },
       "message": {
           "description": "Human-readable informative message only included when appropriate (usually on failure)",
           "type": "string",
        },
        "input": {
           "description": "The input parameters for this task",
           "type": "object",
           "required": true
        },
       "result": {
           "description": "Informatic results of this task",
           "type": "object",
       },
    },
    "links": [
        {
            "href": "{self}", 
            "rel": "self"
        }, 
        {
            "href": "{file}", 
            "rel": "enclosure"
        }, 
        {
            "href": "{schema}", 
            "rel": "describedby"
        }
    ], 
}

Task Request Body

The basic tasks request will be Content-type: application/json and is defined by the following JSON schema.

{
    "name": "task",
    "properties": {
        "type": {
            "description": "The type of task represented by this content",
            "enum": [
                "import",
                "export",
                "clone"
            ],
            "type": "string",
            "required": true
        },
        "input": {
            "description": "The input parameters for this task",
            "type": "object",
            "required": true
        }
    } 
}


Task Response Body

The basic tasks response will be Content-type: application/json and will adhere to the json schema described above.

Task States

Tasks will have the following states:

  • pending : a task has been created, but Glance (via async worker or whatever) hasn't begun to execute the task yet
  • processing : the task is underway
  • success : the task has complete successfully
  • failure : something went wrong, the task was not able to complete


In the case of failure, it's expected that the task resource will contain a message explaining what went wrong.

Requests

Create a Task

POST /v2/tasks

Request body must be appropriate for the task_type.

Display Task Detail

GET /v2/tasks/{task_id}

Returns a task response as defined above.

List Tasks

GET /v2/tasks

Returns a list of tasks owned by the user making the request.

Query Parameters

We'll want to allow filtering on the task_type, e.g.,

GET /v2/tasks?task_type=import

would return all non-expired import tasks owned by the user making the request.

Open Questions

  1. What do we return when a user makes a GET for a task UUID that exists, but they don't own?
    • 401 or 404?
  2. The task request will return a 200 even when the task_status is 'failure' (since the task response itself is being returned OK). Some of these failures will be for things like not-found, format-not-supported, conflict ... this will be mentioned in the 'message' field, but do we want to have a separate failure code or something to make it easier for an API user to extract this info?

Proposed Tasks

  1. import [4]
  2. export [5]
  3. clone [6]

Related Documents

  • Havana summit discussion etherpad (see bottom of pad) [7]
  • original blueprint proposal [8]
  • mailing list discussion of original proposal [9]
  • mailing list discussion of this proposal [10]
  • etherpad of further discussion refining this proposal [11]

References

  1. https://wiki.openstack.org/wiki/Glance-tasks-import
  2. https://wiki.openstack.org/wiki/Glance-tasks-export
  3. https://wiki.openstack.org/wiki/Glance-tasks-clone
  4. https://wiki.openstack.org/wiki/Glance-tasks-import
  5. https://wiki.openstack.org/wiki/Glance-tasks-export
  6. https://wiki.openstack.org/wiki/Glance-tasks-clone
  7. https://etherpad.openstack.org/havana-getting-glance-ready-for-public-clouds
  8. https://blueprints.launchpad.net/glance/+spec/upload-download-workflow
  9. http://lists.openstack.org/pipermail/openstack-dev/2013-May/009385.html
  10. http://lists.openstack.org/pipermail/openstack-dev/2013-August/012866.html
  11. https://etherpad.openstack.org/LG39UnQA7z