Meetings/Storlets
< Meetings
Revision as of 12:09, 13 January 2016 by Takashi Kajinami (talk | contribs)
Meeting Time: Every Wednesday at 13:00 UTC in #openstack-storlets
Agenda:
- NTT Updates
- Session in Openstack Hackathon
- Here is a first shot at defining an agenda: The purpose of the session is to update the community on what's happening in the openstack-storlets project and get feedback on number of subjects (the intention is not to discuss pushing the middleware to Swift at this point).
- Updates:
- Unit tests (Thanks NTT)
- storlets GET flow: https://review.openstack.org/#/c/263533/
- storlets PUT flow: https://review.openstack.org/#/c/264520/
- uploading storlets/dependency: https://review.openstack.org/#/c/264638/
- Copy semantics (I got a working prototype)
- Storlets samples (thumbnail extraction, more to come), what else?
- Unit tests (Thanks NTT)
- Points for discussion:
- Adding a non voting gate job for testing Storlets
- Use footers for adding metadata
- How to pass header information like Content-Type to storlet applications
- Resource limitation
- Should we the max number about containers or processes running on one node?
- Can we stop unnecessary containers/processes?
- To-be-fixed thing in swift
- chunked transferring stuff: https://review.openstack.org/#/c/256201/
- anything else in master?
- more?
- Updates:
- Here is a first shot at defining an agenda: The purpose of the session is to update the community on what's happening in the openstack-storlets project and get feedback on number of subjects (the intention is not to discuss pushing the middleware to Swift at this point).
- Next Openstack Summit
- Here is a first shot at a talk abstract:
- Title: From Analytic to Image Processing in Swift with Openstack Storlets
- Openstack Stolets is an emerging project aimed at pushing down data centric compute jobs to the object store. In this talk we will present the project, discuss and demonstrate use cases varying from spark analytic push down to image processing and present a PoC about an effective system architecture for image processing using Storlets done at NTT.
- Here is a first shot at a talk abstract: