Jump to: navigation, search

Difference between revisions of "Meetings/Storlets"

(Agenda:)
 
(96 intermediate revisions by 4 users not shown)
Line 1: Line 1:
Meeting Time: Every Wednesday at 13:00 UTC in #openstack-storlets
+
Past Meeting Time: Every Thursday at 07:00 UTC in #openstack-meeting
 +
* 15:00 JST
 +
* 10:00 IST
  
=Agenda:=
+
Because of inactivity we don't hold regular meetings now.
* Prioritize patches (suggestion):
+
Please reach out to PTL or other members if you have any topic for discussion.
** https://review.openstack.org/#/c/283486/ (COPY functionality)
 
** https://review.openstack.org/#/c/276545/ (Improve timeout handling)
 
** https://review.openstack.org/#/c/282135/ (Refactor unit tests about storlet docker gateway)
 
** https://review.openstack.org/#/c/280570/ (waiting 282135)
 
** https://review.openstack.org/#/c/285947/ (Refactor directory structure about python modules): Should be fixed
 
*** We should decide when we deal with directory refactoring, to avoid many merge conflicts caused by that change. [takashi]
 
  
 +
== Meeting Name: storlets (#startmeeting storlets) ==
 +
== Meeting Logs:  http://eavesdrop.openstack.org/meetings/storlets ==
 +
== Sorry, but cannot attend ==
 +
Please fill below date, nick for dates you know you cannot attend.
  
* Storlet in Hackathon etherpad
+
=Agenda:=
** I would like to add another analytics related question.
+
* Discuss patches
** What timeframe do we think we need?
+
* Hot links (To be updated in the IRC channel topic as soon as I get permission :-)
 
+
# PTG: https://etherpad.openstack.org/p/storlets-pike-design-summit
=Austin:=
+
# https://etherpad.openstack.org/p/storlets-review-priorities
* We currently have the following abstract
 
** Title: From Analytic to Image Processing in Swift with Openstack Storlets
 
** Openstack Stolets is an emerging Openstack project aimed at pushing down data centric compute jobs to the object store. Storlets offer a server-less programming model enabling developers to quickly develop and deploy data path computations without worrying about the underlying platform details.
 
** Storlets facilitate several interesting use cases such as:
 
*** Performing image processing in the storage, allowing to process large objects without downloading it.
 
*** Spark analytic push down to the store, saving on both bandwidth and memory in the analytic cluster.
 
*** Data obfuscation and anonymization at the source. Thus, preventing sensitive data from ever leaving the store.
 
** In this talk we will present the project, discuss and demonstrate the use cases and present a PoC about an effective architecture for image processing using Storlets done at NTT.
 
 
 
=Swift Hackathon=
 
* See the following etherpad
 
** https://etherpad.openstack.org/p/swift-hackathon-feb-2016-storlets
 
 
 
=Bugs=
 
* Range handling: on going
 
** bug reports
 
*** https://bugs.launchpad.net/storlets/+bug/1534414
 
*** https://bugs.launchpad.net/storlets/+bug/1534455
 
** patches
 
*** https://review.openstack.org/#/c/282931/
 
*** https://review.openstack.org/#/c/283423/
 
* FD leak
 
** FD leak in Storlet GET: https://bugs.launchpad.net/storlets/+bug/1537982 (Fix Released)
 
*** https://review.openstack.org/#/c/272379/ ... merged
 
** There are other possible FD leaks, which may happen in timeout/exception case.
 
*** Use context manager to make sure all FDs are closed: https://review.openstack.org/#/c/282211/ (patch should be fixed)
 

Latest revision as of 15:59, 31 May 2021

Past Meeting Time: Every Thursday at 07:00 UTC in #openstack-meeting

  • 15:00 JST
  • 10:00 IST

Because of inactivity we don't hold regular meetings now. Please reach out to PTL or other members if you have any topic for discussion.

Meeting Name: storlets (#startmeeting storlets)

Meeting Logs: http://eavesdrop.openstack.org/meetings/storlets

Sorry, but cannot attend

Please fill below date, nick for dates you know you cannot attend.

Agenda:

  • Discuss patches
  • Hot links (To be updated in the IRC channel topic as soon as I get permission :-)
  1. PTG: https://etherpad.openstack.org/p/storlets-pike-design-summit
  2. https://etherpad.openstack.org/p/storlets-review-priorities