Jump to: navigation, search

Scientific SIG

Revision as of 21:10, 6 December 2016 by Stig Telfer (talk | contribs)

Status: Active (@May 2016)
Chairs: Stig Telfer, Blair Bethwaite and Martial Michel
OpenStack Foundation liaison: David F. Flanders <Flanders@OpenStack.org>

Welcome to the OpenStack Scientific Working Group landing page.
Please cite this working group using the #scientific-wg tag on listservs, github, blogs, twitter and other social infrastructure.


Aim: The Scientific Working Group is dedicated to representing and advancing the use-cases and needs of research and high-performance computing atop OpenStack. It's also a great forum for cross-institutional collaboration. If you are (or would like to) run OpenStack to support researchers/scientists/academics and/or HPC/HTC, then please join!


  • HPC/HTC Infrastructure
  • Research Data Infrastructure
  • Application Infrastructure
  • Social Infrastructure
  • Create opportunities for the scientific community to engage the wider OpenStack community, i.e. industry,


The default communication of our members is via the following open community mailing lists:

Please use the hashtag "scientific-wg" for tagging any etherpad URLs, code, blogs posts, scientific research and/or other social publishing platforms.


No formal membership is required. Please introduce yourself and/or fellow colleagues to this working group using one of the mailing lists below, or by attending one of the IRC meetings.

This group is open to all members of the scientific OpenStack community and supporting vendors.


Significant dates for the working group (in reverse chronological order):

  • [Please add latest activity for the #scientific-wg here at the top of this list]
  • A proposal for hosting a face-to-face working group meeting was drafted at the following document: https://docs.google.com/document/d/10d7XDC1yw3thjxMMC1EXJlfmMAcjkfj2wnhH2MJgh9k/edit
  • The group was approved by the OpenStack foundation's User Committee board and wiki page minted on 15th January 2016.
  • The original proposal and call for nominations was drafted via this etherpad: https://etherpad.openstack.org/p/scientific-wg
  • The #scientific-wg originated from a conversation in the hallways of the Tokyo OpenStack summit (Oct 2015), ideas originating from John Taylor, Paul Calleja, Stig Telfer, Jonathan Proulx, David F. Flanders, Lauren Sell & Tom Fifield.

Activity Areas

Every OpenStack development cycle, four activity areas are selected to focus on, and working group members gather data on problems and solutions in areas that affect them.

For the Ocata development cycle, the four activity areas are monitoring and telemetry, GPUs, data management and federated identity management.

Monitoring and Telemetry

GPUs in OpenStack

Data Management

Federated Identity Management



The Scientific Working Group usually meets at the OpenStack Design summits, and also at operators mid-cycle meetups (where possible).

Barcelona Summit, October 2016

The Scientific WG planned a range activities for the summit in Barcelona:

  1. The HPC / Research speaker track has seven talks scheduled for Wednesday 26th and Thursday 27th
  2. A BoF for Scientific OpenStack. (Wednesday, October 26, 2:15pm-2:55pm, Hilton Diagonal Mar - P0 - Ballroom B)
    1. Lightning talks schedule TBC
  3. A WG committee meeting for progress review and planning. (Wednesday, October 26, 11:25am-12:05pm, AC Hotel - P14 - Pedralbes)
    1. Agenda items for the meeting, please contribute.
  4. An evening social for members, supporters and friends of the Scientific WG.

Some WG members have compiled a short list of top picks from the summit schedule

IRC Meetings

For the best global coverage, IRC meetings are held in alternating time zones:

  • Every two weeks on even weeks, 2100 UTC on Tuesday in IRC channel #openstack-meeting
  • Every two weeks on odd weeks, 0900 UTC on Wednesday in IRC channel #openstack-meeting

Full details (including a calendar file) are available at eavesdrop.openstack.org. If you need help getting started with IRC see http://docs.openstack.org/upstream-training/irc.html.

IRC Meeting December 7th 2016

2016-12-07 0900 UTC in channel #openstack-meeting

  1. All things monitoring
    1. Discussion from last week on telemetry and monitoring: https://etherpad.openstack.org/p/scientific-wg-telemetry-and-monitoring
    2. Cloud workload traces: https://etherpad.openstack.org/p/Cloud_workload_traces
    3. Other developments in the telemetry/monitoring/tracing space
  2. Any other business

IRC Meeting November 29th 2016

2016-11-29 2100 UTC in channel #openstack-meeting

  1. Network performance with VXLAN and OVS - some test results
  2. OpenStack telemetry and monitoring use cases for research computing
  3. Any other business

Minutes from the meeting

IRC Meeting November 23rd 2016

2016-11-23 0900 UTC in channel #openstack-meeting

  1. Wrap up from Supercomputing 2016
  2. Scientific datasets - update from Sofiane and Saverio
  3. Federation user story up for review
  4. Upcoming Scientific OpenStack events

Minutes from the meeting

IRC Meeting November 9th 2016

2016-11-09 0900 UTC in channel #openstack-meeting

  1. Selection/confirmation of New Activity Areas for Ocata Cycle
    1. https://etherpad.openstack.org/p/scientific-wg-barcelona-agenda
    2. Discussion from last week: http://eavesdrop.openstack.org/meetings/scientific_wg/2016/scientific_wg.2016-11-01-21.02.log.html#l-28
    3. Telemetry & Monitoring: oneswig & martial
    4. Federation: aloga
    5. Scientific Datasets & Data Analytics: TBD (zioproto?)
    6. GPUs and Virtualisation: powerd
  2. 3-slot meeting rota?
  3. Brainstorm of 'Forum' session proposals for Boston
  4. WG Picks from the Summit
    1. Developer sessions
    2. Video Archive
  5. Plans for Supercomputing 2016
    1. Evening social?
    2. Superuser blog post?

Minutes from the meeting

Earlier Meetings

Minutes and transcripts from all previous meetings can be found here.