Jump to: navigation, search

Difference between revisions of "Scientific SIG"

(IRC Meeting November 29th 2016)
(IRC Meeting March 21st 2017)
(34 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 
Status: Active (@May 2016)
 
Status: Active (@May 2016)
 
<br />
 
<br />
Chairs: Stig Telfer and Blair Bethwaite
+
Chairs: Stig Telfer, Blair Bethwaite and Martial Michel
 
<br />
 
<br />
 
OpenStack Foundation liaison: David F. Flanders <Flanders@OpenStack.org>
 
OpenStack Foundation liaison: David F. Flanders <Flanders@OpenStack.org>
Line 44: Line 44:
 
* The original proposal and call for nominations was drafted via this etherpad: https://etherpad.openstack.org/p/scientific-wg
 
* The original proposal and call for nominations was drafted via this etherpad: https://etherpad.openstack.org/p/scientific-wg
 
* The #scientific-wg originated from a conversation in the hallways of the Tokyo OpenStack summit (Oct 2015), ideas originating from John Taylor, Paul Calleja, Stig Telfer, Jonathan Proulx, David F. Flanders, Lauren Sell & Tom Fifield.
 
* The #scientific-wg originated from a conversation in the hallways of the Tokyo OpenStack summit (Oct 2015), ideas originating from John Taylor, Paul Calleja, Stig Telfer, Jonathan Proulx, David F. Flanders, Lauren Sell & Tom Fifield.
 +
 +
== Activity Areas ==
 +
 +
Every OpenStack development cycle, four activity areas are selected to focus on, and working group members
 +
gather data on problems and solutions in areas that affect them.
 +
 +
For the Ocata development cycle, the four activity areas are:
 +
 +
* [[ScientificWGMonitoringAndTelemetry|Monitoring and Telemetry]]
 +
* [[ScientificWGGPUs|GPUs in OpenStack]]
 +
* [[ScientificWGDataManagement|Data Management and Big Data]]
 +
* [[ScientificWGFederatedIdentityManagement|Scientific OpenStack Federation]]
 +
 +
=== Scientific OpenStack ===
 +
 +
The Scientific WG contributes knowledge and experience to the OpenStack Foundation's [https://www.openstack.org/science Scientific OpenStack site].
 +
 +
The Scientific WG also generated and maintains the content for the OpenStack/HPC guide "The Crossroads of Cloud and HPC: OpenStack for Scientific Research", published by the OpenStack Foundation and made available as an ebook.
  
 
== Meetings ==
 
== Meetings ==
  
 
=== Face-to-Face ===
 
=== Face-to-Face ===
The Scientific Working Group usually meets at the OpenStack Design summits, and also at operators mid-cycle meetups (where possible).
+
The Scientific Working Group usually meets at the OpenStack Summits, and also at operators mid-cycle meetups (where possible).
  
 +
* Boston Summit May 2017, Boston, MA, USA: https://etherpad.openstack.org/p/Scientific-WG-boston
 +
* Newton Design Summit April 2016, Austin, USA: https://etherpad.openstack.org/p/scientific-wg-austin-summit-agenda
 
* Operators mid-cycle February 2016, Manchester, UK: https://etherpad.openstack.org/p/MAN-ops-Scientific-WG
 
* Operators mid-cycle February 2016, Manchester, UK: https://etherpad.openstack.org/p/MAN-ops-Scientific-WG
* Newton Design Summit April 2016, Austin, USA: https://etherpad.openstack.org/p/scientific-wg-austin-summit-agenda
 
 
==== Barcelona Summit, October 2016 ====
 
  
The Scientific WG planned a range activities for the summit in Barcelona:
+
==== Boston Summit, May 2017 ====
  
# The [https://www.openstack.org/summit/barcelona-2016/summit-schedule/global-search?t=HPC+%2F+Research HPC / Research speaker track] has seven talks scheduled for Wednesday 26th and Thursday 27th
+
The Scientific WG is planning a range activities for the summit in Boston:
# A [https://www.openstack.org/summit/barcelona-2016/summit-schedule/events/16779/scientific-working-group-bof-and-poster-session BoF] for Scientific OpenStack. (Wednesday, October 26, 2:15pm-2:55pm, Hilton Diagonal Mar - P0 - Ballroom B)
 
## Lightning talks schedule TBC
 
# A [https://www.openstack.org/summit/barcelona-2016/summit-schedule/events/16780/scientific-working-group-meeting WG committee meeting] for progress review and planning. (Wednesday, October 26, 11:25am-12:05pm, AC Hotel - P14 - Pedralbes)
 
## [https://etherpad.openstack.org/p/scientific-wg-barcelona-agenda Agenda items for the meeting], please contribute.
 
# An evening social for members, supporters and friends of the Scientific WG.
 
  
 
+
# [https://etherpad.openstack.org/p/Scientific-WG-boston Boston Summit planning]
Some WG members have compiled a short list of [https://etherpad.openstack.org/p/Scientific-WG-summit-picks top picks from the summit schedule]
 
  
 
=== IRC Meetings ===
 
=== IRC Meetings ===
Line 75: Line 86:
 
Full details (including a calendar file) are available at [http://eavesdrop.openstack.org/#Scientific_Working_Group eavesdrop.openstack.org]. If you need help getting started with IRC see http://docs.openstack.org/upstream-training/irc.html.
 
Full details (including a calendar file) are available at [http://eavesdrop.openstack.org/#Scientific_Working_Group eavesdrop.openstack.org]. If you need help getting started with IRC see http://docs.openstack.org/upstream-training/irc.html.
  
==== IRC Meeting December 7th 2016 ====
+
==== IRC Meeting March 21st 2017 ====
2016-12-07 0900 UTC in channel #openstack-meeting
+
2017-03-21 2100 UTC in channel #openstack-meeting
 
 
# All things monitoring
 
## Discussion from last week on telemetry and monitoring: https://etherpad.openstack.org/p/scientific-wg-telemetry-and-monitoring
 
## Cloud workload traces: https://etherpad.openstack.org/p/Cloud_workload_traces
 
## Other developments in the telemetry/monitoring/tracing space
 
# Any other business
 
  
==== IRC Meeting November 29th 2016 ====
+
# Round-up from the OpenStack Operators Meetup
2016-11-29 2100 UTC in channel #openstack-meeting
+
## Scientific workload test cases sought for live migration
 +
# Boston Summit Forum - contribution to discussion
 +
## http://lists.openstack.org/pipermail/user-committee/2017-March/001856.html
 +
# Other Boston Summit planning
 +
# Future Online Analysis Platform Workshop
 +
## https://press3.mcs.anl.gov/futureplatform/
 +
## Request for materials from community for OpenStack presentation
  
# Network performance with VXLAN and OVS - some test results
+
[http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-03-21-21.01.html Minutes from the meeting]
# OpenStack telemetry and monitoring use cases for research computing
 
# Any other business
 
  
[http://eavesdrop.openstack.org/meetings/scientific_wg/2016/scientific_wg.2016-11-29-21.01.html Minutes from the meeting]
+
==== IRC Meeting March 15th 2017 ====
 +
CANCELLED - due to Operators Meetup
  
==== IRC Meeting November 23rd 2016 ====
+
==== IRC Meeting March 7th 2017 ====
2016-11-23 0900 UTC in channel #openstack-meeting
+
2017-03-07 2100 UTC in channel #openstack-meeting
  
# Wrap up from Supercomputing 2016
+
# Forum brainstorming for Boston summit - second pass
# Scientific datasets - update from Sofiane and Saverio
+
## https://superuser.openstack.org/articles/openstack-forum/
# Federation user story up for review
+
## https://wiki.openstack.org/wiki/Forum
# Upcoming Scientific OpenStack events
+
## http://lists.openstack.org/pipermail/user-committee/2017-February/001767.html
 +
## https://etherpad.openstack.org/p/BOS-UC-brainstorming-scientific-wg
 +
## https://etherpad.openstack.org/p/Scientific-WG-boston
  
[http://eavesdrop.openstack.org/meetings/scientific_wg/2016/scientific_wg.2016-11-23-09.00.html Minutes from the meeting]
+
[http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-03-07-21.00.html Minutes from the meeting]
  
==== IRC Meeting November 9th 2016 ====
+
==== IRC Meeting March 1st 2017 ====
2016-11-09 0900 UTC in channel #openstack-meeting
+
2017-03-01 0900 UTC in channel #openstack-meeting
  
# Selection/confirmation of New Activity Areas for Ocata Cycle
+
# Forum brainstorming for Boston summit
## https://etherpad.openstack.org/p/scientific-wg-barcelona-agenda
+
## https://superuser.openstack.org/articles/openstack-forum/
## Discussion from last week: http://eavesdrop.openstack.org/meetings/scientific_wg/2016/scientific_wg.2016-11-01-21.02.log.html#l-28
+
## https://wiki.openstack.org/wiki/Forum
## Telemetry & Monitoring: oneswig & martial
+
## http://lists.openstack.org/pipermail/user-committee/2017-February/001767.html
## Federation: aloga
+
## https://etherpad.openstack.org/p/Scientific-WG-boston
## Scientific Datasets & Data Analytics: TBD (zioproto?)
 
## GPUs and Virtualisation: powerd
 
# 3-slot meeting rota?
 
# Brainstorm of 'Forum' session proposals for Boston
 
# WG Picks from the Summit
 
## Developer sessions
 
## Video Archive
 
# Plans for Supercomputing 2016
 
## Evening social?
 
## Superuser blog post?
 
  
[http://eavesdrop.openstack.org/meetings/scientific_wg/2016/scientific_wg.2016-11-09-09.00.html Minutes from the meeting]
+
[http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-03-01-09.00.html Minutes from the meeting]
  
 
==== Earlier Meetings ====
 
==== Earlier Meetings ====

Revision as of 22:03, 21 March 2017

Status: Active (@May 2016)
Chairs: Stig Telfer, Blair Bethwaite and Martial Michel
OpenStack Foundation liaison: David F. Flanders <Flanders@OpenStack.org>

Welcome to the OpenStack Scientific Working Group landing page.
Please cite this working group using the #scientific-wg tag on listservs, github, blogs, twitter and other social infrastructure.

Purpose

Aim: The Scientific Working Group is dedicated to representing and advancing the use-cases and needs of research and high-performance computing atop OpenStack. It's also a great forum for cross-institutional collaboration. If you are (or would like to) run OpenStack to support researchers/scientists/academics and/or HPC/HTC, then please join!

Objectives:

  • HPC/HTC Infrastructure
  • Research Data Infrastructure
  • Application Infrastructure
  • Social Infrastructure
  • Create opportunities for the scientific community to engage the wider OpenStack community, i.e. industry,


Communication

The default communication of our members is via the following open community mailing lists:


Please use the hashtag "scientific-wg" for tagging any etherpad URLs, code, blogs posts, scientific research and/or other social publishing platforms.

Members

No formal membership is required. Please introduce yourself and/or fellow colleagues to this working group using one of the mailing lists below, or by attending one of the IRC meetings.

This group is open to all members of the scientific OpenStack community and supporting vendors.

History

Significant dates for the working group (in reverse chronological order):

  • [Please add latest activity for the #scientific-wg here at the top of this list]
  • A proposal for hosting a face-to-face working group meeting was drafted at the following document: https://docs.google.com/document/d/10d7XDC1yw3thjxMMC1EXJlfmMAcjkfj2wnhH2MJgh9k/edit
  • The group was approved by the OpenStack foundation's User Committee board and wiki page minted on 15th January 2016.
  • The original proposal and call for nominations was drafted via this etherpad: https://etherpad.openstack.org/p/scientific-wg
  • The #scientific-wg originated from a conversation in the hallways of the Tokyo OpenStack summit (Oct 2015), ideas originating from John Taylor, Paul Calleja, Stig Telfer, Jonathan Proulx, David F. Flanders, Lauren Sell & Tom Fifield.

Activity Areas

Every OpenStack development cycle, four activity areas are selected to focus on, and working group members gather data on problems and solutions in areas that affect them.

For the Ocata development cycle, the four activity areas are:

Scientific OpenStack

The Scientific WG contributes knowledge and experience to the OpenStack Foundation's Scientific OpenStack site.

The Scientific WG also generated and maintains the content for the OpenStack/HPC guide "The Crossroads of Cloud and HPC: OpenStack for Scientific Research", published by the OpenStack Foundation and made available as an ebook.

Meetings

Face-to-Face

The Scientific Working Group usually meets at the OpenStack Summits, and also at operators mid-cycle meetups (where possible).

Boston Summit, May 2017

The Scientific WG is planning a range activities for the summit in Boston:

  1. Boston Summit planning

IRC Meetings

For the best global coverage, IRC meetings are held in alternating time zones:

  • Every two weeks on even weeks, 2100 UTC on Tuesday in IRC channel #openstack-meeting
  • Every two weeks on odd weeks, 0900 UTC on Wednesday in IRC channel #openstack-meeting

Full details (including a calendar file) are available at eavesdrop.openstack.org. If you need help getting started with IRC see http://docs.openstack.org/upstream-training/irc.html.

IRC Meeting March 21st 2017

2017-03-21 2100 UTC in channel #openstack-meeting

  1. Round-up from the OpenStack Operators Meetup
    1. Scientific workload test cases sought for live migration
  2. Boston Summit Forum - contribution to discussion
    1. http://lists.openstack.org/pipermail/user-committee/2017-March/001856.html
  3. Other Boston Summit planning
  4. Future Online Analysis Platform Workshop
    1. https://press3.mcs.anl.gov/futureplatform/
    2. Request for materials from community for OpenStack presentation

Minutes from the meeting

IRC Meeting March 15th 2017

CANCELLED - due to Operators Meetup

IRC Meeting March 7th 2017

2017-03-07 2100 UTC in channel #openstack-meeting

  1. Forum brainstorming for Boston summit - second pass
    1. https://superuser.openstack.org/articles/openstack-forum/
    2. https://wiki.openstack.org/wiki/Forum
    3. http://lists.openstack.org/pipermail/user-committee/2017-February/001767.html
    4. https://etherpad.openstack.org/p/BOS-UC-brainstorming-scientific-wg
    5. https://etherpad.openstack.org/p/Scientific-WG-boston

Minutes from the meeting

IRC Meeting March 1st 2017

2017-03-01 0900 UTC in channel #openstack-meeting

  1. Forum brainstorming for Boston summit
    1. https://superuser.openstack.org/articles/openstack-forum/
    2. https://wiki.openstack.org/wiki/Forum
    3. http://lists.openstack.org/pipermail/user-committee/2017-February/001767.html
    4. https://etherpad.openstack.org/p/Scientific-WG-boston

Minutes from the meeting

Earlier Meetings

Minutes and transcripts from all previous meetings can be found here.