Jump to: navigation, search

Difference between revisions of "Scientific SIG"

m (IRC Meeting September 5th 2017)
(IRC Meeting December 12th 2017)
(27 intermediate revisions by 3 users not shown)
Line 5: Line 5:
 
OpenStack Foundation liaison: David F. Flanders <Flanders@OpenStack.org>
 
OpenStack Foundation liaison: David F. Flanders <Flanders@OpenStack.org>
  
Welcome to the OpenStack Scientific Working Group landing page.
+
Welcome to the OpenStack Scientific Special Interest Group (SIG) landing page.
 
<br />
 
<br />
Please cite this working group using the #scientific tag on listservs, github, blogs, twitter and other social infrastructure.
+
Please cite this SIG using the #scientific tag on listservs, github, blogs, twitter and other social infrastructure.
  
 
== Purpose ==
 
== Purpose ==
'''Aim''': The Scientific Working Group is dedicated to representing and advancing the use-cases and needs of research and high-performance computing atop OpenStack. It's also a great forum for cross-institutional collaboration. If you are (or would like to) run OpenStack to support researchers/scientists/academics and/or HPC/HTC, then please join!
+
'''Aim''': The Scientific SIG is dedicated to representing and advancing the use-cases and needs of research and high-performance computing with OpenStack. It's also a great forum for cross-institutional collaboration. If you are (or would like to) run OpenStack to support researchers/scientists/academics and/or HPC/HTC, then please join!
 
<br />
 
<br />
 
<br />
 
<br />
Line 24: Line 24:
 
The default communication of our members is via the following open community mailing lists:
 
The default communication of our members is via the following open community mailing lists:
  
* [http://lists.openstack.org/cgi-bin/mailman/listinfo/user-committee user-committee@lists.openstack.org] for coordination of working group activities.  Please prefix email subject lines with the tag "[scientific-wg]".
+
* [http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-sigs openstack-sigs@lists.openstack.org] for coordination of SIG activities.  Please prefix email subject lines with the tag "[scientific]".
 
* [http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators openstack-operators@lists.openstack.org] for operational discussion of scientific OpenStack deployment issues.  Please prefix email subject lines with the tag "[scientific]".
 
* [http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators openstack-operators@lists.openstack.org] for operational discussion of scientific OpenStack deployment issues.  Please prefix email subject lines with the tag "[scientific]".
  
Line 31: Line 31:
  
 
== Members ==
 
== Members ==
No formal membership is required.  Please introduce yourself and/or fellow colleagues to this working group using one of the mailing lists below, or by attending one of the IRC meetings.
+
No formal membership is required.  Please introduce yourself and/or fellow colleagues to this SIG using one of the mailing lists above, or by attending one of the IRC meetings.
  
 
This group is open to all members of the scientific OpenStack community and supporting vendors.
 
This group is open to all members of the scientific OpenStack community and supporting vendors.
Line 37: Line 37:
 
== History ==
 
== History ==
  
Significant dates for the working group (in reverse chronological order):
+
Significant dates for the SIG (in reverse chronological order):
  
* ''[Please add latest activity for the #scientific-wg here at the top of this list]''
+
* ''[Please add latest activity for the #scientific SIG here at the top of this list]''
 +
* The group previously known as the Scientific Working Group adopted SIG status in accordance with recommendation by the OpenStack User Committee
 
* A proposal for hosting a face-to-face working group meeting was drafted at the following document: https://docs.google.com/document/d/10d7XDC1yw3thjxMMC1EXJlfmMAcjkfj2wnhH2MJgh9k/edit
 
* A proposal for hosting a face-to-face working group meeting was drafted at the following document: https://docs.google.com/document/d/10d7XDC1yw3thjxMMC1EXJlfmMAcjkfj2wnhH2MJgh9k/edit
 
* The group was approved by the OpenStack foundation's User Committee board and wiki page minted on 15th January 2016.
 
* The group was approved by the OpenStack foundation's User Committee board and wiki page minted on 15th January 2016.
Line 47: Line 48:
 
== Activity Areas ==
 
== Activity Areas ==
  
Every OpenStack development cycle, four activity areas are selected to focus on, and working group members
+
Every OpenStack development cycle, we select focus areas of interest to active members at the time. These SIG members
 
gather data on problems and solutions in areas that affect them.
 
gather data on problems and solutions in areas that affect them.
  
Line 66: Line 67:
  
 
=== Face-to-Face ===
 
=== Face-to-Face ===
The Scientific Working Group usually meets at the OpenStack Summits, and also at operators mid-cycle meetups (where possible).
+
The Scientific SIG usually meets at the OpenStack Summits, and also at operators mid-cycle meetups (where possible).
  
 
* Boston Summit May 2017, Boston, MA, USA: https://etherpad.openstack.org/p/Scientific-WG-boston
 
* Boston Summit May 2017, Boston, MA, USA: https://etherpad.openstack.org/p/Scientific-WG-boston
Line 86: Line 87:
 
Full details (including a calendar file) are available at [http://eavesdrop.openstack.org/#Scientific_Working_Group eavesdrop.openstack.org]. If you need help getting started with IRC see http://docs.openstack.org/upstream-training/irc.html.
 
Full details (including a calendar file) are available at [http://eavesdrop.openstack.org/#Scientific_Working_Group eavesdrop.openstack.org]. If you need help getting started with IRC see http://docs.openstack.org/upstream-training/irc.html.
  
==== IRC Meeting September 5th 2017 ====
+
==== IRC Meeting December 12th 2017 ====
2017-09-05 2100 UTC in channel #openstack-meeting
+
2017-12-12 2100 UTC in channel #openstack-meeting
  
# Taking advantage of opportunistic capacity on OpenStack
+
Federation in Research Computing round-up
## Experiences and solutions sought!
+
# Open Research Cloud Alliance update
## Preemptible instances spec: input sought - https://review.openstack.org/#/c/438640
+
# NIST/IEEE WG
# Private cloud capacity meter
+
# Aristotle Cloud Federation - https://federatedcloud.org/
## https://github.com/johngarbutt/os-capacity
 
## NeCTAR's capacity monitoring: https://status.rc.nectar.org.au/capacity/
 
# Updated edition of the Scientific OpenStack book: Progress report
 
## Deadline for submission of WG input - 22nd September 2017
 
## Opportunities for new case studies
 
# Scientific SIG
 
  
==== IRC Meeting August 30th 2017 ====
+
[http://eavesdrop.openstack.org/meetings/scientific_sig/2017/scientific_sig.2017-12-12-21.00.html Minutes from the meeting]
2017-08-30 1100 UTC in channel #openstack-meeting
 
  
# Updated edition of the Scientific OpenStack book
+
==== IRC Meeting November 28th 2017 ====
## Deadline for submission of WG input - 22nd September 2017
+
2017-11-28 2100 UTC in channel #openstack-meeting
## Volunteers for contributions - https://github.com/openstack/scientific-wg
 
## Opportunities for new case studies
 
## Revisions to old studies
 
  
[http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-08-30-11.01.html Minutes from the meeting]
+
Slurm-as-a-Service on OpenStack
 +
# OpenHPC on OpenStack
 +
## https://github.com/hpc-cloud-toolkit/ostack-hpc
 +
# Massachusetts Open Cloud
 +
## https://www.openstack.org/videos/sydney-2017/htc-service-on-underutilized-openstack-cloud-resources
  
==== IRC Meeting August 22nd 2017 ====
+
==== IRC Meeting November 22nd 2017 ====
2017-08-22 2100 UTC in channel #openstack-meeting
+
2017-11-22 1100 UTC in channel #openstack-meeting
  
(partial repeat of past week)
+
# Sydney summit roundup for SIG activities
# Updated edition of the Scientific OpenStack book
+
## Summit talk picks
## Deadline for submission of WG input - 22nd September 2017
+
## Focus areas for this cycle
## Volunteers for contributions - https://github.com/openstack/scientific-wg
+
# Supercomputing 2017 roundup
# ORC Update and planning
+
# Manchester OpenStack Meetup, December 12 (+/-): HPC session planned
 +
## Coinciding with CIUK 2017 - http://www.stfc.ac.uk/news-events-and-publications/events/general-interest-events/computing-insight-uk/
 +
# Scientific SIG at RCUK Cloud Workshop 2018, Francis Crick Institute, London
 +
## https://www.eventbrite.co.uk/e/research-councils-uk-cloud-workshop-tickets-39439492584
  
==== IRC Meeting August 16th 2017 ====
+
[http://eavesdrop.openstack.org/meetings/scientific_sig/2017/scientific_sig.2017-11-22-11.00.html Minutes from the meeting]
2017-08-16 1100 UTC in channel #openstack-meeting
 
  
# Updated edition of the Scientific OpenStack book
+
==== IRC Meeting October 17th 2017 ====
## Deadline for submission of WG input - 22nd September 2017
+
2017-10-17 2100 UTC in channel #openstack-meeting
## Volunteers for contributions - https://github.com/openstack/scientific-wg
 
# Scientific WG at OpenStack Days UK - 26th September 2017
 
# ORC Update and planning
 
  
[http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-08-16-11.00.html Minutes from the meeting]
+
# Sydney Summit - SIG and Forum activities
 +
# Open Research Cloud Update
 +
# Supercomputing - book monitor request!
  
==== IRC Meeting August 8th 2017 ====
+
[http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-10-17-21.00.html Minutes from the meeting]
2017-08-08 2100 UTC in channel #openstack-meeting
 
  
# Supercomputing 2017
+
==== IRC Meeting October 11th 2017 ====
## BoF application submitted
+
2017-10-11 1100 UTC in channel #openstack-meeting
## Update to the Scientific OpenStack book - https://github.com/openstack/scientific-wg
+
 
## Request for a SuperUser guest post - volunteers please.
+
# Sydney Summit session prep
# User Committee nominations
+
# Monash OpenStack HPC expansion plans
 +
# Mellanox SR-IOV / RoCE tuning shenanigans
 +
 
 +
[http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-09-27-11.00.html Minutes from the meeting]
  
 
==== Earlier Meetings ====
 
==== Earlier Meetings ====
Line 144: Line 142:
 
Minutes and transcripts from all previous meetings can be found [http://eavesdrop.openstack.org/meetings/scientific_wg/ here].
 
Minutes and transcripts from all previous meetings can be found [http://eavesdrop.openstack.org/meetings/scientific_wg/ here].
  
[[Category: Working_Groups]]
+
[[Category: SIGs]]

Revision as of 22:05, 12 December 2017

Status: Active (@May 2016)
Chairs: Stig Telfer, Blair Bethwaite and Martial Michel
OpenStack Foundation liaison: David F. Flanders <Flanders@OpenStack.org>

Welcome to the OpenStack Scientific Special Interest Group (SIG) landing page.
Please cite this SIG using the #scientific tag on listservs, github, blogs, twitter and other social infrastructure.

Purpose

Aim: The Scientific SIG is dedicated to representing and advancing the use-cases and needs of research and high-performance computing with OpenStack. It's also a great forum for cross-institutional collaboration. If you are (or would like to) run OpenStack to support researchers/scientists/academics and/or HPC/HTC, then please join!

Objectives:

  • HPC/HTC Infrastructure
  • Research Data Infrastructure
  • Application Infrastructure
  • Social Infrastructure
  • Create opportunities for the scientific community to engage the wider OpenStack community, i.e. industry,


Communication

The default communication of our members is via the following open community mailing lists:


Please use the hashtag "scientific" for tagging any etherpad URLs, code, blogs posts, scientific research and/or other social publishing platforms.

Members

No formal membership is required. Please introduce yourself and/or fellow colleagues to this SIG using one of the mailing lists above, or by attending one of the IRC meetings.

This group is open to all members of the scientific OpenStack community and supporting vendors.

History

Significant dates for the SIG (in reverse chronological order):

  • [Please add latest activity for the #scientific SIG here at the top of this list]
  • The group previously known as the Scientific Working Group adopted SIG status in accordance with recommendation by the OpenStack User Committee
  • A proposal for hosting a face-to-face working group meeting was drafted at the following document: https://docs.google.com/document/d/10d7XDC1yw3thjxMMC1EXJlfmMAcjkfj2wnhH2MJgh9k/edit
  • The group was approved by the OpenStack foundation's User Committee board and wiki page minted on 15th January 2016.
  • The original proposal and call for nominations was drafted via this etherpad: https://etherpad.openstack.org/p/scientific-wg
  • The #scientific-wg originated from a conversation in the hallways of the Tokyo OpenStack summit (Oct 2015), ideas originating from John Taylor, Paul Calleja, Stig Telfer, Jonathan Proulx, David F. Flanders, Lauren Sell & Tom Fifield.

Activity Areas

Every OpenStack development cycle, we select focus areas of interest to active members at the time. These SIG members gather data on problems and solutions in areas that affect them.

For the Ocata development cycle, the four activity areas are:

Scientific OpenStack

The Scientific WG contributes knowledge and experience to the OpenStack Foundation's Scientific OpenStack site.

The Scientific WG also generated and maintains the content for the OpenStack/HPC guide "The Crossroads of Cloud and HPC: OpenStack for Scientific Research", published by the OpenStack Foundation and made available as an ebook.

Meetings

Face-to-Face

The Scientific SIG usually meets at the OpenStack Summits, and also at operators mid-cycle meetups (where possible).

Boston Summit, May 2017

The Scientific WG is planning a range activities for the summit in Boston:

  1. Boston Summit planning

IRC Meetings

For the best global coverage, IRC meetings are held in alternating time zones:

  • Every two weeks on even weeks, 2100 UTC on Tuesday in IRC channel #openstack-meeting
  • Every two weeks on odd weeks, 1100 UTC on Wednesday in IRC channel #openstack-meeting

Full details (including a calendar file) are available at eavesdrop.openstack.org. If you need help getting started with IRC see http://docs.openstack.org/upstream-training/irc.html.

IRC Meeting December 12th 2017

2017-12-12 2100 UTC in channel #openstack-meeting

Federation in Research Computing round-up

  1. Open Research Cloud Alliance update
  2. NIST/IEEE WG
  3. Aristotle Cloud Federation - https://federatedcloud.org/

Minutes from the meeting

IRC Meeting November 28th 2017

2017-11-28 2100 UTC in channel #openstack-meeting

Slurm-as-a-Service on OpenStack

  1. OpenHPC on OpenStack
    1. https://github.com/hpc-cloud-toolkit/ostack-hpc
  2. Massachusetts Open Cloud
    1. https://www.openstack.org/videos/sydney-2017/htc-service-on-underutilized-openstack-cloud-resources

IRC Meeting November 22nd 2017

2017-11-22 1100 UTC in channel #openstack-meeting

  1. Sydney summit roundup for SIG activities
    1. Summit talk picks
    2. Focus areas for this cycle
  2. Supercomputing 2017 roundup
  3. Manchester OpenStack Meetup, December 12 (+/-): HPC session planned
    1. Coinciding with CIUK 2017 - http://www.stfc.ac.uk/news-events-and-publications/events/general-interest-events/computing-insight-uk/
  4. Scientific SIG at RCUK Cloud Workshop 2018, Francis Crick Institute, London
    1. https://www.eventbrite.co.uk/e/research-councils-uk-cloud-workshop-tickets-39439492584

Minutes from the meeting

IRC Meeting October 17th 2017

2017-10-17 2100 UTC in channel #openstack-meeting

  1. Sydney Summit - SIG and Forum activities
  2. Open Research Cloud Update
  3. Supercomputing - book monitor request!

Minutes from the meeting

IRC Meeting October 11th 2017

2017-10-11 1100 UTC in channel #openstack-meeting

  1. Sydney Summit session prep
  2. Monash OpenStack HPC expansion plans
  3. Mellanox SR-IOV / RoCE tuning shenanigans

Minutes from the meeting

Earlier Meetings

Minutes and transcripts from all previous meetings can be found here.