Jump to: navigation, search

Difference between revisions of "Scientific SIG"

(IRC Meeting June 13th 2017)
(IRC Meeting September 19th 2017)
(45 intermediate revisions by 4 users not shown)
Line 7: Line 7:
 
Welcome to the OpenStack Scientific Working Group landing page.
 
Welcome to the OpenStack Scientific Working Group landing page.
 
<br />
 
<br />
Please cite this working group using the #scientific-wg tag on listservs, github, blogs, twitter and other social infrastructure.
+
Please cite this working group using the #scientific tag on listservs, github, blogs, twitter and other social infrastructure.
  
 
== Purpose ==
 
== Purpose ==
Line 28: Line 28:
  
  
Please use the hashtag "scientific-wg" for tagging any etherpad URLs, code, blogs posts, scientific research and/or other social publishing platforms.
+
Please use the hashtag "scientific" for tagging any etherpad URLs, code, blogs posts, scientific research and/or other social publishing platforms.
  
 
== Members ==
 
== Members ==
Line 82: Line 82:
  
 
* Every two weeks on even weeks, 2100 UTC on Tuesday in IRC channel #openstack-meeting
 
* Every two weeks on even weeks, 2100 UTC on Tuesday in IRC channel #openstack-meeting
* Every two weeks on odd weeks, 0900 UTC on Wednesday in IRC channel #openstack-meeting
+
* Every two weeks on odd weeks, 1100 UTC on Wednesday in IRC channel #openstack-meeting
  
 
Full details (including a calendar file) are available at [http://eavesdrop.openstack.org/#Scientific_Working_Group eavesdrop.openstack.org]. If you need help getting started with IRC see http://docs.openstack.org/upstream-training/irc.html.
 
Full details (including a calendar file) are available at [http://eavesdrop.openstack.org/#Scientific_Working_Group eavesdrop.openstack.org]. If you need help getting started with IRC see http://docs.openstack.org/upstream-training/irc.html.
  
==== IRC Meeting June 13th 2017 ====
+
==== IRC Meeting September 19th 2017 ====
 +
2017-09-19 2100 UTC in channel #openstack-meeting
  
# RDMA-enabled data analytics from Ohio State University: Hadoop, Spark, Memcached
+
# Sydney summit: Scientific Hackathon - mentors sought
## http://www.hpcadvisorycouncil.com/events/2017/swiss-workshop/pdf/Tuesday11April/DKPanda_BigDataMeetsHPC_Tue04112017.pdf
+
## http://hackathon.openstack.org.au/mentors/
# Update on the Open Research Cloud initiative
+
# OpenStack Days UK - September 26th
# Upcoming events:
+
## Scientific WG lightning talks wanted
## ISC 2017 (International Supercomputer Conference)
+
## Prizes for best talk on the day!
### Frankfurt, June 18-22nd
+
# Guest speaker: Rajul Kumar: HPC and Cloud - efficient utilisation
### http://isc-hpc.com/overview.html
+
## https://www.openstack.org/videos/boston-2017/hpchtc-and-cloud-making-them-work-together-efficiently
## Exacomm 2017 (Communication Architectures for HPC, Big Data, Deep Learning and Clouds at Extreme Scale)
+
## Presentation slides: https://drive.google.com/file/d/0B6_MvTMovwvFcVppSy1xVmFVbDQ/view?usp=sharing
### Thursday June 22nd, at ISC
+
# Scientific Computing and OpenStack book
### http://nowlab.cse.ohio-state.edu/exacomm/
+
# Book and Sticker Point Person for SuperComputing 17 in Denver
  
==== IRC Meeting June 7th 2017 ====
+
[http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-09-19-21.00.html Minutes from the meeting]
2017-06-07 0900 UTC in channel #openstack-meeting
 
  
# Experiences using CephFS for cluster filesystems in research computing
+
==== IRC Meeting September 13th 2017 ====
# Collecting together research papers: user stories of Scientific OpenStack
+
2017-09-13 1100 UTC in channel #openstack-meeting
## http://lists.openstack.org/pipermail/user-committee/2017-May/002051.html
 
# ISC 2017, Frankfurt, June 18-22nd
 
## http://isc-hpc.com/overview.html
 
# Exacomm 2017 - Communication Architectures for HPC, Big Data, Deep Learning and Clouds at Extreme Scale
 
## Thursday June 22nd at ISC
 
## http://nowlab.cse.ohio-state.edu/exacomm/
 
# OpenStack Days UK, London, 26th September
 
## CFP: https://www.papercall.io/openstackdaysuk - closes June 24th
 
  
[http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-06-07-09.00.html Minutes from the meeting]
+
# Taking advantage of opportunistic capacity on OpenStack
 +
## Experiences and solutions sought!
 +
## Preemptible instances spec: input sought - https://review.openstack.org/#/c/438640
 +
# Private cloud capacity meter
 +
## https://github.com/johngarbutt/os-capacity
 +
## NeCTAR's capacity monitoring: https://status.rc.nectar.org.au/capacity/
 +
# Updated edition of the Scientific OpenStack book: Progress report
 +
## Deadline for submission of WG input - 22nd September 2017
 +
## Opportunities for new case studies - especially HPC infrastructure management
 +
## Cover image proposals.
 +
# Scientific SIG
  
==== IRC Meeting May 30th 2017 ====
+
[http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-09-13-11.00.html Minutes from the meeting]
2017-05-30 2100UTC in channel #openstack-meeting
 
  
# Collecting together research papers: user stories of Scientific OpenStack
+
==== IRC Meeting September 5th 2017 ====
## http://lists.openstack.org/pipermail/user-committee/2017-May/002051.html
+
2017-09-05 2100 UTC in channel #openstack-meeting
# Scientific datasets blog from SWITCH
 
## https://cloudblog.switch.ch/2017/05/22/hosting-and-computing-public-scientific-datasets-in-the-cloud/
 
# Working Group activities for the new release cycle
 
# Any other business
 
  
[http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-05-30-21.01.html Minutes from the meeting]
+
# Taking advantage of opportunistic capacity on OpenStack
 +
## Experiences and solutions sought!
 +
## Preemptible instances spec: input sought - https://review.openstack.org/#/c/438640
 +
# Private cloud capacity meter
 +
## https://github.com/johngarbutt/os-capacity
 +
## NeCTAR's capacity monitoring: https://status.rc.nectar.org.au/capacity/
 +
# Updated edition of the Scientific OpenStack book: Progress report
 +
## Deadline for submission of WG input - 22nd September 2017
 +
## Opportunities for new case studies
 +
# Scientific SIG
  
==== IRC Meeting May 24th 2017 ====
+
[http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-09-05-21.00.html Minutes from the meeting]
2017-05-24 0900UTC in channel #openstack-meeting
 
  
# Collecting together research papers: user stories of Scientific OpenStack
+
==== IRC Meeting August 30th 2017 ====
## http://lists.openstack.org/pipermail/user-committee/2017-May/002051.html
+
2017-08-30 1100 UTC in channel #openstack-meeting
# Working Group activities for the new release cycle
 
# Move meetings to new #scientific-wg IRC channel?
 
  
[http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-05-24-09.00.html Minutes from the meeting]
+
# Updated edition of the Scientific OpenStack book
 +
## Deadline for submission of WG input - 22nd September 2017
 +
## Volunteers for contributions - https://github.com/openstack/scientific-wg
 +
## Opportunities for new case studies
 +
## Revisions to old studies
 +
 
 +
[http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-08-30-11.01.html Minutes from the meeting]
 +
 
 +
==== IRC Meeting August 22nd 2017 ====
 +
2017-08-22 2100 UTC in channel #openstack-meeting
 +
 
 +
(partial repeat of past week)
 +
# Updated edition of the Scientific OpenStack book
 +
## Deadline for submission of WG input - 22nd September 2017
 +
## Volunteers for contributions - https://github.com/openstack/scientific-wg
 +
# ORC Update and planning
  
 
==== Earlier Meetings ====
 
==== Earlier Meetings ====

Revision as of 22:06, 19 September 2017

Status: Active (@May 2016)
Chairs: Stig Telfer, Blair Bethwaite and Martial Michel
OpenStack Foundation liaison: David F. Flanders <Flanders@OpenStack.org>

Welcome to the OpenStack Scientific Working Group landing page.
Please cite this working group using the #scientific tag on listservs, github, blogs, twitter and other social infrastructure.

Purpose

Aim: The Scientific Working Group is dedicated to representing and advancing the use-cases and needs of research and high-performance computing atop OpenStack. It's also a great forum for cross-institutional collaboration. If you are (or would like to) run OpenStack to support researchers/scientists/academics and/or HPC/HTC, then please join!

Objectives:

  • HPC/HTC Infrastructure
  • Research Data Infrastructure
  • Application Infrastructure
  • Social Infrastructure
  • Create opportunities for the scientific community to engage the wider OpenStack community, i.e. industry,


Communication

The default communication of our members is via the following open community mailing lists:


Please use the hashtag "scientific" for tagging any etherpad URLs, code, blogs posts, scientific research and/or other social publishing platforms.

Members

No formal membership is required. Please introduce yourself and/or fellow colleagues to this working group using one of the mailing lists below, or by attending one of the IRC meetings.

This group is open to all members of the scientific OpenStack community and supporting vendors.

History

Significant dates for the working group (in reverse chronological order):

  • [Please add latest activity for the #scientific-wg here at the top of this list]
  • A proposal for hosting a face-to-face working group meeting was drafted at the following document: https://docs.google.com/document/d/10d7XDC1yw3thjxMMC1EXJlfmMAcjkfj2wnhH2MJgh9k/edit
  • The group was approved by the OpenStack foundation's User Committee board and wiki page minted on 15th January 2016.
  • The original proposal and call for nominations was drafted via this etherpad: https://etherpad.openstack.org/p/scientific-wg
  • The #scientific-wg originated from a conversation in the hallways of the Tokyo OpenStack summit (Oct 2015), ideas originating from John Taylor, Paul Calleja, Stig Telfer, Jonathan Proulx, David F. Flanders, Lauren Sell & Tom Fifield.

Activity Areas

Every OpenStack development cycle, four activity areas are selected to focus on, and working group members gather data on problems and solutions in areas that affect them.

For the Ocata development cycle, the four activity areas are:

Scientific OpenStack

The Scientific WG contributes knowledge and experience to the OpenStack Foundation's Scientific OpenStack site.

The Scientific WG also generated and maintains the content for the OpenStack/HPC guide "The Crossroads of Cloud and HPC: OpenStack for Scientific Research", published by the OpenStack Foundation and made available as an ebook.

Meetings

Face-to-Face

The Scientific Working Group usually meets at the OpenStack Summits, and also at operators mid-cycle meetups (where possible).

Boston Summit, May 2017

The Scientific WG is planning a range activities for the summit in Boston:

  1. Boston Summit planning

IRC Meetings

For the best global coverage, IRC meetings are held in alternating time zones:

  • Every two weeks on even weeks, 2100 UTC on Tuesday in IRC channel #openstack-meeting
  • Every two weeks on odd weeks, 1100 UTC on Wednesday in IRC channel #openstack-meeting

Full details (including a calendar file) are available at eavesdrop.openstack.org. If you need help getting started with IRC see http://docs.openstack.org/upstream-training/irc.html.

IRC Meeting September 19th 2017

2017-09-19 2100 UTC in channel #openstack-meeting

  1. Sydney summit: Scientific Hackathon - mentors sought
    1. http://hackathon.openstack.org.au/mentors/
  2. OpenStack Days UK - September 26th
    1. Scientific WG lightning talks wanted
    2. Prizes for best talk on the day!
  3. Guest speaker: Rajul Kumar: HPC and Cloud - efficient utilisation
    1. https://www.openstack.org/videos/boston-2017/hpchtc-and-cloud-making-them-work-together-efficiently
    2. Presentation slides: https://drive.google.com/file/d/0B6_MvTMovwvFcVppSy1xVmFVbDQ/view?usp=sharing
  4. Scientific Computing and OpenStack book
  5. Book and Sticker Point Person for SuperComputing 17 in Denver

Minutes from the meeting

IRC Meeting September 13th 2017

2017-09-13 1100 UTC in channel #openstack-meeting

  1. Taking advantage of opportunistic capacity on OpenStack
    1. Experiences and solutions sought!
    2. Preemptible instances spec: input sought - https://review.openstack.org/#/c/438640
  2. Private cloud capacity meter
    1. https://github.com/johngarbutt/os-capacity
    2. NeCTAR's capacity monitoring: https://status.rc.nectar.org.au/capacity/
  3. Updated edition of the Scientific OpenStack book: Progress report
    1. Deadline for submission of WG input - 22nd September 2017
    2. Opportunities for new case studies - especially HPC infrastructure management
    3. Cover image proposals.
  4. Scientific SIG

Minutes from the meeting

IRC Meeting September 5th 2017

2017-09-05 2100 UTC in channel #openstack-meeting

  1. Taking advantage of opportunistic capacity on OpenStack
    1. Experiences and solutions sought!
    2. Preemptible instances spec: input sought - https://review.openstack.org/#/c/438640
  2. Private cloud capacity meter
    1. https://github.com/johngarbutt/os-capacity
    2. NeCTAR's capacity monitoring: https://status.rc.nectar.org.au/capacity/
  3. Updated edition of the Scientific OpenStack book: Progress report
    1. Deadline for submission of WG input - 22nd September 2017
    2. Opportunities for new case studies
  4. Scientific SIG

Minutes from the meeting

IRC Meeting August 30th 2017

2017-08-30 1100 UTC in channel #openstack-meeting

  1. Updated edition of the Scientific OpenStack book
    1. Deadline for submission of WG input - 22nd September 2017
    2. Volunteers for contributions - https://github.com/openstack/scientific-wg
    3. Opportunities for new case studies
    4. Revisions to old studies

Minutes from the meeting

IRC Meeting August 22nd 2017

2017-08-22 2100 UTC in channel #openstack-meeting

(partial repeat of past week)

  1. Updated edition of the Scientific OpenStack book
    1. Deadline for submission of WG input - 22nd September 2017
    2. Volunteers for contributions - https://github.com/openstack/scientific-wg
  2. ORC Update and planning

Earlier Meetings

Minutes and transcripts from all previous meetings can be found here.