Jump to: navigation, search

Difference between revisions of "Scientific SIG"

(IRC Meeting April 18th 2017)
(41 intermediate revisions by 3 users not shown)
Line 50: Line 50:
 
gather data on problems and solutions in areas that affect them.
 
gather data on problems and solutions in areas that affect them.
  
For the Ocata development cycle, the four activity areas are monitoring and telemetry, GPUs, data management
+
For the Ocata development cycle, the four activity areas are:
and federated identity management.
 
  
=== Monitoring and Telemetry ===
+
* [[ScientificWGMonitoringAndTelemetry|Monitoring and Telemetry]]
 +
* [[ScientificWGGPUs|GPUs in OpenStack]]
 +
* [[ScientificWGDataManagement|Data Management and Big Data]]
 +
* [[ScientificWGFederatedIdentityManagement|Scientific OpenStack Federation]]
  
=== GPUs in OpenStack ===
+
=== Scientific OpenStack ===
  
=== Data Management ===
+
The Scientific WG contributes knowledge and experience to the OpenStack Foundation's [https://www.openstack.org/science Scientific OpenStack site].
  
=== Federated Identity Management ===
+
The Scientific WG also generated and maintains the content for the OpenStack/HPC guide "The Crossroads of Cloud and HPC: OpenStack for Scientific Research", published by the OpenStack Foundation and made available as an ebook.
  
 
== Meetings ==
 
== Meetings ==
  
 
=== Face-to-Face ===
 
=== Face-to-Face ===
The Scientific Working Group usually meets at the OpenStack Design summits, and also at operators mid-cycle meetups (where possible).
+
The Scientific Working Group usually meets at the OpenStack Summits, and also at operators mid-cycle meetups (where possible).
  
 +
* Boston Summit May 2017, Boston, MA, USA: https://etherpad.openstack.org/p/Scientific-WG-boston
 +
* Newton Design Summit April 2016, Austin, USA: https://etherpad.openstack.org/p/scientific-wg-austin-summit-agenda
 
* Operators mid-cycle February 2016, Manchester, UK: https://etherpad.openstack.org/p/MAN-ops-Scientific-WG
 
* Operators mid-cycle February 2016, Manchester, UK: https://etherpad.openstack.org/p/MAN-ops-Scientific-WG
* Newton Design Summit April 2016, Austin, USA: https://etherpad.openstack.org/p/scientific-wg-austin-summit-agenda
 
 
==== Barcelona Summit, October 2016 ====
 
 
The Scientific WG planned a range activities for the summit in Barcelona:
 
  
# The [https://www.openstack.org/summit/barcelona-2016/summit-schedule/global-search?t=HPC+%2F+Research HPC / Research speaker track] has seven talks scheduled for Wednesday 26th and Thursday 27th
+
==== Boston Summit, May 2017 ====
# A [https://www.openstack.org/summit/barcelona-2016/summit-schedule/events/16779/scientific-working-group-bof-and-poster-session BoF] for Scientific OpenStack. (Wednesday, October 26, 2:15pm-2:55pm, Hilton Diagonal Mar - P0 - Ballroom B)
 
## Lightning talks schedule TBC
 
# A [https://www.openstack.org/summit/barcelona-2016/summit-schedule/events/16780/scientific-working-group-meeting WG committee meeting] for progress review and planning. (Wednesday, October 26, 11:25am-12:05pm, AC Hotel - P14 - Pedralbes)
 
## [https://etherpad.openstack.org/p/scientific-wg-barcelona-agenda Agenda items for the meeting], please contribute.
 
# An evening social for members, supporters and friends of the Scientific WG.
 
  
 +
The Scientific WG is planning a range activities for the summit in Boston:
  
Some WG members have compiled a short list of [https://etherpad.openstack.org/p/Scientific-WG-summit-picks top picks from the summit schedule]
+
# [https://etherpad.openstack.org/p/Scientific-WG-boston Boston Summit planning]
  
 
=== IRC Meetings ===
 
=== IRC Meetings ===
Line 91: Line 86:
 
Full details (including a calendar file) are available at [http://eavesdrop.openstack.org/#Scientific_Working_Group eavesdrop.openstack.org]. If you need help getting started with IRC see http://docs.openstack.org/upstream-training/irc.html.
 
Full details (including a calendar file) are available at [http://eavesdrop.openstack.org/#Scientific_Working_Group eavesdrop.openstack.org]. If you need help getting started with IRC see http://docs.openstack.org/upstream-training/irc.html.
  
==== IRC Meeting December 7th 2016 ====
+
==== IRC Meeting April 18th 2017 ====
2016-12-07 0900 UTC in channel #openstack-meeting
+
2017-04-18 2100 UTC in channel #openstack-meeting
  
# All things monitoring
+
# Boston OpenStack summit planning roundup
## Discussion from last week on telemetry and monitoring: https://etherpad.openstack.org/p/scientific-wg-telemetry-and-monitoring
+
## Meeting agenda
## Cloud workload traces: https://etherpad.openstack.org/p/Cloud_workload_traces
+
## Lightning talks
## Other developments in the telemetry/monitoring/tracing space
+
## Evening social
 +
# Cloud Congress
 +
## Working agenda: https://drive.google.com/drive/folders/0B4Y7flFgUgf9dElkaFkwbUhKblU?usp=sharing
 +
## Register here: https://www.eventbrite.com/e/boston-open-research-cloud-workshop-tickets-31893256589
 
# Any other business
 
# Any other business
  
==== IRC Meeting November 29th 2016 ====
+
[http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-04-18-21.01.html Minutes from the meeting]
2016-11-29 2100 UTC in channel #openstack-meeting
+
 
 +
==== IRC Meeting April 12th 2017 ====
 +
2017-04-12 0900 UTC in channel #openstack-meeting
  
# Network performance with VXLAN and OVS - some test results
+
# Roundup on resource reservation discussions
# OpenStack telemetry and monitoring use cases for research computing
+
# HPC Advisory Council conference roundup
 +
# Boston OpenStack summit planning roundup
 
# Any other business
 
# Any other business
  
[http://eavesdrop.openstack.org/meetings/scientific_wg/2016/scientific_wg.2016-11-29-21.01.html Minutes from the meeting]
+
[http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-04-12-09.00.html Minutes from the meeting]
  
==== IRC Meeting November 23rd 2016 ====
+
==== IRC Meeting April 4th 2017 ====
2016-11-23 0900 UTC in channel #openstack-meeting
+
2017-04-04 2100 UTC in channel #openstack-meeting
  
# Wrap up from Supercomputing 2016
+
# OpenStack Summit sessions
# Scientific datasets - update from Sofiane and Saverio
+
## Now up to three slots
# Federation user story up for review
+
## Forum activities
# Upcoming Scientific OpenStack events
+
# Boston Cloud Declaration
 
+
# Any other business
[http://eavesdrop.openstack.org/meetings/scientific_wg/2016/scientific_wg.2016-11-23-09.00.html Minutes from the meeting]
 
 
 
==== IRC Meeting November 9th 2016 ====
 
2016-11-09 0900 UTC in channel #openstack-meeting
 
  
# Selection/confirmation of New Activity Areas for Ocata Cycle
+
[http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-04-04-21.02.html Minutes from the meeting]
## https://etherpad.openstack.org/p/scientific-wg-barcelona-agenda
 
## Discussion from last week: http://eavesdrop.openstack.org/meetings/scientific_wg/2016/scientific_wg.2016-11-01-21.02.log.html#l-28
 
## Telemetry & Monitoring: oneswig & martial
 
## Federation: aloga
 
## Scientific Datasets & Data Analytics: TBD (zioproto?)
 
## GPUs and Virtualisation: powerd
 
# 3-slot meeting rota?
 
# Brainstorm of 'Forum' session proposals for Boston
 
# WG Picks from the Summit
 
## Developer sessions
 
## Video Archive
 
# Plans for Supercomputing 2016
 
## Evening social?
 
## Superuser blog post?
 
  
[http://eavesdrop.openstack.org/meetings/scientific_wg/2016/scientific_wg.2016-11-09-09.00.html Minutes from the meeting]
+
==== IRC Meeting March 15th 2017 ====
 +
CANCELLED - due to Operators Meetup
  
 
==== Earlier Meetings ====
 
==== Earlier Meetings ====

Revision as of 22:03, 18 April 2017

Status: Active (@May 2016)
Chairs: Stig Telfer, Blair Bethwaite and Martial Michel
OpenStack Foundation liaison: David F. Flanders <Flanders@OpenStack.org>

Welcome to the OpenStack Scientific Working Group landing page.
Please cite this working group using the #scientific-wg tag on listservs, github, blogs, twitter and other social infrastructure.

Purpose

Aim: The Scientific Working Group is dedicated to representing and advancing the use-cases and needs of research and high-performance computing atop OpenStack. It's also a great forum for cross-institutional collaboration. If you are (or would like to) run OpenStack to support researchers/scientists/academics and/or HPC/HTC, then please join!

Objectives:

  • HPC/HTC Infrastructure
  • Research Data Infrastructure
  • Application Infrastructure
  • Social Infrastructure
  • Create opportunities for the scientific community to engage the wider OpenStack community, i.e. industry,


Communication

The default communication of our members is via the following open community mailing lists:


Please use the hashtag "scientific-wg" for tagging any etherpad URLs, code, blogs posts, scientific research and/or other social publishing platforms.

Members

No formal membership is required. Please introduce yourself and/or fellow colleagues to this working group using one of the mailing lists below, or by attending one of the IRC meetings.

This group is open to all members of the scientific OpenStack community and supporting vendors.

History

Significant dates for the working group (in reverse chronological order):

  • [Please add latest activity for the #scientific-wg here at the top of this list]
  • A proposal for hosting a face-to-face working group meeting was drafted at the following document: https://docs.google.com/document/d/10d7XDC1yw3thjxMMC1EXJlfmMAcjkfj2wnhH2MJgh9k/edit
  • The group was approved by the OpenStack foundation's User Committee board and wiki page minted on 15th January 2016.
  • The original proposal and call for nominations was drafted via this etherpad: https://etherpad.openstack.org/p/scientific-wg
  • The #scientific-wg originated from a conversation in the hallways of the Tokyo OpenStack summit (Oct 2015), ideas originating from John Taylor, Paul Calleja, Stig Telfer, Jonathan Proulx, David F. Flanders, Lauren Sell & Tom Fifield.

Activity Areas

Every OpenStack development cycle, four activity areas are selected to focus on, and working group members gather data on problems and solutions in areas that affect them.

For the Ocata development cycle, the four activity areas are:

Scientific OpenStack

The Scientific WG contributes knowledge and experience to the OpenStack Foundation's Scientific OpenStack site.

The Scientific WG also generated and maintains the content for the OpenStack/HPC guide "The Crossroads of Cloud and HPC: OpenStack for Scientific Research", published by the OpenStack Foundation and made available as an ebook.

Meetings

Face-to-Face

The Scientific Working Group usually meets at the OpenStack Summits, and also at operators mid-cycle meetups (where possible).

Boston Summit, May 2017

The Scientific WG is planning a range activities for the summit in Boston:

  1. Boston Summit planning

IRC Meetings

For the best global coverage, IRC meetings are held in alternating time zones:

  • Every two weeks on even weeks, 2100 UTC on Tuesday in IRC channel #openstack-meeting
  • Every two weeks on odd weeks, 0900 UTC on Wednesday in IRC channel #openstack-meeting

Full details (including a calendar file) are available at eavesdrop.openstack.org. If you need help getting started with IRC see http://docs.openstack.org/upstream-training/irc.html.

IRC Meeting April 18th 2017

2017-04-18 2100 UTC in channel #openstack-meeting

  1. Boston OpenStack summit planning roundup
    1. Meeting agenda
    2. Lightning talks
    3. Evening social
  2. Cloud Congress
    1. Working agenda: https://drive.google.com/drive/folders/0B4Y7flFgUgf9dElkaFkwbUhKblU?usp=sharing
    2. Register here: https://www.eventbrite.com/e/boston-open-research-cloud-workshop-tickets-31893256589
  3. Any other business

Minutes from the meeting

IRC Meeting April 12th 2017

2017-04-12 0900 UTC in channel #openstack-meeting

  1. Roundup on resource reservation discussions
  2. HPC Advisory Council conference roundup
  3. Boston OpenStack summit planning roundup
  4. Any other business

Minutes from the meeting

IRC Meeting April 4th 2017

2017-04-04 2100 UTC in channel #openstack-meeting

  1. OpenStack Summit sessions
    1. Now up to three slots
    2. Forum activities
  2. Boston Cloud Declaration
  3. Any other business

Minutes from the meeting

IRC Meeting March 15th 2017

CANCELLED - due to Operators Meetup

Earlier Meetings

Minutes and transcripts from all previous meetings can be found here.