Jump to: navigation, search

Difference between revisions of "Scientific SIG"

(IRC Meeting January 15th 2020)
(408 intermediate revisions by 9 users not shown)
Line 1: Line 1:
Status: Active
+
Status: Active (@May 2016)
 
<br />
 
<br />
Organiser: Stig Telfer
+
Chairs: Stig Telfer, Blair Bethwaite and Martial Michel
 
<br />
 
<br />
 
OpenStack Foundation liaison: David F. Flanders <Flanders@OpenStack.org>
 
OpenStack Foundation liaison: David F. Flanders <Flanders@OpenStack.org>
  
Welcome to the OpenStack Scientific Working Group home page.
+
Welcome to the OpenStack Scientific Special Interest Group (SIG) landing page.
 
<br />
 
<br />
Please cite this working group using the #scientific-wg tag on listservs, github, blogs, twitter and other social infrastructure.
+
Please cite this SIG using the #scientific tag on listservs, github, blogs, twitter and other social infrastructure.
  
 
== Purpose ==
 
== Purpose ==
'''Aim''': Explore opportunities for cross-institutional collaboration and compatibility around use of OpenStack for use by researchers, scientists, academics and developers.  {To be further specified at the Austin OpenStack Summit}
+
'''Aim''': The Scientific SIG is dedicated to representing and advancing the use-cases and needs of research and high-performance computing with OpenStack. It's also a great forum for cross-institutional collaboration. If you are (or would like to) run OpenStack to support researchers/scientists/academics and/or HPC/HTC, then please join!
 
<br />
 
<br />
 
<br />
 
<br />
Line 22: Line 22:
  
 
== Communication ==
 
== Communication ==
The default communication of our members is via the following open community mailing list:
+
The default communication of our members is via the following open community mailing lists:
  
  *--> user-committee@lists.openstack.org
+
* [http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-sigs openstack-sigs@lists.openstack.org] for coordination of SIG activities.  Please prefix email subject lines with the tag "[scientific]".
 +
* [http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators openstack-operators@lists.openstack.org] for operational discussion of scientific OpenStack deployment issues.  Please prefix email subject lines with the tag "[scientific]".
  
Please append email subject lines with "[scientific-wg]".
 
  
Please use the hashtag "scientific-wg" for tagging any etherpad URLs, code, blogs posts, scientific research and/or other social publishing platforms.
+
Please use the hashtag "scientific" for tagging any etherpad URLs, code, blogs posts, scientific research and/or other social publishing platforms.
 
 
== Meetings ==
 
Face-to-face meetings occur bi-annually at the OpenStack summit, please see the conference programme for dates/times.
 
 
 
* [DRAFT] agenda for generating actions for the #scientific-wg via discussion at the Austin OpenStack Summit: https://etherpad.openstack.org/p/scientific-wg-austin-summit-agenda
 
* Scope of Scientific Working Group generated post Tokyo summit: https://etherpad.openstack.org/p/scientific-wg
 
 
 
To propose a virtual meeting (i.e. IRC/chat-room meeting, conference call or other) please email the mailing list.
 
  
 
== Members ==
 
== Members ==
Please add yourself to this list including your institutional affiliation.
+
No formal membership is required.  Please introduce yourself and/or fellow colleagues to this SIG using one of the mailing lists above, or by attending one of the IRC meetings.
NB if there is already someone listed from your institution, please make an effort to have them nominate you as a co-representative for your institution.
 
  
* Tim Bell, OpenStack Board member, Group Lead of IT Operating systems and Infrastructure Services, CERN.
+
This group is open to all members of the scientific OpenStack community and supporting vendors.
* Kevin Fox, Research Scientist at the Pacific Northwest Laboratory: https://www.emsl.pnl.gov/emslweb/people/kevin-fox
 
* Jonathan Proulx, MIT Computer Science and Artificial Intelligence Laboratory, Boston, USA.
 
* Stig Telfer, HPC on OpenStack contributor.
 
* Dr. Lyle Winton, Deputy Director Australian National Research Cloud Infrastructure (NeCTAR Federation Directorate), Australia.
 
* Dr. Steven Manos, Director of Research Platforms Services University of Melbourne.
 
* Bernard Meade, Cloud and HPC manager for the University of Melbourne
 
* John Taylor, High Performance Computing Service, Cambridge University
 
* Paul Calleja, Deputy Director University Information Services, Cambridge University, UK. http://www.uis.cam.ac.uk/images/news/SLT/calleja.jpg/view
 
* Declan Fleming, Chief Technology Strategist University of California San Diego
 
* Giuseppe Andronico, INFN
 
* Heine de Jager, University of Cape Town, South Africa
 
* Guido Aben, AARNet, Australia
 
* James Weatherall, Harvard Medical School
 
* Adam Hunter, Centre for Comparative Genomics, Murdoch University, Western Australia.
 
* John O'Loughlin, Faculty of Engineering and Phsycial Sciences, University of Surrey: http://www.surrey.ac.uk/cs/research/de/people/john_oloughlin/
 
* Mark Pallen, (climb.ac.uk) Warwick Medical School, http://www2.warwick.ac.uk/fac/med/research/tsm/microinfect/staff/pallen/
 
* Sam Sheppard, (climb.ac.uk) College of Medicine, Swansea University. http://www.swansea.ac.uk/staff/medicine/learningandteaching/sheppards/
 
* Peter Love, Physics, Lancaster University. http://www.physics.lancs.ac.uk/people/peter-love
 
* Amanda Lamb, North West Institute for BioHealth Informatics, Population Health, University of Manchester. http://www.population-health.manchester.ac.uk/staff/AmandaLamb/
 
* Tom Fifield, School of Physics, University of Melbourne
 
* Saverio Proto, SWITCH
 
* Thomas M. Bohnert, ZHAW, blog.zhaw.ch/icclab
 
* Matjaz Pancur, University of Ljubljana, Faculty of Computer and Information Science, Slovenia
 
* Adam Huffman, The Francis Crick Institute. http://www.crick.ac.uk
 
* Sofiane Sarni, Ecole Polytechnique Féderale de Lausanne (EPF), Vice-Presidency for Information Systems, http://vpsi.epfl.ch/VPSI-Teams
 
* John Shillington, Cybera, CA
 
* Stig Telfer, Cambridge University
 
* David F. Flanders, University of Melbourne
 
  
 
== History ==
 
== History ==
  
Significant dates for the working group (in reverse chronological order):
+
Significant dates for the SIG (in reverse chronological order):
  
* ''[Please add latest activity for the #scientific-wg here at the top of this list]''
+
* ''[Please add latest activity for the #scientific SIG here at the top of this list]''
 +
* The group previously known as the Scientific Working Group adopted SIG status in accordance with recommendation by the OpenStack User Committee
 
* A proposal for hosting a face-to-face working group meeting was drafted at the following document: https://docs.google.com/document/d/10d7XDC1yw3thjxMMC1EXJlfmMAcjkfj2wnhH2MJgh9k/edit
 
* A proposal for hosting a face-to-face working group meeting was drafted at the following document: https://docs.google.com/document/d/10d7XDC1yw3thjxMMC1EXJlfmMAcjkfj2wnhH2MJgh9k/edit
 
* The group was approved by the OpenStack foundation's User Committee board and wiki page minted on 15th January 2016.
 
* The group was approved by the OpenStack foundation's User Committee board and wiki page minted on 15th January 2016.
Line 82: Line 46:
 
* The #scientific-wg originated from a conversation in the hallways of the Tokyo OpenStack summit (Oct 2015), ideas originating from John Taylor, Paul Calleja, Stig Telfer, Jonathan Proulx, David F. Flanders, Lauren Sell & Tom Fifield.
 
* The #scientific-wg originated from a conversation in the hallways of the Tokyo OpenStack summit (Oct 2015), ideas originating from John Taylor, Paul Calleja, Stig Telfer, Jonathan Proulx, David F. Flanders, Lauren Sell & Tom Fifield.
  
[[Category: Working_Groups]]
+
== Activity Areas ==
 +
 
 +
Every OpenStack development cycle, we select focus areas of interest to active members at the time. These SIG members
 +
gather data on problems and solutions in areas that affect them.
 +
 
 +
For the Ocata development cycle, the four activity areas are:
 +
 
 +
* [[ScientificWGMonitoringAndTelemetry|Monitoring and Telemetry]]
 +
* [[ScientificWGGPUs|GPUs in OpenStack]]
 +
* [[ScientificWGDataManagement|Data Management and Big Data]]
 +
* [[ScientificWGFederatedIdentityManagement|Scientific OpenStack Federation]]
 +
 
 +
=== Scientific OpenStack ===
 +
 
 +
The Scientific WG contributes knowledge and experience to the OpenStack Foundation's [https://www.openstack.org/science Scientific OpenStack site].
 +
 
 +
The Scientific WG also generated and maintains the content for the OpenStack/HPC guide "The Crossroads of Cloud and HPC: OpenStack for Scientific Research", published by the OpenStack Foundation and made available as an ebook.
 +
 
 +
== Meetings ==
 +
 
 +
=== Face-to-Face ===
 +
The Scientific SIG usually meets at the OpenStack Summits, and also at operators mid-cycle meetups (where possible).
 +
 
 +
* Boston Summit May 2017, Boston, MA, USA: https://etherpad.openstack.org/p/Scientific-WG-boston
 +
* Newton Design Summit April 2016, Austin, USA: https://etherpad.openstack.org/p/scientific-wg-austin-summit-agenda
 +
* Operators mid-cycle February 2016, Manchester, UK: https://etherpad.openstack.org/p/MAN-ops-Scientific-WG
 +
 
 +
==== Boston Summit, May 2017 ====
 +
 
 +
The Scientific WG is planning a range activities for the summit in Boston:
 +
 
 +
# [https://etherpad.openstack.org/p/Scientific-WG-boston Boston Summit planning]
 +
 
 +
=== IRC Meetings ===
 +
For the best global coverage, IRC meetings are held in alternating time zones:
 +
 
 +
* Every two weeks on even weeks, 2100 UTC on Tuesday in IRC channel #openstack-meeting
 +
* Every two weeks on odd weeks, 1100 UTC on Wednesday in IRC channel #openstack-meeting
 +
 
 +
Full details (including a calendar file) are available at [http://eavesdrop.openstack.org/#Scientific_Working_Group eavesdrop.openstack.org]. If you need help getting started with IRC see http://docs.openstack.org/upstream-training/irc.html.
 +
 
 +
==== IRC Meeting January 15th 2020 ====
 +
2020-01-15 1100 UTC in channel #openstack-meeting
 +
 
 +
# Reminder: OpenStack board elections
 +
# Large-Scale SIG - datapoints on networking and other configuration for scale
 +
## http://lists.openstack.org/pipermail/openstack-discuss/2020-January/011820.html
 +
## https://etherpad.openstack.org/p/large-scale-sig-cluster-scaling
 +
# Research computing conferences for 2020
 +
# AOB
 +
 
 +
[http://eavesdrop.openstack.org/meetings/scientific_sig/2020/scientific_sig.2020-01-15-11.00.html Minutes from the meeting]
 +
 
 +
==== IRC Meeting January 7th 2020 ====
 +
2020-01-07 2100 UTC in channel #openstack-meeting
 +
 
 +
# Happy 2020, let's discuss your updated plans for this year
 +
# AOB
 +
 
 +
==== IRC Meeting December 4th 2019 ====
 +
2019-12-04 1100 UTC in channel #openstack-meeting
 +
 
 +
# Unified limits and nested projects - johnthetubaguy
 +
# The post-Gnocchi future
 +
# AOB
 +
 
 +
[http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-12-04-11.00.html Minutes from the meeting]
 +
 
 +
==== IRC Meeting November 26th 2019 ====
 +
2019-11-26 2100 UTC in channel #openstack-meeting
 +
 
 +
# Supercomputing debrief
 +
# Linuxbridge ML2 update
 +
# Issues with mixing virt and baremetal
 +
# The post-Gnocchi future
 +
# AOB
 +
 
 +
[http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-11-26-21.00.html Minutes from the meeting]
 +
 
 +
==== IRC Meeting November 12th 2019 ====
 +
2019-11-12 2100 UTC in channel #openstack-meeting
 +
 
 +
# Shanghai trip report - Stig
 +
# SC19 planning
 +
# AOB
 +
 
 +
[http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-11-12-21.00.html Minutes from the meeting]
 +
 
 +
==== IRC Meeting October 29th 2019 ====
 +
2019-10-29 2100 UTC in channel #openstack-meeting
 +
 
 +
# Shanghai round-up
 +
## Schedule picks
 +
## Scientific SIG at the PTG
 +
# Supercomputing 2019 - Denver, 17-22 November
 +
# AOB
 +
 
 +
[http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-10-29-21.00.html Minutes from the meeting]
 +
 
 +
==== Earlier Meetings ====
 +
 
 +
Minutes and transcripts from all previous meetings can be found [http://eavesdrop.openstack.org/meetings/scientific_wg/ here].
 +
 
 +
[[Category: SIGs]]

Revision as of 12:01, 15 January 2020

Status: Active (@May 2016)
Chairs: Stig Telfer, Blair Bethwaite and Martial Michel
OpenStack Foundation liaison: David F. Flanders <Flanders@OpenStack.org>

Welcome to the OpenStack Scientific Special Interest Group (SIG) landing page.
Please cite this SIG using the #scientific tag on listservs, github, blogs, twitter and other social infrastructure.

Purpose

Aim: The Scientific SIG is dedicated to representing and advancing the use-cases and needs of research and high-performance computing with OpenStack. It's also a great forum for cross-institutional collaboration. If you are (or would like to) run OpenStack to support researchers/scientists/academics and/or HPC/HTC, then please join!

Objectives:

  • HPC/HTC Infrastructure
  • Research Data Infrastructure
  • Application Infrastructure
  • Social Infrastructure
  • Create opportunities for the scientific community to engage the wider OpenStack community, i.e. industry,


Communication

The default communication of our members is via the following open community mailing lists:


Please use the hashtag "scientific" for tagging any etherpad URLs, code, blogs posts, scientific research and/or other social publishing platforms.

Members

No formal membership is required. Please introduce yourself and/or fellow colleagues to this SIG using one of the mailing lists above, or by attending one of the IRC meetings.

This group is open to all members of the scientific OpenStack community and supporting vendors.

History

Significant dates for the SIG (in reverse chronological order):

  • [Please add latest activity for the #scientific SIG here at the top of this list]
  • The group previously known as the Scientific Working Group adopted SIG status in accordance with recommendation by the OpenStack User Committee
  • A proposal for hosting a face-to-face working group meeting was drafted at the following document: https://docs.google.com/document/d/10d7XDC1yw3thjxMMC1EXJlfmMAcjkfj2wnhH2MJgh9k/edit
  • The group was approved by the OpenStack foundation's User Committee board and wiki page minted on 15th January 2016.
  • The original proposal and call for nominations was drafted via this etherpad: https://etherpad.openstack.org/p/scientific-wg
  • The #scientific-wg originated from a conversation in the hallways of the Tokyo OpenStack summit (Oct 2015), ideas originating from John Taylor, Paul Calleja, Stig Telfer, Jonathan Proulx, David F. Flanders, Lauren Sell & Tom Fifield.

Activity Areas

Every OpenStack development cycle, we select focus areas of interest to active members at the time. These SIG members gather data on problems and solutions in areas that affect them.

For the Ocata development cycle, the four activity areas are:

Scientific OpenStack

The Scientific WG contributes knowledge and experience to the OpenStack Foundation's Scientific OpenStack site.

The Scientific WG also generated and maintains the content for the OpenStack/HPC guide "The Crossroads of Cloud and HPC: OpenStack for Scientific Research", published by the OpenStack Foundation and made available as an ebook.

Meetings

Face-to-Face

The Scientific SIG usually meets at the OpenStack Summits, and also at operators mid-cycle meetups (where possible).

Boston Summit, May 2017

The Scientific WG is planning a range activities for the summit in Boston:

  1. Boston Summit planning

IRC Meetings

For the best global coverage, IRC meetings are held in alternating time zones:

  • Every two weeks on even weeks, 2100 UTC on Tuesday in IRC channel #openstack-meeting
  • Every two weeks on odd weeks, 1100 UTC on Wednesday in IRC channel #openstack-meeting

Full details (including a calendar file) are available at eavesdrop.openstack.org. If you need help getting started with IRC see http://docs.openstack.org/upstream-training/irc.html.

IRC Meeting January 15th 2020

2020-01-15 1100 UTC in channel #openstack-meeting

  1. Reminder: OpenStack board elections
  2. Large-Scale SIG - datapoints on networking and other configuration for scale
    1. http://lists.openstack.org/pipermail/openstack-discuss/2020-January/011820.html
    2. https://etherpad.openstack.org/p/large-scale-sig-cluster-scaling
  3. Research computing conferences for 2020
  4. AOB

Minutes from the meeting

IRC Meeting January 7th 2020

2020-01-07 2100 UTC in channel #openstack-meeting

  1. Happy 2020, let's discuss your updated plans for this year
  2. AOB

IRC Meeting December 4th 2019

2019-12-04 1100 UTC in channel #openstack-meeting

  1. Unified limits and nested projects - johnthetubaguy
  2. The post-Gnocchi future
  3. AOB

Minutes from the meeting

IRC Meeting November 26th 2019

2019-11-26 2100 UTC in channel #openstack-meeting

  1. Supercomputing debrief
  2. Linuxbridge ML2 update
  3. Issues with mixing virt and baremetal
  4. The post-Gnocchi future
  5. AOB

Minutes from the meeting

IRC Meeting November 12th 2019

2019-11-12 2100 UTC in channel #openstack-meeting

  1. Shanghai trip report - Stig
  2. SC19 planning
  3. AOB

Minutes from the meeting

IRC Meeting October 29th 2019

2019-10-29 2100 UTC in channel #openstack-meeting

  1. Shanghai round-up
    1. Schedule picks
    2. Scientific SIG at the PTG
  2. Supercomputing 2019 - Denver, 17-22 November
  3. AOB

Minutes from the meeting

Earlier Meetings

Minutes and transcripts from all previous meetings can be found here.