Top Banner
San Diego, April 2013 LUG2013 EOFS Update Hugo R. Falter
27

LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

Sep 28, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013

LUG2013

EOFS Update Hugo R. Falter

Page 2: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 2

Overview

•  EOFS activities •  Participation in projects

Ø Politically driven Ø EIOW activities in national funded projects Ø National and EU funded projects

Page 3: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 3

The Lustre Open Source Community Activities in 2012 •  I/O Workshop 2012 in Garching

Organized by Peter Braam •  LUG 2012 in Austin

•  ISC 2012 in Hamburg Joint Booth, BoF(‘s)

•  Whamcloud Lustre Training in Barcelona •  LAD’12, Lustre Workshop 2012 in Paris

Two day’s session •  SC 2012 in Salt Lake City

Activities in 2013

•  LUG 2013 in San Diego

•  ISC 2013 in Leipzig Joint Booth, BoF(‘s)

•  LAD’13, Lustre Workshop 2013 in Paris

Two day’s session •  3rd Lustre Developers Summit in Paris

•  SC 2013 in Denver

Page 4: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 4

2012 EU Events

•  LAD’12 Ø Over 90 attendees

•  2nd Lustre Developers Summit

Ø 26 attendees from 10 companies Ø Very good/technical discussions

•  ISC12

Ø Breakfast panel was successful (120+ attendees) Ø Booth: Many visits but expensive Ø Lustre BOF: many attendees (Room was full)

Page 5: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 5

ISC’13 in Leipzig

•  Breakfast panel booked Ø Big Data in High Performance Computing Centers? Ø Panelist: DDN, XRTX, Intel, someone from hadoop?

•  Booth booked (# 515)

Ø Lustre BOF on June 18th from 15:00 till 17:00

•  Global budget should be less than 2012

Page 6: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 6

ISC’13 in Leipzig

Page 7: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 7

LAD’13: Save the date!

LUSTRE ADMINISTRATOR & DEVELOPPERS WORKSHOP 2013

Like in 2011 and 2012, Paris will be the place of 2-day event dedicated to Lustre administration and developments

Ø 16-17 September 2013 Ø At Hôtel Lutetia, Paris

Page 8: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 8

LAD’13: Save the date!

•  Talks are welcomed! •  Registration to be opened soon

•  All information on:

http://www.eofs.org/?id=lad13 Proudly sponsored by:

Page 9: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 9

3rd Lustre Developers Summit

•  LAD’13 will be followed by a 1-day summit. Ø September, 18th Ø 20-30 Lustre developers Ø Hotel Lutetia, Paris

Page 10: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 10

Participation in politically driven projects

•  ETP4HPC http://www.etp4hpc.eu/

Ø An ETP is an industry-led forum Medium to long-term research and technological objectives and developing roadmaps to achieve them. Increasing synergies between different research actors, ultimately enhancing European competitiveness

The European Commission is committed to its structured dialogue on research policy and priorities with European technology platforms

Page 11: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 11

How is ETP4HPC organized? •  Incorporated as a Dutch association •  Open membership for organizations having R&D based in Europe

•  Managed by a Steering Board with 15 members representing: Ø Research centres (5) Ø European SMEs (3) Ø European controlled corporations (5) Ø International companies with R&D in Europe (2)

•  Steering board organisation Ø Chairman Ø 2 Vice-chairmen for PRACE coordination and HPC development Ø Secretary-Administrator, Treasurer

•  Virtual office Ø BSC, CEA, Cineca+Eurotech, ParTec

Page 12: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 12

Founders: Key Players of HPC Technology Research in Europe

Page 13: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 13

ETP4HPC – New members

Page 14: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 14

Who should participate in ET4HPC ?

•  European HPC technology ecosystem: Ø Technology providers Ø ISVs facing the multi-core/new architectures disruption Ø Users looking for advanced technological HPC systems Ø Research centers involved in HPC research Ø Computing centers working on HPC technology or innovative Ø HPC system operation

•  Two possibilities Ø Full member : organizations with HPC research in Europe Ø Associate member: individuals or organizations not qualified for full

membership

Page 15: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 15

Strategic Research Agenda

Vision (objectives)

Strategic Research Agenda

(priorities)

EU Calls for

Proposals

European Research Area

Horizon 2020

ETP

HPC Technolog

y Providers

HPC  Research  Centre's  

HPC End Users

Page 16: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 16

Page 17: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 17

What are the main topics covered ?

Ø System and Component Architecture Ø System Software Ø Programming Environment Ø HPC Usage Models

Ø Energy driven HPC Ø Extreme parallelism Ø Resiliency Ø Compute, I/O and Storage Balance Ø Big Data – Supporting New Workloads Ø New HPC Delivery (e.g. Cloud)

Page 18: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 18

What are the relationships with PRACE ?

•  PRACE sets up a High-end Computing (HeC) infrastructure in Europe •  ETP4HPC defines and keeps updated a Strategic Research Agenda

(SRA) aiming to identify research priorities for the development of HPC technologies

•  Both organisations (ETP4HPC and PRACE) are part of the European HPC Governance and have complementary stakeholders

•  ETP4HPC and PRACE both will establish coordination cross links

between their organisations

Page 19: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 19

Why become a member of ETP4HPC ?

•  To participate in the definition of the R&D HPC strategy

•  To share your ideas about the evolution of HPC technology

•  To influence the definition of the SRA •  To pool your resources with other HPC stakeholders

•  To anticipate evolutions related to your activity

•  To increase the visibility and the voice of your organization

Page 20: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 20

Participation in politically driven projects

•  PROSPECT e.V. www.prospect-hpc.eu/ Ø "Promotion of Supercomputing Partnerships for European Competitiveness and Technology“

•  European Supercomputing Centers as initial members

Ø Forschungszentrum Juelich Ø Barcelona Supercomputing Center Ø Leibniz Supercomputing Center Ø A few university chairs, and several companies offering hardware or software for High Performance Computing.

•  Currently 39 members

Page 21: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 21

PROSPECT e.V.

•  Incorporated as an e.V. (e.V. is German for "registered association") •  Association has been founded on December, 15th 2008 in Garching,

Germany. •  The purpose of the association is the furtherance of science and

research in the field of supercomputing and technologies associated therewith. The association will realize its purpose in particular by holding scientific presentations and supporting research projects. Its aim is to foster the creation of a European Technology Platform (ETP) for HPC.

Page 22: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 22

Industrial users

scientific datacenter

HPC Vendors

Focus !

Europe and wordwide

users scientific datacenter

HPC Vendors

Europe

scientific datacenter

Europe

Research centers, universities, scientific users

Scientific Research Agenda (SRA)

European Commission

calls, research programs

Deliverables: produces

•  Techn. req. from EU industry to HPC vendors •  Req. from EU industry re HPC skill buildup •  Reg. updates from EC, PRACE, ETP4HPC, EESI, vendors. •  Reg. dialogue on experiences, best practices •  feedback & position relative to SRA

Deliverables:

produces

informs & updates

Positioning PROSPECT vs. ETP4HPC and PRACE

dialogue

Page 23: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 23

EIOW

Statement: The EOFS board welcomes and supports the Exascale I/O interfaces workgroup and will adopt it as an EOFS initiative. The EOFS board invites OpenSFS to join this initiative and make it a joint EOFS/OpenSFS project.

Page 24: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 24

EIOW activities in national funded projects

•  FAST (decision pending) Ø Find a Suitable Topology for Exascale Applications – Dynamische Topologien in höchstskalierenden Umgebungen Ø Coordinated by André Brinkmann, Johannes Gutenberg-Universität Mainz Ø 7 partners

•  ITEA 2: POINT2BDMC (decision pending) Ø Hierarchical Storage for HPC Ø Coordinated by Denis Foueillassar, Bull S.A.S. Ø 12 partners

Page 25: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 25

Participation in EU funded projects

•  DEEP www.deep-project.eu/ Ø Dynamical Exascale Entry Platform Ø One of the three Exascale projects funded by the EU 7th framework programme

Ø Coordinated by Forschungszentrum Juelich Ø Duration 36 months Ø Funding from the European Commission 8.03 Mio € Ø 16 partners The DEEP consortium will develop a novel, Exascale-enabling supercomputing architecture with a matching SW stack and a set of optimized grand-challenge simulation applications.

Page 26: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 26

Participation in EU funded projects

•  DEEP-ER (decision pending) Ø DEEP – Extended Reach Ø Coordinated by Forschungszentrum Juelich Ø 14 partners

Page 27: LUG2013 EOFS Updateopensfs.org/wp-content/uploads/2013/04/LUG2013-_San-Diego.pdf · • LAD’12, Lustre Workshop 2012 in Paris Two day’s session • SC 2012 in Salt Lake City Activities

San Diego, April 2013 LUG2013 27

Questions?