GENCI and PRACE HPC challenges from a French and

European perspective

G. Hautreux (GENCI)

HPCI Symposium 02/11/2017

l l

• Numerical Simulation: 3rd pillar of science with theory (modelling) and experimentation/ observation

Supercomputers

High Performance Computing

DATA+AI

High Performance

Data Analytics

02/11/2017 HPCI SYMPOSIUM 2

CONVERGENCE HPC & BIG DATA A new paradigma

Modelling of phenomena impossible to « reach »

with observation or experimentation

More and more precise numerical simulations

of complex phenomena

Optimisation of products and

of industrial process

l l 02/11/2017 HPCI SYMPOSIUM 3

THE CONTEXT (1/3) High Performance Computing, a strategic tool

Climat

Energy

Chemistry

Materials

Life Sciences

Astrophysics

Climate

For Science

Automotive

Aeronautics

Pharmacology

Oil & Gas exploration

Personalised medicine

For Innovation

Natural risks

Biological and epidemiological

risks

Impact of industrial activities

Security

For decision support

Social sciences & Humanities

l l 02/11/2017 HPCI SYMPOSIUM 4

THE CONTEXT (2/3) A global and multi-players competition

USA

Major Initiative Public/private partnerships Implication of all the federal

US agencies Exascale in 2021

China

An exascale system expected in 2021 (investment = 130

billion yens)

Japan

An European research infrastructure for HPC #1 objective: Compete with the US and Asia European Open Science Cloud and Data Infrastructure initiatives

Europe

France

Grand Equipement National de Calcul Intensif

Leader since 3 years Sunway TaihuLight #1 in the world (125 Pflop/s, (“home

made” components) Exascale in 2019 !

Massive investments for exascale with key

technological disruptions to come

l l 02/11/2017 HPCI SYMPOSIUM 5

THE CONTEXT (3/3) The HPC ecosystem in France

funded by in the context of

European Governance

National Governance

Regional Governances

25 country members including France represented by GENCI

< 1 Pflop/s

> 10 Pflop/s

Until 10 Pflop/s

Ignition in an annular combustion chamber

Instabilities in vortices

Microcracks in a material

3 computing centres 4 supercomputers

Coordination GENCI 15 partners

+ =

With an opening to the industrials, focus on SMEs

l l

French strategy for equipping the 3 national computing centres (TGCC, Idris, Cines)

National dynamics Expanded into the

regions with

02/11/2017 HPCI SYMPOSIUM 6

MISSIONS OF GENCI

National HPC + storage resources management

Promotion of HPC Among academics and industrials With a specific action towards SMEs Democratisation of the use of HPC in the context of CGI’s CEI with Teratec

GENCI represents France within PRACE Making Curie available (80%) Visibility in Europe

2000-2004 France’s delay

in HPC

2007 Creation of GENCI

to fill the gap

2017 Competitive resources,

Europe of HPC

“Civil society” 5 shareholders

2007-2016 budget = €30M 2017 budget = €30M

• Genci with Equip@meso partners • On the basis of the Bpifrance/GENCI/Inria Initiative

= Proof of concept

Participation in the Europe of HPC

European dynamics • One Network of 7 computers including Curie

70Pflop/s in 2017

l l 02/11/2017 HPCI SYMPOSIUM 7

GENCI IN FRANCE (1/3)

Regular renewal of supercomputers Computing power = 6,7 Pflop/s (x 380 in 10 years)

Free access to core hours Two calls per year for projects process managed by

GENCI, on the criterion of scientific excellence Open to academic researchers and industrials with

publication of their results In 2017, 1.6 billion core hours available Allocations to 600 projects in all fields with 15%

industrial support

Pilot of the allocation process of computing

time

Systems and access

Curie since 2012 Bull Bullx - 1,6 Pflop/s Ada and Turing since 2013

IBM - 1,6 Pflop/s

Occigen since 2015 Bull Bullx - 3,5 Pflop/s

6,7 Pflop/s in 2017

BULL Sequana 9 Pflop/s • 6 cells Skylake 24c : 79 488 c • 3 cells KNL 68c : 45 288 c • 380 TB memory • Multi level Lustre 500 GB/s • Upgrade to 20 Pflops in 2020

Irene (S2 2018)

l l 02/11/2017 HPCI SYMPOSIUM 8

GENCI IN FRANCE (2/3) Some examples of results

Cosmology: Evolution of the Universe 1st full simulations in the world of the evolution of the structuration of the whole observable Universe,

from the Big Bang to nowadays Monitoring of the evolution of 550 billion particles with > 2,5 trillion calculation points Procedure for data processing: 150 PB raw data -> 1,5 PB useful data with smart in-situ Bull Fourier 2012 + HPCwire 2012 and 2013 awards

20 million core hours GENCI on Curie in 2012

DEUS Project CNRS

Turbulence: Bioinspired technologies Simulation of the flight of the bumblebee for conceiving the next generations of micro-drones International project involving German (Berlin and Rostock) and Japanese (Chiba) researchers

Until 16,000 computing cores used to simulate a flight at 9 km/h Demonstration of the bumblebee’s ability to control his flight and to adapt it in a few microseconds

9 million core hours GENCI on Ada and Turing (Idris) in 2015 Next steps: Simulation of the flight of the hawkmoth and of fish swimming

Aix-Marseille Université project

Climatology: Oceanic circulation in the North Atlantic 1st simulations on a km scale taking into account the complexity of coasts and seabed + surface atmospheric

conditions A factor 30 improvement o the existing state-of-the-art Reference data for the joint French-US space mission SWOT in 2020

17 million core hours GENCI on Occigen (Cines) end 2014, with the NEMO code

H20 Project CNRS

l l 02/11/2017 HPCI SYMPOSIUM 9

GENCI IN FRANCE (3/3) SIMSEO a national initiative to boost SME competitiveness !

Result of GENCI/Teratec common answer to the Call for Expression of Interest (CEI) on the “Diffusion of numerical simulation”, launched by the Commissariat Général à l’Investissement (CGI) in 2014

Objective: To help French small and medium-sized companies access to numerical simulation

Dissemination related to HPC issues

Organised in the region by SystemX under

the management of GENCI and Teratec

Local support

7 regional platforms Normandie-Nord-Ouest

Aquitaine-Limousin-Poitou-Ch. Midi-Pyrénées-L.-Roussillon

Île-de-France Champagne-Ardenne

Alsace-Lorraine Auvergne-Rhône-Alpes

Sector-specific services

Construction industry Mechanics Engineering

Manufacturing …

Training Objectives: What is possible to

model? With what kind of tools? What for? With what kind of data? What is

the impact in the process of conception, validation and operation? What are the consequences on the business model? And what could be

the next steps to use numerical?

Sectorial, focused Acculturation Regional, tailor-made

ISC’17 – PRACE Industry Track 20 June 2017

10 www.prace-ri.eu

Partnership for Advanced Computing in Europe

PRACE is an international not-for-profit association under Belgian law, with its seat in Brussels. PRACE counts 25 members and 2 observers. The PRACE Hosting Members are France, Germany, Italy, Spain, and Switzerland. PRACE is governed by the PRACE Council in which each member has a seat. The daily management of the association is delegated to the Board of Directors. PRACE is funded by its members as well as through a series of implementation projects supported by the European Commission.

11 www.prace-ri.eu The Partnership for Advanced Computing in Europe | PRACE

Towards P

RA

CE

Partners

Tow

ards

End

-Use

rs

PRACE | services for science and industry

Tier-0 systems (open R&D) - Project Access

1-3 years - Preparatory Access

Type A, B, C, D Tier-1 systems (open R&D) - DECI Programme

Support Application Enabling & Support - Preparatory access Type C - Preparatory access Type D

- Tier-1 for Tier-0 - SHAPE - HLST support

Training - Training Portal - PATC, PTC - Seasonal Schools & on

demand - International HPC Summer

School - MOOC

- Code Vault - Best Practice Guides - White Papers

Access Communication, Dissemination, Outreach - Website - Public Relations - Scientific Communication - Summer of HPC Events - PRACEdays - SC, ISC, ICT, ICRI, DI4R, … Operation & Coordination of the common PRACE Operational Services - Service Catalogue - PRACE MD-VPN network - Security HPC Commissioning & Prototyping - Technology Watch, PCP - Infrastructure WS - Best Practices - UEABS

12 www.prace-ri.eu The Partnership for Advanced Computing in Europe | PRACE

PRACE | achievements ▶ 570 scientific projects enabled ▶ 16 000 000 000 (thousand million) core hours awarded since 2010 ▶ Of which 63% led by another PI nationality than the HM ▶ R&D access to industrial users with >50 companies supported ▶ >10 000 people trained by 6 PRACE Advanced Training Centers, and other

events ▶ 70 Petaflops of peak performance on 7 world-class systems ▶ 25 PRACE members, including 5 Hosting Members

(France, Germany, Italy, Spain and Switzerland)

13 www.prace-ri.eu The Partnership for Advanced Computing in Europe | PRACE

MareNostrum: IBM BSC, Barcelona, Spain #13 Top 500

JUQUEEN: IBM BlueGene/Q GAUSS @ FZJ, Jülich, Germany

#21 Top 500

CURIE: Bull Bullx GENCI/CEA, Bruyères-le-Châtel, France #85 Top 500

SuperMUC: IBM GAUSS @ LRZ, Garching, Germany #40 Top 500

Hazel Hen: Cray GAUSS/HLRS,

Stuttgart, Germany #17 Top 500

MARCONI: Lenovo CINECA, Bologna, Italy #14 Top 500

Piz Daint: Cray XC50 CSCS, Lugano, Switzerland #3 Top 500

PRACE | Tier-0 Systems

7 Tier0 systems 68 PFlop/s end 2017

14 www.prace-ri.eu The Partnership for Advanced Computing in Europe | PRACE

PRACE | support to science

Data up to and including Call 15, % of total core hours awarded (Project Access)

Biochemistry, Bioinformatics & Life Sciences [POURCENTAGE]

Chemical Sciences & Materials [POURCENTAGE]

Universe Sciences [POURCENTAGE]

Mathematical & Computer Sciences [POURCENTAGE]

Earth System Sciences

[POURCENTAGE]

Engineering [POURCENTA

GE]

Fundamental Constituents of Matter [POURCENTAGE]

15 www.prace-ri.eu The Partnership for Advanced Computing in Europe | PRACE

Breakthroughs for the EU research CLIMATE : FACING THE TEMPEST

A three-year advance in developing new climate models

144 million hours

on Hermit (Germany)

ASSESS THE IMPACT OF BIG EARTHQUAKES

3D full-wave tomographic IMAGINg of the Entire ITalian lithosphere

Use of SPECFEM3D

40 million hours

on Curie (France)

Nuclear physics: New outlooks PRACE (Juqueen@Jülich) + GENCI (Turing@Idris) ressources = 160 million core hours in 2014 Confirmation of the mass difference between neutrons and protons, necessary to the stability of nuclei

1st reliable calculation A step towards 10x more precise calculations Article in Science, commented in Nature by Franck Wilczek, Nobel Prize for physics in 2004

QCDpQED project U. Wuppertal/CNRS

160 million hours

on Juqueen (Germany)

16 www.prace-ri.eu The Partnership for Advanced Computing in Europe | PRACE

Breakthroughs for EU industry

16

IMPROVING CAR SAFETY A world premiere in the automotive industry

→ Performing more accurate crash optimization 42 million hours on Curie (France) Assess new large scale optimization methods: 200

parameters, 20 million finite elements Anticipate new security rules (EuroNCAP6) Impossible with internal Renault R&D HPC

resources

5 million core hours on Hermit (Germany) 8.2 million hours on CURIE (France)

DEVELOPING NEW DRUGS Molecular Dynamics Simulations for Computing Kinetic Constants for Drug Discovery Improve the process of drug discovery by

taking into account for the first time kinetic properties of a drug and a candidate protein

International collaboration K4DD (Kinetics for Drug Discovery) with NAMD and Gromacs

11 million core hours on Fermi (CINECA)

IMPROVING SHIP SURVIVABILITY UNDER WAVE IMPACT AND AQUAPLANING FOR AUTOMOTIVE

→ Major step: 32k cores simulations – Increased EU visibility and competitiveness for a SME 5 million core hours on Hermit (Germany)

8.2 million hours on CURIE (France)

02/11/2017 HPCI Symposium 16

l l 02/11/2017 HPCI SYMPOSIUM 17

© L. Flores – EC DG Connect

l l 02/11/2017 HPCI SYMPOSIUM 18

© L. Flores – EC DG Connect

EURO HPC

PRACE

CoE

ETP4HPC

19 www.prace-ri.eu The Partnership for Advanced Computing in Europe | PRACE

Targets of EDI | COM (2016) 178 final ▶ The European Data Infrastructure is the combination of world-class supercomputing (HPC) capability,

high-speed connectivity, leading-edge data storage and interfaces for cloud-based service delivery.

High-performance ICT infrastructures are needed to manage the current and expected scale of future data

flows. European science, industry and public services need world-class infrastructures and cloud-based

services to compete and thrive in the digital economy. The EDI will provide the right support for the

European Open Science Cloud (EOSC)

▶ Finally, scientific data producers and users must be able to re-use data and to use advanced analytics

techniques, …

▶ EDI will work in combination with the national and regional, scientific and public data centre

▶ The European Data Infrastructure will contribute to the digitisation of industry, to develop European

platforms for new, strategic applications (e.g. medical research, aerospace, energy) and to foster

industrial innovation. It will widen the user base of HPC, providing easier access via the Cloud both to

researchers in key scientific disciplines and to the long tail of science

20 www.prace-ri.eu The Partnership for Advanced Computing in Europe | PRACE

PRACE | perspectives of EDI ▶ Build on PRACE success so far ▶ Update of the PRACE Scientific Case ▶ Extend services

▶ Towards a data-centric approach ▶ Enhance integration of the Tiers ▶ Enhance services towards industry and extend

to public sector ▶ Further federate efforts

▶ European Commission & Member States ▶ Connect to EuroHPC

▶ Develop appropriate governance

new HPC services

Data services

new services

to industry

relation with

Géant

l l 02/11/2017 HPCI SYMPOSIUM 21

AND TOMORROW, WHAT ARE THE NEXT STEPS?

2007 2017 2020 0 Pflop/s ≈ 70 Pflop/s >> 500 Pflop/s

0,02 Pflop/s 6,8 Pflop/s > 80 Pflop/s

<0,01 Pflop/s ≈ 1,5 Pflop/s > 5 Pflop/s

Today: a consolidated ecosystem

But tomorrow: Necessity to continue to invest for remaining competitive… And for answering the needs of users and solving the big questions to come

With a big challenge to face: The convergence of HPC, HPDA, AI and cloud/networks

• Climate: 6th IPCC exercise and global climate models at a kilometric scale

• Combustion: Complete LES simulation of a turbine • Decision support: Real-time modelling of a forest fire, high

resolution seismic imaging of the Earth • Instrumentation: Using data of the future large instruments

(ITER, EUCLID, e-VLT, SWOT, SKA, APOLLON…) • Health: Modelling of the brain or the heart, personalised

medicine, … • Materials: New materials and nanotechnologies • …

22 www.prace-ri.eu The Partnership for Advanced Computing in Europe | PRACE

THANK YOU FOR YOUR ATTENTION ご清聴ありがとうございました

www.genci.fr www.prace-ri.eu