Anselm Cluster at IT4Innovations David...

81
Anselm Cluster at IT4Innovations David Hrbáč 18.9.2015

Transcript of Anselm Cluster at IT4Innovations David...

Page 1: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Anselm Cluster at IT4Innovations

David Hrbáč 18.9.2015

Page 2: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Intro

What is the supercomputer

Infrastructure

Access to cluster

Support

References

Page 3: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Mission and Vision

Mission

Our mission is to deliver scientifically excellent and industry relevant research in the fields of high performance computing and embedded systems. We are providing state-of-the-art technology and expertise in high performance computing and embedded systems and make it available for Czech and international research teams from academia and industry.

Vision

To became top European Centre of Excellence in IT with the emphasis on high performance computing and embedded systems. With our research, know-how and infrastructure we aspire to improve the quality of life, to increase the competitiveness of industrial sector and to promote the cross-fertilization of high-performance computing, embedded systems and other scientific and technical disciplines.

Page 4: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

The IT4Innovations National

Supercomputing Center

Prague

Brno

Ostrava

2013

2014

2015

80 TFLOPs system – most powerful supercomputer in Czech Republic, #6 in Central Europe (June 2013), operational since June 2013, 1 PFLOPs system planned for 2015

Page 5: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Early Days

Page 6: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

The Future / HAL

Page 7: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Supercomputer

Page 8: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

What is a Supercomputer

Bunch of computers

Having a lot of CPU power

Having a lot of RAM

Local storage

Shared storage

High-speed interconnected

Message Passing Interface

Page 9: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Supercomputer?!?

Page 10: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Supercomputer?!?

Page 11: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Areal View I.

Page 12: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Areal View II.

Diesel- generator

Four chillers

Cooling

infrastructure

Service

container

MOBULL

container

Page 13: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

MOBULL Layout

Page 14: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

MOBULL Inside III.

Page 15: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Anselm Hardware

Page 16: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 17: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 18: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 19: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 20: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 21: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 22: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 23: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 24: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 25: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 26: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 27: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 28: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 29: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 30: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 31: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 32: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 33: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 34: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 35: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 36: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Salomon vs. Anselm

0 200 400 600 800 1000 1200 1400 1600 1800 2000

Anselm

Velký cluster

Rpeak CPU

Rpeak GPU

Rpeak MIC

TFLOP

S

Salomo

n

Page 37: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 38: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 39: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 40: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 41: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 42: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 43: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 44: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 45: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 46: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 47: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 48: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 49: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 50: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 51: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 52: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 53: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 54: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 55: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 56: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 57: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 58: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 59: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 60: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 61: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active
Page 62: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Login Credential

Personal certificate

Signed request Credentials encrypted

Login

Password

SSH keys

Passphrase to the key

Page 63: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Credential Lifetime

Active project(s) or affiliation to IT4Innovations

Deleted 1 year after the last project Announcement

3 months before the removal 1 month before the removal 1 week before the removal

Page 64: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Anselm/Salomon SW Environment

Log-in

lSSH (X Forwarding)

lVNC

Modular software stack

lMultiple versions

lExtra data store

PBS Jobs scheduler

lQueues

lPriorities

lProjects

Page 65: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Accessing the Clusters

ssh

round-robin DNS record anselm.it4i.cz (login1,login2) salomon.it4i.cz (login1,login2,login3,login4)

Ssh Agent / Putty Pageant

Page 66: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Command line

Ssh Tmux – console multiplexer

Multisession Handles lost connection

Environment modules Modification to SW stack

Page 67: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

GUI Access

X11 forward Slow Needs fast connection ssh –X [email protected]

VNC server access Dead lock (kill screensaver, kill vncserver) Handles lost connection Vpnpasswd Vncserver :72 –geometry 1920x1080 –depth 24 ssh –L 5972:localhost:5972 [email protected]

Page 68: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Support

Bug tracking and trouble ticketing system

Documentation

IT4I internal command line tools

IT4I web applications

End-user courses

Page 69: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Support Main Mean

Request Tracker

Email [email protected]

Page 70: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Main Users

Page 71: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

mapy.cz

Page 72: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Testing codes for computational fluid dynamics

Page 73: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Thermal expansions of materials for 4th generation reactors

Page 74: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Performance and scalability test of a hydrological model with remote execution

Page 75: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Simulations of particle acceleration by short ultra-intense laser pulses

Page 76: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Research to help Moravian-Silesian Region (regional grants)

Page 77: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Research to help CR (national grants & bilateral co-operations)

VSB-TUO, CVUT, VUT, CDV, CAMEA, CEDA, CE-Traffic, ELTODO, Kapsch, KVADOS

MOLDIMED FN OL, FN Brno, MU, VSB-TUO, UMG AV CR,

IntellMed, GENERI BIOTECH, Sofigen, IAB, CGB lab, EXBIO Praha

Page 78: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Research to Help Europe (grants within 7th framework programme)

POLIMI, IMEC, ICCS, UCY, IT4I, THALES, HENESYS

Page 79: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

We Want You

Page 80: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Key Message

We will provide you with

Resources

Plenty of CPU time

Data store

Specialized HW – GPU cards

SW – you name

Support

Technical – what, how, when, where

Code experts

Optimization

Page 81: Anselm Cluster at IT4Innovations David Hrbáčprace.it4i.cz/sites/prace.it4i.cz/files/files/salomon-09-2015-hrbac.pdf · SSH keys Passphrase to the key. Credential Lifetime Active

Thank you for listening

Questions?

docs.it4i.cz

www.it4i.cz