Helix Nebula, the Science Cloudeuchina2013.ux.uis.no/presentations/HN presentation...Helix Nebula...

Helix Nebula, the Science Cloud

CloudCom SCC-Computing Summer Symposium on EU-China-

North America Collaboration on HPC, Cloud and Big Data Stavanger, 20-21 June 2013

Maryline Lengert, ESA

2 CloudCom 2013, Stavanger 20-21 June 2013 Maryline Lengert, ESA

Why is Helix Nebula relevant for HPC?

• Started with 3 “extreme” labs with global user community – Instrumentation:

• Earth Observation satellites and archives, • LHC • Next Generation DNA sequencing and high-throughput 4-dimensional

microscopy/imaging technologies

– Models: • Climate change, Earthquakes, … • LHC: Interactive data analysis, simulation of physics detectors • Helps biomedical researchers to better understand the concepts of life

(aging, diseases…) and it also helps developing new drugs or treatments


Source: Tyndall Centre for Climate Change research & EC “Towards a ‘Global Systems Science’” - Ralph Dum

Example: Humans in the loop: A vicious circle of positive feedback loops

4 Maryline Lengert, ESA CloudCom 2013, Stavanger 20-21 June 2013

Helix Nebula, the Science Cloud initiative is a Partnership between big science and

big business to implement the Strategic Plan for a

Scientific Cloud Computing Infrastructure in Europe


http

://c

dsw

eb.c

ern.

ch/r

ecor

d/13

7417

2/fil

es/C

ERN

-OPE

N-2

011-

036.

pdf

1. Set up a sustainable multi-tenant cloud computing infrastructure in Europe, initially

based on the needs of the European Research Area & Space agencies

2. Identify and adopt policies for trust, security and privacy on a European-level

3. Create a light-weight governance structure involving all stakeholders

4. Define a short and medium term funding scheme

http://cdsweb.cern.ch/record/1374172/files/CERN-OPEN-2011-036.pdf










What is Infrastructure?

• Infrastructure consists of common resources used for deployment of platforms.

• Physical infrastructure includes the copper, fiber, silicon, and wireless switching fabric of the internet.

• DNS is an infrastructure service for the Internet.

Source: http://iot-datamodels.blogspot.fr/2012/12/the-internet-of-things-needs-open.html


Helix Nebula, the Science Cloud

• It is NOT a project! • It doesn’t have a paying customer: it is meeting

strategic interest of each participant preparing the future

• It has been set up by “Extreme Labs”, IT & T-Com industry, SMEs (application & computing) to create something new by bringing together a fragmented landscape and building on strength from sustainable diversity


Strategic Objective • The European Research Area shall drive the

development and implementation of a secure and globally recognised European Cloud Computing Infrastructure, initially targeting science users. This infrastructure will become THE platform for Europe, under public governance, ensuring open standard and interoperability and adhering to European policies, norms and requirements.


Long Term Goal • To create a multi-tenant ‘Open Market Place for

Science’, where data, scientists, funding bodies, SMEs and downstream industry are meeting to work along common interests.

This ecosystem should implement

many-to-many relationships, quickly being established, to transform

data into valuable information


Operating as an Ecosystem

An ecosystem is a community of living organisms (plants, animals and microbes) in conjunction with the nonliving components of their environment (things like air, water and mineral soil), interacting as a system.

An ecosystem is a community of living organisms (plants, animals and microbes) in conjunction with the nonliving components of their environment (things like air, water and mineral soil), interacting as a system.


What is an Ecosystem? • An ecosystem is a system of systems that all share

resources and protocols, and interact and influence the outcome of each other.

• In a healthy ecosystem there is a natural interdependence that is balanced against competition.

• An ecosystem needs multiple competing platforms to be contained within a single company or institution.

• The sustainable ecosystem seems to be based on open participation at all levels.

Source: http://iot-datamodels.blogspot.fr/2012/12/the-internet-of-things-needs-open.html


Contributors to the Ecosystem

Scientists

Data providers

IT Suppliers Funding Bodies R&D Labs

SME’s

Downstream industry


Data provider Supplier Y Supplier X

Skills Brokerage

Data & tools

IT Brokerage

Scientist Funding bodies (€/$/£)

Supplier A SME

Supplier SME

Demand

Supplier

Final Ecosystem: Discovery driven

Discovery oriented approach

Skills brokerage: Dynamic team building based on discovery


Timeline

2011 2012-2013 2014 …

• Pilot Phase • Deploy flagships, • Analysis of functionality,

performance & financial model

Towards an open market for Science

• Endorse the Common Strategy

• Agree on the Partnership • Select flagships use cases • Define governance model


Initial Flagship Use Cases

• Scientific challenges with societal impact • Sponsored by user organisations • Stretch what is possible with the cloud today


New flagships • 3 selected from 15 proposals:

– European Center for Medium Range Weather Forecasts (ECMWF)

• Weather Data Information Supersite (WDIS) with 100 years of weather data

– UNESCO (Intergovernmental Oceanographic Commission) • Ocean and Coastal Information Supersite (OCIS)

– Port d’Informació Científica (PIC), Barcelona • Reduce costs and improve speed of delivery, increase

volume and accuracy for Neuroimaging

• Foresee to deploy the new flagships in 2H 2013


Helix Nebula, GEANT & GRID

• Connections of Helix Nebula partners is ensured through private and/or GEANT network (100 Gbit/s)

• EGI (European Grid Infrastructure) is part of Helix Nebula consortium and will also be accessible through the Blue Box thanks to an hybrid model

Helix Nebula and EGI supply: proposed hybrid model

EGI Helix Nebula

Atos Cloud Sigma

T- Systems

Blue Box Fed Cloud Task Force

Front-end Front-end Front-end

Front-end Front-end

Academic Other market sectors Big Science Long tail

Public funded

Commercial

HN as supplier to research

Government Manufacturing Oil & gas, etc.

CloudCom 2013, Stavanger 20-21 June 2013 Maryline Lengert, ESA 18

Net

wor

k C

omm

erci

al/G

EA

NT


Helix Nebula and HPC • The expertise developed by the HPC community

in efficient parallel programming paradigms and optimising software for a range of architectures is directly relevant.

• As well as sharing expertise, the services offered by structures such as Helix Nebula and the HPC centres should be integrated to form part of the overall ecosystem To participate in the federated identity management scheme and data sharing services.


Mutual Benefits • Increase the HPC user community with relevant

capability needs and possibility to off load capacity to Helix Nebula (commodity hardware)

• Bringing HPC resources within this heterogeneous and federated Science Cloud Infrastructure would significantly enhance the performance of the overall infrastructure and its ability to solve next generation of scientific problems (in the field of bioinformatics, climate change, …)


https://cds.cern.ch/record/1537032

A European cloud computing partnership: big science teams up with big business

Strategic Plan

Establish multi-tenant, multi-provider cloud infrastructure

Identify and adopt policies for trust, security and privacy

Create governance structure

Define funding schemes

To support the computing capacity needs for the ATLAS

experiment

Setting up a new service to simplify analysis of large

genomes, for a deeper insight into evolution

and biodiversity

To create an Earth

Observation platform, focusing on

earthquake and volcano research

Adopters

http://www.helix-nebula.eu/

http://www.awst.at/en/index.html





Helix Nebula, the Science Cloudeuchina2013.ux.uis.no/presentations/HN presentation...Helix Nebula...

Documents

Transcript of Helix Nebula, the Science Cloudeuchina2013.ux.uis.no/presentations/HN presentation...Helix Nebula...