A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny ***...

22
A.Joutchkov*, N.Tverdokhlebov*, S.Arnautov**, A.Yanovsky**, Y.Lyssov***, A.Cherny*** *Telecommunication Center “Science & Society” ** Institute for Chemical Physics RAS *** Institute for Molecular Biology RAS Development of an Interdisciplinary fragment of the Russian Grid segment: state of the art
  • date post

    19-Dec-2015
  • Category

    Documents

  • view

    217
  • download

    0

Transcript of A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny ***...

Page 1: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

A.Joutchkov*, N.Tverdokhlebov*, S.Arnautov**, A.Yanovsky**, Y.Lyssov***, A.Cherny***

*Telecommunication Center “Science & Society”

** Institute for Chemical Physics RAS

*** Institute for Molecular Biology RAS

Developmentof an Interdisciplinary fragment

of the Russian Grid segment: state of the art

Page 2: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

Telecommunication Centre “Science and Society”

“Science and Society”

Association of ScientificSocieties of Russia

State Institute ofInformation Technologiesand Telecommunications

“Open Society” Institute

MoscowCommunication

BackboneMinistry of Science Scientific Society

Page 3: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

Our areas of interest

• Telecommunication Grid infrastructure – Gigabit backbone development and maintenance.

• Biomedical metacomputing – Grid-based decisions for large-scale computing tasks in biology and health care.

• Investigating Grid-related aspects of knowledge networks (KN).

• Grid-services providing using specialized portals for interested users (scientific organizations mainly).

Page 4: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

SINP MSU – Institute for Nuclear Physics at MSU

Science & Society – There we are

IOC – Institute for Organic Chemistry

EIMB – Institute for Molecular Biology

ITEP – Institute for Theoretical and Experimental Physics

IITP – International Institute for Theory of Earthquake Prognosis

RSSI – Research Space Science Institute

М9 – Gateway to World

- Prospective

RGridin Moscow

Moscow Medical

Academy

Institute for

Biomedical Chemistry

National Research Center for Surgery

Institute for Virusology

StateScientific Center for

Immunology

Page 5: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

Backbone of the RGrid

ITEPIOC RAS

Science & Society320 SI95, 0.28 TBSINP MSU

SCC MSU

Gateway to FREENET

Gatewayto YuMOS

Gateway toCOSMOS

Gateway to RUHEP

ICP RAS

EIMB RAS

RbNet

С3524…

FastEthernet 100 MB/s

GigaEthernet 1GB/s

GENOMEResources

IITPRSSI

M9

……

С5505

……

С5505

С3524…

С3524…

С3524…

С3524…

… future connections

С3524…

С3524…

С3524…

GBI RAS

Page 6: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

GRID – InterdisciplinaryProject

• Unifying resources • Grid Technologies (Globus, …)

• Grid Teams (Working groups, Testbeds, …)

• Distributed Computation Implementation (LCG, BLAST,...)

• “Knowledge networks” development (Genomics,

Health Care, Ecology, Chemistry)

Page 7: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

“Science & Society”for Russian HEP Grid

ALICE distributed computations Communication using RGrid clusters

ATLAS backbone, Grid controlCMS software Testbed 0, Testbed 1, … WP 6

LHCb

LHC Our Gridexperiments role activity

Page 8: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

DNA LengthBacteria 1-3.106

Plants 1-5.108

You and me 4.109

Computationalcomplexity

“Science & Society”for Computational Biology

Page 9: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

BioGrid subsegment

IOC RAS

Science & Society320 SI95, 0.28 TB

ICP RASIBCP RAS

EIMB RAS

FastEthernet (100 Mb/s)

GigaEthernet (1,0 Gb/s)

С3524…

С3524…

С3524…

GBI RAS

Windows Clusterof EIMB

farm1

farm2

farm3

farm4

Farm-central

S & SCluster

Institute for Biomedical Chemistry

Virusology Institute

will be connected

in 2002

Page 10: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

BLAST experiment on RGrid:Web-portal for BLAST users Distributed computation schema

Page 11: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

BLAST experiment on “Grid”

(1st step - without Globus)

Windows Clusterof EIMB

Farm-central

farm1

farm2

farm3

farm4

UserQuery

blast.exe

blast.exe

blast.exe

blast.exe

executioncomputers

GUI

BLAST-run daemon

BLAST-end daemon

Datatransfer daemon

Data area

Data daemon

Page 12: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

BLAST experiment : Search Results

Page 13: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

BLAST experiment under PBS (2nd step – still without Globus)

Windows Clusterof EIMB

Farm-central

farm1

farm2

farm3

farm4

UserQuery

blast.exe

blast.exe

blast.exe

blast.exe

executioncomputers

GUIwww.rgrid.ru

PBS-server

Queue serverand

Task estimator

Page 14: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

BLAST experiment on Grid(3rd step – trying Globus)

Windows Clusterof EIMB

Farm-central

farm1

farm2

farm3

farm4

UserQuery

blast.exe

blast.exe

blast.exe

blast.exe

executioncomputers

GUIwww.rgrid.ru

PBS-server

GRAM

Userautentification

and autorization

Page 15: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

Knowledge Networks – a new level of data integration

Investigating Grid-aware aspectsof KN development

Page 16: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

Simple-way www-interaction

Page 17: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

Thin portal(1st step - links to services and resources)

Page 18: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

Thick portal (2nd step - searching, collecting and messaging)

Page 19: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

Broker ( 3rd element)

Page 20: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.
Page 21: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

Metadata formatsfor Data Collections

• Dublin Core (15 elements);

• Dublin Core with qualificators;

• Learning Object Metadata;

• MARC (21, Rus);

• Content Standard for Digital Geospatial Metadata (FGDC);

• Encoded Archival Description (EAD).

Page 22: A.Joutchkov *, N.Tverdokhlebov *, S.Arnautov **, A.Yanovsky **, Y.Lyssov ***, A.Cherny *** *Telecommunication Center “Science & Society” ** Institute for.

What further?

We are going:

• Develop requirements for hardware, software and middleware architecture of interdisciplinary Grid-node by experiments with Biomedical, HEP and Chemical tasks.

• Develop appropriate list of metadata formats to construct Knowledge Network prototypes.

• Develop requirements and specifications for common and specialized web-interfaces as GUI to Grid.