1

Garuda : The National Grid Computing Initiative Of India

Natraj A.C,CDAC Knowledge Park,Bangalore.natraj@cdacb.ernet.in

2

Agenda

• About CDAC• Garuda grid highlights• Garuda Foundation Phase • EU-India grid• Garuda-EGEE Interoperability• Q&A

3

C-DAC

• Center for Development of Advanced Computing is a an autonomous society formed in 1988 under the Ministry of Communication & Information Technology, Government of India.

• 10 Centers across India.• High Performance Computing (HPC) and Grid Computing,

Real Time Systems, Embedded Systems, VLSI Design, Cyber Security, e-Governance, Education and Training (including e-learning)

• http://cdac.in

4

CDAC - Areas of focus

…

…

HPC Grid Computing

LanguageComputing

Professional Electronics

SoftwareTechnologies

Cyber Security

Science & Engineering

Industry e-Governance Health Education & Training

…

Enabling Technologies

End to End Solutions

5

CDAC Bangalore Overview•

Established in 1989 as a Resource Centre in System Software for High Performance Computing (HPC)

•

Activities cover HPC & Grid computing, Real Time & Dependable Computing, Heritage Computing, E-

Governance, Education and Training•

Houses C-DAC’s TeraScale Supercomputing Facility (CTSF) as a National HPC Facility

•

Several turn key projects in system software, real time systems and E-Governance for the domestic and foreign markets

•

100-150 Technical Members

6

GARUDA – At a glance

Proof of Concept phase of project completed in March 2008Precursor to the National Grid Computing Initiative

–

Test Bed for grid technology/concepts and applications leading to the plan for the main grid initiative

Major Deliverables on PoC–

Technologies, Architectures, Standards & Research Initiatives

–

Nation-wide high-speed communication fabric–

Aggregation of Grid Resources

–

Deployment of Select applications of National Importance–

Grid Strategic User Group

High-speed Networking Component in collaboration with ERNET

7

Garuda Communication fabric

CC--DAC, DAC, BangaloreBangaloreLAN

Local User

HeadNode

Compute Nodes

InternetAccessGeneric

User

Local User

HeadNode

Compute Nodes

LAN

CC--DAC, PuneDAC, Pune

Partner Partner without resourceswithout resources

Access Terminals

PartnerPartnerwith resourceswith resources

UserHeadNode

Telescope

LAN

Storage

HeadNode

Compute Nodes

LAN

Access Terminal

Gateway

Submit Node

Submit Node

Gateway

AccessTerminal

Access Terminal

Access Terminal

M P L S M P L S AccessAccess

Gateway

Gateway

CC--DAC, DAC, BangaloreBangaloreLAN

Local User

HeadNode

Compute Nodes

HeadNode

Compute Nodes

InternetAccess

InternetAccessGeneric

User

Local User

HeadNode

Compute Nodes

HeadNode

Compute Nodes

LAN

CC--DAC, PuneDAC, Pune

Partner Partner without resourceswithout resources

Access Terminals

PartnerPartnerwith resourceswith resources

UserHeadNode

Telescope

LAN

Storage

HeadNode

Compute Nodes

LAN

Access Terminal

GatewayGateway

Submit Node

Submit Node

Submit Node

Submit Node

GatewayGateway

AccessTerminal

Access Terminal

Access Terminal

M P L S M P L S AccessAccess

GatewayGateway

GatewayGateway

8

Garuda Component Architecture

Resources• Compute, Data, Storage,• Scientific Instruments, • Softwares,..

Access Methods• Access Portal• Problem Solving

Environments

Data Management• Storage Resource

Broker

Development Environment• DIViA for Grid

Management & Monitoring• Paryaveekshanam

Collaborative Environment• Video Conferencing over IP• Access Grid

Resource Mgmt & Scheduling• Moab from Cluster Resources• Load Leveler, Torque• Globus 2.x

Application (PoC)• Disaster Management• Bioinformatics

9

Grid Infrastructure – Resources

• At Bangalore, we have PARAM Padma and at Pune, Hyderabad & Chennai, we have Linux Clusters

• Grid Labs have been setup at Bangalore, Pune & Hyderabad

• Fourteen of the partner institutions are contributing resources including satellite terminals (compute aggregating to more than 600 CPUs)

10

GARUDA Partners• Motivation

– To Collaborate on Research and Engineering of Technologies, Architectures, Standards and Applications in Grid Computing

– To Contribute to the aggregation of resources in the Grid

• Current Participation– Total of 45 institutions– 36 research & academic

institutions in 17 cities– ERNET-HQ in Delhi– 8 centres of C-DAC

11

Bioinformatics• Bioinformatics Resources &

Applications Facility (BRAF) on PARAM Padma supports highly optimized bioinformatics codes

• Accessible to Bioinformatics community involved in insilico molecule identification and new drug discoveries.

• Web computing portal providing all computational facility to solve related problems

12

Disaster Management

PARAM Padma

at Bangalore

Flight data transmission from

nearby Airport

Grid Partner Resource

at Pune

User

Agencies

GRID Communication

Fabric

High Speed Communication

UserAgencies

13

Virtual User Community

• Astrophysics• High Energy Physics & Astronomy• Grid Technology• Disaster Management• Earth Science• Bioinformatics (Genome)• Computational Fluid Dynamics• Network Technology

14

Research Initiatives• Objective

– Create the foundation for next generation grids by addressing long term research issues in the strategic areas of • Knowledge and data management • Programming models • Architectures • Grid Management and Monitoring• Problem solving environments • Tools and grid services

• Research Initiatives in– Semantic Grids– Integrated Development Environment– Network Simulation– Mobile Agents– Grid File Systems– Resource Brokers

15

Collaborations• Space Application Centre, Ahmedabad

• Disaster Management• Grid Middleware for Satellite Grids

• Indian Institute of Science, Bangalore• Climate Modeling

• Madras Institute of Technology, Chennai• Grid Middleware for Semantic Grid Services

• Indian Institute of Technology, Mumbai• Computational Fluid Dynamics Package on PARAM Padma

• University of Pune• Quantum Chemistry, Materials Modeling, Bioinformatics• INDMOL Molecular Package developed

• EU-India Grid• BARC, C-DAC, ERNET, Saha Institute, TIFR, Univ. Pune• Consortium GARR, ICTP, INFN (Italy)• Cambridge University (UK)

16

Accomplishments of GARUDA PoC Phase

Building core technical competence in grid computing – development and deployment of Grid middleware, tools and servicesDeployment of Cyberinfrastructure– High speed Networking– Resource aggregation (resources from various

institutes/organizations) Prototype Demonstration of Applications of National importance- Disaster management (DMSAR)- BioinformaticsBuilding the Grid communityUnderstanding research challenges in Grid computing

17

Garuda Foundation - Objectives• To advance the scientific and technological

excellence in the area of Grid technologies

• To demonstrate selected pilot applications of national and strategic importance

• To strengthen and improve the Garuda grid infrastructure

18

Garuda – Foundation phase : 2008-09

• Test interoperability of Garuda with other international grids

• Monitor and operate the high speed bandwidth Garuda network and grid resources

• Upgrade Garuda resources • Demonstrate SOA framework that may lead to

participation from Industry• Research on security and grid technologies • Establish certificate authority for national grid

operation • Enable selected applications on grid environment

19

Targeted Grid Applications – prototype

. GMRT Data processing and analysis (NCRA)

. Disaster Management (SAC)

. Computer Aided Engineering (Zeus Numerix)

. Bioinformatics (C-DAC team)

. E-Learning (IIT Kgp)

20

Middleware Technology migration

• GT4.x test and deploy • Migration to Service Oriented Architecture

( SOA)• Test VOMS for virtual organisation

management• Deploy alternative metaschedulers • Old configurations to be maintained till

application users are migrated

21

Indian Grid Certification Authority (IGCA)

• The Indian Grid Certification Authority(IGCA) provides X.509 certificates to support the secure environment in grid computing. IGCA is under the process of getting accreditation from APgridPMA (Asia Pacific Grid Policy Management Authority) for Grid Authentication.

• We issue User Certificates and Host Certificates to users of GARUDA Grid, Foreign collaborators or institutes related to Grid research and scientific collaborations from India.

• The IGCA is operated by Garuda Grid Operation Centre.

22

Eu-Indiagrid Project Goals

• To support the interconnection and interoperability of the prominent European Grid infrastructure (EGEE) with the Indian Grid infrastructure (Garuda National Grid Initiative, DAE-Grid) for the benefit of eScience applications

• To identify and aggregate research, scientific and industrial communities which may benefit from the use of Grid technology resulting in an eScience Network Community

• To promote the use of advanced Grid technologies within the created Network Community relying on pilot applications in Biology and High Energy Physics Material Science, Earth and Atmospheric Sciences and specific outreach and dissemination activities

• To disseminate European EGEE Grid technology achievements in India and leverage on Indian Grid experiences and skills.

23

PARTICIPANTS

EUROPE• Italian National Institute of Nuclear Physics, INFN (project coordinator), • Metaware SpA, • Italian Academic and Research Network (GARR) • Cambridge University

INTERNATIONAL• Abdus Salam International Centre for Theoretical Physics (ICTP) INDIA• Indian Education and Research Network (ERNET), • University of Pune, • SAHA Institute of Nuclear Physics, Kolkata, • Centre for Development of Advanced Computing (C-DAC), • Bhabha Atomic Research Centre, Mumbai• TATA Institute for Fundamental Research (Mumbai)

National Centre for Biological Sciences (Bangalore)

24

Middleware Components: GARUDA Vs EGEE

MOAB

GLOBUS

lcg-CE(GT2 based)

GARUDA-CE(GT2 based)

BDII

GSI+VOMS

PORTAL UI

WMS

JC+LM

LFCSRM

MDS

GSI+gridmapfile

PBS-Like LRMS

WN-1WN-2

WN-nLinux + AIX

SRB

25

Experimental Setup – EGEE to GARUDA

26

GARUDA-EGEE Interoperability

Plans– Installation of UI, CE and worker node at CDAC KP.– Configure PBS of CE as client so that it could submit

job to PBS server at GARUDA.– Setting up of compute nodes with outbound connection

for EGEE – Trying out BMUSE application to port in both EGEE and

GARUDA infrastructure– Job submission from GARUDA to EGEE: couple of

solutions proposed

27

Any Questions ?

28

Thank you!www.garudaindia.in