Recent ARC developments in the EMI project

13
EMI is partially funded by the European Commission under Grant Agreement RI-2 Recent ARC developments in the EMI project Andrii Salnikov, Ievgen Sliusar UNG 2012, November 1

description

Recent ARC developments in the EMI project. Andrii Salnikov , Ievgen Sliusar. UNG 2012 , November 1. Road behind ARC. Balázs Kónya , NorduGrid 2012, Uppsala, Sweden. UAG. First grid segment of NASU. First grid clusters in Ukraine: KIPT, BITP, KNU. EMI goal. Before EMI. - PowerPoint PPT Presentation

Transcript of Recent ARC developments in the EMI project

EMI is partially funded by the European Commission under Grant Agreement RI-261611

Recent ARC developments in the EMI project

Andrii Salnikov, Ievgen Sliusar

UNG 2012, November 1

UNG 2012 2

Road behind ARC

01/11/2012 Balá

zs K

ónya

, Nor

duG

rid 2

012,

Upp

sala

, Sw

eden

First grid clustersin Ukraine:

KIPT, BITP, KNU

First grid segment of NASU

UAG

UNG 2012 3

EMI goal

Balá

zs K

ónya

, Nor

duG

rid 2

012,

Upp

sala

, Sw

eden

Standards,New technologies,

Users and Infrastructure Requirements

EMI common products

3 yearsBefore EMI After EMI

Implemented Agreements

Repositories

01/11/2012

UNG 2012 4

CE: EMI-ES (CREAM, A-REX, UNICORE/X)IS: GLUE2 XML and LDAP renderingII: EMI Registry (EMIR)SE: SRM v2.2 (dCache, DPM, StoRM)Accounting: APELEMI Clients: ARC ClientsEMI DataLib: GFAL2EMI Security: VOMS, caNl

EMI Standards

01/11/2012

UNG 2012 5

A-REX

Job management interfaces:• gridFTP (old one, globus-

based, will be dropped)• xBES (OGSA WS-interface,

not really used)• EMI-ES

Secure, Robust, Feature-rich CERuns on any UNIX/Linux platformsNo impact on other OS componentsSupport various batch systemsEasily extendable by plugins

01/11/2012

UNG 2012 6

ARIS

Flor

ido

Paga

nelli

, Nor

duG

rid 2

012,

Upp

sala

, Sw

eden

LDAP NorduGrid LDAP Glue1.3 GLUE2

01/11/2012

UNG 2012 7

ARC service discovery

Flor

ido

Paga

nelli

, Nor

duG

rid 2

012,

Upp

sala

, Sw

eden

NorduGrid LDAP OnlyPerformance Issues

01/11/2012

UNG 2012 8

SE: ARC withdrawn own SE implementation, but works well with existing ones.Accounting to APEL: JURA (almost there).ARC Clients as EMI Clients: fully interoperable with GLUE2 and EMIR. Ongoing performance improvements and more testing.EMI DataLib: ARC DataLib is able to employ GFAL2 (code is finished), but packaging issues exist.EMI Security: caNl++ is finished, client-side integration for arcproxy tool only, same problems with packaging.

Other components

01/11/2012

UNG 2012 9

Documentation

Balá

zs K

ónya

, Nor

duG

rid 2

012,

Upp

sala

, Sw

eden

01/11/2012

UNG 2012 10

Total sites in EGIIS: 33Sites in giis.grid.org.ua EGIIS: 28Sites in lcg.bitp.kiev.ua EGIIS: 20

Sites with GLUE2: 5Sites with EMI-ES: 4

UNG ARC Deployment

failed - 30.6.1 - 10.6.5 - 40.8.1 - 10.8.1.1 - 10.8.3 - 10.8.3.1 - 51.0.1 - 11.1.0 - 42.0.0 - 12

01/11/2012

UNG 2012 11

• Update to EMI-2 ARC and keep it up to date• Enable GLUE2 and EMI-ES• Read the manual and find advanced

configuration use-cases to efficiently utilize cluster resources• EMIR deployment in Ukraine (almost there)• Enable accounting (SGAS and APEL)• Use the latest EMI clients!

Moving the right way

01/11/2012

UNG 2012 12

ARC components:nordugridmapPBS batch system backendsplugins for advanced use-casesdocumentationlots of bug-reports and bug-fixesStand-alone solutions:PHP VOMS-Admin

Our contribution

01/11/2012

UNG 2012 13

Questions?

01/11/2012