http://www.dorii.eu/

DORII Joint Research ActivitiesDORII Joint Research Activities

Status and Progress

4th All-Hands-Meeting (AHM)

Alexey Cheptsov

on behalf of the JRA

16.06.2009, Santander, Spain

DORII Joint Research Activities Goals and Objectives 1/2

The Remote Instrumentation Infrastructure. Layered viewThe Remote Instrumentation Infrastructure. Layered view

The JRA aim at setting up a middleware framework, extended and enhanced towards support of Remote Instrumentation Applications, enabling full-service management, maintenance and exploitation of heterogeneous instrumentation and acquisition devices on the Grid.

The JRA aim at setting up a middleware framework, extended and enhanced towards support of Remote Instrumentation Applications, enabling full-service management, maintenance and exploitation of heterogeneous instrumentation and acquisition devices on the Grid.

Visualization and Interactivity (Int.EU.Grid)

Workflow Management

(VLab)

Middleware Services

Middleware Services

Core middleware stack (EGEE)

Core middleware stack (EGEE)

Computation Grid

Storage Grid

Application Development on Grid (g-Eclipse)

Application Development on Grid (g-Eclipse)

Management of Grid resources

(GRIDCC)

Management of Grid resources

(GRIDCC)

The DORII middleware architectureThe DORII middleware architecture

Remote Instrumentation on Grid (RinGRID, GRIDCC)

DORII Middleware FrameworkDORII Middleware Framework

Management & Development

tools

Management & Development

tools

DORII Joint Research Activities Goals and Objectives 2/2

Parallel application

support (Open MPI)

The time planning of JRA tasksThe time planning of JRA tasks

Time planning and tasks performed 1/14

M1 M2 M3 M4 M5 M6 M7 M8 M9 M10 M11 M12 M13 M14 M15 M16 M17 M18 M19 M20 M21 M22 M23 M24 M25 M26 M27 M28 M29 M30

IdentificationAdaptationFinal Report

1.1 M1: First release of SW M2: Updated Release M3: Updated Releases1.2.1-11.2.1-21.2.1-31.2.2-11.2.2-21.2.2-31.2.2-41.2.2-51.2.2-61.2.3-11.2.3-21.2.3-31.2.4-11.2.4-21.3-11.3-21.3-3Final Report

Color Coding: ALL PSNC ELETTRA GUP HLRS

DJRA1.1 DJRA1.2 DJRA1.3

The time planning of JRA tasks. AdaptationThe time planning of JRA tasks. Adaptation

Time planning and tasks performed 2/14

M1 M2 M3 M4 M5 M6 M7 M8 M9 M10 M11 M12 M13 M14 M15 M16 M17 M18 M19 M20 M21 M22 M23 M24 M25 M26 M27 M28 M29 M30

IdentificationAdaptationFinal Report

1.1 M1: First release of SW M2: Updated Release M3: Updated Releases1.2.1-11.2.1-21.2.1-31.2.2-11.2.2-21.2.2-31.2.2-41.2.2-51.2.2-61.2.3-11.2.3-21.2.3-31.2.4-11.2.4-21.3-11.3-21.3-3Final Report

Color Coding: ALL PSNC ELETTRA GUP HLRS

Task 1.3 – Integration of all enhanced components into a common framework

Time planning and tasks performed 3/14

Plan for adaptation of the components to the requirements of the Remote Instrumentation Infrastructure

Plan for adaptation of the components to the requirements of the Remote Instrumentation Infrastructure

Time planning and tasks performed 4/14

Developer support environmentDeveloper support environment

https://gforge.hlrs.de/projects/dorii-jra/https://gforge.hlrs.de/projects/dorii-jra/

GForge is a collaborative software development environment, also adopted in the DORII JRA.

• a set of collaborative and groupware tools (mailing lists, forums, bug and issue trackers, etc.)

• a set of collaborative and groupware tools (mailing lists, forums, bug and issue trackers, etc.)

• additional services, such as File Release System, Document Management Service, etc.

• additional services, such as File Release System, Document Management Service, etc.

Main features:Main features:• a subversion-based version control system for storing and management of the source code, documentation and other files

• a subversion-based version control system for storing and management of the source code, documentation and other files

Time planning and tasks performed 5/14

Source code version control systemSource code version control system

Release 1.0 of the DORII middleware components

trunk

DORII.eu

applicationsmiddleware

VCR WfMS

OPATM-BFM SWAN

g-Eclipse

Open MPI

branch

release Your application

application farm

user domain

Common LibVisualization

Time planning and tasks performed 6/14

Release of the 1st version of the DORII middleware frameworkRelease of the 1st version of the DORII middleware framework

Time planning and tasks performed 7/14

Time planning and tasks performed 8/14

Early deployment of the pilot applications on the DORII infrastructure

Early deployment of the pilot applications on the DORII infrastructure

Time planning and tasks performed 9/14

Evaluation of the user feedback, mainly on the user interface (VCR)

Evaluation of the user feedback, mainly on the user interface (VCR)

With regard to the middleware architecture, the overall rating was goodWith regard to the middleware architecture, the overall rating was good

but…

Grid security requires some simplification

Slowness of performing some operations must be overcome and perceived effectiveness improved

Reliability must be improved (already foreseen by the Plan for Adaptation)

Application customization and usability must be improved

Integration with data bases (i.e. for the availability of historical data), as well as meta- and semantic data

Tools for postprocessing and advanced visualization (of data acquired and postprocessed) must be integrated as well

Time planning and tasks performed 10/14

User support in JRAUser support in JRA

Helpdesk – an online issue and bug tracker

Helpdesk – an online issue and bug tracker

dorii-user-support@...user support mailing listdorii-user-support@...

user support mailing list

www.dorii.eu/middlewareDORII middleware page

www.dorii.eu/middlewareDORII middleware page

Time planning and tasks performed 11/14

Collaboration within the workpackageCollaboration within the workpackage

Time planning and tasks performed 12/14

Participation in conferencesParticipation in conferences

Instrumenting the Grid (INGRID’09) conference

Parametric Jobs Facilitation of IE Usage in Grid Applications. K. Bylec, S. Mueller, M. Pabiś, M. Wojtysiak, P. Wolniewicz

Analysis and optimization of performance characteristics of parallel scientific applications on the Grid (a case study for the OPATM-BFM environmental application). A. Cheptsov, B. Koller, S. Salon, P.Lazzari

HPC-Europa seminars

Our scientific activitiesOur scientific activities

Time planning and tasks performed 13/14

Participation in conferencesParticipation in conferences

Computational Methods in Science and Technology

Towards deployment of the Remote Instrumentation e-Infrastructure (in the frame of the DORII project) – published

International Conference for High-Performance Computing, Networking, Storage and Analysis

Grid Support of Scientific Instrumentation in Practice – The Remote Instrumentation e-Infrastructure – submitted

IEEE International Workshop on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS'2009)

Remote Instrumentation Infrastructure for e-Science. Approach of the DORII project – accepted

Our scientific activitiesOur scientific activities

Scientific articlesScientific articles

Time planning and tasks performed 14/14

1st annual DORII review

a draft of the presentation incorporating the suggestions of the Coordinator is done

internal discussion takes place

2nd release of the middleware

main outcome – the common library and basic support of it in

Further integration of components, according to the Plan for Adaptation of Components

Important deadlines and milestonesImportant deadlines and milestones