NA4 Progress

www.see-grid-sci.eu

SEE-GRID-SCI

NA4 Progress

PSC06Istanbul, 7-8 December 2009

The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

Cevat SenerDept. of Computer Engineering

METU, [email protected]

SEE-GRID-SCI PSC06, Istanbul, December 7-8, 2009 2

■ NA4.1 Study the Grid applications

■ NA4.2 Adapt Grid applications

■ NA4.3 Support the deployed applications

■ NA4.4 Assess applications Grid usage and take-up

Activities


■ DNA4.1 Target applications analysis

■ DNA4.2 Application deployment and support

■ DNA4.3 Porting guidelines for target scientific fields

■ DNA4.4 User community engagement and applications assessment

Deliverables


■ Some more deployed in the last quarter – But not all!■ Applications generally going well.■ Some problems with CHERS

■ Its ASG team: Florin Pop and Emanouil Atanassov, in addition to Neki Frasheri

■ RO team is also ready for the support

■ Details shall be covered within the VO sessions.

Gridification Status


■ All applications are supposed to have a web page or a wiki section with■ Scientific model implemented■ User documentation■ Application Service usage

– In case of a separate web page, there should be a link from the wiki

■ Many applications has improved their page/wiki section■ However, some tend to postpone improving the

content on the web till when their applications become fully-ready.

Web Pages / Wiki


■ Especially, MCSAES, CHERS, MSACM, MSERRHSA, CCIAQ, WRF-ARW and MDSSP-WA should improve asap.

– But, all need to check considering the given list on the previous slide

■ ROMS has a web page, but no link from its wiki section

Web Pages / Wiki


■ Submissions to UF by most of the applications – except MSERRHSA and ROMS ?

■ Contributions to the VO training sessions■ Applications prefer not to submit to iSGTW before their

applications are fully-developed. ■ List of scientific events & journals to be announced

(kept updated) by the VO Leaders & Scientific Representatives■ Only by Seismo VO, so far, at

http://erciyes.cmpe.boun.edu.tr/seegridsci/scipub■ Number of publications from all three VOs

Application Dissemination


■ Seismology VO → OK

■ Meteorology VO → OK

■ Environmental VO■ No VOMS group for CHERS■ GreenView has only HU/App/Greenview

but no RO/App/Greenview group – Instead there exist RO/App/ESIP?

Application AccountingVOMS Groups


Application AccountingNumber of Jobs

Application Q1 Q2 Q3 Q4 Q5 Q6 Nov'09

MCSAES 122 463 92 2541 804 21 0

MSACM 1 199 859 53 37 0 5

SRA 0 0 0 0 0 14 3

MDSSP-WA 0 0 0 0 0 2 0

VO Q1 Q2 Q3 Q4 Q5 Q6 Nov'09

Seismo VO 0 0 100 1266 4937 999 291

Envo VO 0 0 381 3502 2448 1677 2640

Meteo VO 1 4681 4922 5738 1647 1524 1471


Application AccountingElapsed Time

Application Q1 Q2 Q3 Q4 Q5 Q6 Nov'09

MCSAES 21 480 6 5971 2237 4 0

MSACM 0 631 6664 99 247 0 0

SRA 0 0 0 0 0 0 2

MDSSP-WA 0 0 0 0 0 0 0

VO Q1 Q2 Q3 Q4 Q5 Q6 Nov'09

Seismo VO 0 0 0 278 63 222 207

Envo VO 0 0 3018 6139 3117 250 6338

Meteo VO 0 943 18175 12437 3822 4361 1743


■ Other applications not seen on the output■ Their developers not using the VOMS properly on submissions?■ Not yet implemented on the accounting portal? ■ Or ?

■ Any problem?■ Total of applications << VO figures■ Only in November there are 498 recorded submissions with VOMS

role, but overall total for SRA jobs is only 17 according to portal (927 jobs from TR-03-METU listed in Seismo VO – almost all should belong to SRA).

■ Portal claims that there are 12 submissions from AM and 3 from RO, but they are collaborating to SRA.

– Need to be figured out.

Application Accounting


■ At EGEE'09 Dorian Gorgan participated to a meeting with GENESI-DR representative Roberto Cossu. ■ Proposed the setting up of a pilot data repository for the

development tasks of the related international projects

■ He was to attend the GENESI-DR Workshop on "Earth observation data policy" at Villafranca on 04.12.09 ■ To present the position and requirements■ To iterate the proposal for the pilot data repository

GENESI-DR Interaction


■ Leading partner: RBI■ Date of the deliverable: M20 (this December)■ The goal of this deliverable:

■ Report the experience gained in the project by applications developers

■ Should be used to accelerate the migration of new applications to the grid

■ Focus will be on categorisation of porting issues for specific scientific fields

DNA4.3


■ Collect contributions from the partners through SEEGRID wiki pages – till 10th December

■ Develop new/upgrade wiki pages for Gridification Guide http://wiki.egee-see.org/index.php/SG_Gridification_Guide

■ Two types of contributions:■ Update and correct old wiki sections (1. - 5. section)■ Fill-in new sections (6. - 8.)

■ From wiki pages extract contribution for the final deliverable

■ New wiki sections – the core of the DNA4.3 → main contributions are expected from this sections

DNA4.3 – Plan


■ Old wiki gridification guide sections should be updated■ Job management■ File Management and Access■ Inter-job communication■ Information service■ Development Environments and Portals

■ Does not require lot of effort■ Should be checked and if some changes occurred

updated by contributors from SEE-GRID2

DNA4.3 – Old Sections


■ New wiki gridification guide sections■ Operational tools■ Application Level Services■ Targeted Scientific Fields

■ Environmental VO■ Meteo VO■ Seismology VO

■ Contributions are expected from the application developers

■ Detailed description of porting techniques, used tools and services, implementation details

■ Should be described job mgt, data mgt. Information service used, etc..

■ Describe using of existing JRA1 AS/OT

DNA4.3 – New Sections


■ ToC finished - 22nd October 2009■ Wiki pages structure created - 1st December 2009■ Start collecting contributions - 1st December 2009■ Some partners has already sent their contributions:

■ IPB (WatG Browser)■ SZTAKI (Workflows, CWRE, GSSVA, USGIME, NMMC3D)

DNA4.3 - Status


■ NA4.4 Assess applications Grid usage and take-up■ Assesses and quantifies the applications usage of the

infrastructure, and application take-up in the community [M19-M24]

■ Leader: RBI

■ Deliverable: DNA4.4 User community engagement and applications assessment [M24]

■ Lead beneficiary: RBI

Task NA4.4 Started in November


■ VOMS roles should be used properly when submitting jobs onto the eInfrastructure

■ List of scientific events and journals should be maintained by the Vos to guide the members.

■ Applications should be deployed in production as soon as possible, and they should be made available to the scientific community to attract potential users.

■ Web pages / Wiki sections should be completed.

Action


■ Immediate: Contributions to DNA4.3 by 10.12.09 & Wiki updates by 31.12.09.

■ Work on REFS to increase success rate.■ Investigate on getting seismic data from GE.■ Seismo VO will complete development of EMSC

interface.■ CHERS should make use the of mechanisms/support

offered like ASG team and RO team.■ Revision/Improvement of UF papers by all application

developers for submission to Earth Science Informatics special issue.

New APs


■ VO Leaders and all, especially deployed, applications should seriously work on ■ User community enlargement ■ Collaborations with other researchers, projects, applications ■ Scientific (most preferably,refereed) publications

■ Not only per-VO, but also per-application accounting figures need to be monitored and checked; any discrepancy should be reported.

■ The possibility of making use of RAS JRA1 AS within NA4 will be iterated; developers of RAS can provide a sample case to demonstrate its capabilities.

New APs

NA4 Progress

Documents

Transcript of NA4 Progress