NA4 Progress

www.see-grid-sci.eu

SEE-GRID-SCI

NA4 Progress

PSC07Zabljak, 22-23 February 2010

The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

Cevat SenerDept. of Computer Engineering

METU, [email protected]

SEE-GRID-SCI PSC07, Zabljak, 22-23 February 2010 2

■ NA4.1 Study the Grid applications

■ NA4.2 Adapt Grid applications

■ NA4.3 Support the deployed applications

■ NA4.4 Assess applications Grid usage and take-up

Activities


■ DNA4.1 Target applications analysis

■ DNA4.2 Application deployment and support

■ DNA4.3 Porting guidelines for target scientific fields

■ DNA4.4 User community engagement and applications assessment

Deliverables


■ MNA4.1 Regional applications analysed [PM04]■ Means of verification: DNA4.1 Target applications analysis

■ MNA4.2 Three core user groups’ applications running on the regional Grid [PM24]■ Means of verification: DNA4.4 User community engagement

and applications assessment + Demonstration at review

Milestones


“In the second year of the project, the partners will need to place more emphasis on dissemination of the scientific outputs from the project.

Deliverable NA4.4 due in M24, User Community Engagement and Applications Assessment, should signpost: the new science / new capabilities developed by the project; how the scientific state of the art has been advanced by the project; how the grid has helped advance the science base.

In addition, it will be important to point to scientific papers produced by the project that have appeared in refereed conferences/journals outside the grid community in the scientific field of interest.”

Review Recommendations


■ Almost all in “Deployed in Production” !

■ Extension to GreenView: EnviMon from MD – Also “Deployed in Production”

■ CHERS – in “Developed Grid-mode”– almost ready for “Testing Grid-mode”

■ ROMS – in “Testing Grid-mode”

Gridification Status


■ All applications are supposed to have a web page or a wiki section – In case of a web page, there should be a link from the wiki

■ These, especially, should make improvements asap:■ MCSAES, CHERS, MSACM, MSERRHSA, CCIAQ, ROMS,■ GreenView (missing info on EnviMon), ■ Lizza-PAKP (link broken on the wiki)

– But, all need to consider the check-list for the content:■ Scientific model implemented■ User documentation*: guide, licensing info, ...■ Description of JRA1 AS/OT usage

* Suggested to use the format given in “2.4.2. User Documentation” of “Deliverable JRA1.3 – Application services design report”

Web Pages / Wiki Sections


■ Scientific publications (incl. submissions) within PY2■ CHERS: 1+1, GreenView: 10+0, Lizza-PAKP:1+0, ROMS:0+1, BG

Apps:10+2 => Total for Envo: 22+4■ WRF-ARW: 3+1, REFS: 4+0 => Total for Meteo: 7+1■ ELF: 1+0, FPS:1+1, SDS: 3+1, SRA: 1+3, MDSSP-WA: 1+1,

NMMC3D: 2+1 => Total for Seismo: 9+7■ a+b means 'published/just submitted' + 'near-future plan'

– More emphasis should be given to publications!

■ List of scientific events & journals to be announced (and then kept updated) by VOs in order to guide members ■ Achieved only by Seismo VO, so far, at

http://erciyes.cmpe.boun.edu.tr/seegridsci/scipub

Application Dissemination


■ VOMS groups are ready for all applications■ Some collaborators still not registered, eg.,

■ Ljupco Jordanovski to MDSSP-WA■ BG partners to SRA■ ME and GE partners to REFS

■ Application developers should check if all collaborators are registered to the applications' VOMS groups; ■ When such exists, VOMS admin should be contacted

■ Note: Regional collaborators in ROMS !

Application AccountingCollaborators in VOMS Groups


Application AccountingNumber of Jobs

– See the file Accounting_22.02.2010.xls –


Application AccountingBase CPU Time

– See the file Accounting_22.02.2010.xls –


■ Other applications not seen on the output■ Differences between VO totals of per-application accounting and

per-VO accounting numbers?■ Some sites not publishing the accounting data have been

identified – Could any other such site exist?■ All zero: CHERS, ROMS, SDA■ WRF-ARW + WRF-ARW/Role=developer ?

Application Accounting


■ All are met for all Vos■ Number of applications deployed■ Number of users■ Number of countries involved■ Number of research groups involved

■ Except■ Number of users for Meteo VO■ Expected: 35, Now: 30

PM24 Metrics


■ GENESI-DR works on defining and developing data policies and tools to support the data and service access.

■ There are two tendencies among partners GENESI-DR partners on data policy:■ To make public the spatial data, especially for EC projects,

education and research (e.g. GMES, GEO)■ To make data private and to require particular license (e.g.

RapidEye, JRC – by individual contract)■ Combination of the first two solution (e.g. ESA)

GENESI-DR InteractionBackground


■ SEE-GRID-SCI uses just the public data and services provided by GENESI-DR, available as batch files. ■ SEE-GRID-SCI continues to make experiments on functional

development and performance evaluation of tools and services considering data availability, format, dimension, location, etc.

■ GENESI-DR does not provide yet data we require in production.

■ SEE-GRID-SCI has made a proposal to GENESI-DR to develop and provide a set of pilot data repositories to be available for the development of the SEE-GRID-SCI applications. ■ The pilot repositories are resident on the sites of GENESI-DR data

providers. ■ Data could be accessed through secured ways and policy (i.e.

certificates to access Portal and distributed repositories), as any other production data.

GENESI-DR Interaction Status


■ Gridification Guideline updates (reflecting the information contained in DNA4.3) should be completed by the relevant contributors of DNA4.3 by 15 March 2010. ■ To be guided/followed by Davor.

DNA4.3 and GG@wiki


■ Taken from “http://appdb.eu-egee.org”■ EGEE Regional Support Applications Registry■ This registry is the central point for gathering and providing

information about the scientific applications deployed in EGEE, exploiting the project's international Grid infrastructure.

■ If you are interested in adding your application in the Regional Applications Database, please contact the team responsible for your region: “[email protected]”

EGEE APPDB


■ Task NA4.4 - “Assess of the application and takeup” ■ Assesses and quantifies the applications usage of the

infrastructure, and application take-up in the community,■ Finish with the deliverable DNA4.4 [PM24]■ Leader: RBI

■ Working plan:■ Accounting, for every application – the number of jobs, total CPU

time, based time,■ Per country application accounting (at least for the countries that

are involved in the application development) - CPU time, based time, number of jobs,

■ Per country engagement – number of jobs, CPU based time, CPU time

■ Total application usage per VO (summary of the application accounting)

■ Raw accounting data could be very useful!

NA4.4


■ DNA4.4 – “User community engagement and application assessment” [PM24]■ Final and overall assessment of the involvement of the end-user

community and application usage and take-up in the project■ Editor: RBI

■ What is to be reported?■ Application aims and benefits – description of the VOs

(env,meteo,seismo), social and scientific benefits per VO, social benefits

■ Summary of user community involvment – number of users, country distribution, number of user per VO,

■ Summary of international collaboration – other project with MoU, VOs, national VOs and other user groups, user community established between the project partners

DNA4.4


■ Proposed structure for application assessment, per VO, per application■ Application

■ Short description■ Usage scenario■ New scientific results – new capabilities developed within the

project, scientific stat of the art advances, how the grid has helped advance the science base

■ Scientific/social impact of the application (?)■ Overall user community and end-user involvement■ Application status on the grid■ Resource & requirements■ Developed by / Collaborations

DNA4.4 (2)


■ Analyzing the usage of the SEE-GRID infrastructure■ Analysis per scientific field – number of jobs, CPU time, based time■ Analysis per application■ Infrastructure usage by the applications■ Analysis per country engagement■ Summary of infrastructure requirements

DNA4.4 (3)


■ Existing APs on the followings are still valid with updates:■ Scientific (most preferably, refereed) publications■ Extended papers from UF to ESI – deadline 28 Feb'10■ ISTGW submissions■ User community enlargement■ Collaborations with other researchers, projects, applications■ Use of VOMS roles ■ Registering collaborators to application's VOMS group■ List of scientific events and journals by VOs ■ Web pages / Wiki sections with (i) Scientific model implemented,

(ii) User documentation*, (iii) Description of JRA1 AS/OT usage*: for the user documentation, the format given in “2.4.2. User Documentation” of DJRA1.3 is highly suggested

■ Updating Gridification Guide at wiki till 15.03.2010 – to be followed by Davor

Action


■ New APs:■ Meteo VO to note:

(i) PM24 metric 'number of users' not met yet and (ii) REFS accounting + WRF-ARW accounting << Meteo VO accounting

■ CHERS and ROMS to be deployed in production asap ■ Lizza PAKP and NMMC3D to investigate the accounting issues■ BBmSAM to start submitting tests with Envo VO credentials –

towards end of project■ Complete the gridification of EnviMon and its integration with

GreenView (incl. info on the web/wiki)■ MDSSP-WA to have the final version for production ■ SRA application will work on getting input data from other

countries like MK, MD, BG.■ SDSAS source version control by C.Ozturan■ Format of the AL earthquake data to be corrected

Action


■ New APs (cnt'd):■ ToC for DNA4.4 is to be finalized and contributions to the

deliverable to be collected by Davor. Need to cover both the technical and scientific points of view.

■ Developers consider adding their applications to EGEE APPDB at “http://appdb.eu-egee.org”

■ SEE-GRID-SCI logo to put on the applications' web pages■ Classification of NA4 publications as Grid and non-Grid

Action

NA4 Progress

Documents

Transcript of NA4 Progress