VOMS: Status & Plans Vincenzo Ciaschini, Valerio Venturi MWSG Meeting, CERN, Feb 23-24 2005.
D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2...
-
Upload
eugene-simon -
Category
Documents
-
view
216 -
download
3
Transcript of D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2...
![Page 1: D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.](https://reader036.fdocuments.net/reader036/viewer/2022082820/56649e4c5503460f94b41af3/html5/thumbnails/1.jpg)
D. Britton
GridPP Status - ProjectMap22/Feb/06
![Page 2: D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.](https://reader036.fdocuments.net/reader036/viewer/2022082820/56649e4c5503460f94b41af3/html5/thumbnails/2.jpg)
22/Feb/2006 GridPP Status D. Britton
GridPP2 ProjectMap
0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 0.10 0.11 0.12 0.13 0.14 0.15 0.16 0.17 0.100 0.101 0.102 0.103 0.104 0.105 0.106 0.107 0.108 0.109 0.110 0.111 0.112 0.113 0.114 0.115 0.116
0.18 0.19 0.20 0.21 0.22 0.23 0.24 0.25 0.26 0.27 0.28 0.29 0.30 0.31 0.32 0.33 0.34 0.117 0.118 0.119 0.120 0.121 0.122 0.123 0.124 0.125 0.126 0.127 0.128 0.129 0.130 0.131 0.132 0.133
0.35 0.36 0.37 0.38 0.39 0.40 0.41 0.42 0.43 0.44 0.45 0.46 0.47 0.48 0.49 0.50 0.51 0.134 0.135 0.136 0.137 0.138 0.139 0.140 0.141 0.142 0.143 0.144 0.145 0.146 0.1470.52 0.53 0.54 0.55 0.56 0.57 0.58 0.59 0.60 0.61 0.62
2.1 3.1 4.1 5.1 6.1
1.1.1 1.1.2 1.1.3 1.1.4 2.1.1 2.1.2 2.1.3 2.1.4 2.1.5 3.1.1 3.1.2 3.1.3 3.1.4 3.1.5 4.1.1 4.1.2 4.1.3 4.1.4 4.1.5 5.1.1 5.1.2 5.1.3 5.1.4 5.1.5 6.1.1 6.1.2 6.1.3 6.1.4 6.1.5
1.1.5 2.1.6 2.1.7 2.1.8 2.1.9 2.1.10 3.1.6 3.1.7 3.1.8 3.1.9 3.1.10 4.1.6 4.1.7 4.1.8 4.1.9 4.1.10 5.1.6 5.1.7 5.1.8 5.1.9 5.1.10 6.1.6 6.1.7 6.1.8 6.1.9
2.1.11 2.1.12 3.1.11 3.1.12 3.1.13 4.1.11 4.1.12 5.1.11 5.1.12
2.2 3.2 4.2 5.2 6.2
1.2.1 1.2.2 1.2.3 1.2.4 2.2.1 2.2.2 2.2.3 2.2.4 2.2.5 3.2.1 3.2.2 3.2.3 3.2.4 3.2.5 4.2.1 4.2.2 4.2.3 4.2.4 4.2.5 5.2.1 5.2.2 5.2.3 5.2.4 5.2.5 6.2.1 6.2.2 6.2.3 6.2.4 6.2.5
1.2.5 2.2.6 2.2.7 2.2.8 2.2.9 2.2.10 3.2.6 3.2.7 4.2.6 4.2.7 4.2.8 4.2.9 4.2.10 5.2.6 5.2.7 5.2.8 5.2.9 5.2.10 6.2.6 6.2.7 6.2.8 6.2.9 6.2.10
2.2.11 2.2.12 2.2.13 2.2.14 2.2.15 4.2.11 4.2.12 4.2.13 4.2.14 4.2.15 5.2.11 5.2.12 5.2.13 5.2.14 5.2.15 6.2.11 6.2.12 6.2.13 6.2.14
2.3 3.3 4.3 6.3
1.3.1 1.3.2 1.3.3 2.3.1 2.3.2 2.3.3 2.3.4 2.3.5 3.3.1 3.3.2 3.3.3 3.3.4 3.3.5 4.3.1 4.3.2 4.3.3 4.3.4 4.3.5 6.3.1 6.3.2 6.3.3 6.3.4 6.3.5
2.3.6 2.3.7 2.3.8 2.3.9 2.3.10 3.3.6 3.3.7 3.3.8 3.3.9 3.3.10 4.3.6 4.3.7 4.3.8 4.3.9 4.3.10
2.3.11 3.3.11 3.3.12 3.3.13 4.3.11 4.3.12 4.3.13
2.4 3.4 4.4 6.4
2.4.1 2.4.2 2.4.3 2.4.4 2.4.5 3.4.1 3.4.2 3.4.3 3.4.4 3.4.5 4.4.1 4.4.2 4.4.3 4.4.4 4.4.5 6.4.1 6.4.2 6.4.3 6.4.4
2.4.6 2.4.7 2.4.8 2.4.9 2.4.10 3.4.6 3.4.7 3.4.8 3.4.9 3.4.10 4.4.6 4.4.7 4.4.8 4.4.9
2.4.11 2.4.12 2.4.13 2.4.14 2.4.15 3.4.11 3.4.12 3.4.13 3.4.14 3.4.15
2.5 3.5 60 Days2.5.1 2.5.2 2.5.3 2.5.4 2.5.5 3.5.1 3.5.2 3.5.3 3.5.4 3.5.5
2.5.6 2.5.7 2.5.8 2.5.9 2.5.10 3.5.6 3.5.7 3.5.8 3.5.9 Monitor OK 1.1.1 2.5.11 Monitor not OK 1.1.1 Milestone complete 1.1.1
2.6 3.6 Milestone overdue 1.1.1
2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 3.6.1 3.6.2 3.6.3 3.6.4 3.6.5 Milestone due soon 1.1.1
2.6.6 2.6.7 2.6.8 2.6.9 2.6.10 3.6.6 3.6.7 3.6.8 3.6.9 3.6.10 Milestone not due soon 1.1.1
2.6.11 2.6.12 2.6.13 Item not Active 1.1.1
Workload
6
1.2
Development
Dissemination
Project Execution
BaBarMetadata
Storage
2 3
Knowledge Transfer
LHCb
GANGA
ATLAS
InteroperabilitySamGrid
Engagement
Production Grid Milestones Production Grid Metrics
1LCG External
4M/S/N
5Non-LHC Apps Management
Navigate downExternal link
PhenoGrid
LHC Apps
1.1
1.3
Security
InfoMon
Design
Service Challenges
Other Link Network LHC Deployment
Project Planning
CMS
Portal
Status Date - 31/Dec/05 + next
UKQCD
Update
Clear
Metric OK
Metric not OK
Tasks Complete
Tasks Overdue
Tasks due in next 60 days
Items Inactive
Tasks not Due
Change Forms
88
(91%)
9 103
(40%)
7 16 20 132 37
![Page 3: D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.](https://reader036.fdocuments.net/reader036/viewer/2022082820/56649e4c5503460f94b41af3/html5/thumbnails/3.jpg)
22/Feb/2006 GridPP Status D. Britton
Metrics
88 are currently satisfied; the 9 below are not:
0.105: Number of LCG/EGEE jobs slots used. 0.106: GridPP KSI2K available.0.108: GridPP disk storage available: 0.131: Tier-1 service disaster recovery plans up to date.0.140: Training needs addressed.0.141: GridPP Helpdesk functioning adequately.5.2.4: Tier-2 Hardware realization.5.2.7: Quarterly reports received within 1 month of end of
quarter.5.2.13: Number of UB meetings
Shortage of Hardware (wrt planning): This reflects the slower than planned ramp-up of resources at the institutes. This is improving (Tier2 report). Usage is low.
![Page 4: D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.](https://reader036.fdocuments.net/reader036/viewer/2022082820/56649e4c5503460f94b41af3/html5/thumbnails/4.jpg)
22/Feb/2006 GridPP Status D. Britton
Milestones
A total of 258 active milestones; 103 (40%) have been completed; there are 7 milestones overdue:
0.37: Full Tier-1 Team in place (2 posts advertised).
0.49: Tier-2 storage accessible via SRM interface. (Almost, but not quite all).
0.54: GridPP accounting data accessible. (This is largely available).
0.59: GridPP able to monitor networks to all supported sites. (Being rolled out).
1.3.3 and 5.1.10: International MoU with CERN (We believe that this is close!) 6.2.6: First stage connection of GridPP sites to NGS: (This is partly complete.)
![Page 5: D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.](https://reader036.fdocuments.net/reader036/viewer/2022082820/56649e4c5503460f94b41af3/html5/thumbnails/5.jpg)
22/Feb/2006 GridPP Status D. Britton
Change Forms
Thirty seven change forms have been submitted, reviewed, enacted.
Production Grid (7)Storage Group (2)WLMS (2)Security (4)InfoMon (2)
ATLAS (4)GANGA (1)LHCb (3)CMS (1)PhenoGrid (2)LCG deployment (1)SAM (7)UKQCD (1)
![Page 6: D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.](https://reader036.fdocuments.net/reader036/viewer/2022082820/56649e4c5503460f94b41af3/html5/thumbnails/6.jpg)
22/Feb/2006 GridPP Status D. Britton
Risk Register
R10-Apps: External middleware dependence.
R22-LCG, R22-Apps, R22-PRO: Hardware resources inadequate.
R32-PRO: Security inadequate to operate Grid.
R40-Apps: Lack of future funding.
Six high risks identified:ID Name
Li Im Risk Li Im Risk Li Im Risk Li Im Risk Li Im RiskR1 Recruitment/retention difficulties 2 2 4 2 2 4 2 2 4 2 2 4R2 Sudden loss of key staff 1 3 3 1 3 3 1 3 3 1 4 4R3 Minimal Contingency 2 2 4 1 2 2R4 GridPP deliverables late 1 3 3 2 3 6 3 2 6R5 Sub-components not delivered to project 1 2 2 2 3 6 2 3 6 2 3 6R6 Non take-up of project results 2 1 2 1 4 4 2 2 4 1 4 4R7 Change in project scope 1 1 1 2 2 4R8 Bad publicity 1 3 3 1 3 3 1 3 3 2 3 6R9 External OS dependence 3 1 3
R10 External middleware dependence 4 2 8 1 4 4 3 3 9 2 2 4R11 Lack of monitoring of staff 1 2 2 2 2 4 2 2 4 2 2 4R12 Withdrawal of an experiment 2 3 6 1 4 4R13 Lack of cooperation between Tier centres 2 2 4 1 4 4R14 Scalablity problems 1 2 2 2 2 4R15 Software maintainability problems 2 2 4 1 3 3 2 2 4 1 3 3R16 Technology shifts 1 2 2 2 3 6 2 3 6R17 Repitition of research 3 2 6R18 Lack of funding to meet LCG PH-1 goals 4 1 4R20 Conflicting software requirements 3 2 6 1 3 3R22 Hardware resources inadequate 3 3 9 4 3 12 3 3 9R25 Hardware procurement problems 3 2 6 2 3 6R26 LAN Bottlenecks 1 3 3R27 Tier-2 organisation fails 2 2 4
R28 Experiment Requirements not met 1 4 4R29 SYSMAN effort inadequate 2 3 6R30 Firewalls interfere with Grid 2 3 6R31 Inablility to establish trust relationshipsR32 Security inadequate to operate Grid 3 3 9R33 Interoperability 2 3 6R35 Failure of international cooperation 2 1 2R36 e-Science and GridPP divergence 1 3 3R37 Institutes do not embrace Grid 2 2 4R38 Grid does not work as required 4 2 8 4 2 8R39 Delay of the LHC 2 2 4R40 Lack of future funding 2 3 6 2 3 6 3 3 9R41 Network backbone failure 0 4 1R42 Network backbone bottleneck 2 2 4R43 Network backbone upgrade delay 1 4 4R44 Inadequate User Support 1 4 4Alt-i-r
Pro. GridGridPP LCG MSN Apps
![Page 7: D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.](https://reader036.fdocuments.net/reader036/viewer/2022082820/56649e4c5503460f94b41af3/html5/thumbnails/7.jpg)
22/Feb/2006 GridPP Status D. Britton
Added Value
High Level Value added by GridPP
LCG 1 Enabling the start of the LCG Project
Mid
dlewar
e2 Generic Metadata Development.3 To provide common storage solutions for the UK.4 Test and validate the Workload Management system in the UK.5 Security in the Grid environment.6 Information Monitoring System.7 Network development.
Mid
dlewar
e
Applicat
ions 8 Integration of the LHC experiment applicationts.
9 Ganga Development.10 Integration with running experiments.11 Connecting with the Theory Community12 Grid PortalApplic
atio
ns
Infra
stru
cture 13 The Deployment Team
14 The Tier-2 structures15 The Tier-1 infrastructure16 Grid Support17 Service ChallengesIn
frast
ruct
ure
Coordin
atio
n 18 The GridPP Website19 The GridPP Identity20 Dissemination21 Management22 The largest Grid in the UK - GRIDPPCoord
inat
ion
The top six items (the order is not significant):1) The GridPP Identity 2) Enabling the LCG Project 3) Leading contributions to Grid Middleware
4) The Tier centre structures. 5) The Deployment team. 6) The UK Particle Physics Grid.
![Page 8: D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.](https://reader036.fdocuments.net/reader036/viewer/2022082820/56649e4c5503460f94b41af3/html5/thumbnails/8.jpg)
D. Britton
GridPP Status - Resources22/Feb/2006
![Page 9: D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.](https://reader036.fdocuments.net/reader036/viewer/2022082820/56649e4c5503460f94b41af3/html5/thumbnails/9.jpg)
22/Feb/2006 GridPP Status D. Britton
GridPP Financial Summary
Category Sub-Cat FY01 FY02 FY03 FY04 FY05 FY06 FY07 Total CostLCG £0 £907,843 £2,379,162 £2,379,829 £0 £0 £0 £5,666,835Tier-1 Staff £62,045 £311,089 £513,625 £671,501 £763,045 £921,619 £410,135 £3,653,059Tier-1 Hardware £774,300 £602,366 £116,927 £820,535 £527,000 £996,000 £1,476,000 £5,313,128Tier-2 Staff £0 £0 £24,499 £293,881 £749,087 £1,051,215 £616,525 £2,735,207Tier-2 Hardware £0 £0 £0 £150,000 £49,000 £27,000 £0 £226,000Applications Staff £97,528 £668,448 £726,561 £776,943 £1,034,946 £1,081,376 £483,221 £4,869,024N/M/S Staff £561,819 £1,028,552 £1,203,242 £1,053,794 £890,950 £963,025 £477,777 £6,179,158Operations Managers £127,827 £243,448 £267,729 £294,056 £318,666 £329,170 £141,085 £1,721,981Operations Staff £0 £0 £0 £17,339 £138,621 £152,584 £61,147 £369,690Operations Travel £175,000 £182,733 £274,825 £268,493 £289,000 £296,000 £130,000 £1,616,051Operations Misc £113,000 £5,000 £45,195 £141,009 £10,000 £40,000 £15,000 £369,204
£1,911,519 £3,949,478 £5,551,766 £6,867,379 £4,770,316 £5,857,989 £3,810,890 £32,719,336£32,900,000
£74,423£255,087
TotalTotal PPARC funding
EU Travel RebateUnallocated Funds
Integrated GridPP1 + GridPP2 picture.
![Page 10: D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.](https://reader036.fdocuments.net/reader036/viewer/2022082820/56649e4c5503460f94b41af3/html5/thumbnails/10.jpg)
22/Feb/2006 GridPP Status D. Britton
Unallocated Funds
• Unallocated Funds arose from:
• Lower average staff cost for FY04/05 at CCLRC (£61.1K compared to the planned value of £64.4K) This contributed £72K in total savings.
• Two vacant Tier-1 posts. This contributes £64.4K for each 6 month period. Table-1 includes this contribution up to the end of the 2005 calendar year.
• Application posts at Manchester (BaBar) and Bristol (Babar/WP6) ended early and funds were returned to the GridPP budget (£21,575 and £31,208, respectively).
• EU travel refunds (EDG and EGEE) with a total of £74,423 were received for travel originally paid by GridPP.
Propose to apply these funds to purchase additional Tier-1 hardware.
![Page 11: D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.](https://reader036.fdocuments.net/reader036/viewer/2022082820/56649e4c5503460f94b41af3/html5/thumbnails/11.jpg)
22/Feb/2006 GridPP Status D. Britton
Future
Further funds of the order of £150K may become available in the future from the following sources:
• The average staff cost for CCLRC staff is now probably overestimated for FY05-FY07.
• The Tier-1 posts are presently being advertised but some additional savings will occur before these are filled.
• The projected FY05 travel out-turn (£283K) looks like it is close to the budgeted amount (£289K), but an EGEE-II travel funding for UK posts may return some amount.
• No expenditure is presently foreseen against £65K remaining on the GridPP consumables budget.
![Page 12: D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.](https://reader036.fdocuments.net/reader036/viewer/2022082820/56649e4c5503460f94b41af3/html5/thumbnails/12.jpg)
22/Feb/2006 GridPP Status D. Britton
GridPP2 Post Summary
Work Area FTE Total Posts Unfilled
Application Interfaces 18.5 20 0
Middleware/Security/Networking 14.5 18 0
Tier-2 15 20 3 Note-1
Tier-1 13.5 13.5 2 Note-2
EGEE Infrastructure Support 4 4 0
Project Management Board 3.4 6 0
Operations 2.5 3 0
TOTAL 71.4 84.5 5
GridPP2 Funding
Note-1: Tier-2 security post; Tier-2 network post; Joint HP post.Note-2: Two Tier-1 posts currently advertised.
![Page 13: D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.](https://reader036.fdocuments.net/reader036/viewer/2022082820/56649e4c5503460f94b41af3/html5/thumbnails/13.jpg)
22/Feb/2006 GridPP Status D. Britton
GridPP2 Effort Summary
Of planned Of actualGridPP and EU effort.
Of plannedGridPP and EU effort.
05Q4GridPP EU Other Total
Applications 100% #DIV/0! 25% 124%MSN 98% 91% 37% 132%Tier-1 78% #DIV/0! 32% 104%Tier-2 72% 95% 63% 128%
TOTAL 93% 93% 39% 129%
Cumulative to end of
Disclaimer: Numbers are indicative. There are many known effects that would need to be taken out to obtain precise statistics.
![Page 14: D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.](https://reader036.fdocuments.net/reader036/viewer/2022082820/56649e4c5503460f94b41af3/html5/thumbnails/14.jpg)
22/Feb/2006 GridPP Status D. Britton
Travel Budget
The predicted outturn for financial year 2005 is £283K compared to a budget of £289K.
![Page 15: D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.](https://reader036.fdocuments.net/reader036/viewer/2022082820/56649e4c5503460f94b41af3/html5/thumbnails/15.jpg)
22/Feb/2006 GridPP Status D. Britton
Resource Summary
• GridPP proposes to redirect £255K that is currently unallocated to address the anticipated shortage of Tier-1 hardware in 2007/8.
• The FY06 Tier-1 hardware budget remains at £996K. We note that the purchase must be initiated immediately in order to deploy the hardware needed this calendar year. We ask PPARC/OC for agreement to proceed with this.
• The project is in the steady-state with just a few vacant posts and with effort being delivered as anticipated.