Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open...
Transcript of Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open...
![Page 1: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/1.jpg)
Open Science Grid
D. Petravick, FNAL
I2 Spring Meeting/HEP SIG
May 3, 2005
![Page 2: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/2.jpg)
5/27/05 D. Petravick - Open Science GRid 2
Open Science GridConsortium
• The Open Science Grid (OSG) Consortiumwas formed in 2004 by teams from U.S.universities and national laboratories in orderto build and support a production qualitypeta-scale Grid infrastructure for large scalescience.
• Partners with EGEE, LCG and TerraGrid.• Non US institutions.may be partners.
– Case under consideration is when an applicationbring s in non US sites.
![Page 3: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/3.jpg)
5/27/05 D. Petravick - Open Science GRid 3
CMS and U.S. OSGparticipants
![Page 4: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/4.jpg)
5/27/05 D. Petravick - Open Science GRid 4
OSG Organizational Structure
![Page 5: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/5.jpg)
5/27/05 D. Petravick - Open Science GRid 5
Two Important TechnicalGroups
• Storage (active for a year)
• Network (just forming)
• Buffering Storage and networking arecomplimentary activities.
![Page 6: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/6.jpg)
5/27/05 D. Petravick - Open Science GRid 6
Storage Technical Group
• The Storage Technical group is lead by PaulSheldon (Vanderbilt) and Robert Kennedy(Fermilab).
• The main activity of the group is to deploymanaged storage elements on the OSG.– Independently implemented, interoperating, SE
are being deployed.• LBL DRM• Fermilab/DESY Dcache.• Interest in from the IBP people (Tennessee)• Possible interest from Xootd people (SLAC)
![Page 7: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/7.jpg)
5/27/05 D. Petravick - Open Science GRid 7
OSG Storage element
![Page 8: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/8.jpg)
5/27/05 D. Petravick - Open Science GRid 8
March Tape IngestDemonstration
![Page 9: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/9.jpg)
5/27/05 D. Petravick - Open Science GRid 9
Current Production
![Page 10: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/10.jpg)
5/27/05 D. Petravick - Open Science GRid 10
Current (POSIX side) reads
![Page 11: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/11.jpg)
5/27/05 D. Petravick - Open Science GRid 11
CMS plans
• SE at US Tier 1 (FNAL)
• SE at US Tier 2s (Caltech, Florida, MIT,Nebraska, Purdue, UCSD, Wisconsin)
• Partial deployment and use in Recentlyconcluded Service Challenge.
• Storage Embedded in OSG.
![Page 12: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/12.jpg)
5/27/05 D. Petravick - Open Science GRid 12
Network Technical Group
• The Network Technical group is lead byShawn McKee(Michigan) and DonaldPetravick (Fermilab).
• We are beginning to organize.– Have seeded a monitoring activity.
– Want to consider the needs of the HEPexperiments exploiting OSG.
![Page 13: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/13.jpg)
5/27/05 D. Petravick - Open Science GRid 13
Evident Areas of Interest
• Understand the impact of ourapplication on the existing networksinfrastructures.– Large Data Transfers for LHC experiments
within the US are just being organized.
• HEP desires an “overlay network”composed from all available resources
![Page 14: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/14.jpg)
5/27/05 D. Petravick - Open Science GRid 14
Mona Lisa Monitoring
• For OSG-ITB– Integration Test Bed
• http://gocmon.uits.iupui.edu:8888/
![Page 15: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/15.jpg)
5/27/05 D. Petravick - Open Science GRid 15
HEP Overlay network
• Esnet and I2.
• Ultralight
• US university initiatives.
• LHC net.
• T[12] <-> T[12] worldwide
![Page 16: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/16.jpg)
5/27/05 D. Petravick - Open Science GRid 16
![Page 17: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/17.jpg)
5/27/05 D. Petravick - Open Science GRid 17
UltraLightUltraLight Network: Network: PHASE 2PHASE 2
Move into productionMove into production(2007)(2007)
Optical switching fullyOptical switching fullyenabled amongst primaryenabled amongst primarysitessites
Integrated internationalIntegrated internationalinfrastructureinfrastructure
![Page 18: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/18.jpg)
5/27/05 D. Petravick - Open Science GRid 18
FNAL Inbound traffic
![Page 19: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/19.jpg)
5/27/05 D. Petravick - Open Science GRid 19
Summary
• The OSG is a significant computationalresource.
• HENP stakeholders are counting on the OSGto provide a grid framework in the US for theLHC.
• Many contributions beyond the DOE labs andT2 centers.
• OSG is in a position to exploit resourcesopportunistically, including high impactnetworks.
![Page 20: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/20.jpg)
5/27/05 D. Petravick - Open Science GRid 20
Grid computing and nationalinfrastructure.
• In HEP tape is usedin data movement,not only dataarchive.
• Data movement is atnational scales.
• D0, one currentHEP system.
![Page 21: Open Science Gridcd-docdb.fnal.gov/0008/000845/001/I2-OSG-Talk.pdf5/27/05 D. Petravick - Open Science GRid 2 Open Science Grid Consortium • The Open Science Grid (OSG) Consortium](https://reader033.fdocuments.net/reader033/viewer/2022050200/5f53de407a15ff3a112ba50a/html5/thumbnails/21.jpg)
5/27/05 D. Petravick - Open Science GRid 21