The CARMEN Science Cloud & Beyond
-
Upload
phelan-christensen -
Category
Documents
-
view
35 -
download
2
description
Transcript of The CARMEN Science Cloud & Beyond
![Page 1: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/1.jpg)
Microsoft Research Faculty Summit 2008
![Page 2: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/2.jpg)
The CARMEN Science Cloud & Beyond
Paul WatsonProfessor of Computer ScienceNewcastle University, UK
![Page 3: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/3.jpg)
CARMEN Project building a science cloud for neuroscientists
Stirling
St. Andrews
Newcastle
York
Sheffield
Cambridge
ImperialPlymouth
Warwick
Leicester
Manchester
UK EPRSC e-Science Pilot$9M (2006-10)20 Investigators
![Page 4: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/4.jpg)
Research Challenge
Understanding the brain is the greatest informatics challenge
Enormous implications for science:Medicine
Biology
Computer Science
100,000 scientists are working on this
![Page 5: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/5.jpg)
Neuroinformatics Problems
Data isexpensive to collect but rarely sharedin proprietary formats & locally described
The result isa shortage of analysis techniques that can be applied across neuronal systemslimited interaction between research centres with complementary expertise
![Page 6: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/6.jpg)
Epilepsy Exemplar
Data analysis guides surgeon during operation
Data stored for further analysis
WARNING!The next 2 Slides show an exposed human brain
![Page 7: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/7.jpg)
![Page 8: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/8.jpg)
![Page 9: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/9.jpg)
CARMEN e-Science Requirements Summary
Sharingdatacode
Capacityhuge data storage
(100TB+)
support data intensive analysis
![Page 10: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/10.jpg)
CARMEN Cloud Architecture
Data storageand
analysis
User access over Internet(typically via
browser)
Users upload data &
services
Users run analyses
![Page 11: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/11.jpg)
Science Cloud Design Options
Cloud Infrastructure:Storage & Compute
Scie
nce
Ap
p 1
....
Scie
nce
Ap
p n
Cloud Infrastructure: Storage & Compute
Science Cloud Platform
ScienceApp 1 .... Science
App n
![Page 12: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/12.jpg)
CARMEN Science Cloud Platform
Filestore with PatternSearch
Database
Metadata
ServiceRepository
Processing
WorkflowEnactment
Workflow
Secu
rity
Browsers &Rich Clients
![Page 13: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/13.jpg)
Re-using e-Science technologies
Filestore with PatternSearch
Database
Metadata
ServiceRepository
Processing
WorkflowEnactment
Workflow
Secu
rity
Browsers &Rich Clients
Taverna
SRB & Aura
SQL Server
Symba
Dynasoar
Gold
SDE
![Page 14: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/14.jpg)
Example: Running a Workflow
![Page 15: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/15.jpg)
Conclusions and Current Directions
CARMEN is delivering a scalable Science Cloud Platform that can be applied across a diverse range of sciencese-Science Central (One NorthEast)
piloting a science cloud for a range of academic and industrial scientists across the North East of England
![Page 16: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/16.jpg)
Sustainability
Sustainability is a problem for e-science projectscost of managing & maintaining h/w & s/wacademics are funded to do research, not run a service
![Page 17: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/17.jpg)
Commercial Clouds to the Rescue?
Are Commercial Clouds the solution?e.g. “Pay-as-You-Go” Amazon EC2 & S3focus is currently on infrastructure: storage & processing
But, this is only part of the stackwhat about the cloud middleware?
Can we have pay-as-you-go Science Cloud Platforms?
![Page 18: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/18.jpg)
A Commercial Science Cloud Platform?
?Current gap
ExistingCommercialClouds
Storage & Compute
Science Cloud Platform
ScienceApp 1
.... ScienceApp n
Where scientistsshould focus
![Page 19: The CARMEN Science Cloud & Beyond](https://reader036.fdocuments.net/reader036/viewer/2022081516/568135c1550346895d9d2437/html5/thumbnails/19.jpg)
Reasons to be optimistic
CARMEN Science Cloud Platform services are also needed by commercial applications:
Filestore, Databases & MetadataDynamic Service Provisioning, WorkflowSecurity
Science Cloud Platforms should be able to leverage commercial cloud platforms
allowing scientists to focus on the domain-specific science applications