Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan...
-
Upload
jackeline-ways -
Category
Documents
-
view
216 -
download
0
Transcript of Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan...
www.csiro.au
Towards Service Oriented GeoscienceSEE Grid and APAC Grid
Dr Robert Woodcock
Mr Ryan Fraser
Division of Exploration and Mining
2
Outline
• The “geoscience” modelling workflow
• Inefficiencies
• The Solid Earth and Environment Grid
• The APAC (Geoscience) Grid
• Putting it all together: pmd*CRC Modelling Workflow
3
What is the role of:
• Competency contrasts?
• Permeability?
• Pore fluid pressure & flow fields?
Modelling Workflow
Define the geological problem
Build the model
Run the model
View and Interpret Results
Iterate to achieve Understanding
Report and feed into knowledge base
…Must be repeatable, robust and timely
very weak
strong
weak
strong
Tensile failure
mod. strong
mod. strong
mod. strong
mod. strong
Block model of dilation: showing impact of Fault set “A” Dip variation
4
Inefficiencies in the Workflow
Information is scattered across:
Organisations – company, geological survey, etc
Resources – different hardware and software platforms
Geography – geological surveys in each state and territory
Cost of data integration is high, in some situations exceeding all other costs
• Computational resources:
Different architectures suit different numerical codes better
Are often available but outside your organisations direct control
Are setup in different ways
Cost of adapting an investigators specific toolkit to use multiple sites is often prohibitive
Can these issues be removed?
5
The SEE Grid Community
Working together (loosely) to develop a toolkit for interoperability for the Solid Earth and Environmental Sciences
Together… because our information and services need to be shared more easily to achieve our goals
Loosely… because ultimately we are separated by political and economic boundaries
Toolkit… because our World is dynamic and we need tools that can be reconfigured and chained together quickly to answer our questions
…in this context we must reduce the barriers to becoming a part of the community
6
Data Structures
Proprietary Software
Versions of Software
Client
Pre-competitive geoscience data - The trouble is…
7
XML
GML/XMML
Client
Our aim…
8
PIRSAWeb Feature Service (WFS)
Common Interface Binding – GML/XMML
GA Geochemistry
Feature Data Source
DOIRGeochemistry
FeatureData Source
DOIRWeb Feature Service (WFS)
GAWeb Feature Service (WFS)
Geoserver (Open Source)
PostGIS (Open Source)
OraclePostGIS (Open Source)
CLIENT APPLICATIONS
DATA ACCESS SERVICES
DATA SOURCES
WebMap Composer
GA Reports Application
PIRSA Geochemistry
FeatureData Source
Little or no change required here
Translation to standards here
9
Common Interface Binding – GML/XMML
WebMap Composer
GA Reports Application
PIRSAWFS
DOIRWFS
GAWFS
NTGSWFS
MRTWFS
NRMWFS
NSWDPIWFS
VICDPIWFS
?FracSIS
pmd*CRCModel Tools
CLIENTS
DATA SOURCES
DATA SERVICES
10
Features – Geoscience Community (XMML & GeoSciML)
Borehole collar location shape collar diameter length operator logs related observations …
Fault shape surface trace displacement age … Ore-body
commodity deposit type host formation shape resource estimate …
Observation location subject/specimen/station property/theme method operator date/time result (+ type/reference
system/scale/classification) …
Basin? formations shape – time
dependent resource estimate …
11
A user makes a request and gets back GML based data which can be ….
Rendered into a map layer AND queried by a user or….
… formatted into a report or ….
… read and used by any enabled application
Slides courtesy Stuart Girvan – Geoscience Australia
How would you use an interoperable service?
12
Web Map Interface (courtesy of Social Change Online)
Bounding Box
Known Layers
13
Tabular Reports by Source(courtesy of Geoscience Australia)
14
Desktop Visualisation (courtesy of Fractal Technologies)
15
Client
The Grid Application… Service Interactions
Resource Registry
Data Management Service
HPC Repository
LoginJob
MonitorRun
SimulationEdit Problem Description
Local Repository
Archive Search
Geology S.A
Geology W.ARock Prop.
N.S.W
Rock Prop. W.A
Information
Authentication Job Management Service
Finley ServiceFastfloRT Service
User
Workflow...
Computation
Community Infrastructure
Physical Resource Physical Resource
16
Grid Technology Layers
Data and Information
Infrastructure
Application Portals
Visualisation3-D models
Data andKnowledge
Portals
e-Science and e-Geoscience Layer
Community-specific Knowledge Environments and Networks for Research and Education
Customised for discipline- and project specific applications
eg, ESDN, Geochronology, Palaeontology, Oceanography, Groundwater
Networks,Communications
High performance
computing
High VolumeStorage
Middleware Architecture
Base Computing TechnologiesAPAC Grid
pmd*CRC
SEE Grid
17
Traditional Mechanical Modelling Workflow
• “Powerful” desktop computes several models at a time
•Limitations are in the order of ~2 models per week.
• Models (mesh + data files) are individually and labouriously constructed
• The manual process is error prone
• Results are manually visualised one at a time.
• Screenshots are manually taken and made into “movies”.
• Very little, if any, standardised data archiving is done. This results in potential confusion or loss of the originating conditions of the experiments, making it unrepeatable in the long term.Slide courtesy of Robert Cheung and Warren Potma
18
New Refined Workflow
•Parameterised template or wizard driven model geometry/mesh creation.
•Boundary condition & model properties parameter sweep utilities
•automatically creates a “family” of model, data files based on varying a set of parameters.
• Inversion algorithms
•determine input parameters of future iterations automatically based on the user ranking of previous results.
Automated generation of visualisations
Automated movie generation
Automated archiving
3D Time varying volume visualisation
Parameterised Geometry Creation
Multi-site data storage via Storage Resource Broker
Slide courtesy of Robert Cheung and Warren Potma
19
Results to Date
For one Investigator, on one investigation:
•500 Models in 4 months (100x more!)
• Inversion/parameter sweep algorithms – semi-automated model creation; faster, less errors
• Automated post-processing/visualisation – all views X all timescale X all models await the investigator automatically
• Automated archiving – metadata searchable, more accurate store of experimental conditions, delivered to your store!
20
Conclusion
Major modelling inefficiencies have been removed by:
• Integrating the pmd*CRC geoscience modelling workflow
with the:
• Solid Earth and Environment Grid, and
• APAC (Geoscience) Grid
www.csiro.au
Thank You
Exploration and Mining
Name Dr Robert Woodcock
Title Principle Software Engineer
Phone +61 8 6436 8780
Email [email protected]
Web www.csiro.au
www.seegrid.csiro.au
Contact CSIRO
Phone 1300 363 400
+61 3 9545 2176
Email [email protected]
Web www.csiro.au
Name Mr Ryan Fraser
Title Software Engineer
Phone +61 8 6436 8760
Email [email protected]