Landslide Modelling With LCG Tools

8/13/2019 Landslide Modelling With LCG Tools

1/24

Landslide modelling

with LCG toolsMichael Wallace - Research Assistant, Particle Physics,University of Bristol


2/24

Overview

Landslides and landslide simulation

Landslide data management issues

How WLCG tools and resources can help

Overview of proposed architecture


3/24

Impact of landslides


4/24

Economic impact

!"!#

!"#

#

#!

%&'()* +(,()- ./0,*12

!"#$ &'( $" )*+),&(# *+& -""

.//0 1 .//2 3) 4,+" (5(+$

31-( 45'66'1& %+78

Developing countriesmore vulnerable

Less resources fordisaster recovery

Accumulated risk dueto poorly planneddevelopment schemes


5/24

!"!#

!"#

#

#!

%&'()* +(,()- ./0,*12

!"#$ &'( $" )*+),&(# *+& -""

.//0 1 .//2 3) 4,+" (5(+$

31-( 45 16 789:

Economic impact

Developing countriesmore vulnerable

Less resources fordisaster recovery

Accumulated risk dueto poorly planneddevelopment schemes


6/24

Disaster planning

Landslide risk of a slope for a given storm

Size and runout of a landslide

Economic impact of a landslide

Things that are useful to know:

courtesy of Dr Liz Holco

mbe


7/24

Landslide modelling

Bristol University has world leading

landslide modellers

chasm -> Landslide risk, hazard, size

questa -> Economic impact

Used by the World Bank for planning

development schemes in developingcountries


8/24

Data management

Analysing different scenarios across 100s of

slopes results in many simulations and a

long overall runtime

10s of TB generated per year for a typical

usage scenario

No facilities for managing this data


9/24

Current simulation

workflow

!" $%&'(

)*'+",-

.'/-0 /12'1//*+

3/,2*(45'&(- +&'/1&/+

$,&(- 2,6/*17/1"

8'+(+"/* 4-(11/*+

9'6'- /12'1//*+

:14%" 0("(

;(-'0("/0 '14%" 0("(

!'7%-(/1/?"+


10/24

Current simulation

workflow

!" $%&'(

)*'+",-

.'/-0 /12'1//*+

3/,2*(45'&(- +&'/1&/+

$,&(- 2,6/*17/1"

8'+(+"/* 4-(11/*+

9'6'- /12'1//*+

:14%" 0("(

;(-'0("/0 '14%" 0("(

!'7%-(/1/?"+


11/24

Improved simulation

workflow

!"#$% '"()*+,)+- ./(/% )+'/+))*0 1/0$0-)* 2%$++)*0

345678 9/+$*:;)"'*$2


12/24

Improved simulation

workflow

!"#$% '"()*+,)+- ./(/% )+'/+))*0 1/0$0-)* 2%$++)*0

345678 9/+$*:;)"'*$2


13/24

What is CouchDB?

Top-level Apache project

Document-oriented database

Data stored as JSON documents, indexed

by UID

Views allow indexing by any document field


14/24

Why CouchDB?

Multi-master replication out of the box

Geo-indexing out of the box

Runs on phones, laptops, servers & clusters

Provides application logic and can serve

client-side code

Browser + CouchDB = Web application


15/24

Why not CouchDB?

Greater storage requirements than a

typical RDBMS for most data

Uncertainty over write speeds - need to

test how many writes per second we can

scale to


16/24


17/24

Task request

Specifies software release and input files

Specifies variable parameters:

Stochastic parameters

Investment scenarios

Rainfall scenarios


18/24

Job definition

Specifies software release and input files

Specific parameters generated by task

sentinel

For stochastic jobs:

Seed for generation of stochastic

parameters


19/24

What is a job?

We submit a job wrapper

~400 lines of python

Downloads job definition

Downloads executable and inputs

Runs executable

Parses and uploads output files


20/24

Executables

Geographical sciences tag a release in SVN

We automatically check out the release,build it and commit it to a new releases DB

Regression tests are run

Release is replicated to the production DB


21/24


22/24


23/24

In conclusion...

We are applying WLGC tools, resources

and concepts to landslide modelling

This allows us to develop an integratedsystem to provide better informed disaster

planning and reduced economic impact

Planning to have a product deployed with

engineers in the Organisation of EasternCaribbean States by 2012


24/24

One more thing...

Please support our VO!

vo.landslides.mossaic.org

Landslide Modelling With LCG Tools

Documents

Transcript of Landslide Modelling With LCG Tools