Post on 15-Apr-2017
Laboratory of ecohydrologyEcole polytechnique federalede Lausanne
Data assimilation for distributed models:an overview of applications with CATHY
Damiano Pasetto
Workshop on coupled hydrological modelingPadova, 24 Sept. 2015
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Table of Contents
Table of Contents
1 Introduction
2 Data assimilation methods
3 Hydrological applications
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Introduction Motivations
State-space model
{x(t) = f (x(t), λ, q(t), t) + w(t) t ∈ [0,∞] transient modely∗k
↔ yk = h (x, tk) + vk k = 1, . . . observation model
y∗k observationsx(t) state variables
p (x(t))λ parameters p(λ)q(t) ATM forcingsx(0) initial conditionw(t) model structural errorvk measurement error
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Introduction Motivations
State-space model
{x(t) = f (x(t), λ, q(t), t) + w(t) t ∈ [0,∞] transient modely∗k
↔ yk = h (x, tk) + vk k = 1, . . . observation model
y∗k observationsx(t) state variables
p (x(t))
λ parameters
p(λ)
q(t) ATM forcingsx(0) initial conditionw(t) model structural error
vk measurement error
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Introduction Motivations
State-space model
{x(t) = f (x(t), λ, q(t), t) + w(t) t ∈ [0,∞] transient modely∗k ↔ yk = h (x, tk) + vk k = 1, . . . observation model
y∗k observationsx(t) state variables
p (x(t))
λ parameters
p(λ)
q(t) ATM forcingsx(0) initial conditionw(t) model structural errorvk measurement error
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Introduction Motivations
State-space model
{x(t) = f (x(t), λ, q(t), t) + w(t) t ∈ [0,∞] transient modely∗k ↔ yk = h (x, tk) + vk k = 1, . . . observation model
y∗k observationsx(t) state variables p (x(t))λ parameters
p(λ)
q(t) ATM forcingsx(0) initial conditionw(t) model structural errorvk measurement error
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Introduction Motivations
State-space model
{x(t) = f (x(t), λ, q(t), t) + w(t) t ∈ [0,∞] transient modely∗k ↔ yk = h (x, tk) + vk k = 1, . . . observation model
y∗k observationsx(t) state variables p (x(t))λ parameters p(λ)q(t) ATM forcingsx(0) initial conditionw(t) model structural errorvk measurement error
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Introduction Motivations
MotivationsHydrological forecasting is subject to many sources of uncertainty
Initial conditionForcing termsModel parameters(Model itself?)
Data Assimilation (DA)Correct the model forecast considering the measurements
State . . . xk−1 → x−k xk → x−k+1 . . .↓ ↑ ↓
Observations . . . y−k ↔ y∗k . . .
Forecast pdf: π−(x(tk) | y1, . . . , yk−1)Filtering pdf: π+(x(tk) | y1, . . . , yk−1, yk)
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Introduction Motivations
MotivationsHydrological forecasting is subject to many sources of uncertainty
Initial conditionForcing termsModel parameters(Model itself?)
Data Assimilation (DA)Correct the model forecast considering the measurements
State . . . xk−1 → x−k xk → x−k+1 . . .↓ ↑ ↓
Observations . . . y−k ↔ y∗k . . .
Forecast pdf: π−(x(tk) | y1, . . . , yk−1)
Filtering pdf: π+(x(tk) | y1, . . . , yk−1, yk)
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Introduction Motivations
MotivationsHydrological forecasting is subject to many sources of uncertainty
Initial conditionForcing termsModel parameters(Model itself?)
Data Assimilation (DA)Correct the model forecast considering the measurements
State . . . xk−1 → x−k xk → x−k+1 . . .↓ ↑ ↓
Observations . . . y−k ↔ y∗k . . .
Forecast pdf: π−(x(tk) | y1, . . . , yk−1)Filtering pdf: π+(x(tk) | y1, . . . , yk−1, yk)
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Introduction A simple example with CATHY
Example: application to CATHY (CATchment HYdrology)
Coupled surface/subsurface modelRichards equation:
Sw(ψ)Ss∂ψ
∂t+ φ
∂Sw(ψ)
∂t= ∇ · [KsKrw(Sw(ψ)) (∇ψ + ηz)] + qss(h)
1-D path-based surface routing:
∂Q
∂t+ ck
∂Q
∂s= Dh
∂2Q
∂s2+ ckqs(h, ψ)
BC-switching/forcing algorithm
State variables: x = {ψ,Q}.Measures: piezometric head, soil moisture, streamflow, electricpotential (ERT).
(Camporese et al. 2010, WRR)Damiano Pasetto DA for distributed models Padova - 24 September 2015
Introduction A simple example with CATHY
Example: application to CATHY (CATchment HYdrology)
Coupled surface/subsurface modelRichards equation:
Sw(ψ)Ss∂ψ
∂t+ φ
∂Sw(ψ)
∂t= ∇ · [KsKrw(Sw(ψ)) (∇ψ + ηz)] + qss(h)
1-D path-based surface routing:
∂Q
∂t+ ck
∂Q
∂s= Dh
∂2Q
∂s2+ ckqs(h, ψ)
BC-switching/forcing algorithm
State variables: x = {ψ,Q}.Measures: piezometric head, soil moisture, streamflow, electricpotential (ERT).
(Camporese et al. 2010, WRR)Damiano Pasetto DA for distributed models Padova - 24 September 2015
Introduction A simple example with CATHY
DA: example on the V-catchment
3 m soil depthAssimilation of streamflow
Uncertainty:Initial conditionsATM forcings
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Introduction A simple example with CATHY
Forecast considering model uncertainties (open loop)
0 1800 3600 5400 7200 9000 10800 12600 144000
1
2
3
4
5
6St
ream
flow
(m
3 /s) TRUE
ObservationsOpen Loop
0 1800 3600 5400 7200 9000 10800 12600 14400Time (s)
1.939
1.940
1.941
1.942
1.943
1.944
Wat
er S
tora
ge (
106 m
3 )
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Introduction A simple example with CATHY
Assimilation of measurement of streamflow
0 1800 3600 5400 7200 9000 10800 12600 144000
1
2
3
4
5
6St
ream
flow
(m
3 /s) TRUE
ObservationsSIR
0 1800 3600 5400 7200 9000 10800 12600 14400Time (s)
1.939
1.940
1.941
1.942
1.943
1.944
Wat
er S
tora
ge (
106 m
3 )
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Data assimilation methods EnKF and SIR
Forecast step: MC simulation
xi0 ∼ p(x0), i = 1, . . . , N Initial samples
xi,−k = f(xik−1, λi, qik, tk) + wi
k Forecast
Analysis stepEnsemble Kalman filter (EnKF, Evensen 1994): Kalman gain
xik = xi,−k +Kk
(y∗k − h(x
i,−k )
)
Sequential Importance Resampling (SIR):weighted realizations
(xik, ω
ik
)update weights with the likelihood and normalize
ωik = Cωi
k−1L(y∗k |xi,−k )
duplicate particles that have largest weights.
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Data assimilation methods EnKF and SIR
Forecast step: MC simulation
xi0 ∼ p(x0), i = 1, . . . , N Initial samples
xi,−k = f(xik−1, λi, qik, tk) + wi
k Forecast
Analysis stepEnsemble Kalman filter (EnKF, Evensen 1994): Kalman gain
xik = xi,−k +Kk
(y∗k − h(x
i,−k )
)
Sequential Importance Resampling (SIR):weighted realizations
(xik, ω
ik
)update weights with the likelihood and normalize
ωik = Cωi
k−1L(y∗k |xi,−k )
duplicate particles that have largest weights.
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Data assimilation methods EnKF and SIR
Forecast step: MC simulation
xi0 ∼ p(x0), i = 1, . . . , N Initial samples
xi,−k = f(xik−1, λi, qik, tk) + wi
k Forecast
Analysis stepEnsemble Kalman filter (EnKF, Evensen 1994): Kalman gain
xik = xi,−k +Kk
(y∗k − h(x
i,−k )
)Sequential Importance Resampling (SIR):
weighted realizations(xik, ω
ik
)update weights with the likelihood and normalize
ωik = Cωi
k−1L(y∗k |xi,−k )
duplicate particles that have largest weights.
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Data assimilation methods EnKF and SIR
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Hydrological applications 1. Geophysical coupled inversion
1. Geophysical coupled inversion: Electrical Resistivity Tomography
(Rossi et al. 2015, AWR)Damiano Pasetto DA for distributed models Padova - 24 September 2015
Hydrological applications 1. Geophysical coupled inversion
Iterative particle filter
(Manoli et al. 2015, JCP)Damiano Pasetto DA for distributed models Padova - 24 September 2015
Hydrological applications 1. Geophysical coupled inversion
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Hydrological applications 2. Landscape Evolution Observatory (LEO)
2. Landscape Evolution Observatory (LEO)
Three convergent landscapes
30 m long, 11 m wide, 1 m soil
10 degrees average slope
Environmentally controlledgreenhouse facility
Landscape instrumentation
rainfall simulator(3-45 mm/h)
10 load cells
6 flow meters forseepage faceoutflow
1,835 sensorsembedded in thesoil
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Hydrological applications 2. Landscape Evolution Observatory (LEO)
First experiment at LEO (18 February 2013)
Experiment setup:
Unsaturated initialconditions
Imposed rainfall:≈12 mm/h
With homogeneous soil,steady state expectedafter 36 h
After the experiment: the rainfall wasstopped after 22 h due to the occurrenceof overland flow.
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Hydrological applications 2. Landscape Evolution Observatory (LEO)
Synthetic scenario reproducing Experiment 1 at LEO
Assumption: Y = log(KS) is a Gaussian random field with exponentialcovariance function. E[KS ] = 10−4 m/s with coefficient of variation100% (µY = −9.56, σY = 0.83)
Test case 1 (TC1): λx = λy = 8 m; λz= 0.5 mTest case 2 (TC2): λx = λy = 4 m; λz= 0.25 m
Number of grid cells: 60×22×20= 26400
Sensor failure analysisThe assimilation is repeated decreasing the number of measurements,from m=496 to m= 21 active sensors.
(Pasetto et al. 2015, AWR)
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Hydrological applications 2. Landscape Evolution Observatory (LEO)
−5 0 5
5
10
15
20
25
d= 0.00÷0.05 m
x (m)
y (m
)
−5 0 5
5
10
15
20
25
d= 0.15÷0.20 m
x (m)−5 0 5
5
10
15
20
25
d= 0.30÷0.35 m
x (m)−5 0 5
5
10
15
20
25
d= 0.50÷0.55 m
x (m)−5 0 5
5
10
15
20
25
d= 0.80÷0.85 m
x (m)−5 0 5
5
10
15
20
25
d= 0.95÷1.00 m
x (m)
10−5
10−4
10−3
K S (m
/s)
True
−5 −2 0 2 5
5
10
15
20
25
d= 0.00÷0.05 m
x (m)
y (m
)
−5 −2 0 2 5
5
10
15
20
25
d= 0.15÷0.20 m
x (m)−5 −2 0 2 5
5
10
15
20
25
d= 0.30÷0.35 m
x (m)−5 −2 0 2 5
5
10
15
20
25
d= 0.50÷0.55 m
x (m)−5 −2 0 2 5
5
10
15
20
25
d= 0.80÷0.85 m
x (m)−5 −2 0 2 5
5
10
15
20
25
d= 0.95÷1.00 m
x (m)
10−5
10−4
10−3
K S (m
/s)
m= 496
True and estimated spatial distributions of KS in TC2.Damiano Pasetto DA for distributed models Padova - 24 September 2015
Hydrological applications 2. Landscape Evolution Observatory (LEO)
0
0.5
1
1.5
Ove
rland
Flo
w (m
3 /h)
EnsembleEnsemble MeanTrue90% C.I.
TC1 (long correlation length)
0
0.5
1
1.5
Seep
age
Face
Flo
w (m
3 /h)
0 4 8 12 16 20 24 28 32 36Time t (h)
40
60
80
100
120
Wat
er S
tora
ge (m
3 )
TC2 (short correlation length)
0 4 8 12 16 20 24 28 32 36Time t (h)
Open loop: model response with 200 random realizations of the priordistribution of Y = log(KS) without data assimilation.
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Hydrological applications 2. Landscape Evolution Observatory (LEO)
0
0.5O
verla
nd (m
3 /h)
Truem= 496m= 196m= 46m= 21
TC1 (long correlation length)
0
0.5
1
1.5
Seep
age
(m3 /h
)
406080
100120
Stor
age
(m3 )
0 4 8 12 16 20 24 28Time t (h)
0.001
0.01
RM
SE o
n vw
c
TC2 (short correlation length)
0 4 8 12 16 20 24 28 32 36Time t (h)
Model response with the calibrated saturated hydraulic conductivity
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Conclusions
Conclusions
Data assimilation methods help improve the forecast and reduce theuncertainty of high dimensional hydrological models.
Data assimilation methods allow the online estimation of both the statevariables and the model parameters.
Work in progress
Covariance localization and ensemble inflation to minimizeill-conditioning and filter inbreeding in the EnKF update.Update step performed with a combination of EnKF and SIR(Gaussian Mixture Filters)Surrogate models to accelerate the Monte Carlo simulation.
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Conclusions
Conclusions
Data assimilation methods help improve the forecast and reduce theuncertainty of high dimensional hydrological models.
Data assimilation methods allow the online estimation of both the statevariables and the model parameters.
Work in progress
Covariance localization and ensemble inflation to minimizeill-conditioning and filter inbreeding in the EnKF update.Update step performed with a combination of EnKF and SIR(Gaussian Mixture Filters)Surrogate models to accelerate the Monte Carlo simulation.
Damiano Pasetto DA for distributed models Padova - 24 September 2015
Conclusions
Thank you for your attention
ReferencesD Pasetto, M Camporese, and M Putti. Ensemble Kalman filter versus particle filter for aphysically-based coupled surface-subsurface model, Adv Water Resources, 2012.G Manoli, M Rossi, D Pasetto, R Deiana, S Ferraris, G Cassiani, and M Putti. An iterativeparticle filter approach for coupled hydro-geophysical inversion of a controlled infiltrationexperiment, J Comp Phys, 2015.M Rossi, G Manoli, D Pasetto, R Deiana, S Ferraris, C Strobbia, M Putti, G Cassiani.Coupled inverse modeling of a controlled irrigation experiment using multiplehydro-geophysical data, Adv Water Resources, 2015.D Pasetto, G-Y Niu, L Pangle, C Paniconi, M Putti, PA Troch. Impact of sensor failure onthe observability of flow dynamics at the Biosphere 2 LEO hillslopes, Adv WaterResources, 2015.
Damiano Pasetto DA for distributed models Padova - 24 September 2015