Lagrangian Data Assimilation and Manifold Detection for a Point...
Transcript of Lagrangian Data Assimilation and Manifold Detection for a Point...
![Page 1: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/1.jpg)
Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model
David Darmon, AMSC
Kayo Ide, AOSC, IPST, CSCAMM, ESSIC
Mid-year Progress Report
![Page 2: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/2.jpg)
Today’s Presentation
Background
Database Generation
The EKF, Validation and Testing
The EnKF, Validation and Testing
Moving Forward
![Page 3: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/3.jpg)
![Page 4: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/4.jpg)
![Page 5: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/5.jpg)
![Page 6: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/6.jpg)
Background
Iterative processData Assimilation
Forecast
Analysis
True State
Observation
![Page 7: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/7.jpg)
Database Generation
−2 −1 0 1 2−2.5
−2
−1.5
−1
−0.5
0
0.5
1
1.5
2
x
y
![Page 8: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/8.jpg)
Database Generation
True System Dynamics
�
- system state
� - Brownian motion
- deterministic evolution operator
![Page 9: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/9.jpg)
Database Generation
Point-VorticesDeterministic Dynamics
�
�
![Page 10: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/10.jpg)
Database Generation
DriftersDeterministic Dynamics
�
�
![Page 11: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/11.jpg)
Database Generation
Stochastic Differential EquationScalar vs. Vector Case
�
![Page 12: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/12.jpg)
Database Generation
Runge-KuttaNumerical Solution
� �
![Page 13: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/13.jpg)
Database Generation
Runge-KuttaNumerical Solution
![Page 14: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/14.jpg)
Database Generation
Runge-KuttaNumerical Solution
![Page 15: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/15.jpg)
Database Generation
ValidationSimple Scalar Case
�� � �
![Page 16: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/16.jpg)
1 1.2 1.4 1.6
5
10
15
t
X(t)
True solutionRK solution
![Page 17: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/17.jpg)
Database Generation
Stochastic Differential EquationTrue Dynamics
�
![Page 18: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/18.jpg)
−1 −0.5 0 0.5 1 1.5 2−1.5
−1
−0.5
0
0.5
1
1.5
x
y
Vortex 1Vortex 2Drifter
![Page 19: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/19.jpg)
−1 −0.5 0 0.5 1 1.5 2−1.5
−1
−0.5
0
0.5
1
1.5
x
y
Vortex 1Vortex 2Drifter
σ = 0.02
![Page 20: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/20.jpg)
−1 −0.5 0 0.5 1 1.5 2−1.5
−1
−0.5
0
0.5
1
1.5
x
y
Vortex 1Vortex 2Drifter
σ = 0.02ρ = 0.02
![Page 21: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/21.jpg)
Data Assimilation
Forecast
Analysis
True State
Observation
![Page 22: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/22.jpg)
Data Assimilation
Approach 1:EKF
![Page 23: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/23.jpg)
Approach 1
Extended Kalman Filter (EKF), Forecast
- covariance matrix from SDE�� - Jacobian of M
![Page 24: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/24.jpg)
Approach 1
Extended Kalman Filter (EKF)Validation - Jacobian via Tangent Linear Model
- Reference Trajectory- Perturbed Trajectory
![Page 25: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/25.jpg)
Approach 1
Extended Kalman Filter (EKF)Validation - Jacobian via Tangent Linear Model
- Reference Trajectory- Perturbed Trajectory
![Page 26: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/26.jpg)
Approach 1
Extended Kalman Filter (EKF)Validation - Jacobian via Tangent Linear Model
- Reference Trajectory- Perturbed Trajectory
Tangent Vector (small)
![Page 27: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/27.jpg)
Approach 1
Extended Kalman Filter (EKF)Validation - Jacobian via Tangent Linear Model
����
![Page 28: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/28.jpg)
Approach 1
Extended Kalman Filter (EKF)Validation - Jacobian via Tangent Linear Model
Evolve reference and perturbed trajectories forward using deterministic ODE
Evolve tangent vector forward using Tangent Linear Model
Compare and
![Page 29: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/29.jpg)
0 0.5 1 1.5 27.5
8
8.5
9
9.5
10 x 10−11
t
y 1
Tangent LinearRK
![Page 30: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/30.jpg)
Approach 1
Extended Kalman Filter (EKF), Analysis
- covariance matrix from observation
- Jacobian of hk
��
![Page 31: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/31.jpg)
Approach 1
Extended Kalman Filter (EKF)Validation - No Noise
![Page 32: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/32.jpg)
Approach 1
Extended Kalman Filter (EKF)Validation - Full Observation, Imperfect Data
Observe vortices and drifter under observational noise
−1 −0.5 0 0.5 1 1.5 2−1.5
−1
−0.5
0
0.5
1
1.5
x
y
![Page 33: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/33.jpg)
0 5 10 15 20−2
−1
0
1
t
Drifter
ξ1
![Page 34: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/34.jpg)
0 5 10 15 20 25
−1
−0.5
0
0.5
1
t
Vortex 1
x1
![Page 35: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/35.jpg)
0 20 40 600
0.5
1
1.5
t
||Xtru
e − X
filte
r|| 2
![Page 36: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/36.jpg)
Approach 1
Extended Kalman Filter (EKF)Results - Partial Observation, Imperfect Data
Observe only drifter under observational noise
−1 −0.5 0 0.5 1 1.5 2−1.5
−1
−0.5
0
0.5
1
1.5
x
y
![Page 37: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/37.jpg)
0 10 20 30
−2
−1
0
1
t
Drifter
ξ1
![Page 38: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/38.jpg)
0 20 40 60−4
−2
0
2
4
6
8
t
Vortex 1
x1
![Page 39: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/39.jpg)
0 20 40 600
5
10
15
t
||Xtru
e − X
filte
r|| 2
![Page 40: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/40.jpg)
Data Assimilation
Approach 1:EnKF
![Page 41: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/41.jpg)
Approach 2
Ensemble Kalman Filter (EnKF)
Approximate pdf by an ensemble of particles:
Evolve particles forward using SDE
Perform Kalman-like analysis
Forecast:
Analysis:
![Page 42: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/42.jpg)
Approach 2
Ensemble Kalman Filter (EnKF)
Approximate pdf by an ensemble of particles:
Evolve particles forward using SDE ODE
Perform Kalman-like analysis
Forecast:
Analysis:
![Page 43: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/43.jpg)
Approach 2
Ensemble Kalman Filter (EnKF)
Approximate pdf by an ensemble of particles:
Evolve particles forward using ODE
Perform Kalman-like analysis
Forecast:
Analysis:
![Page 44: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/44.jpg)
Approach 2a
EnKF with Observational Perturbations
�
�
![Page 45: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/45.jpg)
Approach 2a
EnKF with Observational Perturbations
�
Forecast ensembleObservation ensemble
�
![Page 46: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/46.jpg)
Approach 2a
EnKF with Observational PerturbationsKalman-like update
![Page 47: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/47.jpg)
Approach 2a
EnKF with Observational PerturbationsKalman-like update
�Sample Covariance Matrix
![Page 48: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/48.jpg)
Approach 2
Ensemble Kalman Filter (EnKF)
Approximate pdf by an ensemble of particles:
Evolve particles forward using SDE ODE
Perform Kalman-like analysis
Forecast:
Analysis:
![Page 49: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/49.jpg)
Approach 2b
Ensemble Transform Kalman Filter (ETKF)
![Page 50: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/50.jpg)
Approach 2b
Ensemble Transform Kalman Filter (ETKF)
Use sample estimates:
![Page 51: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/51.jpg)
Approach 2b
Ensemble Transform Kalman Filter (ETKF)
� �Define
![Page 52: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/52.jpg)
Approach 2b
Ensemble Transform Kalman Filter (ETKF)
� �Define
![Page 53: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/53.jpg)
Approach 2b
Ensemble Transform Kalman Filter (ETKF)
� �Define
![Page 54: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/54.jpg)
Approach 2b
Ensemble Transform Kalman Filter (ETKF)
Define
is the matrix square root of
Choose
![Page 55: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/55.jpg)
Approach 2b
Ensemble Transform Kalman Filter (ETKF)
Analysis Ensemble
![Page 56: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/56.jpg)
−1 −0.5 0 0.5 1 1.5 2−1.5
−1
−0.5
0
0.5
1
1.5
x
y
Approach 2
Ensemble Kalman Filter (EnKF)Validation - Full Observation, Imperfect Data
Observe vortices and drifter under observational noise
N = 6 ensemble members
![Page 57: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/57.jpg)
5 10 15 20 25 30
−3
−2
−1
0
1
t
Drifter
ξ1
![Page 58: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/58.jpg)
0 20 40 60−1.5
−1
−0.5
0
0.5
1
1.5
t
Vortex 1
x1
![Page 59: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/59.jpg)
0 20 40 600
0.5
1
1.5
2
2.5
Time (s)
||Xtru
e − X
filte
r|| 2
![Page 60: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/60.jpg)
Approach 2
Ensemble Kalman Filter (EnKF)Results - Partial Observation, Imperfect Data
Observe only drifter under observational noise
N = 6 ensemble members
−1 −0.5 0 0.5 1 1.5 2−1.5
−1
−0.5
0
0.5
1
1.5
x
y
![Page 61: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/61.jpg)
5 10 15 20 25−2
−1
0
1
2
t
Drifter
ξ1
![Page 62: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/62.jpg)
0 20 40 60−2
−1
0
1
2
t
Vortex 1
x1
![Page 63: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/63.jpg)
0 20 40 600
1
2
3
4
5
6
Time (s)
||Xtru
e − X
filte
r|| 2
![Page 64: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/64.jpg)
Data Assimilation
Testing
![Page 65: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/65.jpg)
Testing, Phase I
Compare EKF, perturbed observations EnKF and ETKF
Failure statistic: time to failure
![Page 66: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/66.jpg)
Testing, Phase I
Generate M = 500 instances of the SDE at each of L = 4 drifter locations
Start vortex 1 at (0, 1)Start vortex 2 at (0, -1)
Add observational noise according to the model
Failure statistic: time to failure
![Page 67: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/67.jpg)
−2 0 2
−2
−1
0
1
2
x
y
![Page 68: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/68.jpg)
Testing, Phase I
Record when the distance between the analyzed state and the true state for either vortex is greater than 1
Failure statistic: time to failure
![Page 69: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/69.jpg)
−2 0 2
−2
−1
0
1
2
x
y
![Page 70: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/70.jpg)
Testing, Phase I
Failure statistic: time to failure
![Page 71: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/71.jpg)
0 20 40 600
0.05
0.1
0.15
0.2
Time to Failure
Frac
tion
Faile
d
EKF
0 20 40 600
0.05
0.1
0.15
0.2
Time to Failure
Frac
tion
Faile
d
EnKF,PerturbedObservation
0 20 40 600
0.05
0.1
0.15
0.2
Time to Failure
Frac
tion
Faile
d
ETKF
![Page 72: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/72.jpg)
Moving Forward
Improvements to EnKF
Covariance Inflation
Localization Local Ensemble Transform Kalman Filter (LETKF)
![Page 73: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/73.jpg)
Moving Forward
Implement Particle Filter
Approximate pdf by an ensemble of weighted particles:
Evolve particles forward using SDE
Perform full Bayesian update at analysis
Forecast:
Analysis:
![Page 74: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/74.jpg)
Moving Forward
Phase II - Manifold Detection for Observing System Design
−2 −1 0 1 2−2
−1.5
−1
−0.5
0
0.5
1
1.5
2
x
y
![Page 75: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/75.jpg)
Timeline
– Produce database: now through mid-October– Develop extended Kalman Filter: now through mid-October– Develop ensemble Kalman Filter: mid-October through mid-November– Develop particle filter: mid-November through end of January– Validation and testing of three filters (serial): Beginning in mid-October, complete by February
Phase I
![Page 76: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/76.jpg)
Timeline
– Produce database: now through mid-October– Develop extended Kalman Filter: now through mid-October– Develop ensemble Kalman Filter: mid-October through mid-November– Develop particle filter: mid-November through end of January– Validation and testing of three filters (serial): Beginning in mid-October, complete by February
Phase I
![Page 77: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/77.jpg)
(Some) References
D.J. Higham. An algorithmic introduction to numerical simulation of stochastic differential equations. SIAM review, pages 525–546, 2001.
A.H. Jazwinski. Stochastic processes and filtering theory. Dover Publications, 2007.
E. Kalnay. Atmospheric modeling, data assimilation, and predictability. Cambridge University Press, 2003.
G. Evensen. Data assimilation: the ensemble Kalman filter. Springer Verlag, 2009.
T. DelSole and M. Tippett. The ensemble square root filter. Accessed: http://mason.gmu.edu/%7Etdelsole/AdvStat/
![Page 78: Lagrangian Data Assimilation and Manifold Detection for a Point …rvbalan/TEACHING/AMSC663Fall2011/... · 2011-12-14 · Lagrangian Data Assimilation and Manifold Detection for a](https://reader034.fdocuments.net/reader034/viewer/2022042203/5ea481995e15474b9e6af892/html5/thumbnails/78.jpg)
Questions???