Experimental design approach for optimal selection and placement of rain sensors

45
Eawag: Swiss Federal Institute of Aquatic Science and Technology Experimental design approach for optimal selection and placement of rain sensors 2 December 2015 Andreas Scheidegger Continuous Assimilation of Integrating Rain Sensors

Transcript of Experimental design approach for optimal selection and placement of rain sensors

Page 1: Experimental design approach for optimal selection and placement of rain sensors

Eawag: Swiss Federal Institute of Aquatic Science and Technology

Experimental design approach for optimal

selection and placement of rain sensors

2 December 2015

Andreas Scheidegger

Continuous Assimilation of Integrating Rain Sensors

Page 2: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Rain sensors

Rasmussen et al.

(2008)

www.unidata.com.au/ww

w.o

tt.c

om

Building automation

sensor

Microwave Links

1

Rabiei et al. (2013)

Which combination gives is most

informative?

Page 3: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

The optimal measurement set-up depends on

I. Quantity of interest

II. Sensor locations

• Spatial

• Temporal

III. Sensors properties

• Integration

• Uncertainty

• Scale

IV. Rain field properties

• Temporal / spatial correlation

• Intensity2

Page 4: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

I. Quantity of interest

tim

e

x

3

Page 5: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

I. Quantity of interest

tim

e

x

3

Page 6: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

The optimal measurement set-up depends on

vs.I. Quantity of interest

II. Sensor locations

• Spatial

• Temporal

III. Sensors properties

• Integration

• Uncertainty

• Scale

IV. Rain field properties

• Temporal / spatial correlation

• Intensity4

Page 7: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

II. Sensor locations

tim

e

x

5

Page 8: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

The optimal measurement set-up depends on

vs.

vs.

I. Quantity of interest

II. Sensor locations

• Spatial

• Temporal

III. Sensors properties

• Integration

• Uncertainty

• Scale

IV. Rain field properties

• Temporal / spatial correlation

• Intensity6

Page 9: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Rain sensors

Rasmussen et al.

(2008)

www.unidata.com.au/ww

w.o

tt.c

om

Building automation

sensor

Microwave Links

Rabiei et al. (2013)

7

Page 10: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

III. Sensor properties

tim

e

x

8

Page 11: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

The optimal measurement set-up depends on

I. Quantity of interest

II. Sensor locations

• Spatial

• Temporal

III. Sensors properties

• Integration

• Uncertainty

• Scale

IV. Rain field properties

• Temporal / spatial correlation

• Intensity

vs.

vs.

vs. vs.

9

Page 12: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

IV. Rain field properties

https://flic.kr/p/wYJxB, Guillaume Bertocchi http://cloud-maven.com/the-perfect-rain/

10

Page 13: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

The optimal measurement set-up depends on

I. Quantity of interest

II. Sensor locations

• Spatial

• Temporal

III. Sensors properties

• Integration

• Uncertainty

• Scale

IV. Rain field properties

• Temporal / spatial correlation

• Intensity

vs.

vs.

vs. vs.

vs.

Page 14: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Continuous Assimilation of Integrating Rain Sensors

Signals

• Different sensors

• Consider integrating

• Consider different scales

(continuous, binary, …)

Prior knowledge

• Temporal correlation

• Spatial correlation

Map of rain intensities

• Arbitrary resolution

+ =

12

Page 15: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

CAIRS: Assimilation of all available information

Integrated rain intensity

+ =

12

Page 16: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Bayesian Assimilation

1) Infer the rain at the measured coordinates and domains

2) Extrapolation to other points or regions

Arbitrary distributions

→ adaptive Metropolis-within-Gibbs sampler

(Roberts and Rosenthal, 2009)

Gaussian

= rain at

measured locations

= rain at

predicted locations

= set of all signals

prior

signal distribution

13

Page 17: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Experimental design

Uncertainty of estimated quantity of interest

Sensor configuration (types and position)

Rain field

simulate

signals

14

Page 18: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Experimental design

Uncertainty of estimated quantity of interest

Sensor configuration (types and position)

Rain field

uncertainty

estimate

simulate

signals

14

Page 19: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

CAIRS for experimental design

15

Select 10 sensors: gauge, short or long MWL

Page 20: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

CAIRS for experimental design

15

large medium small

Page 21: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

CAIRS for experimental design

16

large medium small

Page 22: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Conclusions

To find the optimal sensor configuration we need…

1) Sensor error models

17

2) Rain field characterization

3) A generic assimilation method

4) A clever optimization algorithm

CAIRS is on GitHub,

feedback is highly welcome!

https://github.com/scheidan/CAIRS.jl

Page 23: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Page 24: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

CAIRS for experimental design

16

large medium small

Page 25: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Signal scale and interactions

time

Rain

inte

nsity

Page 26: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Sensor characterization

Point measurement: Integrated measurement:

Describe the signal noise

assuming we know the true rain field

13

Page 27: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Prior knowledge

Gaussian process with three dimensions: x, y, and time

How “likely” is a combination of rain intensities?

How “likely” is a combination of rain

intensities, if something is known?

Mainly defined by the temporal and the spatial correlation length

time or space

Rain

inte

nsity

13

Page 28: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Measure roof run-off?

maps.google.com

12

Page 29: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Signals in arbitrary time resolution

Time resolution of predicted

rain maps:

10 seconds

Measurement intervals:

MWLs: 174 – 276 seconds

Gauges: 60 seconds

13time

Page 30: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Microwave Links

2013-06-09 21:38:00 2013-06-09 21:38:00

x-coordinate [m] x-coordinate [m]

y-c

oord

inate

[m

]

4 k

m (

2.4

9 m

iles)

Rain intensities Uncertainty of rain intensities

9

3 km (1.86 miles)

Page 31: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Microwave Links + Pluviometers

2013-06-09 21:38:00 2013-06-09 21:38:00

x-coordinate [m] x-coordinate [m]

y-c

oord

inate

[m

]

y-c

oord

inate

[m

]

Rain intensities Uncertainty of rain intensities

10

Page 32: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Microwave Links + Radar + Pluviometers

2013-06-09 21:38:00 2013-06-09 21:38:00

x-coordinate [m] x-coordinate [m]

y-c

oord

inate

[m

]

y-c

oord

inate

[m

]

Rain intensities Uncertainty of rain intensities

11

Page 33: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

CAIRS for experimental design

17

Page 34: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

CAIRS for experimental design

16

Page 35: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Integration matters

time

Rain

inte

nsity

integration domain

t2t1

4

Page 36: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Prior knowledge matters

time

Rain

inte

nsity

integration domain

t2t1

4

Page 37: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Pluviometers

2013-06-09 21:38:00 2013-06-09 21:38:00

x-coordinate [m] x-coordinate [m]

y-c

oord

inate

[m

]

y-c

oord

inate

[m

]

Rain intensities Uncertainty of rain intensities

9

Page 38: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Arbitrary location of integration domains

12

Useful to combine

different radar

products

Page 39: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Arbitrary prediction points

Compute higher

resolution for critical

areas

14

Page 40: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Predict integrated rain intensities directly

Predict integrated rain

intensities

• in space and/or

• in time

15

Computationally

comparable to a single

point on the rain map

Page 41: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Arbitrary location of integration domains

Potentially useful to

combine different radar

products

13

Page 42: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Covariance function

Page 43: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

1D-example

time

Rain

inte

nsity

Page 44: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Bayesian Assimilation

1) Infer the rain at the measured coordinates and domains

2) Extrapolation to other points

Arbitrary distributions

→ adaptive Metropolis-within-Gibbs sampler

(Roberts and Rosenthal, 2009)

Gaussian

8

= set of all

measured locations

= set of

predicted locations

= set all signals

from prior

Page 45: Experimental design approach for optimal selection and placement of rain sensors

Andreas Scheidegger – Eawag

Conclusions

Assimilation very different

(novel) sensors possible

Asses benefits of

additional sensors

CAIRS is under development

Feedback is highly welcome!

https://github.com/scheidan/CAIRS.jl

Transformation:

non-normal priors ?

Integration matters!

Prior formulation:

add advection, diffusion?

16

Continuous Assimilation of

Integrating Rain Sensors