Lidar calibration – What’s the problem? - DTU...

18
General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. Users may download and print one copy of any publication from the public portal for the purpose of private study or research. You may not further distribute the material or use it for any profit-making activity or commercial gain You may freely distribute the URL identifying the publication in the public portal If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. Downloaded from orbit.dtu.dk on: Jun 10, 2018 Lidar calibration – What’s the problem? Courtney, Michael Publication date: 2015 Document Version Peer reviewed version Link back to DTU Orbit Citation (APA): Courtney, M. (2015). Lidar calibration – What’s the problem? European Wind Energy Association (EWEA). [Sound/Visual production (digital)]. EWEA Annual Conference and Exhibition 2015 , Paris, France, 17/11/2015

Transcript of Lidar calibration – What’s the problem? - DTU...

Page 1: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights.

• Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal

If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim.

Downloaded from orbit.dtu.dk on: Jun 10, 2018

Lidar calibration – What’s the problem?

Courtney, Michael

Publication date:2015

Document VersionPeer reviewed version

Link back to DTU Orbit

Citation (APA):Courtney, M. (2015). Lidar calibration – What’s the problem? European Wind Energy Association (EWEA).[Sound/Visual production (digital)]. EWEA Annual Conference and Exhibition 2015 , Paris, France, 17/11/2015

Page 2: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

DTU Wind Energy, Technical University of Denmark

Add Presentation Title in Footer via ”Insert”; ”Header & Footer”

Mike Courtney [email protected]

Lidar calibration – What’s the problem?

Page 3: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

DTU Wind Energy, Technical University of Denmark

Add Presentation Title in Footer via ”Insert”; ”Header & Footer”

The storyline

• What is the point of calibrating lidars?

• How we do this for various lidar types

• What are the main components of the uncertainty?

2

• This makes lidar uncertainty too high, calibrations that are not very repeatable and lidar sensitivity impossible to understand.

• Errors are not necessarily uncertainties

• How we can significantly reduce cup and therefore lidar uncertainty

The reference wind speed = cup uncertainty DOMINATES

Page 4: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

DTU Wind Energy, Technical University of Denmark

Add Presentation Title in Footer via ”Insert”; ”Header & Footer”

Calibration – what is it?

• A comparative test between a test instrument and a reference instrument that allows you to do two things:

1. Find a transfer function between the indications of the test instrument and the reference instrument.

2. Derive an uncertainty for the test instrument indication

≈ reference instrument uncertainty + transfer function uncertainty

3

Without a calibration, we do not have the traceability to international standards necessary in order to define an uncertainty.

Page 5: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

DTU Wind Energy, Technical University of Denmark

Add Presentation Title in Footer via ”Insert”; ”Header & Footer”

Lidar calibration – what’s the point?

• All the components of the lidar have tolerances (uncertainties). Unless each component is formally calibrated, it will not be possible to assign an uncertainty.

• Even if all the lidar components are calibrated, how do we know that the lidar algorithm (all of it) is implemented correctly?

4

“Lidars are ‘absolute’ instruments (you can calculate the wind speed from first principles) so no calibration is necessary.”

A not uncommon statement:

Some unfortunate truths:

Consequently:

For wind lidars, nacelle lidars and scanning lidars it is currently not possible to assign an uncertainty without performing a field calibration using a met mast equipped with cup anemometers and wind vanes.

Page 6: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

DTU Wind Energy, Technical University of Denmark

Add Presentation Title in Footer via ”Insert”; ”Header & Footer”

How we calibrate wind lidars

5

Page 7: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

DTU Wind Energy, Technical University of Denmark

Add Presentation Title in Footer via ”Insert”; ”Header & Footer”

Calibrating scanning lidars – here for long range sector scanning

6

• LOS speed • Inclinometers • Pointing accuracy

Things to calibrate:

Page 8: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

DTU Wind Energy, Technical University of Denmark

Add Presentation Title in Footer via ”Insert”; ”Header & Footer”

Lidar uncertainty from the calibration (per bin, according to Annex L)

7

Ulidar = 𝑈𝑟𝑒𝑓2 + ∆𝑉2 +

𝜎𝑙𝑖𝑑𝑎𝑟2

𝑁+ 𝜎𝑑𝑒𝑣

2

Lidar uncertainty

Reference uncertainty

mean deviation

”uncertainty” of mean in bin (?)

Standard deviation of the deviation

I am not convinced that these terms are correct, but it doesn’t change the main argument of this presentation.

Page 9: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

DTU Wind Energy, Technical University of Denmark

Add Presentation Title in Footer via ”Insert”; ”Header & Footer”

Lidar uncertainty from the calibration - Typical sizes (m/s) at 10 m/s (standard uncertainty)

8

Ulidar = 𝑈𝑟𝑒𝑓2 + ∆𝑉2 +

𝜎𝑙𝑖𝑑𝑎𝑟2

𝑁+ 𝜎𝑑𝑒𝑣

2

0.17

0.152

0.052

0.022

0.072

Page 10: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

DTU Wind Energy, Technical University of Denmark

Add Presentation Title in Footer via ”Insert”; ”Header & Footer”

9

The reference wind speed (cup) uncertainty DOMINATES lidar uncertainty

Consequently:

• Lidar uncertainty is too high

• Lidar calibrations (against masts are not repeatable enough

• Since we don’t understand cup sensitivity, we can not understand lidar sensitivity (classification) either

Page 11: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

DTU Wind Energy, Technical University of Denmark

Add Presentation Title in Footer via ”Insert”; ”Header & Footer”

Where does the reference cup uncertainty come from? (typical values for 10 m/s, k=1)

10

𝑈𝑟𝑒𝑓 = 𝑈𝑐𝑎𝑙2 + 𝑈𝑡𝑢𝑛𝑛𝑒𝑙

2 + 𝑈𝑜𝑝𝑒𝑟𝑎𝑡𝑖𝑜𝑛𝑎𝑙2 + 𝑈𝑚𝑜𝑢𝑛𝑡𝑖𝑛𝑔

2

Cup uncertainty

Calibration standard uncertainty

Spread of tunnels uncertainty

Classification uncertainty

Mounting uncertainty

0.025 m/s

0.058 m/s

0.076 m/s

0.11 m/s

0.15 m/s

Inconsistent!!!

Errors included as uncertainties!

Page 12: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

DTU Wind Energy, Technical University of Denmark

Add Presentation Title in Footer via ”Insert”; ”Header & Footer”

Summing up so far:

• Most of the lidar uncertainty comes from the cup

• Most of the cup uncertainty comes from

–Tunnel uncertainty

–Operational uncertainty

–Mounting uncertainty

11

Page 13: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

DTU Wind Energy, Technical University of Denmark

Add Presentation Title in Footer via ”Insert”; ”Header & Footer”

Known errors are not uncertainties

• Wind tunnel calibration differences

• The effects of

–Turbulence

–Temperature

–Maybe even tilt angle

• Mast mounting errors

12

Most of the cup uncertainty comes from errors that we could/should know something about. These include:

Page 14: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

DTU Wind Energy, Technical University of Denmark

Add Presentation Title in Footer via ”Insert”; ”Header & Footer”

What we need to do

• Get wind tunnel calibrators to agree with each other so that the given calibration best estimates and uncertainties are consistent between wind tunnels.

• Determine how well the current sensitivty (Accuwind) model actually performs and improve it, if necessary. Use the sensitivities to correct the cup speeds for (at least) turbulence and temperature effects.

• Do the same for mast influence models – we need to know how good e.g. CFD models are. Then we need to start using them for operational corrections and use much lower mounting uncertainties.

13

• Move away from a culture where errors are included as uncertainties

• Move towards a culture where we strive to correct for errors and • include much smaller uncertainties that reflect our ability to do this.

We can tackle the following 3 areas:

Page 15: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

DTU Wind Energy, Technical University of Denmark

Add Presentation Title in Footer via ”Insert”; ”Header & Footer”

How we will do it

14

Short range CW lidars (lidics) can be calibrated using a rotating wheel. They will have a much lower uncertainty than cup anemometers or cup calibrated lidars.

Lidics will be an important tool for • Documenting wind tunnel accuracy • Measuring cup anemometer influences (TI and T) • Measuring how masts and booms affect cup wind speeds

Page 16: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

DTU Wind Energy, Technical University of Denmark

Add Presentation Title in Footer via ”Insert”; ”Header & Footer”

Measuring in the free-air using 3 lidics

15

3 lidic los speeds transformed to (u, v, w)

Lidic 1

Lidic 2

Lidic 3

2-1

0 m

The uncertainty of (u, v, w) will depend on: • the los speed uncertainty • the lidic geometry • the range accuracy

We can perform measurents on: • individual cups • cup/boom/mast

systems

Page 17: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

DTU Wind Energy, Technical University of Denmark

Add Presentation Title in Footer via ”Insert”; ”Header & Footer”

Conclusion

• Lidar uncertainty is dominated by the reference cup anemometer uncertainty.

• Cup anemometer uncertainty can be improved by:

– Solving the tunnel blockage calibration issues

– Measuring and correcting for sensitivities instead of just including them as uncertainties (Smartcups)

– Measuring and correcting for mounting effects, with much reduced mounting uncertainty as a consequence.

• We can use precision calibrated, short range, continuous wave lidars (LIDICS) to achieve this.

• These improvements will reduce cup anemometer, sonic and consequently lidar uncertainty

16

Page 18: Lidar calibration – What’s the problem? - DTU Orbitorbit.dtu.dk/files/118318120/Lidar_calibration_presentation.pdf · DTU Wind Energy, Technical University of Denmark Add Presentation

DTU Wind Energy, Technical University of Denmark

Add Presentation Title in Footer via ”Insert”; ”Header & Footer”

17

Thanks and any questions? [email protected]