Introduction to iCOR and ACOLITE atmospheric correction...

52
User Uptake Workshop 16-17 November 2017 European Environment Agency, Copenhagen, Denmark Dimitry Van der Zande - RBINS Clémence Goyens – VITO Quinten Vanhellemont – RBINS Liesbeth De Keukelaere - VITO Introduction to iCOR and ACOLITE atmospheric correction for Landsat-8 and Sentinel-2

Transcript of Introduction to iCOR and ACOLITE atmospheric correction...

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Dimitry Van der Zande - RBINS Clémence Goyens – VITO

Quinten Vanhellemont – RBINS Liesbeth De Keukelaere - VITO

Introduction to iCOR and ACOLITE atmospheric correction for Landsat-8

and Sentinel-2

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

ATMOSPHERIC CORRECTION

Ozone layer

Absorption by aerosols

& molecules

Scattering by aerosols & molecules

Scattering from the

target

Rayleigh

Aerosols

θ𝑠𝑠 θ𝑣𝑣

Scattering from the

background

Atmosphere

Δφ

𝐿𝐿 𝑇𝑇𝑇𝑇𝑇𝑇 = 𝐿𝐿𝑡𝑡𝑡𝑡𝑡𝑡𝑡𝑡𝑡𝑡𝑡𝑡 + 𝐿𝐿𝑡𝑡𝑡𝑡𝑎𝑎−𝑝𝑝𝑡𝑡𝑡𝑡𝑝 + 𝐿𝐿𝑏𝑏𝑡𝑡𝑏𝑏𝑏𝑏𝑡𝑡𝑡𝑡−𝑝𝑝𝑡𝑡𝑡𝑡𝑝

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

AC in Ocean Color

Courtesy of PJ Werdell

𝐿𝐿 𝑇𝑇𝑇𝑇𝑇𝑇 = 𝐿𝐿𝑤𝑤𝑡𝑡𝑡𝑡𝑡𝑡𝑡𝑡 + 𝐿𝐿𝑡𝑡𝑡𝑡𝑎𝑎−𝑝𝑝𝑡𝑡𝑡𝑡𝑝 + 𝐿𝐿𝑏𝑏𝑡𝑡𝑏𝑏𝑏𝑏𝑡𝑡𝑡𝑡−𝑝𝑝𝑡𝑡𝑡𝑡𝑝 In the NIR

Gordon and Wang, 1994 Black Pixel Assumption

Ignored

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

AC in Ocean Color

Courtesy of PJ Werdell

𝐿𝐿 𝑇𝑇𝑇𝑇𝑇𝑇 = 𝐿𝐿𝑤𝑤𝑡𝑡𝑡𝑡𝑡𝑡𝑡𝑡 + 𝐿𝐿𝑡𝑡𝑡𝑡𝑎𝑎−𝑝𝑝𝑡𝑡𝑡𝑡𝑝 + 𝐿𝐿𝑏𝑏𝑡𝑡𝑏𝑏𝑏𝑏𝑡𝑡𝑡𝑡−𝑝𝑝𝑡𝑡𝑡𝑡𝑝

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

ATMOSPHERIC IMAGE CORRECTION

- Use a NIR modelling scheme and remove ρW(λNIR) from ρt(λ) → apply GW94 e.g., Siegel et al. (2000), Stumpf et al. (2003), Bailey et al. (2010), Wang et al. (2012) - Fix aerosol contribution from nearby pixels and model to determine the ρW(λNIR) e.g., Hu et al. (1999) and Ruddick et al. (2000, 2006)

- Using Short Wave Infrared (SWIR) bands in highly turbid waters e.g., Wang and Shi (2007) and Wang et al. (2009)

- Coupled Ocean-Atmosphere optimization/inversion e.g., Gordon et al. (1997) (spectral matching); Chomko and Gordon (1998), Chomko et al.

(2003) and Kuchinke et al. (2009) (spectral optimization method); Jamet et al. (2005) and Brajard et al. (2012) (spectral optimization including NN); Doerffer and Schiller (2008, 2007), Schroeder et al.(2007) (NN inversion); Steinmetz et al. (2010) (polynomial atmospheric path radiance).

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

ICOR, ATMOSPHERIC IMAGE CORRECTION

- Sensor generic (S2, L8, hyperspectral, … ) - Scene generic (Land and Water) - Focus on operationability - Handle land and water pixels - Focus on coastal and inland waters Previously known as OPERA

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

𝐿𝐿 𝑇𝑇𝑇𝑇𝑇𝑇 = 𝐿𝐿𝑡𝑡𝑡𝑡𝑡𝑡𝑡𝑡𝑡𝑡𝑡𝑡 + 𝐿𝐿𝑡𝑡𝑡𝑡𝑎𝑎−𝑝𝑝𝑡𝑡𝑡𝑡𝑝 + 𝐿𝐿𝑏𝑏𝑡𝑡𝑏𝑏𝑏𝑏𝑡𝑡𝑡𝑡−𝑝𝑝𝑡𝑡𝑡𝑡𝑝

De

Keu

kela

ere

et a

l. (s

ubm

itted

)

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

• Using external sources OR image based • Image based

– Guanter et al., 2005 – Derived above land – Spatially extended over water pixels – Fixed rural aerosol model

Latm−path & AOT retrieval

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

As seen by the satellite

Rayleigh scattering

ρw(λ) ?

Lbackgr.−path over water

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Lbackgr.−path over water

NIR similarity spectrum Ruddick et al. (2006 )

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Lbackgr.−path over water

Lake Marken - 15/09/16 Lake Marken - 15/09/16

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Lake Marken - 15/09/16

Transect – 865 nm (9km)

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Mantua Lakes - 23/09/14

No SIMEC SIMEC

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Lbackgr.−path over land

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

iCOR in SNAP

Let’s try it during 11:00 Practical hands-on session: iCOR atmospheric correction using the SNAP toolbox

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

ACOLITE Atmospheric Correction for High-Resolution Satellites

To develop AC algorithms for Sentinel-2, Landsat-8 taking TOA radiance data and auxiliary data as input and provide bottom of

atmosphere water reflectance as output.

L8 20140716

TOA radiances Rayleigh corrected radiances water reflectance

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

ACOLITE aims at

ρ Rayleigh

TOA

ρ aerosol

Rayleigh corrected

Retrieve water-leaving radiance reflectance, ρw, for turbid waters - use dark SWIR pixels to establish estimate of aerosol reflectance - SWIR threshold delineates water/non water - exponential extrapolation using 1.6/2.2 SWIR ratio (smoothed) - no direct AOT/Ta estimation

Sensitive to adjacency effects (inland waters), water surface effects (glint)

water reflectanc

e

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

ACOLITE processor

L1 Imagery

Rayleigh corrected imagery

Rayleigh correction: LUT based on 6SV and sun and sensor geometry

Land/cloud masking

ρc 6 > 0.0215

Cloud shadow detection -in development-

Rayleigh corrected imagery with water

pixels

Height of lake

Elevation automatically extracted from DE

Select clear water pixels

SWIR (1609,2201)

ε spatially

fixed or variable

NIR (655,865nm)

ε spatially

fixed

SWIR (865,1609nm)

ε spatially

fixed

SWIR (865,2201nm)

ε spatially

fixed

Aerosol type (ε) selection

ρw=𝟏𝟏𝒕𝒕

(𝝆𝝆𝒄𝒄 − 𝜺𝜺. ρam)

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Currently at version ‘2070718’ • Binary distribution of L8/S2 AC processor for Windows, Linux and MAC • Simple and fast processing of L8/S2 images for marine and inland water applications • AC is image based, no need for external Inputs!! • ε constant over scene (crop), aerosol multiple scattering reflectance varies per pixel • Use of settings file (created by acolite) batch processing

‘idl –rt=acolite.sac –args image=imagelist.txt sttings=acolite_settings_file’

ACOLITE software

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Standard Features • Atmospheric correction of L8/S2 • RGB image generation (TOA, RCO, pan sharpened), RGB scaling • extraction of rectangular regions • Mapping options: next to NetCDF, GeoTIFF, PNG now also KMZ • L2 processing products:

ACOLITE software

Rhow

CHL_OC2, CHL_OC3

SPM_NECHAD 561, 655, 865

SPM_Balaton

RTOA, LTOA DEM T_NECHAD_645

RRC, LRC FAI (floating algae index)

T_DOGLIOTTI (red, NIR, mix)

RHOAM NDVI, NDVI_TOA, NDVI_RCO

QAA_a QAA_bb QAA_Kd

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Qualitative inspection of ACOLITE products for L8-OLI

ACOLITE products for L8

Lake Balaton (20140716)

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Qualitative inspection of ACOLITE products for L8-OLI

ACOLITE products for L8

Lake Balaton (20140716)

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

ACOLITE products for S2

S2 10m resolution 16/1/2016

Ice

Ice

Thin cloud

Submerged ice

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

ACOLITE products for S2

S2 10m resolution 16/1/2016 Submerged

ice

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

ACOLITE products for S2

S2 665nm 10m resolution 16/1/2016

Cloud shadow

High reflectance by ice (cracks)

Striping in RGB bands

Water visible through ice?

Clouds flagged

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

ACOLITE products for S2 Cyanobacterial bloom in Lake Mulwala (Australia)

705 nm reference

665 nm chla absorption

9x9 pixels

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

ACOLITE products for S2 Cyanobacterial bloom in Lake Mulwala

9x9 pixels

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Validation of L8 & S2 AC

Lake Balaton (20140716) *WISP-ASD-RAMSES-HyperSAS

Lake Mantua (20140923) *ASD, SE Curonian Lagoon (20140902)

*WISP

Inter-comparison exercise of AC procedures for L8 • In situ remote sensing reflectance gathered by CNR (and INFORM consortium) in

Balaton Lake, Kis, Lake Mantua and Curonian Lagoon • Match up time difference max 2h • Every match up QC for cloud, cloud shadow, glint

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Inter-comparison exercise of AC procedures • In situ Rrs data was QC and processed by individual partners responsible for data

acquisition 1 hyperspectral Rrs measurement per station

• Resampled to L8-OLI bands and S2-MSI to enable direct comparison (using SRF)

Validation of L8 & S2 AC

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Balaton 20160721 L8-OLI

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Validation of L8-OLI 443nm

490nm

ACOLITE

iCOR

ACOLITE Slope = 0.927 R² = 0.921 rmse = 0.004

iCOR / iCOR-SIMEC Slope = 1.075 / 1.114 R² = 0.934 / 0.939 rmse = 0.004 / 0.004

iCOR-SIMEC

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Validation of S2-MSI

ACOLITE Slope = 1.166 R² = 0.752 rmse = 0.003

iCOR / iCOR-SIMEC Slope = 0.920 / 0.630 R² = 0.950 / 0.812 rmse = 0.0002 / 0.001

ACOLITE ACOLITE

iCOR iCOR-SIMEC

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

• Atmospheric correction could be considered the most important step in the generation of L2W products.

• iCOR (SNAP) & ACOLITE (stand alone) open access software provides AC for water applications with land-sensors

• iCOR & ACOLITE show good results in many cases but limitations have been identified (e.g. noisy SWIR bands S2)

• Limitations due to sensor characteristics have been mentioned in the recommendations for future Copernicus missions

• BEL-Ponder: development of new AC approach (multi-band dark pixel fitting) to deal with AC issues for current sensors

Summary

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Bonus slides

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Validation of L8 with MOW1 data

Validation of ACOLITE using BE AERONET

Match-up analysis Zeebrugge-MOW1 station (prelim results): • AERONET-DATA from Febr 2014-Febr

2016 + Aug-Sept 2016

• Level 1 13 match ups • Level 1.5 1 match up • Level 2 1 match up

• ACOLITE v20160602v2 (SubF_Unity) • Actual pixel value • < 1h time difference

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Validation of L8 with MOW1 data

T5.1.3 Validation of ACOLITE

443nm

490nm

560nm

665nm

865nm

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Validation of S2-MSI with AERONET-OC data

T5.1.3 Validation of ACOLITE

• AERONET-DATA 2016 MOW1: since Aug 2016 Cpower: full S2-MSI mission

• Level 1.5 16 match ups (15 Cpower, 1 MOW1) • 8 Cpower and 1 MOW1 matchup remained after quality control (clouds,

haze, wave effects, glint, …) • ACOLITE v20161123v1.0 (SWIRvar_Unity)

• 300m by 300m (31x31 pixels)

• < 1h time difference

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

T5.1.3 Validation of ACOLITE

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

T5.1.3 Validation of ACOLITE

Increased scatter towards shortest blue band (bug in ACOLITE?)

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

T5.1.3 Validation of ACOLITE

665nm: Increased scatter in clear water match-ups due to differences between SRFs of narrow AERONET-band and

wide S2-MSI band

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

T5.1.3 Validation of ACOLITE

Difficulties to measure a very low NIR signal in clear waters show the limits of the sensor and atmospheric correction

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Validation of L8 AC –ACOLITE- 560nm 443nm

490nm 665nm

865nm

MAPE

ACOLITE

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Validation of L8 AC –iCOR- 560nm 443nm

490nm 665nm

865nm

MAPE

iCOR

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Validation of L8 AC –iCOR SIMEC- 560nm 443nm

490nm 665nm

865nm

MAPE

iCOR-SIMEC

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Validation of S2 AC –ACOLITE- 560nm 443nm

490nm 665nm

865nm

MAPE

ACOLITE

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Validation of S2 AC –iCOR- 560nm 443nm

490nm 665nm

865nm

MAPE

iCOR

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Validation of S2 AC –iCOR SIMEC- 560nm 443nm

490nm 665nm

865nm

MAPE

iCOR-SIMEC

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Validation of S2-MSI

490nm

ACOLITE Slope = 0.952 R² = 0.767 rmse = 0.003

iCOR / iCOR-SIMEC Slope = 0.920 / 0.630 R² = 0.950 / 0.812 rmse = 0.0002 / 0.001

ACOLITE

iCOR

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

Inter-comparison exercise of AC procedures • In situ remote sensing reflectance gathered by CNR (and INFORM consortium) in

Balaton Lake, Kis, Lake Mantua and Curonian Lagoon, Lake Garda, Lake Iseo, Lake Marken

Validation of L8 & S2 AC

ACOLITE (RBINS) –Based on approach of Ruddick et al. (2000) • Input: target altitude; sun-target geometry • Aerosol model and aerosol reflectance estimated from spectral imagery • No adjacency correction • Water applications

iCOR (VITO) – Based on MODTRAN • Input: target altitude; sun-target geometry; • Visibility with land approach • Fixed rural aerosol model • Spatially extended over water pixels • procedure for adjacency effects • Land and water applications

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

ACOLITE products for S2 Lake Garda

17/8/2016 12/9/2015 1/7/2016

Rrs664

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

ACOLITE products for S2

S2 443nm 60m resolution 16/1/2016

Mis-alignment of lenses for 443 band?

User Uptake Workshop

16-17 November 2017

European Environment Agency, Copenhagen, Denmark

ACOLITE products for S2

S2 497nm 10m resolution 16/1/2016

NO Mis-alignment of lenses for 497 band