AMSR-E and AMSR-E Validation Archive & Distribution Status Amanda Leon, NSIDC AMSR-E Lead Joint...

AMSR-E and AMSR-E ValidationArchive & Distribution Status

Amanda Leon, NSIDC AMSR-E Lead

Joint AMSR-E Science Team Meeting

Hunstville, Alabama2-3 June


Amanda Leon - NSIDC DAAC 2-3 June 20102

Outline

AMSR-E• Product Status• Data Support • Metrics• Accomplishments & Plans

AMSR-E Validation• Status• Metrics

Sea ice derived from the AMSR-E 89 GHz Tbs. Image courtesy

of NASA/GSFC Visualization Studio



Product Status

• V04 L3 Ocean release (May

’10) and reprocessing (on-going)

• V12 Sea Ice release and reprocessing (April - May ’10)

• L3 Land, Sea Ice, & Snow to validated Version 2 using V10 L2A reprocessing (July ’09)

AMSR-E Data Versions: http://nsidc.org/data/amsre/versions.html

Average ice sheet surface temperature over Greenland from August 5 through August 13, 2005 using AMSR-E 6.25 Tbs and 12.5 km sea ice products. Image courtesy of NASA/GSFC Visualization Studio.



Data Support: Data AccessWarehouse Inventory Search Tool (WIST)• Search/order from ECHO metadata database• https://wist.echo.nasa.gov/~wist/api/imswelcome

Data Pool• On-line access to entire archive• http://nsidc.org/data/data_pool/

Data Subscriptions• http://nsidc.org/daac/subscriptions.html

Preliminary (NRT) Data• L2 & L3 products • http://nsidc.org/data/amsre/prelim.html

http://nsidc.org/data/amsre/order_data.html



Data Support: Data Access

Easier to get to AMSR-E data on NSIDC web site – fewer clicks.



Data Support: Documentation & USOhttp://nsidc.org/data/amsre/data_summaries/index.htmlDocumentation

• Comprehensive product documentation• Algorithm version information

User Services• Provide support of data products, in-house developed tools, and

proprietary software

• Coordinate product announcements, outreach materials, and NSIDC presence at meetings

Published Research • Citations updated annually

Please email any additions or corrections to [email protected] or [email protected]

Added an ATBD section

http://nsidc.org/data/amsre/research.html

[email protected]



Archive MetricsTotal Archive: 18 TB

Total Version 2 Archive: 9 TB

18 June 2002 – 30 April 2010

Stats from EMS

Product GBs

AE_5DSNO 1.13

AE_DYOCN 34.11

AE_DYSNO 5.70

AE_L2A 4218.21

AE_LAND 57.49

AE_LAND3 171.73

AE_MOOCN 1.13

AE_MOSNO 0.19

AE_OCEAN 476.43

AE_RAIN 882.90

AE_RNGD 0.01

AE_SI12 164.88

AE_SI25 54.34

AE_SI6 123.05

AE_WKOCN 4.92

AMSREL1A 3032.05

Total 9228.28

Version 2 Archive Volume

0

1000

2000

3000

4000

5000

6000

2002 2003 2004 2005 2006 2007 2008 2009 2010

Vol

ume

(GB

)Version 1 Version 2 Total

Switch to Version 2



Distribution Metrics: Total18 June 2002 – 30 April 2010

Stats from EMS

Total Distribution:329.48 TBs

10.2 million files

AMSR-E sea surface temperatures in the Gulf of Mexico on 29 May 2009. Image courtesy of NASA/GSFC Visualization Studio.

Data Type Files Volume (GB)

AE_5DSNO 43371 76.80211

AE_DYOCN 51302 562.2645

AE_DYSNO 276492 483.1743

AE_L2A 4388018 243388.9

AE_LAND 1171058 713.5345

AE_LAND3 704225 33265.71

AE_MOOCN 1645 15.37441

AE_MOSNO 8908 14.10229

AE_OCEAN 848980 8991.692

AE_RAIN 1699439 13956.12

AE_RNGD 3139 0.212054

AE_SI12 322820 15143.6

AE_SI25 110634 1692.644

AE_SI6 128038 4803.416

AE_WKOCN 3488 29.15175

AMSREL1A 414139 14245.87

Total 10175696 337382.5



Distribution Metrics: Trends2004 - 2010 File Distribution

Stats from EMS

Growth

2004-2005113%

2005-2006116%

2006-2007-25%

2007-200826%

2008-2009100%

302184 332369

874314561729

704166

1337034

251970

127411

457444

307185

222507

537633

0

500000

1000000

1500000

2000000

2500000

3000000

2004 2005 2006 2007 2008 2009 2010

AMSREL1A

AE_WKOCN

AE_SI6

AE_SI25

AE_SI12

AE_RNGD

AE_RAIN

AE_OCEAN

AE_MOSNO

AE_MOOCN

AE_LAND3

AE_LAND

AE_L2A

AE_DYSNO

AE_DYOCN

AE_5DSNO

381,897

814,779

1,766,343

1,314,039

1,657,879

3,325,423

864,340



Distribution Metrics: Trends2004 - 2009 Volume Distribution

Stats from EMS

Growth

2004-200557%

2005-200697%

2006-2007-0.2%

2007-200861%

2008-200950%

11770.07 15177.22

37136.91 34356.60

55704.22

76351.78

12050.46

0.00

20000.00

40000.00

60000.00

80000.00

100000.00

2004 2005 2006 2007 2008 2009 2010

AMSREL1A

AE_WKOCN

AE_SI6

AE_SI25

AE_SI12

AE_RNGD

AE_RAIN

AE_OCEAN

AE_MOSNO

AE_MOOCN

AE_LAND3

AE_LAND

AE_L2A

AE_DYSNO

AE_DYOCN

AE_5DSNO

15,100

23,750

46,777 46,643

75,314

113,082

29,147



Distribution Metrics: Data Access Method

Stats from EMS

0.00%

10.00%

20.00%

30.00%

40.00%

50.00%

60.00%

70.00%

80.00%

90.00%

100.00%

2004 2005 2006 2007 2008 2009 2010

SUBSCRIPTION - SCP

SUBSCRIPTION - FTPPULL

SUBSCRIPTION - FTPPUSH

DLT

DATAPOOL

DVD

CDROM

FTPPUSH

FTPPULL

Data access based on distributed data volume.

Overall:

ECHO/EDG orders = 46.29 %Data Pool downloads = 48.93%

Subscriptions = 4.78%



Distribution Metrics: Users18 June 2002 – 30 April 2010

41 % - U.S. Users

59% - Foreign Users

Stats from EMS & USO TRAK Database

~2527 DistinctAMSR-E Users

User TypeDistinct Users

FOREIGN COMMERCIAL 41

FOREIGN GVMT 195

FOREIGN K-12 2

FOREIGN OTHER 590

FOREIGN UNIVERSITY 663

NASA 151

NOAA 42

US COMMERCIAL 52

US FEDERAL GVMT 52

US GENERAL PUBLIC 10

US GOVERNMENT 18

US K-12 5

US OTHER 86

US STATE/LOCAL GVMT 12

US UNIVERSITY 555

ECS OTHER 49

WDC 2

OTHER 2

Data TypeDistinct Users

AE_5DSNO 442

AE_DYOCN 220

AE_DYSNO 519

AE_L2A 2115

AE_LAND 604

AE_LAND3 1269

AE_MOOCN 92

AE_MOSNO 235

AE_OCEAN 450

AE_RAIN 471

AE_RNGD 163

AE_SI12 821

AE_SI25 341

AE_SI6 320

AE_WKOCN 82

AMSREL1A 280



Distribution Metrics: Users

Stats from USO TRAK Database

2003 – 2010 Total Distinct Users per Year

108

298

675

609

282

471

517

597

0

100

200

300

400

500

600

700

800

2003 2004 2005 2006 2007 2008 2009 2010

Dis

tin

ct

Us

ers



Distribution Metrics: Preliminary Data

Preliminary (NRT) L2 & L3 Distribution through 30 April 2010

Users have doubled since last June. AE_L2A increased by 521 users.

Statistics from our University FTP logs

NRT 12.5 km Sea Ice concentration data in Google Earth for 20 June 2009.

ProductDistinct Users Files

Volume (MB)

AE_DyOcn 29 217 2306.758

AE_DySno 68 14494 29712.48

AE_L2A 786 8653980 14567323

AE_Land 97 22746 15240.27

AE_Land3 184 5646 266266.5

AE_Ocean 63 31035 377279.7

AE_Rain 36 5454 55254.48

AE_SI12 69 12585 388000.2

AE_SI25 51 2106 42517.4

AE_SI6 63 1269 54700.05

Total 1194 8750323 15799811



Accomplishments & PlansAccomplishments • NRT L3 soil moisture in Google Earth

30/60/90 day animations http://nsidc.org/data/virtual_globes/index.html

• Data Stories Katrina - SST http://nsidc.org/data/amsre/image_gallery/index.html

• QA, PH & Browse files Now searchable and orderable from WIST and DataPool

• AMSR-E related data sets Co-Registered AMSR-E, QuikSCAT, and WMO Data (Marco Tedesco) Daily Global Land Surface Parameters Derived from AMSR-E (John Kimball) Canadian Meteorological Centre (CMC) Daily Snow Depth Analysis Data (Ross

Brown)



Accomplishments & PlansL3 Soil Moisture for 25 May 2010



Plans• Sea Ice reprocessing for ice concentration difference

issue: documentation updates, user notice

• Sea ice drift product: documentation, ingest testing, public release

• 2007 sea ice minimum data story

• Hopefully integrate LANCE with preliminary data stream

• Integrate ECS data discovery with NSIDC’s Searchlight interface

Accomplishments & Plans



AMSR-E Validation: Status

• Have published all validation data held at NSIDC! Used new low level of effort process. Published 50 data sets in 2009.

• We welcome any additional validation data that PIs have Northern Manitoba Regional Snow

Surveys for AMSR-E Field Validation (Chris Derksen)

GAPS09 & GAPS10 (Marco Tedesco)?

CryosphereAMSRIce03AMSRIce06

CLPxMeltpond 2000 Puenta Arenas

East Antarctic Sea IceWest Antarctic Sea Ice

Sea of Okhostk

RainfallBALTEX

Eureka, CAIowa City, IAWakasa Bay

Soil MoistureSMEX02 SMEX03

SMEX04-NAMESMEX05



AMSR-E Validation: Metrics

0

2

4

6

8

10

12

14

16

18

20

2003-2Q

2003-4Q

2004-1Q

2004-2Q

2004-3Q

2004-4Q

2005-1Q

2005-3Q

2005-4Q

2006-1Q

2006-2Q

2006-3Q

2006-4Q

2007-1Q

2007-4Q

2008-1Q

2008-2Q

2008-3Q

2008-4Q

2009-1Q

2009-2Q

2009-3Q

2009-4Q

2010-1Q

2010-2Q

Dat

a se

ts p

ublis

hed

Data sets published by quarter.




5.1

476

94

0

50

100

150

200

250

300

350

400

450

500

Rainfall Cryosphere Soil Moisture

Archive volume (GB) on disk as of 26 May 2010.Total Archive Volume = 575.1 GB



AMSR-E Validation: MetricsDistinct users from FTP site through 30 April 2010.

Total Distinct Users = 3,714

1,444

1,940

330

0

500

1000

1500

2000

2500





AMSR-E Validation: MetricsFiles download from FTP site through 30 April 2010.

Total Files Distributed = 627,596


204,839

402,613

20,144

0

50000

100000

150000

200000

250000

300000

350000

400000

450000





Volume (GB) downloaded from FTP site through 30 April 2010.Total Volume Distributed = 1,647.47 GB


105.80

629.63

912.04

0.00

100.00

200.00

300.00

400.00

500.00

600.00

700.00

800.00

900.00

1000.00




AMSR-E Team at NSIDC

Thanks to the AMSR-E Teams at NSIDC!

AMSR-E

Chris Bond – Operations

Karla LeFevre – Technical Writer

Lisa Booker – User Services

Jeff Smith – Programmer

Siri Jodha Khalsa – ECS Science Coordinator

Walt Meier – Scientist

Doug Fowler – Test Engineer

Cathy Fowler – Database Administrator

AMSR-E Validation

Chris Bond – Operations

Karla LaFevre – Technical Writer

Dan Webster – Technical Writer

Lisa Booker – User Services

Jeff Smith – Programmer



Backup Slides



AMSR-E Activities at NSIDC

• Redesigned AMSR-E Web site http://nsidc.org/data/amsre/index.html

• Google Earth 30/60/90 day NRT 12.5 km sea ice concentration and extent animations http://nsidc.org/data/virtual_globes/index.html

• NRT12.5 km sea ice images used by Science on a Sphere http://nsidc.org/data/virtual_globes/index.html

• QA files should be available to users in January 2010

AMSR-E and AMSR-E Validation Archive & Distribution Status Amanda Leon, NSIDC AMSR-E Lead Joint...

Documents

Transcript of AMSR-E and AMSR-E Validation Archive & Distribution Status Amanda Leon, NSIDC AMSR-E Lead Joint...