ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

17
ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany

Transcript of ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

Page 1: ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

ODV for Data Products

Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany

Page 2: ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

1. Providing data QC as well as outlier flagging and filtering.

2. Providing data file aggregation and production of large integrated datasets.

3. Providing production of time-series plots, maps, sections and animated 3D plots.

Page 3: ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

Visual Quality Control

• easy spotting and identification of outliers or offsets

• painless editing of data value and quality flag

• logging of all value or flag modifications

Page 4: ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

Automatic Range Checks

• full sample set •sample sub-set

Page 5: ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

QF Mass Assignments

•all samples of many or all stations (initialization)

•all samples in a window

•all or some selected samples of current station

•current sample only

Page 6: ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

Using Quality Flag Filters

Before filtering After filtering

Page 7: ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

File Aggregation

Multi-file import (analysis and aggregation phases).

Page 8: ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

•Use //SDN_parameter_mapping section

•Determine type of data (profile, time-series, trajectory).

//SDN_parameter_mapping//<subject>SDN:LOCAL:PRESSURE</subject><object>SDN:P011::PRESPS01</object><units>SDN:P061::UPDB</units>//<subject>SDN:LOCAL:T90</subject><object>SDN:P011::TEMPS901</object><units>SDN:P061::UPAA</units>//<subject>SDN:LOCAL:Salinity</subject><object>SDN:P011::PSALPR02</object><units>SDN:P061::UUUU</units>//<subject>SDN:LOCAL:fluorescence</subject><object>SDN:P011::CPHLPM01</object><units>SDN:P061::UGPL</units>//<subject>SDN:LOCAL:Trans_red_25cm</subject><object>SDN:P011::POPTDR01</object><units>SDN:P061::UPCT</units>//<subject>SDN:LOCAL:POTM</subject><object>SDN:P011::POTMCV01</object><units>SDN:P061::UPAA</units>//<subject>SDN:LOCAL:Density</subject><object>SDN:P011::SIGTPR01</object><units>SDN:P061::UKMC</units>

File Analysis

Page 9: ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

• ODV collections are created for every data type found.

• Data of a given file are imported into the corresponding ODV collection.

• Process is fully automatic.

• Results in one or more ODV collections containing all data of a given type.

Aggregation

Page 10: ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

////SDN_parameter_mapping//<subject>SDN:LOCAL:DEPTH</subject><object>SDN:P011::ADEPZZ01</object><units>SDN:P061::ULAA</units>//<subject>SDN:LOCAL:Temperature</subject><object>SDN:P011::TEMPS901</object><units>SDN:P061::UPAA</units>//<subject>SDN:LOCAL:Salinity</subject><object>SDN:P011::ODSDM021</object><units>SDN:P061::UUUU</units>//<subject>SDN:LOCAL:Oxygen</subject><object>SDN:P011::DOXYCZ01</object><units>SDN:P061::KGUM</units>//

////SDN_parameter_mapping//<subject>SDN:LOCAL:DEPH</subject><object>SDN:P011::ADEPZZ01</object><units>SDN:P061::ULAA</units>//<subject>SDN:LOCAL:PRES</subject><object>SDN:P011::PRESPR01</object><units>SDN:P061::UPDB</units>//<subject>SDN:LOCAL:TEMP</subject><object>SDN:P011::TEMPPR01</object><units>SDN:P061::UPAA</units>//<subject>SDN:LOCAL:PSAL</subject><object>SDN:P011::PSLTZZ01</object><units>SDN:P061::UUUU</units>//<subject>SDN:LOCAL:DOX1</subject><object>SDN:P011::DOXYZZXX</object><units>SDN:P061::UMLL</units>//<subject>SDN:LOCAL:DOXY</subject><object>SDN:P011::DOXYZZXX</object><units>SDN:P061::UPOX</units>//<subject>SDN:LOCAL:TUR4</subject><object>SDN:P011::TURBXXXX</object><units>SDN:P061::USTU</units>//<subject>SDN:LOCAL:NTRA</subject><object>SDN:P011::NTRAZZXX</object><units>SDN:P061::UPOX</units>//<subject>SDN:LOCAL:SLCA</subject><object>SDN:P011::SLCAZZXX</object><units>SDN:P061::UPOX</units>//<subject>SDN:LOCAL:PHPH</subject><object>SDN:P011::PHXXZZXX</object><units>SDN:P061::UUPH</units>//<subject>SDN:LOCAL:CORG</subject><object>SDN:P011::CORGZZZX</object><units>SDN:P061::UPOX</units>//<subject>SDN:LOCAL:POCP</subject><object>SDN:P011::MDMAP010</object><units>SDN:P061::UMMC</units>//<subject>SDN:LOCAL:TSMP</subject><object>SDN:P011::TSEDZZZZ</object><units>SDN:P061::UMGL</units>//

Aggregated Variables

Page 11: ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

When aggregating SDN files different BODC parameter/unit codes are maintained as separate variables (e.g., 3 oxygen variables).

User may combine separate variables by means of aggregated derived variables (e.g., 1 oxygen variable for scientific usage).

Page 12: ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

Aggregated derived variable

Oxygen [ml/l] =1 * (DOX1 DISSOLVED OXYGEN ml/l) + 0

0.02297 * (DOX2 DISSOLVED OXYGEN micromole/kg) + 0 0.02241 * (DOXY DISSOLVED OXYGEN millimole/m3) + 0

Merging Principles:• Merging Type (exclusive use of first available value, average over

all available values)• Order of input variables matters (in case of eclusive merge)• Standard or user-specified conversion formulas • Quality flag inheritence

Page 13: ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

CDI catalogue as of July 2012

Page 14: ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

Time-series Plots

Page 15: ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

Time-series Plots

Page 16: ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

Distribution Maps

Sections

Page 17: ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

3D Animations