SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf ·...

40
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01 TITLE: Ozone_cci System Verification Report SVR Reference: Ozone_cci_DLR_SVR_01 Date of issue: 30-10-2015 Version: 01.01 Phase 2, Task 5 Deliverable: D3.2 WP Manager: M. Wolfmüller WP Manager Organization: DLR-EOC Other partners: EOST: BIRA, CHALM, DLR-, FMI, KIT, KNMI, RAL, UBR, ULB, UofT, UofS VALT: CRG:

Transcript of SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf ·...

Page 1: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

TITLE:

Ozone_cci

System Verification Report SVR

Reference: Ozone_cci_DLR_SVR_01

Date of issue: 30-10-2015

Version: 01.01

Phase 2, Task 5

Deliverable: D3.2 WP Manager: M. Wolfmüller WP Manager Organization: DLR-EOC Other partners: EOST: BIRA, CHALM, DLR-, FMI, KIT, KNMI, RAL, UBR, ULB, UofT, UofS VALT: CRG:

Page 2: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

DOCUMENT PROPERTIES

Title SVR

Reference Ozone_cci_DLR_SVR_01

Issue 01

Revision 01

Status Released

Date of issue 30-10-2015

Document type System Verification Report

FUNCTION NAME DATE SIGNATURE

LEAD AUTHOR

WP Manager M.Wolfmüller 30-10-2015 Original in hands of PM

CONTRIBUTING AUTHORS

C. Lerot (TC_L2)

D. Loyola (TC/TTOC_L3)

M. Coldewey-Egbers (TC L3)

K.-P. Heue (TTOC_L3)

G. Miles (NP_L2)

R. van der A (NP_L3/L4)

N. Rahpoe (LP_L2_SCIA)

V.Sofieva (LP_L2_GOMOS)

A. Laeng (LP_L2_MIPAS)

C. Roth (LP_L2_OSIRIS)

J. Urban (LP_L2_SMR)

P.-F. Coheur (NP_L2_IASI)

R. Astoreca (NP_L2_IASI)

R. Hargreaves (LP_L2_ACE)

V.Sofieva (LP_L3_MRG)

M. Weber (LP)

M. Wolfmüller

Page 3: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

REVIEWED BY

ISSUED BY

DOCUMENT CHANGE RECORD

Issue Revision Date Modified items Observations

00 01 20/06/2015 - Creation of document

00 0 25/09/2015 - Contributions inserted from C.Lerot, G.Miles, R. van der A, V.Sofieva, R.Astoreca, N.Rahpoe, M.Coldewey-Egbers and K.-P.Heue

00 05 07/10/2015 First version for internal review

01 00 14/10/2015 - First realised version with the inputs from the EOSTs

01 01 30/10/2015 Minor changes in chapters: 1.2.2, 5.3, 7.4, 8.4 regarding inputs from A.Laeng and N. Rahpoe

Page 4: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

Executive Summary

The System Verification Report (SVR, deliverable D3.2) gives a complete report of all activities executed and the results achieved form a technical assessment of the end-to-end Ozone_cci system with all its subcomponents to verify that the Ozone_cci system is compliant to the requirements (PSD) and technical specifications (IODD, SSD) and that it fulfils its intended purpose and replicates the results of the selected algorithms selected.

The new products created in this context are Essential Climate Variables, which are used for an assessment of climate forcing, health impact and other environmental issues.

Page 5: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

SVR – System Verification Report

This document describes the verification activities for the CCI O3 system phase 2.

TABLE OF CONTENTS

1  Introduction ................................................................................................................... 9 1.1  Scope and Applicability ............................................................................................... 9 1.2  Definitions, acronyms and abbreviations ..................................................................... 9 

1.2.1  Terms and Definitions ....................................................................................................... 9 1.2.2  Abbreviations .................................................................................................................. 11 

1.3  Applicable Documents .............................................................................................. 12 1.4  Reference Documents ............................................................................................... 12 1.5  Document Overview ................................................................................................. 12 

2  General Approach for Ozone_cci System Verification .............................................. 13 2.1  General Verification Strategy .................................................................................... 13 2.2  Technical Verification Strategy .................................................................................. 14 2.3  Test Environment ...................................................................................................... 14 2.4  Naming Conventions ................................................................................................ 14 2.5  Responsibilities ......................................................................................................... 15 

3  Overview about the Verification of the System ....................................................... 17 3.1  Objectives and Scope of the Ozone_cci System ......................................................... 17 

3.1.1  Workflow, elements and components of the TC processing system ................................. 17 3.1.2  Workflow, elements and components of the NP processing system ................................. 18 3.1.3  Workflow, elements and components of the LP processing system .................................. 18 

4  Test Assemblies ........................................................................................................... 21 4.1  Test Assemblies of the TC processing system............................................................. 21 4.2  Test Assemblies of the NP processing system............................................................. 22 

5  Summary Description of Test Cases and Test Data ................................................... 25 5.1  Test Cases and Test Data for TC ................................................................................ 25 5.2  Test Cases and Test Data for NP ................................................................................ 26 5.3  Test Cases and Test Data for LP ................................................................................ 27 

6  Test Results .................................................................................................................. 31 6.1  Overview about all Test Results TC ............................................................................ 31 6.2  Overview about all Test Results TTOC ....................................................................... 32 6.3  Overview about all Test Results NP ............................................................................ 32 6.4  Overview about all Test Results LP ............................................................................. 33 

7  Description of acceptable and stated Limitations in the Ozone_cci System ........... 37 7.1  Limitations in the TC Processing System .................................................................... 37 7.2  Limitations in the TTOC Processing System ................................................................ 37 7.3  Limitations in the NP Processing System .................................................................... 37 7.4  Limitations in the LP Processing System ..................................................................... 37 

Page 6: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

8  Verification Summary ................................................................................................. 39 8.1  Verification Summary for TC ..................................................................................... 39 8.3  Verification Summary for NP ..................................................................................... 39 8.4  Verification Summary for LP ...................................................................................... 39 

Page 7: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

Figures

Figure 2-1 System Verification Approach ...................................................................................... 14 Figure 3-1 Workflows for the generation of the TC ECV products .............................................. 17 Figure 3-2 Workflows for the generation of the NP ECV products .............................................. 18 Figure 3-3 Workflows for the generation of the LP ECV products .............................................. 19 Figure 3-4 Workflows for the generation of the UTLS ECV products .......................................... 20 Figure 3-5 Workflows for the generation of the MLT ECV products ........................................... 20 Figure 8-1 Comparison Ozone profiles for SABER and HALOE .................................................... 40 

Page 8: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

Tables

Table 2-1 Test Responsibilities ........................................................................................................ 16 Table 4-1 Test Assemblies for Total and Tropospheric Column ................................................... 22 Table 4-2 Test Assemblies for Nadir Profile ................................................................................... 22 Table 4-3 Test Assemblies for Limb Profile .................................................................................... 24 Table 5-1 Test Data used by the Total Column Tests .................................................................... 25 Table 5-2 Summary Description of all Test Cases for Total Column ............................................ 26 Table 5-3 Summary Description of all Test Cases for TTOC .......................................................... 26 Table 5-4 Test Data used by the Nadir Profile Tests ..................................................................... 26 Table 5-5 Summary Description of all Test Cases for Nadir Profile .............................................. 27 Table 5-6 Test Data used by the Limb Profile Tests ...................................................................... 28 Table 5-7 Summary Description of all Test Cases for Limb Profile ............................................... 30 Table 6-1 Summary of all performed Test Cases for Total Column ............................................. 32 Table 6-2 Summary of all performed Test Cases for TTOC ........................................................... 32 Table 6-3 Summary of all performed Test Cases for Nadir Profile ............................................... 33 Table 6-4 Summary of all performed Test Cases for Limb Profile ................................................ 36 

Page 9: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

1 Introduction

1.1 Scope and Applicability

This document defines the overall activities to be performed for the integration and technical verification of the Ozone_cci system for CCI phase 2. It defines various strategies and test preparations which are required to conduct the integration and technical verification activities and gives a list of assemblies and test cases to be conducted by the subsystem team.

This system verification report contains the test plans and the test results of the processing systems and additional assemblies covering different levels of integration.

The described verification processes of the ozone_cci system shall verify the generation processes of the following ozone ECV parameters generated by the ozone_cci system:

Total Ozone from UV nadir instruments,

Tropical Tropospheric Ozone Column from UV nadir instruments,

Low vertical resolution ozone profiles from nadir sensors and

Stratospheric and upper tropospheric ozone profiles from limb and occultation types of sensors

The Ozone ECV products shall be generated using the following data sets:

The Ozone ECV products shall be generated using the following data sets:

Input data from GOME, SCIAMACHY, GOME-2A, GOME-2B, OMI and OMPS for total ozone ([CR1], in [AD1] chapter 1.2).

Input data from GOME, GOME-2A, and GOME-2B for tropical tropospheric ozone column ([CR1], in [AD1] chapter 1.2).

Input data from GOME, SCIAMACHY, GOME-2, OMI and IASI for Ozone nadir profiles ([CR1], in [AD1] chapter 1.2)

Input data from MIPAS, GOMOS, SCIAMACHY, OSIRIS, SMR, ACE, SAGE II and HALOE for the generation of ozone limb profiles ([CR1], in [AD1] chapter 1.2) and optionally TPM.

This document is applicable for the components of the TC, NP and LP processing systems. It describes the strategies used to verify the compatibility of the implemented components of these systems.

The integration of the Processors shall be done without the need of other subsystems except for the Processor-Subsystem itself.

1.2 Definitions, acronyms and abbreviations

Terms, definitions and abbreviations are collected within this document.

1.2.1 Terms and Definitions

Term Explanation of the term

Ozone_cci project for the development of the CCI ECV Ozone

Page 10: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

Processor Software algorithm running in the Ozone_cci system to produce intermediate or ECV products according the Product Specification Document ([AD5])

Page 11: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

1.2.2 Abbreviations

abbreviation Explanation of the abbreviation (tbc)

API Application Programming Interface

CCI Climate Change Initiative

CRG Climate Research Group

CMUG CCI Climate Modelling User Group

DARD Data Access Requirements Document

DCA Diurnal Correction Adjusted

ECMWF European Centre for Medium-Range Weather Forecasts

ECV Essential Climate Variable

EOST-1 EO Science Team for Total Column and Nadir Prodfile within the Ozone_cci project

EOST-2 EO Science Team for Limb Profile within the Ozone_cci project

ESA European Space Agency

EUMETSAT European Organisation for the Exploitation of Meteorological Satellites

GMES Global Monitoring for Environment and Security is the European Programme for the establishment of a European capacity for Earth Observation

HMI Human Machine Interface

KNMI Royal Netherlands Meteorological Institute

LP Limb Profile

NASA National Aeronautics and Space Administration

NP Nadir Profile

O3 Ozone

O3TC Ozone Total Column

TTOC Tropical Tropospheric Ozone Column

O3NP Ozone NadirProfile

O3LP Ozone Limb Profile

OMI Ozone Monitoring Instrument (aboard EOS-Aura)

OS Operating System

PSD Product Specification Document

SET System Engineering Team within the Ozone_cci project

UPAS Processor for Atmospheric Spectrometers

tbc to be collected

tbd to be defined (shall be defined later if the information is available)

TC Total Column

Page 12: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

1.3 Applicable Documents

[AD1] Ozone_cci Phase-II Technical Baseline, ESA RFQ 3-13904/13/I-NB , 26/09/2013

[AD2] ESA Climate Change Initiative Phase 1: Scientific User Consultation and Detailed Specification, AO/1-6207/09/I-LG, 11/11/2009

[AD3] CCI System Requirements v1, CCI-PRGM-EOPS-TN-12-0031, 13 June 2013. Available on line at: http://46.137.76.174/?q=webfm_send/72.

[AD4] Ozone_cci System Specification Document (SSD Phase 2)

[AD5] Product Specification Document (PSD Phase 2)

[AD6] Data Access Requirement Document (DARD Phase 2)

1.4 Reference Documents

[RD1] CCI guidelines from the colocation meeting 1, Issue 1.0, EOP-DTEX-EOPS-SW-10-0002, 05/11/2010

[RD2] User Requirements Document (URD Phase 2)

1.5 Document Overview

Chapter 2 describes the verification approach for the system.

Chapter 3 gives a overview about the verification of the Ozone_cci sytsem and the tested system components and workflows.

Chapter 4 describes all test assembies used for the verification of the Total Column, Nadir, and Limb Profile system components.

Chapter 5 describes the test cases for the verification of the Total Column, Nadir, and Limb Profile system components.

Chapter 6 summarizes the verification results of the Total Column, Nadir, and Limb Profile system components.

Chapter 7 contains a summary of possible limitations of the Ozone_cci system.

Page 13: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

2 General Approach for Ozone_cci System Verification

This chapter describes the approach taken on system and sytsem component level to integrate the ozone_cci system components and to verify them. The test assemblies and test cases are then listed and described in chapters 5 and 6.

2.1 General Verification Strategy

Figure 2-1 shows the general strategy for the verification of the whole Ozone_cci sytsem which is responsible to ensure the production of the Ozone_cci ECVs TC, NP and LP. The Ozone_cci system consists of the following specific processing systems:

Processing System BIRA

Processing System CHALM

Processing System DLR

Processing System FMI

Processing System KIT

Processing System KNMI

Processing System RAL

Processing System UBR

Processing System ULB

Processing System UofT

Processing System UofS

Each specific processing system consists of several components. Each component implements several functions and features which are needed to handle the complete production process of the ECVs. The components implement interfaces by which it is possible to exchange interface items (e.g. input products, auxiliary products).

The system components must be under version control and are tagged with configuration items. For the verification of the system suitable Test Assemblies are defined to test simple up to more and more integrated workflows. An Assembly is instanced by Assembly Versions. Each Assembly version holds the information about used versions of the involved system components.

The test coverage of an Assembly/Assembly Version is defined by the different Test Cases which are defined for an Assembly Version. The results of the test runs of an Assembly Version are documented in this document.

The verification that the system is conform to the System Requirements is reached if sufficient tests are performed successfully which cover all functions of the system.

The Test Assemblies are described in chapter 4 and the Test Cases are described with the help of tables (see chapter 5.

Page 14: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

Figure 2-1 System Verification Approach

2.2 Technical Verification Strategy

The system is verified by the successful execution of all defined Test Cases of all defined Test Assemblies.

Regression tests are planned for the integration of the system components into the Ozone_cci system. These tests will include the whole chain of data driven.

Test runs shall be done on the basis of predefined Assembly Versions which document the following Information:

The used configuration items (versions of the used components, environment, test data etc)

Administrative test Information (Test Date, Test Persons)

One test report for the execution of the test cases of an Assembly Version reporting the test execution and the test results.

2.3 Test Environment

Each science team has its own test environment to install and test the specific processing systems.

2.4 Naming Conventions

The following naming conventions are defined for the Test Assemblies, Test Assembly Versions, Test Cases and Test Reports.

These naming conventions are not obligatory. If the teams use already other naming conventions they are free to use their own.

Page 15: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

Test Assemblies: AS-<pp>-<aa> pp = TC or NP or LP, aa = 2 digits, e.g. AS-NP-01 Test Case: CS-<pp>->aa>-<tt> pp = TC or NP or LP, aa = the Assembly number, tt = 2 Digits for the Test Case number, e.g. TC-NP-01-01 (first Test Case of the first Nadir Profile Test Assembly)

2.5 Responsibilities

Each science team is responsible for testing its specific processing system as indicated in the table below.

Team Product Responsible institute

EOST-1 TC L2 BIRA

TC L3 DLR

TTOC_L3 DLR

NP L2 (GOME, SCIA, GOME2, OMI)

RAL

NP L2 (IASI) ULB

NP L3/L4 KNMI

EOST-2 LP L3 SCIA FMI

LP L3 GOMOS FMI

LP L3 MIPAS FMI

LP L3 OSIRIS FMI

LP L3 SMR FMI

LP L3 ACE FMI

LP L3 Merge FMI

LNTOC_L3 UBR

LP_L2_SCIA_HARMOZ UBR

LP_L2_SAGEII_HARMOZ UBR

LP_L2_HALOE_HARMOZ UBR

LP_L2_MLS _HARMOZ UBR

LP_L2_GOMOS_HARMOZ FMI

LP_L2_MIPAS_HARMOZ KIT

LP_L2_OSIRIS_HARMOZ UofS

LP_L2_SMR_HARMOZ CHALM

Page 16: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

LP_L2_ACE_HARMOZ UofT

UTLS_L3 FMI

UTLS_L2_SCIA UBR

UTLS_L2_MIPAS KIT

UTLS_L2_GOMOS FMI

UTLS_L2_OSIRIS UofS

UTLS_L2_ACE UofT

MLT_L3 KIT

MLT_L2_MIPAS_DN_DCA* KIT/IAA

MLT_L2_GOMOS_DN_DCA* KIT/IAA

MLT_L2_ACE_DN_DCA* UofT

MLT_L2_SMR_DN_DCA* CHALM

MLT_L2_MIPAS_SM# KIT

Table 2-1 Test Responsibilities

Page 17: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

3 Overview about the Verification of the System

The overview includes

a description of the objectives and scope of the Ozone_cci system

a list of all elements and components of the system that have been tested including a description of the platform, the network, and the interfaces with other systems

a description of all test activities carried out and of the criteria on how the system was tested to ensure that the requirements are fulfilled and that the system performs as specified

a summary description of all test cases, test procedures, and test data used

a record of all test results

a description of all acceptable and stated limitations in the ozone_cci system and the steps taken to workaround anomalous, inappropriate, or undesired operating conditions.

3.1 Objectives and Scope of the Ozone_cci System

3.1.1 Workflow, elements and components of the TC processing system

The Ozone_cci system can be seen as the collective of the processing systems distributed over several organisations. These processing systems are used for the generation of the ECV output products for TC, NP and LP products.

Figure 3-1 gives an overview about the main workflows implemented by the TC processing systems in order to generate all TC ECV output products.

Figure 3-1 Workflows for the generation of the TC ECV products

The following list contains all elements and components of the TC processing systems that have been tested. The TC processing system consists of the following components:

TC L2 Processor

TC L3 Processor

Page 18: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

TC L3 Merge

TC&CL L2 Processor

TTOC L3 Processor

TTOC L3 Merge

3.1.2 Workflow, elements and components of the NP processing system

Figure 3-2 gives an overview about the main workflows implemented by the NP processing systems in order to generate all NP ECV output products.

Figure 3-2 Workflows for the generation of the NP ECV products

The following list contains all elements and components of the NP processing systems that have been tested. The NP processing system consists of the following components:

L2 Processor: ozone profile retrieval algorithm of RAL L2 Processor ozone profile retrieval algorithm of ULB L3 ECV Merge: merge and gridding algorithm of KNMI L4 ECV Merge: assimilation algorithm of KNMI

3.1.3 Workflow, elements and components of the LP processing system

Figure 3-3 gives an overview about the main workflows implemented by the LP processing systems in order to generate all LP ECV output products.

Page 19: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

Figure 3-3 Workflows for the generation of the LP ECV products

The following list contains all elements and components of the LP processing systems that have been tested. The LP processing system consists of the following components:

The LP processing system consists of the following components:

LP L2 HARMOZ

LP L3 MZM: Monthly mean Zonal Mean

LP L3 MZM Merged: Merged Monthly mean Zonal Mean

LP L3 SMM: Merged Semi-monthly Mean

LP L3 SMM Merged: Merged Semi-monthly Mean

LP L3 FR: Fine Resolution

Figure 3-4 gives an overview about the main workflows implemented by the UTLS processing systems in order to generate all Limb ECV output products.

Page 20: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

Figure 3-4 Workflows for the generation of the UTLS ECV products

The following list contains all elements and components of the UTLS processing systems that have been tested. The UTLS processing system consists of the following components:

UTLS L2

UTLS L3

UTLS L3 Merged

Figure 3-5 gives an overview about the main workflows implemented by the UTLS processing systems in order to generate all Limb ECV output products.

Figure 3-5 Workflows for the generation of the MLT ECV products

The following list contains all elements and components of the MLT processing systems that have been tested. The MLT processing system consists of the following components:

The MLT processing system consists of the following components:

MLT L2

MLT L3

MLT L3 Merged

Page 21: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

4 Test Assemblies

The whole Ozone_cci system will be verified by the verification of the single processing systems. Each processing system has defined its own verification strategies, tests and verification reports. They are verified and tested according to these specific descriptions.

The following section lists and describes all Test Assemblies grouped per generated product.

4.1 Test Assemblies of the TC processing system

Table 4-1 gives an overview about all defined Test Assemblies used for the TC tests.

Test Assembly Test Assembly Description AS-TC-01 This Test Assembly is defined to verify the L2 processing of the TC

processing system. It consists of the following components: L1 Ingestion and soft correction L2 Processing of GOME data L2 Processing of SCIAMACHY data L2 Processing of GOME-2 data L2 Processing of OMI data L2 Processing of OMPS data L2 Archive and Dissemination

AS-TC-02 This Test Assembly is defined to verify the L3 processing of the TC processing system. It consists of the following components:

L2 Ingestion L3 Processing of GOME data L3 Processing of SCIAMACHY data L3 Processing of GOME-2 data L3 Processing of OMI data L3 Processing of OMPS data L3 Archive

AS-TC-03 This Test Assembly is defined to verify the L3 merging of the TC processing system. It consists of the following components:

L3 Ingestion L3 Merging of GOME, SCIAMACHY, GOME-2, OMI and OMPS

data L3 Archive and Dissemination

AS-TC-04 This Test Assembly is defined to verify the L2 processing of the TTOC processing system. It consists of the following components:

L1 Ingestion and soft correction L2 TT&CL Processing of GOME data L2 TT&CL Processing of GOME-2 data L2 Archive and Dissemination

AS-TC-05 This Test Assembly is defined to verify the L3 processing of the TTOC processing system. It consists of the following components:

Page 22: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

L2 TC&CL Ingestion L3 TTOC Processing of GOME data L3 TTOC Processing of GOME-2 data L3 TTOC Archive

AS-TC-06 This Test Assembly is defined to verify the L3 merging of the TTOC processing system. It consists of the following components:

L3 TTOC Ingestion L3 TTOC Merging of GOME and GOME-2 data L3 TTOC Archive and Dissemination

Table 4-1 Test Assemblies for Total and Tropospheric Column

4.2 Test Assemblies of the NP processing system

Table 4-2 gives an overview about all defined Test Assemblies used for the NP tests.

Test Assembly Test Assembly Description AS-NP-01 This Test Assembly is defined to verify the L2 processing of the NP

processing system. It consists of the following components: L1 Ingestion L2 Processing of GOME data L2 Processing of GOME-2 data L2 processing of SCIAMACHY data L2 processing of OMI data L2 processing of IASI data L2 Archive and Distribution

AS-NP-02 This Test Assembly is defined to verify the L3 processing of the NP processing system. It consists of the following components:

L2 Ingestion Processing of L2 data to a merged L3 product L3 Archive and Dissemination

AS-NP-03 This Test Assembly is defined to verify the L4 processing of the NP processing system. It consists of the following components:

L2 Ingestion Processing of L2 data to a merged L4 product using data

assimilation L4 Archive and Dissemination

Table 4-2 Test Assemblies for Nadir Profile

Test Assemblies of the LP processing system

AS-LP-07 This Test Assembly is defined to verify the L3 UTLS processing of the LP processing system. It consists of the following components:

L2 HARMOZ Ingestion L3 UTLS processing L3 UTLS Archive and Dissemination

Page 23: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

AS-LP-08 This Test Assembly is defined to verify the L3 UTLS Merge processing of the LP processing system. It consists of the following components:

L2 HARMOZ Ingestion L3 UTLS Merge processing L3 UTLS Archive and Dissemination

Table 4-3 gives an overview about all defined Test Assemblies used for the LP tests.

Test Assembly Test Assembly Description AS-LP-01 This Test Assembly is defined to verify the L2 processing of the LP

processing system and the UTLS L2 Processing. It consists of the following components:

L2 Ingestion L2 HARMOZ processing L2 Archive and Dissemination

AS-LP-02 This Test Assembly is defined to verify the L3 MZM processing of the LP processing system. It consists of the following components:

L2 HARMOZ Ingestion L3 MZM processing L3 MZM Archive and Dissemination

AS-LP-03 This Test Assembly is defined to verify the L3 MZM Merge processing of the LP processing system. It consists of the following components:

L3 MZM Ingestion L3 MZM Merge processing L3 MZM Merge Archive and Dissemination

AS-LP-04 This Test Assembly is defined to verify the L3 SMM processing of the LP processing system. It consists of the following components:

L2 HARMOZ Ingestion L3 SMM processing L3 SMM Archive and Dissemination

AS-LP-05 This Test Assembly is defined to verify the L3 SMM Merge processing of the LP processing system. It consists of the following components:

L3 SMM Ingestion L3 SMM Merge processing L3 SMM Archive and Dissemination

AS-LP-06 This Test Assembly is defined to verify the L3 FR processing of the LP processing system. It consists of the following components:

L2 HARMOZ Ingestion L3 FR processing L3 FR Archive and Dissemination

AS-LP-07 This Test Assembly is defined to verify the L3 UTLS processing of the LP processing system. It consists of the following components:

L2 HARMOZ Ingestion L3 UTLS processing L3 UTLS Archive and Dissemination

Page 24: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

AS-LP-08 This Test Assembly is defined to verify the L3 UTLS Merge processing of the LP processing system. It consists of the following components:

L2 HARMOZ Ingestion L3 UTLS Merge processing L3 UTLS Archive and Dissemination

Table 4-3 Test Assemblies for Limb Profile

Page 25: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

5 Summary Description of Test Cases and Test Data

5.1 Test Cases and Test Data for TC

Table 5-1 gives an overview about all used test data for the TC tests.

Test Data Test Data Description GOME L1 Orbit for January/1999, version 4_00

One month of GOME L1 data from orbit 19338 to 19781

SCIAMACHY L1 Orbit for January/2006, version 7_04

One month of SCIAMACHY L1 data from orbit 20068 to 20511

GOME-2 L1 Orbit for January/2009, version R/5_12

One month of GOME-2 L1 data from orbit 11428 to 11867

OMI L1 One month of OMI L1 data from orbit 13962 to 14406 OMPS L1 Not yet achieved Auxiliary Data FRESCOv6 and O2-O2 cloud parameters

Table 5-1 Test Data used by the Total Column Tests

Table 5-2 gives an overview about all tests performed. Column one identifies the Test Case performed, column two gives a short description of the test case and column 3 is a reference to the input data used in the test case.

Test Case Summary Test Case Description Input Test Data CS-TC-01-01: TC L2 GOME Processing

Test the L2 processing of one month of GOME data

GOME L1 described in Table 5-1

CS-TC-01-02: TC L2 SCIAMACHY Processing

Test the L2 processing of one month of SCIAMACHY data

SCIAMACHY L1 described in Table 5-1

CS-TC-01-03: TC L2 GOME-2 Processing

Test the L2 processing of one month of GOME-2 data

GOME-2 L1 described in Table 5-1

CS-TC-01-04: TC L2 OMI Processing

Test the L2 processing of one month of OMI data

OMI L1 described in Table 5-1

CS-TC-01-05: TC L2 OMPS Processing

Test the L2 processing of one month of OMPS data (not yet achieved)

OMPS L1 described in Table 5-1

CS-TC-02-01: TC L3 GOME Processing

Test the L3 processing of one month of GOME data

GOME L2 data generated in CS-TC-01-01

CS-TC-02-02: TC L3 SCIAMACHY Processing

Test the L3 processing of one month of SCIAMACHY data

SCIAMACHY L2 data generated in CS-TC-01-02

CS-TC-02-03: TC L3 GOME-2 Processing

Test the L3 processing of one month of GOME-2 data

GOME-2 L2 data generated in CS-TC-01-03

CS-TC-02-04: TC L3 OMI Processing

Test the L3 processing of one month of OMI data

OMI L2 data generated in CS-TC-01-04

CS-TC-02-05: TC L3 Test the L3 processing of one month of OMPS OMPS L2 data generated

Page 26: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

OMPS Processing data in CS-TC-01-05 CS-TC-03-01: TC L3 Merging

Test the L3 merging of one month of GOME, SCIAMACHY, GOME-2, OMI and OMPS data

TC L3 data generated in CS-TC-02-01, CS-TC-02-02, CS-TC-02-03, CS-TC-02-04 and CS-TC-02-05

Table 5-2 Summary Description of all Test Cases for Total Column

Table 5-3 gives an overview about all tests performed. Column one identifies the Test Case performed, column two gives a short description of the test case and column 3 is a reference to the input data used in the test case.

Test Case Summary Test Case Description Input Test Data CS-TC-05-01: TTOC L3 GOME Processing

Test the L3 TTOC processing of one month of GOME data

GOME L2 TC&CL data generated in CS-TC-04-01

CS-TC-05-02: TTOC L3 GOME-2 Processing

Test the L3 TTOC processing of one month of GOME-2 data

GOME-2 L2 TC&CL data generated in CS-TC-04-02

CS-TC-06-01: TTOC L3 Merging

Test the L3 TTOC merging of one month of GOME, GOME-2 data

TTOC L3 data generated in CS-TC-05-01 and CS-TC-05-02

Table 5-3 Summary Description of all Test Cases for TTOC

5.2 Test Cases and Test Data for NP

Table 5-4 gives an overview about all used test data for the NP tests.

Test Data Test Data Description GOME L1 Orbit for June/1997, version GDP V4

One month of GOME L1 data from orbit 19970601T004807 to 19970630T232006

GOME-2 L1 Orbit for June/2008, version 4.0

One month of MetOp-A GOME-2 L1 data from orbit 20080601010857 to 20080630230257

SCIA L1 tbd OMI L1 tbd IASI L1 One month of IASI Metop-A L1 data from bufr 20080401 to 20080430 Auxiliary Data ECMWF re-analysis meteorological data

Table 5-4 Test Data used by the Nadir Profile Tests

Table 5-5 gives an overview about all tests performed. Column one identifies the Test Case performed, column two gives a short description of the test case and column 3 is a reference to the input data used in the test case.

Test Case Summary Test Case Description Test Data CS-NP-01-01: NP L2 Processing

Test the L2 processing of one month of GOME data

GOME L1 data described in Table 5-4

CS-NP-01-02: NP L2 Processing

Test the L2 processing of one month of GOME-2 data

GOME-2 L1 data described in Table 5-4

CS-NP-01-03: NP L2 Test the L2 processing of one month of SCIA SCIA L1 data data

Page 27: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

Processing data described in Table 5-4 CS-NP-01-04: NP L2 Processing

Test the L2 processing of one month of OMI data

OMI L1 data data described in Table 5-4

CS-NP-01-05: NP L2 Processing

Test the L2 processing of one month of IASI data

IASI L1 data data described in Table 5-4

CS-NP-02-01 NP L3 processing of GOME1

Test the L3 processing of one month of GOME data

GOME L2 data data described in CS-NP-01-01

CS-NP-02-02 NP L3 processing of GOME2

Test the L3 processing of one month of GOME-2 data

GOME-2 L2 data data described in CS-NP-01-02

CS-NP-02-03 NP L3 processing of SCIA

Test the L3 processing of one month of SCIA data

SCIA L2 data data described in CS-NP-01-03

CS-NP-02-04 NP L3 processing of OMI

Test the L3 processing of one month of OMI data

OMI L2 data data described in CS-NP-01-04

CS-NP-02-05 NP L3 processing of IASI

Test the L3 processing of one month of IASI data

IASI L2 data data described in CS-NP-01-05

CS-NP-03-01 NP L4 processing of GOEM1

Test the L4 processing of one month of GOME data

GOME L2 data data described in CS-NP-01-01

CS-NP-03-02 NP L4 processing of GOME2

Test the L4 processing of one month of GOME-2 data

GOME-2 L2 data data described in CS-NP-01-02

CS-NP-03-03 NP L4 processing of SCIA

Test the L4 processing of one month of SCIA data

SCIA L2 data data described in CS-NP-01-03

CS-NP-03-04 NP L4 processing of OMI

Test the L4 processing of one month of OMI data

OMI L2 data data described in CS-NP-01-04

CS-NP-03-05 NP L4 processing of IASI

Test the L4 processing of one month of IASI data

IASI L2 data data described in CS-NP-01-05

Table 5-5 Summary Description of all Test Cases for Nadir Profile

5.3 Test Cases and Test Data for LP

Table 5-6 gives an overview about all used test data for the LP tests.

Test Data Test Data Description SCIAMACHY L2 Orbit for Jan/2008, version 7.04

One month of SCIAMACHY L2_HARMOZ data from orbit 30717 to 30730

GOMOS L2 Orbit for Jan/2008, version

One month of GOMOS L2_HARMOZ data

MIPAS L2 Orbit for Jan/2008 , version 220

One month of MIPAS L2_HARMOZ data from orbit 30516 to 30960

ACE L2 Orbit for Jan/2008 , version 220

One month of ACE L2_HARMOZ data from orbit 23612 to 24068

SMR L2 Orbit for Jan/2008 , version 6.0

One month of SMR L2_HARMOZ data from orbit 0x9201 to 093C5

OSIRIS L2 Orbit for One month of OSIRIS L2_HARMOZ data from scan 37376020 to

Page 28: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

Jan/2008 , version 37838034

SAGE II L2 One month of SAGE II L2 data from January 2000 HALOE L2 One month of HALOE L2 data from January 2006 SABER L2 One month of SABER L2 data from January 2002 MLS L2 One month of MLS L2 data from January 2000 Auxiliary Data ECMWF pressure and temperature profiles are included in the HARMOZ

files. MIPAS retrieves ITS own pressure and temperature profiles.

Table 5-6 Test Data used by the Limb Profile Tests

Table 5-7 gives an overview about all tests performed. Column one identifies the Test Case performed, column two gives a short description of the test case and column 3 is a reference to the input data used in the test case.

Test Case Summary Test Case Description Test Data CS-LP-01-01: LP L2 SCIAMACHY Processing

Test the L2 processing of one month (January 2008) of SCIAMACHY data

SCIAMACHY L2 described in Table 5-6

CS-LP-01-02: LP L2 GOMOS Processing

Test the L2 processing of one month of GOMOS data

GOMOS L2 described in Table 5-6

CS-LP-01-03: LP L2 ACE-FTS Processing

Test the L2 processing of one month of ACE-FTS data

ACE-FTS L2 described in Table 5-6

CS-LP-01-04: LP L2 MIPAS Processing

Test the L2 processing of one month of MIPAS data

MIPAS L2 described in Table 5-6

CS-LP-01-05: LP L2 OSIRIS Processing

Test the L2 processing of one month of OSIRIS data

OSIRIS L2 described in Table 5-6

CS-LP-01-06: LP L2 SMR Processing

Test the L2 processing of one month of SMR data

SMR L2 described in Table 5-6

CS-LP-01-07: LP L2 SAGEII Processing

January 2000 test L2 harmoz processing

SAGEII L2 described in Table 5-6

CS-LP-01-08: LP L2 HALOE Processing

January 2006 test L2 harmoz processing

HALOE L2 described in Table 5-6

CS-LP-01-09: LP L2 MLS Processing

January 2000 test L2 harmoz processing

MLS L2 described in Table 5-6

CS-LP-01-10: LP L2 SABER Processing

January 2002 test L2 harmoz processing SABER L2 described in Table 5-6

CS-LP-02-01: LP L3 MZM SCIAMACHY Processing

Test the L3 MZM processing of one month of SCIAMACHY data

SCIAMACHY L2 data generated in CS-LP-01-01

CS-LP-02-02: LP L3 MZM GOMOS Processing

Test the L3 MZM processing of one month of GOMOS data

GOMOS L2 data generated in CS-LP-01-02

CS-LP-02-03: LP L3 MZM ACE-FTS Processing

Test the L3 MZM processing of one month of ACE-FTS data

ACE-FTS L2 data generated in CS-LP-01-03

CS-LP-02-04: LP L3 MZM MIPAS Processing

Test the L3 MZM processing of one month of MIPAS data

MIPAS L2 data generated in CS-LP-01-

Page 29: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

04 CS-LP-02-05: LP L3 MZM OSIRIS Processing

Test the L3 MZM processing of one month of OSIRIS data

OSIRIS L2 data generated in CS-LP-01-05

CS-LP-02-06: LP L3 MZM SMR Processing

Test the L3 MZM processing of one month of SMR data

SMR L2 data generated in CS-LP-01-06

CS-LP-02-07: LP L3 MZM SAGEII Processing

Test the L3 MZM processing of one month of SAGEII data

SAGEII L2 data generated in CS-LP-01-07

CS-LP-02-08: LP L3 MZM HALOE Processing

Test the L3 MZM processing of one month of HALOE data

HALOE L2 data generated in CS-LP-01-08

CS-LP-02-09: LP L3 MZM MLS Processing

Test the L3 MZM processing of one month of MLS data

MLS L2 data generated in CS-LP-01-09

CS-LP-02-10: LP L3 LNTOC SCIAMACHY Processing

Test the L2 processing of one month (January 2008) of LMN Ozone profiles for SCIA SCIA

SCIAMACHY L2 described in Table 5-6

CS-LP-03-01: LP L3 Merge MZM Processing

Test the L3 MZM Merge processing of one month of L3 MZM data

L3 data generated in CS-LP-02-01 - CS-LP-02-09

CS-LP-04-01: LP L3 SMM SCIAMACHY Processing

Test the L3 SMM processing of one month of SCIAMACHY data

SCIAMACHY L2 data generated in CS-LP-01-01

CS-LP-04-02: LP L3 SMM GOMOS Processing

Test the L3 SMM processing of one month of GOMOS data

GOMOS L2 data generated in CS-LP-01-02

CS-LP-04-03: LP L3 SMM ACE-FTS Processing

Test the L3 SMM processing of one month of ACE-FTS data

ACE-FTS L2 data generated in CS-LP-01-03

CS-LP-04-04: LP L3 SMM MIPAS Processing

Test the L3 SMM processing of one month of MIPAS data

MIPAS L2 data generated in CS-LP-01-04

CS-LP-04-05: LP L3 SMM OSIRIS Processing

Test the L3 SMM processing of one month of OSIRIS data

OSIRIS L2 data generated in CS-LP-01-05

CS-LP-04-06: LP L3 SMM SMR Processing

Test the L3 SMM processing of one month of SMR data

SMR L2 data generated in CS-LP-01-06

CS-LP-04-07: LP L3 SMM SAGEII Processing

Test the L3 SMM processing of one month of SAGEII data

SAGEII L2 data generated in CS-LP-01-07

CS-LP-04-08: LP L3 SMM HALOE Processing

Test the L3 SMM processing of one month of HALOE data

HALOE L2 data generated in CS-LP-01-08

Page 30: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

CS-LP-04-09: LP L3 SMM MLS Processing

Test the L3 SMM processing of one month of MLS data

MLS L2 data generated in CS-LP-01-09

CS-LP-05-02: LP L3 Merge SMM Processing

Test the L3 SMM Merge processing of one month of L3 SMM data

L3 data generated in CS-LP-04-01 - CS-LP-04-09

CS-LP-06-01: LP L3 FR SCIAMACHY Processing

Test the L3 FR processing of one month of SCIAMACHY data

SCIAMACHY L2 data generated in CS-LP-01-01

CS-LP-06-02: LP L3 FR GOMOS Processing

Test the L3 FR processing of one month of GOMOS data

GOMOS L2 data generated in CS-LP-01-02

CS-LP-06-03: LP L3 FR ACE-FTS Processing

Test the L3 FR processing of one month of ACE-FTS data

ACE-FTS L2 data generated in CS-LP-01-03

CS-LP-06-04: LP L3 FR MIPAS Processing

Test the L3 FR processing of one month of MIPAS data

MIPAS L2 data generated in CS-LP-01-04

CS-LP-06-05: LP L3 FR OSIRIS Processing

Test the L3 FR processing of one month of OSIRIS data

OSIRIS L2 data generated in CS-LP-01-05

CS-LP-07-01: LP L3 UTLS SCIAMACHY Processing

Test the L3 UTLS processing of one month (January 2008) of SCIAMACHY data

SCIAMACHY L2 described in Table 5-6

CS-LP-07-02: LP L3 UTLS GOMOS Processing

Test the L3 UTLS processing of one month of GOMOS data

GOMOS L2 described in Table 5-6

CS-LP-07-03: LP L3 UTLS ACE-FTS Processing

Test the L3 UTLS processing of one month of ACE-FTS data

ACE-FTS L2 described in Table 5-6

CS-LP-07-04: LP L3 UTLS MIPAS Processing

Test the L3 UTLS processing of one month of MIPAS data

MIPAS L2 described in Table 5-6

CS-LP-07-05: LP L3 UTLS OSIRIS Processing

Test the L3 UTLS processing of one month of OSIRIS data

OSIRIS L2 described in Table 5-6

CS-LP-08-01: LP UTLS L3 Merge Processing

Test the UTLS L3 Merge processing of one month of L3 UTLS data

L3 UTLS data generated in CS-LP-07-01 - CS-LP-07-05

Table 5-7 Summary Description of all Test Cases for Limb Profile

Page 31: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

6 Test Results

The following summaries give an overview about all tests performed and its main results. The gray rows are the test results from the tests in phase 1 which are still valid within this context.

6.1 Overview about all Test Results TC

Table 6-1 gives an overview about all tests performed. Column one identifies the Test Case performed, column two the test environment and column three the summary of the test result.

Test Case Test Environment Summary Test Result CS-TC-01-01: TC L2 GOME Processing

Processor GODFIT (v3) running in a Linux cluster with 1 core @ 2.3 GHz.

Pass Processing time for 412 orbits: 0 day, 18 hours.

CS-TC-01-02: TC L2 SCIAMACHY Processing

Processor GODFIT (v3) running in a Linux cluster with 1 core @ 2.3 GHz.

Pass Processing time for 410 orbits: 2 days, 10 hours.

CS-TC-01-03: TC L2 GOME-2 Processing

Processor GODFIT (v3) running in a Linux cluster with 1 core @ 2.3 GHz.

Pass Processing time for 423 orbits: 7 days, 22 hours.

CS-TC-01-04: TC L2 OMI Processing

Processor GODFIT (v3 - look-up table version) running in a Linux cluster of 32 cores @ 2.66 Ghz.

Pass Processing time for 445 orbits: 1 day, 9 hours.

CS-TC-01-05: TC L2 OMPS Processing

Not yet achieved NA

CS-TC-02-01: TC L3 GOME Processing

Processor UCAS (v2) running in a Linux workstation with 1 core @ 2.4 GHz

Pass Processing time for one month data: 3 hours, 40 minutes

CS-TC-02-02: TC L3 SCIAMACHY Processing

Processor UCAS (v2) running in a Linux workstation with 1 core @ 2.4 GHz

Pass Processing time for one month data: 2 hours, 25 minutes

CS-TC-02-03: TC L3 GOME-2 Processing

Processor UCAS (v2) running in a Linux workstation with 1 core @ 2.4 GHz

Pass Processing time for one month data: 6 hours, 30 minutes

CS-TC-02-04: TC L3 OMI Processing

Processor UCAS (v2) running in a Linux workstation with 1 core @ 2.4 GHz

Pass Processing time for one month data: 32 hours

CS-TC-02-05: TC L3 OMPS Processing

Not yet achieved NA

CS-TC-03-01: TC L3 Merging

Not yet achieved NA

Page 32: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

Table 6-1 Summary of all performed Test Cases for Total Column

6.2 Overview about all Test Results TTOC

Table 6-2 gives an overview about all tests performed. Column one identifies the Test Case performed, column two the test environment and column three the summary of the test result.

Test Case Test Environment Summary Test Result CS-TC-05-01: TTOC L3 GOME Processing

Processor CCD-trop (v1) running in a Linux cluster with 1 core @ 2.9 GHz.

Pass Processing time for 1 Month of L2 data: 2 Minutes

CS-TC-05-02: TTOC L3 GOME-2 Processing

Processor CCD-trop (v1) running in a Linux cluster with 1 core @ 2.9 GHz.

Pass Processing time for 1 Month of L2 data: 7 Minutes

CS-TC-06-01: TTOC L3 Merging

not yet achieved NA-

Table 6-2 Summary of all performed Test Cases for TTOC

6.3 Overview about all Test Results NP

Table 6-3 gives an overview about all tests performed. Column one identifies the Test Case performed, column two the test environment and column three the summary of the test result.

Test Case Test Environment Summary Test Result CS-NP-01-01: NP L2 Processing of GOME

Processor RAL O3P (2.1) running in a Linux cluster with 140 cores @ 2.4 GHz (Opteron 6238), SPEC2006: 30/45/400/330.

Pass. Processing time for 420 orbits: 0 days, 10 hours.

CS-NP-01-02: NP L2 Processing of GOME2

Processor RAL O3P (2.1) running in a Linux cluster with 140 cores @ 2.4 GHz (Opteron 6238), SPEC2006: 30/45/400/330.

Pass Processing time for 420 orbits: 1days, 12 hours. Summary

CS-NP-01-03: NP L2 Processing of SCIA

not yet achieved NA

CS-NP-01-04: NP L2 Processing of OMI

not yet achieved NA

CS-NP-01-05: NP L2 Processing of IASI

Processor FORLI-O3 v20140922 running in a Linux cluster with 280 cores @2.4 Ghz

Pass Processing time for 14400 BUFR: 10 days

CS-NP-02-01 NP L3 processing of GOME

Processor NADC running on a cluster of blades

Pass Processing time for 12 months of data: 30 minutes

CS-NP-02-02 NP L3 Processor NADC running on a Pass

Page 33: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

processing of GOME-2 cluster of blades Processing time for 12 months of data: 30 minutes

CS-NP-02-03: NP L3 Processing of SCIA

not yet achieved NA

CS-NP-02-04: NP L3 Processing of OMI

not yet achieved NA

CS-NP-02-05: NP L3 Processing of IASI

not yet achieved NA

CS-NP-03-01 NP L4 processing of GOME

Processor NADC running on a single blade

Pass Processing time for 12 months of data: 50 hours

CS-NP-03-02 NP L4 processing of GOME-2

Processor NADC running on a single blade

Pass Processing time for 12 months of data: 50 hours

CS-NP-03-03: NP L4 Processing of SCIA

not yet achieved NA

CS-NP-03-04: NP L4 Processing of OMI

not yet achieved NA

CS-NP-03-05: NP L4 Processing of IASI

not yet achieved NA

Table 6-3 Summary of all performed Test Cases for Nadir Profile

6.4 Overview about all Test Results LP

Table 6-4 gives an overview about all tests performed. Column one identifies the Test Case performed, column two the test environment and column three the summary of the test result.

Test Case Test Environment Summary Test Result CS-LP-01-01: LP L2 SCIAMACHY Processing

HARMOZ_SCIA_UBR 2.9 Linux local PC with 1 core @ 3.16 GHz

Pass Processing time for 50000 orbits: 10 days 6 hours

CS-LP-01-02: LP L2 GOMOS Processing

GOMOS HARMOZ v1 Windows laptop and Linux desktop,

passed

CS-LP-01-03: LP L2 ACE-FTS Processing

not yet achieved NA

CS-LP-01-04: LP L2 MIPAS Processing

MIPAS IMK Original L2 V5R_O3_220 and V5H_O3_20; MIPAS HARMOZ v1 Solaris Cluster

passed

CS-LP-01-05: LP L2 OSIRIS Processing

2 Xeon E5420 2.5 GHz Pass 64000 orbits: 8 hours

CS-LP-01-06: LP L2 SMR not yet achieved NA

Page 34: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

Processing CS-LP-01-07: LP L2 SAGEII Processing

harmoz_sage V7 Linux local PC with 1 core @ 3.16 GHz

Pass Processing time: 50 minutes

CS-LP-01-08: LP L2 HALOE Processing

harmoz_haloe V19 Linux 1 core @ 3.16 GHz

Pass Processing time 6 hours

CS-LP-01-09: LP L2 MLS Processing

harmoz_mls 3.3 Linux @ 2.7 GHz

Pass Procssing time: 45 days

CS-LP-01-10: LP L2 SABER Processing

harmoz_saber V 1.07 Linux @ 2.7 GHz

Pass Procssing time:28 hours

CS-LP-02-01: LP L3 MZM SCIAMACHY Processing

LP-MZM-HARMOZ V1 Windows laptop and Linux desktop

pass

CS-LP-02-02: LP L3 MZM GOMOS Processing

LP-MZM-HARMOZ V1 Windows laptop and Linux desktop

pass

CS-LP-02-03: LP L3 MZM ACE-FTS Processing

LP-MZM-HARMOZ V1 Windows laptop and Linux desktop

pass

CS-LP-02-04: LP L3 MZM MIPAS Processing

LP-MZM-HARMOZ V1 Windows laptop and Linux desktop

pass

CS-LP-02-05: LP L3 MZM OSIRIS Processing

LP-MZM-HARMOZ V1 Windows laptop and Linux desktop

pass

CS-LP-02-06: LP L3 MZM SMR Processing

LP-MZM-HARMOZ V1 Windows laptop and Linux desktop

pass

CS-LP-02-07: LP L3 MZM SAGEII Processing

LP-MZM-HARMOZ V1 Windows laptop and Linux desktop

verification open

CS-LP-02-08: LP L3 MZM HALOE Processing

LP-MZM-HARMOZ V1

verification open

Page 35: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

Windows laptop and Linux desktop

CS-LP-02-09: LP L3 MZM MLS Processing

LP-MZM-HARMOZ V1 Windows laptop and Linux desktop

verification open

CS-LP-02-10: LP L3 LNTOC SCIA Processing

Code 4 LNTOC V 2.9 SCIA SCIA Linux 2.7 GHz

Pass 7.5 days

CS-LP-03-01: LP L3 Merge MZM Processing

LP-MZMM V1 Windows laptop and Linux desktop

pass

CS-LP-04-01: LP L3 SMM SCIAMACHY Processing

LP-L3SMM V1 Windows laptop and Linux desktop

pass

CS-LP-04-02: LP L3 SMM GOMOS Processing

LP-L3SMM V1 Windows laptop and Linux desktop

pass

CS-LP-04-03: LP L3 SMM ACE-FTS Processing

LP-L3SMM V1 Windows laptop and Linux desktop

pass

CS-LP-04-04: LP L3 SMM MIPAS Processing

LP-L3SMM V1 Windows laptop and Linux desktop

pass

CS-LP-04-05: LP L3 SMM OSIRIS Processing

LP-L3SMM V1 Windows laptop and Linux desktop

pass

CS-LP-04-06: LP L3 SMM SMR Processing

LP-L3SMM V1 Windows laptop and Linux desktop

Verification open

CS-LP-05-02: LP L3 Merge SMM Processing

LP-SMM V1 Windows laptop and Linux desktop

pass

Page 36: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

CS-LP-06-01: LP L3 FR SCIAMACHY Processing

LP-FR V1 Windows laptop and Linux desktop

pass

CS-LP-06-02: LP L3 FR GOMOS Processing

LP-FR V1 Windows laptop and Linux desktop

pass

CS-LP-06-03: LP L3 FR ACE-FTS Processing

LP-FR V1 Windows laptop and Linux desktop

pass

CS-LP-06-04: LP L3 FR MIPAS Processing

LP-FR V1 Windows laptop and Linux desktop

pass

CS-LP-06-05: LP L3 FR OSIRIS Processing

LP-FR V1 Windows laptop and Linux desktop

pass

CS-LP-07-01: LP L3 UTLS SCIAMACHY Processing

results expected in SVR V2

CS-LP-07-02: LP L3 UTLS GOMOS Processing

results expected in SVR V2

CS-LP-07-03: LP L3 UTLS ACE-FTS Processing

results expected in SVR V2

CS-LP-07-04: LP L3 UTLS MIPAS Processing

results expected in SVR V2

CS-LP-07-05: LP L3 UTLS OSIRIS Processing

results expected in SVR V2

CS-LP-08-01: LP L3 UTLS Merge Processing

results expected in SVR V2

Table 6-4 Summary of all performed Test Cases for Limb Profile

Page 37: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

7 Description of acceptable and stated Limitations in the Ozone_cci System

This chapter contains a description of all acceptable and stated limitations in the system and the steps taken to workaround anomalous, inappropriate, or undesired operating conditions.

7.1 Limitations in the TC Processing System

The following limitations were found in the TC processing:

1. The level-2 TC data sets rely on auxiliary cloud parameters provided by the FRESCO v6 and O2-O2 algorithms. In case of unavailability of these parameters, no total ozone retrieval is performed.

2. During two days per month, the OMI instrument switches in the so-called zoom mode, in which the spatial resolution is significantly improved with respect to the nominal mode, at cost of the spatial coverage. The level of accuracy of the total ozone columns retrieved from this specific mode with the look-up table version of GODFIT_3 is expected to be less good than for the nominal observations and are consequently not provided.

3. The TC_L3_MRG monthly mean product is not generated in case of too few data in high latitudes close to the polar night terminator

7.2 Limitations in the TTOC Processing System

The following limitations were found in the TTOC processing:

1. The level-3 TTOC retrieval depends on Cloud parameters and Total Ozone columns, if one is missing or incorrect the retrieval fails.

2. A strong dependency on the cloud product (cloud height) is observed, the dependency on the total column data is of similar magnitude.

7.3 Limitations in the NP Processing System

The following limitations were found in the NP processing:

1. Processing capability at the CEMS facility can be variable. We have between 300 and 2000 nodes available to use at any one time but is a shared facility and therefore processing time is dependent upon the level of community use

2. No limitations were found during the processing of IASI test data

7.4 Limitations in the LP Processing System

The following limitations were found in the LP processing:

Verification report for SCIAMACHY is presented in the Drift and Bias Analysis

Tests performed for all LP Systems:

Page 38: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

1. For most of the products, the processing time is within couple of hours. Exceptions are dense samplers like MLS, SCIAMACHY and LNTOC from SCIA SCIA, which takes 45 days, 10 days and 7 days respectively. Especially for MLS there might be a risk of delivery delay on time for reprocessing.

Test has been successfully performed for the additional US sensors: SABER, HALOE, and SAGE II. The issues are summarized in 8.4.

Page 39: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

8 Verification Summary

8.1 Verification Summary for TC

During the first phase of the project, processing tests have been successfully passed for the three instruments GOME, SCIAMACHY and GOME-2 and consisted in generating one month of L2 total ozone data for each of these instruments using the prototype code GODFIT v3 on a single core of a Linux machine. As the prototype code has not significantly changed since then, these tests remain valid and the results have been recalled in this document. For the processing of the OMI L1 data, a much faster look-up table version of the GODFIT algorithm has been developed. A similar verification test based on the production of one month of OMI data has been successfully carried out. The full reprocessing of the OMI sensor followed and the full OMI L2 total ozone data set has been made publicly available in Spring 2015. An interface still needs to be added to GODFIT in order to ingest OMPS L1 data. A similar verification test will be realized and reported in a future version of this document. For the L3 total ozone data from GOME, SCIAMACHY, and GOME-2 the tests carried out during the first phase of the project remain valid. A similar verification test has been carried out based on the production of one month of OMI L3 total ozone data. In the same way a verification test will be realized for the new TC_L3_MRG product.

8.2 Verification Summary for TTOC

Processing test has been performed for GOME and GOME-2 data. Both the operational DLR L2 data and the GODFIT v3 data were successfully used to generate one year of tropical tropospheric ozone data. The processing speed was independent of the input dataset. The SCIAMACHY and OMI data are not yet included in the processing. Here new interfaces are being developed and similar tests will be performed soon. After the processing of the OMI L2 GODFIT data a merged dataset is planned. The respective test results will be reported in an updated version of this report.

8.3 Verification Summary for NP

The processing of IASI test data did run without problems. Note that the time needed for this test processing concerns only one of the platforms (Metop-A). More processing time will be needed if the two platforms are considered.

8.4 Verification Summary for LP

No verification performed so far. Most of the processing of ozone limb profiles for the mentioned sensors SCIAMACHY, MLS, SAGE II; HALOE, and SABER perform within the limitation of the vertical grid resolution. Because of low vertical resolution of the CCI pressure grid the double ozone peak and maxima are missed. An example for HALOE and SABER is shown in Fig. 2. This means that tThe position of ozone peak can be shifted off to higher or lower altitudes or missing and interpolating and the missing the double ozone peaks due to interpolation. However this is accounted in the error budget.

Page 40: SVR Ozone cci P2 1.1cci.esa.int/sites/default/files/filedepot/incoming/SVR_Ozone_cci_P2_1.1.pdf · M. Weber (LP) M. Wolfmüller . TITLE: System Verification Report Issue: 01 - Revision:

TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01

Figure 8-1 Comparison Ozone profiles for SABER and HALOE

The comparison of the ozone profiles at the peak of ozone for SABER native (right) and HALOE (left) shown as black (dashed) lines and harmonized SABER CCI (red dashed) profiles.