ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 1

ORFEO Methodology

Status & Future work

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 2

Contents

�OTB

�R&D Studies

�ORFEO data base setting up

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 3

OTB

OTB

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 4

Orfeo Toolbox

• Goals : make easier the development of new algorith ms, their validation

and capitalisation, fill the gap between researcher s and ORFEO users.

• CNES is responsible for design and specification.

• Open source software for Image Processing labs, use rs and the industry.

• Contractor : Communications et Systèmes, CS

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 5

Orfeo Toolbox

• C++ library based on existing developments

���

������

���� �������

Developpers

���������

Users�������������

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 6

External Libraries

������������� �������� ����� ��

������� �������

�� ������������ ������� ���������� ��� ��

�����������!�"�������

�#������$��

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 7

Orfeo Toolbox

• Library (Phase 1)– IO

– Visualisation

– Features, descriptors

– Change detection

– Supervised learning

• Utilities (Phase 1) – Quick look

– ROI extraction

– Meta-data access

– Pseudo-ortho-rectif

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 8

Orfeo Toolbox : Roadmap

�Version 1 (2006):

� core of the system,

� IO,

� basic filtering, segmentation and classification,

� basic feature extraction,

� basic change detection.

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 9

Orfeo Toolbox : Roadmap

�Version 2 (2007):

� geometric corrections,

� radiometric corrections,

� registration.

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 10

Orfeo Toolbox : Roadmap

�Version 3 (2008):

� multi-scale and multi-resolution analysis,

� object detection and recognition,

� supervised learning.

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 11

Orfeo Toolbox : Roadmap

�Version 4 (2009):

� data fusion,

� spatial reasoning.

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 12

Examples of functionnalities

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 13

Supervised classification

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 14

Markov random fields segmentation

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 15

Line detection on SAR images

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 16

Perceptual alignment detection

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 17

Anti-speckle filtering

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 18

Salient point detection

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 19

Object segmentation

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 20

Change detection

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 21

Original Blurring Edge preserving

Denoising

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 22

Watershed segmentation

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 23

Vehicle detection

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 24

Object detection

Reference

Scene image

•Similarity measure•Rotation•Scale

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 25

Object detection (2)

Correlation matching

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 26

Object detection (3)

Segmentation using the seeds from object matching

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 27

Circle extraction

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 28

Other functionnalities and features

�Generic I/O

�Streaming, threading

�Synchronized pipeline (processing on demand)

�Type genericity (int, float, double, complex)

�Multi-platform

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 29

OTB Users

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 30

OTB Users

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 31

OTB Users

�100+ downloads since June 2006

�Many methodology developers, some thematic users

� Different needs, different difficulties, different ways of using OTB

�25% from private companies

�47% France, 9% Belgium, 6% USA, 4% China, Spain, Ca nada,

Germany, Portugal, ...

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 32

OTB Users

�Sea & coast: 1. Risk: 2. Carto: 3. Geophys: 3. Hydr o: 2. Forest: 1. Agri:

3. Defence: 4.

�Optical Change Det: 5. Optical/radar fusion: 3. Opt ical registration: 3.

Object recognition: 2. Segmentation (opt. 7; radar 2). Remote sensing

25 (opt. 20; radar 1). Image Processing 39 (opt. 31 ).

�Linux: 35. MVC++: 62.

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 33

OTB: Feedback?

�Bug correction

�Install / use improvements

�Suggestions of functionalities

�How would you like to use it?

� GUI

� Tools for specific applications: ship detection, ro ad extraction, etc.

� Integrated application for building processing chai ns

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 34

R&D Studies

OTB

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 35

Means

�CNES' R&D program

� 2006: 6 contracts

� 2007: 3 contracts

�Grants: PhD, post-doc

�Internal Studies

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 36

CNES' R&D program (ongoing, 492 k€)

�Similarity measures. ENST-B + TeSA. 3 years contrac t (160k€).

�Optical/radar registration for 3D extraction. ENST. 1 year contract (35

k€).

�Active contours for network extraction (roads, hydr o, etc.). INRIA. 3

years contract (96 k€).

�PMP parameter estimation. INRIA. 3 years contract ( 96 k€).

�Gestalts. CMLA. 2 years contract (60 k€).

�3D Change detection. IGN. 1 year contract (45 k€).

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 37

CNES' R&D program (to come, 150 k€)

�Mutistrategy & multi-resolution classification.

�3D extraction & 3D model evaluation.

�Spatial reasoning for object recognition.

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 38

R&D budget synthesis

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 39

CNES' internal studies

�Completed

� Spatial reasoning for object recognition

� Target identification on HR SAR images

� Road extraction

�Carried on in 2007

� Progressive/adaptive image compression

� Image / data base change detection

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 40

ORFEO data base setting up

OTB

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 41

VHR image object data base

�Main goal: methodology development

�List of objects: taken from WG's reports, meant to be balanced

(generic-specific)

� WG's members will be asked for validation

� Interesting object examples may be proposed

�Restricted: optical only, for the thematic test s ites, not all kinds of

objects

ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 42