Orfeo ToolBox - Archived web...

CS Communication and Systems

The Orfeo ToolBox – GeoCap 09-11 1

www.orfeo-toolbox.c-s.fr

GeoCap – Taormina 19th November 2009

Orfeo Tool Box

Orfeo ToolBox:An open source tool for high resolution image processing.

Eric Guzzonato - Cyrille Valladeau – Jordi IngladaCS Communication and Systems - CNES

The OTBIn few words



The OTB in few wordsContext & Aims

• ORFEO (Optical and Radar Federated EarthObservation):

Dual earth observation satellite system:Optic: CNES, France (Pléiades, HR)Radar: ASI, Italy (Cosmo-Skymed)

• ORFEO Accompaniment Program:Goals:

make easier the development of new algorithmstheir validation and capitalisationfill the gap between researchers and ORFEO users




Thematic part:User’s needs (extracted information)Product definitionValidation

Methodologic part: Coordination of research activities in image processing:




• Orfeo ToolBox (OTB):Designed to prepare, support and promote the use of imagesOpen source software for image processing (for labs, ORFEO users and the industry)1 major and 3 or 4 minor releases each year



The OTB in few wordsWhat

• Technical factsA C++ image processing library All Open source under french CECILL licenseFully Based on ITK (Insight ToolKit), C++ library for medical image processingA set of GUI applications for remote sensing images processing and information extraction: OTB-ApplicationA generic image processing application dedicated to end-users: MonteverdiBindings with Python, Java and IDL/Envi language




• Used LibrariesITK: library for medical image processingOpenGL: graphical displayGDAL: image readingFLTK: GUIsLibSVM (Support Vector Machine): supervised classificationOpenJpeg: Jpeg2000 formatlibKML: Google vector data format6S: Radiometric processingOSSIM: sensor modelling and map projections…




• The OTB frameworksApplication Domains: remote sensing, medical imaging, robotics, vision, …Algorithm families:

Filters: optical/SAR, morphological operators, denoising, ...Segmentation: watersheds, Hough, …Image registration: transforms, interpolators, ...Learning and classification: Markov, K-means, SVMMeasure of similarities: correlations, mutual information, K-means, Kullback, …Geometric corrections: with sensor model and common map projectionsChange detection: multi-temporal/sensors series…




Data type : Images

N dimensionsMono/Multi channelReal/Complex

RasterVector dataGraphsMeshes Label object map (RLE)



The OTB in few wordsWho

• OTB is designed and funded by the CNES

• Mainly developed by CS, since 2006



The OTB in few wordsWho

• International community (09-01)

OTB documentation download

OTB download

The OTBAdvantages



The OTB AdvantagesGeneral Advantages

• Multiple plateforms supportedDaily tested on multiple configurations

(Windows, Linux/Unix, MacOS)

• GenericityUse template ⇒ open and evolving architecture

• PipelineAutomatic input and output management

ReaderImage

FileFilter

Image Writer File



The OTB AdvantagesGeneral Advantages

• Multiple image formatsstandard and remote sensing formats

(scalar, complex, mono or multi channels types)



The OTB AdvantagesStreaming/Threading

• High performances:Multi-threading:

Use every available processor ⇒ Parallelize computations

Division4

Division3

Division2

Division1

Division4

Division3

Division2

Division1

PU4

PU3

PU2

PU1

Output ImageInput Image



The OTB AdvantagesStreaming/Threading

• High performances:Streaming:

Deal with areas in image ⇒ Process huge image.

Reader StreamingWriter

OutputImage

Filter

Update()Update() Update()

Image Region

Image Region

Image RegionImage Region

N times

InputImage



The OTB AdvantagesGIS

• Read/write vector format (KML and shapefile)• On the fly projections: vector data on remote sensing

image using image geometry (OSSIM based):Raw: using sensor model and digital elevation modelOrtho: using cartographical projections

• Vector rendering, layer management, …• Registration (application)

Image/ImageImage/Vector DataVector Data/Vector Data: Incoming

Some Application Examples



Some Application ExamplesAvailable modules

• OTB-Applications (≈ 20 applications)• Monteverdi (≈ 15 new modules)

OTB

OTBApplications Monteverdi



Some Application ExamplesViewer

Allows:

• Image visualization and navigation,

• Histogram manual adaptation,

• Vector Data display, cares the projection.



Some Application ExamplesStereoscopy visualization

Allows:• Visualization of stereoscopic image pair

• Zoom, navigation.



Some Application ExamplesOrtho rectification

Allows:

• Selection of an extract (in physicalcoordinates),

• Orthorectification.



Some Application ExamplesOrtho fusion

Allows:• Selection of an extract (in physicalcoordinates),

• Orthorectifications,

• Pan sharpening.



Some Application ExamplesRegistration

Allows:• Vector Data/Image

• Image/Image

•Vector Data/Vector Data (Incoming)

Pireo ImageToDBRegistraion Application



Some Application ExamplesSupervised Classification

Allows:

• Multiple classes selection,

• Classification using SVM,

• Result export (image or vector data).



Some Application ExamplesUrban Area Extraction

Allows:

• Urban Area Extraction using radiometric indexes and edge density,

• Result export (image or vector data).



Some Application ExamplesFeature Extraction

Allows:• Compute features (textures, radiometric

indexes, etc.)

• Save image result (each channel is 1 feature).

NDVI radiometric index



Some Application ExamplesAnd…

• In OTB-ApplicationsImage type convertorImage extractorRadiometric calibrationSAR polymetric analysis tool,Object counting, …

• In MonteverdiRegistration using homologous point selectionSensor model creation using GCPs selectionSurimpositionReprojectionBand mathComplex image transformation (log-modulus), …

CS and the OTB



CS and the OTBExperience

• CS has been developed OTB since 2006• CS participates to the OTB users mailing list• CS delivers OTB training courses• CS contributes to the OTB as all user can do • CS uses OTB for other project:

InternshipsCNES funding R&Ts:

Object detection:Dynamic format for risk management productsMaritime surveyCompressed sensing...

Project



CS and the OTBExperience

CNES funding R&Ts:Object detection:

Focusing chain for region of interest extractionObject Recognition by template registrationSpatial ReasoningAutomatic object detection and recognition

Dynamic format for risk management productsMaritime surveyCompressed sensing...

Project Venµs (CNES-ISA)



CS and the OTBPublications

• CS participates to many publications based on OTB

“Reference algorithm implementation in OTB: Textbook cases”, IGARSS 2009, J. Michel (CS), J. Inglada (CNES)“Focus pre-processing chain for object detection in high resolution remote sensing images”, IGARSS 2009, J. Michel (CS), C. Valladeau (CS), J. Inglada (CNES)“Assesment of interest points detection algorithms in OTB”, IGARSS 2009, O. Lahlou (CS), J. Michel (CS), J. Inglada (CNES)...

Enter the OTB



Enter the OTBGet Informations

• An users list: [email protected]• A blog: http://blog.orfeo-toolbox.org• A wiki: http://wiki.orfeo-toolbox.org• A bug tracker: http://bugs.orfeo-toolbox.org• Online documentation: http://www.orfeo-

toolbox.org/otb/documentation.htmlClasses documentation: DoxygenOTB Guide: SoftwareGuide

www.orfeo-toolbox.org



Enter the OTBHow to start

• Compile your own OTB, OTB-Application or Monteverdi

Downlaod sources:Lastest release: http://sourceforge.net/projects/orfeo-toolbox/files/orfeo-toolbox/OTB-3.0Current development version using Mercurial (http://www.selenic.com/mercurial) and

hg clone http://hg.orfeo-toolbox.org/OTB

hg clone http://hg.orfeo-toolbox.org/OTB-Applications

hg clone http://hg.orfeo-toolbox.org/Monteverdi

Follow the compilation procedure according to the SoftwareGuide documentation.



Enter the OTBHow to start

• Download OTB-Applications Windows executable: http://sourceforge.net/projects/orfeo-toolbox

• Use the live CD: www.orfeo-toolbox.org/otblive

Don’t hesitate to contact the OTB community:[email protected]

Thank you

Questions?

Orfeo ToolBox - Archived web...

Documents

Transcript of Orfeo ToolBox - Archived web...