USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

22
June 2015 – Hackfest OTB - Toulouse CENTRE FOR EXPERTISE AND ENGINEERING ON RISKS, URBAN AND COUNTRY PLANNING, ENVIRONMENT AND MOBILITY Satellite Application Pole - MEDDE DOMINIQUE HEBRARD – GILLES FOUVET A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT USING ORFEO TOOLBOX

Transcript of USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

Page 1: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

June 2015 – Hackfest OTB - Toulouse

CENTRE FOR EXPERTISE AND ENGINEERING ON RISKS, URBAN AND COUNTRY PLANNING, ENVIRONMENT AND MOBILITY

Satellite Application Pole - MEDDE

DOMINIQUE HEBRARD – GILLES FOUVET

A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

USING ORFEO TOOLBOX

Page 2: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

June 2015 – Hackfest OTB - Toulouse

Who are we ? Context and aims

Usage of OTB

Example of studies and tools

FeedBack

of CEREMA's team

Presentation Outline

Presentation Outline

Page 3: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

June 2015 – Hackfest OTB - Toulouse

Who are we ?

Context and aims

Who are we ?

Context and aims

Page 4: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

Date_Titre de la présentation

Satellite Application Pole

INSTITU-

TIONAL

SERVICES

DG, DREAL

DRAAF, DDT

CEREMA, Local

authorities…

INSTITU-

TIONAL

SERVICES

DG, DREAL

DRAAF, DDT

CEREMA, Local

authorities…

SATELLITE POLE

Located in CEREMA

SATELLITE POLE

Located in CEREMA

Transmission potential user's needsTransmission potential user's needs

Promotion of satellite applications

technical support and services

Promotion of satellite applications

technical support and services

Partnership and projectsPartnership and projects

EARTH OBSERVATION ACTIVITY :

INTEGRATING IN A PERTINENT AND USEFUL UTILISATION OF

SATELLITE IMAGES IN THE INSTITUTIONAL SERVICES

EARTH OBSERVATION ACTIVITY :

INTEGRATING IN A PERTINENT AND USEFUL UTILISATION OF

SATELLITE IMAGES IN THE INSTITUTIONAL SERVICES

TECHNICAL

ACTORS IN

SATELLITE

APPLICATIONS

Laboratories,

CNES, ESA

Service providers,

companies…

TECHNICAL

ACTORS IN

SATELLITE

APPLICATIONS

Laboratories,

CNES, ESA

Service providers,

companies…

Page 5: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

June 2015 – Hackfest OTB - Toulouse

French Policies About SoftwareConvergence towards free software

Administrative circular of the Prime Minister - September 2012Usage of free software in the French administration :

- added value for the users- cost control, - adaptability, - ….

Two examples :

- Mimo : list of free office software- Qgis becomes the main GIS software in MEDDE active and great community in the services

Page 6: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

June 2015 – Hackfest OTB - Toulouse

Stakes and Aims

From research to development and democratization

Specifications and targets:

- GIS specialist CEREMA, MEDDE, local authorities (non specialist in remote sensing)

- skills transfer

- reproducibility (software, methodology, training)

- Potentially widespread in the services (products or tools)

- Training (pedagogical suitcase)

Page 7: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

June 2015 – Hackfest OTB - Toulouse

Training (pedagogical suitcase)Module 1 : (1 day)

- Awarness and acculturation,

- What can we do with satelitte images ? Where can you get them ?

- targets : GIS engeneers and technicians, and project manager in charge of public policies

Module 2 : (3 days)

- Basic raster manipulations

- Basic classifcations (thresholding) and index (NDVI,etc..)

- supervised classification

Page 8: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

June 2015 – Hackfest OTB - Toulouse

Usage of OTBUsage of OTB

Page 9: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

June 2015 – Hackfest OTB - Toulouse

USAGES OF OTBAre we users or developers ?

For the GIS users :

We are developers and specilized in remote sensing

For the developers :

We are end-users

So :

We are using OTB application

Page 10: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

USAGES OF OTBOTB application - a bridge between GUI users and CLI users for automatization

OTB applications

OTB applications CLI

Command Line InterfaceCLI

Command Line Interface

GUIGraphical User Interface

GUIGraphical User Interface

Scriptfew lines : loops

Scriptfew lines : loops

Processing chain6000 lines

Processing chain6000 lines

Monteverdi 2.0Monteverdi 2.0

QGIS 2.0 sextante

QGIS 2.0 sextante

SpatiaLiteSpatiaLite

Page 11: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

June 2015 – Hackfest OTB - Toulouse

Example of studies

and

tools

Example of studies

and

tools

Page 12: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

June 2015 – Hackfest OTB - Toulouse

What the users mainly need ?

The example of Land Cover:

- evaluation for territory planning policies : ➢ anthropisation, natural lands, agricultural land:

minimum each 3 years➢ urban density

- very low cost

- stability of the method

The needs are quite simple, the answer a little bit less!

Page 13: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

June 2015 – Hackfest OTB - Toulouse

Study led in CEREMA

✔ Various topics and studies : always linked with public policies in the fields of territory planning, natural and industrial hasards or environment

✔ Various images : Pléiades, Rapideye, Spot 6, Spot 5, sentinelle 2 ?, …

✔ Different needs, so several methods

✔ Numerous orders from the users : demonstrator to test on their territories

✔ Strong need of human ressource optimization, led us to automatization strategy

Page 14: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

June 2015 – Hackfest OTB - Toulouse

Processing chain : Satellite Application PoleBorn in 2012

- first need of automatization

V 1.0 end of 2013- 90% tasks automatization (scripts Python, OTB, spatialite, gdal)

V 1.x road map 2014- increase computing performance- improve ergonomy, stability and maintenance

V 2.0 road map 2015- cutting the chain in several application modules

- command line interface via argument parser - integration methodology evolutions

- computation time optimization - hypervisor

V 2.x road map 2016 - hypervisor

- GUI ?

Page 15: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

Processing chain

Exemple step 1

Page 16: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

Processing chain

Exemple step 2

Page 17: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

Processing Chain :

Software

architecture

Page 18: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

June 2015 – Hackfest OTB - Toulouse

Processing chain : Satellite Application PoleBuiltDifference.py: # otbcli_BandMath, otbcli_BinaryMorphologicalOperation, otbcli_Superimpose, otbcli_Rasterization

ChannelsConcatenation.py: # otbcli_BandMath, otbcli_ConcatenateImages, otbcli_ComputeImagesStatistics, otbcli_DimensionalityReduction

ClassReallocationRaster.py: # otbcli_BandMath

DataBaseSuperposition.py: # otbcli_BandMath, otbcli_Rasterization

ImageCompression.py: # otbcli_BandMath, otbcli_ConcatenateImages

KmeansMaskApplication.py: # otbcli_BandMath, otbcli_KMeansClassification

MacroSamplesCreation.py: # otbcli_BandMath

MacroSamplesAmelioration.py:# otbcli_BandMath, otbcli_BinaryMorphologicalOperation

MajorityFilter.py: # otbcli_ClassificationMapRegularization

MaskCreation.py: # otbcli_BandMath, otbcli_Rasterization

MicroClassesFusion.py: # otbcli_BandMath

NeoChannelsComputation.py: # otbcli_BandMath, otbcli_HaralickTextureExtraction, otbcli_SplitImage

QualityIndicatorComputation.py:# otb otbcli_ComputeConfusionMatrix

SupervisedClassification.py: # otbcli_ComputeImagesStatistics, otbcli_TrainImagesClassifier, otbcli_ImageClassifier

Vectorization.py: # otbcli_band_math, otbcli_mean_shift_smoothing, otbcli_lsms_segmentation, otbcli_lsms_small_regions_merging, otbcli_lsms_vectorization

Page 19: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

June 2015 – Hackfest OTB - Toulouse

Exemple of result✔ Bordeaux Métropole ✔ 4 Pléiades couples images ✔ 4 DTS Digital Terrain Surface✔ Evaluation of urban density

Work station✔ CPU : xeon E5-2620 2,1 GHz✔ Memory : 12 Go + 12 Go swap

Computation time :✔ 300 hours

Page 20: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

June 2015 – Hackfest OTB - Toulouse

FeedBack

of CEREMA's team

FeedBack

of CEREMA's team

Page 21: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

June 2015 – Hackfest OTB - Toulouse

Feedback

Before comming, we meet each member of our 10 guys staff and interviewed them.

✔ BUG : we have made a list but we are unforgivable : we did not feed the Mantis

✔ Propositions of enhancement : ergonomics, calculation performance, new applications, enhacement of existing applications, otb applications in french,…

✔ need to complete documentation (in french, more examples and recepies,...)

✔ Outlook : OTB can be an integrated tool ? After classification, post-treatments (polygonization), opportunity for methodolgy sharing (forum, wiki, howto, tutorial,...)

Page 22: USING ORFEO TOOLBOX A GROWING COMPETENCE IN A COLLABORATIVE ENVIRONMENT

June 2015 – Hackfest OTB - Toulouse

CENTRE FOR EXPERTISE AND ENGINEERING ON RISKS, URBAN AND COUNTRY PLANNING, ENVIRONMENT AND MOBILITY

Dominique [email protected]

Gilles [email protected]

Thank you for your attention.