rpas for the generation of a common operational picture

F. Remondino – RPAS FOR THE GENERATION OF A COMMON OPERATIONAL PICTURE

RPAS FOR THE GENERATION OF A

COMMON OPERATIONAL PICTURE

Fabio REMONDINO

3D Optical Metrology (3DOM)

Bruno Kessler Foundation (FBK)

Trento, Italy

Email: [email protected]

http://3dom.fbk.eu

President of EuroSDR Commission I

President of ISPRS Commission V

With contributions from

Goerres Grenzdoerffer (Rostock Univ., Germany) and Markus Gerke (ITC / Twente Univ., The Netherlands)


– Not-for Profit Organisation (+ Member Organisation)

– Linking National Mapping and Cadastral Agencies with

Research Institutes and Universities

– Aim: Applied Research in Provision, Management and Delivery

of Spatial Data and Mapping Products

– Technical structure:

• Commission 1: Sensors, Primary Data Acquisition and Georeferencing

• Commission 2: Image Analysis and Information Extraction

• Commission 3: Production Systems and Processes

• Commission 4: Data Specifications

• Commission 5: Network Services

EuroSDR

European Spatial Data Research Network (EuroSDR)

http://eurosdr.net/


Scientific

Meetings Rolling Research Plan

Research Proposals Projects, Workshops, Taskforces

Reports

Engagement with Standards and Specifications Organisations

Official Publications and EduServ Courses

EuroSDR – Research & Dissemination

NMCAs Research

Organisations +

Transferring Results of Research to Mapping / Production Domain

Mapping Agencies together with Research Institutes

Leading in Calibration and Validation Initiatives


EuroSDR – The network idea

• Form a network of GI experts within EuroSDR

• Build and maintain alliances with neighbouring

organisations in GI research, development and practice:

– EuroGeographics

– ISPRS, ICA, FIG, AGILE

– INSPIRE

– JRC, OGC Europe, ISO TC 211, CEN TC 287

– ...

F. Remondino – RPAS FOR THE GENERATION OF A COMMON OPERATIONAL PICTURE 5

RPAS in EU

Hot topic at the moment

Growing in popularity and use but many open issues

RPAS can offer a wide range of civil applications for the benefit of

European citizens and businesses

RPAS can perform tasks that manned systems cannot perform,

either for safety or for economic reasons

Progressive development of the commercial drones market while

safeguarding the public interest

Current situation and actors: a multilayer system with many

stakeholders and no ideal coordination

EU Roadmap for the integration of civil RPAS into the European

Aviation System (http://ec.europa.eu/enterprise/sectors/aerospace/files/rpas-

roadmap_en.pdf)


RPAS in EU

Multilayer system:

Global level: ICAO (Int. Civil Aviation Organization), JARUS (Joint Authorities

for Rulemaking on Unmanned Systems)

EU level: European Union, European Aviation Safety Agency (EASA),

Eurocontrol, SESAR Joint Undertaking (SJU), European Defense Agency

(EDA), European Organization for Civil Aviation Equipment (EuroCAE)

National level: Member states, local authorities, federation of national drones

associations

This leads to

Fragmentation in the market - no strong EU market for RPAS

No coherent and continuous RPAS policy

Insufficient clarity between international, European and national layers

Incomplete regulatory framework

Missing links between R&D and regulation

Unclear civil – military relations


RPAS in EuroSDR

On-going activities since 2004 (Unconventional Earth observation

platforms including UAS)

RPAS is of interest for most NMCAs but few NMCAs already

accessed real RPAS data

So far none of the NMCAs has already fully integrated RPAS into

production lines

RPAS will not replace the traditional large format aerial sensors

for mapping purposes, but will be advantageous for local area

applications / small scale mapping projects, e.g.:

Cadastre updating

Environmental monitoring

Harmonized flight regulations throughout Europe will be the

requirement for further use of RPAS by NMCAs

MoU with UVS International


Ordnance Survey

Great Britain

Ordnance Survey

Ireland

Kadaster

Netherlands

Verification process of

cadastral borders of

ownership

Flexible mapping – low water surveys, erosion

documentation at sea coast / cliffs, high/low

watermark documentation

RPAS within NCMAs


9

IGN

France

LGL Baden-Württemberg

Germany

Land consolidation Dyke surveys, more

general use of RPAS

(own developments)

Finnish Geodetic

Institute Finland

Land monitoring,

hyperspectral

classification, research

RPAS within NCMAs


0.1 m 1 m 10 m 100 m 1 km 10 km 100 km 1000 km

10 Mil

1 Mil

100 000

10 000

1 000

100

10

1

Ob

ject

/ S

cen

e C

om

ple

xit

y [

po

ints

/ob

ject]

Object / Scene Size

Close-range

photogrammetry

and

terrestrial laser scanners

Aerial

photogrammetry

and LiDAR

Satellite

Remote Sensing

Tactile / CMM

Hand

measurements

Total stations

GNSS

RPAS

after [Boehler, 2001]

Surveying techniques & platforms


Platform types:

Balloons

Airship

Kite

model helicopter (electric or ICE)

fixed/rotary wing aircraft

solar powered

etc.

Onboard sensors:

navigation units (GPS/INS),

digital camera (compact or SRL, VIS or multispectral)

active sensors (laser scanner, Kinect, etc.)

Different open-source and low-cost solutions (HW and SW level)

Fastest growing remote sensing sector

Mainly driven by non-geospatial applications

RPAS issues


Point of interest for different communities:

Photogrammetry

Surveying / Cartography

Robotics / Computer vision

Artificial intelligence

Archaeology / Cultural Heritage

Geography / Geology

Forestry

Problems and limitations are still existing:

Payload

Size, Weight and Power (SWaP)

Instability

direct geo-referencing

Regulation under creation / harmonization at EU level (http://www2.isprs.org/commissions/comm1/icwg15b/resources.html)

RPAS issues


Terminology:

Drone

Remotely Piloted Aircraft Systems (RPAS)

Unmanned Aircraft Systems (UAS)

Remotely Piloted Vehicle (RPV)

Remotely Operated Aircraft (ROA)

Micro Aerial Vehicles (MAV)

Remote Controlled (RC) Helicopter

Model Helicopter, etc.

Typical requested products:

3D models

DSM/DTM

Orthoimages

Surveillance / Monitoring info (Energy, Environment, Agriculture, etc.)

Maps / Land cover

RPAS issues


DRONE

Terminology……..


UAV – Unmanned Autonomous Vehicle

Terminology……..


RPAS – Remotely Piloted Aerial Systems

Terminology……..


MAV – Micro Aerial Vehicle

Terminology……..


Range [km]

Altitude [

m]

1 10 100 1000 5000

100

1000

5000

10000

Micro

Mini

Close-range

Short-range

Low altitude endurance Medium altitude

long endurance

High altitude

long endurance

Swinglet-like

Multirotor-like

Model helicopter-like

Civil RPAS classification


Aeromao

Pteryx

Gatewing SenseFly CAM

SmartPlanes

Borjet Maja

Swinglet-like

Small RPAS platforms


Multirotor-like

Droidworx

DraganFly

OktoKopter

Aibotix

Heliprocam

NuvAero

GAUI ASCTEC Falcon

Microdrones



Helicam Autocopter

Edmonton

SYMA

SurveyCopter Aeroscout

Model Helicopter-like



Easy take-off, long range, self-powered

Crash proof, unlimited landing

Excellent navigation system

Collaborative navigation (swarms)

Courtesy of Graham Taylor et al. (Oxford

Univ.) and Holger Babinsky (Cambridge)

Unregulated RPAS platform


Everything can fly….


RPAS – Sensors integration


Natural hazards in EU countries

[Source: ESPON]

WILDFIRE LANDSLIDE EARTHQUAKE


RIVER FLOOD AVALANCHES AGGREGATED

hazard

Natural hazards in EU countries

Good reasons to think about RPAS as strategic for environmental monitoring and

surveillance applications [Source: ESPON]


Surveillance:

borders, roads, maritime, search & rescue, etc.

Monitoring / Surveying:

Infrastructures: electric power lines, solar panels, railways, dams, etc.

Environment: air pollution, traffic, terrain, mapping, etc.

Disasters: fires, floods, earthquakes, avalanches

Seasonal vs Sporadic vs Continuous

All possible applications are distributed in time and space → Good

reasons to think about RPAS as strategic for environmental

monitoring and surveillance applications

RPAS for safety-related applications


100 m

300 m

- Urban area surveyed for building reconstruction, map production, PV potential

estimation

- Microdrone platform MD4-200

- Flight height ca 100-125 m => GSD ca 4 cm => mapping scale: 1:200

- Overlap 80% - 40%

RPAS for Mapping Applications


Image triangulation results



Dense matching 3D reconstruction (point cloud)




Dense matching 3D

reconstruction (point cloud)



Point cloud, maps

and building 3D

models


3D reconstruction of a (rock / nickel) quarries for volume excavation monitoring

Flight plan Image triangulation Final textured 3D model

Image mosaic of the area Final textured 3D model



Multi-temporal 3D reconstructions of a archaeological area for volume excavation

Area of interest Derived DSM @ t1 Derived 3D point cloud @ t1

Geometric comparison

between 2011 (t1) and

2012 (t2) surveying



3D reconstructions of

post-earthquake

buildings for monitoring

and damage assessment




3D reconstructions of post-earthquake buildings for monitoring and damage

assessment


RPAS for “civil” applications


RPAS: security issues

../../../Users/aa/Videos/UAV_wedding.mp4


RPAS are really powerful platforms for mapping applications

RPAS promising solution for NMCAs needs but further investigation

and benchmarking are mandatory

Photogrammetric processing of RPAS images deliver very satisfactory

results but image block and quality play an important role

Applications varies from monitoring to inspection, from 3D

reconstruction to damage assessment, etc.

Open research issues: direct georeferencing, longer endurance,

higher payload, integration of multiple sensors, etc.

EuroSDR on-going activity on RPAS seeks for collaborations and

input datasets

Need to strengthen the use, awareness and acceptance of RPAS for

(emergency) mapping purposes

CONCLUSIONS


Platforms

Evolution (reliability, safety, automatic take-off & landing, stability, endurance,

better performances, fail safe functions, redundancy for motor dropout, etc.)

Sense & avoid

Access to charging points

On-board sensors

Privacy issues

Law / Regulation enforcement

Standardize communication (protocol and HW certification)

CHALLENGES FOR THE FUTURE


THANK YOU

Fabio REMONDINO

3D Optical Metrology (3DOM)

Bruno Kessler Foundation (FBK)

Trento, Italy

Email: [email protected]

http://3dom.fbk.eu

rpas for the generation of a common operational picture

Documents

Transcript of rpas for the generation of a common operational picture