Reality Modeling. Utilizing Drone and Aerial...

43
NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 1 Reality Modeling: Utilising Drone and Aerial Photos November 2017 Presenter: Jerard Marsh

Transcript of Reality Modeling. Utilizing Drone and Aerial...

Page 1: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 1

Reality Modeling:Utilising Drone and Aerial Photos November 2017

Presenter: Jerard Marsh

Page 2: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 2

Quick poll

– ContextCapture users ?

– Other Bentley reality modeling product users ?

– Total beginners ?

– Persons in charge of data capture ?

– Persons consuming reality modeling data ?

Introduction

Page 3: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

WWW.BENTLEY.COM I © 2016 Bentley Systems, Incorporated I 3WWW.BENTLEY.COM I © 2016 Bentley Systems, Incorporated I 3

What is Reality Modeling ?

Page 4: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 4

What is reality modeling ?

Capturing existing conditions in 3D using one or a combination devices. (UAVs, Handheld Camera, Laser Scanner)

to support different applications such as

Mapping, Design, Construction, Inspection and Asset Management

Page 5: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 5

Page 6: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 6

Asset Lifecycle

Why Model Reality?

Identify Need /

Objectives /

Risk

Service /

Performance

Standards Demand /

Load

Forecasts

Funding /

Economic

Modeling

Procurement

Construction

CommissioningOperation

Service

Delivery

Deterioration

and

Maintenance

Condition

Performance

Monitoring

Decomission

Renewal /

Replacement

Understand the

existing conditions

Changes

detection

Risk

management

Document construction

Virtual

Inspection

Visual Operation

Training and

simulation

Page 7: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 7

Asset Lifecycle

Why Model Reality?

Identify Need /

Objectives /

Risk

Service /

Performance

Standards Demand /

Load

Forecasts

Funding /

Economic

Modeling

Procurement

Understand the

existing conditions

Risk

management

Page 8: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 8

Asset Lifecycle

Why Model Reality?

Construction

CommissioningOperation

Service

Delivery

Changes

detection

Document construction

Page 9: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 9

Asset Lifecycle

Why Model Reality?

Deterioration

and

Maintenance

Condition

Performance

Monitoring

Decommission

Renewal /

Replacement

Visual Operation

Training and

simulation

Page 10: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 10

Asset Lifecycle

Why Model Reality?

Deterioration

and

Maintenance

Condition

Performance

Monitoring

Decommission

Renewal /

Replacement

Virtual

Inspection

Page 11: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 11

Unlimited Scalability

Why Model Reality?

Page 12: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

WWW.BENTLEY.COM I © 2016 Bentley Systems, Incorporated I 12WWW.BENTLEY.COM I © 2016 Bentley Systems, Incorporated I 12

Example Aerial Models

Page 13: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 13

Infrastructure | Petrochemical Plant

Page 14: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 14

Urban Planning | Aligning Conceptual Design With Reality

Page 15: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 15

Surveying | Building Conditions and Roof Structures

Page 16: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 16

Transportation | As-Built Structures Modeling

Page 17: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 17

Surveying | Stockpile Volume Measurement

Page 18: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 18

Communication | Illustration of Disaster Impacts

Page 19: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

WWW.BENTLEY.COM I © 2016 Bentley Systems, Incorporated I 19WWW.BENTLEY.COM I © 2016 Bentley Systems, Incorporated I 19

Mixing aerial and ground

photography

Page 20: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 20

Page 21: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 21

The interest of the fusion

• Mixing dataset from

different point of view

• Covering the model from

all angles

• Mixing dataset at different

resolution

Page 22: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 22

Two workflows

• Workflow 1 : mixing dataset that are too different to be matched automatically.

• Workflow 2 : mixing dataset that are difficult to mix fully automatically.

Page 23: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 23

Two workflows

• Workflow 1 : mixing dataset that are too different to be matched automatically

� Create two independent blocks (or more) : Block_1 / Block_2

� Process AT separately on each of this block.

� Create user tie-points in Block_1 (at least 3). It should be visible in the photos of Block_2 as

well.

� Export the tie-point list in a txt file.

� Import the tie-points as control points in Block_2

� Perform the control points measurement in Block_2

� Resubmit Block_2 AT and choose “use control points for rigid registration”

� Merge both blocks

� Create a reconstruction (adaptive tiling)

� Submit production

Page 24: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 24

Workflow 1

� Create two independent blocks (or more) : Block_1 / Block_2

Page 25: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 25

Workflow 1

� Process AT separately on each of this block.

Page 26: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 26

Workflow 1

� Create user tie-points in Block_1 (at least 3). It should be visible in the photos of Block_2 as well.

Page 27: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 27

Workflow 1

� Export the tie-point list in a txt file.

Page 28: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 28

Workflow 1

� Import the tie-points as control points in Block_2

Page 29: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 29

Workflow 1� Perform the control points measurement in Block_2

Page 30: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 30

Workflow 1

� Resubmit Block_2 AT and choose “use control points for rigid registration”

Page 31: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 31

Workflow 1

� Merge both blocks

Page 32: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 32

Workflow 1

� Create a reconstruction (adaptive tiling)

Page 33: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 33

Two workflows

• Workflow 2 : mixing dataset that are difficult to mix fully automatically

� Create two independent blocks (or more) : Block_1 / Block_2

� Process AT separately on each of this block.

� Geo-reference both blocks separately (GPS tags, control points, control points extracted

from one block using tie-points).

� Merge both blocks

� Set the block type to “structured aerial dataset”

� Submit a new AT of the merged block

� Create a reconstruction (adaptive tiling)

� Submit production

Page 34: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 34

Workflow 2

� Create two independent blocks (or more) : Block_1 / Block_2

Page 35: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 35

Workflow 2

� Geo-reference both blocks separately (GPS tags, control points, control

points extracted from one block using tie-points).

Page 36: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 36

Workflow 2

� Merge both blocks

Page 37: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 37

Workflow 2

� Set the block type to “structured aerial dataset”

When a block type is set to structured aerial data and all the photos have position and rotation information,

a tilt ratio is applied to help the keypoint matching of oblique and Nadir photos. Oblique photos will be

shrunk so that the horizontal surfaces will be similar to the nadir photos.

Page 38: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 38

Workflow 2

� Submit a new AT on the merged block

Page 39: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 39

Workflow 2

� Create a reconstruction (adaptive tiling)

Page 40: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 40

Workflow 2

� Submit production

Page 41: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 41

Demo

Page 42: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 42

Any questions?

Page 43: Reality Modeling. Utilizing Drone and Aerial Photosbentleyuser.dk/sites/default/files/files/a3_-_reality...Microsoft PowerPoint - Reality Modeling. Utilizing Drone and Aerial Photos.ppsx

NOT FOR DISTRIBUTION, CONFIDENTIAL I © 2014 Bentley Systems, Incorporated I 43