Vertical surface processing from integrated MBES – lidar data

61
Vertical surface processing from integrated MBES –lidar data Eli Leblanc, Mathieu Rondeau & Jean-Guy Nistad CARIS 2012

description

CARIS 2012. Vertical surface processing from integrated MBES – lidar data. Eli Leblanc, Mathieu Rondeau & Jean-Guy Nistad. Introduction. In the last few years, CIDCO has been developing expertise in port infrastructure inspection - PowerPoint PPT Presentation

Transcript of Vertical surface processing from integrated MBES – lidar data

Page 1: Vertical surface processing from integrated MBES – lidar  data

Vertical surface processing from integrated MBES –lidar data

Eli Leblanc, Mathieu Rondeau & Jean-Guy Nistad

CARIS 2012

Page 2: Vertical surface processing from integrated MBES – lidar  data

Introduction

• In the last few years, CIDCO has been developing expertise in port infrastructure inspection

– Current method: subjective and partial observations from divers

– CIDCO method: objective, full coverage and efficient sonar-lidar 3D dataset

Page 3: Vertical surface processing from integrated MBES – lidar  data

Introduction

Page 4: Vertical surface processing from integrated MBES – lidar  data

Introduction

• For the first time, port management bodies have a full view of the submerged part of their structures

• Precious information tobetter plan maintenanceand repair

Page 5: Vertical surface processing from integrated MBES – lidar  data

Introduction

• 3D points cloud is not easily usable by engineers

• Uncertainty on the sonar 3D dataset exceeds the clients specifications of 5 cm

• Vertical surfaceprocessing is not yetsupported in CARIS HIPS

Page 6: Vertical surface processing from integrated MBES – lidar  data

Introduction

• 3D points cloud is not easily usable by engineers

• Uncertainty on the sonar 3D dataset exceeds the clients specifications of 5 cm

• Vertical surfaceprocessing is not yetsupported in CARIS HIPS

Page 7: Vertical surface processing from integrated MBES – lidar  data

Introduction

• 3 solutions were tested1) Vessel file roll bias (HIPS)

2) Inverse-distance WMA filter (HIPS-Matlab)

3) XTF files rotation (Matlab-HIPS)

Page 8: Vertical surface processing from integrated MBES – lidar  data

Dataset

• Port of Montréal• November 2011• 30° tilted MBES Reson Seabat 7125 • Data recorded in xtf format

Page 9: Vertical surface processing from integrated MBES – lidar  data

Dataset

GPS

LiDARScanner

Camera

IMU

Reson 7125 SV30° starboard tilted

ALMIS 350

Page 10: Vertical surface processing from integrated MBES – lidar  data

Dataset

Page 11: Vertical surface processing from integrated MBES – lidar  data

1) Vessel file roll bias

• 90° roll bias applied to the vessel file during merging → HIPS

• BASE surface → HIPS

Page 12: Vertical surface processing from integrated MBES – lidar  data

1) Vessel file roll bias

• Original sonar data (observed depths)

Page 13: Vertical surface processing from integrated MBES – lidar  data

1) Vessel file roll bias

• Step 1: 90° roll bias in the vessel file

Page 14: Vertical surface processing from integrated MBES – lidar  data

1) Vessel file roll bias

• Step 1: Sound velocity correction

Page 15: Vertical surface processing from integrated MBES – lidar  data

1) Vessel file roll bias

• Step : Merge the line (processed depths)

Page 16: Vertical surface processing from integrated MBES – lidar  data

1) Vessel file roll bias

• Step 3: Merge the line

Page 17: Vertical surface processing from integrated MBES – lidar  data

1) Vessel file roll bias

• Step 4: Remove the seabed

Page 18: Vertical surface processing from integrated MBES – lidar  data

1) Vessel file roll bias

• Step 5: Create a BASE surface– Swath angle, 10 cm

Page 19: Vertical surface processing from integrated MBES – lidar  data

1) Vessel file roll bias

• Limits– Roll bias applied in sonar referential at each

ping rather than at a fixed rotation point• Distortion• Impossible to process multiple lines

Page 20: Vertical surface processing from integrated MBES – lidar  data

1) Vessel file roll bias

• Limits– Roll bias applied in sonar referential at each

ping rather than at a fixed rotation point• Distortion• Impossible to process multiple lines

Page 21: Vertical surface processing from integrated MBES – lidar  data

2) Inverse-distance WMA filter

• Data merging → HIPS

• Filtering and surface meshing → Matlab

Page 22: Vertical surface processing from integrated MBES – lidar  data

2) Inverse-distance WMA filter

• Step 1: Export merged data from HIPS and load them in Matlab

Page 23: Vertical surface processing from integrated MBES – lidar  data

• Step 2: Remove the seabed (depth threshold)

2) Inverse-distance WMA filter

Page 24: Vertical surface processing from integrated MBES – lidar  data

• Step 2: Model the infrastructure axis and rotate around z

2) Inverse-distance WMA filter

θaxis

y

x

Page 25: Vertical surface processing from integrated MBES – lidar  data

2) Inverse-distance WMA filter

• Inverse-distance weight moving average filter (10 cm, r = 14.14 cm)

Infrastructure axis (m)

Alti

tude

(m

)

20 40 60 80 100 120 140

-6-4-20

-0.500.5

Infrastructure axis (m)

Alti

tude

(m

)

65 70 75 80 85 90 95 100 105 110 115

-6

-4

-2

0

-0.5

0

0.5

Page 26: Vertical surface processing from integrated MBES – lidar  data

2) Inverse-distance WMA filter

• Limits of the method– Costly in computation time

• 4 lines = 150 m = 750 000 soundings = 30 minutes

– Possible memory problems for larger datasets– No shadow effects or texture

Infrastructure axis (m)

Alti

tude

(m

)

65 70 75 80 85 90 95 100 105 110 115

-6

-4

-2

0

-0.5

0

0.5

Page 27: Vertical surface processing from integrated MBES – lidar  data

3) XTF files rotation

• 90° rotation applied on xtf files → Matlab

• Data cleaning, merging and BASE surface → HIPS

Page 28: Vertical surface processing from integrated MBES – lidar  data

• Step 1: Extract fields from xtf files– For each swath

• x-y coordinates• Pitch, roll, heave,

heading

– For each sounding• Two-way travel time• Angle

3) XTF files rotation

(x,y)z

yx

(t,θ)

θ t

Page 29: Vertical surface processing from integrated MBES – lidar  data

• Step 2: Model the infrastructure axis and rotate around z

3) XTF files rotation

θaxis

θheading θ'heading

axisheadingheading '

y

x

Page 30: Vertical surface processing from integrated MBES – lidar  data

• Step 3: Compute range

3) XTF files rotation

2

ctR

z

y

x

heav

e

(x,y)sonar

(t,θ)sounding

θ

R

Page 31: Vertical surface processing from integrated MBES – lidar  data

3) XTF files rotation

• Step 4: Project (x,y)sonar across swathz

y

x

heav

e

(x,y)sonar

(x,y,z)sounding

θ

sonarsounding xx

sinRysounding

heaveRz cos R

Page 32: Vertical surface processing from integrated MBES – lidar  data

• Step 5: Rotate around x (90°)

3) XTF files rotation

z

yx

yz

zy

z

yx

90°

Page 33: Vertical surface processing from integrated MBES – lidar  data

• Step 5: Rotate around x (90°)

3) XTF files rotation

z

yx

yz

zy

z

yx

90°

Page 34: Vertical surface processing from integrated MBES – lidar  data

• Step 5: Rotate around x (90°)

3) XTF files rotation

z

yx

yz

zy

z

yx

90°

Page 35: Vertical surface processing from integrated MBES – lidar  data

• Step 6: Edit θ

3) XTF files rotation

z

y

x

θ'

θ

)90('

Page 36: Vertical surface processing from integrated MBES – lidar  data

• Step 7: Edit navigation - (x,y)sonar

– x coordinates → infrastructure axis

3) XTF files rotation

y'

x'

Page 37: Vertical surface processing from integrated MBES – lidar  data

• Step 7: Edit navigation - (x,y)sonar

– y coordinates

3) XTF files rotation

90°

y

zx

z

yx

sonaryheave '

Page 38: Vertical surface processing from integrated MBES – lidar  data

• Step 7: Edit navigation - (x,y)sonar

– y coordinates

3) XTF files rotation

(x,y)’sonar

''' sinRyy soundingsonar

z

y

x

R(x,y,z)’sounding

θ'

θ heaveRz

zy sounding

cos

'

Page 39: Vertical surface processing from integrated MBES – lidar  data

• Step 8: Edit attitude angles (Pitch)– x-z plane– x to horizontal axis

3) XTF files rotation

z

yx

z

xy

θpitch

Page 40: Vertical surface processing from integrated MBES – lidar  data

• Step 8: Edit attitude angles (Pitch)– x-z plane– x to horizontal axis

3) XTF files rotation

90°

z

xy

z

xy

θpitch

Page 41: Vertical surface processing from integrated MBES – lidar  data

• Step 8: Edit attitude angles (Pitch)– x-z plane– x to horizontal axis

3) XTF files rotation

z

xy

z x

y

θpitch

θ’heading

pitchheading 90'

Page 42: Vertical surface processing from integrated MBES – lidar  data

• Step 8: Edit attitude angles (Heading)– x-y plane– y to horizontal axis

3) XTF files rotation

y

z x

y

z x

θheading

Page 43: Vertical surface processing from integrated MBES – lidar  data

• Step 8: Edit attitude angles (Heading)– x-y plane– y to horizontal axis

3) XTF files rotation

90°

θheading

y

z x

y

z x

Page 44: Vertical surface processing from integrated MBES – lidar  data

• Step 8: Edit attitude angles (Heading)– x-y plane– y to horizontal axis

3) XTF files rotation

z

y x

θheading

θ'pitch

y

z x

)90(' headingpitch

Page 45: Vertical surface processing from integrated MBES – lidar  data

• Step 8: Edit attitude angles (roll)– y-z plane– z to vertical axis

3) XTF files rotation

z

yx

z

yx

θroll

Page 46: Vertical surface processing from integrated MBES – lidar  data

• Step 8: Edit attitude angles (roll)– y-z plane– z to vertical axis

z

yx

θroll

3) XTF files rotation

z

yx

θ'roll

rollroll '

90°

Page 47: Vertical surface processing from integrated MBES – lidar  data

• Step 9: Edit fields to create new xtf files– For each swath

• x-y coordinates• Pitch, heave, heading

– For each sounding• Beam angle

3) XTF files rotation

Page 48: Vertical surface processing from integrated MBES – lidar  data

3) XTF files rotation

• Step 10: Create a BASE surface in HIPS– Swath angle, 10 cm

Page 49: Vertical surface processing from integrated MBES – lidar  data

3) XTF files rotation

• Limits of the method– Sound velocity cannot be corrected in HIPS

• SVC in Matlab would imply correcting for attitude

– TPU would have to be investigated to use CUBE

Page 50: Vertical surface processing from integrated MBES – lidar  data

Discussion

• Comparison of methodsMethod 90° roll bias WMA filter XTF rotation

Page 51: Vertical surface processing from integrated MBES – lidar  data

Discussion

• Comparison of methodsMethod 90° roll bias WMA filter XTF rotation

Complexity of implementation Low Medium High

Page 52: Vertical surface processing from integrated MBES – lidar  data

Discussion

• Comparison of methodsMethod 90° roll bias WMA filter XTF rotation

Complexity of implementation Low Medium High

Processing time Low Very high Medium

Page 53: Vertical surface processing from integrated MBES – lidar  data

Discussion

• Comparison of methodsMethod 90° roll bias WMA filter XTF rotation

Complexity of implementation Low Medium High

Processing time Low Very high Medium

Distorsion Yes No No

Page 54: Vertical surface processing from integrated MBES – lidar  data

Discussion

• Comparison of methodsMethod 90° roll bias WMA filter XTF rotation

Complexity of implementation Low Medium High

Processing time Low Very high Medium

Distorsion Yes No No

SVC Yes Yes No

Page 55: Vertical surface processing from integrated MBES – lidar  data

Discussion

• Comparison of methodsMethod 90° roll bias WMA filter XTF rotation

Complexity of implementation Low Medium High

Processing time Low Very high Medium

Distorsion Yes No No

SVC Yes Yes No

Multiple lines No Yes Yes

Page 56: Vertical surface processing from integrated MBES – lidar  data

Discussion

• Comparison of methodsMethod 90° roll bias WMA filter XTF rotation

Complexity of implementation Low Medium High

Processing time Low Very high Medium

Distorsion Yes No No

SVC Yes Yes No

Multiple lines No Yes Yes

Detailed view Yes No Yes

Page 57: Vertical surface processing from integrated MBES – lidar  data

Discussion

• Comparison of methodsMethod 90° roll bias WMA filter XTF rotation

Complexity of implementation Low Medium High

Processing time Low Very high Medium

Distorsion Yes No No

SVC Yes Yes No

Multiple lines No Yes Yes

Detailed view Yes No Yes

Texture Yes No Yes

Page 58: Vertical surface processing from integrated MBES – lidar  data

Discussion

• Comparison of methodsMethod 90° roll bias WMA filter XTF rotation

Complexity of implementation Low Medium High

Processing time Low Very high Medium

Distorsion Yes No No

SVC Yes Yes No

Multiple lines No Yes Yes

Detailed view Yes No Yes

Texture Yes No Yes

CUBE Yes No No

Page 59: Vertical surface processing from integrated MBES – lidar  data

Discussion

• Comparison of methods

90° roll bias

Infrastructure axis (m)

Alti

tude

(m

)

30 40 50 60 70 80

-6

-4

-2

0

-0.5

0

0.5

WMA filter

XTF rotation

Page 60: Vertical surface processing from integrated MBES – lidar  data

Conclusion

• 3 methods were tested to process vertical surfaces– 1) Vessel file roll bias (HIPS)

• Distorsion makes it unusable

– 2) Inverse-distance WMA filter (HIPS-Matlab)• Long to process• Less details and no texture

– 3) XTF files rotation (Matlab-HIPS)• Promising• Needs further development (SVC,CUBE,LAS)

Page 61: Vertical surface processing from integrated MBES – lidar  data

Questions?