Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR … · Fusion of...

14
| | Geosensors and Engineering Geodesy Institute of Geodesy and Photogrammetry E. Friedli, J. Banz, Z. Gojcic and A. Wieser 10.05.2018 FIG Congress 2018 - Istanbul - Turkey 1 Fusion of laser scanning and Photogrammetric data for the documentation and VR visualization of an archaeological tomb complex

Transcript of Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR … · Fusion of...

Page 1: Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR … · Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR Visualization

||Geosensors and Engineering Geodesy

Institute of Geodesy and Photogrammetry

E. Friedli, J. Banz, Z. Gojcic and A. Wieser

10.05.2018FIG Congress 2018 - Istanbul - Turkey 1

Fusion of laser scanning and Photogrammetric

data for the documentation and VR visualization

of an archaeological tomb complex

Presented at th

e FIG Congress 2018,

May 6-11, 2018 in

Ista

nbul, Turkey

Page 2: Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR … · Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR Visualization

||Geosensors and Engineering Geodesy

Institute of Geodesy and Photogrammetry10.05.2018FIG Congress 2018 - Istanbul - Turkey 2

Life Histories of Theban Tombs (LHTT)1

)1 Cooperation with Department of Ancient Civilizations, University of Basel, SNSF grant 162967, https://lhtt.philhist. unibas.ch/sheikh-abd-el-qurna

Goal: 3D Digital Reality with large coverage

and sub-mm resolution

Page 3: Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR … · Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR Visualization

||Geosensors and Engineering Geodesy

Institute of Geodesy and Photogrammetry10.05.2018FIG Congress 2018 - Istanbul - Turkey 3

Approach

▪ Fusion of TLS, Photogrammetry and close-up scans

▪ Selective coverage with highest resolution

Fotos: © University of Basel, LHTT Photos: M. Kačičnik

Page 4: Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR … · Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR Visualization

||Geosensors and Engineering Geodesy

Institute of Geodesy and Photogrammetry

Challenge:

Upper part not accessible with the scanner

Solution:

▪ 8 scans of the shaft (ladder)

▪ 98 pictures with SLR camera

mounted on a long pole for upper ¼

▪ Feature-based registration of

photogrammetric and TLS point clouds

(overlap only 15%)

10.05.2018FIG Congress 2018 - Istanbul - Turkey 4

Example: Narrow vertical shaft

© University of Basel, LHTT Photo: K. Powroznik

10 m

Page 5: Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR … · Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR Visualization

||Geosensors and Engineering Geodesy

Institute of Geodesy and Photogrammetry10.05.2018FIG Congress 2018 - Istanbul - Turkey 5

Workflow

TLS

point cloud

Photogrammetric

point cloud

Coarse scaling

Keypoint extraction

(Harris3D)

Keypoint matching

(K4-PCS)

Fine alignment

and scaling (ICP)

Registered

point clouds

Coarse alignment

Page 6: Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR … · Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR Visualization

||Geosensors and Engineering Geodesy

Institute of Geodesy and Photogrammetry10.05.2018FIG Congress 2018 - Istanbul - Turkey 6

Results

Page 7: Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR … · Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR Visualization

||Geosensors and Engineering Geodesy

Institute of Geodesy and Photogrammetry10.05.2018FIG Congress 2018 - Istanbul - Turkey 7

Results

2 m

vertical

cross section

horizontal

cross section

5 mm RMS

Page 8: Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR … · Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR Visualization

||Geosensors and Engineering Geodesy

Institute of Geodesy and Photogrammetry

Challenge

Fully textured 3D model

despite poor illumination, surface roughness,

and parts with little texture

Solution

▪ TLS for geometry (80 scans)

▪ RGB pictures (7000) with

SLR camera and flash for texture

▪ Fusion of TLS and photogrammetric point

clouds after color adjustment

and dense matching

10.05.2018FIG Congress 2018 - Istanbul - Turkey 8

Example: Funerary Chapel

© University of Basel, LHTT Map: G. Heindl, S. Stucky

© University of Basel, LHTT Photo: M. Kačičnik

9 m

18 m

Page 9: Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR … · Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR Visualization

||Geosensors and Engineering Geodesy

Institute of Geodesy and Photogrammetry10.05.2018FIG Congress 2018 - Istanbul - Turkey 9

Workflow 1 (Geometry)

TLS

point cloud

Photogrammetric

point cloud

Coarse scaling

Keypoint extraction

(Harris3D)

Keypoint matching

(K4-PCS)

Fine alignment

and scaling (ICP)

Registered

point clouds

Coarse alignment

Page 10: Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR … · Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR Visualization

||Geosensors and Engineering Geodesy

Institute of Geodesy and Photogrammetry10.05.2018FIG Congress 2018 - Istanbul - Turkey 10

Workflow 2 (Texture)

TLS

mesh

Oriented and

calibrated images

Creation of

texture atlas

Textured

TLS mesh

Page 11: Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR … · Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR Visualization

||Geosensors and Engineering Geodesy

Institute of Geodesy and Photogrammetry10.05.2018FIG Congress 2018 - Istanbul - Turkey 11

Texture Atlas

Atlas

Page 12: Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR … · Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR Visualization

||Geosensors and Engineering Geodesy

Institute of Geodesy and Photogrammetry10.05.2018FIG Congress 2018 - Istanbul - Turkey 12

Workflow 3 (Reduction of resolution)

Challenge:

Resulting textured model too large

for RT visualization (25M faces)

Solution:

▪ Decimation of TLS mesh

▪ Calculation of bump maps

▪ New texture atlas:

Shading from bump map

plus original texture

Page 13: Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR … · Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR Visualization

||Geosensors and Engineering Geodesy

Institute of Geodesy and Photogrammetry10.05.2018FIG Congress 2018 - Istanbul - Turkey 13

Workflow 3 (Reduction of resolution)

original resolution (25 Mio faces)decimated resolution (22k faces)decimated resolution (22k)

with bump map from the original resolution

Page 14: Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR … · Fusion of Laser Scanning and Photogrammetric Data for the Documentation and VR Visualization

||Geosensors and Engineering Geodesy

Institute of Geodesy and Photogrammetry10.05.2018FIG Congress 2018 - Istanbul - Turkey 14

Conclusion

▪ Multi-modal data acquisition

for generation of 3d models

with appropriate properties

▪ Variety of sensors for obtaining

point clouds and colors

▪ Key are coregistration and blending

▪ Presented herein purely data driven

approach for scaling and registration

▪ RT visualization using techniques

from gaming industry and CG