Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua...

34
Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics 2013, Hong Kong Jing LI Department of Orthodontics Peking University School and Hospital of Stomatology, P. R. of China Ph.D. Yanheng ZHOU Ph.D. Computers & Graphics

Transcript of Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua...

Page 1: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Tooth Segmentation on Dental Meshes

Using Morphologic Skeleton

Kan WUSchool of Software

Tsinghua University, P. R. of China

M.Eng. Li CHEN Ph.D.

CAD/Graphics 2013, Hong Kong

Jing LIDepartment of Orthodontics

Peking University School and Hospital of Stomatology, P. R. of China

Ph.D. Yanheng ZHOU Ph.D.

Computers & Graphics

Page 2: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Background

our work

Page 3: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Contribution

significantly reduced user interaction

avoid complex mesh feature estimation

an applicable pipeline for dental mesh segmentation

experiments on various clinical cases of different tooth

shapes and various levels of crowding problems

Page 4: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Problems of Current Work

intensive interaction

affected by feature disturbance

not sufficiently accurate Kumar et al.

2011

Kronfeld et al.

2010

“3Shape”

Page 5: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

A Good Dental Segmentation Approach Should

locate teeth area automatically

separate adjacent teeth automatically

less dependent on complex feature estimation

smoothed & fitted boundary

morphologic

skeleton

Page 6: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Why Morphologic Skeleton

insensitive to feature missing & disturbance

simplified approximation of mesh features

easy separation of adjacent objects

ACCURACY

EFFICIENCY

REDUCED INTERACTION

Page 7: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Dental Mesh Segmentation Pipeline

Page 8: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

1st Step: Locating Teeth Parts

automaticplane cutting

region-growing

skeletonization

original mesh

Page 9: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

PCA-basedplane

initialization

energy field

1st Step: Locating Teeth Parts – (1)Estimating Cutting Plane

Page 10: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

(1)Estimating Cutting Plane – PCA-based Plane Initialization

Kronfeld et al., 2010

set of feature vertices

barycentric point

eigenvector corresponding to

the smallest eigenvalue

Page 11: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

weighted distance

feature pointsconnected to

v

(1)Estimating Cutting Plane – Energy Field

Page 12: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

skeleton

1st Step: Locating Teeth Parts – (2)Morphologic Skeletonization

curvature threshholdin

g

connectivity filtering

morphologicoperation

skeletonization

Page 13: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

original morphologic skeleton(Rossl et al., 2000)

improved morphologic skeleton

1st Step: Locating Teeth Parts – (2)Morphologic Skeletonization

Page 14: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

seed points

skeleton

1st Step: Locating Teeth Parts – (3)Region-Growing

Page 15: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

cut

2nd Step: Separating Teeth

Page 16: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

valid cutdiscarded cut

2nd Step: Separating Teeth – Various Scenarios

Page 17: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

2nd Step: Separating Teeth – Results

Page 18: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

3D contours

2D contours

sampled 2D contours sampled 3D contours

interpolated 3D contours

3rd Step: Smoothing Tooth Contours

Page 19: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Direction Change Measure Length Change Measure

center point for contour

middle point

3rd Step: Smoothing Tooth Contours – 2D Sampling

Page 20: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Direction Change Measures

Length Measures

sign(x) = 1 if x > 0, otherwise -1

3rd Step: Smoothing Tooth Contours – 2D Sampling

Page 21: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Results – Mild Tooth Crowding

original model cutting planeestimation

skeletonization &

region-growing

separating &contour

smoothing

Page 22: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Results – Moderate Tooth Crowding

original model cutting planeestimation

skeletonization &

region-growing

separating &contour

smoothing

Page 23: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Results – Severe Tooth Crowding

original model cutting planeestimation

skeletonization &

region-growing

separating &contour

smoothing

Page 24: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Results

Page 25: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Results

Page 26: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Results

Page 27: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Kumar et al. 2011

Kronfeld et al. 2010

our approach

our approach

Comparative Results – Published Approaches

Page 28: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

when user interaction is not sufficiently accurate enough

“3Shape” Software

“3Shape” Software

our approach

our approach

Comparative Results – “3Shape” Software

Page 29: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Accuracy Evaluation – Mean Errors

The mean errors that compare our results to manually labeled ground truth. The unit is mm.

Page 30: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

the distribution of particular error values across all segmented boundary vertices. The blue, yellow, red lines indicate the ranges of [0, 0.25], [0.25, 0.5], [0.5, 1.5], respectively.

Accuracy Evaluation – Error Distribution

Page 31: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

User Interaction Evaluation

Time consumed by user interactions. The blue and yellow lines indicate manual boundary completion and additional seed adding, respectively. The unit is s

Page 32: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Limitations

a dental mesh benchmark

GPU accelerating

completely eliminate user interaction

Future Work

user interaction still needed

no GPU accelerating

Page 33: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Demo

Page 34: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.

Kan WU ([email protected])

THANK YOU

Li CHEN ([email protected])

Jing LI ([email protected]) Yanheng ZHOU ([email protected])