Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua...
-
Upload
jameson-clemence -
Category
Documents
-
view
223 -
download
3
Transcript of Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua...
![Page 1: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/1.jpg)
Tooth Segmentation on Dental Meshes
Using Morphologic Skeleton
Kan WUSchool of Software
Tsinghua University, P. R. of China
M.Eng. Li CHEN Ph.D.
CAD/Graphics 2013, Hong Kong
Jing LIDepartment of Orthodontics
Peking University School and Hospital of Stomatology, P. R. of China
Ph.D. Yanheng ZHOU Ph.D.
Computers & Graphics
![Page 2: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/2.jpg)
Background
our work
![Page 3: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/3.jpg)
Contribution
significantly reduced user interaction
avoid complex mesh feature estimation
an applicable pipeline for dental mesh segmentation
experiments on various clinical cases of different tooth
shapes and various levels of crowding problems
![Page 4: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/4.jpg)
Problems of Current Work
intensive interaction
affected by feature disturbance
not sufficiently accurate Kumar et al.
2011
Kronfeld et al.
2010
“3Shape”
![Page 5: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/5.jpg)
A Good Dental Segmentation Approach Should
locate teeth area automatically
separate adjacent teeth automatically
less dependent on complex feature estimation
smoothed & fitted boundary
morphologic
skeleton
![Page 6: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/6.jpg)
Why Morphologic Skeleton
insensitive to feature missing & disturbance
simplified approximation of mesh features
easy separation of adjacent objects
ACCURACY
EFFICIENCY
REDUCED INTERACTION
![Page 7: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/7.jpg)
Dental Mesh Segmentation Pipeline
![Page 8: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/8.jpg)
1st Step: Locating Teeth Parts
automaticplane cutting
region-growing
skeletonization
original mesh
![Page 9: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/9.jpg)
PCA-basedplane
initialization
energy field
1st Step: Locating Teeth Parts – (1)Estimating Cutting Plane
![Page 10: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/10.jpg)
(1)Estimating Cutting Plane – PCA-based Plane Initialization
Kronfeld et al., 2010
set of feature vertices
barycentric point
eigenvector corresponding to
the smallest eigenvalue
![Page 11: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/11.jpg)
weighted distance
feature pointsconnected to
v
(1)Estimating Cutting Plane – Energy Field
![Page 12: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/12.jpg)
skeleton
1st Step: Locating Teeth Parts – (2)Morphologic Skeletonization
curvature threshholdin
g
connectivity filtering
morphologicoperation
skeletonization
![Page 13: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/13.jpg)
original morphologic skeleton(Rossl et al., 2000)
improved morphologic skeleton
1st Step: Locating Teeth Parts – (2)Morphologic Skeletonization
![Page 14: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/14.jpg)
seed points
skeleton
1st Step: Locating Teeth Parts – (3)Region-Growing
![Page 15: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/15.jpg)
cut
2nd Step: Separating Teeth
![Page 16: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/16.jpg)
valid cutdiscarded cut
2nd Step: Separating Teeth – Various Scenarios
![Page 17: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/17.jpg)
2nd Step: Separating Teeth – Results
![Page 18: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/18.jpg)
3D contours
2D contours
sampled 2D contours sampled 3D contours
interpolated 3D contours
3rd Step: Smoothing Tooth Contours
![Page 19: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/19.jpg)
Direction Change Measure Length Change Measure
center point for contour
middle point
3rd Step: Smoothing Tooth Contours – 2D Sampling
![Page 20: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/20.jpg)
Direction Change Measures
Length Measures
sign(x) = 1 if x > 0, otherwise -1
3rd Step: Smoothing Tooth Contours – 2D Sampling
![Page 21: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/21.jpg)
Results – Mild Tooth Crowding
original model cutting planeestimation
skeletonization &
region-growing
separating &contour
smoothing
![Page 22: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/22.jpg)
Results – Moderate Tooth Crowding
original model cutting planeestimation
skeletonization &
region-growing
separating &contour
smoothing
![Page 23: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/23.jpg)
Results – Severe Tooth Crowding
original model cutting planeestimation
skeletonization &
region-growing
separating &contour
smoothing
![Page 24: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/24.jpg)
Results
![Page 25: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/25.jpg)
Results
![Page 26: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/26.jpg)
Results
![Page 27: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/27.jpg)
Kumar et al. 2011
Kronfeld et al. 2010
our approach
our approach
Comparative Results – Published Approaches
![Page 28: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/28.jpg)
when user interaction is not sufficiently accurate enough
“3Shape” Software
“3Shape” Software
our approach
our approach
Comparative Results – “3Shape” Software
![Page 29: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/29.jpg)
Accuracy Evaluation – Mean Errors
The mean errors that compare our results to manually labeled ground truth. The unit is mm.
![Page 30: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/30.jpg)
the distribution of particular error values across all segmented boundary vertices. The blue, yellow, red lines indicate the ranges of [0, 0.25], [0.25, 0.5], [0.5, 1.5], respectively.
Accuracy Evaluation – Error Distribution
![Page 31: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/31.jpg)
User Interaction Evaluation
Time consumed by user interactions. The blue and yellow lines indicate manual boundary completion and additional seed adding, respectively. The unit is s
![Page 32: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/32.jpg)
Limitations
a dental mesh benchmark
GPU accelerating
completely eliminate user interaction
Future Work
user interaction still needed
no GPU accelerating
![Page 33: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/33.jpg)
Demo
![Page 34: Tooth Segmentation on Dental Meshes Using Morphologic Skeleton Kan WU School of Software Tsinghua University, P. R. of China M.Eng. Li CHEN Ph.D. CAD/Graphics.](https://reader038.fdocuments.net/reader038/viewer/2022102716/5519d550550346047c8b4d6a/html5/thumbnails/34.jpg)
Kan WU ([email protected])
THANK YOU
Li CHEN ([email protected])
Jing LI ([email protected]) Yanheng ZHOU ([email protected])