Image-Based Anatomical Modeling Part I - Instituto...
Transcript of Image-Based Anatomical Modeling Part I - Instituto...
![Page 1: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/1.jpg)
Image-Based Anatomical Modeling Part I
![Page 2: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/2.jpg)
Summary
Part I – Fundamentals on IBAM
Definition of Image-Based Modeling Applications Types of volume data sets. 3D medical image visualization Image segmentation Mesh processing and adjustment techniques
Part II – Tutorial on IBAM
Software Pipeline 3D Modeling class
![Page 3: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/3.jpg)
Objectives
A – Understand what IBAM really is B – Why 3D anatomical models are important C – Reveal the stages of 3D modeling from images D – Able to use a freeware/opensource pipeline
![Page 4: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/4.jpg)
Image-Based Modeling
Creating a 3D model from a set of views
Why is a view so important?
![Page 5: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/5.jpg)
Image-Based Modeling G
EOM
ETRY
![Page 6: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/6.jpg)
Image-Based Modeling TO
POLO
GY
![Page 7: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/7.jpg)
Image-Based Modeling
![Page 8: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/8.jpg)
Image-Based Modeling
http://www.lugher3d.com/tutorials-for-maya/car-modeling-in-maya-videotutorial
![Page 9: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/9.jpg)
Image-Based Modeling
http://mastersketchup.com/sketchup-modeling-from-plans-and-elevations/
![Page 10: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/10.jpg)
Image-Based Modeling
![Page 11: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/11.jpg)
Image-Based Modeling
![Page 12: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/12.jpg)
Image-Based Modeling
http://www.thegnomonworkshop.com/store/product/133/Image-Based-Modeling%3A-Essentials#.VVs5V_lVhBc
![Page 13: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/13.jpg)
Image-Based Modeling
![Page 14: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/14.jpg)
Image-Based Modeling
"Image-based Tree Modeling, " Ping Tan, Gang Zeng, Jingdong Wang, Sing Bing Kang, Long Quan, ACM Transactions on Graphics 26(3) (Proc. SIGGRAPH 2007)
![Page 15: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/15.jpg)
Image-Based Anatomical Modeling
Creating anatomical models from a stack of medical images
Why is a medical image so important?
![Page 16: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/16.jpg)
Image-Based Anatomical Modeling
http://jnm.snmjournals.org/content/45/2/279/F2.expansion.html http://jnm.snmjournals.org/content/52/10/1501/F1.expansion.html http://jnm.snmjournals.org/content/51/8/1198/F3.expansion.html
![Page 17: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/17.jpg)
Anatomical Models
http://www.3ders.org/articles/20150512-chinese-doctors-use-3d-printed-spine-of-patient-to-help-in-delicate-spinal-surgery.html
![Page 18: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/18.jpg)
Applications
https://www.zygotebody.com/
![Page 19: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/19.jpg)
Sphere
Ellipsoid
Superellipsoid
Ovoid
Superovoid
sphere
ellipsoid
super ellipsoid
ovoid
super ovoid
Applications
traditional model
OR
alternative model
![Page 20: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/20.jpg)
Applications
Nuno J.G. dos Santos, Preliminary Biomechanical Studies on the Diaphragmatic Function in Control and Patients with Loss of Motor Units, M.Sc. Thesis, Instituto Superior Técnico, Universidade Técnica de Lisboa, 2009
![Page 21: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/21.jpg)
Applications
http://thehigherlearning.com/2014/08/25/a-chinese-boy-receives-first-3-d-printed-vertebra-implant-video/ http://www.hallpress.com/index.php/3d-printing-surgical-planning/
![Page 22: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/22.jpg)
Medical Data Types
http://www.imageclef.org/2015/medical
![Page 23: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/23.jpg)
Radiation Source Sensor Sample
CT X-Ray Tissue density (attenuation coefficient)
MRI Magnetic Field Proton density
Imaging
![Page 24: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/24.jpg)
Medical Image
![Page 25: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/25.jpg)
Medical Image File Format
(Digital Imaging and Communications in Medicine)
DICOM
*.dcm
![Page 26: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/26.jpg)
Image Navigation
![Page 27: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/27.jpg)
Volume Rendering
![Page 28: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/28.jpg)
Volume Rendering
http://www.dca.fee.unicamp.br/courses/IA369E/2s2010/projects/camillo_curado/algoritmos.html
![Page 29: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/29.jpg)
AIR
FAT MUSCLE
BONE
Num
ber o
f obs
erva
tions
Transfer Function
Input image intensity
![Page 30: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/30.jpg)
Transfer Function O
paci
ty
![Page 31: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/31.jpg)
Image Segmentation
![Page 32: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/32.jpg)
White = 1 (bone) Black = 0 (boundary) Blue = -1 (void)
Image Segmentation
![Page 33: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/33.jpg)
I = 0
Image Segmentation
![Page 34: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/34.jpg)
I = 30
Image Segmentation
![Page 35: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/35.jpg)
I = 60
Image Segmentation
![Page 36: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/36.jpg)
I = 90
Image Segmentation
![Page 37: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/37.jpg)
I = 120
Image Segmentation
![Page 38: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/38.jpg)
I = 290
ATTENTION: Over-Segmentation Sub-Segmentation
Image Segmentation
![Page 39: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/39.jpg)
Sub-Segmentation Over-Segmentation
Image Segmentation
![Page 40: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/40.jpg)
Image Segmentation
![Page 41: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/41.jpg)
Mesh Processing & Adjustments
![Page 42: Image-Based Anatomical Modeling Part I - Instituto ...web.ist.utl.pt/ist151462/MIT-PT-SBIM/IBAM_slides_Part I.pdf · Part I – Fundamentals on IBAM ... alternative model . ... (Digital](https://reader031.fdocuments.net/reader031/viewer/2022030420/5aa710b27f8b9a6d5a8bd2f5/html5/thumbnails/42.jpg)
References
N.S. Ribeiro, P.C.R. Fernandes, D.S. Lopes, J. Folgado and P.R. Fernandes, 3-D Solid and Finite Element Modeling of Biomechanical Structures – A Software Pipeline. ESMC2009 7th Euromech Solid Mechanics Conference, Lisboa, Portugal, September 2009. P. A. Yushkevich, J. Piven, H. C. Hazlett, R. G. Smith, S. Ho, J. C. Gee and G. Gerig, User-guided 3-D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage. 31(3): 1116-28, 2006. W. Lorensen and H. Cline, Marching Cubes: A high resolution 3-D surface construction algorithm. Computer Graphics. 21(4): 163-169, 1987. W. J. Schroeder, J. A. Zarge and W. E. Lorensen, Decimation of Triangle Meshes. Computer Graphics. (SIGGRAPH92 Proceedings): 65-70, 1992.