NA-MIC National Alliance for Medical Image Computing ABC: Atlas-Based Classification Marcel...

24
NA-MIC National Alliance for Medical Image Computing http://na-mic.org ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing and Imaging Institute University of Utah

Transcript of NA-MIC National Alliance for Medical Image Computing ABC: Atlas-Based Classification Marcel...

Page 1: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

NA-MICNational Alliance for Medical Image Computing http://na-mic.org

ABC: Atlas-Based Classification

Marcel Prastawa and Guido Gerig

Scientific Computing and Imaging Institute

University of Utah

Page 2: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

Atlas Based Classification

ABC

Atlas template with spatial priors for tissue categories

Page 3: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

Tissue Classification

Atlas to subject warping

Inhomogeneity correction

ABC: Fully Automatic WorkflowSpatial normalization (linear): intermodality, atlas

Page 4: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

• K. Van Leemput, F. Maes, D. Vandermeulen, P. Suetens, P., Automated model-based tissue classification of MR images of the brain, IEEE TMI, 18(10) 1999

• N. Moon, E. Bullitt, K. van Leemput, G. Gerig, Automatic Brain and Tumor Segmentation, Proc. MICCAI ‘02, Springer LNCS 2488, 09/2002

ABC: Properties• Fully automatic, no user interaction required

• Repeatable, reproducible results

• Arbitrary #channels/modalities: Co-registration

• Integrates brain stripping, bias correction and segmentation into one optimization framework ≠ set of separate procedures

• Atlas to subject warping: diffeomorphic fluid flow registration

• Generic framework: Needs image(s) and prob. atlas → RUN

• Rigorous validation and testing

• Run time: Affine atlas matching: 0.5h, deformable: 2-3hrs

• In progress: Extension to pathologies

Page 5: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

Typical Output: Registration and Segmentation of T1/T2

3D wm surface

3D cortical surface

T1 T2 Brain Tissue

T1 T2 Brain Tissue

Page 6: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

“Byproduct”: Bias inhomogeneity correction

T1 registered Corrected image Bias field

3T

1.5T

Page 7: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

“Byproduct”: Brain Stripping

MRI segmentation: ICV as result of brain segmentation (gm+wm+csf)

DTI: Brain masking via tissue segmentation of B0 image.

Page 8: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

“Byproduct”: Co-Registration of structural MRI for visualizing multi-contrast data

MPrage+gad GRE-bleed TSE FLAIR SWI

TBI case courtesy J. v Horn , D. Hovda, UCLA

Page 9: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

ABC in human traveling phantom across-site MRI calibration

phan1_chop phan1_sea

phan1_unc phan1_unc_res

phan1_washu_cli phan1_washu_res

phan2_chop phan2_sea

phan2_unc phan2_unc_res

phan2_washu_cli phan2_washu_res

0

200000

400000

600000

800000

1000000

1200000

1400000

1600000

1800000

ACE IBIS Living Phantom tissue segmentation volumes

WMGMICV

Sites

Vol

um

e

Phantom1 Phantom2

Courtesy ACE-IBIS autism study, Piven, UNC

MRI and DTI scans of 2 traveling phantoms annually at 6 sites

Robust framework for detecting calibration errors

Page 10: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

Typical Clinical Study

Drug addition, effects on brain morphometry and function (sMRI/DTI)

Yale: Linda Mayes, Marc Potenza

UNC: Joey Johns Utah: Gerig/Gouttard

ABC automatically processes MR datasets

Page 11: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

Application: Basic Segmentation with T1 only

T1 Brain Tissue

T1 Brain Tissue

Page 12: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

Application: Lobe Parcellation

Use nonlinear registration of template to map parcellation in atlas space

Table of gm/wm/csf per lobe -> biostatistical analysis

Page 13: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

Application: multi-modal sMRI of TBI case

MPrage+gad GRE-bleed TSE FLAIR SWI Brain/csf segmentation

ABC performs co-registration of all input modalities (here 5 MRI channels) and atlas-based segmentation of brain tissue and csf. Bias-correction (all modalities) and brain-stripping is an integrative, automatic part of ABC. White matter lesions and ventricles were segmented via postprocessing using level-set segmentation. MRI data courtesy of UCLA (John Van Horn and David Hovda).

Page 14: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

Application: Joint analysis of sMRI and DTI

• Co-registration of structural modalities to DTI (baseline image registered to TSE) using ABC.

• DTI tensor field and structural images available in same coordinate system.

DTI (mean diffusivity) TSE GRE-bleed Segmentation

Page 15: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

ABC and Slicer-3: Tractography and joint display of segmented objects and MRI

• Tractography, fiber clustering and composition by Ron Kikinis

• Co-registration DTI/sMRI and brain/lesion segmentation by Guido Gerig

Page 16: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

Neuro Image Research and Analysis Laboratory

Application: Monkey Brain Segmentation

16

ABC applied to macaque brain processing: M. Styner, I. Oguz, UNC

Page 17: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

UNC Conte Center EAB meeting Feb 2010

Application: Mouse “Brain Stripping” for DTI

MD FA

ABC applied to mouse brain processing: M. Styner, I. Oguz, UNC

Page 18: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

Current Extensions: Lesions and Pathology

T2 FLAIR 3D

WM lesions in lupus (MIND, J. Bockholt)

Marcel Prastawa and Guido Gerig. Brain Lesion Segmentation through Physical Model Estimation. International Symposium on Visual Computing (ISVC) 2008. Lecture Notes in Computer Science (LNCS) 5358, Pages 562-571

Page 19: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

Work in Progress: TBI Case 1

• T1 difficult quality (low contrast, non-isotropic voxels, brain damage)• Automatic brain segmentation.• User-supervised level-set segmentation of lesions and ventricles.• Cursor points to right frontal brain damage,T1 hyperintense lesions shown in yellow.

TBI data courtesy UCLA (D. Hovda)

Page 20: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

Work in Progress: Example TBI Case 2

• T1 difficult quality (motion, contrast, non-isotropic voxels)

• Automatic brain segmentation.

• User-supervised level-set segmentation of lesions and ventricles.

• T1 hyperintense lesions shown in yellow.

TBI data courtesy UCLA (D. Hovda)

Page 21: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

Work in Progress: Other TBI Cases

Page 23: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

Slicer 3 Interface

Advanced parameter settings:• Type of linear transformation for intra-subject modalities• Bias correction polynomial degree• Amount of deformation of atlas (affine, fluid w. #iterations)

Page 24: NA-MIC National Alliance for Medical Image Computing  ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.

More Information

• http://www.nitrc.org/projects/abc