Tissue Characterization by Image Analysis for Diagnosis ...

33
Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012 Tissue Characterization by Image Analysis for Diagnosis Purposes Biomedical signal and image processing Master in Medical Informatics FCUP 2012 J. Miguel Sanches (PhD) Assistant Professor Institute for Systems and Robotics Bioengineering Department (DBE) Instituto Superior Técnico / Technical University of Lisbon email: [email protected] home: www.isr.ist.utl.pt/~jmrs 1

Transcript of Tissue Characterization by Image Analysis for Diagnosis ...

Page 1: Tissue Characterization by Image Analysis for Diagnosis ...

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

Tissue Characterization by Image Analysis for Diagnosis Purposes

Biomedical signal and image processing Master in Medical Informatics

FCUP 2012

J. Miguel Sanches (PhD) Assistant Professor

Institute for Systems and Robotics Bioengineering Department (DBE)

Instituto Superior Técnico / Technical University of Lisbon

email: [email protected] home: www.isr.ist.utl.pt/~jmrs

1

Page 2: Tissue Characterization by Image Analysis for Diagnosis ...

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

Medical Imaging

Different Biomedical Image Modalities are corrupted and distorted by different types of noise

CT MRI LSFCM

(IV)US

MRI/ASL

2

Page 3: Tissue Characterization by Image Analysis for Diagnosis ...

Noise

• Is usually discarded because it is unwanted and purposeless • Is generated during the acquisition process and/or processing • Is stochastic and is usually described from a statistical point of view, e.g., first or

higher order statistics • Is difficult to eliminate • It is usually very difficult to decide what is noise/artifact what what is not

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

But it can contains useful information about the observed

object

3

Page 4: Tissue Characterization by Image Analysis for Diagnosis ...

Image Distortion and Noise Observation model

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

)(xfy =

x

Original

Hxw =

Blurred

)1log( += wz

Non linear distortion

η+= zy

Noise

Typical effects/models

4

Page 5: Tissue Characterization by Image Analysis for Diagnosis ...

(Usual) Goal

Estimate x from y

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

))(())((ˆ 1 xygxyfx == −

Estimated

y

Noisy and distorted observation

x

Original

5

Page 6: Tissue Characterization by Image Analysis for Diagnosis ...

Ill-posedness

• Estimating x from y is usually an ill-posed inverse problem • A problem is ill-posed if it is not well-posed. • The problem is well-posed, according Hadamard, if

– A solution exists – The solution is unique – The solution depends continuously on the data

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

)(ˆ ygx =

6

Page 7: Tissue Characterization by Image Analysis for Diagnosis ...

Example

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

),(minargˆ xyExx

=

),( yxE

x

),( 1yxE

),( 2yxE

x1x

2x

7

Page 8: Tissue Characterization by Image Analysis for Diagnosis ...

Mathematical Characterization

• Noise Characterization: – Additive/Multiplicative/Other – White / Colored

e.g. White and Gaussian

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

{ }iyYXYpY =≈ )),(,( θ

),())(|(

))(|())(|(

2σθ

θθ

iiii

iiii

xNxyp

xypxYp

=∏

8

White:

Gaussian:

Page 9: Tissue Characterization by Image Analysis for Diagnosis ...

AWGN

Additive White Gaussian Noise

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

),())(|(

),0()(

2

2

σθ

ση

η

iiii

i

iii

xNxyp

Np

xy

+=

9

Page 10: Tissue Characterization by Image Analysis for Diagnosis ...

MWGN

Multiplicative White Gaussian Noise

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

),0())(|(

),0()(

22

2

σθ

ση

η

iiii

i

iii

xNxyp

Np

xy

=

10

Page 11: Tissue Characterization by Image Analysis for Diagnosis ...

MWRN

Multiplicative White Rayleigh Noise

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

)())(|(

),(

)1,()(

2

2

iiii

xy

ii

iii

xRxyp

exyxyR

Rp

xy

=

=

=

θ

ηη

η

11

Page 12: Tissue Characterization by Image Analysis for Diagnosis ...

Multiplicative in Wide Sense

• Variance depending on Signal • Not necessarily multiplicative

in the algebraic sense

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

xy

eyxxyPoissonxyp −≈≈

!),())(|( θ

The Variance depends of the observation (signal); it is not constant

12

Page 13: Tissue Characterization by Image Analysis for Diagnosis ...

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

Speckle

Processed by José Seabra (Biomedical PhD student)

• Ultrasound images usually present low quality (low SNR) • Images are corrupted by speckle noise (multiplicative)

13

Page 14: Tissue Characterization by Image Analysis for Diagnosis ...

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

Medical Information

Speckle Pattern (texture) contains relevant medical information

fatty Liver.

14

Page 15: Tissue Characterization by Image Analysis for Diagnosis ...

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

Image Decomposition

• Decompose the image in textural and anatomical/morphological components.

• Characterize the texture/“noise” (speckle).

• Associate the texture characteristics with the disease.

• Classification and Quantification for Detection (Diagnosis) and Quantification (Severity Assessment) of the disease.

15

Page 16: Tissue Characterization by Image Analysis for Diagnosis ...

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

Decomposition Examples

16

Page 17: Tissue Characterization by Image Analysis for Diagnosis ...

Texture Characeterization Rayleigh Mixture Model(RMM)

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012 17

Seabra, J.C.; Ciompi, F.; Pujol, O.; Mauri, J.; Radeva, P.; Sanches, J. , "Rayleigh Mixture Model for Plaque Characterization in Intravascular Ultrasound," Biomedical Engineering, IEEE Transactions on , vol.58, no.5, pp.1314-1324, May 2011.

Page 18: Tissue Characterization by Image Analysis for Diagnosis ...

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

Speckle Analysis for Diagnostic Purposes

• Liver Steatosis – Ricardo Ribeiro (PhD Student)

• Classification and Staging of Chronic Liver Disease from Multimodal Data

– Ricardo Ribeiro (PhD Student)

• Carotid Atherosclerotic Plaques

– José Seabra (PhD) – David Afonso (PhD Student) – Manya Afonso (PhD, Post-Doc)

18

Page 19: Tissue Characterization by Image Analysis for Diagnosis ...

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

Liver (Steatosis and Cirrhosis)

• Diffuse Liver diseases such as Steatosis and Cirrhosis are mainly textural abnormalities of the hepatic parenchyma

• Today, the assessment is subjectively performed by visual inspection

19

Page 20: Tissue Characterization by Image Analysis for Diagnosis ...

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

Steatosis

• Comparison with histological data

20

Page 21: Tissue Characterization by Image Analysis for Diagnosis ...

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

Liver Steatosis Local Analysis

21

Page 22: Tissue Characterization by Image Analysis for Diagnosis ...

Classification and Staging of Chronic Liver Disease from Multimodal Data

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

Normal chronic hepatitis

Cirrhosis compensated decompensated

22

Page 23: Tissue Characterization by Image Analysis for Diagnosis ...

Clinical Based Classifier (CBC)

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012 23

Page 24: Tissue Characterization by Image Analysis for Diagnosis ...

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

Atherosclerotic Plaques Carotid

24

Page 25: Tissue Characterization by Image Analysis for Diagnosis ...

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

Tissue Characterization from Intra Vascular US (IVUS)

Collaboration with the Centre de Visió per Computador, Universitat Autònoma de Barcelona, Profª Petia Radeva

25

Page 26: Tissue Characterization by Image Analysis for Diagnosis ...

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

Plaque IVUS

Decomposition

Classification

26

Page 27: Tissue Characterization by Image Analysis for Diagnosis ...

Plaque B-Mode

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012 27

Page 28: Tissue Characterization by Image Analysis for Diagnosis ...

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

3D Generalization US Acquisition

• Freehand • Mechanical

28

Page 29: Tissue Characterization by Image Analysis for Diagnosis ...

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

3D Diagnosis

Global and local analysis

29

Page 30: Tissue Characterization by Image Analysis for Diagnosis ...

Enhanced Activity Index (EAI) Architecture

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012 30

Page 31: Tissue Characterization by Image Analysis for Diagnosis ...

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

Enhanced Activity Index (EAI) Prototype

31

Page 32: Tissue Characterization by Image Analysis for Diagnosis ...

Computer Aided Diagnosis AtherosRiskTM

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012 32

Page 33: Tissue Characterization by Image Analysis for Diagnosis ...

Biomedical signal and image processing, Master in Medical Informatics, FCUP, 2012

THANKS

33