1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 –...

20
1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour, I. H.; Furuie, S. S.; Nedel, L. P.; Fr eitas, C. M. D. S. Student: 黃黃黃 Advisor : 黃黃黃

Transcript of 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 –...

Page 1: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

1

A Framework to Visualize and Interact with Multimodal Medical Images

Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001

Author :Manssour, I. H.; Furuie, S. S.; Nedel, L. P.; Freitas, C. M. D. S.

Student: 黃健彰Advisor : 張顧耀

Page 2: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

2

Outline

Introduction

Requirement

Framework Description

Interaction and Visualization Model

Conclusions

Page 3: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

3

IntroductionThe simultaneous use of images obtained from different sources (modality)

造影源 優點 缺點 一般用途及特別用途

CT X 射線 快速 掃描骨頭及軟骨

高成本 應用範圍有限 游離輻射

血塊 骨折 手術房 / 急診室 腦瘤

MRI 磁場 軟組織 骨組織內部 非侵入性

高成本 無法獲得骨骼影像 耗時

腦部疾病 / 腫瘤 腦下垂體瘤 多發性硬化症 / 髓鞘值惡化

PET 放射性同位素

評估代謝功能 即時造影 使用多種放射性追蹤劑

高成本 研究導向 空間資訊少 複雜 需要迴旋加速器

癲癇 / 抽搐 癌症 柏金森氏症 艾滋海默氏症 腦部功能定位研究

Page 4: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

4

Introduction

A framework for interactive multimodal visualization of 3D medical image

Page 5: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

5

Requirement

Page 6: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

6

Requirement

RegistrationTo represent the same object of interest to a common coordinate system

Match two of more image, or volumesFrom different times, sensors, scanners or viewpoints

Reference imageMap pixels from one image

Test imageTo pixels in another image

Page 7: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

7

Requirement

Interactive multimodal visualizationLinked feature display

Display of cut planes

Surface texturing and mapping

Integrated data display

Spectral Volume Rendering

Page 8: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

8

Requirement

Page 9: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

9

Requirement

Interactive multimodal visualizationLinked feature display

Display of cut planes

Surface texturing and mapping

Integrated data display

Spectral Volume Rendering

Page 10: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

10

Requirement

Page 11: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

11

Requirement

Interactive multimodal visualizationLinked feature display

Display of cut planes

Integrated data display

Surface texturing and mapping

Spectral Volume Rendering

Page 12: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

12

Page 13: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

13

Requirement

Interactive multimodal visualizationLinked feature display

Display of cut planes

Integrated data display

Surface texturing and mapping

Spectral Volume Rendering

Page 14: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

14

Requirement

Interaction toolTo provide ways to manipulate the data

Extract measurements and functional information

Allow different types of visualization

Navigation inside the structures

The computational cost is very highSeveral acceleration techniques have been developed

Page 15: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

15

Framework Description

One of the largest challenges??Development of strategies

Requirements for the development of a new system

Have multimodal visualization features

Use the optimize algorithms

Reuse software

Easy to use

Page 16: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

16

Framework Description

Model-View-Controller (MVC)Model

Encapsulates core data and functionality

ViewDisplay information to the user

ControllerReceive input

– Mouse movement, activation of mouse buttons, or keyboard input

Page 17: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

17

Page 18: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

18

Interaction and Visualization Model

Page 19: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

19

Page 20: 1 A Framework to Visualize and Interact with Multimodal Medical Images Source: VG01 – INTERNATIONAL WORKSHOP ON VOLUME GRAPHICS, 2001 Author :Manssour,

20

Conclusions

Find suitable strategies to integrate multiple data sets

Design user-friendly interface

Integrate all techniques