JISCrte Meeting, May 25,2011

Dr. Yu QianSchool of Engineering Information Sciences,

Middlesex Universityy.qian@mdx.ac.uk

Repository @ http://image.mdx.ac.uk/vin/demo.php

Contents• System demonstration http://image.mdx.ac.uk/vin/demo.php

• Introduction of MIRAGE project– MIRAGE Phase 1 (2009-2010)– MIRAGE 2011, Phase 2 (2011)

• Project communication• Dissemination • Obstacles and issues• Lessons learned so far• Summary

MIRAGE(Middlesex medical Image Repository with a CBIR ArchivinG Environment)

Phase 1: MIRAGE- from Creation to Archiving • Strand : Start-up Repository funded by JISC• Between Apr. 2009- Sep. 2010.• Aim: To develop a repository of medical images benefiting MSc and research students in

the immediate term and serve a wider community in the long term in providing a rich supply of medical images for data mining, to complement MU current online e-learning system OASIS+.

Phase 2: MIRAGE 2011 – from Archiving to Creation• Strand : Take-up and Embedding funded by JISC• Between Feb. 2011- Oct. 2011.• Aim: To enrich the current repository MIRAGE with two necessities of ‘3D Viewer’ and

‘Uploading’ to meet users’ needs, leading to a sustainable, usable and flexible model of data management.

Framework for MRIAGE

Phase 1: MIRAGE --from Creation to Archiving

Phase 1: MIRAGE -- GIFT(GNU Image Finding Tool)

GIFT is open framework for content-based image retrieval and is developed by University of Geneva.

Query by example and multiple query Relevance Feedback Distributed architecture (Client - Server) MRML---C-S communication protocol

Phase 1: MIRAGE – Online system(1)

• Server side: Image collection: Accommodating 100,000 2D images and 100 3D

images Visual feature extraction: Pre-processing off-line using C++ and Perl. Indexing file creation

• Client side: Interface based on PHP generate dynamic web pages.

• Client – Server communication protocol: MRML: a XML based protocol

Phase 1: MIRAGE – Online system(2)Repository connection

Phase 1: MIRAGE – Online system(3)Interface

Phase 1: MIRAGE – Online system(4)Query and retrieval results

Phase 1: MIRAGE – Online system(5)Link to OASIS+

Phase 1: MIRAGE – Online system(6)On-line survey

Survey report show all respondents 'agreed' or 'strongly agreed‘The retrieved results meets users’ expectationsFast and easy to useUseful for teaching and learning

Phase 1: MIRAGE –Limitations (1)1. At Repository interface

Montage

Phase 1: MIRAGE –Limitations (2)2. Uploading image

Phase 2: MIRAGE2011---- From Archiving to Creation

Aim:

• To enrich the current repository MIRAGE with two necessities to meet users’ needs, leading to a sustainable, usable and flexible model of data management.

Phase 2: MIRAGE2011---3D CBIR Proposed Framework for 3D Image Retrieval

Phase 2: MIRAGE2011---3D CBIR 3D texture feature extraction

1) 3D Grey Level Co-occurrence Matrices (3D GLCM)2) 3D Wavelet Transform (3D WT)3) 3D Gabor Transform (3D GT)4) 3D Local Binary Pattern (3D LBP)

Publications:

1) Qian Y., Gao X. etc, Content-based Retrieval of 3D Medical Images, eTELEMED 2011, February, 2011. (Best paper award )

2) Gao X., Qian Y. etc, Texture-based 3D image retrieval for medical applications, IADIS e-Health2010,, July 2010.

Phase 2: MIRAGE2011---3D CBIR

3D Brain Visualization(1)

Phase 2: MIRAGE2011---3D CBIR 3D Brain Visualization(2)

Phase 2: MIRAGE2011---3D CBIR On-line system(1):

• Server side: 100 3D brain images(DICOM format to JPG format) 3D visual feature extraction(4 methods): Off-line pre-

processing using Matlab. 3D visualization: using Matlab

• Client side: Interface based on PHP generate dynamic web pages.

Phase 2: MIRAGE2011---3D CBIR Online system(2): Embedding to MIRAGE

Phase 2: MIRAGE2011---3D CBIR Online system(3):

Interface for 3D images retrieval and visualization

Phase 2: MIRAGE2011---Uploading

Development of a plug-in for uploading queries

• Will integrate various types of textual metadata and ontology in addition to image data.

Phase 2: MIRAGE2011---UploadingImage Annotation(1)

Phase 2: MIRAGE2011---UploadingImage annotation(2)

•Framework for image annotation

Phase 2: MIRAGE2011---UploadingImage annotation(3)

Classified Dataset

Phase 2: MIRAGE2011---Uploading Image(Future work)

Two problems need to be solved:

SecurityOnline query time

Thanks

Yu Qiany.qian@mdx.ac.uk