Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface...
Transcript of Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface...
![Page 1: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera](https://reader031.fdocuments.net/reader031/viewer/2022021812/5e2df93693ef1242967ef307/html5/thumbnails/1.jpg)
Shambala - A Modern Web
Interface for Medical Image
Retrieval
SGMI2014
Presented by : Alba García Seco de Herrera
Roger Schaer, Henning Müller
![Page 2: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera](https://reader031.fdocuments.net/reader031/viewer/2022021812/5e2df93693ef1242967ef307/html5/thumbnails/2.jpg)
Motivation
• Image search is a daily task for medical
professionals
• Medical images are abundant
• Clinicians’ schedules are tight
• Intuitive, easy-to-use, efficient retrieval tools
are needed!
2
![Page 3: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera](https://reader031.fdocuments.net/reader031/viewer/2022021812/5e2df93693ef1242967ef307/html5/thumbnails/3.jpg)
KHRESMOI
• Multilingual, multimodal search and access
system for biomedical information and
documents
• Three target user groups
– General public
– General practitioners
– Radiologists
3
![Page 4: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera](https://reader031.fdocuments.net/reader031/viewer/2022021812/5e2df93693ef1242967ef307/html5/thumbnails/4.jpg)
Methods
• ParaDISE (Parallel Distributed Image Search
Engine)
– Image retrieval system
• Text & CBIR
– Focused on
• Modularity : independent components
• Expandability : easy to add new features
• Scalability : efficient with very large image collections
4
![Page 5: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera](https://reader031.fdocuments.net/reader031/viewer/2022021812/5e2df93693ef1242967ef307/html5/thumbnails/5.jpg)
ParaDISE Web Layer
5
![Page 6: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera](https://reader031.fdocuments.net/reader031/viewer/2022021812/5e2df93693ef1242967ef307/html5/thumbnails/6.jpg)
Datasets
6
ImageCLEF2012
>300’0000 images
PubMed OpenAccess
>1’500’000 images
![Page 7: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera](https://reader031.fdocuments.net/reader031/viewer/2022021812/5e2df93693ef1242967ef307/html5/thumbnails/7.jpg)
Shambala
• Buddhist concept of ParaDISE :-)
• Based on 3 principles
– Easy
– Interactive
– Modern
7
![Page 9: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera](https://reader031.fdocuments.net/reader031/viewer/2022021812/5e2df93693ef1242967ef307/html5/thumbnails/9.jpg)
Features
• Adaptive results zone
• Image editing
9
![Page 10: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera](https://reader031.fdocuments.net/reader031/viewer/2022021812/5e2df93693ef1242967ef307/html5/thumbnails/10.jpg)
Features
• Compound figure interaction
10
![Page 11: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera](https://reader031.fdocuments.net/reader031/viewer/2022021812/5e2df93693ef1242967ef307/html5/thumbnails/11.jpg)
Features
• Image samples & upload
– Random samples from ImageCLEF2012
– Upload by drag’n’drop from the computer directly
11
![Page 12: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera](https://reader031.fdocuments.net/reader031/viewer/2022021812/5e2df93693ef1242967ef307/html5/thumbnails/12.jpg)
Features
• Search configuration
– Choose dataset
– Filter by imaging modality
– Use image examples’ captions for text search
– Replace image captions with semantic terms
obtained by a third-party Web Service
12
![Page 13: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera](https://reader031.fdocuments.net/reader031/viewer/2022021812/5e2df93693ef1242967ef307/html5/thumbnails/13.jpg)
Future Work • Integration with Leap Motion sensor
13
![Page 14: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera](https://reader031.fdocuments.net/reader031/viewer/2022021812/5e2df93693ef1242967ef307/html5/thumbnails/14.jpg)
Conclusions
• Shambala is easy-to-use and modern
• Currently works with ParaDISE, could be
adapted for any web-based retrieval system
• User tests will be performed to evaluate the
benefit of using this interface
14
![Page 15: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera](https://reader031.fdocuments.net/reader031/viewer/2022021812/5e2df93693ef1242967ef307/html5/thumbnails/15.jpg)
15
Thank you for your attention !
Questions?
http://shambala.khresmoi.eu