Virtual interactive presence in global neurosurgical ... interactive presence in global...
Transcript of Virtual interactive presence in global neurosurgical ... interactive presence in global...
![Page 1: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/1.jpg)
Virtual interactive presence in global neurosurgical education: international collaboration through augmented reality
Matthew C. Davis, Dang Do Thanh Can, Brandon G. Rocque, James M. JohnstonChildren’s of Alabama Hospital, Birmingham, Alabama, USA
Children’s Hospital #2, Ho Chi Minh City, Vietnam
![Page 2: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/2.jpg)
This work was supported by a grant from the Children’s of Alabama Global Health Program Initiative.
Disclosures
![Page 3: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/3.jpg)
Vietnam
Population: 92 million
10 neurosurgeons in South Vietnam who treat pediatric patients, with varying levels of subspecialty training
2 pediatric neurosurgical training programs – one in Ho Chi Minh City, the other in Hanoi
![Page 4: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/4.jpg)
2 week trip in January 2015
1 attending pediatric neurosurgeon, 1 pediatric neurosurgery fellow, 1 neurosurgery resident
Goals:
1) Teach and advise on case selection, management and surgical techniques, emphasizing craniosynostosis, ETV/CPC
2) Set up VIPAR system for international collaboration following return to Birmingham
Trip details
Local neurosurgery team
![Page 5: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/5.jpg)
Local Video Capture
Hybrid Video Display
iPad
Compiling server
Distant Video Capture
Virtual Presence and Augmented Reality (VIPAR)
![Page 6: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/6.jpg)
![Page 7: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/7.jpg)
![Page 8: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/8.jpg)
Clinic day
24 patients seen on first clinic day, additional patients seen individually over following week
12 operative cases selected
![Page 9: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/9.jpg)
![Page 10: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/10.jpg)
![Page 11: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/11.jpg)
![Page 12: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/12.jpg)
Shenai, 2011
VIPAAR Interface – v1.0
![Page 13: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/13.jpg)
The local student (left) and remote mentor (right) are in separate locations (A), but both see a merged display of the other's actions (B)
VIPAAR Interface – v1.0
![Page 14: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/14.jpg)
• Problems• Requires complex
hardware/codecs at both learner and mentor sites
• Microscope/goggle based
• Bandwidth requirements may exceed standard available Internet/WiFi capabilities for learner hospitals
VIPAAR 1.0 for Neurosurgery MentoringiPAD/App StoreVIPAAR 2.0
VIPAAR v2.0iPAD/App Store
![Page 15: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/15.jpg)
VIPAAR 2.0 iPad Neuroendoscopy Configuration
iPAD
![Page 16: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/16.jpg)
Endoscopic Third Ventriculostomy
Mentor Surgeon
Learner Surgeon
Mentor
![Page 17: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/17.jpg)
![Page 18: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/18.jpg)
Endoscopic Third Ventriculostomy
![Page 19: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/19.jpg)
Endoscopic Third Ventriculostomy
![Page 20: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/20.jpg)
VIPARR Operative Microscope Configuration
![Page 21: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/21.jpg)
Composite latency and accuracy analysis
Using synchronized audio to calculate visual delay between remote locations. The two video streams are synchronized to a common audio cue, then the time difference between identical video locations is calculated by counting frames between the audio cue and video (visual) alignment.
![Page 22: Virtual interactive presence in global neurosurgical ... interactive presence in global neurosurgical education: international collaboration through augmented ... neurosurgery fellow](https://reader030.fdocuments.net/reader030/viewer/2022020412/5af16fbd7f8b9a8b4c8ec664/html5/thumbnails/22.jpg)
Future Steps
• Ongoing, international operative collaboration• Implications for global training and capacity building