SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI...
Transcript of SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI...
SURGICAL:AIAI Democratise Computer Aided Surgery
WHY NOT GOOGLE MAPAMAZONUBERFACEBOOKALPHAGOFOR SURGERY
SURGERY CRISIS
Healthcare Cost $30 Trillions
(US 23% GDP)
Surgery Cost 40%
($12 Trillion)
5 Billion have no Access to Surgery
OA Affects 1 in 5 (US),
1 in 6 (China)
OA cost 1%-2.5% GDP,
Second cause of disability
Surgery serves Only 5% patients (US), 0.5% (China)
SURGICAL AUTONOMY
AI and Robotics 50% , worth $6 Trillion
Narrow AI
Highly Controlled Environment
Human Support
Cost Insensitive
Ethical , Risk and Regulation
DO SURGEON REALLY NEEDS AUTONOMY
ProBot Full Autonomous, 1997
Da Vinci, No Autonomy, 2000
ACRobot/Mako/Stryker Cooperative, 2012
BrainLab, Navigation
Sedasys
Robotic Drill
THE BARRIERS (T,C,S,A)
Time (prepare)
Time(OR)
Capability
Safety Affordability
Manual 10 minutes 2 hour 100experts
50% success
+0
Robot +1 Day 4 hour 1,000 experts
90% success
+$500,00-$2,00,000
Navigation +1 Day 3 hour 300 experts
75%success
+$100,000-300,00
PSI +1 Month 1 hour 1,000experts
90%success
+$1,000
SurgicalAI 10 minutes 1 hour 1000 experts
95% success
+$500SURGICAL:AI
AUTONOMOUS PSI DESIGN BY AI
Design in Less in 10 seconds, Deliver in 4 hours
Web base Mixture Reality Interface
Deep Morphology Engine Planning And Design Engine
TensorLab: Big Data WarehouseAnd Autonomous Machine Learning System
SHOULDER PSI EXAMPLE (CAOS 2016) (FULLY AUTONOMOUS)
Deep Morphology Engine
1 Data Scarcity: 30 Volumes vs 2 Millions
2 Memory Consumption3D volume vs 1 D signal
3 No Explanation and No Confidence4 Flexible Workflow…..5 Not Cooperative
Traditional Deep Learning for Medical Images processingWishing A baby will becoming a greatdoctor by showing him lots of scans without going to school
= + +
Neural Poincare Engine
Deep Poincare Map (https://arxiv.org/pdf/1703.09200.pdf)
It works like Surgeon, It has memory, knows where to attend its focus
Speed: 0.2 Seconds for Segmentation one bone from a volumeData Efficiently: trained 5 volume we achieve accuracy close to humanMemory Efficient: Needs about 500MB memory, It can run on your mobile phoneFlexible:Parts scan or arbitrary posture.Error Estimation:We know when it fails.
SURGICAL DB
Medical Image and Processed ImagesPSI ModelsImplantsThe Surgery Plan
NoSQL and Map Reduce Search Engine Solution
Find me all the pre and after surgery CT scans of all the patients using Company A implants on the third Spine Joint
The only Question Surgeons Care but No existing PACS or EHR system can Answer
TensorLab for Autonomous Continuous Learning
Heart Failure
AccIoU
Time
Recruitment by Search Engine
The Principal: 1) Everything is Data. 2) Everything is Identified by Query. 3) Pulling based Stream Processing
Images and Sematic Labels
Model Versions and Performance Metrics
Left Volume
Model Architecture
Search Engine is usedas the Router for Data
Job1 Job 2 Job3 Job4 Job5 Job6
Builder Analyser Validator Builder Analyser Builder Analyser Validator
Job Queue
Job Query as Load Balancer
Build Job
Data:Heart with Tumour
Arch:Best Segmenation Model
Input Version:Most Accurate Version
Output Version:Heart Tumour Detection
CLINICAL RESULTS:
Save 40 minutes in OR,1000GBP for 1 procedure
PATIENT SPECIFIC OSTEOTOMY
Guide was designed, printed and sterilized
Guide was fixed to the unique position on the bone
Bone was resected following the guidance of the guide
15° wedge was resected and removed
Wedge was closed and bone was fixed
OTHER PROCEDURES
APPLICATIONS
1) Surgery Planning
2) Patient Specific Guide Device
4) Implants Registration and Management
3) Surgical Workflow Management
A TEAM OF WORLD LEADING EXPERTS
Professor Anan Shetty
(Chief Medical Scientist)Dr Fangde Liu (CEO &CRO)
The best Surgeon in the UKShetty-Kim Technique InventorThe Surgeon of 2017 by Royal College of SurgeonProudest Award for UK, the Hunterian ProfessorAdvisor of NICE ( National Institute of Clinical Excellence)
Chief Architecture of Several Flagship Surgical Robots,Pharmacovigilance for multinationAutonomous CMR Analysis System and DiagnosisSenior Associate ofRoyal Society of Medicine
Dr Hao Dong (Engineering VP)
PhD at Imperial College, Data Science InstituteDeep Learning Engineering ExpertThe Creator of TensorLayerMost Popular DL Framework in China
Yinna Bu (Client and BD Manager in China)MSc from UCLCEO of two start-ups
Prof Yike Guo (Advisor)
Prof Ferdinando Rodriguez y Baena (Advisor)
Dr Joshua Giles (Advisor)
Dr Jianmo Li (Advisor)
Full Professor of Medical Robots at IC, World First Orthopaedics Surgical RobotsSold For Stryker 1.67 Billion DollarsTeam Leader of Biggest Surgical Robots ProjectIn European UnionChair of World Computer Aided Orthopaedics
Full Professor of Data Science at Imperial CollegeChairman of TranSmart FoundationWorld Standard Platform for Translation and Clinical MedicineAdopted by all the major Pham Company in the worldIncluding J&J, Merkek, Roche, Sanophie.
PostDoc at Imperial CollegeInventor of Should PSI
PhD Prof Andrew AmisPostdoc at Imperial CollegeInventor of Knee PSI
Mr Saif AhmedConsultant SurgeonProfessor of AnatomyExpert on 3D Printing and Surgical RobotsExecutive Comminute of Computer Aided Orthopaedics' UK
Kent Institute of Medicine & Surgery
• KIMS is the largest Independenthospital in SouthEast England andKent.
• No.1 patient satisfaction (92%)against other 92 independent hospitalin the UK
• The hospital is equipped with state-of-the-art technology and innovativediagnostic services
• Wide range of treatment – coveringall the orthopedic area and jointreplacement
AI Democratise Computer Aided Surgery
Autonomous Surgery is FeasibleThe barrier is Human Machine CooperationFor Surgery, Not Just AI, Vehicle MattersProvides the tool, not solutionGPU plays crucial by breaking the time barrier
CAOS 2016, Japan Osaka IDEALondon, 2016
Daily Mail, 2016
Re.Work Deep Learning in Healthcare Summit, 2017
GTC 2017
Surgical AI:Bring Big Data and AI into Operating Theatre
Thank You