[18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance
-
Upload
robotica-medica-uma -
Category
Health & Medicine
-
view
49 -
download
3
description
Transcript of [18-22 Oct 2010] Auto-Guided Movements on Minimally Invasive Surgery for Surgeon Assistance
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
System Engineering and Automation Departmenthttp://www.isa.uma.es
University of Malaga (Spain)
INTELLIGENT ROBOTICS AND SYSTEMS (IROS 2010)
AUTO-GUIDED MOVEMENTS ON MINIMALLY INVASIVE SURGERY FOR SURGEON
ASSISTANCEEnrique Bauzano NúñezVíctor Muñoz-Martínez, Isabel García-Morales
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
Auto-Guided Movements on MIS for Surgeon Assistance
OUTLINE
I. General Overview
II. Laparoscopic Auto-Guided Navigation Problem
III.Control Strategy
a.APF behavior
b.Velocity corrections
c.Backward movement
IV.Implantation and Experiments
V. Conclusions and Future Works
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
I. GENERAL OVERVIEW
INDEX
I. Overview
II.Auto-Guided Problem
III.Control Strategy
IV.Experiments
V.Conclusions
Auto-Guided Movements on MIS for Surgeon Assistance
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
I. General Overview
LAPAROSCOPIC SURGERY
Advantages Lessen recovery time
Limit post-operative complications
Lower scars
Constraints Movement limitations
Loss of touch and 3D perception
Hand-eye coordination problems
INDEX
I. Overview
II.Auto-Guided Problem
III.Control Strategy
IV.Experiments
V.Conclusions
Main Drawback of Robotic Assistants: Lengthen operating time
Solution: Give more autonomy to surgeon assistants
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
A Semi-Autonomous Micro-Robotic System for Colonoscopy (Robotics & Biomimetics, 2008) G. Chen & M. Pham
Motion Estimation in Beating Heart Surgery (Biomedical Engineering, 2005) T. Ortmaier, M. Gröger et al.
I. General Overview
Visual Servoing: The robot assistant automatically focuses the workspace where the surgeon is working.
Auto-Guided Movements: The robot assistant moves to a target or performs a task without the surgeon direct intervention.
EXAMPLES
INDEX
I. Overview
II.Auto-Guided Problem
III.Control Strategy
IV.Experiments
V.Conclusions
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
II. LAPAROSCOPIC AUTO-GUIDED NAVIGATION PROBLEM
INDEX
I. Overview
II.Auto-Guided Problem
III.Control Strategy
IV.Experiments
V.Conclusions
Auto-Guided Movements on MIS for Surgeon Assistance
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
INDEX
I. Overview
II.Auto-Guided Problem
III.Control Strategy
IV.Experiments
V.Conclusions
II. Laparoscopic Auto-Guided Navigation Problem
R
C S
P
RG
CG
SG
PG
Robot
Camera
Target
Primary Tool
View Field
Abdomen
Robot Trajectory
GOAL: Find a path for the robot to reach the Target (primary tool) by avoiding the Obstacle (secondary tool).
AUTO-GUIDED NAVIGATION PROBLEM
Secondary Tool
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
CISOBOT: SEMI-AUTONOMOUS ROBOT ASSISTANT
Surgeon
Patient
Surgeon Model
3D TrackingImage Processing
ToolMovement
Surgeon Command (Voice, Gesture…)
Surgeon’s Tools Location
Maneuver
Processed Image
Dire
ct In
terv
entio
nRobot
Assistant
PWE Controller
Auto-Guide System
RobotTrajectory
ImageCaption
INDEX
I. Overview
II.Auto-Guided Problem
III.Control Strategy
IV.Experiments
V.Conclusions
II. Laparoscopic Auto-Guided Navigation Problem
3-Layer Control for Active Wrists in Laparoscopic Surgery(IROS, 2009) E. Bauzano, V.F. Munoz et al.
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
III. CONTROL STRATEGY
INDEX
I. Overview
II.Auto-Guided Problem
III.Control Strategy
IV.Experiments
V.Conclusions
Auto-Guided Movements on MIS for Surgeon Assistance
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
INDEX
I. Overview
II.Auto-Guided Problem
III.Control Strategy
IV.Experiments
V.Conclusions
III. Control Strategy
MULTI-BEHAVIOR OBSTACLE AVOIDER
Fuzzy Decision
APF Planner
Velocity Correctio
ns
Backward Movemen
t
Σ
AUTO-GUIDE SYSTEM (LOCAL PLANNER)
c1
c2
c3
v1
v2
v3
vsecondaryvrobot
2
1
3
4
vsecondary
vrobot
FUZZY DECISION
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
INDEX
I. Overview
II.Auto-Guided Problem
III.Control Strategy
a.APF Planner
b.Velocity Corrections
c.Backward movement
IV.Experiments
V.Conclusions
III. Control Strategy
ARTIFICIAL POTENTIAL FIELD (APF) PLANNER
Procedure for Automatic Movements1) Locate the minimal distance point MR
2) Calculate its target MRf
3) Apply the forces and compute the needed velocity of MR
4) Move the robot tool to fit both, the new location and the fulcrum constraint GR
End Procedure
0
02
2
0
if0
ifˆ2
111
nr
KFgoal
rrep
goalaatt rKF
2
t
m
Ftvttv
1
111 )()(
New Method for Improving Artificial Potential Field in Mobile Robot Obstacle Avoidance (International Conference on Automation and Logistics, 2007) S. Enxiu, C. Tao et al.
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
III. Control Strategy
VELOCITY CORRECTIONS
RM
SM
Estimated second tool trajectory
Robot’s Path
Time to cross
Distance to cross
INDEX
I. Overview
II.Auto-Guided Problem
III.Control Strategy
a.APF Planner
b.Velocity Corrections
c.Backward movement
IV.Experiments
V.Conclusions
Behavior: Reduce the robot velocity when it moves nearby the surgeon’s secondary tool (obstacle).
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
III. Control Strategy
BACKWARD MOVEMENT
INDEX
I. Overview
II.Auto-Guided Problem
III.Control Strategy
a.APF Planner
b.Velocity Corrections
c.Backward movement
IV.Experiments
V.Conclusions
GR GS
Behavior: Follow the surgeon’s secondary tool trajectory when he or she forces the contact with the robot tool.
SvBF
3
ρmin
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
IV. IMPLANTATION AND EXPERIMENTS
INDEX
I. Overview
II.Auto-Guided Problem
III.Control Strategy
IV.Experiments
V.Conclusions
Auto-Guided Movements on MIS for Surgeon Assistance
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
INDEX
I. Overview
II.Auto-Guided Problem
III.Control Strategy
IV.Experiments
V.Conclusions
IV. Implantation and Experiments
IMPLANTATION
Robot Assistant
3D Tracker
Camera Tool
Surgeon’s Tools
Virtual Patient
Force Sensor
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
INDEX
I. Overview
II.Auto-Guided Problem
III.Control Strategy
IV.Experiments
V.Conclusions
IV. Implantation and Experiments
IN-VITRO EXPERIMENT
Link to videoCISOBOT Video
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
INDEX
I. Overview
II.Auto-Guided Problem
III.Control Strategy
IV.Experiments
V.Conclusions
IV. Implantation and Experiments
EXPERIMENTAL RESULTS
STATIC OBSTACLE
DYNAMIC OBSTACLE
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
V. CONCLUSIONS AND FUTURE WORKS
INDEX
I. Overview
II.Auto-Guided Problem
III.Control Strategy
IV.Experiments
V.Conclusions
Auto-Guided Movements on MIS for Surgeon Assistance
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
CONCLUSIONS
The robot tool movements must be restricted to the camera cone of vision, and the camera should follow the robot tool.
Include a map of the abdominal cavity to avoid inner collisions with the patient.
The robot tool-patient interaction must be studied to extend the possible maneuvers.
FUTURE WORKS
An auto-guided system has been developed to find paths for the robot assistant to reach a surgeon tool while it avoids collisions with the other one.
Thanks to the force sensor, the fulcrum is always located and forces over the abdomen are reduced.
The robot tool may react just before a contact with the obstacle tool. This is useful for surgeon-robot interaction.
V. Conclusions and Future Works
INDEX
I. Overview
II.Auto-Guided Problem
III.Control Strategy
IV.Experiments
V.Conclusions
Sys
tem
En
gin
eeri
ng
an
d
Au
tom
atio
n D
epar
tmen
t
Mr. Enrique Bauzano Nuñez [email protected]
Thanks for your attention
Auto-Guided Movements in Surgeon Assistance