Stable rendering methods for Haptic interaction
-
Upload
trunghieu1211 -
Category
Education
-
view
210 -
download
0
Transcript of Stable rendering methods for Haptic interaction
![Page 1: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/1.jpg)
A STUDY ON STABLE HAPTIC RENDERING METHODS USING FPGA
Student: Trung Hieu Do Advisor: Jee-Hwan RyuBioRobotics Lab. School of ME - Korea University of Technology and Education
![Page 2: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/2.jpg)
Contents Haptic Interfaces and Stability Analysis Review of the Time Domain Passivity
Approach Proposed Methods
Memory-based Method Multi-rate TDPA Method
Experimental Setup Conclusions & Future works References
![Page 3: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/3.jpg)
Haptic Interfaces & Stability Analysis
![Page 4: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/4.jpg)
Overview of Haptic Interfaces
Human Operat
or
Computer-based
VESlow
update rate
EmbeddedHaptic
ControllerFast
update rate
hx
hf vef
vex
10-100 Hz1-10kHz
MasterDevice
mx
mf
Assumption: Virtual Objects are Static & Passive
MasterDevice
Human Operat
or
Computer-based
VESlow
update rate
hx
hf
vex
vef
N. Diolaiti, G. Niemeyer, F. Barbagli, J. Kenneth Salisbury, Jr, ”Stability of Haptic Rendering: Discreatization, Quantization, Time-Delay and Coulomb Effects,” IEEE Transactions on Robotics, 22(2): pp. 256-268, April 2006.
![Page 5: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/5.jpg)
Zero Order Hold & The Effect of Discretization
Analog
t
f
![Page 6: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/6.jpg)
Unstable Behavior of Haptic Interface
102.425 /
ve
ve
T msk kN m
![Page 7: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/7.jpg)
Review of the Time Domain Passivity Approach
![Page 8: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/8.jpg)
Time Domain Passivity Approach
Passivity Observer (PO):
Passivity Controller (PC):
Human Operator
MasterDevice
Computer-based
VEPC PO
pcf
mx
mf vef
vex
10-100 Hz
TDPA
![Page 9: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/9.jpg)
Ideal Behavior of TPDA Method
![Page 10: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/10.jpg)
Block Diagram Conventional TDPA
method
POUpdate PO
PC
Clock signal
Reset PO
Conv. TDPA Stability Controller
Update PC
![Page 11: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/11.jpg)
Noisy Behavior of Conventional TDPAJ-H. Ryu, B. Hannaford, D-S. Kwon, and J-H. Kim, “A Simulation/Experimental Study of the Noisy Behavior of the Time Domain Passivity Controller,” IEEE Trans. on Robotics, Vol. 21, No. 4, pp. 733-741.
![Page 12: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/12.jpg)
Noisy Behavior of Conv. TDPA
102.425 /
ve
ve
T msk kN m
![Page 13: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/13.jpg)
Block Diagram FPGA-based TDPA
PO
Update PO
PC
Reset PO
FPGA-based TDPA Stability ControllerMotion Detector
Update PC
Reset PO
1. Irregular activating method2. Increase activating speed of PC3. Reduce generated energy
B. Han, J-H. Ryu “An Injecting Method of Physical Damping to Haptic Interfaces Based on FPGA,” Proceedings of the International Conference on Control, Automation and Systems (ICCAS 2008), Seoul, Korea, pp. 1835-1840.
![Page 14: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/14.jpg)
Stable Behavior FPGA-based TDPA 102.425 /
ve
ve
T msk kN m
![Page 15: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/15.jpg)
Noisy Behavior in Stiffer VE104.85 /
ve
ve
T msk kN m
![Page 16: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/16.jpg)
Memory-based method
Proposed methods
![Page 17: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/17.jpg)
Idea of Memory-based Method
Pressin
g
Releasi
ng
Position
• Memorize the pressing forces• Use pressing forces as boundaries for releasing forces• VE characteristics changes when releasing.• However Pressing period is more important for human feeling.
![Page 18: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/18.jpg)
Block Diagram Memory-based Method
Select
Switch
Data
Address
R/W
Memory
Direction Detector
Memory-based method Stability Controller
![Page 19: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/19.jpg)
Stable Behavior Memory-based Method
104.85 /
ve
ve
T msk kN m
![Page 20: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/20.jpg)
Slow Interaction Behavior Memory-based
method102.425 /
ve
ve
T msk kN m
![Page 21: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/21.jpg)
Proposed MethodsMulti-rate TDPA method
![Page 22: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/22.jpg)
Multi-rate Haptic
Computer-based VE0.1kHz
Multi-rate Haptic
Controller10kHz
10kHz sample rate
Master device
FPGA
Analog
t
f f
0.1kHz sample rate
f
t t
Human Operato
r
tx
tf
![Page 23: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/23.jpg)
Multi-rate Haptic Interpolation Method
M. C. Cavusoglu and F. Tendick, "Multirate Simulation for High Fidelity Haptic Interaction with Deformable Objects in Virtual Environments," in Proceedings of the IEEE International Conference on Robotics and Automation, 2000, pp. 2458-2465.
F(t)
![Page 24: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/24.jpg)
Behavior of Multi-rate Haptic
Fm[N]
![Page 25: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/25.jpg)
Activity of Multi-rate Haptic Interface
102.425 /
ve
ve
T msk kN m
Active period
Passive period
![Page 26: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/26.jpg)
Activity of Multi-rate Haptic
Multi-rate haptic can’t guarantee Stability
TDPA method
Generated energy:
![Page 27: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/27.jpg)
Multi-rate TDPA
Computer-based VE
0.1kHz
Multi-rateForce
estimator10kHz
Time Domain Passivity Controlle
r10kHz
Human Operator
FPGA
Masterdevice
tf
tx
![Page 28: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/28.jpg)
Block Diagram of Multi-rate TDPA
FPGA-based Haptic Controller
Force interpolator
PC-based VE
Down sample
Encoder reader
Multi-rate TDPA Stability Controller
Conv.TDPAor
event-based TDPA
tF
![Page 29: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/29.jpg)
Dissipitation of Generated Energy
PC activated
![Page 30: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/30.jpg)
Stability of Multi-rate TDPA104.85 /
ve
ve
T msk kN m
![Page 31: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/31.jpg)
Slow Interaction of Multi-rate TDPA
104.85 /
ve
ve
T msk kN m
![Page 32: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/32.jpg)
Experimental Setup
![Page 33: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/33.jpg)
Haptic System
Human operator Motor driverMechanical
interface
Master Device
FPGA-BasedHaptic ControllerPC-based VE
Physical interaction
Virtual Interaction
![Page 34: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/34.jpg)
Software Architecture
Stability Controller
PC-basedVE
0.1kHz
PI Current Controller
50kHz
Position counter
Elapsed timer
Directiondetector
Encoder reader
A phase
B phase
Position
PWM output
Measured force (current)
FPGA-based haptic controller
PWMgenerator
FIFO data acquisition
5 kHz
TCP/IP
Parrallel, complicated, flexible, high-speed and simultaneous tasksThe necessity of FPGA technology.A DSP/MCU-based system is possible but difficult to realize.
![Page 35: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/35.jpg)
Conclusions & Future Works
![Page 36: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/36.jpg)
Maximum VE Stiffness
VE
![Page 37: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/37.jpg)
Conclusions MethodsFeatures
FPGA-based TDPA Memory-based Multi-rate TDPA
Performance Worst performance Better performance Best performance
Range of impedance Lowest max. stiffness Higher max.stiffness Highest max.stiffness
Noise behavior Noise behavior Less noise behavior Least noise behavior
Distortion (VE) When activity detected
When releasing force higher than pressing force
Interpolation&When activity detected
Conservativeness No No Assumption of slowly change VE
Update method Irregular updatefast interupt
Irregular updatefast interupt
Regular update
Algorithm comlexity Simple Simplest Complicated
Others Need high-speed RAM (Random access memory)
![Page 38: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/38.jpg)
Future Works Apply proposed methods to moving and
time varying VE. Improve performance of methods: less
noise, wider range of impedace, more general cases.
Implement to Teleoperation. Implement methods in lower cost
devices: MCUs or DSPs.
![Page 39: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/39.jpg)
References M. C. Cavusoglu and F. Tendick, "Multirate Simulation for High Fidelity
Haptic Interaction with Deformable Objects in Virtual Environments," in Proceedings of the IEEE International Conference on Robotics and Automation, 2000, pp. 2458-2465.
B. Han, J-H. Ryu “An Injecting Method of Physical Damping to Haptic Interfaces Based on FPGA,” Proceedings of the International Conference on Control, Automation and Systems (ICCAS 2008), Seoul, Korea, pp. 1835-1840.
J-H. Ryu, B. Hannaford, D-S. Kwon, and J-H. Kim, “A Simulation/Experimental Study of the Noisy Behavior of the Time Domain Passivity Controller,” IEEE Trans. on Robotics, Vol. 21, No. 4, pp. 733-741.
N. Diolaiti, G. Niemeyer, F. Barbagli, J. Kenneth Salisbury, Jr, ”Stability of Haptic Rendering: Discreatization, Quantization, Time-Delay and Coulomb Effects,” IEEE Transactions on Robotics, 22(2): pp. 256-268, April 2006.
J-H. Ryu, B. Hannaford, D-S. Kwon, and J-H. Kim, “A Simulation/Experimental Study of the Noisy Behavior of the Time Domain Passivity Controller,” IEEE Trans. on Robotics, Vol. 21, No. 4, pp. 733-741.
![Page 40: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/40.jpg)
Implementation on High-Stiffness Moving Objects
, 00, 0eF k e e
F e
F F
Master 1 Master 2
Passivate Object
Virtual object
![Page 41: Stable rendering methods for Haptic interaction](https://reader036.fdocuments.net/reader036/viewer/2022062401/58ef22821a28abca7a8b4617/html5/thumbnails/41.jpg)
THANK YOU