Development of the 1DoF Haptic Renderer: …...Avin Khera 1, Randy Lee , Zhixuan Yu2, Roberta...
1
Avin Khera 1 , Randy Lee 1 , Zhixuan Yu 2 , Roberta Klatzky, PhD 3 , George Stetten, MD, PhD 1,4 1 Bioengineering, University of Pittsburgh, 2 Biomedical Engineering, Carnegie Mellon University, 3 Psychology, Carnegie Mellon University, 4 Robotics Institute, Carnegie Mellon University INTRODUCTION THE 1DOF HAPTIC RENDERER METHODS RESULTS & DISCUSSION ACKNOWLEDGMENTS REFERENCES Development of the 1DoF Haptic Renderer: Controller-Based Membrane Modeling for Haptic Devices During procedures, microsurgeons primarily make use of visual feedback, because the involved forces are below the threshold of touch. Current haptic platforms that model tissue interaction, such as the Geomagic Touch and the Butterfly Haptics Magnetic Levitation Haptic Device (MLHD), are expensive, limited in force output, or subject to inertial effects due to their heavy actuators platforms. The 1DoF Haptic Renderer was developed to address these limitations [1]. It uses a woofer loudspeaker actuator with force and displacement sensors to simulate tissue interaction. • Actuator: 80W subwoofer speaker (Faital PRO 5FE120) 5 inch (12.7 cm) diameter and a cone mass of 11 grams (Figure 2) • Can undergo 9.5 mm displacement and can move steadily against forces up to 10 N [1] • Uses direct electromechanical transduction, with force related simply to the voltage across the speaker coil • Stereolithographic scaffold with a Honeywell FS03 Force Sensor for force sensing • Optical IR transceiver (Vishay TCRT5000L) used to measure speaker cone position • Total mass of 23.6 grams • Controlled by Analog Devices ADuC7026 microprocessor • Wixel USB module (Pololu; Las Vegas, NV) enabled communication between the “master” microprocessor and a “slave” computer for data logging and mode selection A Proportional-Integral-Derivative (PID) feedback controller was used to regulate speaker current based on force and displacement measurements [2]. The error (e) was determined by subtracting the sensor voltage at some set point from the current sensor voltage. Proportional control multiplies a proportional gain (Kp) by the error, while the integral (Ki) and differential (Kd) controls summate previous errors and predict future errors with their respective gains [2] (Figure 1). Two primary modes of PID were developed: (1) Virtual Wall (VW) mode, in which a set-point was chosen based on the desired displacement, with the error used to resist displacement from the set- point with maximum force, and (2) Zero Stiffness (ZS) mode in which speaker voltage was used to minimize force detected by the sensor and thereby simulate open air. These modes were compared with the actuator on mute, with no compensation of force (Figure 3). In each case, PID control was used determine the output voltage based on the error (Equation 1). "#$ = ’ ∗ + , - . . $ 0 + 1 () Equation 1: PID Controller tuning equation Open-loop Ziegler-Nichols tuning was performed to empirically determine the PID gains from the ultimate gain (Ku), the value of Kp at which the system began oscillating, and the period (Tu) of oscillation for each mode. Anti-windup control was implemented by scaling down the integral component by the difference in the calculated controller output and the maximum actuator output [2]. A slew-rate limiter and a low pass filter were added to compensate for high frequency signal noise accentuated by the derivative gain term. • Tyreus-Luyben PID controller settings were adopted over Ziegler- Nichols due to their greater stability. • Final Ku and Tu were found for each operation mode • PID control of Virtual Wall mode produced forces opposite to the user, resulting in almost zero displacement (Figure 4) • The new rendition of Zero-Stiffness mode actively removed the tension at all positions of the speaker cone (Figure 5) Dynamic control of the actuator was achieved with PID and successfully rendered both a very stiff membrane in VW mode and an empty space simulation in ZS mode. In both modes, PID control of the speaker actuator minimized errors with lower latency than simply P or PI methods. The addition of derivative control predicted future errors and balanced the error averaging conducted by the integral term. Prior to anti-windup control, the actuator suffered from repeating integration of previous errors. Anti-windup eliminated “stickiness” related to actuator saturation at the ends of the displacement range. NIH R01EY021641, NSF IIS-1518630, Research to Prevent Blindness, University of Pittsburgh Swanson School of Engineering REU [1] Khera et al. One-Dimensional Haptic Rendering using Audio Speaker with Displacement Determined by Inductance, Machines, 2016, 4, 9; doi:10.3390/machines4010009 [2] Astrom, K. J., & Murray, R. M. (2008). PID Control. In Feedback Systems: An Introduction for Scientists and Engineers (pp. 293-312). Princeton, NJ: Princeton University Press. Figure 5: Actuator response to applied forces is almost full compliance. Force application by user results in reduction of counter forces with low latency Figure 4: Reaction forces are created by the actuator, shown by an increase in speaker output. Counteracting forces reduce displacement from rest. Figure 2: The 1 DOF Haptic Renderer (A) Solidworks model and (B) Physical prototype Figure 3: Force and displacement sensor measurements of perturbations when controller is turned off Figure 1: Block diagram of PID controller. Output “v” of controller limited between 0-2.5V due to actuator saturation, resulting in speaker output voltage (u). System receives actuator output and calculates appropriate sensor voltage (y)
Transcript of Development of the 1DoF Haptic Renderer: …...Avin Khera 1, Randy Lee , Zhixuan Yu2, Roberta...
Avin Khera1, Randy Lee1, Zhixuan Yu2, Roberta Klatzky, PhD3, George Stetten, MD, PhD1,4
1Bioengineering, University of Pittsburgh, 2Biomedical Engineering, Carnegie Mellon University, 3Psychology, Carnegie Mellon University, 4Robotics Institute, Carnegie Mellon University
INTRODUCTION
THE 1DOF HAPTIC RENDERER
METHODS
RESULTS & DISCUSSION
ACKNOWLEDGMENTS
REFERENCES
Development of the 1DoF Haptic Renderer: Controller-Based Membrane Modeling for Haptic Devices
During procedures, microsurgeons primarily make use of visualfeedback, because the involved forces are below the threshold oftouch. Current haptic platforms that model tissue interaction, such asthe Geomagic Touch and the Butterfly Haptics Magnetic LevitationHaptic Device (MLHD), are expensive, limited in force output, orsubject to inertial effects due to their heavy actuators platforms. The1DoF Haptic Renderer was developed to address these limitations[1]. It uses a woofer loudspeaker actuator with force anddisplacement sensors to simulate tissue interaction.
• Actuator: 80W subwoofer speaker (Faital PRO 5FE120) 5 inch(12.7 cm) diameter and a cone mass of 11 grams (Figure 2)
• Can undergo 9.5 mm displacement and can move steadily againstforces up to 10 N [1]
• Uses direct electromechanical transduction, with force relatedsimply to the voltage across the speaker coil
• Stereolithographic scaffold with a Honeywell FS03 Force Sensorfor force sensing
• Optical IR transceiver (Vishay TCRT5000L) used to measurespeaker cone position
• Total mass of 23.6 grams• Controlled by Analog Devices ADuC7026 microprocessor• Wixel USB module (Pololu; Las Vegas, NV) enabled
communication between the “master” microprocessor and a “slave”computer for data logging and mode selection
A Proportional-Integral-Derivative (PID) feedback controller was usedto regulate speaker current based on force and displacementmeasurements [2]. The error (e) was determined by subtracting thesensor voltage at some set point from the current sensor voltage.Proportional control multiplies a proportional gain (Kp) by the error,while the integral (Ki) and differential (Kd) controls summate previouserrors and predict future errors with their respective gains [2] (Figure1).Two primary modes of PID were developed: (1) Virtual Wall (VW)mode, in which a set-point was chosen based on the desireddisplacement, with the error used to resist displacement from the set-point with maximum force, and (2) Zero Stiffness (ZS) mode in whichspeaker voltage was used to minimize force detected by the sensorand thereby simulate open air. These modes were compared with theactuator on mute, with no compensation of force (Figure 3).
In each case, PID control was used determine the output voltagebased on the error (Equation 1).
𝑉"#$ = 𝐾' ∗ 𝑒 𝑡 +𝐾, - 𝑒 𝑡. 𝑑𝑡.$
0+𝐾1
𝑑𝑒(𝑡)𝑑𝑡
Equation 1: PID Controller tuning equation
Open-loop Ziegler-Nichols tuning was performed to empiricallydetermine the PID gains from the ultimate gain (Ku), the value of Kpat which the system began oscillating, and the period (Tu) ofoscillation for each mode. Anti-windup control was implemented byscaling down the integral component by the difference in thecalculated controller output and the maximum actuator output [2]. Aslew-rate limiter and a low pass filter were added to compensate forhigh frequency signal noise accentuated by the derivative gain term.
• Tyreus-Luyben PID controller settings were adopted over Ziegler-Nichols due to their greater stability.
• Final Ku and Tu were found for each operation mode• PID control of Virtual Wall mode produced forces opposite to the
user, resulting in almost zero displacement (Figure 4)• The new rendition of Zero-Stiffness mode actively removed the
tension at all positions of the speaker cone (Figure 5)Dynamic control of the actuator was achieved with PID andsuccessfully rendered both a very stiff membrane in VW mode andan empty space simulation in ZS mode. In both modes, PID controlof the speaker actuator minimized errors with lower latency thansimply P or PI methods. The addition of derivative control predictedfuture errors and balanced the error averaging conducted by theintegral term. Prior to anti-windup control, the actuator suffered fromrepeating integration of previous errors. Anti-windup eliminated“stickiness” related to actuator saturation at the ends of thedisplacement range.
NIH R01EY021641, NSF IIS-1518630, Research to PreventBlindness, University of Pittsburgh Swanson School of EngineeringREU
[1] Khera et al. One-Dimensional Haptic Rendering using Audio Speaker withDisplacement Determined by Inductance, Machines, 2016, 4, 9;doi:10.3390/machines4010009[2] Astrom, K. J., & Murray, R. M. (2008). PID Control. In Feedback Systems:An Introduction for Scientists and Engineers (pp. 293-312). Princeton, NJ:Princeton University Press.
Figure 5: Actuator response to appliedforces is almost full compliance. Forceapplication by user results in reductionof counter forces with low latency
Figure 4: Reaction forces are createdby the actuator, shown by an increasein speaker output. Counteractingforces reduce displacement from rest.
Figure 2: The 1 DOF Haptic Renderer(A) Solidworks model and (B) Physicalprototype
Figure 3: Force and displacementsensor measurements of perturbationswhen controller is turned off
Figure 1: Block diagram of PID controller. Output “v” of controller limited between0-2.5V due to actuator saturation, resulting in speaker output voltage (u). Systemreceives actuator output and calculates appropriate sensor voltage (y)
![NeurIPS 2019 Yuan Liu, Zehong Shen, Zhixuan Lin, Sida Peng ... · [2] Zhenhua Wang, et al. Affine subspace representation for feature description. In ECCV,2014. [3] Tsun-Yi Yang,](https://static.fdocuments.net/doc/165x107/5f487887584d1133366c3fe9/neurips-2019-yuan-liu-zehong-shen-zhixuan-lin-sida-peng-2-zhenhua-wang.jpg)
