Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of...
-
Upload
ralf-briggs -
Category
Documents
-
view
229 -
download
1
Transcript of Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of...
![Page 1: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/1.jpg)
Introduction to Haptic Rendering
JPL - Virtual Environments LaboratoryCalifornia Institute of Technology
(http://eis.jpl.nasa.gov/~basdogan)
Cagatay Basdogan, Ph.D
![Page 2: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/2.jpg)
Haptic (adj.):related to the sense of touch.
Haptic Rendering:process of displaying synthetically generated 2D/3D haptic stimuli to the user
Graphical Rendering: process of displaying synthetically generated 2D/3D visual stimuli to the user
F
simulatedhapticprobe
Haptic Interface: device for touch interactions in real and virtual worlds
![Page 3: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/3.jpg)
Applications
Haptic Feedback for Medical Simulation and
Training
VisualDisplay
HapticDisplay
force
molecule
Haptic Feedback forMolecular Simulation
![Page 4: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/4.jpg)
Haptic Feedback for Crew TrainingHaptic User Interface (HUI)
collected data
haptic display
Haptic Visualization
tangible data
Tangible Interfaces• buttons• dials• slider bars• folders• layers• force fields
Simulation ofrepair and
maintenance tasks
Haptic Feedback for CollaborativeEngineering Design
Applications
![Page 5: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/5.jpg)
A little evidence can tell you the whole story!
The Power of Touch:
![Page 6: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/6.jpg)
Hu
man
Hap
tics
Mach
ine H
aptics
Human vs Machine Haptics:
![Page 7: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/7.jpg)
Tactile DisplaysNet Force Displays
Types of Haptic Devices
Machine Haptics:
![Page 8: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/8.jpg)
Types of Haptic Devices
ActivePassive
keyboard, trackball, mice, etc.
Force
![Page 9: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/9.jpg)
Types of Haptic Devices
Grounded Attached
combined
![Page 10: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/10.jpg)
Integration of Vision and Touch
HapticThread
HapticInterface
HUMAN OPERATOR
VisualThread
VisualInterface
SharedDatabase
Mot
orT
orqu
es
En
cod
erP
osit
ions
DIS
PL
AY
FO
RC
E
STA
TE
~1 k
Hz
DIS
PL
AY
VIS
UA
LS
STA
TE
Imag
es
~ 30
Hz
![Page 11: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/11.jpg)
Haptic Rendering with a Force Display
CollisionDetection
CollisionResponse
Geometry
Material
Object Database
PositionOrientation
ContactInformation
ForceTorquevirtual
wall
F
![Page 12: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/12.jpg)
Force
Force
Torque
b ca
Force
Torque
d
Point-Object
Types of Haptic Interactions with 3D Objects:
Line Segment-Object Object-Object
more computation
![Page 13: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/13.jpg)
void calculate_force (Vector &force) { float X, Y, Z, distance; float R = 20.0;
X = HIP[0]; Y = HIP[1]; Z = HIP[2]; distance = sqrt(X*X + Y*Y + Z*Z);
if(distance < R) //collision check { force[0] = X/distance * (R-distance); force[1] = Y/distance * (R-distance); force[2] = Z/distance * (R-distance);
}
}
F
R
distanceHIP
Hand
Haptic Rendering Of 3D Geometric Primitives(point-object interaction)
![Page 14: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/14.jpg)
Haptic Rendering of 3D Objects (point-object interaction)
F = k x
x
IHIP
HIP
3D Primitivesno problem ! ?
3D Object- optimization
- rule-based techniques
![Page 15: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/15.jpg)
Modeling Choices for 3D Object Representation(point-object interaction)
• polygonal
• implicit
• NURBS
• voxel
will becovered
in this tutorial see my notes forrelated references
![Page 16: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/16.jpg)
Polygon Edge Vertex
Edge Vertex
Neighbors
Representation of a 3D Polyhedron
SoCoordinate3 SoIndexedFaceSet
X Y Z-5.0 2.0 1.01.0 6.0 -3.04.0 2.0 -2.0… … ...
012...
SoSeparator
1 4 07 3 65 1 2… … ...
012...
Open Inventor/VRML file
Database
3D Polyhedron
![Page 17: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/17.jpg)
1) Bounding-box hierarchy
Key Components of the Rendering Algorithm
F1
F2
F3
Box I Box II
Box III Box IV
3) Local coherence
2) Contact history
F3
![Page 18: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/18.jpg)
HIPt
HIPt-1 HIPt-2HIPt-3
v2
v3
v1
HIPt+1
IHIPt
IHIPt+1
d
HIPt+2
IHIPt+2
d
Haptic Rendering of Polygonal Surfaces
see Ho et al., 1999 for details
![Page 19: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/19.jpg)
actualshape
Haptic Display of Surface Details
• Haptic smoothing of object surfaces
• Rendering of haptic textures
• Haptic rendering of surfaces with friction
Direction
of movement
Fn
Ff
Ft
Fuser displayedshape
![Page 20: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/20.jpg)
Friction
Fn
Ff
Ft
Fuser
Force Shading Texture
Common Principle: Perturbation of force vector !
ref: Phong Shading ref: Bump Mappingref: Mechanics books
3
3
.
ii
iii
s
A
NAN
A1
A2
A3
N1
N2
N3
kz
hj
y
hi
x
hh ˆˆˆ
h(x,y,z) : texture field
FFperturbed
h
![Page 21: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/21.jpg)
Haptic Texturing
s
t
• image-based
• procedural
h(x,y,z)
two-stage mapping
Bier & Sloan, 1986
bump mapping
Blinn, 1978;Max and Becker, 1994
![Page 22: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/22.jpg)
Force-Reflecting Deformable Models:
Haptic Sculpting
Surgical Simulation
F
F
Animation/Ergonomics
Web-based hapticsfor product designand purchase
Free-form Deformation
Real-time FEM
![Page 23: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/23.jpg)
T3x3
1
T
1
HIP
T-1
1
H2 = H1T
V2 = V1T
F2
F2
F1
X
Y
(HIP) T-1
b)
c)
H2 = H1
V2 = V1T
F2 = F1T
IHIP
Ftotal
a)
Rigid Body Dynamics:
Method (c) is computationally better than (b) !
![Page 24: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/24.jpg)
Recording and Playing-back Haptic Stimuli:
Web-based Haptics
Gear.wrl
+ Haptics
- file format- data structure- device independent support- internet protocol- data compression...
![Page 25: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/25.jpg)
Problems in Engineering Design:
A few problems with current systems:• automated systems can not duplicate the knowledge and intelligence of an experienced designer.• limits the ability of design engineers to experiment with different design configurations.• design process is slow, sequential, and non-intuitive.•testing the functionality/ergonomics of a product
is costly and requires many iterations
CAD CAE CAM productionconcept
digital prototypehaptic sculpting?
Virtual Prototyping with Haptic Feedback
![Page 26: Introduction to Haptic Rendering JPL - Virtual Environments Laboratory California Institute of Technology (basdogan) Cagatay Basdogan,](https://reader035.fdocuments.net/reader035/viewer/2022062300/56649e215503460f94b0e158/html5/thumbnails/26.jpg)
Benefits of Touch Feedback in Engineering Design:
• finding the insertion/removal paths of objects• precision mating• planning the sequence of assembling products • guiding/constraining the user during digital sculpting• improving depth perception and resolving visual ambiguities • testing the functionality of products in virtual worlds• designing user friendly interfaces
However, haptic feedback can be used for
1 Path planning2 Assembly sequence3 Digital Prototyping4 Functionality & Maintenance5 Ergonomics
areas where haptic feedback can contribute significantly to design process !