Delft University of Technology 175 jaar TU Delft Erfgoed ...
The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller...
Transcript of The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller...
![Page 1: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/1.jpg)
1David Abbink – Human Controller |65
The Human ControllerClass 3. …to action
Teacher:• David ABBINK• BioMechanical Engineering, Delft University of Technology, The Netherlands
Simulation
While computers are capable of sometimes beating the world’s best (human) chess masters, states Wolpert, “when it comes to dexterity, a five-year-old child could beat any machine being made.”
- Wolpert’s TEDx Lecture
![Page 2: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/2.jpg)
2David Abbink – Human Controller |65
Learning Goals Lecture 2After this lecture, you will be able to:
1. Reproduce the human sensors1. Basics of anatomy, functionality of haptics (tactile & kinesthetic)
2. Apply methods to determine limitations of haptic perception
1. Apply the concept of admittance to explain neuromuscular feedback
1. Critically reflect on feedforward and feedback control
2. Critically reflect on the role of the neuromuscular system while performing a visual/vestibular tracking task
![Page 3: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/3.jpg)
3David Abbink – Human Controller |65
• Linkage (skeleton)
• Actuators (muscles)
• Sensory system• muscle spindles
(pos/vel feedback)• Golgi tendon organs
(force feedback)
• Controller(Central nervous system,
posterior parietal cortex)
• Wires (neurons)
Xdesired
Xrealized
The Neuromuscular System
![Page 4: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/4.jpg)
4David Abbink – Human Controller |65
• Linkage (skeleton)
• Actuators (muscles)
• Sensory system• muscle spindles
(pos/vel feedback)• Golgi tendon organs
(force feedback)
• Controller(Central nervous system,
posterior parietal cortex)
• Wires (neurons)
Fsensed
Fcontact
The Neuromuscular System
![Page 5: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/5.jpg)
5David Abbink – Human Controller |65
Sensor processing decision motorprogram
muscle
Nerve pulse Nerve pulse
central nervous system
Vision, Audio, and TactileInformation Processing: cognition
![Page 6: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/6.jpg)
6David Abbink – Human Controller |65
Sensor Reflex muscle
Nerve pulse Nerve pulse
Spinal cord
Vision, Audio, and TactileInformation Processing: ‘reflex’
![Page 7: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/7.jpg)
7David Abbink – Human Controller |65
Haptic sensing (feeling):Tactile and Proprioceptive sensors
![Page 8: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/8.jpg)
8David Abbink – Human Controller |65
Function of haptic perception
• Gathering information• Interaction with outside world• About forces, movements and orientation of limbs
• Human-machine interaction• Haptic Displays
• Vibrations (cell phone)
• Forces (assistance, simulation)
![Page 9: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/9.jpg)
9David Abbink – Human Controller |65
Two Kinds of Haptic Perception
1. Kinaesthetic/Proprioceptive:
force and displacementfrom tendon force, muscle stretch and
stretch velocities
1. Tactile: “everything else” :vibrations, temperature, pain, tickles, surface roughness,shear stress etc.from receptors in the skin
Two kinds of haptic perception
![Page 10: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/10.jpg)
10David Abbink – Human Controller |65
Sensing
Tactile Proprio.
Sensing
Tactile Proprio. Tactile sensors1. Merkel disk receptor
2. Meissner corpuscle
3. Pacinian corpuscle
4. Ruffini ending
5. Golgi-Mazzoni corpuscle
6. Free nerve ending
7. Hair tylotrich, hair-guard
8. Hair-down
9. Field
3
216
4
5
Anatomy: tactile
![Page 11: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/11.jpg)
11David Abbink – Human Controller |65Van der Helm
Sensing
Tactile Proprio.
Golgi Tendon Organ: force Muscle Spindles: position and velocity
Anatomy: proprioceptors
![Page 12: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/12.jpg)
12David Abbink – Human Controller |65
Voisin, 2002
Experiment set-up
2D angle discrimination
Index finger positioned at ‘a’
Single to-and-fro movement(a-b-c-b-a)
Subjects identify the larger of two angles (2AFC)
Proprioceptive and tactile contributions to haptic perception
![Page 13: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/13.jpg)
13David Abbink – Human Controller |65Voisin, 2002
Tactile feedback No tactile feedback
Proprioceptive feedback
Active touch, both present (reference)
Active touch with finger anaesthesia,
only proprioceptive
No proprioceptive feedback
Passive touch, only tactile
Passive touch withdigital anaesthesia,
neither
Experiment conditions
Proprioceptive and tactile contributions to haptic perception
![Page 14: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/14.jpg)
14David Abbink – Human Controller |65Voisin, 2002
Tactile feedback
No tactile feedback
Proprio-ceptive
feedback4.0° 7.2°
No proprio-ceptive
feedback8.7°
Chance (>13°)
Experiment results
Proprioceptive and tactile contributions to haptic perception
![Page 15: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/15.jpg)
15David Abbink – Human Controller |65
• … research on the computational principles of motor control can help us understand everyday occurrences like fights between your kids in the back seat of the family car. A few years ago, Wolpert set out to understand why these battles escalated. Each of his daughters, then age 9 and 12, would always claim that the other one had hit her harder, so they would continue and hit harder each turn. He figured that sensory filtering was at work here, as in tickling: “Whenever you are getting sensations based on your own movements, you will subtract some of that from your own perception. Tit-for-tat actually escalates.” He confirmed the hypothesis with a tapping (not slugging) experiment, finding that the force of the taps increased 40% at each exchange.
Sensory Noise
![Page 16: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/16.jpg)
16David Abbink – Human Controller |65
Influences on Haptic PerceptionSensory Weighting (Mugge et al., 2009)
![Page 17: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/17.jpg)
17David Abbink – Human Controller |65
Influences on Haptic Perception
• What do you expect to influence whether you perceive a force or not?
Influences on Haptic Perception
![Page 18: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/18.jpg)
18David Abbink – Human Controller |65
Bias force
Jones, 2002
Increase in bias force increases Just-Noticeable Difference proportionally
Time
Forc
e
Bias
Influences on Haptic PerceptionInfluences on Haptic Perception
![Page 19: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/19.jpg)
19David Abbink – Human Controller |65
Frequency:
Enriquez, 2002; Jones, 2002
Higher frequencies (up to 250 Hz) are easier to detect
Time
Forc
e
Frequency (Hz)
Forc
e (m
Nm
)
Influences on haptic perceptionInfluences on Haptic Perception
![Page 20: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/20.jpg)
20David Abbink – Human Controller |65
Body location, shape and size of stimulator
Density of receptors in body parts is differentFor example density of corpuscles of Meissner: Fingertips: 23 per mm2
Forearm: 1 per 36 mm2
Ratio: 800 to 1
Van Lunteren & Stassen, 1970
Greater amount of affected mechanoreceptors are easier to detect
Influences on haptic perceptionInfluences on Haptic Perception
![Page 21: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/21.jpg)
21David Abbink – Human Controller |65
Distraction
BSc research:Determination JND at three different task complexities
Geurtsen & Herfkens, 2004
Additional task deteriorates performance on haptic perception
Influences on haptic perceptionInfluences on Haptic Perception
![Page 22: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/22.jpg)
22David Abbink – Human Controller |65
Footwear
0246810121416
10.50.3
Frequency (Hz)
Perc
eptio
n lim
it (N
)
Bowling shoe
Sneaker
Sock
Covering of the skin (gloves, shoes)
Determination perception limits with different types of footwear
Altena & De Gier, 2004
Footwear deteriorates haptic perception
Influences on haptic perceptionInfluences on Haptic Perception
![Page 23: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/23.jpg)
23David Abbink – Human Controller |65
Conflicting sensory input
In general vision is dominant over other modalities when conflicting information is presented
Nevertheless when more precise judgements are required the response modality dominates
Heller, 1999
e.g. larger objects of the same weight are perceived heavier
Influences on haptic perceptionInfluences on Haptic Perception
![Page 24: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/24.jpg)
24David Abbink – Human Controller |65
How do you respond to a signal?
From Haptic Perception To Action
sensors
Brain
200 msstimulus
response
spine
stimulus
cognitiveresponse
From Perception to Action
![Page 25: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/25.jpg)
25David Abbink – Human Controller |65
How do you respond to a signal?
From Haptic Perception To Action
muscle sensors
Brain
200 msstimulus
spine
stimulus
cognitiveresponsereflexive
response
40 ms
passiveresponse
From Perception to Action
![Page 26: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/26.jpg)
26David Abbink – Human Controller |65
1. Re-constructing Reality• Tele-operation: restoring natural force feedback• Over distance / in scale
2. Simulating Reality• Training difficult manual tasks
3. Enhancing reality• Games, Fun and Gadgets• Art & Music• Communication / Alerts/ Warnings• Improving Manual Control
• Shared Control
Haptic ApplicationsHaptic Applications (more in class 7-9)
![Page 27: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/27.jpg)
27David Abbink – Human Controller |65
Neuromuscular System- generating force
![Page 28: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/28.jpg)
28David Abbink – Human Controller |65
How do humans generate force?
• Humans generate force by contracting skeletal muscles
• Skeletal muscles consist of muscle fibers
• Muscle fibers are built up from myofibrils, the basic force generating unit of muscles
• Muscles can only contract actively; extension is passive
Physiological and anatomical aspects
How do we generate force?
![Page 29: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/29.jpg)
29David Abbink – Human Controller |65
How do humans generate force?Physiological and anatomical aspects
Anatomy
![Page 30: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/30.jpg)
30David Abbink – Human Controller |65
How do humans generate force?Physiological and anatomical aspects
• Muscles can only contract actively due to chemical structure of the myofibrils
• Muscles cannot, therefore, actively extend
Anatomy
![Page 31: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/31.jpg)
31David Abbink – Human Controller |65
How do humans generate force?
• Skeletal muscles are connected to bones via tendons
• Force, speed and unidirectional of movement of limbs is achieved via levers of bone-muscle attachments
Limb movement
Transfering muscle force to skeleton
![Page 32: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/32.jpg)
32David Abbink – Human Controller |65
How do humans generate force?
• Bidirectional movement of limbs is achieved through a combinations of antagonistic muscle pairs
Limb movement
Moving a joint – muscle pairs
![Page 33: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/33.jpg)
33David Abbink – Human Controller |65
How do humans generate force?
• Afferent neurons carry signals from the muscles to the spinal chord and the brain
• Efferent neurons carry signals form the brain and spinal chord to the muscle fibres
Control of muscle force and limb movement
Information flow to and from muscles
![Page 34: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/34.jpg)
34David Abbink – Human Controller |65
How do humans generate force?
• Conscious control requires input from the brain
• Limb movement is the result of automatic inhibition of antagonist muscle upon activation of agonist muscle
Control of muscle force and limb movement
Central Nervous System and Muscles
![Page 35: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/35.jpg)
36David Abbink – Human Controller |65
Force-length & velocity relationMuscle Force depends on: velocity and length
![Page 36: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/36.jpg)
39David Abbink – Human Controller |65
Hill-type models
Fmax
Activation dynamics q(t)
Neural input force
contraction dynamics f(l), g(v)
Muscle length
Muscle velocity
Modeling Muscle Force Generation: Hill
![Page 37: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/37.jpg)
41David Abbink – Human Controller |65
Fiber typesMotor Noise
• Force build-up is not perfectly smooth:• motor noise
• Motor noise depends on• Type of muscle• Fatigue
• Can be reduced
![Page 38: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/38.jpg)
42David Abbink – Human Controller |65
Neuromuscular System- motor control- experiments & modeling
![Page 39: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/39.jpg)
43David Abbink – Human Controller |65
Motor Control – two types
Feed-forward control • Requires: Good internal model of interaction• Most used: No perturbations
Fast goal-directed movements
Feedback control (impedance control)• Requires: sensory information• Most used: disturbance rejection
![Page 40: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/40.jpg)
44David Abbink – Human Controller |65
Experimental study
Procedure1. Learn trajectories in
normal field2. Perform in divergent
force fields (4 strengths)3. Randomly do stiffness
measurements during some DF-trials
• Hogan: “Impedance control can be used to stabilize the arm”
• To what extent can impedance control be modified?
Franklin et al (2004) - Impedance Control Balances Stability With Metabolically CostlyMuscle Activation. Journal of NeuroPhysiology
![Page 41: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/41.jpg)
45David Abbink – Human Controller |65
Results• Subjects learn to generate smooth trajectories in each unstable
environment • Subjects adapted their endpoint stiffness to each unstable
environment: the stronger the field, the larger the stiffness• Overall stiffness (of manipulator + human) remained similar
All of this suggests that metabolic energy and stability margins are balanced during motion control
![Page 42: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/42.jpg)
47David Abbink – Human Controller |65
Neuromuscular identification
• How do humans control posture?• What is the role of motor reflexes?• How effective is intrinsic joint stiffness (resulting from pretension of
antagonist muscles)?
• Motivation• Aircraft control (stability issues)• Automotive control (steering, haptic gas pedal)• Medical, understand & diagnose motor disorders
Controlling posture or forces: how?
![Page 43: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/43.jpg)
48David Abbink – Human Controller |65
How do humans generate force?
• Reflexive behaviour is regulated via the spinal chord and does not require conscious control
• But: conscious control can influence the strength and nature of the response!
• Reflexive behaviour is fast and also automatically inhibits the antagonistic muscle to allow movement of the excited muscle
Control of muscle force and limb movement
Spinal Reflexes
![Page 44: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/44.jpg)
49David Abbink – Human Controller |65
Strategies to resist force perturbations
• Co-activation of muscles (co-contraction):• Increased muscle stiffness & viscosity• Effective for large range of frequencies• Costs much energy
• Proprioceptive feedback:• Length, velocity and force feedback• Energy efficient, only active if perturbations are present• Only effective for low frequency perturbations due to time-delays in
nervous system
Two strategies to resist perturbations
![Page 45: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/45.jpg)
50David Abbink – Human Controller |65
Postural control:Resisting external perturbations
Externalforces
Drill
![Page 46: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/46.jpg)
51David Abbink – Human Controller |65
Postural control:Resisting ‘internal’ perturbations
‘Internal’forces
cup
![Page 47: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/47.jpg)
52David Abbink – Human Controller |65
How do we model limb movement?
• The neuromusculoskeletal system is modeled as a mass-spring-damper system
• Humans can actively control the stiffness of the muscles
Physical mass-spring-damper model
xarm
Simple Modeling of the Neuromuscular System
![Page 48: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/48.jpg)
53David Abbink – Human Controller |65
How do we model limb movement?
• When in contact with objects, the grip is modeled as a very stiff system with some damping and no mass.
Physical mass-spring damper model
xarm xhandle
grip
grip
arm
armFhandle
Simple Modeling of the Neuromuscular System
![Page 49: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/49.jpg)
54David Abbink – Human Controller |65
Stretch amplitude & muscle activation (e.g., Cathers, 1999; Kearney and Hunter, 1983)
Frequency content of perturbation (e.g., Van Der Helm et al., 2002)
Dynamics of environment (stiffness, damping)(e.g., Schouten et al. 2004, 2008b, Abbink et al. 2004)
Task instruction (transient response)(e.g., Doemges & Rack 1992a,b; Abbink et al. 2004, 2009 )
Response to perturbations is highly adaptive
Simple Modeling of the Neuromuscular System
Adaptability of Neuromuscular Feedback
![Page 50: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/50.jpg)
55David Abbink – Human Controller |65
α
F
1. Impose Force Perturbation2. Task Instruction3. Measure Signals
• Pedal Force• Pedal Displacement• Force Perturbation
4. Estimate Admittance
Simple Modeling of the Neuromuscular System
Measuring Neuromuscular Feedback
![Page 51: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/51.jpg)
56David Abbink – Human Controller |65
can be estimated as frequency response functioninput force/torque output position/rotation
captures causal dynamic response of a human to interaction forces with the environment
K B
IRoughly resembles 2nd
order system
Highly adaptive!
Admittance:
X/F
frequency
Measuring Neuromuscular Feedback
![Page 52: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/52.jpg)
57David Abbink – Human Controller |65
Time-variance in admittance (Abbink et al.)
![Page 53: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/53.jpg)
58David Abbink – Human Controller |65
Tactile and kinesthetic contributions to admittance (Mugge & Abbink 2013)
![Page 54: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/54.jpg)
59David Abbink – Human Controller |65
Conclusions Neuromuscular System• Skeletal muscle is strongly non-linear (Hill)
• Non-linearity is essential in human motion• Linearization is successful for control tasks with small amplitudes
• Reflexive feedback gains are very important for the behaviour of neuro-musculoskeletal systems
• Position feedback• Velocity feedback• Force feedback
• Co-contraction and Reflexive feedback gains are continuously adapted, near-optimal
• task instructions, environment, perturbations
• Endpoint behaviour can be captured by admittance
Conclusions about the Neuromuscular System
![Page 55: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/55.jpg)
60David Abbink – Human Controller |65
The Role of the Neuromuscular System in visual / vestibular control loops
![Page 56: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/56.jpg)
61David Abbink – Human Controller |65
The Lumped Neuromuscular System
- -
The neuromuscular system is usually considered as a limitation, and can be seen as a controller-actuator system between udesired and urealized
The neuromuscular system can be modeled as a first or second-order low-pass filter:Lumped neuromuscular system.
Sensors Equalization VehicleDynamics
Displays NeuromuscularSystem
ControlInceptor
+
Hlumped =
![Page 57: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/57.jpg)
62David Abbink – Human Controller |65
- -
The Neuromuscular SystemSensors Equalization Vehicle
DynamicsDisplays Neuromuscular
SystemControlInceptor
+
-
--
-
Feed-forward
Feed-back
![Page 58: The Human Controller - TU Delft OCW...David Abbink – Human Controller 1 |65 The Human Controller Class 3. …to action Teacher: • David ABBINK • BioMechanical Engineering, Delft](https://reader033.fdocuments.net/reader033/viewer/2022041713/5e49c0f508d9a138915a4e38/html5/thumbnails/58.jpg)
63David Abbink – Human Controller |65
Take Home Message
Today you have learned:
1. About two kinds of haptic perception1. Tactile2. Proprioceptive
2. About Human Motion Control (muscles and reflexes)1. Feedforward
1. Learn smooth movements over time
2. Motor noise
2. Feedback1. stiff through co-contraction and reflexive activity
2. compliant through relaxed muscles and reflexive activity
3. Endpoint feedback properties can be captured by admittance