By - Automation, Robotics, & Mechatronics Laboratory

162
i ANALYSIS OF PARALLEL MANIPULATOR ARCHITECTURES FOR USE IN MASTICATORY STUDIES By MADUSUDANAN SATHIA NARAYANAN September 2008 A thesis submitted to the Faculty of the Graduate School of the State University of New York at Buffalo in partial fulfillment of the requirements for the degree of MASTER OF SCIENCE Department of Mechanical and Aerospace Engineering State University of New York at Buffalo Buffalo, New York 14260

Transcript of By - Automation, Robotics, & Mechatronics Laboratory

Page 1: By - Automation, Robotics, & Mechatronics Laboratory

i

ANALYSIS OF PARALLEL MANIPULATOR ARCHITECTURES

FOR USE IN

MASTICATORY STUDIES

By

MADUSUDANAN SATHIA NARAYANAN

September 2008

A thesis submitted to the Faculty of the Graduate School of the State University of New York at Buffalo in partial fulfillment of the requirements

for the degree of MASTER OF SCIENCE

Department of Mechanical and Aerospace Engineering State University of New York at Buffalo

Buffalo, New York 14260

Page 2: By - Automation, Robotics, & Mechatronics Laboratory

ii

To my family and friends,

Without whom, I am nothing

Page 3: By - Automation, Robotics, & Mechatronics Laboratory

iii

Acknowledgement

I want to express my sincerest gratitude to my advisor, Dr. Krovi for constantly

motivating and supporting me, and for being a good friend. This work would be highly

impossible without him. I grateful to have worked under his guidance for the last two

years and I thank him for providing me the wonderful opportunity of being a part of

ARMLAB, which actually became my second home in the due course. I also thank Dr.

Mendel, my co-advisor throughout this work for his motivation and support. I enjoyed

working with him.

I also thank Dr. Tarunraj Singh for being a part of my thesis committee as well as

a former instructor. His classes and the projects were very useful.

I also thank all the ARMLAB members for having our shared of enjoyment and

entertaining experiences. I also thank CP and Leng-Feng, the current senior lab members

for helping and supporting me since the day I joined the lab. Also special thanks to Pat,

Hao, Qiushi, Yao, Anand, Kun as well as Rajan for lending helping hands whenever I

needed them. I also thank Srikanth for being my partner not only in this project but

throughout my graduate course work and lab activities, and his good company.

I also thank all my friends in Buffalo- Parthi, Amol, Govind and others, who made my

stay in the U.S. more comfortable and happy. Special thanks to all my friends in India as

well especially, Karthik, Arun, Nisha, Deepika and many more, with whom I have

cherished memories that will never fade. Lastly, but most importantly, I would like to

dedicate this work to my parents and my sister without whom I would not be where I am

Page 4: By - Automation, Robotics, & Mechatronics Laboratory

iv

now. They constantly motivated and supported me from the beginning, and cherished my

growth and achievements, especially while I was away from home.

Thank you— Mom, Dad and Sis for everything.

Thank you everyone.

Page 5: By - Automation, Robotics, & Mechatronics Laboratory

v

Table of Contents

List of Figures............................................................................................... xi

List of Tables ............................................................................................ xxiv

Abstract..................................................................................................... xxvi

1. Introduction ........................................................................................ 1

1.1. Background .......................................................................................................... 2

1.2. Problem Statement ............................................................................................... 4

1.2.1. Research Goals........................................................................................ 4

1.3. Research Issues .................................................................................................... 6

1.4. Thesis Organization.............................................................................................. 7

2. Literature Survey ............................................................................... 8

2.1. Related Work........................................................................................................ 8

2.1.1. Biomechanical Model of the Jaw............................................................ 8

2.1.2. Masticatory Robotic Manipulators ....................................................... 10

2.1.3. Parallel Actuated Robotic Manipulators............................................... 15

2.1.4. Jaw Motion Analysis, Imaging and Experiments ................................. 16

2.2. Computational Tools .......................................................................................... 18

2.2.1. Musculoskeletal Analysis Tools: .......................................................... 18

Page 6: By - Automation, Robotics, & Mechatronics Laboratory

vi

2.2.2. Dynamics Simulation/ Analysis Tools: ................................................ 22

2.2.3. CT Scanning and Imaging .................................................................... 25

2.3. Motion Capture Technology .............................................................................. 26

2.3.1. Motion Capture and analysis Systems: ................................................. 26

2.3.2. Optical Markers: ................................................................................... 27

2.3.3. Non-optical markers: ............................................................................ 29

2.3.4. Markerless tracking devices:................................................................. 30

2.3.5. Motion Capture beyond Markers - 3D Scanners .................................. 31

2.3.6. Issues with MoCap Systems ................................................................. 33

2.3.7. SimiMotion System .............................................................................. 35

2.3.8. Modules................................................................................................. 36

2.3.9. MoCap Transformation and Synchronization....................................... 38

3. Biomechanics of Masticatory Motion............................................. 41

3.1. Human Masticatory System ............................................................................... 41

3.1.1. Temporo-Mandibular Joint (TMJ)........................................................ 42

3.1.2. Musculoskeletal Modeling.................................................................... 42

3.1.3. Dynamic modeling of Mastication........................................................ 44

3.1.4. Inverse Dynamic Analysis and Muscle Actuation................................ 45

3.1.5. Muscle Modeling (Active and Passive): ............................................... 47

Page 7: By - Automation, Robotics, & Mechatronics Laboratory

vii

Passive Elements: ...................................................................................................... 48

3.1.6. Posselt Envelope: .................................................................................. 49

4. Mathematical Background .............................................................. 51

4.1. Kinematics of R-U-S Configuration .................................................................. 51

4.2. Position Kinematics: .......................................................................................... 53

4.3. Velocity Kinematics to find Link Jacobian Matrix:........................................... 54

4. 3.1. Link and Manipulator Jacobian Matrix................................................. 56

4.4. Screw Theoretic Jacobian Matrix and Singularity Analysis .............................. 57

4.5. Singularity Analysis of the Jacobian of R-U-S Platform ................................... 58

4.6. Kinematic of P-U-S Platform............................................................................. 59

4.7. Velocity Kinematics of P-U-S Platform............................................................. 61

4.8. Denavit Hartenberg Parameterization ................................................................ 62

4.9. P-U-S Manipulator Parametric Study ................................................................ 65

4.9.1. Maximum Reachable Workspace, Velocity and Force......................... 65

4.10. Jacobian-Based Performance Measures (JBPM) .......................................... 69

4.10.1. SVD and Manipulability ellipsoid ........................................................ 70

4.10.2. Yoshikawa Measure.............................................................................. 71

4.10.3. Condition Number ................................................................................ 72

4.10.4. Isotropy Index ....................................................................................... 72

Page 8: By - Automation, Robotics, & Mechatronics Laboratory

viii

4.11.1. Transformation Matrix between MoCap coordinates and Platform

coordinates ............................................................................................................ 73

5. Technological Tools .......................................................................... 76

5.1. CT-Scan to CAD Conversion............................................................................. 76

5.2. SimiMotion MoCap Station ............................................................................... 78

5.2.1. Workflow for Motion Capture using SimiMotion system:................... 78

5.2.2. Experimental Setup............................................................................... 82

5.3. Inverse Dynamics Analysis of Musculoskeletal Models ................................... 83

5.3.1. Human Jaw Model (Mark de Zee Model)............................................. 83

5.3.2. Human Jaw Model (14 Muscle Actuator Model) ................................. 85

5.3.3. Labrador Jaw Model ............................................................................. 87

6. Musculoskeletal Modeling Simulation and Results ...................... 91

6.1. Work envelope study using Posselt diagram...................................................... 91

6.1.1. Human Jaw Model ................................................................................ 91

6.1.2. Labrador Jaw Model ............................................................................. 92

6.2. Musculoskeletal Model Case Studies- Human Jaw ........................................... 93

Case A.I.1: Simple Muscle Model, No bite force (free chewing motion) ............ 93

Case A.I.2: Simple Muscle Model, Constant Bite Force (200 N in –z) ............... 95

Case A.I.3: Simple Muscle Model, Realistic Bite Force ...................................... 96

Page 9: By - Automation, Robotics, & Mechatronics Laboratory

ix

Case A.II.1: Muscle Model 3E, No Bite Force (free chewing motion) ................ 97

Case A.II.2: Muscle Model 3E, Constant Bite Force (100 N in –z) ..................... 98

Case A.II.3: Muscle Model 3E, Realistic Bite Force............................................ 99

6.3. Musculoskeletal Model Case Studies- Labrador Dog...................................... 100

Case B. I. 1: Simple Muscle Model, no bite force (free chewing motion) ......... 100

Case B.I.2: Temporalis Muscle Tendon Unit, Constant Bite Force ................... 101

Case B.I.3: Temporalis Muscle Tendon Unit, Realistic Bite Force.................... 102

7. Masticatory Simulator- Analysis and Results ............................. 103

7.1. Inverse Kinematics and Jacobian Based Workspace Analysis of 6-DOF R-U-S

Manipulator.............................................................................................................. 103

7.1.1. Inverse Kinematics Simulation ........................................................... 103

7.2. Validation using Visual Nastran for R-U-S Case............................................. 104

Case 1: Point ....................................................................................................... 105

Case 2: Straight line ............................................................................................ 105

Case 3: Circle...................................................................................................... 105

7.3. Constant Orientation Workspace Analysis ...................................................... 106

7.4. Inverse Kinematics and Jacobian Based Workspace Analysis of 6-DOF P-U-S

Manipulator.............................................................................................................. 111

7.4.1. Inverse Kinematics Simulation ........................................................... 111

Page 10: By - Automation, Robotics, & Mechatronics Laboratory

x

7.4.2. Constant Orientation Workspace Analysis ......................................... 113

7.5. Visual Nastran Implementation P-U-S Manipulator ........................................ 116

Case 1: Human Jaw Motion Trajectory .............................................................. 116

Case 2: Labrador Jaw Motion Trajectory ........................................................... 117

Case 2: Bulldog Jaw Motion Trajectory ............................................................. 118

7.6. Parametric Study of P-U-S Manipulator .......................................................... 119

7.6.1. Simplified Representation of Parametric Analysis ............................. 119

7.6.2. Parametric Study I: Effects of R/r and r on Fz, Pz and Vz ................. 120

7.6.3. Parametric Study II: Effects of /l r and r on Fz, Pz and Vz.............. 122

7.6.4. Parametric Study III: Effects of q0/ Tq0 and r on Fz, Pz and Vz ....... 123

7.6.5. Parametric Sweep of Workspace Variables against r and r/R ratio: ... 125

7.6.6. Parametric Sweep of Workspace Variables against r and r/R ratio: ... 125

8. Conclusion:...................................................................................... 128

8.1. Summary .......................................................................................................... 128

8.2. Future Work: .................................................................................................... 129

Bibliography .............................................................................................. 131

Page 11: By - Automation, Robotics, & Mechatronics Laboratory

xi

List of Figures

Figure 1-1: Engineering Paradigm..................................................................................... 3

Figure 1-2: Virtual to Physical Prototyping Cycle ............................................................. 3

Figure 1-3: Project Flowchart ............................................................................................ 5

Figure 2-1: Hinge Joint Axis Of TMJ For Left Side Movement ........................................ 9

Figure 2-2: Modeling Of Muscles As Threads ................................................................... 9

Figure 2-3: Anteriolateral View Of The Basic Model ........................................................ 9

Figure 2-4: Jaw Model With TMJ And Incisor Point Envelope......................................... 9

Figure 2-5: Oblique And Side View Of Jaw And Larynx Model In “Artisynth”............. 10

Figure 2-6: WY-5RII Mastication Robot......................................................................... 11

Figure 2-7: Commercial Mastication Robot For Use (WOJ1).......................................... 11

Figure 2-8: Food Texture Measurement Robot WWT-1 .................................................. 11

Figure 2-9: Jaw Robot 3D Simulation WOJ-1RII ............................................................ 11

Figure 2-10: Masticatory Robot Covered By The Skull In SolidWorks .......................... 12

Figure 2-11: 3-D Model Of The Mandible- The Actuators’ Attaching Points (Mi), And

The Reference Points ........................................................................................................ 12

Figure 2-12: Robotic Model In The Form Of Platform Mechanism Nomenclature And

Coordinate Systems .......................................................................................................... 13

Figure 2-13: 3D Kinematic Jaw Model ............................................................................ 13

Page 12: By - Automation, Robotics, & Mechatronics Laboratory

xii

Figure 2-14: Robotic Model Of Crank Actuation............................................................. 14

Figure 2-15: Physical Prototype Of The Dental Simulator............................................... 14

Figure 2-16: Four Bar Mechanism Simulator (MS Thesis, Darren Lewis, University Of

Massey) ............................................................................................................................. 14

Figure 2-17: Schematic Diagram Of Stewart Platform..................................................... 15

Figure 2-18: Force Analysis On Leg ................................................................................ 15

Figure 2-19: 2D CT scans and 3D STL Model Of The Human Jaw ............................... 18

Figure 2-20: AnyBody Software Interface ....................................................................... 19

Figure 2-21: Inverse Dynamics of a Redundant Musculoskeletal System (Konakanchi

[24])................................................................................................................................... 20

Figure 2-22: SIMM Virtual Model ................................................................................... 21

Figure 2-23: Double Pendulum Model implementation in DFP....................................... 22

Figure 2-24: SolidWorks- SimMechanics- VRML Framework ....................................... 23

Figure 2-25: SolidWorks Model of Parallel Manipulator................................................. 24

Figure 2-26: Open Loop Kinematics and Dynamic Analysis in Visual Nastran.............. 24

Figure 2-27: CT Scan Slices to STL Conversion.............................................................. 25

Figure 2-28: Working with STL in Rhinoceros................................................................ 25

Figure 2-29: OptiTrack Motion Capture........................................................................... 28

Figure 2-30: Peak Motus MoCap Equipment .................................................................. 28

Page 13: By - Automation, Robotics, & Mechatronics Laboratory

xiii

Figure 2-31:Time Modulated Active Marker ................................................................... 29

Figure 2-32: Semi Perceptible Marker.............................................................................. 29

Figure 2-33: Electromagnetic Motion Capture System .................................................... 30

Figure 2-34: Exoskeleton Mocap System......................................................................... 30

Figure 2-35: Inertial Motion Capture Systems ................................................................. 30

Figure 2-36: Inertial Motion Capture Systems at NASA (Miller, Jenkins et al. [42]) ..... 30

Figure 2-37: Markerless Motion Capture Systems by Organic Motion ........................... 31

Figure 2-38: Markerless Motion Capture Systems by Noraxon ....................................... 31

Figure 2-39: Facial Motion Capture at CMU Robotics Institute ...................................... 32

Figure 2-40: Facial Motion capture at IBM...................................................................... 32

Figure 2-41: PONTOS Scanners for Crash testing ........................................................... 32

Figure 2-42: PONTOS for Car Body testing .................................................................... 32

Figure 2-43: Errors in Motion Capture Process Gonzalez-Morcillo, Jimenez-Linares et al.

[49].................................................................................................................................... 34

Figure 2-44: Frames Captured at Different Instant during Motion Capture of a Mobile

Robotic Platform with Traces of the Markers at all times ................................................ 35

Figure 2-45: 2D/ 3D Kinematics Module ......................................................................... 36

Figure 2-46: Human Avatar within SimiMotion .............................................................. 36

Page 14: By - Automation, Robotics, & Mechatronics Laboratory

xiv

Figure 2-47: 3D Visualization of MoCap data of Jaw Motion using Stick Diagrams and

Plots of 3D coordinates of the incisor point tip ................................................................ 37

Figure 2-48: Simi Motion System..................................................................................... 38

Figure 2-49: Configure Trigger Signal in SimiMotion..................................................... 39

Figure 2-50: Triggering Unit in SimiMotion .................................................................... 39

Figure 3-1: Human Mandible............................................................................................ 42

Figure 3-2: Temporomandibular Joint .............................................................................. 42

Figure 3-3: Masticatory Muscular Architecture (Xu, Lewis et al. [11]) .......................... 43

Figure 3-4: Anatomical Planes- used to describe the positions of the muscles or organs in

musculoskeletal systems (Shin [53]) ................................................................................ 44

Figure 3-5: Six degrees of freedom for jaw movement. ................................................... 45

Figure 3-6: Forces acting on the lower jaw in the Sagittal plane...................................... 46

Figure 3-7: Schematic of force vector diagrams for each muscle groups......................... 47

Figure 3-8: Sagittal Plane- Posselt Envelope.................................................................... 49

Figure 3-9: Frontal Plane : Posselt Envelope.................................................................... 50

Figure 4-1: Schematic diagram of R-U-S configuration.................................................. 51

Figure 4-2: Kinematics of leg I of the R-U-S manipulator (front and side view) ........... 52

Figure 4-3: Base- Revolute Joint frame A ................................................................... 52

Page 15: By - Automation, Robotics, & Mechatronics Laboratory

xv

Figure 4-4: Front and Side Orthogonal View of ith Leg Configuration of the R-U-S

Manipulator....................................................................................................................... 55

Figure 4-5: Schematic diagram showing the DH parameterization for each joint

coordinate to determine the end effector reference frame ................................................ 62

Figure 4-6: Top view of base platform ............................................................................ 66

Figure 4-7: Front view of the manipulator at the two extreme positions to find Pz ......... 66

Figure 4-8: Top view of the base platform with the linear actuators – FBD to calculate

maximum workspace forces and torques.......................................................................... 67

Figure 4-9: Front and side view of the manipulator with the linear actuators – FBD to

calculate maximum workspace forces and torques........................................................... 68

Figure 4-10: Manipulability ellipsoid: mapping joint space velocities (hyper sphere) to

task space velocities (hyper ellipsoid) (Manipulability Index [61]) ................................. 70

Figure 4-11: Plane of Jaw Motion Measured using MoCap System with marker positions

identified ........................................................................................................................... 73

Figure 4-12: Transformation between MoCap and Platform Reference Frames............. 74

Figure 5-1: Different Views of Labrador Specimen ........................................................ 76

Figure 5-2:CT Scanned Images Import and Pixels Information Dialog ........................... 76

Figure 5-3: Segmentation Options .................................................................................... 77

Figure 5-4: Segmentation and 3D Calculation.................................................................. 77

Figure 5-5: STL file of CT scans ...................................................................................... 78

Page 16: By - Automation, Robotics, & Mechatronics Laboratory

xvi

Figure 5-6: Digitizing the Human Jaw Movement ........................................................... 79

Figure 5-7: Digitizing the Dog Jaw Movement ................................................................ 79

Figure 5-8: Typical Camera Setup for 2D Motion Capture Analysis............................... 79

Figure 5-9: Calibration of MoCap Region- Camera1 ....................................................... 80

Figure 5-10: Calibration of MoCap Region- Camera2 ..................................................... 80

Figure 5-11: Marker Occlusion Problems in Animals...................................................... 81

Figure 5-12: Digitization of the sequence of frames and automatic tracking of 2D

coordinates- Camera1 and 2.............................................................................................. 81

Figure 5-13: 3D Data Calculation and Stick Diagram Representation of Jaw for Cameras

1 and 2............................................................................................................................... 82

Figure 5-14: Experimental Setup for Animal Motion Capture with Cameras.................. 83

Figure 5-15: MoCap Workstation and Camera Setup for Animal Subjects ..................... 83

Figure 5-16: Muscle Actuators of a Jaw Model................................................................ 84

Figure 5-17: Lateral View of the Mark de Zee Human Jaw Model.................................. 84

Figure 5-18: Lower Mandible with the muscles attached used in Mark de Zee Model and

Structural Properties.......................................................................................................... 84

Figure 5-19: Temporalis Muscle Model (Green Colored Muscle Tendon Units) ............ 86

Figure 5-20: Aerial View of Mandible with Different Muscle Groups ............................ 86

Figure 5-21: Side and Top view of Musculoskeletal Jaw Model of Labrador Dog ........ 87

Page 17: By - Automation, Robotics, & Mechatronics Laboratory

xvii

Figure 5-22: Measurement of fiber length for Masseter muscle....................................... 88

Figure 5-23: Digastric Muscle (Jaw opener)- dissected out of the jaw ............................ 88

Figure 6-1: X and Z coordinates forming a Posselt Envelope in Sagittal Plane- Human

Jaw .................................................................................................................................... 91

Figure 6-2: X and Y coordinates forming a Posselt Envelope in Transverse Plane- Human

Jaw .................................................................................................................................... 91

Figure 6-3: Velocity trajectory of incisor tooth tip point for Human Jaw........................ 92

Figure 6-4: Acceleration trajectory of incisor tooth tip point for Human Jaw ................. 92

Figure 6-5: X and Z coordinates forming a Posselt Envelope in Sagittal Plane- Labrador

Jaw .................................................................................................................................... 92

Figure 6-6: X and Z coordinates forming a Posselt Envelope in transverse plane-

Labrador Jaw..................................................................................................................... 92

Figure 6-7: Velocity trajectory of incisor tooth tip point - Labrador Jaw ........................ 93

Figure 6-8: Acceleration trajectory of incisor tooth tip point - Labrador Jaw.................. 93

Figure 6-9: (a), (b) Elevator Muscle forces and activities (c) Muscle Lengths of RHS

Muscles ............................................................................................................................. 94

Figure 6-10: (a), (b) Depressor Muscle forces and activities (c) Muscle Lengths of LHS94

Figure 6-11: Parametric Studies for Mastication Musculoskeletal Analysis.................... 94

Figure 6-12: (a), (b) Elevator Muscle forces and activities for Case A.I.2...................... 95

Figure 6-13: (a), (b) Depressor Muscle forces and activities for Case A.I.2.................... 95

Page 18: By - Automation, Robotics, & Mechatronics Laboratory

xviii

Figure 6-14: TMJ Reaction forces for Case A.I.2 ............................................................ 95

Figure 6-15: (a), (b) Elevator Muscle forces and activities for Case A.I.3...................... 96

Figure 6-16: (a), (b) Depressor Muscle forces and activities Case A.I.3.......................... 96

Figure 6-19: (a) TMJ Reaction forces (b) Simulated bite force for Case A.I.3................ 96

Figure 6-18: (a), (b) Elevator Muscle forces and activities (c) Muscle Lengths of RHS

Muscles for Case A.I.2...................................................................................................... 97

Figure 6-19: (a), (b) Depressor Muscle forces and activities (c) Muscle Lengths of LHS

for Case A.I.2.................................................................................................................... 97

Figure 6-20: (a), (b) Elevator Muscle forces and activities of RHS Muscles for Case A.I.2

........................................................................................................................................... 98

Figure 6-21: (a), (b) Depressor Muscle forces and activities for Case A.I.2.................... 98

Figure 6-22: TMJ Reaction forces Case A.II.3................................................................. 98

Figure 6-23: (a), (b) Elevator Muscle forces and activities of RHS Muscles for Case A.I.3

........................................................................................................................................... 99

Figure 6-24: (a), (b) Depressor Muscle forces and activities for Case A.I.3.................... 99

Figure 6-25: (a) TMJ Reaction forces (b) Simulated bite force for Case A.II.3............... 99

Figure 6-26: (a), (b) Elevator Muscle forces and activities (c) Muscle Lengths of RHS

Muscles for Case B.I.1.................................................................................................... 100

Figure 6-27: (a), (b) Depressor Muscle forces and activities (c) Muscle Lengths of LHS

for Case B.I.1 .................................................................................................................. 100

Page 19: By - Automation, Robotics, & Mechatronics Laboratory

xix

Figure 6-28: (a), (b) Elevator Muscle forces and activities of RHS Muscles for Case B.I.2

......................................................................................................................................... 101

Figure 6-29: (a), (b) Depressor Muscle forces and activities for Case B.I.2 .................. 101

Figure 6-30: TMJ Reaction forces for Case B.I.2........................................................... 101

Figure 6-31: (a), (b) Elevator Muscle forces and activities of RHS Muscles for Case B.I.3

......................................................................................................................................... 102

Figure 6-32: (a), (b) Depressor Muscle forces and activities for Case B.I.3 .................. 102

Figure 6-33: (a) TMJ Reaction forces (b) Simulated bite force for Case B.I.3 .............. 102

Figure 7-1: R-U-S Manipulator Configuration for Validation Test: (a) Line along Z (b)

3D Sine curve.................................................................................................................. 103

Figure 7-2: R-U-S Joint trajectory for Validation Test: (a) Line along Z axis (b) 3D Sine

curve................................................................................................................................ 103

Figure 7-3: R-U-S Manipulator Configuration for Validation Test: (a) Circle in YZ plane

(b) Circle in XY (c) Ellipse in XZ plane......................................................................... 104

Figure 7-4: R-U-S Joint trajectory for Validation Test: (a) Circle in YZ plane (b) Circle in

XY (c) Ellipse in XZ plane ............................................................................................. 104

Figure 7-5:Point Tracking Simulation of R-U-S in Visual Nastran ............................... 105

Figure 7-6:Point Tracking Joint Angle Trajectories from MATLAB Code ................... 105

Figure 7-7: Line Tracking Simulation of R-U-S in Visual Nastran................................ 105

Figure 7-8: Line Tracking Joint Angle Trajectories from MATLAB Code ................... 105

Page 20: By - Automation, Robotics, & Mechatronics Laboratory

xx

Figure 7-9: Circle Tracking Simulation of R-U-S in Visual Nastran ............................. 105

Figure 7-10: Circle Tracking Joint Angle Trajectories from MATLAB Code............... 105

Figure 7-11: (i), (ii), (iii): Condition number based measure of manipulability plotted

along the vertical z-axis for every point in the 2D circular region: 0<r<0.06 at z=0.20

plane................................................................................................................................ 107

Figure 7-12: (i), (ii), (iii): Yoshikawa measure of manipulability plotted along the vertical

z-axis for every point in the 2D circular region: 0<r<0.06 at z=0.20 plane ................... 107

Figure 7-13: (a), (b), (c): Condition number based measure of manipulability plotted

along the vertical z-axis for every point in the 2D circular region: 0<r<0.06 at z=0.30

plane................................................................................................................................ 108

Figure 7-14: (a), (b), (c): Yoshikawa measure of manipulability plotted along the vertical

z-axis for every point in the 2D circular region: 0<r<0.06 at z=0.30 plane ................... 108

Figure 7-15: (a), (b), (c): Condition number based measure of manipulability plotted

along the vertical z-axis for every point in the 2D circular region: 0<r<0.06 at z=0.40

plane................................................................................................................................ 109

Figure 7-16: (a), (b), (c): Yoshikawa measure of manipulability plotted along the vertical

z-axis for every point in the 2D circular region: 0<r<0.06 at z=0.40 plane ................... 109

Figure 7-17: (a), (b), (c): Condition number based measure of manipulability plotted

along the vertical z-axis for every point in the 2D circular region: 0<r<0.06 at z=0.45

plane................................................................................................................................ 110

Page 21: By - Automation, Robotics, & Mechatronics Laboratory

xxi

Figure 7-18: (i), (ii), (iii): Yoshikawa measure of manipulability plotted along the vertical

z-axis for every point in the 2D circular region: 0<r<0.06 at z=0.45 plane ................... 110

Figure 7-19: P-U-S Manipulator Configuration for Validation Test: (a) Line along Z axis

(b) Straight line (c) 3D Sine curve.................................................................................. 111

Figure 7-20: P-U-S Joint trajectory for Validation Test: (a) Line along Z axis (b) Straight

line (c) 3D Sine curve ..................................................................................................... 111

Figure 7-21: Maximum Reachable Characteristic Values of the Manipulator 6-71: P-U-S

Manipulator Configuration for Validation Test: (a) Circle in XY Plane (b) Circle in YZ

Plane (c) Ellipse in YZ plane .......................................................................................... 112

Figure 7-23: P-U-S Joint trajectory for Validation Test: (a) Circle in XY Plane (b) Circle

in YZ Plane (c) Ellipse in YZ plane................................................................................ 112

Figure 7-24: (a), (b), (c): Condition number based measure of manipulability plotted

along the vertical z-axis for every point in the 2D circular region: 0<r<0.06 at z=0.45

plane................................................................................................................................ 113

Figure 7-25: (a), (b), (c): Yoshikawa measure of manipulability plotted along the vertical

z-axis for every point in the 2D circular region: 0<r<0.06 at z=0.45 plane ................... 113

Figure 7-26: (a), (b), (c): Condition number based measure of manipulability plotted

along the vertical z-axis for every point in the 2D circular region: 0<r<0.06 at z=0.60

plane................................................................................................................................ 114

Figure 7-27: (a), (b), (c): Yoshikawa measure of manipulability plotted along the vertical

z-axis for every point in the 2D circular region: 0<r<0.06 at z=0.60 plane ................... 114

Page 22: By - Automation, Robotics, & Mechatronics Laboratory

xxii

Figure 7-28: (a), (b), (c): Condition number based measure of manipulability plotted

along the vertical z-axis for every point in the 2D circular region: 0<r<0.06 at z=0.75

plane................................................................................................................................ 115

Figure 7-29: (a), (b), (c): Yoshikawa measure of manipulability plotted along the vertical

z-axis for every point in the 2D circular region: 0<r<0.06 at z=0.75 plane ................... 115

Figure 7-30: Visual Nastran Implementation of P-U-S with Human Jaw motion

Trajectory Input .............................................................................................................. 116

Figure 7-31: Visual Nastran Implementation of P-U-S with Labrador Jaw motion

Trajectory Input .............................................................................................................. 117

Figure 7-32: Visual Nastran Implementation of P-U-S with Bulldog Jaw motion

Trajectory Input .............................................................................................................. 118

Figure 7-33: Workspace in Z, m..................................................................................... 120

Figure 7-34: Speed in Z, m/s........................................................................................... 120

Figure 7-35: Maximum Force in Z, Newton................................................................... 120

Figure 7-36: Pitch Torque, Nm...................................................................................... 121

Figure 7-37: Roll Torque, Nm ........................................................................................ 121

Figure 7-38: Yaw Torque, Nm........................................................................................ 121

Figure 7-39: Workspace in Z, m..................................................................................... 122

Figure 7-40: Speed in Z, m/s........................................................................................... 122

Figure 7-41: Force in Z, Newton .................................................................................... 122

Page 23: By - Automation, Robotics, & Mechatronics Laboratory

xxiii

Figure 7-42: Workspace in Z, m..................................................................................... 123

Figure 7-43: Speed in Z, m ............................................................................................. 123

Figure 7-44: Workspace in X, m/s.................................................................................. 124

Figure 7-45: Force in Z, N .............................................................................................. 124

Figure 7-46: Pitch/ Roll angles, rad and velocities, rad/s ............................................... 125

Figure 7-47: Yaw angles, rad and velocities, rad/s......................................................... 125

Figure 7-48: Pitch angles, rad and velocities, rad/s ........................................................ 125

Figure 7-49: Yaw angles, rad and velocities, rad/s......................................................... 126

Figure 7-50: Torque about X, Nm .................................................................................. 126

Figure 7-51: Torque about Y, Nm .................................................................................. 126

Figure 7-52: Torque about Z, Nm................................................................................... 126

Page 24: By - Automation, Robotics, & Mechatronics Laboratory

xxiv

List of Tables

Table 2-1: Brief Survey on Commercially Available 6 DOF Parallel Architecture

Simulator........................................................................................................................... 17

Table 4-1 DH Parameterization of R-U-S Manipulator.................................................... 64

Table 4-2 DH Parameterization of P-U-S Manipulator .................................................... 64

Table 4-3 List of Parameters............................................................................................. 65

Table 5-1 CT Scan Images Information............................................................................ 77

Table 5-2: Muscle Model Parameters [Koolstra, 2002].................................................... 85

Table 5-3: Muscle Fiber Length, Insertion and Origin Points of Human Jaw Model ...... 86

Table 5-4: Muscle Mass based on Turnbull [66] .............................................................. 87

Table 5-5: Muscle Model Parameters [Koolstra, 2002].................................................... 89

Table 5-6: Muscle Fiber Length, Insertion and Origin Points of Labrador Jaw Model ... 89

Table 7-1: Manipulator Parameters for Set 1: (all linear dimensions in meters and angular

dimensions in radians) .................................................................................................... 106

Table 7-2: Maximum Reachable Characteristic Values of the Manipulator .................. 113

Table 7-3: Parametric Studies Conducted to Identify Optimal Values for Jaw Motion

Simulation ....................................................................................................................... 119

Table 7-4: Values of Platform Parameters...................................................................... 120

Table 7-5: Preliminary Specification Values of the Manipulator................................... 124

Page 25: By - Automation, Robotics, & Mechatronics Laboratory

xxv

Table 7-6: Final Specification of the Manipulator.......................................................... 127

Table 7-7: Maximum Reachable Characteristic Values of the Manipulator .................. 127

Page 26: By - Automation, Robotics, & Mechatronics Laboratory

xxvi

Abstract

The goal of this work is to (i) quantitatively analyze the jaw motions using a

variety of quantitative engineering tools and (ii) create/ design a virtual jaw motion

simulator based on parallel architecture manipulator that can reproduce these recorded

jaw motions of vertebrates/ animals accurately. Such an implementation could provide a

test bed to quantitatively characterize the jaw motion based on “chewability index” factor

for wide range of applications. To this end we will examine two sets of case studies—

human jaw motion and canine jaw motion.

In the first phase, we begin with initially developing the biomechanical models of

a human and canine jaw in AnyBody. The human model is developed using elements

from the AnyBody repository while the canine jaw was developed from scratch. . For this

purpose, the muscle model parameters as well as kinematic modeling of temporo-

mandibular joint are ascertained by a real dog cadaver dissection. Detailed case studies

were conducted to validate the inverse dynamics analyses and work envelope of both the

models— human and labrador dog. We also artificially simulated the bite force in these

biomechanical models as a part of this case study for further validation.

In the second phase, we examine the different parallel architecture manipulator

systems that would suit our desired application resulting in final selection of two

manipulator configurations for our application- 6 DOF R-U-S (revolute- universal-

spherical with active revolute joints) and P-U-S (prismatic- universal-spherical with

active prismatic joints) manipulators. Accurate kinematic models of these manipulators

were developed in MATLAB and these were used to evaluate the manipulators based on

Page 27: By - Automation, Robotics, & Mechatronics Laboratory

xxvii

Jacobian based measures. Kinematics of Parallel manipulators is, in general, modeled

using simple loop closure technique and Jacobian matrices were derived using screw-

theoretic modeling. We then completed a comprehensive parametric studies based on

maximum workspace and force limits for P-U-S manipulator case. Motion capture

trajectories for the jaw motion are obtained using the high speed SimiMotion motion

capture system with the real subjects (humans and dogs). For ascertaining the model of

simulator, we finally use the motion capture trajectories to drive the AnyBody as well as

the parallel manipulator model and verify the workspace envelope to match with the jaw

trajectories. Finally, we briefly discuss the dynamic modeling of the system for real-time

with hardware-in-loop simulation and physical prototype implementation using rapid

prototypes as well as cast dentitions.

Page 28: By - Automation, Robotics, & Mechatronics Laboratory

1

1. Introduction Use of mathematics, mechanics and numerical simulation to build sophisticated

dynamic models has played a major role in the bridging different fields- physics based

modeling, rigid body dynamics, nanotechnology and many more. Engineering related

fields benefited most from these advances but application to other areas are fast

approaching. Developing computational tools for anatomists and biologists for rapid

hypotheses testing and “what-if” type analyzes is already an active area of research. In

fact, it is this need, which provide enormous amount of scope for collaboration between

engineering and biological sciences.

Similar collaboration between biological researchers and engineers can be found

in the field of bioengineering and biomedical applications. Recently, there is increase in

the interest in bioengineering/ biomimetic systems and human system-based simulators.

Presently, bioengineered models are used with increasing frequency to study structural

and functional interactions in the human musculoskeletal system. They provide a way to

create virtual anatomical models accurate properties and functional attributes, and to

express these relationships quantitatively. As a result, mathematical models that are

developed help to demonstrate, and explain the causes-and-effects within a given

physiological or pathological environment. When used in what-if scenarios their ability

to demonstrate relationships among system components during all phases of a simulation

can be valuable both from research and educational perspective.

In this thesis, we will concentrate on musculoskeletal modeling of jaw motions

based on muscle grouping and modeling, rigid body dynamics, their mathematical

modeling and simulation of the whole simulator. Most of currently available

mathematical and biomechanical models of the masticatory system have been useful in

simulating the human chewing process. However, it is hard for them to apply to study the

jaw motions in the context of assessing the “chewability or performance index”,

especially with numerous variations in food properties, dentitions, and physiological

structure of human jaws. Thus, we will seek to arrive at such a “performance index”-

based assessment of mastication process. Further, we will seek to develop a test-bed for

continuous and detailed monitoring of bolus sizes and mandibular motion during the

Page 29: By - Automation, Robotics, & Mechatronics Laboratory

2

entire mastication cycle. But this is difficult and time consuming in the real world. Not

only these models need to be developed, refined and validated, but additionally must be

designed to automatically adjust the model parameters for any given species. Building

such a generic engineering model that can be used to study the masticatory motion across

different species is a challenging goal. Moreover, these well-engineered models also aid

in creating an ideal platform for designing and prototyping prosthetic additions to the

masticatory apparatus. Hence, the pursuance of this objective suggests the need for the

development of a robotic manipulator by means of which the mastication process can be

reproduced in a mechanically controllable way while the “chewability index” and/or food

dynamics determined quantitatively.

1.1. Background

To aid us in this process we will engage current technological tools and

paradigms in an engineering paradigm of measure-estimate-test cycle (Figure 1-2). The

main idea is to test an accurate virtual prototype before building a physical prototype. It is

based on this phenomenon there is greater emphasis and interest on the need to build an

accurate virtual prototype compared to real physical prototype testing. (See Figure 1-1:

Engineering Paradigm ).

Currently, a number of definitions for VP exist in the literature and in industry. To

have a clear insight about the ideas that will be discussed in the subsequent sections, it is

better to understand the meaning of “Virtual Prototyping (VP)” Wang [1] in the present

context. Here, we refer to VP as a process of simulating the product and their physical

interaction (whether or not involving humans) in virtual environment by means of

software across different stages of product design and conducting virtual quantitative

performance analysis of the product before physical prototyping. Other synonyms, for VP

are— “digital mock-up”, “software prototypes”, ‘software mock-up” and simulation

based design (SBD). Usually VP techniques aim at building products with the notions of

design and product optimization. It can however be used just for concept verification,

presentation, and training. Secondly, design optimization based on virtual prototypes

entails many new and challenging issues. Thus, VP-based design optimization deserves

Page 30: By - Automation, Robotics, & Mechatronics Laboratory

3

to be an independent topic and such distinction will help to address research issues of

different nature which are not discussed here.

Courtesy: Web-Based Self-Paced Virtual Prototyping Tutorials,

ARMLAB

Figure 1-1: Engineering Paradigm Figure 1-2: Virtual to Physical Prototyping Cycle

The preliminary measurement phases of engineering paradigm as outlined in

Figure 1-1 involve non-invasive measurements to study—geometric parameters of

musculoskeletal systems (segments mass properties, muscle properties etc.), calculation

of 3D motion trajectories (position, velocity and accelerations of the joints or any

superficial points) using high end motion capture (MoCap) systems and physical

parameters of the manipulators and actuators. In particular, to analytically characterize

masticatory efficiency, the measurements must include: frequency, length of chewing,

tracking of jaw movement, force distribution, application of compression and shear

forces on the food, and particle size and structure of the bolus just prior to swallowing.

We seek to develop dynamic musculoskeletal models during the estimation phase

to accurately analyze the joint and structural behaviors and estimate the muscle forces for

different types of food, cycles etc. This also involves implementing kinematic and

dynamic models of different parallel manipulators for the masticatory motion analysis

and simulation.

Measure Estimate Test

Page 31: By - Automation, Robotics, & Mechatronics Laboratory

4

For the final testing phase, models of the parallel manipulators are used to draw macro

level comparisons between the both— musculoskeletal systems as well as robotic

manipulators. These models are validated using forward and inverse dynamics tools

before implementing these models for our application. We analyze and study the

behavior of the systems based on standard “what-if’ type tests in a virtual environment

prior to the physical prototyping phase.

1.2. Problem Statement

The goal of this thesis is to analyze the masticatory jaw motions of animals

(including humans) and establish the quantitative relationship between relevant

mechanical parameters, for example joint motions, forces, pressures, work envelope and

muscle or actuator parameters, for example maximum muscle forces, optimal activity

regions for muscles during the mastication process. Such an understanding would be

useful from different perspectives. From a biological science perspective, it would be

useful to know how various animals process food by chewing and biting. From an

economic perspective, such a study on masticatory performance would:

I. enable designing animal foods based upon the “chewability index”

II. enable design of dental orthosis based on the knowledge of mechanical signals-

motions, forces, pressures etc.

1.2.1. Research Goals

We propose as a part of this thesis to develop a mathematical model of a jaw

simulator for dogs that has the capability to mimic the trajectory of the actual jaw motion.

For this purpose, we intend to perform a biomechanical analysis on a musculoskeletal jaw

model to determine muscle behavior, dynamic parameters, joint motions, and the work

envelope that the jaw can cover by its incisor tooth tip point (ITP). We intend to

implement human and dog jaw case studies to study the behavior in detail, determine

muscle parameters (actuators in musculoskeletal systems), evaluate motion of the ITP

(end-effector point) and biting forces that could be achieved for different types of jaw

motions.

Page 32: By - Automation, Robotics, & Mechatronics Laboratory

5

To develop a jaw motion simulator, we examine various design variants of

parallel manipulators, keeping in mind the high force requirements for simulating jaw

biting actions. We plan to develop a trajectory tracking inverse kinematics model for the

application. To ensure the manipulator possess the desired workspace a detailed

workspace analysis based on the Jacobian measures is imperative. We will then drive the

kinematic model with the jaw motion trajectories obtained from the Motion Capture

(MoCap) Analysis System. A detailed kinematic study between two parallel manipulators

(6 DOF R-U-S: revolute-universal-spherical, and P-U-S: prismatic-universal-spherical

joint with active revolute and prismatic joints respectively) will be presented later in this

thesis. Finally, we develop parametric analysis for building the prototype and provide

insight on developing dynamic models for 6 DOF P-U-S parallel manipulators.

Figure 1-3: Project Flowchart To tie all these disparate aspects together, we will consider specific case studies of

dog and human jaw motion in this thesis (refer Figure 1-3). We will primarily focus on

the following major research challenges in this regard:

Page 33: By - Automation, Robotics, & Mechatronics Laboratory

6

a. Virtual prototyping using CT scan to CAD Model to Dentition

b. Motion capture of jaw motions of humans and animals

c. Musculoskeletal and muscle modeling

d. Mathematical modeling of parallel manipulators- forward and inverse

kinematics

1.3. Research Issues

To run the biomechanical analyzes, we develop a simplified virtual model with

minimum number of muscle groups (favorably six muscle groups- three on each side) to

achieve the necessary jaw motion and work envelope. Next, we analyze the masticatory

biomechanics of different animals and create a dynamic musculoskeletal model to

estimate the muscle activity levels and biting forces for the case of labrador breed of dog.

To accurately calculate the 3D jaw motion trajectories which can drive these virtual

models, and later the mechanical jaw simulator, we record the jaw motions of different

subjects using high-speed video cameras— a SimiMotion- a semi portable 3D motion

capture system.

Based on the conclusions ascertained by this study, we propose a jaw simulator

based on the spatial parallel-actuated mechanism and implemented the inverse kinematics

for accurate trajectory tracking. For subsequent study and analyzes, we narrow our

choices into two parallel-actuated mechanisms and conduct a detailed kinematics analysis

of these two manipulators— 6-DOF R-U-S manipulator and P-U-S manipulators for our

application. We validate the generated mathematical models against standard case studies

and past literature for desired performance.

To this end, we discuss the screw-theoretic modeling and other methodologies that

provide a convenient way of modeling these platforms at kinematics and dynamics level.

The relevant details encompassed with the modeling framework will be addressed in the

latter portions of this work. For the above mentioned application, we develop a detailed

kinematics and workspace analysis on the specific class of manipulators.

Page 34: By - Automation, Robotics, & Mechatronics Laboratory

7

1.4. Thesis Organization

The rest of the thesis is organized as follows: Section 2 discusses about the past

and present research efforts relevant to developing a jaw simulator, and virtual

prototyping and testing, and biomechanical jaw models. A brief overview of different

scientific and computational tools as well as other equipment that were considered in the

process of designing the simulator is also discussed in Section 2. Section 3 gives a

detailed background on different musculoskeletal modeling aspects and masticatory

biomechanics. The mathematical modeling and kinematic derivations and basic concepts

on measure of manipulability and other mathematical derivations are presented in Section

4. Section 5 covers the equipment setup, dynamic model creation, and experiments

conducted, and Section 6 provides simulation results of our biomechanical and

manipulator models and discusses the results of kinematic and dynamic analyzes.

Page 35: By - Automation, Robotics, & Mechatronics Laboratory

8

2. Literature Survey

2.1. Related Work

2.1.1. Biomechanical Model of the Jaw

Since the early 1980s many researchers in the field of biomechanics have worked

in the areas of redundant musculoskeletal systems, muscle modeling, and mathematical

modeling for dynamic simulation. Realizing the significance of developing an accurate

kinematic model, numerous researchers have attempted to model the jaw kinematics (i.e.)

describing the geometrical and analytical connections between rotation of the joints and

the actual motion of all parts of the jaw. Some of these results formed the basis for the

dynamic simulation of the masticatory simulation model, which is an active research

topic today.

The biomechanical model of the jaw developed by Koolstra and Eijden [2] can be

regarded as the first reliable and realistic model built. The model is unique in the way that

each muscle is able to influence all six degrees of freedom, which makes the system

kinematically, and mechanically indeterminate. This work further provides insight into

procedure to determine muscle forces affecting each degree of freedom.

Another notable effort from University of Karlsruhe, Germany by Weingartner,

Hassfeldet al. [3] where they developed an accurate kinematic model of the complex

temporomandibular joints (TMJs). Such realistic models of TMJ are necessary to

simulate the jaw motion perfectly (Figure 2-1, Figure 2-2, Figure 2-3 and Figure 2-4). For

dynamic simulation of muscles, they modeled each muscle as threads, signifying the

major force vector of the muscles and implemented an open loop robotic model for

different mandibular motions— opening/ closing, protrusions and lateral movements.

Page 36: By - Automation, Robotics, & Mechatronics Laboratory

9

Figure 2-1: Hinge Joint Axis Of TMJ For Left Side Movement

Figure 2-2: Modeling Of Muscles As Threads

Muscle groups, 1-anterior digastric; 2-superficial

masseter; 3-medial pterygoid; 4-deep masseter; 5-

lateral pterygoid; 6-posterior temporalis; 7-middle

temporalis; 8-anterior temporalis. 9-gravity

Figure 2-3: Anteriolateral View Of The Basic Model

Figure 2-4: Jaw Model With TMJ And Incisor Point Envelope

Peck, Langenbachet al. [4] developed jaw models to determine the external force

required to reach maximum gape in five relaxed participants, and used this information,

with other musculoskeletal data, to construct a dynamic, muscle-driven, three-

dimensional mathematical model of the craniomandibular system in ADAMS. It allowed

six degrees-of-freedom shaped by forces from 16 craniomandibular muscle groups, two

TMJs, and gravity.

Page 37: By - Automation, Robotics, & Mechatronics Laboratory

10

Figure 2-5: Oblique And Side View Of Jaw And Larynx Model In “Artisynth”

This model also had a more realistic way of modeling TMJs and the contact of

condyles with functional fossae. A follow up of this work was published by Enciso,

Memonet al. [5] wherein they detail about the forward dynamic simulation of the jaw

model in the context of swallowing using an open source platform “ArtiSynth” for

running the biomechanical simulation (Figure 2-5).

2.1.2. Masticatory Robotic Manipulators

The advent of the latest technologies and advanced computational tools marked a

new era in human masticatory robotic simulation. Many research groups have

concentrated on accurately simulating jaw motion by building a physical robotic

manipulator and conducting real time studies on biting and food texture properties.

However, the first ever device built for tracking jaw motion was in the mid 1950s by

Posselt [6]. The apparatus (known as the Gnatho-thesiometer) permitted measurements

(at three points) in the three main planes on a freely movable cast of a lower jaw. He also

presented a simple comparative study on error obtained between mounting various casts

manufactured by different techniques.

The research group at Waseda-University [7], Japan led by Atsuo Takanishi

actually marked the beginning of this new era. The group has developed a “Waseda Jaw’

series of masticatory robots named as WJ-0, WJ-1, WJ-2 and WJ-3 as in Figure 2-7, Figure

2-8 and Figure 2-9, whose mechanical structures resemble those of the human masticatory

Page 38: By - Automation, Robotics, & Mechatronics Laboratory

11

system, especially muscle positions. They placed sensors in muscles and under the teeth and

in the mandible to measure forces and movements. The same group also succeeded in

extending their application of WJ series of robots to treating TMJ disorders with their new

WY series of robots (Figure 2-6).

Even though their robots are predominantly 3-DOF, it is mentioned in Takanobu,

Kuchikiet al. [8] one of their works that the human masticatory system is similar in

configuration to a parallel mechanical manipulator driven by linear or rotary actuators, and so

resembles closely a 6-DOF Stewart Platform. We would like to make use of this

interpretation in our thesis to model a jaw simulator for a generic case.

The research group named BioMouth led by Dr. Xu from Massey University,

New Zealand is actively involved in jaw modeling and dynamic analysis at present. They

Figure 2-6: WY-5RII Mastication Robot Figure 2-7: Commercial Mastication Robot For Use (WOJ1)

Figure 2-8: Food Texture Measurement Robot WWT-1

Figure 2-9: Jaw Robot 3D Simulation WOJ-1RII

Page 39: By - Automation, Robotics, & Mechatronics Laboratory

12

implemented a jaw model prototype Figure 2-10 based on parallel manipulator analogy.

Xu, Bronlundet al. [9]

They studied muscle parameters and their functioning and reduced the complex

jaw model shown in Figure 2-11 to a simple model with 6-muscle groups. This simplified

model was then mapped into a 6-DOF dental simulator similar to a Stewart Platform. In

this work, they tried to represent the major muscle groups as double acting linear

actuators (Figure 2-12 and Figure 2-13) and hence just included the jaw closing muscles

in their model which can pull and push the jaw. An interesting aspect of this work is that

this group has used currently available mechanical simulation package, namely

SolidWorks/ Cosmos Motion, for dynamic analyzes of their simulators and compared the

performance of the manipulator with that of the musculoskeletal model (Figure 2-10 and

Figure 2-11). The same group implemented a jaw simulator using the existing Stewart

Platform model built in SimMechanics, and developed a dynamic simulation setup for the

dental simulator, and conducted studies on jaw kinematics, actuator forces and food

textures.

Figure 2-10: Masticatory Robot Covered By The Skull In SolidWorks

Figure 2-11: 3-D Model Of The Mandible- The Actuators’ Attaching Points (Mi), And The

Reference Points

Page 40: By - Automation, Robotics, & Mechatronics Laboratory

13

Figure 2-12: Robotic Model In The Form Of Platform Mechanism Nomenclature And Coordinate Systems

Figure 2-13: 3D Kinematic Jaw Model

They have also come up with a life-sized masticatory robot (Figure 2-15), which

is intended to “chew” foods in a human way while the food properties are evaluated using

a 6RSS parallel mechanism. It is based on a robotic mechanism whose kinematic

parameters (Figure 2-14) are defined according to the biomechanical findings and

measurements of the human masticatory system by Xu, Torrenceet al. [10]. For a given

mandibular trajectory to be tracked, the closed-form solution to inverse kinematics of the

robot is found for joint actuations, whereas differential kinematics is derived in Jacobian

matrices. Experimental results for free chewing, soft-food chewing, and hard-food

chewing are given where the foods are simulated by foam and hard objects. They also

studied crank actuations and driving torques (an indication of muscular activities) and

compared them for chewing different foods.

Relevant to this discussion is another robotic device that was built by Lewis— a

Master’s student Xu, Lewiset al. [11] from Massey University based on a four bar

linkage mechanism. It has adjustable link lengths to simulate chewing trajectories only in

the frontal plane of different subjects. The work also involved building a physical

prototype of the simulator and the enclosure and a comparison study with the virtual

prototype.

Page 41: By - Automation, Robotics, & Mechatronics Laboratory

14

Figure 2-14: Robotic Model Of Crank Actuation Figure 2-15: Physical Prototype Of The Dental Simulator

Most of the research on jaw modeling and simulation is concerned with human jaws and

biting force analysis based on the food texture. Only a few of those focus on other

mammals. Hence, in this thesis we would like to address this topic and arrive at a way to

model and build a generic dental simulator.

Figure 2-16: Four Bar Mechanism Simulator (MS Thesis, Darren Lewis, University Of Massey)

Page 42: By - Automation, Robotics, & Mechatronics Laboratory

15

2.1.3. Parallel Actuated Robotic Manipulators

Based on the biomechanical studies just describe, we could restrict our choices for

building a dental simulator to a set of parallel-actuated platform manipulators. Parallel

manipulators offer many advantages as they can withstand high-end effector forces as

well as satisfy trajectory space requirements. They also possess high system stiffness and

high load/weight ratio, which makes it possible to describe the given trajectories

precisely, even under heavily alternating loads and large accelerations. However, the

major limitation of these types of manipulators is the limited workspace compared with

those of serial manipulators.

Figure 2-17: Schematic Diagram Of Stewart Platform

Figure 2-18: Force Analysis On Leg

There have been considerable developments in this field especially related to

developing inverse dynamic models of Stewart platform since its birth in the mid 1950s.

Notable among these are inverse dynamics equations obtained using virtual work

principle by Tsai [12] (Figure 2-17 and Figure 2-18) as well as Lagrangian modeling by

Guo and Li [13]. The virtual work as well as Lagrangian modeling procedures can be

extended to most variants of Stewart platforms. Tsai’s details about the standard

methodology for deriving dynamical equations of motion for parallel architectural

manipulators at the joint space Figure 2-17 and Figure 2-18. In the other work, a closed-

form explicit dynamic equation in task space using Lagrangian method is derived. The

work also provides benchmark results that can be used for validation of similar models.

Both this work considered the leg mass and inertial effects in the dynamic formulation.

Page 43: By - Automation, Robotics, & Mechatronics Laboratory

16

For symbolic computation based on Tsai’s work, interested readers are referred to Wang

[14].

Parallel manipulators also offer advantages from a manufacturing point of view as

similar parts are used to fabricate the overall system resulting in cost reduction. However,

most of the commercially available motion simulators are customized devices, which

ultimately make these costlier. These simulators are commonly used in motion generator

for flight simulators, surgical devices, high-speed machine heads and for augmented VR

applications. A brief survey of commercial simulators and their features are displayed in

the Table 2-1.

2.1.4. Jaw Motion Analysis, Imaging and Experiments

Several implementations of the jaw motion capture and design of fixtures for

accurate motion capture has already been implemented in the context of medical

evaluation of injuries, fractures, tumors etc. In Enciso, Memonet al. [5], the author

describes the process of CT scan and segmentation of the human jaw for 3D model

reconstruction. The process of motion capture using an ultrasonic capture device to

construct patient specific models is also discussed to evaluating the medical condition for

specific patients based on the model reconstruction techniques. Weingartner a dental

scientist from Switzerland explained in Gallo [15] the wrench axis representation for the

jaw motion about which the rotation as well as translation takes plane. He concluded that

the joint axis seldom passes through the centers of the condyles even in the case of free

opening and closing motion. The work also details about the dynamic stereometry of the

TMJ for 3D reconstruction and animation of the joint using real time tracking of jaw

motion.

Dentitions for dental simulators can be built using the virtual prototypes of human

jaws. These virtual prototypes are obtained using high-end 3D digital laser scanners that

convert the point cloud data to a 3D CAD model (easily accessible in most CAD

platforms). This 3D CAD model is used in rapid prototyping machines to obtain the

dentition in physical form. To create dentitions of different materials, casting of the wax

model can be undertaken.

Page 44: By - Automation, Robotics, & Mechatronics Laboratory

17

Company Name and Features Applications

Moog [16] Motion Base Non customizable

Payload: 1000-14500 kgs MATLAB RT control High fidelity and scalability

Servos [17] Simulation Electric actuators only, portable system Computer control

Weight: 500 lbs. Miniature type available Cost: 25k- 75k USD Workspace: 0.38” (X-Y-Z)

Sarnicola [18] Simulation Systems Electric and hydraulic Computer control(no MATLAB)

Weight: 500 lbs Workspace: 0.3m (X-Y-Z) Velocity: 0.45 m/sec (X-Y-Z) Payload: 2000 lbs

Mitsubishi Motion Base Electric and hydraulic actuators

Driver training as VR applications Workspace: 0.3m (X-Y-Z)

In Motion Simulation:http://inmotionsimulation.com/ [19] Electro pneumatic actuator

Workspace: 0.38m (X-Y-Z) Payload: 3000 lbs Cost: 75k USD

Aeronumerics, Inc.: http://www.aeronumerics.com/ [20] 6 DOF Customizable system Hydraulic and Electromechanical actuators

Car and flight simulators Cost: 19k USD

Alio Industries Hexapods: http://www.alioindustries.com/stages_hexapods.html [21] C++/ Labview Compatible Open architecture in Windows and intuitive GUI

Medical and micromachining Workspace: 0.025-0.096 m Velocity: 0.2 m/s

Table 2-1: Brief Survey on Commercially Available 6 DOF Parallel Architecture Simulator

Page 45: By - Automation, Robotics, & Mechatronics Laboratory

18

Figure 2-19: 2D CT scans and 3D STL Model Of The Human Jaw

The research team in University of Illinois working on Mandible-Reconstruction-Project

[22] has done CT scan to CAD model conversion for different mandibles (Figure 2-19) as

a part of a bone implant project, and in fact, developed a virtual database of mandibles.

2.2. Computational Tools

2.2.1. Musculoskeletal Analysis Tools:

AnyBody

This musculoskeletal modeling software (AnyBody Modeling Software Manual

[23]) was developed as part of the “The AnyBody Project” at Aalborg University in

Denmark. The software was developed to parametrically analyze detailed

musculoskeletal systems of both humans and animals. Figure 2-20 shows a picture of a

musculoskeletal simulation performed within AnyBody. AnyBody is a script based

analysis program so that writing code is necessary to develop the musculoskeletal system

models. It uses its own scripting language, AnyScript, which is an object-oriented

language similar to C++ or Java Script. This software also has the capability to perform

analyses on complex musculoskeletal models. This complexity encompasses model

geometry, number of muscles, dynamic changes in muscle position, and degrees of

freedom of the system. Within the program musculoskeletal and physiological properties

such as muscle forces, joint reactions, metabolism, mechanical work, and efficiency can

Page 46: By - Automation, Robotics, & Mechatronics Laboratory

19

be examined for a given system. Several musculoskeletal system simulations have been

performed using this software and example simulations can be seen on the AnyBody

website (anybody.auc.dk). More specifically, in conjunction with this research effort, the

capabilities and application of this software toward modeling and simulating the

skull/mandible musculoskeletal system of an extinct saber-toothed cat (Smilodon-Fatalis)

was explored in depth by Konakanchi [24].

Inverse dynamics analysis (IDA) can be thought as the main process of

calculating muscles forces within AnyBody Modeling Software system. Given the

motion of the musculoskeletal model, muscle and reaction forces are calculated by setting

up the equations of motion. Problems pertaining to static indeterminacy, limitations on

the maximum muscle forces need to be resolved before the analysis. Because there are

more muscles than degrees of freedom (see Figure 2-21), redundancy posed by the

system indicates that there is no unique solution to the inverse dynamics problem.

Figure 2-20: AnyBody Software Interface

While performing a body motion the muscles collaborate according to some

rational criteria. These criteria when combined with the fact that muscles can only pull

and not push results in a unique recruitment pattern. This suggests that the central

nervous system applies some sort of “optimality” criteria to determine muscle activation

-0.1-0.08

-0.06-0.04

-0.020

0.12

0.14

0.16

0.18-28.9

-28.8

-28.7

-28.6

-28.5

-28.4

-28.3

-28.2

Pterygoid 'X'

Surface plot of Bite force

Pterygoid 'Y'

Bite

forc

e

Page 47: By - Automation, Robotics, & Mechatronics Laboratory

20

order. If such an “optimal criteria” is combined with the equilibrium equations, we can

have unique solutions for a problem. The basic optimality assumption is that “the body

attempts to use its muscles in such a way that fatigue is postponed as far as possible”.

Hence, in our optimization problem we would minimize the maximum muscle activity

subject to equilibrium constraints and positive muscle force constraint. Hence, the

optimization problem for calculating the muscle forces Rasmussen, Damsgaardet al. [25]

can be mathematically written as:

,

1

,

:

:

0 : 1,...,

pnM i

i i

M i

FMinimize V

N

Subject toCf dF i n

=

⎛ ⎞= ⎜ ⎟

⎝ ⎠

=≥ =

∑ (2.2.1)

Various forms of this optimization problem may be created raising the power of the

individual muscle activity to a polynomial power, ‘p’. With increasing value of ‘p’, the

criteria tend to distribute the relative load evenly between the muscles.

The min/max-objective function is non-differentiable and therefore appears to complicate

the practical solution of the optimization problem. However, by using bound formulation,

which is widely used and well tested, in the field of optimum engineering design we can

easily solve the min/max problems. By introducing a new artificial variable β and an

artificial criterion function ( )B β and the new criterion can be a monotonic function ofβ .

By choosing the ( )B β = β we can reformulate the above problem as:

Figure 2-21: Inverse Dynamics of a Redundant Musculoskeletal System (Konakanchi [24])

Page 48: By - Automation, Robotics, & Mechatronics Laboratory

21

,

,

: ,

:

0

; 1,...

M i

M i

i

Minimize

Subject Cf d

FF

i nN

β

β

=

≤ ∈

(2.2.2)

In the min/max optimization problem we are looking at the muscle recruitment that

balances the exterior loads and minimizes the largest relative load on any muscle in the

system, thereby postponing fatigue of the muscle as far as possible. This is the approach

used within the AnyBody software.

SIMM

SIMM or Software for Interactive Musculoskeletal Modeling is a biomechanics

software toolkit developed by MusculoGraphics Inc. Within this software, the user has

the ability to construct, model, animate, and analyze a musculoskeletal system in a three-

dimensional environment. This software differs from the traditional articulated

mechanical system analysis packages in that is was designed specifically to simulate

systems consisting of bones, muscles, ligaments, and tendons. Figure 2-22 below depicts

an example simulation performed using SIMM (Musculographics-Inc. [26]).

Figure 2-22: SIMM Virtual Model

Within a SIMM model, each musculoskeletal system consists of representations

of bones, muscles, ligaments etc. SIMM enables the analysis of a musculoskeletal system

by calculating the joint moments that each muscle can produce at any given body

Page 49: By - Automation, Robotics, & Mechatronics Laboratory

22

position. The resultant motion and muscle force properties can then be analyzed and

visualized with the SIMM environment. The exploration of the capabilities of the SIMM

musculoskeletal analysis software has been examined by many authors both in the

context of musculoskeletal system analysis(Yamaguchi, Moranet al. [27]), and its

adaptation and expansion into the development other musculoskeletal system analysis

tools (Konakanchi [24, Davoodi, Brownet al. [28]).

2.2.2. Dynamics Simulation/ Analysis Tools: MAPLE/ DynaFlexPro with MATLAB/ Simulink

DynaFlexPro (DFP) is a Maple package (Bhatt and Krovi [29]) for modeling and

simulating the dynamics of mechanical multibody systems. DFP uses a graph theoretic-

modeling approach to create kinematic and dynamic EOMs within a systematic and

automated symbolic implementation. While a symbolic or numeric study of the system is

possible using Maple’s built-in ODE solver dsolve, DFP also offers the capability to

export the EOMs to other platforms (C, Fortran, and Matlab) using code-generation tools.

Figure 2-23 illustrates the basic functionality of DFP for the double pendulum example.

SolidWorks-SimMechanics- VRML

SimMechanics software (Mathworks [30]) is a block diagram-modeling

environment for the engineering design and simulation of rigid body machines and their

motions, using the standard Newtonian dynamics of forces and torques. With

SimMechanics software, one can model and simulate mechanical systems with a suite of

tools to specify bodies and their mass properties, their possible motions, kinematic

Figure 2-23: Double Pendulum Model implementation in DFP

Page 50: By - Automation, Robotics, & Mechatronics Laboratory

23

constraints, and coordinate systems, and to initiate and measure body motions. In

SimMechanics, a connected block diagram represents a mechanical system as with any

Simulink models, and complex mechanical systems can be modeled as hierarchical

subsystems.

The visualization tools of SimMechanics software display simplified renderings

of 3-D machines, before and during simulation, using the MATLAB Graphics system and

with some additional effort the system can be even visualized using VRML engine- in-

built in MATLAB.

Figure 2-24: SolidWorks- SimMechanics- VRML Framework

Additionally, any 3D CAD models created in SolidWorks can directly be

imported into VRML model files by saving the model assemblies as *.xml format. This

file is subsequently imported into VRML environment for visualization and animation.

To generate SimMechanics models from SolidWorks, “import_physmod” model builder

in SimMechanics, SolidWorks assemblies can be used to seamlessly convert into

Simulink block diagrams with the exact geometric relationship between different

components (Figure 2-24). In SimMechanics, one can implement task space or joint

space control by adding Sensor and Actuator blocks to joints or to the end effector

directly and drive the joints using the appropriate control algorithms. Following is a

figure that shows the different steps involved from building an assembly in SolidWorks

Page 51: By - Automation, Robotics, & Mechatronics Laboratory

24

to running simulation in SimMechanics environment using VRML engine for animation/

visualization.

SolidWorks- Visual Nastran

MSC.Software Visual Nastran vN4D MSC.visualNastran 4D Manual:

www.mae.virginia.edu/meclab/images/visualNastran4D.pdf [31] simulates 3D motion

with dynamic finite element analysis FEA on Windows and is intended mainly for

engineering education and professionals. MSC.visualNastran4D (vN4d) merges the

technologies from motion, animation, and FEA simulation into a single functional

modeling system. It allows one to simulate his/her mechanical designs dynamically, to

determine if the products will function as expected. vN4d also has the capability to

simulate a mechanical system running in an open loop and monitor the output positions,

velocities, actuator forces/ torques etc. A block representing the vN4d mechanical model

can be inserted into Simulink to expand beyond mechanical simulation to system-level

simulation. Using this block in Simulink one can represent the mechanical system in

vN4D, that allows one to simulate an entire system, including hydraulics, electronics, and

controls. Mechanical parameters in the vN4d mechanical model, such as velocity,

position, or torque, can be linked between vN4d and MATLAB or Simulink for control

system design or processing to allow closed loop simulation functionality (Figure 2-25

and Figure 2-26).

Figure 2-25: SolidWorks Model of Parallel Manipulator

Figure 2-26: Open Loop Kinematics and Dynamic Analysis in Visual Nastran

Page 52: By - Automation, Robotics, & Mechatronics Laboratory

25

2.2.3. CT Scanning and Imaging

Mimics

Mimics is the standard imaging software that is used for image processing and

converting scanner data (CT scans/ MRI data) into 3D CAD models. Based on the

segmentation mask, Mimics automatically generates the contours (polylines) of the mask.

The MedCADMaterialize [32] Module allows the user to grow polylines into a subset of

polylines based on a specified tolerance. The subset of polylines can then be used to fit

different CAD objects to the anatomical geometry. One can either build CAD objects

interactively or create the objects parametrically by specifying the different parameters

for the object (e.g. the location of the center point and the radius of a circle). The objects

can also be adjusted interactively with the mouse after they are created. All of these

entities can be exported as IGES files. The files are directly usable for the design of

custom-made prostheses in any CAD system. Another typical application is the use of the

MedCAD Module for statistical analyses (e.g. it is possible to do measurements on a

number of different femurs and use these measurements for the design of a set of

standardized implants). STL module (Figure 2-27) also allows one to create STL files

from the scanner data which can then be transferred to any rapid prototyping machine for

creating the parts slice by slice.

Figure 2-27: CT Scan Slices to STL Conversion Figure 2-28: Working with STL in Rhinoceros

It is possible to export from a mask, 3D object or 3dd file. The available export formats

are ASCII STL, Binary STL, DXF, VRML 2.0 and Point Cloud. Several calculation

Page 53: By - Automation, Robotics, & Mechatronics Laboratory

26

parameters can be specified for building an STL file that gives the possibility to reduce

the triangles of the exported files, to interpolate the images and to do smoothing on the

3D files.

Rhinoceros

Rhinoceros [33], Rhino for short is mainly a NURB surfaces modeling tool used

to create, edit, analyze, document, render, animate, and translate NURBS curves,

surfaces, and solids with no limits on complexity, degree, or size. It also supports

polygon meshes and point clouds. It allows uninhibited free-form 3D modeling as well as

repairs any sort of complex surfaces from IGES or mesh files. The main advantage of

using Rhino is it is compatible with most of the 3D scanners currently available in the

market today and can be obtained at a low cost. Hence, their applications are mainly

found in reverse engineering of complex designs. (See Figure 2-28)

2.3. Motion Capture Technology

2.3.1. Motion Capture and analysis Systems:

In the 1970s, motion tracking or motion capture (WikiPedia [34]) started as a

photogrametric analysis tool in biomechanics research and since then the research

community has seen tremendous advances in this field. These tools are not only used by

biomechanical community for research, product design or ergonomics study purposes but

also by graphical programmers prevailing in animation-movie, sports and video gaming

industries. Present automated motion capture systems record the positions, angles,

velocities, accelerations and impulses that can provide an accurate digital representation

of the motion in real time. Biomechanists can use this real time data to diagnose problems

or suggest ways to improve performance, requiring motion capture technology to record

motions up to 140 miles per hour for a golf swing. These motion capture systems are

broadly classified into optical and non-optical (video- markerless motion capture, electro-

magnetic and mechanical) types and are discussed in detail below.

Page 54: By - Automation, Robotics, & Mechatronics Laboratory

27

2.3.2. Optical Markers:

Optical systems triangulate the 3D position of a marker between one or more

cameras calibrated to provide overlapping projections. Tracking a large number of

markers or multiple performers or expanding the capture area is accomplished by the

addition of more cameras. These systems produce data with 3 degrees of freedom for

each marker, and rotational information must be inferred from the relative orientation of

three or more markers; for instance shoulder, elbow and wrist markers providing the

angle of the elbow. The performer is free to move unencumbered by cables or harnesses

typically associated with magnetic trackers.

a) Passive markers:

Passive optical system use markers coated with a Retro-reflective material to reflect light

back that is generated near the cameras lens. Cameras sensitivity can be adjusted taking

advantage of most cameras’ narrow range of sensitivity to light, so only the bright

markers will be sampled ignoring skin and fabric. This type of system can capture large

numbers of markers at frame rates as high as 2000fps. SimiMotion system is an example

for this type and will be discussed in detail later in this section. Other systems of this type

are Vicon-Peak-Motus [35, OptiTrack [36].

OptiTrack (see Figure 2-29) is a complete motion capture and analysis studio with

limited features and low cost. The refreshing rate of the camera is about 100 fps and is a

gray scale camera. With up to four cameras per USB hub, one can cover a large range

area by using multiple cameras / hubs. Vicon Motus/ Vicon MX (Figure 2-30) is one of

the fully equipped motion capture systems with broader features for different applications

in the industry and research. It has a high-speed video cameras operating up to 10,000

frames per second with a resolution of 2-4 million pixels, which can track intricate

movements in 2-D and 3-D motion analysis.

Page 55: By - Automation, Robotics, & Mechatronics Laboratory

28

Figure 2-29: OptiTrack Motion Capture Figure 2-30: Peak Motus MoCap Equipment

b) Active markers:

Active optical systems triangulate positions by illuminating one LED at a time very

quickly or multiple LEDs, but sophisticated software is required to identify them by their

relative positions, somewhat akin to celestial navigation. The markers themselves are

powered to emit their own light. Active markers can further be refined as Semi

perceptible and time modulated. Phoenix technologies and PhaseSpace Inc. are the major

players in this category and normally provide active markers of both these types.

PhaseSpace [37]

Time Modulated Active Marker (Figure 2-31): The motion capture is handled by strobing

one marker on at a time, or tracking multiple markers over time and modulating the

amplitude or pulse width to provide marker ID. The unique ID of the markers reduces the

turnaround, by eliminating marker swapping and providing much cleaner data than other

technologies. These motion capture systems are typically under $50,000 for an eight

camera, 12-mega pixel spatial resolution 480-hertz system with one actor.

Semi Perceptible Active Marker (Figure 2-32): These systems use inexpensive multi-

LED high-speed projectors that optically encode the space. The system uses

photosensitive marker tags to decode the optical signals. By attaching tags with photo

sensors to scene points, the tags can compute not only their own locations of each point,

but also their own orientation, incident illumination, and reflectance.

Page 56: By - Automation, Robotics, & Mechatronics Laboratory

29

Figure 2-31:Time Modulated Active Marker Figure 2-32: Semi Perceptible Marker

These tracking tags that work in natural lighting conditions can be imperceptibly

embedded in attire or other objects. The system supports an unlimited number of tags in a

scene, with each tag uniquely identified to eliminate marker reacquisition issues. The tags

also provide incident illumination data, which can be used to match scene lighting when

inserting synthetic elements. The technique is therefore ideal for on-set motion capture or

real-time broadcasting of virtual sets

2.3.3. Non-optical markers:

a) Mechanical

These trackers directly track body joint angles and are often referred to exo-skeleton

motion capture systems (in Figure 2-34) due to the way the sensors are attached to the

body. Most of them operate in real-time, are relatively low-cost, free-of-occlusion, and

use wireless (untethered) systems that have unlimited capture volume. Typically, they are

rigid structures of jointed, straight metal or plastic rods linked together with

potentiometers that articulate at the joints of the body. Some examples are GolfMotion by

METAMotion [38], MiniRobot XBot by Nuzoo [39].

b) Magnetic

Magnetic systems calculate position and orientation by the relative magnetic flux of

three orthogonal coils on both the transmitter and each receiver. The relative intensity of

the voltage or current of the three coils allows these systems to calculate both range and

orientation by meticulously mapping the tracking volume as an e-Motek [40] MoCap

system Figure 2-33.

Page 57: By - Automation, Robotics, & Mechatronics Laboratory

30

Figure 2-33: Electromagnetic Motion Capture System

Figure 2-34: Exoskeleton Mocap System

c) Inertial

Based on miniature inertial sensors, biomechanical models and sensor fusion algorithms

the data from inertial sensors can be transmitted to PC across a wireless network for

recording of motion/ position. MoCap systems Moven-Inc [41] are of inertial types.

The inertial motion trackers give absolute orientation estimates, which can also be used to

calculate the 3D linear accelerations in world coordinates, which in turn give translation

estimates of the body segments (Figure 2-35 and Figure 2-36).

Figure 2-35: Inertial Motion Capture Systems Figure 2-36: Inertial Motion Capture Systems at NASA (Miller, Jenkinset al. [42])

2.3.4. Markerless tracking devices:

The necessity for capturing animal motions without use of trackers led to a wide

range of software and camera systems that allows one to capture and analyze motion

using markerless tracking softwares. These systems are suitable for biomechanical

experiments to be performed on animals. However, the accuracy of the markerless

tracking devices depend on the accuracy of selecting the points on each frame of the

video, efficiency of the automatic tracking algorithm implemented on the system and

Page 58: By - Automation, Robotics, & Mechatronics Laboratory

31

various other factors. As a general case, based on the current trends, it is better to opt for

motion capture systems using makers rather than markerless devices for accuracy and

usefulness. Among the very few companies, Noraxon-Inc,

http://www.noraxon.com/index.php3 [43] (commercially called- Functional Assessment

of Biomechanics- FAB, see Figure 2-37) and Organic Motion [44] (see Figure 2-38:

Markerless Motion Capture Systems by Noraxon) are the commercially successful

systems.

Figure 2-37: Markerless Motion Capture Systems

by Organic Motion Figure 2-38: Markerless Motion Capture Systems

by Noraxon

2.3.5. Motion Capture beyond Markers - 3D Scanners

Usually 3D scanners of this kind create point cloud data of geometric samples on

the surface of the subject. These points can then be used to extrapolate the shape of the

subject (a process called reconstruction). If color information is collected at each point,

then the colors on the surface of the subject can also be determined. In short, 3D

scanners digitize real objects, which can then be used for any type of virtual analysis/

visual applications.

Page 59: By - Automation, Robotics, & Mechatronics Laboratory

32

Figure 2-39: Facial Motion Capture at CMU Robotics Institute

Figure 2-40: Facial Motion capture at IBM

Facial motion capture is the process of electronically converting the movements

of a person's face into a digital database, and cameras or laser 3D scanners are used for

this purpose. Active LED Marker technology is currently being used to drive facial

animation in real-time to provide user feedback. Markerless technologies use the features

of the face such as nostrils, the corners of the lips and eyes, and wrinkles and then track

them. This technology is discussed and demonstrated at The Robotics Institute, CMU

[45], IBM [46], from University of Manchester (where facial capture actually started)

using active appearance models, principle component analysis, eigen-tracking and other

techniques to track the desired facial features from frame to frame. This technology is

much less cumbersome, and allows greater expression for the actor.

Vision based approaches also have the ability to track pupil movement, eyelids,

tooth occlusion on the lips and tongue, which are obvious problems in most computer

animated features. Typical limitations of vision based approaches are resolution and

frame rate, both of which are decreasing as issues as high speed, high resolution CMOS

cameras become available from multiple sources. Structured-light scanners like PONTOS

from G-O-M [47] (Gesellschaft für Optische Messtechnik) based in Germany are used to

capture precise position, motion and deformation calculation of structures and

components. These are normally used for in a system for optical, dynamic 3D analysis

like car crash tests, vibrations in the structures, component tests, etc. For more detailed

survey of digital 3D scanners readers are referred to Kannan [48].

Figure 2-41: PONTOS Scanners for Crash testing Figure 2-42: PONTOS for Car Body testing

Page 60: By - Automation, Robotics, & Mechatronics Laboratory

33

2.3.6. Issues with MoCap Systems

In spite of their advantages, motion capture systems require considerable effort in

post processing, because the capture process is commonly associated with four basic

error-types (Figure 2-43)— discrete channel error, interchange of channels, erroneous

trajectory and precision mistakes. The correction of these capture errors is automatically

completed by the use of cubic splines or another type of interpolation curve, like cardinal

splines. Nevertheless, the detection of this variety of errors is frequently made with

human intervention, so that it develops into the essentially speed problem of this type of

systems as described by Gonzalez-Morcillo, Jimenez-Linareset al. [49].

The main disadvantage of magnetic motion capture systems is the “fails” and

“distortions” when the operational environment has external noise or disturbance of other

magnetic fields. On the other hand, this kind of systems operates better than other

systems in real time and interactive environments due to their good behavior at

identifying the marks. Optical motion capture systems do not present any limitation about

the number of markers, and they are usually applied in a complex movement capture. As

we can see in Figure 1, there are four kinds of usual errors in optical systems that we

must repair before making any kind of biomechanical analysis with the data.

Data Transmission Losses

One of the most important issues in real-time video capturing is that the MoCap

workstation should be capable of storing the data onto the harddrive at very high rates. In

full size and full speed (NTSC mode) the amount of data even at the slowest frame rate of

30 frames per second (fps) that has to be streamed onto the harddrive is approximately

27Mb (24bit color * 640 * 480 * 30 frames/sec). Hence, the drive should be capable of

handling large amounts of data even at 30 fps. It is common to record videos at 100 fps

even for the simplest motion capture analysis. Hence, harddrive capacities of about 1 TB

and speed of about 10000 rpm should be used. To avoid data transmission or frame

capture losses at such high rates, the firewire ports are commonly used, which have the

capability to synchronize the data received at 100 fps from all the cameras at every

instant. The workstation must have data buses to support one firewire port for each

camera for such applications.

Page 61: By - Automation, Robotics, & Mechatronics Laboratory

34

Figure 2-43: Errors in Motion Capture Process Gonzalez-Morcillo, Jimenez-Linareset al. [49]

Marker swapping and Occlusion

The motion capture data obtained with this class of systems presents a group of problems

represented in Figure 2-43. Each graph in Figure 2-43 represents the time in X-axis and

the position of the marker in the space along Y-axis (we use, of course, one graph per

trajectory and axis). One type of problem is the occlusion of the mark through the

subject's body. If the subject hides some markers in a zone where at least two cameras are

not grabbing the marker (we need two simultaneous cameras to achieve stereoscopic

vision), the system will produce discrete errors called Lost Marks.

By way of a set of 2D captured images, the system is not able to obtain the correct 3D

position for the intermediate frames. This incident (called Erroneous Trajectory) is

represented in Figure 2-43, left bottom. When two markers are close to each other, the

capture system may swap each of their values at a time interval and there on may

continue with the swapped values. This is called marker swapping.

The Channels Interchange error (Figure 2-43, center) is difficult to detect only with

the trajectories of the marker and hence, some extra information is needed to accomplish

it. Eventually, there are Precision Errors in the calculation of the position in the space.

This event produces a shaky trajectory effect. In Figure 2-43, and on the right part, the

top graph represents a trajectory with precision errors and the bottom graph is the same

Page 62: By - Automation, Robotics, & Mechatronics Laboratory

35

trajectory after smooth handling. This is caused by the lens curvature and the imperfect

markers stuck to the subject’s joint. Usually, the detection of these errors is made

manually. An expert observes the captured data and analyses the input channels

identifying the problems in the capture phase. The cleaning process is usually made

through curve interpolation (generally cubic splines), or curve smoothing. Sometimes,

repositioning of the markers may be involved in each frame.

2.3.7. SimiMotion System

Based on the detailed survey and careful analysis of our application which

pertains to jaw motion studies, the choice of MoCap system for our application was

narrowed down to SimiMotion capture system SimiMotion [50]. This is an optical retro-

reflective-passive marker based semi portable MoCap system. Since most of the

experiments will be conducted in a controlled environment (either in the case of humans

or animals), the problem of safety in operational environment is ensured. The video

capture speed that is required for a mastication motion analysis is in the range 60- 80 Hz

and hence, the system required the video cameras to record at maximum rate of 100 Hz.

For efficient data transmission between cameras and workstation, high-speed firewire

ports are plugged in each data bus.

Figure 2-44: Frames Captured at Different Instant during Motion Capture of a Mobile Robotic Platform with Traces of the Markers at all times

Simi Motion has been designed for professional 2D or 3D motion analysis in the

fields of sports, biomechanics, veterinary medicine, rehabilitation, industry, biology and

entertainment. Due to long cooperation with movement scientists and biomechanical

institutes, the software has become an ideal tool for motion capture and analysis. High

Page 63: By - Automation, Robotics, & Mechatronics Laboratory

36

flexibility and accuracy combined with an easy to use interface are the strengths of this

product. Capturing of the movement is not time-limited and after digitization, all data can

be edited and visualized in many ways. 3D coordinates are calculated by synchronizing

data from other devices and can be exported in various formats. The following section

explains different modules of the motion capture system.

2.3.8. Modules

a) 2D/ 3D Kinematics:

SimiMotion 2D has been designed to analyze planar movements. First the

movement is digitized by placing markers on the measured object. In this case, automatic

tracking uses image-processing algorithms to detect the markers. Pattern matching

algorithms are also available and allow tracking of any object without markers

(markerless tracking). Raw data can be filtered or smoothed and interpolated to add

missing information. The 3D kinematics module includes all the features of 2D

kinematics, in particular the automatic tracking of moving objects (with or without

markers). A spatial analysis requires at least two cameras from different perspectives to

reconstruct 3D coordinates. One or more video clips are captured from different angles

and processed using the software for this purpose.

Figure 2-45: 2D/ 3D Kinematics Module Figure 2-46: Human Avatar within SimiMotion

b) Inverse Kinematics/ Dynamics:

Using a pre-defined marker set which is similar to 'Helen Hayes', this module

calculates joint centers, joint and segment rotation as well as axes. The resulting data

Page 64: By - Automation, Robotics, & Mechatronics Laboratory

37

complies with the worldwide typical data collections for clinical gait analysis. This

module provides data like inverse kinematics and additionally computes the joint forces

and muscle moments. It requires data from one or two force plates and the results make

up a complete set of data for professional and detailed motion analysis (e.g. clinical gait

analysis).

All results can be displayed in graphs and stick diagrams for visualization.

Additionally, virtual reality representations can be created using a skeleton model or

another 3D model and forces and moments can be simultaneously visualized.

Figure 2-47: 3D Visualization of MoCap data of Jaw Motion using Stick Diagrams and Plots of 3D coordinates of the incisor point tip

c) Cameras:

Basler 602f cameras can be connected to standard FireWire (IEEE-1394)

interfaces, which are inexpensive and available for all computers, including notebooks.

With 100 frames per second (non interlaced) and a resolution of 656x492 pixels, these

cameras play in higher league than standard DV cameras. For special purposes, the time

resolution can be increased by reducing the image size: More than 200 Hz for 400x300 or

more than 300 Hz for 400x200 pixels. Simi integrated these cameras seamlessly into the

Simi Motion software.

Page 65: By - Automation, Robotics, & Mechatronics Laboratory

38

A single computer can be used to capture 4 or even 6 cameras and all video

streams are automatically synchronized with analog data (force platforms, EMG etc.). All

video clips are saved in AVI format and can be processed with standard video editing

software and of course with all built-in features of Simi Motion (cropping, rotation,

mirror etc.).

These modules provide support for simultaneous capturing with Windows 2000

and Windows XP of multiple digital video cameras (DV). They are often combined with

the 2D and 3D motion analysis (kinematics) modules, but you may also extend your

EMG or force plate module with synchronized video analysis from several perspectives

without performing kinematic measurements.

2.3.9. MoCap Transformation and Synchronization

The computation phase of analysis is performed after all camera views have been

digitized. The purpose of this phase is to compute the three-dimensional image space

coordinates of the subject's body joints from the relative two-dimensional digitized

coordinates of each camera's view. Transformation is the process of converting two or

more, two-dimensional digitized views into a three-dimensional image sequence. The

transformation option is also available to convert a single, two-dimensional digitized

view into a two-dimensional image sequence. In either case, the process involves

automatic transforming of the relative digitized coordinates of each point in each frame to

absolute image space coordinates but for some initial timing information.

(a) Workstation and Camera Connection

(b) Basler Camera (c) Synchronization of 6 DV Cameras using DV Capture

Figure 2-48: Simi Motion System

Page 66: By - Automation, Robotics, & Mechatronics Laboratory

39

If a three-dimensional transformation is performed, an additional operation must be

performed on the individual camera views to synchronize them. This process is called

time matching. Since each digitized camera view may start at a different point in time,

frame one of the first view may not correspond to frame one of the second view. The

transformation will only yield accurate results if digitized coordinates from simultaneous

frames are used. For synchronization, image sequences do not have to have the same

frame rate as the individual views, as the software module will automatically interpolate

linearly between digitized frames to create any resulting frame rate desired. In case, if the

cameras are not synchronous then following options may be considered:

Triggering the cameras

By connecting all the cameras through special cables and triggering them by one signal

can help avoid such problems. This is often the case with digital cameras that are

activated by a signal ("trigger") and can begin simultaneously with the recording. If all

the cameras are started in this way at the same time, on the one hand it is guaranteed that

the moment of exposure will be simultaneous and on the other hand it is not necessary to

identify the reference frame because all the camera sequences begin with the same

picture.

Figure 2-49: Configure Trigger Signal in SimiMotion

Figure 2-50: Triggering Unit in SimiMotion

Measuring time discrepancy between the cameras

Using the appropriate electronic equipment, it is possible to measure the discrepancy in

time between cameras, which are not synchronized (with an accuracy of 0.0001s). This

Page 67: By - Automation, Robotics, & Mechatronics Laboratory

40

time lag must then be taken into account in the mathematical computation of 3-D data.

The error can thus be greatly reduced.

Finding synchronous frames

If there is no exact information available and the equipment used does not guarantee

synchronous recording, then the frames with the smallest possible time lag must be

looked for in each camera. A signal is generated which is visible from every camera

angle in order to indicate that the measurement is beginning. The recording of the

movement by the individual cameras begins with this optically marked frame or is

displaced by a constant time factor. This signal can also often be used to control other

measuring instruments or can be generated by these when measurement begins.

In spite of all these options, the automatic triggering control of the cameras is taken care

by SimiMotion software and hence automatic synchronization of the cameras is ensured

via firewire ports. In SimiMotion, the triggering unit sends a signal continuously within

short time periods to all the cameras that are connected to it and aids in transmitting the

data to the computer with synchronization.

Page 68: By - Automation, Robotics, & Mechatronics Laboratory

41

3. Biomechanics of Masticatory Motion The biomechanics of masticatory motion is an important part of the thesis which

needs a detailed description here. Actually, the biomechanical literature on human

masticatory system occupies a relatively small place owing to its relative complexity,

which makes it more difficult to analyze than, for instance, the system of the shoulder,

arm, hip, knee, or leg. Reasons that render the dynamic simulation of jaw motion difficult

are:

a. Large number of muscles of different size and shapes, making the system

kinematically indeterminate

b. Complex architecture of the jaw muscles making it impossible to determine the jaw

configuration only from orientation

c. Complexity of TMJ architecture that helps in articulating lower jaws with respect to

upper jaws- separation of the articular surfaces by cartilaginous disc that moves freely

between these surfaces that introduce complexity in motion and muscle actuation

d. Limited capability of experimental data collection pertaining to jaw motion

In the next few sections, we will discuss most of these issues including the

anatomical relationship, muscular system architecture and muscle models of jaw

mastication (Koolstra [51]).

3.1. Human Masticatory System The structural elements of the human mastication system consists of a skull and

mandible articulated at right and left TMJs. Dynamic balance of the system is provided

by complex architecture of the muscle elements and their actuations. The complexity of

the TMJs was discussed in the literature survey Section 2.1.1, but a detailed description

of the TMJ is provided here.

Page 69: By - Automation, Robotics, & Mechatronics Laboratory

42

Figure 3-1: Human Mandible Figure 3-2: Temporomandibular Joint

3.1.1. Temporo-Mandibular Joint (TMJ) Mandibular movements are guided by the articular surfaces fossae of TMJs that

reside on the temporal bones of the skull. Cartilaginous articular discs of variable

thickness separate the articular surfaces. These discs can move against fossae along the

fossa while interior surfaces of the discs simultaneously rotating on the condyles. The

discs attach to the ligaments binding mandible to skull. Together, these structures make

up the articular capsule. This articular capsule is slack.

Some consequences of this architecture are as follows. First, the articulating surfaces of

the TMJs are incongruent to each other, which allow a large a range of motion, but at the

cost of smaller joint contact and less joint stability. Second, the joint axis about which the

jaw rotates is not fixed in space or relative to the skull. Consequently, motion of an

incisor tooth cannot be related to TMJ position or condylar motion. Put it simply, the

paths that an incisor path can track is indefinite (analogous to redundant parallel

manipulators), so in reality, there are infinite solutions to this inverse kinematics/

dynamics problem.

3.1.2. Musculoskeletal Modeling The importance of complex muscle architecture in maintaining the jaw system in

dynamic balance was already mentioned earlier. Muscles that move the jaw are classified

as elevators (jaw closers) and depressors (jaw openers). Elevators include temporales,

masseters, and pterygoids (medial) and run from the skull to mandible. Depressor groups

technically include geniohyoid, mylohyoid, digastric muscles and lateral pterygoids, but

only the digastrics by far the most powerful depressors, were included in analyzes.

Elevator muscles differ from the depressor muscles. The former have larger pinnate

Page 70: By - Automation, Robotics, & Mechatronics Laboratory

43

angles, higher physiological cross sectional areas (PCSA), with shorter fibers compared

to depressors.

Figure 3-3: Masticatory Muscular Architecture (Xu, Lewiset al. [11])

From Figure 3-3 (right-top corner), one can see that the temporalis is a flat, fan-

shaped muscle that originates in the temporal fossae and inserts on the coroniod process and

the anterior edge of the ramus of the mandible. The masseter (left top of Figure 3-3) is an

elevator muscle providing much of the power required for crushing food. It also assists in

protrusion. In addition to functioning as an elevator of the mandible, the medial pterygoid

aids in lateral positioning and is active during protrusion as explained by Lehman-Grimes

[52]. Similarly, other muscles can be easily identified from the Figure 3-3.

It is clear that the masticatory system is redundant system (more actuators than

degrees of freedom). This means that the controlling central system could potentially

control the actuation of the muscles to optimally reduce the energy consumption. As a

result, the muscles can move the jaw in various ways, in fact in infinite ways. Although

the system is able to generate cyclic movements controlled by a central pattern generator,

its muscles cannot be lumped into a limited number of alternating muscle groups. One of

the reasons for this is that they have to adapt constantly to the texture of the food between

the teeth. Because the muscle attachments are spread over wider regions (i.e., not at

specific points) and given the adaptability of the muscles to exert forces based on the

motion activity, it is certain that muscle lines of action will vary for different jaw

Page 71: By - Automation, Robotics, & Mechatronics Laboratory

44

motions. Other points to be noted before considering the problem of the determining the

muscle forces for a given jaw motion are— inherent capability of fine tuning of muscles

by selective activation of motor units, relative large attachment area of muscles, presence

of spatially distant fibers to shorten by varying degrees for the mandibular movements.

All these may cause a shift in muscle’s action of force, which does not depend on the

central pattern generator (or central nervous system).

Figure 3-4: Anatomical Planes- used to describe the positions of the muscles or organs in musculoskeletal systems (Shin [53])

3.1.3. Dynamic modeling of Mastication

To model the mastication, we need to determine degrees of freedom for jaw

movements and then try to form a geometrical relationship to express joint positions in

defining the incisor tooth tip (end effector) position, the occlusal edged of lower central

incisor. Considering the mandible to be a body in space, it is considered a 6-DOF body,

but it is constrained and balanced by joints, discs and muscular architecture. In

mathematical terms, the position and orientation of the jaw can be given in terms of 3-

translational and 3-rotational coordinates— anteroposterior or X, mediolateral or Y, and

supero-inferior or Z giving a orthogonal set of planes to define the motion in anatomy,

see Figure 3-4 for the explanation of the anatomical planes.

There are different ways to represent jaw motions but a convenient way is to use

the screw axes. That is movement as a translation along and rotation about the same axis.

To account for 6-DOF, a set of 3-screw axes must be determined corresponding to

Page 72: By - Automation, Robotics, & Mechatronics Laboratory

45

movement of the jaw. However, in this case the screw axes vary for each movement and

hence must be determined at every instant to completely define the position and

orientation of the jaw. By this token, we can express the jaw motion using 6-coordinates

and the location of the joint axes depends on the type of motion described along the axes.

We can now proceed to describe the position, velocity and acceleration of the

mandible, which will be parameterized using six independent variables as previously

explained. As in Koolstra [51], we use Newton’s law to determine the equations of

motion including active and passive muscle forces generated by ligaments, tendons and

dental elements. These forces and the resulting torques about the points of interest can be

used in Newton’s equation to determine accelerations. The calculated acceleration terms

induce changes in velocities and positions.

Dashed lines: principal axes, a: (linear) accelerations, F: (linear) forces, m: mass, α: angular accelerations.

M: torques, I: moments of inertia

Figure 3-5: Six degrees of freedom for jaw movement.

3.1.4. Inverse Dynamic Analysis and Muscle Actuation

Any musculoskeletal system in general is considered a redundant mechanical

system because there are more actuators to cause movement of the segments than there

are the actual degrees of freedom for the system considered. As mentioned before, this

statement is true for the masticatory system jaw as it has as many as 24 actuators (muscle

portions), which can be actuated independently to cause mandibular movements in 6-

Page 73: By - Automation, Robotics, & Mechatronics Laboratory

46

DOF space. Because these muscles (passive and active) generate forces with higher

degrees of interdependency, it is impossible to formulate a clear-cut inverse dynamic

problem and determine the influence of individual forces. In addition, the fact that these

muscles attach over wide areas makes it difficult to accurately determine lines of action

of forces. For most jaw movements, active elements of muscles play a dominant role and

in general, used as jaw motion determinants however, along the boundaries, passive

muscles become dominant.

Generally, the contribution of a muscle to jaw movements can be established by

the direction of its line of action, and the position of this line with respect to the center of

gravity of the lower jaw. It accelerates the jaw in the direction of the line of action

according to F = ma, where a is the linear acceleration vector, F is the muscle force

vector, and m is the mass of the jaw. Also, an angular acceleration about the center of

gravity occurs according to M = Iα, where α is the angular acceleration vector, M the

muscle torque vector about the center of gravity, and I the moment of inertia vector. The

actual movement, then, is determined by the resultant instantaneous linear and angular

accelerations initiated by the forces of all active and passive structures. These combined

factors determine the effect of muscle contraction and, consequently, the contribution of

each single muscle to jaw movement.

Crosshairs: center of gravity, Fclosers: mean force of the jaw-closing muscles, Fopeners: mean force of jaw-opening muscles, Fjoint: joint force, Fbite: bite force, a: moment arm of the different forces.

Figure 3-6: Forces acting on the lower jaw in the Sagittal plane

Page 74: By - Automation, Robotics, & Mechatronics Laboratory

47

In a sagittal plane analysis, the lines of action of most jaw-closers are directed

upward, and those of the jaw-openers, downward and backward as in Figure 3-6.

1. MA- Masseter

2. TE- Temporalis

3. LP- Lateral Pterygoid

4. Medial Pterygoid

JF- Joint Forces

BF- Bite forces

Courtesy: Koolstra 2002

Figure 3-7: Schematic of force vector diagrams for each muscle groups (force on both sides will be included for mathematical modeling)

However, in both cases, each line of action has a similarly directed moment with

respect to the sagittal axis through the center of gravity of the lower jaw. Jaw closers and

openers are able to produce a similarly directed torque about this axis, which leads to an

angular acceleration in the “negative elevation” (opening) direction. Consequently,

almost every muscle pair that is activated symmetrically attempts, aside from its specific

action, to perform an opening rotation about the center of gravity. It is through this

mechanism that both jaw closers and openers, despite their difference in orientation, are

able to maintain articular contact while performing unloaded (symmetrical) jaw

movements.

3.1.5. Muscle Modeling (Active and Passive):

The factors affecting optimal forces produced by muscle are given below:

a. Physiological cross sectional area (PCSA) - It is the area of a transverse section of

muscle and can be calculated as

( )cosmuscle

fibre density

mPCSA

ρ= , (3.1.1)

Page 75: By - Automation, Robotics, & Mechatronics Laboratory

48

where muscle mass is the wet weight of the muscle, theta is the angle of fiber pinnation,

fiber length is the mean fiber length within the muscle and muscle density is assumed to

be a constant (1.067 g cm−3).

b. Muscle activity level (0 to 1) -. If the activities of a set of muscles are close to 1, then

it is said to be in maximum activation and can cause serious damages i.e. failure of

muscle or other passive elements.

c. Force- length relationship- This relationship maintains the ability of the muscles to

generate forces when their sarcomeres (sliding elements) are within a specific range

of lengths (lmin and lmax), and are not extended beyond or contracted below this range.

It has been found that is an important limiting factor in jaw mastication movements.

d. Muscle contraction shortening velocity- It is not a major limiting factor for normal

jaw movements. However, during deceleration of the jaw after a sudden

disappearance of resistance during forceful biting the relationship between force-

velocity appears.

Passive Elements:

These elements have the ability to resist jaw motion in one or more degrees of

freedom by generating reaction forces/ torques. Their influence is evident when the jaw

deviates from the midline and serve to prevent joint dislocation in these off-centered

movements. Ligaments involved in temporomandibular joints have three main functions:

stabilization, guidance of movement, and limitation of movement. The temporomandibular,

stylomandibular, and sphenomandibular ligaments are the three primary ligaments of the

TMJ. In most cases, however, the ratio between linear and angular accelerations effected

by a muscle is subtly dependent on the mass and moments of inertia of the jaw, and all

structures that are more or less rigidly attached to it. This attachment may include the part

of the masticatory muscles attached to the mandible, the tongue, skin, and other soft

tissues. However, the influence of these inertial properties on the final movement is small

and can be neglected in the final dynamic model of mastication.

Mathematical models applied to the study of the passive forces of the masticatory

muscles have been unable to open the jaw more than about 3 cm, whereas an opening of

Page 76: By - Automation, Robotics, & Mechatronics Laboratory

49

6 cm is frequently observed in vivo. Therefore, the quantitative nature of these

predictions is disputable. Due to the proposed exponential relationship between the

passive muscle forces and their sarcomere lengths, small errors in the constants that

determine this relationship may lead to relatively large errors in the projected passive

forces. As long as there are no accurate quantitative data on the relationship between

sarcomere length and passive force of the human masticatory muscles, this issue remains

uncertain.

3.1.6. Posselt Envelope:

The main motions of the jaw, namely opening and closing, are a combination of

both translation and rotation. The translational and rotational components are not

combined equally through the whole of the motion. In the initial phase of the opening

cycle, the movement is primarily rotational, but after approximately the first 20 mm of

jaw opening, translation becomes pronounced. Maximum opening is reached when the

distance between occlusal edges of the upper and lower incisors is about 50 mm, which is

actually limited by the ligament and joint capsules (Zantos, Tavareset al. [54]). Closing

movement begins with a phase in which posterior translation predominates. The jaw

closes with translation as its major component until about two-thirds of maximal opening.

At this time the condyles and discs have returned to the posterior slope of the articular

eminence. Once this happens, closing occurs as a smooth combination of translatory and

rotary motion. Occlusal position is then attained primarily, though not entirely, by

rotational motion.

Jaw Motion Cycles

a. 1-2: MRO

b. 2-3- FRO

c. 3- MO

d. 3-4: MFP

e. 4-1- RP

Figure 3-8: Sagittal Plane- Posselt Envelope

Page 77: By - Automation, Robotics, & Mechatronics Laboratory

50

A point located between the incisal edges of the lower central incisors, termed the

incisal point, is usually used to describe the movement of the mandible. The Posselt diagram

(Figure 3-9, Figure 3-8) outlines the border movements of the incisal point. The initial

position of the incisal point is called centric occlusion, and at this position, the occlusal

surfaces are in maximum contact. The sagittal Posselt figure can be divided into 4 segments.

In the first segment, called the maximal rear opening (MRO, 1-2) period, the jaw rotates

approximately 10 degrees about an axis that intersects the center of the condyles. If the

mandible opens farther, protrusion starts, and the final rear opening (FRO, 2-3) period can be

considered as the combined movement of the rotation about the axis and protrusion. After

this period the maximal opening (MO- 3) is reached. The maximal frontal path (MFP- 3, 4) is

described as a rotation around the axis accompanied by maximal protrusion. At the upper

border, the mandible is only in maximum protrusion and can return to its initial position of

centric occlusion by a retrusive path (RP, 4-1).

Figure 3-9: Frontal Plane : Posselt Envelope

Page 78: By - Automation, Robotics, & Mechatronics Laboratory

51

4. Mathematical Background

In this section, we will explain the mathematical derivations and results obtained

by numerical simplifications that will be used in the section 6 and Error! Reference

source not found. for simulating the musculoskeletal mastication model as well as jaw

masticators.

4.1. Kinematics of R-U-S Configuration

The kinematics of a 6 DOF R-U-S platform is explained below. The reference

frames at the base and platform are as chosen at points B and P respectively— shown in

figure (1).

Figure 4-1: Schematic diagram of R-U-S configuration

The first frame (frame O) is defined by the center of the base-platform- shown by a red

circle in the figure (1). Following description pertains to ith leg of the manipulator:

OBi- base platform radius: l0- link length between the frame O and frame B

AB- leg1: l1- link length between the origin of the frame A and frame B

BiCi- leg 2: l2- link length between the frame B and frame C

Page 79: By - Automation, Robotics, & Mechatronics Laboratory

52

CiPi- moving platform radius: l3- link length between the frame C and frame P

Figure 4-2: Kinematics of leg I of the R-U-S manipulator (front and side view)

Types of joints located at different points are given below:

Ai- revolute joint (θ1i) - connects (link 1)i to the base platform- acts like crank to the ith leg

Bi- universal joint - connects (leg 1) i and (leg 2) i

Ci- spherical joint - connects (leg 2) i with the upper platform frame P.

l3- link length between the frame C and frame P

x –axis is aligned along iOA→

z-revolute joint axis

y- axis selected to form a RH triad (parallel to global y axis)

Figure 4-3: Base- Revolute Joint frame A

Page 80: By - Automation, Robotics, & Mechatronics Laboratory

53

The third frame (Frame P) is defined on the center of the top platform. Angles θ2i and

θ3i are the orientation of the link2 as shown in the figure (3) above. These angles were

included to develop the inverse kinematics code in MATLAB and can be used to

represent the universal joint angles. The orientations of the frame B and C is aligned

based on their respective joint configuration.

4.2. Position Kinematics:

The loop closure equation given by Tsai [55]of an ith leg of the R-U-S manipulator yields:

OA AB BC CP OP→ → → → →

+ + + = (4.2.1)

; ;a OA c CP p OP→ → → → → →

= = = - where all the vectors are defined in base reference frame.

1 1 2 3 1 2

1 1 2 3 1 2

2 3

cos( ) sin( ) cos( )sin( ) sin( )sin( ) ( )

0 cos( )

i i i iB

i i i i

i

AB BC p a cl ll l p a CP

l

θ θ θ θθ θ θ θ

θ

→ → → → →

→ → →

+ = − −

+⎡ ⎤ ⎡ ⎤⎡ ⎤ ⎡ ⎤ ⎡ ⎤⎢ ⎥ ⎢ ⎥+ + = − −⎢ ⎥ ⎢ ⎥ ⎢ ⎥⎢ ⎥ ⎢ ⎥ ⎣ ⎦ ⎣ ⎦ ⎣ ⎦⎢ ⎥ ⎢ ⎥⎣ ⎦ ⎣ ⎦

(4.2.2)

1 1 2 3 1 2

1 1 2 3 1 2

2 3

cos( ) sin( )cos( )sin( ) sin( )sin( )

0 cos( )

i i i i i

i i i i i

i i

l l cxl l cy

l cz

θ θ θ θθ θ θ θ

θ

+⎡ ⎤ ⎡ ⎤ ⎡ ⎤⎢ ⎥ ⎢ ⎥ ⎢ ⎥+ + =⎢ ⎥ ⎢ ⎥ ⎢ ⎥⎢ ⎥ ⎢ ⎥ ⎢ ⎥⎣ ⎦ ⎣ ⎦ ⎣ ⎦

(4.2.3)

where [ , , ]P

Ti i ic cx cy cz

→⎛ ⎞ =⎜ ⎟⎝ ⎠

Equating 3rd row of the equation(4.2.3), we get 3 2cos( / )ia cz lθ =

Substituting that in the following equation, we can find 2θ as follows:

2 2 2 2 21 2 1 2 3 22 sin( ) cos( )i i icx cy cz l l l l θ θ+ + = + − (4.2.4)

2

2 2 2 2 21 2

1 2

cos( ),( )

2i i i

a Kcx cy cz l lwhere K

l l

θ =

+ + − −=

(4.2.5)

Page 81: By - Automation, Robotics, & Mechatronics Laboratory

54

From 2θ and 3θ we can determine 1θ from linear equations in 1cos( )θ and 1sin( )θ obtained

from 1st and 2nd row of loop closure equation(4.2.3).

4.3. Velocity Kinematics to find Link Jacobian Matrix:

From the loop closure equation (4.2.1),

OA AB BC CP OP→ → → → →

+ + + = (4.3.1)

; ;a OA c CP p OP→ → → → → →

= = = - where all the vectors are defined in base reference frame.

To find the link Jacobian matrix, we consider ith leg of the R-U-S manipulator and

express top platform points, Ci in the base frame O.

1 1 2 3 1 2

1 1 2 3 1 2

2 3

,

cos( ) sin( ) cos( )sin( ) sin( )sin( ) .

0 cos( )

PAi

i i i iO P

i i i i P

i

AB BC c c p R c

l ll l p R CP

l

θ θ θ θθ θ θ θ

θ

→ → → → → →

→→

⎛ ⎞+ = = + ⎜ ⎟⎝ ⎠+⎡ ⎤ ⎡ ⎤

⎡ ⎤⎡ ⎤⎢ ⎥ ⎢ ⎥+ + = + ⎢ ⎥⎢ ⎥⎢ ⎥ ⎢ ⎥ ⎣ ⎦ ⎣ ⎦⎢ ⎥ ⎢ ⎥⎣ ⎦ ⎣ ⎦

(4.3.2)

where AiOR is the rotation transformation matrix from base O with reference to Ai and R is

obtained from the end effector position and orientation as:

cos( )cos( ) cos( )sin( )sin( ) sin( )cos( ) cos( )sin( )cos( ) sin( )sin( )sin( )cos( ) sin( )sin( )sin( ) cos( )cos( ) sin( )sin( ) cos( ) cos( )sin( )

sin( ) cos( )sin( ) cos( )cos( )

OP

y p y p r y r y p r y rR y p y p r y r y p r y r

p p r p r

− +⎡ ⎤⎢ ⎥= + −⎢ ⎥⎢ ⎥−⎣ ⎦

(4.3.3)

Differentiating (4.3.2) w.r.t time t, we get,

2 3 1 2 1 2 2 3 1 2 31 1

1 1 1 2 3 1 2 1 2 2 3 1 2 3

2 3 3

sin( )sin( )( ) cos( ) cos( )( )sin( )cos( ) sin( ) cos( )( ) cos( )sin( )( )

0 sin( )( )

i i i i i i i i ii

i i i i i i i i i i i

i i

l lll l l

l

p

θ θ θ θ θ θ θ θ θθθ θ θ θ θ θ θ θ θ θ θ

θ θ

• • •

• • • •

→•

⎡ ⎤− + + + +⎢ ⎥−⎡ ⎤⎢ ⎥⎢ ⎥ + + + + + +⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎣ ⎦ −⎢ ⎥⎣ ⎦

⎡=⎣

.( )OPR c

→⎤⎢ ⎥ +⎢ ⎥⎦

i

(4.3.4)

Page 82: By - Automation, Robotics, & Mechatronics Laboratory

55

2 3 1 2 1 2 2 3 1 2 31 1

1 1 1 2 3 1 2 1 2 2 3 1 2 3

2 3 3

sin( )sin( )( ) cos( ) cos( )( )sin( )cos( ) sin( ) cos( )( ) cos( )sin( )( )

0 sin( )( )

i i i i i i i i ii

i i i i i i i i i i i

i i

l lll l l

l

p

θ θ θ θ θ θ θ θ θθθ θ θ θ θ θ θ θ θ θ θ

θ θ

• • •

• • • •

→•

⎡ ⎤− + + + +⎢ ⎥−⎡ ⎤⎢ ⎥⎢ ⎥ + + + + + +⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎣ ⎦ −⎢ ⎥⎣ ⎦

⎡=⎣

cω→⎤

⎢ ⎥ + ×⎢ ⎥⎦

(4.3.5)

1

0

, .( ) .( ) .( ).( ) . , 0

0

, .( )

O O O O O OP P P P P P

O OP P

as R c R R R c c where

extracting from R c c

γ β

γ α

β α

α

ω β ω

γ

→ →

⎡ ⎤−⎢ ⎥⎢ ⎥

= = Ω Ω = −⎢ ⎥⎢ ⎥−⎢ ⎥⎣ ⎦

⎡ ⎤⎢ ⎥⎢ ⎥

= Ω = ×⎢ ⎥⎢ ⎥⎢ ⎥⎣ ⎦

i i

i i i i

i i

i

ii

i

Figure 4-4: Front and Side Orthogonal View of ith Leg Configuration of the R-U-S Manipulator

where on assuming ω→

is obtained by considering the Euler angles α, β, γ are represented

w. r. t. to global x, y, z axes respectively and so rearranging the terms in (4.3.5) becomes,

Page 83: By - Automation, Robotics, & Mechatronics Laboratory

56

1 1 2 3 1 2 2 3 1 2

1 1 2 3 1 2 1 2 3 1 2 2

2 3 1 2

2 3 1 2

2 3

sin( ) sin( )sin( ) sin( )sin( )cos( ) sin( ) cos( ) sin( )cos( )

0 0

cos( ) cos( )cos( )sin( )

sin( )

i i i i i i i

i i i i i i i i i

i i i

i i i

i

l l ll l l

ll

l

θ θ θ θ θ θ θθ θ θ θ θ θ θ θ θ

θ θ θθ θ θ

θ

• •− − + − +⎡ ⎤ ⎡ ⎤⎢ ⎥ ⎢ ⎥+ + + +⎢ ⎥ ⎢ ⎥⎢ ⎥ ⎢ ⎥⎣ ⎦ ⎣ ⎦

+⎡+ +

−[ ]3 3 3

00

0

z y

i z x

y x

x c cI y c c

c cz

α

θ β

χ

• •

• • •

×

• •

⎡ ⎤ ⎡ ⎤⎢ ⎥ ⎢ ⎥⎡ ⎤−⎤⎢ ⎥ ⎢ ⎥⎢ ⎥⎢ ⎥ = + −⎢ ⎥ ⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥ ⎢ ⎥⎢ ⎥⎢ ⎥ −⎣ ⎦ ⎣ ⎦⎢ ⎥ ⎢ ⎥⎣ ⎦ ⎣ ⎦

(4.3.6)

1 1 2 3 1 2 2 3 1 2

1 1 2 3 1 2 2 3 1 2

12 3 1 2

2 3 1 2 2

2 33

sin( ) sin( )sin( ) sin( )sin( )cos( ) sin( ) cos( ) sin( ) cos( )

0 0

cos( )cos( )cos( )sin( )

sin( )

i i i i i i i

i i i i i i i

ii i i

i i i i

ii

l l ll l l

ll

l

θ θ θ θ θ θ θθ θ θ θ θ θ θ

θθ θ θθ θ θ θ

θ θ

− − + − +⎡⎢ + + +⎢⎢⎣

⎡ ⎤⎢+ ⎤⎢⎥+ ⎢⎥⎢⎥− ⎦ ⎢⎣ ⎦

~

~

1 0 0 00 1 0 00 0 1 0

z y

z x

y x

qi xi

c cc c

c c

J q J

X

x

⎥ ⎡ ⎤−⎥ ⎢ ⎥ ⎡ ⎤= −⎥ ⎢ ⎥ ⎢ ⎥⎣ ⎦⎥ ⎢ ⎥−⎣ ⎦⎥

=i

(4.3.7)

where Jqi is joint space jacobian matrix and Jxi is the task space jacobian matrix that can

be used to determine the iVci— velocity of point ci w.r.t the ith reference frame located at

the corresponding base revolute joint of the leg in the base plate (Ai).

4. 3.1. Link and Manipulator Jacobian Matrix

To obtain the manipulator Jacobian matrix, we need to first form link Jacobian matrix

from equation (4.3.7) as follows in the local frame at ith revolute joint. For this we need to

multiply the RHS by 1( )O AA OR R− = to express the link Jacobian matrix in the local leg

frame at Ai. So, let Jq1 be defined as

(4.3.8)

1 1 2 3 1 2 2 3 1 2

1 1 1 2 3 1 2 2 3 1 2

2 3 1 2

2 3 1 2

2 3

sin( ) sin( ) sin( ) sin( ) sin( )cos( ) sin( ) cos( ) sin( ) cos( )

0 0

cos( ) cos( )cos( ) sin( )

sin( )

i i i i i i i

q i i i i i i i

i i i

i i i

i

l l lJ l l l

ll

l

θ θ θ θ θ θ θθ θ θ θ θ θ θ

θ θ θθ θ θ

θ

− − + − +⎡⎢= + + +⎢⎢⎣

+ ⎤⎥+ ⎥⎥− ⎦

Page 84: By - Automation, Robotics, & Mechatronics Laboratory

57

From the link jacobian matrix (Jq) i, we can obtain the manipulator jacobian matrix JP by

extracting the first row of (Jq) i for each leg and equating to 1iθ•

(manipulator active joints)

for each leg. Finally we arrive at the relation:

1 ,1~

( )i q iJ xθ••

= , (4.3.9)

where (Jq, 1) i is the first row of (Jq)i obtained for ith leg. Therefore, we get the manipulator

jacobian matrix JP as

,1 1

,1 2

,1 3

~ ~,1 4

,1 5

,1 6

( )( )( )( )( )( )

q

q

qpa

q

q

q

JJJ

q JJJJ

x x• ••

⎡ ⎤⎢ ⎥⎢ ⎥⎢ ⎥

= =⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎣ ⎦

, where 1 2 3 4 5 6 ,T

aq θ θ θ θ θ θ• • • • • • •⎡ ⎤= ⎢ ⎥⎣ ⎦

active joint rates for

the manipulator system considered

4.4. Screw Theoretic Jacobian Matrix and Singularity Analysis From the loop closure equation (4.3.1), we have for this case as derived by Filho and

Cabral [56]

1 1

11 2 2 1

~ ~ ~

3 3

, ( ) ( ) [( ) ] ( )

i i

C Cq i A ci i q A ci q i

i i

Then J R J J R J Jx x xθ θ

θ θ

θ θ

• •

• • •• •−

• •

⎡ ⎤ ⎡ ⎤⎢ ⎥ ⎢ ⎥⎢ ⎥ ⎢ ⎥

= ⇒ = =⎢ ⎥ ⎢ ⎥⎢ ⎥ ⎢ ⎥⎢ ⎥ ⎢ ⎥⎣ ⎦ ⎣ ⎦

i i

Page 85: By - Automation, Robotics, & Mechatronics Laboratory

58

OA AB BC CP OP

OA AB BC OP PC

→ → → → →

→ → → → →

+ + + =

+ + + = + (4.4.1)

Differentiating this equation w.r.t time,

( ), 1,.....,6i i

i iP P bi i i B C i iV P l l B C for iω θ θ ω+ × = × + × + × =i i

(4.4.2)

Since the velocity of the passive link, BC is irrelevant to our present analysis we can

eliminate by cross- multiplying the above equation by BiCi to obtain:

1

11

1

. .( ) 2 .( ), 1,.....,6

[ ] 2 .( ) , 1,.....,6

ii i P P i i i i i i i

iPii i i i i i i i i

P i

B C V b B C A B B C for i

VB C b B C A B B C for i

ω θ

θ θω θ

+ × = × =

⎧ ⎫× = × =⎨ ⎬

⎩ ⎭

i

ii

i

(4.4.3)

which on combining for all the six legs becomes,

11

1

[ ] 2 .( ) , 1.....6x

q

iPii i i i i i i i i

PJ i q

XJ

VB C b B C diagonal A B B C for iθ θ

ω θ

⎡ ⎤⎢ ⎥⎧ ⎫

× = × =⎢ ⎥⎨ ⎬⎢ ⎥⎩ ⎭⎢ ⎥⎣ ⎦

i

i

ii

i (4.4.4)

4.5. Singularity Analysis of the Jacobian of R-U-S Platform Once we obtain the Jacobian matrix by the above formulation, we can now find when the

manipulator reaches singular positions by analyzing the forward and backward dynamic

jacobian matrices and finding the determinant of these matrices. Thus we obtain by

expanding along the 3rd column,

1 2 3 1 1 2 3 1 2 2 3 1 2

1 1 2 3 1 2 2 3 1 22 2

1 2 3 2

det( ) *sin( )*[( sin( ) sin( )sin( ))( sin( ) cos( ))

( cos( ) sin( ) cos( ))( sin( )sin( ))]

sin( ) sin( ) 0

q i i i i i i i i

i i i i i i i

i i

J l l l l

l l l

l l

θ θ θ θ θ θ θ θ

θ θ θ θ θ θ θ

θ θ

= − − − + + −

− + + − +

= − = (4.5.1)

One of the solutions for the above equation is θ2i = nπ, n=-α ...-3,-2,-1, 0, 1, 2, 3… α,

which occurs when the passive link comes in line with the crank (active link).

Page 86: By - Automation, Robotics, & Mechatronics Laboratory

59

4.6. Kinematic of P-U-S Platform Similar to the loop closure equation (4.3.1) of R-U-S platform, it can obtained for P-U-S

platform as in Kim [57],

, ,i o i o iiOA A A A B BP OP

→ → → → →

+ + + = (4.6.1)

The start and end points of the rails of the prismatic joint is given by Ai,o and Ai,1 the

center of the universal joint i, which lies on the line segment Ai,o Ai,1 (rail axis i), will be

denoted by the base joint Ai. A right handed base reference frame with center O is

attached to the base. The center of the spherical joint i will be denoted by a platform joint

Bi. The mobile reference frame is attached to the point Ci on the platform (CG of the

platform). The distance between point Ai,0 and Ai,1 will be denoted by articular coordinate

λi, changing the articular coordinates will change the pose of the platform, P. The position

of the platform is denoted by point P measured from the origin O and the orientation

angles (Euler angles) are expressed as [α, β, γ]. For inverse kinematic problem, the

position and orientation of the platform will be given. Euler angles are defined w.r.t.

global X, Y, Z-axes respectively and hence the same rotation matrix (4.3.3) as in the

previous case with R-U-S manipulator can be used.

Suppose the position of P is given at any instant, then we can determine the as AiBi. Let ai

be the unit vector along the rail axis slider Ai,0 Ai,1. To find λi the following procedure is

followed. From the position vector of P, the joint center position OBi can be determined

as PBi is known and remains constant in the platform reference frame. Then AiBi is

determined in the global reference frame.

,0 ,i i i i i o i i iiA B A B A A d aλ→ → → → →

= − = − (4.6.2)

But, ,i iA B l→

= of the constant magnitude (4.6.3)

2( ) ( )Ti i i i i id a d a lλ λ

→ → → →

− − =i (4.6.4)

Solving the equation(4.6.4) for the articular variable λi, we get,

Page 87: By - Automation, Robotics, & Mechatronics Laboratory

60

2( )T T Ti i i i i i ia d a d d d lλ = − − + (4.6.5)

Therefore, λi is obtained by knowing the vector di vector (i.e. Bi) from the equation

(4.6.1)

,i i o i iA A aλ→

= + (4.6.6)

The following method is actually used to implement the inverse kinematics of the 6-DOF

P-U-S system. We simplify (4.6.1) for this purpose to obtain the following:

, ,

, ,

,,

00

i o x i i xO O O

i o y A B i i y P

i i zi o z

A A B xA R R A B y R PC

qi A B zA

→⎧ ⎫ ⎧ ⎫⎧ ⎫ ⎧ ⎫⎪ ⎪ ⎪ ⎪ ⎪ ⎪ ⎪ ⎪+ + = +⎨ ⎬ ⎨ ⎬ ⎨ ⎬ ⎨ ⎬⎪ ⎪ ⎪ ⎪ ⎪ ⎪ ⎪ ⎪

⎩ ⎭ ⎩ ⎭⎩ ⎭⎩ ⎭

(4.6.7)

Since Ai,o as well as OAR , we proceed with the equation to solve for 4 unknown

variables- , , ,, , intO O Oi x i y i y iB B B and q prismatic jo position−

From first 2 rows of equation(4.6.7), we solve for , ,O

i i x i i yA B and A B as,

, , ,

, , ,

Oi i x i x i x

Oi i y i x i y

A B C A

A B C A

= −

= − (4.6.8)

Since we know that length of link AB is constant= l2. We obtain ,i i zA B as

( )

( )

2 2 22 , , ,

2 2 2, 2 , ,

i i i i x i i y i i z

i i z i i x i i y

A B l A B A B A B

A B l A B A B

= = + +

= − + (4.6.9)

which again on substituting in the 3rd row of the equation(4.6.7), we can solve for qi.

Thus we, see that there are two values of AiBi, z (+/ -) which actually results in 2 solutions

for each leg that produces 26 solutions for the Stewart platform manipulator. For practical

application purposes, positive values are commonly used.

Page 88: By - Automation, Robotics, & Mechatronics Laboratory

61

4.7. Velocity Kinematics of P-U-S Platform In their work by Zhao and Gao [58], the Jacobian matrix using the screw theoretic

formulation technique was derived which can be used conveniently to derive Jacobian

matrices for any parallel manipulators. We start from differentiating the loop closure

equation of P-U-S as in equation(4.6.1) w.r.t. time t as follows:

^

i ii i i ia A B V cλ ω ω→ → → →

+ × = + ×i

(4.7.1)

Dot multiplying by AiBi, we get

^

. . .i ii i i i i i ia A B V A B c A Bλ ω→ → → → → →⎛ ⎞ = + ×⎜ ⎟

⎝ ⎠

i (4.7.2)

^

1

.i ii i i

i i i

VA B c A B

a A Bλ

ω

→→ → →

→ →

⎛ ⎞⎡ ⎤⎜ ⎟ ⎡ ⎤ ⎢ ⎥⎜ ⎟= ×⎢ ⎥ ⎢ ⎥⎛ ⎞ ⎣ ⎦⎜ ⎟⎜ ⎟ ⎣ ⎦⎜ ⎟⎝ ⎠⎝ ⎠

i (4.7.3)

^

1. , ,.

i ii i i

i i i

VJ where J A B c A B

a A Bλ

ω

→→ → →

→→

⎛ ⎞⎡ ⎤ ⎜ ⎟ ⎡ ⎤⎢ ⎥ ⎜ ⎟= = ×⎢ ⎥⎢ ⎥ ⎛ ⎞ ⎣ ⎦⎜ ⎟⎜ ⎟⎣ ⎦ ⎜ ⎟⎝ ⎠⎝ ⎠

i

(4.7.4)

is the manipulator jacobian matrix for P-U-S degree of manipulator, with i=1…6.

Page 89: By - Automation, Robotics, & Mechatronics Laboratory

62

4.8. Denavit Hartenberg Parameterization

Figure 4-5: Schematic diagram showing the DH parameterization for each joint coordinate to

determine the end effector reference frame

The DH parameterization CMU [59] requires four quantities to be determined at each

joint by attaching the reference frames along each joint DOF whose names are generally

given as link length(ai), link twist(αi), link offset(di) and joint angle (θi). These are called

as DH parameters and can be obtained for each joint DOF frame as follows.

Initially, a base reference (zeroth ) frame is attached to first joint, in this case at the point

Ai for each legs. Then the DH parameters can be determined as follows:

o Assign Zi axis of i-th reference frame along the axis of joint i.

For a revolute joint, the joint axis is along the axis of rotation.

For a prismatic joint, the joint axis is along the axis of translation.

o Choose Xi axis to point along the common perpendicular of Zi and Zi+1

pointing towards the next joint.

Page 90: By - Automation, Robotics, & Mechatronics Laboratory

63

if Zi and Zi+1 intersect, then choose Xi as normal to the plane of intersection.

o Choose Yi to round out a right hand coordinate system.

The Y-axis is not used for DH transformation matrices so it is not usually displayed in

DH parameterized systems. So based on these guidelines, we can determine the

transformation matrix of i-th reference frame w.r.t the (i-1)th reference frame as follows:

( ) ( ) ( ) ( ) ( ) ( )( ) ( ) ( ) ( ) ( ) ( )

( ) ( )

1, , , ,. . .

cos sin cos sin sin cossin cos cos cos sin sin

0 sin cos0 0 0 1

i i i i i

ii z z d x a x

i i i i i i i

i i i i i i i

i i i

A R Trans Trans R

aa

d

θ α

θ θ α θ α θθ θ α θ α θ

α α

− =

⎡ − ⎤⎢ ⎥− −⎢ ⎥=⎢ ⎥⎢ ⎥⎣ ⎦

(4.8.1)

Subsequently, by deriving mathematically or numerically the homogeneous

transformation by DH parameterization, we can finally obtain the global transformation

matrix at the end effector 0EEA as:

0 0 1 2 1 11 2 3 2........... EE EE

EE EE EEA A A A A A− −−= (4.8.2)

where 1iiA − is the transformation matrix as explained before and 1

EEEEA − − is the

transformation matrix of end effector (EE) reference frame w.r.t. its previous joint axis

frame (EE-1).

Once the transformation matrix 0EEA is obtained, we can find its differentiation w.r.t time

symbolically and use that to compute the twist matrix 0EET :

( )

. 1

0 0 0.EE EE EET A A−⎛ ⎞

= ⎜ ⎟⎝ ⎠ (4.8.3)

This twist matrix actually comprises of angular velocity matrix 0

0EE⎡ ⎤Ω⎣ ⎦ as well as the

translational velocity components 0

0EEV⎡ ⎤⎣ ⎦ in the base reference frame and can be

extracted as below:

Page 91: By - Automation, Robotics, & Mechatronics Laboratory

64

( )0 00 0 0

00 0

EE EEEE VT

⎡ ⎤⎡ ⎤ ⎡ ⎤Ω⎣ ⎦ ⎣ ⎦⎢ ⎥=⎢ ⎥⎣ ⎦

(4.8.4)

Where,

03 2

0

0 3 1

2 1

00

0

EE

ω ωω ωω ω

−⎡ ⎤⎢ ⎥⎡ ⎤Ω = −⎣ ⎦ ⎢ ⎥⎢ ⎥−⎣ ⎦

and 0 0

0 ,0 ,0 ,0[ , , ]EE EE EE EE Tx y zV V V V⎡ ⎤ =⎣ ⎦

DH Parametric table for the R-U-S and P-U-S configuration is given below:

Table 4-1 DH Parameterization of R-U-S Manipulator

link length(ai) link twist(αi) link offset(di) joint angle (θi) 1 l1 0 0 1θ 2 0 90 0 2θ 3 l2 0 0 3θ 4 0 90 0 4θ 5 0 90 0 5θ 6 l3 0 d6 6θ

Table 4-2 DH Parameterization of P-U-S Manipulator

link length(ai) link twist(αi) link offset(di) joint angle (θi)

1 0 0 di 0

2 0 90 0 2θ

3 l2 0 0 3θ

4 0 90 0 4θ

5 0 90 0 5θ

6 l3 0 d6 6θ

Page 92: By - Automation, Robotics, & Mechatronics Laboratory

65

4.9. P-U-S Manipulator Parametric Study

We will see from the workspace analysis of P-U-S manipulator that it is capable of

tracking the jaw motion trajectories. Before building the physical prototype, we need to

estimate the maximum limits on workspace, velocities as well as forces in these

manipulators, especially to obtain the geometrical and actuator specifications of the

system. For this purpose, we proceed with a top down approach by which we derive the

equations for the maximum reachable workspace, speed as well as end effector force

given the leg lengths, force and travel and sizes of the base plate and top plate.

We use the following nomenclature in the subsequent derivations:

Table 4-3 List of Parameters

Geometric Parameters

r Base platform radius, m

R Top platform radius, m

l Length of each leg, m

Actuator Parameters

q0 Nominal length of the linear actuator, m

Tq0 Travel of linear actuator on either side (+/ -), m

Vq0 Maximum actuator speed, m/s

Fq Actuator maximum force, Newton

4.9.1. Maximum Reachable Workspace, Velocity and Force This can be obtained by assuming the initial configuration of the manipulator when the

actuators are at q0-Tq0 position and are free to travel to other extreme position q0+Tq0 as

in the following figure.

Page 93: By - Automation, Robotics, & Mechatronics Laboratory

66

Figure 4-6: Top view of base platform Figure 4-7: Front view of the manipulator at the two extreme positions to find Pz

From the figure, it is clear that as the actuator 1 and 2 travel between two extreme

positions, the workspace covered by end effector frame in X and Y axes can be given as,

02x yP P Tq= = (4.9.1)

Similarly, due to the travel of the actuator between two extreme positions, we get the

maximum reachable workspace in the Z direction as,

2 2 2 20 1 0 2 0 0 0 0( ) ( )zP A A A A l q Tq l q Tq→ →

= − = − − − − + (4.9.2)

2 2 2 20 1 0 2 0 0 0 0( ) ( )zP A A A A l q Tq l q Tq→ →

= − = − − − − + (4.9.3)

The maximum attainable orientation- roll, pitch, yaw of the platform can be

geometrically obtained as

1tan zroll pitch yaw

Pr

θ θ θ − ⎛ ⎞= = = ⎜ ⎟⎝ ⎠

(4.9.4)

We can also determine the maximum reachable speed in translational X, Y and Z

directions simply as follows:

Page 94: By - Automation, Robotics, & Mechatronics Laboratory

67

0x yV V Vq= = (4.9.5)

00 2 2

0

zqV Vq

l q

⎛ ⎞⎜ ⎟=⎜ ⎟−⎝ ⎠

(4.9.6)

Since we know that linear velocities are related to angular velocity as V rω= , we obtain

roll, pitch and yaw velocities as,

0roll pitch yaw

Vqr

ω ω ω= = = (4.9.7)

Figure 4-8: Top view of the base platform with the linear actuators – FBD to calculate maximum

workspace forces and torques

To calculate the maximum forces, we draw a FBD of the base platform along with the

actuators. From the figure, we can identify the lines of action of actuator forces along the

linear actuators’ axes. Resolving the forces in the X and Y direction, we find the

maximum possible forces in the X and Y directions as,

( )

( )4 cos / 6

2 4 sin / 6x q

y q q

F F pi

F F F pi

=

= + (4.9.8)

To determine the maximum exertable force in the Z- direction, a three-dimensional FBD

is used to determine the orientation of the force vector along the leg, Fi.

( ), cosz i iF F φ= (4.9.9)

Page 95: By - Automation, Robotics, & Mechatronics Laboratory

68

where φ is defined as the angle between the leg vector and the position vector of Ai,0

which is given as,

Figure 4-9: Front and side view of the manipulator with the linear actuators – FBD to calculate maximum workspace forces and torques

( ) 1

1 1

sin sini i

R r R r

P A P Aφ φ −

→ →

⎛ ⎞ ⎛ ⎞⎜ ⎟ ⎜ ⎟− −⎜ ⎟ ⎜ ⎟= ⇒ =⎜ ⎟ ⎜ ⎟⎜ ⎟ ⎜ ⎟⎝ ⎠ ⎝ ⎠

(4.9.10)

Substituting (4.9.9) in (4.9.10), we get

( ) 1,

1

cos cos sinz i i i

i

R rF F FP A

φ −→

⎛ ⎞⎛ ⎞⎜ ⎟⎜ ⎟−⎜ ⎟⎜ ⎟= =⎜ ⎟⎜ ⎟

⎜ ⎟⎜ ⎟⎝ ⎠⎝ ⎠

(4.9.11)

We can now find the relationship between Fi and Fq based on the simple trigonometric

relationship as,

( ) ( )tan tanii

F F FqFq

θ θ= ⇒ = (4.9.12),

where θ can be obtained as,

Page 96: By - Automation, Robotics, & Mechatronics Laboratory

69

2 2

01

0

tanl q

qθ −

⎛ ⎞−⎜ ⎟=⎜ ⎟⎝ ⎠

(4.9.13)

Substituting equation (4.9.13) in(4.9.11), we get

( )1,

1

cos sin tanz i q

i

R rF FP A

θ−→

⎛ ⎞⎛ ⎞⎜ ⎟⎜ ⎟−⎜ ⎟⎜ ⎟=⎜ ⎟⎜ ⎟

⎜ ⎟⎜ ⎟⎝ ⎠⎝ ⎠

(4.9.14)

Hence, the maximum exertable force in the Z direction by all the legs will be summation

of the equation (4.9.14) for i=1 to 6,

( ) ( )6

, ,1

6 6 cos tanz z i z i qi

F F F F φ θ=

= = =∑ (4.9.15)

( )2 cos / 63roll zF r piτ = (4.9.16)

( )1 2 sin / 63 3pitch z zF r F r piτ = + (4.9.17)

6yaw qF rτ = (4.9.18)

Thus, we have derived all the equations to obtain maximum reachable workspace, speeds

as well as forces w.r.t. the base reference frame axes and expressed them in terms of

geometrical and actuator parameters. The setup now is ideal to conduct a series of

parametric studies to determine the optimum values for these undecided parameters that

would satisfy our application requirements which will be dealt in detail in Section 5.

4.10. Jacobian-Based Performance Measures (JBPM)

As noted from above equations, the Jacobian matrix offers a configuration dependent

linear relationship between the joint and task space velocities. This matrix has played an

important role in developing metrics for evaluating and characterizing the performance of

robotic systems. Such Jacobian-Based Performance Measures (JBPM), including

Page 97: By - Automation, Robotics, & Mechatronics Laboratory

70

manipulability, isotropy index, condition number, dexterity and singularity, have been

employed in many robotic applications. By quantitatively evaluating the qualitative

characteristics, such measures play a critical role in design, evaluation and optimization

of a robotic system.

In this thesis, we mainly utilize the manipulability measures to evaluate the performances

of our systems. Manipulability is defined as the measure of the flexibility of the

manipulator to transmit the end-effector motion in response to a unit norm motion of the

rates of the active joints in the system. We will briefly review some of the literature

pertaining to the research on manipulability.

4.10.1. SVD and Manipulability ellipsoid

The Singular Value Decomposition (SVD) of the Jacobian matrix and its geometric

relationship offer further insights in characterizing the “manipulability” of a manipulator.

We here briefly summarized the major mathematical and geometrical aspects that are

relevant to our work, and interested readers are referred to Nakamura [60] for more

details.

Consider an m×n Jacobian matrix PJ , it can always be transformed into the form of

m mI

TP

T T

J U V

with U U UU ×

= ∑

= = (4.10.1)

and T Tn nV V VV I ×= = (4.10.2)

Figure 4-10: Manipulability ellipsoid: mapping joint space velocities (hyper sphere) to task space

velocities (hyper ellipsoid) (Manipulability Index [61])

Page 98: By - Automation, Robotics, & Mechatronics Laboratory

71

and Σ is an m×n matrix with singular values σi’s on the diagonal, where

1 1

1 2 3

... 0 0 ... 0........

m n k

k

diag σ σ σσ σ σ σ

×∑ =

≥ ≥ ≥ (4.10.3)

The rank of PJ is k, and k ≤ min (m, n)

The columns of U are the ortho-normal eigenvectors of TP PJ J , while the columns of V

are the ortho-normal eigenvectors of TP PJ J . In this thesis, we employ the svd command

in MATLAB for our computation.

4.10.2. Yoshikawa Measure

The manipulability is defined in Yoshikawa [62]

( ) det( )Ty P P PJ J JΓ = (4.10.4)

In the context of SVD, if

T TPJ U V= ∑ (4.10.5)

Since U and V are ortho-normal, det (U) =det (V) =+1, we can simplify equation

(4.10.4) to

det( )TyΓ = ∑∑ (4.10.6)

1 2. ...........Y Kσ σ σΓ = (4.10.7)

Hence, the measures is nothing more than the product of all the singular values of PJ

1 2. ...........Y Kσ σ σΓ = (4.10.8)

Geometrically, such product is directly proportional to the volume VE of the

manipulability ellipsoid

Page 99: By - Automation, Robotics, & Mechatronics Laboratory

72

/ 2

(1 / 2)

k

E yVk

π= ΓΓ +

(4.10.9)

where [ ]yΓ i is the gamma function. The proportional coefficient is constant and depends

only on the rank of PJ , k.

4.10.3. Condition Number

Salisbury and Craig [63] define the manipulability to evaluate the workspace quality by

utilizing the condition number of PJ , which is given by

1( )CN Pk

J σσ

Γ = (4.10.10)

where σ1 and σk are the minimum and maximum singular values of JP, and 1 1 ,σ λ=

k kσ λ= and λ1 and λk are the minimum and maximum of the eigenvalues of TP PJ J ,

respectively.

Geometrically, it is the ratio of the length of the semi-major axis to the length of the

semi-minor axis of the manipulability ellipsoid. Such measure has a lower bound of 1,

but it grows out of bound and tends to infinity when the manipulator is near the singular

configuration. The reader is referred to Section 4.9 in [37] for more mathematical

treatment on this topic.

4.10.4. Isotropy Index

Zanganeh and Angeles [64] define the manipulability measures by the reciprocal of the

condition number of JP, which is given by

1( )Ty P

k

J σσ

Γ = (4.10.11)

Geometrically, it is the ratio of the length of the semi- minor axis to the length of the

major axis of the manipulability ellipsoid. Such a measure is better behaved compared

with the condition number, since the values remain bounded between 0 and 1.

Page 100: By - Automation, Robotics, & Mechatronics Laboratory

73

4.11.1. Transformation Matrix between MoCap coordinates and Platform coordinates

The 3D coordinates of the three points of the mandible (left TMJ, right TMJ and incisor

tooth tip) obtained from motion capture system defined with respect to its own global

reference frame (reference frame of the calibration grid used for motion capture

experiments) should be transformed to the base reference frame of the platform. The

transformed coordinates will be used as kinematic motion trajectories to drive the end-

effector platform in the final simulation.

Figure 4-11: Plane of Jaw Motion Measured using MoCap System with marker positions identified

Let 1v→

and 2v→

be any two vectors along the plane containing the points— left TMJ, right

TMJ and incisor tooth tip defined in the reference frame of the calibration grid (A0) as

shown in the figure. We define the unit vectors along the triad attached with the incisor

tooth tip as follows

1 23

1 2

v vev v

→ →→

→ →

×=

× (4.11.1)

Page 101: By - Automation, Robotics, & Mechatronics Laboratory

74

2 3 1

1 1 2 3 1 2 3

| | | | | |

, ,| | | | | |

e

e

e

e e e

xe e e e y where R e e e

z

→ → →

→ → → → → → →

= ×

⎡ ⎤ ⎡ ⎤⎡ ⎤⎢ ⎥ ⎢ ⎥⎢ ⎥⎢ ⎥ ⎢ ⎥= =⎢ ⎥⎢ ⎥ ⎢ ⎥⎢ ⎥⎣ ⎦⎢ ⎥ ⎢ ⎥⎣ ⎦ ⎣ ⎦

(4.11.2)

1 2 3 1 2 3

| | | | | |

, ,| | | | | |

e

O e

e

xX e e e y where R e e e

z

→ → → → → → →

⎡ ⎤ ⎡ ⎤⎡ ⎤⎢ ⎥ ⎢ ⎥⎢ ⎥⎢ ⎥ ⎢ ⎥= =⎢ ⎥⎢ ⎥ ⎢ ⎥⎢ ⎥⎣ ⎦⎢ ⎥ ⎢ ⎥⎣ ⎦ ⎣ ⎦

(4.11.3)

where T- transformation matrix of the jaw reference frame with respect to the motion

capture reference frame,

1

2

3

| | || || | |0 0 0 1

dR d

Td

⎡ ⎤⎢ ⎥⎢ ⎥=⎢ ⎥⎢ ⎥⎣ ⎦ (4.11.4)

Let A(0) be the transformation matrix of the initial jaw reference frame to the origin

reference frame A0 and A(t) be the transformation matrix of the moving jaw reference

frame with time to the origin reference frame, A0. Using these relationship, we can

obtain the jaw motion trajectories w.r.t the A(0) reference frame as:

1( ) (0) ( ) ( )Pr eA t A A t X t−= = (4.11.5)

where, Ar(t) is the relative jaw motion defined w.r.t the initial frame A(0).

MoCap transformation Platform Transformation

Figure 4-12: Transformation between MoCap and Platform Reference Frames

Page 102: By - Automation, Robotics, & Mechatronics Laboratory

75

This Ar(t) is equivalent to the relative jaw motion trajectory defined in the platform frame

P which can be converted to the global reference frame B.

For the platform, we can find the global transformation matrix B0 that relates the base

frame B to P based on the end effector position and orientation using the equation

(4.11.4) discussed before in Sec. 7.3.

0

0, 00

0

| | || || | |0 0 0 1

PE

P PB E

PE

xR y

Bz

⎡ ⎤⎢ ⎥⎢ ⎥=⎢ ⎥⎢ ⎥⎣ ⎦

(4.11.6)

So using this matrix, we can define the global motion trajectories of the platform using

(4.11.6) and (4.11.5) as,

0( ) ( )BP rX t B A t= (4.11.7)

which can be used to drive the platform in global frame B,

0, 0 0 0

PTP P P

E E E EX x y z→

⎡ ⎤= ⎣ ⎦

Page 103: By - Automation, Robotics, & Mechatronics Laboratory

76

5. Technological Tools

5.1. CT-Scan to CAD Conversion

CT scans of the mandible and skull of labrador dog were obtained from the vendor which

is used to build 3D CAD models in STL format using Mimics software. The STL

conversion process includes the following steps, which can now be used in the CAD

model as well as musculoskeletal models. The original specimens of skull and mandible

are shown in Figure 5-1.

Dorsal view Postero-Lateral View Ventral View

Figure 5-1: Different Views of Labrador Specimen

The CT scans of the Labrador’s skull and mandible are first imported into a project in

Mimics to start the conversion process. Each of the CT scan slices must occupy same

memory in the disk to proceed with the 3D data calculation. Once the slices are imported,

we need to enter the slice thickness and pixels information for accurate conversion.

Figure 5-2:CT Scanned Images Import and Pixels Information Dialog

Page 104: By - Automation, Robotics, & Mechatronics Laboratory

77

The pixels and image information is normally provided by the vendor. The following

table shows the CT scanned image information. These values must be entered in the

pixels and images information dialog.

Table 5-1 CT Scan Images Information

File Output Type 16bit: 1024x1024 16-bit TIFF images

Slice Thickness 0.25 mm

Slice Spacing 0.2 mm

Total number of slices 746

The slices will be seen in the three orthographic projection views and proper

nomenclature must be assigned to each of these (anterior-posterior, left- right and top-

bottom) before proceeding further. Then, we need to properly segment the sliced images

with an appropriate threshold value. The segmented image at one specific slice is shown

in the Figure 5-4.

Segmented CT slice 3D Calculate Dialog

Figure 5-4: Segmentation and 3D Calculation

Figure 5-3: Segmentation Options

Page 105: By - Automation, Robotics, & Mechatronics Laboratory

78

Figure 5-5: STL file of CT scans

Next, the 3D mesh surfaces are calculated using the 3D Calculate option. Finally, we

obtain a 3D cad model of the Labrador skull, which will be used in musculoskeletal and

virtual analyses.

5.2. SimiMotion MoCap Station

5.2.1. Workflow for Motion Capture using SimiMotion system: Specification: The markers are selected based on the analysis from pre-defined skeleton

landmarks or user-defined points or imported marker sets from previous projects or from

a template file. The number of markers is decided based on the degrees of freedom of the

subject under study. In our case, we are interested in determining 3D coordinates of jaw

motion. As explained before, the jaw model has six motion-DOFs and hence in our

model, we use three markers (reflective type) to accurately determine the positions and

orientations of the jaw in the global x-, y- and z- axes respectively. The three markers are

attached to the left TMJ, right TMJ and frontal point of the chin.

The main idea of using three markers for this study is that determining the coordinates of

three points in jaw allows us to not only define the exact position of the incisor tooth tip

(which in our case is the frontal point of chin) but also calculate the orientation of the

plane. Another reason is that we would like to use minimum number of markers making

it convenient to conduct the motion analysis especially on animals.

Page 106: By - Automation, Robotics, & Mechatronics Laboratory

79

Figure 5-6: Digitizing the Human Jaw Movement Figure 5-7: Digitizing the Dog Jaw Movement

Camera-setup: The number and the position of the cameras are determined based on the

testing requirements. For 2D analyzes, at least one camera is required and for 3D at least

two cameras are required. However, most 3D movements require three or more cameras

to avoid occlusion.

Figure 5-8: Typical Camera Setup for 2D Motion Capture Analysis

Calibration: It is the process of capturing a known calibrated object (e.g. a cube for 3D).

This is generally used to define the value of one unit distance that which the software can

use to quantify the positions in the camera views. This way, the system can reconstruct

the position and settings of your cameras. In addition, the calibration can be checked for

accuracy and validated for further applications.

Page 107: By - Automation, Robotics, & Mechatronics Laboratory

80

Figure 5-9: Calibration of MoCap Region- Camera1

Figure 5-10: Calibration of MoCap Region- Camera2

Video capturing and analog data acquisition: With cameras positioned to cover the

whole motion of the test subject, it is synchronized using firewire ports at maximum rate

of 100 Hz. The capture process is initiated by an analog signal (e.g. touching a force plate

or triggering a light barrier) using a pulsed trigger. Once recorded, SimiMotion provides

tools to crop and save the video clips of all cameras in a single step. Other methods of

achieving synchronization are already explained in Literature Survey section of this

thesis.

Tracking / digitization: The markers are then digitized in each frame of the video by

manually selecting in first few frames. Afterwards, using the automatic tracking

algorithm will be used to identify white and colored markers automatically and the

system will be able to track the markers for remaining frames. To overcome problems of

marker occlusion or falling down of makers from skin, the pattern-matching algorithm

for markerless tracking or manual tracking option in SimiMotion is used. A typical

scenario of such an occurrence is shown in the figure below.

Page 108: By - Automation, Robotics, & Mechatronics Laboratory

81

Figure 5-11: Marker Occlusion Problems in Animals

Reconstruction of 2D or 3D coordinates: Once completing the 2D tracking for all

frames in all the cameras, 3D coordinates of the markers can be calculated. This can be

followed by a post-processing step to smoothen out the disturbances using filter and

interpolation settings from your raw data.

Figure 5-12: Digitization of the sequence of frames and automatic tracking of 2D coordinates-

Camera1 and 2

Analysis/ Visualization: From the calculated 3D coordinates (post-processed data), other

geometrical parameters like angles, distances and centers of mass can be determined. We

can also use arithmetic, trigonometric and a rich set of other functions (integration,

Page 109: By - Automation, Robotics, & Mechatronics Laboratory

82

frequency analysis, transformations etc.) to get further information. For visualization

purposes, SimiMotion provides diagrams, stick figures and virtual reality representations.

Figure 5-13: 3D Data Calculation and Stick Diagram Representation of Jaw for Cameras 1 and 2

5.2.2. Experimental Setup

To conduct motion capture on animals an experimental setup is required that not only

restricts the motion of animals to track the markers accurately but also to ensure the

safety of the equipments involved. For this purpose, we used the standard sized cage with

nearly double the maximum volume estimate of a dog. All the subject studies presented

here are conducted only after explanation of all the procedures involved in the motion

capture to the owners concerned and providing the training to the subject for feeding

inside the cage for a certain period.

Page 110: By - Automation, Robotics, & Mechatronics Laboratory

83

The experimental setup used for carrying out the motion studies is shown below. As the

analysis is three dimensional, we used three cameras with appropriate lighting struts for

illumination.

Figure 5-14: Experimental Setup for Animal Motion Capture with Cameras

Figure 5-15: MoCap Workstation and Camera Setup for Animal Subjects

5.3. Inverse Dynamics Analysis of Musculoskeletal Models

5.3.1. Human Jaw Model (Mark de Zee Model) The jaw model developed by Zee, Dalstraet al. [65] contained two rigid bodies, the skull

and the mandible. Mass and mass moments of inertia of the mandible are based on the

work of Koolstra and Van Eijden (2005) and are listed in Table 1.

Page 111: By - Automation, Robotics, & Mechatronics Laboratory

84

Figure 5-16: Muscle Actuators of a Jaw Model Figure 5-17: Lateral View of the Mark de Zee Human Jaw Model

In this model, the mandibular fossa was modeled as a planar constraint, which was angled

30° downwards relative to the occlusal plane and canted 5° medially (Langenbach and

Hannam, 1999). Each TMJ had, therefore, the possibility to rotate in all three dimensions

and to translate in the specified plane (i.e. five degrees-of freedom). This resulted in a

mandible with four degrees of freedom. In reality, the condyles move between the

articular discs and TMJ is not constrained to move in a plane. However, this assumption

proved to be satisfactory for normal clenching and chewing jaw motions in humans and

in effect can be extended to animals.

Mass: 0.44 Kg

Ixx: 0.00086 kg m2

Iyy: 0.00029 kg m2

Izz: 0.00061 kg m2

Figure 5-18: Lower Mandible with the muscles attached used in Mark de Zee Model and Structural Properties

This model included 24 muscle-tendon units as discussed before that include— masseter

(superficial, deep anterior and posterior), temporalis (anterior and posterior), medial

pterygoid, lateral pterygoid (superior and inferior), anterior digastric, geniohyoid,

mylohyoid (anterior and posterior) on each side. The muscle model parameters for the

Page 112: By - Automation, Robotics, & Mechatronics Laboratory

85

model was obtained as reported in Zee, Dalstraet al. [65]. The muscle cross sectional area

and hence, their maximal forces can be obtained from the slices of CT scans available

online (http://vhp.med.umich.edu/HeadNeck.html).

Table 5-2: Muscle Model Parameters [Koolstra, 2002]

Muscles Max Force (N)

Muscle-length (mm)

CE length (mm)

SE length (mm)

Masseter 272.8 48 22.6 25.8

Anterior Temporalis 308 57.4 30.7 24.2

Temporalis 222 62.9 31.3 28.8

Posterior Temporalis 250 60.0 30.5 27

Medial Pterygoid 240 43.3 14.1 27.6

Lateral Pterygoid 112 27.2 22.3 9

Digastrics 46.4 51.9 42.6 3

There are also certain limitations that persist in this model. In reality, the TMJ condyles

are not constrained to move in a plane but in curvilinear paths. In addition, the model

does not take into account of ligaments, which play a major role only near the joint limits.

As long as, the jaw motion that we try to simulate do not necessitate the actuation near

the joint limits, ligaments and their contribution to joint forces can be ignored safely. We

ultimately would like to simulate this model for even abnormal chewing trajectories.

However, presently we use the MoCap data obtained by motion capture of a human

subject to drive the musculoskeletal jaw model as illustrated in the previous chapter.

5.3.2. Human Jaw Model (14 Muscle Actuator Model) We recreated the human jaw model with only those musculotendon actuators that connect

the head and skull and ignored the geniohyoid and mylohyoid muscles that connect the

mandible from the neck region to reduce the complexity as well as limit our study to

these muscles alone. Hence the simplified version of our model comprises of 14

musculotendon actuators— temporalis (anterior, medial and posterior), masseter,

digastric, medial and lateral pterygoid on each side. We implemented a TMJ model

similar to the one explained in Mark de Zee model. The insertion and origin points of the

model were obtained by approximate measurements made on a human skull and

mandible specimen and locations of the muscle attachment sites.

Page 113: By - Automation, Robotics, & Mechatronics Laboratory

86

The muscle model parameters and insertion and origin points that we used are given in

the table below:

Table 5-3: Muscle Fiber Length, Insertion and Origin Points of Human Jaw Model

Muscles Insertion Origin

Masseter 35.0,-49.0,-49.0 37.9,-52.3,20.0

Anterior Temporalis 36.0,-42.0,-6.0 -20.0,-50.0,67.0

Temporalis 36.0,-42.0,-6.0 -38.0,-60.0,45.0

Posterior Temporalis 36.0,-42.0,-6.0 -43.0,-70.0,0.0

Medial Pterygoid 25,-50,-3 30.0,-22.0,-19.0

Lateral Pterygoid 20.0,-50,-5.0 37.0,-18.0,-25.0

Digastric 85.0,-7.0,-84.0 -20.0,-50.0,-20.0

In our case, the tendon lengths were assumed to be around 4-5% of the overall

fiber length and calibrated for accurate results within AnyBody at one of the extreme

positions obtained from jaw trajectory data. We also tried to incorporate the wing shaped

temporalis muscle by approximating it to a three muscle-tendon units with varying lines

of action as shown in figure.

Figure 5-19: Temporalis Muscle Model (Green

Colored Muscle Tendon Units) Green: Temporalis (3 muscle-tendon units)

Blue: Medial Pterygoid, Grey: Lateral Pterygoid Red: Masseter, Pink: Digastric

Figure 5-20: Aerial View of Mandible with Different Muscle Groups

Green: Temporalis (3 muscle-tendon units) Blue: Medial Pterygoid, Grey: Lateral Pterygoid

Red: Masseter, Pink: Digastric

The jaw model was simulated for two different muscle models- simple muscle model and

Hill type muscle model (passive and active elements). A brief comparative study of these

two models for both the cases will be presented below mainly based on the muscle

Page 114: By - Automation, Robotics, & Mechatronics Laboratory

87

activities and forces are given below. To simulate the bite forces without any

measurements, we introduce a constant bite force and time varying bite force at the

incisor tooth tip and studied the increase in muscle forces.

5.3.3. Labrador Jaw Model A labrador dog jaw model was developed to realize our ultimate goal of

masticatory study in animals. The TMJ model was adopted from the human jaw studies

and applied to the labrador model. The STL file for visualization was obtained as

explained in the first section of this chapter.

Muscle Nomenclature: Green: Temporalis, Red: Masseter, Blue- Lateral Pterygoid White: Medial Pterygoid, Pink: Anterior Digastric

Figure 5-21: Side and Top view of Musculoskeletal Jaw Model of Labrador Dog

As before, the muscle insertion and origin points were measured on a real

specimen of labrador skull and mandible. The muscle model parameters implemented for

this case study is shown below in the table as well as other geometric parameters. Some

of these muscle model parameters are obtained by conducting the dissection experiment

on the real animal cadaver. The following section discusses the dissection experiments in

detail.

Table 5-4: Muscle Mass based on Turnbull [66]

Subject Masseter Anterior Temporalis0

Temporalis Posterior Temporalis

Medial Pterygoid

Lateral Pterygoid

Digastrics

Canine 20% 20% 20% 20% 4% 6% 10 %

Muscle Mass (gm)

40.185

40.185

40.185

40.185

8.307

12.056

21.7

Page 115: By - Automation, Robotics, & Mechatronics Laboratory

88

Real Animal Cadaver Dissection Experiment

The dissection experiment was conducted on the cadaver of the dog subject that has been

kept under the care of Laboratory Animal Facilities department, UB South Campus.

Proper approval forms were filed prior to performing dissection on the cadaver (dog)

under the supervision of Dr. Frank Mendel, Associate Professor in Pathology and

Anatomical Sciences. At the end of this cadaver study, we were able to visually study the

muscle architecture in the real musculoskeletal system, layer by layer attachments of

muscles, region of muscle attachments sites as well as we were able to determine the

muscle model parameters required to build our model, especially length of muscle fibers

and physiological cross section area. Also, to some extent, the approximate lines of action

of muscle forces could also be evaluated.

Figure 5-22: Measurement of fiber length for Masseter muscle

Figure 5-23: Digastric Muscle (Jaw opener)- dissected out of the jaw

This study also helped understand the level of approximations of our musculoskeletal

model. In reality, the jaw comprises of nearly 5-6 layers of muscles of each type

separated by cleavage planes that act independently at certain range of motion of the

joint. For example in Figure 5-22 , the masseter muscle comprised of 6 layers which in

effect act as each independent actuator to the TMJ joint and consequently the overall jaw

motion. But only one or utmost a few of these single muscle layer units are active during

a certain part of the cycle and the active layer switches from one to another (above or

below) based on the current joint position. The sequence of their actuation is in effect

controlled by the central nervous system- a complicated control system by itself. Hence

the real musculoskeletal jaw comprises of the large number of muscle layers which act

independently but not simultaneously, thereby increasing the complexity of the modeling

Page 116: By - Automation, Robotics, & Mechatronics Laboratory

89

techniques involved. However, in our model we use only one muscle fiber for the

masseter. Though using such a model enabled us to achieve comparable results with the

previous studies by Mark de Zee.

To better model the muscle parameters, we used the equation in (3.1.1)

Table 5-5: Muscle Model Parameters [Koolstra, 2002]

Muscles Max Force (N)

Muscle-length (mm)

CE length (mm)

SE length (mm)

Masseter 272.8 48 0.066 0.0033

Anterior Temporalis 308 57.4 0.035 0.00175

Temporalis 222 62.9 0.06 0.0030

Posterior Temporalis 250 60.0 0.065 0.00325

Medial Pterygoid 240 43.3 0.1 0.005

Lateral Pterygoid 112 27.2 .072 0.00360

Digastrics 46.4 51.9 0.185 0.00925

We also estimated the physiological cross sectional area property for all the muscles

based on the relative weights estimation in Horsman, Koopmanet al. [67]. To estimate the

mass of all the muscles, the anterior digastrics muscle was separated from the cadaver

and its wet mass was measured. Using the relative weights scaling given in Turnbull [66]

the mass of all other masticatory muscles were determined and provided the base to build

a more realistic model of the canine jaw.

Table 5-6: Muscle Fiber Length, Insertion and Origin Points of Labrador Jaw Model

Muscles Insertion Origin

Masseter 35.0,-50.0,-20.0 40,-65,30.0

Anterior Temporalis 25.0,-42.0,45.0 15.0,-25.0,65.0

Temporalis 25.0,-42.0,45.0 -20.0,-25.0,50.0

Posterior Temporalis 25.0,-42.0,45.0 -40.0,-25.0,35.0

Medial Pterygoid 0.0,-40.0,-35.0 37.0,-15.0,26.0

Lateral Pterygoid 0.0,-25,0.0 24.0,-10.0,0.0

Anterior Digastrics 155.0,-5.0,-5.0 -40.0,-20.0,-0.0

Page 117: By - Automation, Robotics, & Mechatronics Laboratory

90

In our model, we also simulate the biting force of the incisor by artificially introducing a

force vector at the tip- a constant force vector and a more realistic bite force model.

These bite force simulations can be considered similar to the real subjects chewing foods

of different texture and hardness. Hence, the importance of realistic modeling of bite

force is realized but it is left as a part of the future work. One such example can be found

as a part of Mark de Zee model. Other possibilities in this direction can be conducting

real subjects testing with implant force transducers in the incisor tooth tip to allow

accurate measurement of the biting forces, which can now be transferred to AnyBody as

a force and trajectory tracking optimization problem.

Page 118: By - Automation, Robotics, & Mechatronics Laboratory

91

6. Musculoskeletal Modeling Simulation and Results

6.1. Work envelope study using Posselt diagram 6.1.1. Human Jaw Model

In order to develop a dental simulator, it is significant to study the motion ranges

of the jaw in all the above cases. Since we are driving these models using motion capture

data, we conduct some preliminary analyzes on those trajectories first.

As discussed before about the Posselt diagram, we plot the path of incisor tooth tip in

sagittal, transverse as well as coronal plane. Thus, we will obtain 2D graphs of the work

envelope for the jaw motion case studies, which should be comparable with the Posselt

diagram. By this way, we can not only validate the accuracy of the jaw model but also

use that result while charting out the specifications for the parallel manipulator.

Figure 6-1: X and Z coordinates forming a Posselt Envelope in Sagittal Plane- Human Jaw

Figure 6-2: X and Y coordinates forming a Posselt Envelope in Transverse Plane- Human

Jaw

Other than the actuator forces and workspace envelope, it is also necessary to

have a quantitative estimate of jaw motion velocity and acceleration in each direction—

X, Y and Z. For this purpose, we will again monitor the incisor tooth tip point and

graphically obtain the motion rates using AnyBody plot tools as below.

From the graph (Figure 6-3), we see that velocity of the human jaw case study is about 4-

5 mm/s and acceleration is about 5 mm/s2. This value however, is obtained for normal

chewing action in humans. In order to build a generic simulator, we need to have similar

estimates for jaw models of different vertebrates performing under varying conditions.

However, we do not concentrate on such detailed studies in this thesis.

Page 119: By - Automation, Robotics, & Mechatronics Laboratory

92

To provide motivation for such a study in future, we will next analyze the jaw

model of the labrador and study its work envelope. It should be noted that Posselt

diagram is generally studied in case of human models only.

Figure 6-3: Velocity trajectory of incisor tooth tip point for Human Jaw

Figure 6-4: Acceleration trajectory of incisor tooth tip point for Human Jaw

6.1.2. Labrador Jaw Model We see that Posselt diagram for Labrador jaw model in sagittal plane as well as in

transverse plane as in Figure 6-6 and Figure 6-5. it can seen that the velocities and

accelerations of the jaw motion in both the cases- human jaw as well labrador jaw model

is less and hence these are not considered to be an important design variable for our study

in building the simulator.

Figure 6-5: X and Z coordinates forming a Posselt Envelope in Sagittal Plane- Labrador Jaw

Figure 6-6: X and Z coordinates forming a Posselt Envelope in transverse plane- Labrador

Jaw

Page 120: By - Automation, Robotics, & Mechatronics Laboratory

93

Figure 6-7: Velocity trajectory of incisor tooth tip point - Labrador Jaw

Figure 6-8: Acceleration trajectory of incisor tooth tip point - Labrador Jaw

6.2. Musculoskeletal Model Case Studies- Human Jaw We will discuss the parametric analysis of the musculoskeletal models and conduct a

series of studies based on the following figure. So to start with, we will first create a 3

temporalis muscle-tendon unit using Simple Muscle Model. We then proceed to do

systematic parametric studies as highlighted in the figure.

Case A.I.1: Simple Muscle Model, No bite force (free chewing motion)

Figure 6-9 (a)

Figure 6-10 (a)

Figure 6-9 (b)

Figure 6-10 (b)

Page 121: By - Automation, Robotics, & Mechatronics Laboratory

94

Figure 6-9 (c)

Figure 6-10 (c)

Figure 6-9: (a), (b) Elevator Muscle forces and activities (c) Muscle Lengths of RHS Muscles

Figure 6-10: (a), (b) Depressor Muscle forces and activities (c) Muscle Lengths of LHS

After carefully examining the muscle forces and actuators, we found the muscle

activities of 14 muscle model in case A.I is close to the Mark de Zee Model as forces

obtained in both these models are in the similar range. Therefore, we can conclude that

the jaw model built using 14-muscle actuator is a good approximation and gives a better

base to study the effects of only those muscles attached to the skull and mandible which

actually are major players in masticatory motion. Hence, we progress to implement a

series of studies based on type of subjects, bite force simulation and muscle models as

indicated in Figure 6-18.

Figure 6-11: Parametric Studies for Mastication Musculoskeletal Analysis

The bite forces will be exerted on the pre molar node on the right hand side of the

mandible. We will implement a constant bite force as well as a realistic bite force in a

negative z direction. By realistic bite force, we mean it is maximum at minimal gape and

Page 122: By - Automation, Robotics, & Mechatronics Laboratory

95

minimum at maximal gape. These bite forces in effect actually simulate the different food

textures and by accurate modeling of this for different food and chewing cycles, we will

be able to obtain the muscle force estimates in a real sense. Obtaining accurate models of

the bite forces will be a part of our future work.

Case A.I.2: Simple Muscle Model, Constant Bite Force (200 N in –z)

Figure 6-12 (a)

Figure 6-13 (a)

Figure 6-12 (b)

Figure 6-13 (b) Figure 6-12: (a), (b) Elevator Muscle forces and

activities for Case A.I.2 Figure 6-13: (a), (b) Depressor Muscle forces and

activities for Case A.I.2

Figure 6-14: TMJ Reaction forces for Case A.I.2

Page 123: By - Automation, Robotics, & Mechatronics Laboratory

96

Case A.I.3: Simple Muscle Model, Realistic Bite Force

Figure 6-15 (a)

Figure 6-16 (a)

Figure 6-15 (a)

Figure 6-16 (b)

Figure 6-15: (a), (b) Elevator Muscle forces and activities for Case A.I.3

Figure 6-16: (a), (b) Depressor Muscle forces and activities Case A.I.3

Figure 6-17 (a)

Figure 6-17 (b)

Figure 6-17: (a) TMJ Reaction forces (b) Simulated bite force for Case A.I.3

We see from the plots that most of the jaw opening action is performed by the pair

of digastric muscles and muscles effort for the jaw closing action is distributed between

the three temporalis units, medial pterygoid as well as the masseter. Also the model

response for the simulated chewing activities provided realistic muscle force and activity

Page 124: By - Automation, Robotics, & Mechatronics Laboratory

97

plots. From the cases Case A.I.1, Case A.I.2 and Case A.I.3 we notice that muscle forces

and activity levels have increased due to the biting force at the incisor tooth tip and more

realistic muscle forces can be realized in the later case using the Simple Muscle model.

The model response proved to be better for hill type muscle models compared to simple

muscle model.

Case A.II.1: Muscle Model 3E, No Bite Force (free chewing motion)

Figure 6-18 (a)

Figure 6-19 (a)

Figure 6-18 (a)

Figure 6-19 (b)

Figure 6-18: (a), (b) Elevator Muscle forces and activities (c) Muscle Lengths of RHS Muscles for

Case A.I.2

Figure 6-19: (a), (b) Depressor Muscle forces and activities (c) Muscle Lengths of LHS for

Case A.I.2

Using the Hill type muscle models for the human mastication models, provide a more

accurate way to model the passive elements especially tendons, ligaments etc. and

monitor the passive muscle forces to better understand the model response for jaw

trajectories.

Page 125: By - Automation, Robotics, & Mechatronics Laboratory

98

Case A.II.2: Muscle Model 3E, Constant Bite Force (100 N in –z)

Figure 6-20 (a)

Figure 6-21(a)

Figure 6-20 (b)

Figure 6-21(b)

Figure 6-20: (a), (b) Elevator Muscle forces and activities of RHS Muscles for Case A.I.2

Figure 6-21: (a), (b) Depressor Muscle forces and activities for Case A.I.2

Figure 6-22: TMJ Reaction forces Case A.II.3

Page 126: By - Automation, Robotics, & Mechatronics Laboratory

99

Case A.II.3: Muscle Model 3E, Realistic Bite Force

Figure 6-23 (a)

Figure 6-24(a)

Figure 6-23(b)

Figure 6-24(b)

Figure 6-23: (a), (b) Elevator Muscle forces and activities of RHS Muscles for Case A.I.3

Figure 6-24: (a), (b) Depressor Muscle forces and activities for Case A.I.3

Figure 6-25 (a)

Figure 6-25 (b)

Figure 6-25: (a) TMJ Reaction forces (b) Simulated bite force for Case A.II.3

Page 127: By - Automation, Robotics, & Mechatronics Laboratory

100

6.3. Musculoskeletal Model Case Studies- Labrador Dog

Case B. I. 1: Simple Muscle Model, no bite force (free chewing motion)

Figure 6-26 (a)

Figure 6-27 (a)

Figure 6-26 (b)

Figure 6-27 (b)

Figure 6-26 (c)

Figure 6-27 (c)

Figure 6-26: (a), (b) Elevator Muscle forces and activities (c) Muscle Lengths of RHS Muscles for

Case B.I.1

Figure 6-27: (a), (b) Depressor Muscle forces and activities (c) Muscle Lengths of LHS for Case B.I.1

Page 128: By - Automation, Robotics, & Mechatronics Laboratory

101

Case B.I.2: Temporalis Muscle Tendon Unit, Constant Bite Force The muscle behavior for labrador case did not vary considerably for Hill type

muscle model (Muscle model 3E in AnyBody) in our preliminary analyses and hence the

results for the first case only are shown below.

Figure 6-28 (a)

Figure 6-29 (a)

Figure 6-28 (b)

Figure 6-29 (b)

Figure 6-28: (a), (b) Elevator Muscle forces and activities of RHS Muscles for Case B.I.2

Figure 6-29: (a), (b) Depressor Muscle forces and activities for Case B.I.2

Figure 6-30: TMJ Reaction forces for Case B.I.2

Page 129: By - Automation, Robotics, & Mechatronics Laboratory

102

Case B.I.3: Temporalis Muscle Tendon Unit, Realistic Bite Force

Figure 6-31 (a)

Figure 6-32(a)

Figure 6-31 (b)

Figure 6-32 (b)

Figure 6-31: (a), (b) Elevator Muscle forces and activities of RHS Muscles for Case B.I.3

Figure 6-32: (a), (b) Depressor Muscle forces and activities for Case B.I.3

Figure 6-33 (a)

Figure 6-32 (b)

Figure 6-33: (a) TMJ Reaction forces (b) Simulated bite force for Case B.I.3

Similar to human jaw case, the muscle activities seem to increase proportional to

the bite forces exerted at the incisor tooth tip of the labrador jaw. Three cases are

implemented for labrador mastication model— no bite force, constant bite force and a

realistic bite force.

Page 130: By - Automation, Robotics, & Mechatronics Laboratory

103

7. Masticatory Simulator- Analysis and Results

7.1. Inverse Kinematics and Jacobian Based Workspace Analysis of 6-DOF R-U-S Manipulator

7.1.1. Inverse Kinematics Simulation The 6 DOF crank type parallel manipulator (otherwise known as 6 DOF R-U-S

manipulator) is not so widely used among the variants of the Stewart platform

manipulator. In this work however, we will concentrate on the implementation of inverse

kinematics for such manipulator. The inverse kinematics routine developed in MATLAB

is first tested against standard trajectories— point, line, circle and ellipse. After carrying

our the validation, the manipulator is driven using the kinematic jaw trajectories obtained

from MoCap system after carefully transforming the points to the platforms as explained

in the Sec. 4.11.1.

Case 1: Line and Curve Tracking:

Figure 7-1 (a)

Figure 7-2 (a)

Figure 7-1 (b)

Figure 7-2 (b)

Figure 7-1: R-U-S Manipulator Configuration for Validation Test: (a) Line along Z (b) 3D Sine

curve

Figure 7-2: R-U-S Joint trajectory for Validation Test: (a) Line along Z axis (b) 3D Sine curve

Page 131: By - Automation, Robotics, & Mechatronics Laboratory

104

Case 2: Circle and Ellipse Tracking

Figure 7-3(a)

Figure 7-4(a)

Figure 7-3(b)

Figure 7-4(b)

Figure 7-3 (c)

Figure 7-4(c)

Figure 7-3: R-U-S Manipulator Configuration for Validation Test: (a) Circle in YZ plane (b) Circle in

XY (c) Ellipse in XZ plane

Figure 7-4: R-U-S Joint trajectory for Validation Test: (a) Circle in YZ plane (b) Circle in XY (c)

Ellipse in XZ plane

7.2. Validation using Visual Nastran for R-U-S Case A similar system is also deployed in SolidWorks/ Visual Nastran framework for open

loop simulation of tracking desired jaw motion trajectories. We start with the sample case

studies before implementing the jaw motion trajectory.

Page 132: By - Automation, Robotics, & Mechatronics Laboratory

105

Case 1: Point

Figure 7-5:Point Tracking Simulation of R-U-S in

Visual Nastran Figure 7-6:Point Tracking Joint Angle

Trajectories from MATLAB Code

Case 2: Straight line

Figure 7-7: Line Tracking Simulation of R-U-S in

Visual Nastran Figure 7-8: Line Tracking Joint Angle

Trajectories from MATLAB Code

Case 3: Circle

Figure 7-9: Circle Tracking Simulation of R-U-S

in Visual Nastran Figure 7-10: Circle Tracking Joint Angle

Trajectories from MATLAB Code

Page 133: By - Automation, Robotics, & Mechatronics Laboratory

106

We were able to validate our mathematical model based on the joint trajectories’

plots obtained from visual Nastran with some angle offsets that was necessary to be given

for creating the CAD model.

7.3. Constant Orientation Workspace Analysis By constant orientation workspace, it is implied as a set of permissible positions

for the centre of the mobile platform while the platform is kept at a constant orientation,

normally at zero roll-pitch-yaw orientation. We will look at this type of workspace

analysis of the 6-DOF R-U-S manipulator. The workspace considered is the 3D

cylindrical space swept by the circle of maximum radius 0.06 m with center at origin (0,

0, 0) and height ranging from 0.20 to 0.45 m.

The jacobian analysis is performed for the following set of geometric parameters

and the jacobian-based measures of the manipulability of the 6-DOF manipulator are

determined namely the Yoshikawa Measure and Condition number. From the plots we

were able to verify that within the region considered the manipulator does not attain

singular configuration (i.e. jacobian matrix does not loose rank). It means that each

revolute joint is able to actuate independently and affect the each dof of the top platform.

Table 7-1: Manipulator Parameters for Set 1: (all linear dimensions in meters and angular dimensions in radians)

Base plate radius, l0 0.1 AB Link length, l1 0.1 BC Link length, l2 0.1693 Top plate radius, l3 0.1

Page 134: By - Automation, Robotics, & Mechatronics Laboratory

107

Figure 7-11 (a)

Figure 7-12(a)

Figure 7-11 (b)

Figure 7-12(b)

Figure 7-11 (c)

Figure 7-12(c)

Figure 7-11: (i), (ii), (iii): Condition number based measure of manipulability plotted along the

vertical z-axis for every point in the 2D circular region: 0<r<0.06 at z=0.20 plane

Figure 7-12: (i), (ii), (iii): Yoshikawa measure of manipulability plotted along the vertical z-axis

for every point in the 2D circular region: 0<r<0.06 at z=0.20 plane

Page 135: By - Automation, Robotics, & Mechatronics Laboratory

108

Figure 7-13 (a) Figure 7-14 (a)

Figure 7-13 (b)

Figure 7-14 (b)

Figure 7-13 (c)

Figure 7-14 (a)

Figure 7-13: (a), (b), (c): Condition number based measure of manipulability plotted along the vertical z-axis for every point in the 2D circular region: 0<r<0.06

at z=0.30 plane

Figure 7-14: (a), (b), (c): Yoshikawa measure of manipulability plotted along the vertical z-axis for every point in the 2D circular region: 0<r<0.06 at

z=0.30 plane

Page 136: By - Automation, Robotics, & Mechatronics Laboratory

109

Figure 7-15 (a) Figure 7-16 (a)

Figure 7-15 (b) Figure 7-16 (b)

Figure 7-15 (c) Figure 7-16 (c) Figure 7-15: (a), (b), (c): Condition number based

measure of manipulability plotted along the vertical z-axis for every point in the 2D circular

region: 0<r<0.06 at z=0.40 plane

Figure 7-16: (a), (b), (c): Yoshikawa measure of manipulability plotted along the vertical z-axis

for every point in the 2D circular region: 0<r<0.06 at z=0.40 plane

Page 137: By - Automation, Robotics, & Mechatronics Laboratory

110

Figure 7-17(a) Figure 7-18 (a)

Figure 7-17(b)

Figure 7-18 (b

Figure 7-17(b)

Figure 7-18 (c)

Figure 7-17: (a), (b), (c): Condition number based measure of manipulability plotted along the

vertical z-axis for every point in the 2D circular region: 0<r<0.06 at z=0.45 plane

Figure 7-18: (i), (ii), (iii): Yoshikawa measure of manipulability plotted along the vertical z-axis

for every point in the 2D circular region: 0<r<0.06 at z=0.45 plane

Page 138: By - Automation, Robotics, & Mechatronics Laboratory

111

7.4. Inverse Kinematics and Jacobian Based Workspace Analysis of 6-DOF P-U-S Manipulator

7.4.1. Inverse Kinematics Simulation For P-U-S manipulators we implement the kinematics as shown in Figure 7-19, Figure

7-20, Figure 7-21 and Figure 7-23. Based on the inverse kinematics equations derived in

Sec. 4.6, the kinematic models were implemented and validated as before for standard

cases. We then proceed to do a workspace analysis based on jacobian based measures to

assess the manipulability of the P-U-S manipulator.

Line and Curve Tracking:

Figure 7-19 (a)

Figure 7-20 (a)

Figure 7-19 (b)

Figure 7-20 (b)

Figure 7-19 (c)

Figure 7-20 (c)

Figure 7-19: P-U-S Manipulator Configuration for Validation Test: (a) Line along Z axis (b)

Straight line (c) 3D Sine curve

Figure 7-20: P-U-S Joint trajectory for Validation Test: (a) Line along Z axis (b) Straight line (c) 3D

Sine curve

Page 139: By - Automation, Robotics, & Mechatronics Laboratory

112

Circle and Ellipse Tracking

Figure 7-21 (a)

Figure 7-23 (a)

Figure 7-21 (b)

Figure 7-23 (a)

Figure 7-21 (c)

Figure 7-23 (c) Figure 7-21: Maximum Reachable Characteristic

Values of the Manipulator 7-22: P-U-S Manipulator Configuration for Validation Test: (a) Circle in XY Plane (b) Circle in YZ Plane (c)

Ellipse in YZ plane

Figure 7-23: P-U-S Joint trajectory for Validation Test: (a) Circle in XY Plane (b) Circle in YZ Plane

(c) Ellipse in YZ plane

Page 140: By - Automation, Robotics, & Mechatronics Laboratory

113

7.4.2. Constant Orientation Workspace Analysis Table 7-2: Maximum Reachable Characteristic Values of the Manipulator

Base plate radius, l0 0.1 m BC Link length, l2 0.35 m Top plate radius, l3 0.1 m Offset angle for top and base plate gimbal point, theta0 pi/4 rad

The jacobian analysis is performed for the following set of geometric parameters and the

jacobian-based measures of the manipulability of the 6-DOF manipulator are determined

namely the Yoshikawa Measure and Condition number.

Figure 7-24 (a)

Figure 7-25 (a)

Figure 7-24 (b)

Figure 7-25 (b)

Figure 7-24 (c)

Figure 7-25 (c) Figure 7-24: (a), (b), (c): Condition number based

measure of manipulability plotted along the vertical z-axis for every point in the 2D circular region: 0<r<0.06

at z=0.45 plane

Figure 7-25: (a), (b), (c): Yoshikawa measure of manipulability plotted along the vertical z-axis for every point in the 2D circular region: 0<r<0.06 at

z=0.45 plane

Page 141: By - Automation, Robotics, & Mechatronics Laboratory

114

Figure 7-26(a)

Figure 7-27(a)

Figure 7-26(b)

Figure 7-27(b)

Figure 7-26(c)

Figure 7-27(c)

Figure 7-26: (a), (b), (c): Condition number based measure of manipulability plotted along the vertical z-axis for every point in the 2D circular region: 0<r<0.06

at z=0.60 plane

Figure 7-27: (a), (b), (c): Yoshikawa measure of manipulability plotted along the vertical z-axis for every point in the 2D circular region: 0<r<0.06 at z=0.60 plane

Page 142: By - Automation, Robotics, & Mechatronics Laboratory

115

Figure 7-28 (a)

Figure 7-29 (a)

Figure 7-28 (b)

Figure 7-29 (b)

Figure 7-28 (c)

Figure 7-29 (c)

Figure 7-28: (a), (b), (c): Condition number based measure of manipulability plotted along the vertical z-axis for every point in the 2D circular region: 0<r<0.06

at z=0.75 plane

Figure 7-29: (a), (b), (c): Yoshikawa measure of manipulability plotted along the vertical z-axis for every point in the 2D circular region: 0<r<0.06 at

z=0.75 plane

Page 143: By - Automation, Robotics, & Mechatronics Laboratory

116

7.5. Visual Nastran Implementation P-U-S Manipulator We created a CAD model of a P-U-S manipulator in SolidWorks and used visual Nastran

to run an open simulation project for our analysis. We initially validated the model

against standard trajectories before driving the platform using our jaw motion trajectories.

We show the implementation of the series of test for the jaw motion case studies in

Figure 7-30, Figure 7-31 and Figure 7-32.

Case 1: Human Jaw Motion Trajectory

Figure 7-30 (a)

Figure 7-30 (b)

Figure 7-30: Visual Nastran Implementation of P-U-S with Human Jaw motion Trajectory Input (a) Visual Nastran model imported from SolidWorks (b) Actuator force trajectory Vs time

Page 144: By - Automation, Robotics, & Mechatronics Laboratory

117

Case 2: Labrador Jaw Motion Trajectory

Figure 7-31 (a)

Figure 7-31 (b)

Figure 7-31: Visual Nastran Implementation of P-U-S with Labrador Jaw motion Trajectory Input (a) Visual Nastran model imported from SolidWorks (b) Actuator force trajectory Vs time

Page 145: By - Automation, Robotics, & Mechatronics Laboratory

118

Case 2: Bulldog Jaw Motion Trajectory

Figure 7-32 (a)

Figure 7-32 (b)

Figure 7-32: Visual Nastran Implementation of P-U-S with Bulldog Jaw motion Trajectory Input (a) Visual Nastran model imported from SolidWorks (b) Actuator force trajectory Vs time

Page 146: By - Automation, Robotics, & Mechatronics Laboratory

119

7.6. Parametric Study of P-U-S Manipulator Implementing dynamic model of these types of manipulator which have a passive

link in each of their legs is complicated. Hence in our study, we explore an alternative

method to specify the parallel manipulator based on finding the limits on workspace,

velocity and forces by considering the simple geometry as well as the free body diagram

at extreme positions. However, for implementing inverse dynamic models for P-U-S

manipulators interested readers are referred to Zhao and Gao [58] based on virtual work

principle to determine the actuator forces.

In section 4.9 we have derived all the equations to obtain maximum reachable workspace,

speeds as well as forces about the base reference frame axes and expressed them in terms

of geometrical and actuator parameters. The setup now is ideal to conduct a series of

parametric studies to determine the optimum values for these undecided parameters that

would satisfy our application requirements.

7.6.1. Simplified Representation of Parametric Analysis We choose two sets of parameters— geometric and actuator type as discussed

before in the table to study their effects on the output variables namely Fz, Pz and Vz. To

keep our parametric study generalized for manipulator of different sizes, we seek to use

dimensionless parameters in our analysis. Before arriving at the final specification for the

manipulator system, we conduct the parametric studies based on these dimensionless

quantities— (a) R/r ratio, (b) l/r ration, (c) q0 and Tq0. Following figure illustrates

the types of parametric studies we have carried out for this purpose.

As a part of validation of the values of geometric and actuator parameters, we will

conduct a final parametric studies to study the effects of the dimensionless quantities on

workspace, speed and forces in other two directions (X and Y) for validation.

Table 7-3: Parametric Studies Conducted to Identify Optimal Values for Jaw Motion Simulation Fz (N) Pz (m) Vz (m/s)

R/r ratio I.a I.b I.c l/r ration II.a II.b II.c

qo and Tqo III.a III.b III.c

Page 147: By - Automation, Robotics, & Mechatronics Laboratory

120

To start with, we assume the values of the actuator and geometric parameters as below:

Table 7-4: Values of Platform Parameters Parameters Values

Fq (N) 20 Vqo (m/s) 0.2 m/s qo (m) 0.08

Actuator

Tqo (m) 0.05 Geometric l (m) 0.3 m

7.6.2. Parametric Study I: Effects of R/r and r on Fz, Pz and Vz For this parametric study, the ranges of values used were— r/R ratio ∈[1, 3] and r

∈[0.05, 0.35]. We can see from the equations (4.9.3) and (4.9.6) that there is no effect of

R/r ratio and r on Pz and Vz, hence they remain constant at 0.04575 m and 0.08729 m/s

respectively as shown in the surface plot.

Figure 7-33: Workspace in Z, m Figure 7-34: Speed in Z, m/s

Figure 7-35: Maximum Force in Z, Newton

Page 148: By - Automation, Robotics, & Mechatronics Laboratory

121

However, Fz varies according to the equation (4.9.15) and has a non-linear

relationship with R/r as well as r. From the plot, we see that Fz continuously decreases

and does not exist when the inverse of sine or tangent of the resulting angle is not real or

invalid as indicated by the flat region. With the knowledge of our workspace as well as

the approximate estimation of the ground area, we fix the value of r at about 0.2- 0.3 m.

We also choose r/R ratio of 1 as the maximum attainable force in Z direction is highest

along the line r/R=1. The value of Fz also falls in the desired range of above 200 N.

Similar trends are also observed with torque about X and Y axes as they depend on Fz

and r.

Figure 7-36: Pitch Torque, Nm Figure 7-37: Roll Torque, Nm

Hence, these torques also are at maximum when r/R ratio is equal to one. For yaw

torque (torque about Z axis), we see that it stays constant with r/R ration but increases as

r increases.

Figure 7-38: Yaw Torque, Nm

Page 149: By - Automation, Robotics, & Mechatronics Laboratory

122

7.6.3. Parametric Study II: Effects of /l r and r on Fz, Pz and Vz Since we fixed the value of r/R ratio at 1, we proceed further to the second parametric

study where we look for l/r and r in the ranges of [1, 2] and [0.15, 0.45] respectively.

Giving l/r value greater than 1, maximum force in Z direction is higher. Now, as evident

from the equations (4.9.3) and(4.9.6), Pz and Vz depend on l alone. However, for Pz to be

positive and Vz to exist, l needs to satisfy the condition—

00 0

0 0

,l ql q Tq

l q Tq⎫> ⎪ > +⎬> + ⎪⎭

Therefore, as long as the second condition is satisfied, Pz and Vz can be calculated from

the equation to complete a 3D plot. Using this, we will be able to determine the optimal

value of l/r.

Figure 7-39: Workspace in Z, m Figure 7-40: Speed in Z, m/s

Figure 7-41: Force in Z, Newton

Page 150: By - Automation, Robotics, & Mechatronics Laboratory

123

However, Fz increases continuously and non-linearly with both l/r as well as r. Based on

our bite force estimate, we can now find the value of l/r as 1.5 or higher corresponding to

r=0.25 (according to parametric study I) and Fz = 489.5 N app. and maximum value of

Pz= 0.1996 m.

7.6.4. Parametric Study III: Effects of q0/ Tq0 and r on Fz, Pz and Vz To determine the actuator parameters— nominal length as well as the travel of the

actuator, we use the geometric parameter values obtained from the previous studies. From

Fz equation derived before, for lower values of q0, the force in Z direction increases but

smaller q0 ( / 2l< ) would result in lower Vz. Hence, an optimal value of q0 should be

reached based on this parametric study.

So, we chose to vary Tq0 from 0.25l to 0.707l and studied the effects of Fz, Vz and Pz.

From the figure we see that, when the top platform aligns itself with the base platform,

0 0l q tq= + (4.11.8)

However, in our case, we would give a minimum height between the top and base

platform by limiting the value of tq0 as,

( )0 01.25l q tq= + (4.11.9)

By this way, we can make sure that the values of Tq0 and q0 calculated are real and valid.

Plotting the values of Px and Pz against q0 we can find the optimal value for the nominal

length of the actuator (maximum value is 0.2192 m).

Figure 7-42: Workspace in Z, m Figure 7-43: Speed in Z, m

Page 151: By - Automation, Robotics, & Mechatronics Laboratory

124

Figure 7-44: Workspace in X, m/s Figure 7-45: Force in Z, N

From the plots, we can see the optimal value of q0 is approximately 0.66 (2l )= 0.175 m

and Tq0 is approximately 0.15 where Fz = 227 N. Combining all the above, we now have

formed a initial set of specifications for the P-U-S manipulator case which needs to be

validated for workspace, speed and forces in other directions (X and Y).

Table 7-5: Preliminary Specification Values of the Manipulator Symbol (units) Description Values

r (m) Platform radius 0.25

R(m) Base radius 0.25

L (m) Arm length 0.375

h (m) Actuator nominal height 0.33

q0 (m) Actuator nominal length 0.175

Tq0 (m) Actuator travel +/- 0.15

Fq (N) Actuator maximum force 20

Similar to above, we created the parametric studies for each of the variables- roll, pitch,

yaw and the corresponding velocities against:

a. r/R ratio and r

b. l/r ratio and r

Page 152: By - Automation, Robotics, & Mechatronics Laboratory

125

7.6.5. Parametric Sweep of Workspace Variables against r and r/R ratio:

Figure 7-46: Pitch/ Roll angles, rad and velocities, rad/s

Figure 7-47: Yaw angles, rad and velocities, rad/s

7.6.6. Parametric Sweep of Workspace Variables against r and r/R ratio:

Figure 7-48: Pitch angles, rad and velocities, rad/s

Page 153: By - Automation, Robotics, & Mechatronics Laboratory

126

Figure 7-49: Yaw angles, rad and velocities, rad/s

In all these analysis, the forces in X and Y direction remain constant at 80 and 69.282 N

respectively as they depend only on Fq as well as the geometry of the base platform. For

the torques about X, Y and Z-axes, we get the following plots.

Figure 7-50: Torque about X, Nm Figure 7-51: Torque about Y, Nm

Figure 7-52: Torque about Z, Nm

Page 154: By - Automation, Robotics, & Mechatronics Laboratory

127

Since for our application, high velocities are not required, all the workspace velocities as

well as forces are compatible with the jaw motions and forces. Thus we, arrive at the final

specification for the P-U-S manipulator as:

Table 7-6: Final Specification of the Manipulator Symbol (units) Description Values

r (m) Platform radius 0.25

R(m) Base radius 0.25

L (m) Arm length 0.375

h (m) Actuator nominal height 0.311

q0 (m) Actuator nominal length 0.208

Tq0 (m) Actuator travel +/- 0.125

Fq (N) Actuator maximum force 20

The output values table corresponding to these geometric and actuator parameters

obtained from the equations derived in Section 4.9.1 are given below:

Table 7-7: Maximum Reachable Characteristic Values of the Manipulator

X Y Z Roll Pitch Yaw

Maximum Force, Torque (N, N.m) 69.282 80.000 227.411 32.824 37.902 30.000

Workspace (m, deg) 0.300 0.300 0.187 36.809 36.809 50.193

Maximum Speed (m/s, deg/s) 0.200 0.200 0.106 45.837 45.837 24.187

Thus we obtained the set of geometrical and actuator parameters’ values based on our

requirements of tracking the jaw motions of different vertebrates precisely.

Page 155: By - Automation, Robotics, & Mechatronics Laboratory

128

8. Conclusion:

8.1. Summary We developed a biomechanical model with accurate model of TMJ for

performing inverse dynamics analysis on animal as well as human jaws. This helped us to

perform quantitative analysis on these models and also study the muscle behavior under

different circumstances. The necessity of dissection study was realized to estimate muscle

parameters for the animals which was conducted in Animals Facility, UB South campus.

With a more realistic model, we were able to study the jaw motion envelope of human

and canine jaws as a part of our model validation process.

This model provided a basis on which we were able to implement parallel

manipulator architectures for the jaw motion simulators. To improve the performance of

the manipulator, we setup a motion capture system and conducted real subjects testing to

extract the jaw motion trajectories. We conducted on field experiments to capture the

motions of animals to obtain the kinematic trajectories. These trajectories were then used

to drive the musculoskeletal model case studies with different biting forces models to

understand the jaw behavior. We also created 3D CAD models of dentitions using laser

3D Scanner as well as from CT scan slices which were used for biomechanical analyzes.

This dentition can also be used while building the physical prototype of the jaw

simulator. For analysis of parallel manipulator architectures, we implemented the

kinematics for R-U-S and P-U-S manipulator and validated the model to accurately track

the jaw trajectory. We also developed the model in SolidWorks – VisualNastran that

helped us to validate our kinematics equations which in turn helped us to track the jaw

trajectories accurately. Finally to conclude the work, a parametric analysis on workspace,

Page 156: By - Automation, Robotics, & Mechatronics Laboratory

129

velocities as well as forces parameters were conducted to determine the physical

specification of the jaw simulator.

8.2. Future Work: As a part of future work, we would like to have the inverse dynamic model of P-

U-S manipulator as well as R-U-S manipulator implemented in real time to allow us to

work out a much more comprehensive analysis of the system for jaw motion tracking.

With proper development of the dynamics code, simultaneous force and trajectory

tracking can also be accomplished which will be very useful for the concerned

application (i.e.) the implementing the dynamic level control of manipulator so that they

can track the desired jaw trajectory as well as apply the necessary force to bite food

particles of different texture. Such setting would enable us to conduct mastication

experiments of food chewing as well food texture for better understanding of the chewing

behavior.

However, for this we need to know the accurate estimate of the bite force which

will also be a part of our proposed future work. This can be implemented by using the

implant force transducer devices for the subjects testing so that an accurate model of

force estimate can be obtained. As mentioned in the section 5.3.3, the biomechanical

model developed in this work does not exactly resemble the real jaw model where the

muscles are attached as layers to themselves before attaching to the corresponding

segments. in order to achieve such an accurate biomechanical model, a comprehensive

dissection study is really important by which we can determine each individual muscle

parameters separately. In short, improving the model realism as well as accuracy of

muscle parameters for the model will be included in our future work.

Page 157: By - Automation, Robotics, & Mechatronics Laboratory

130

Also to realize the goal of building a generic jaw simulator, the motion capture

experiments should be performed across different subjects as well as in more numbers so

as to study the cumulative muscle models and behaviors for each kind of subjects which

would help the work envelope study for the manipulator and hence, improve the design

and control of the simulator.

Page 158: By - Automation, Robotics, & Mechatronics Laboratory

131

Bibliography 1. Wang, G.G., Definition and Review of Virtual Prototyping, 2001.

2. Koolstra, J.H., et al., A Method To Predict Muscle Control in Kinematically and Mechanically Indeterminate Human Masticatory System. Journal of Biomechanics, September 2001. 34(9): p. 1179-88.

3. Weingartner, T., et al. Dynamic Simulation of Jaw and Chewing Muscles for Maxillofacial Surgery in Proceedings of IEEE Workshop on Motion of Non-Rigid and Articulated Objects (NAM '97), 1997, pg:104 - 111.

4. Peck, C.C., et al., Dynamic Simulation of Muscle and Articular Properties during Human Wide Jaw Opening. Archives of Oral Biology, Nov 2000. 45(11): p. 20.

5. Enciso, R., et al., The virtual craniofacial patient: 3D jaw modeling and animation. Student Health Technology Information, 2003. 94.: p. 65-71.

6. Posselt, U., An Analyzer for Mandibular Positions. The Journal of Prosthetic Dentistry,1957. 7(3): p. 7.

7. Waseda-University. [cited; Available from: http://www.takanishi.mech.waseda.ac.jp/research.

8. Takanobu, H., et al. Control of Rapid Closing Motion of a Robot Jaw Using Nonlinear Spring Mechanism. in "Human Robot Interaction and Cooperative Robots", Proceedings of International Conference on Intelligent Robots and Systems,1995. Pittsburg, PA, USA.

9. Xu, W.L., et al., A Robotic Model of the Human Masticatory System for Reproducing Chewing Behaviors. IEEE Robotics and Automation Magazine, 2005. 12(2): p. 9.

10. Xu, W.L., et al., Kinematics and Experiments of a Life Sized Masticatory Robot for Characterizing Food Texture. IEEE Transactions on Industrial and Electronics, May 2008. 55(5): p. 12.

11. Xu, W.L., et al., Mechanism, design and motion control of a linkage chewing device for food evaluation. Mechanisms and Machines Theory, 2007: p. 14.

12. Tsai, L.-W., Inverse Dynamics Analysis of Stewart Platform by Means of Virtual Work Principle. Journal of Mechanical Design, 2000. 122: p. 7.

13. Guo, H.B., et al., Dynamic Analysis and Simulation of a 6 dof Stewart Platform Manipulator. Proceedings of Institution for Mechanical Engineers, Part C, Journal of Mechanical Engineering Science, 2006. 220(1).

Page 159: By - Automation, Robotics, & Mechatronics Laboratory

132

14. Wang, Y., Symbolic Kinematics and Dynamics Analysis and Control of General Stewart Parallel Manipulator in Department of Mechanical and Aerospace Engineering, University at Buffalo: Buffalo.

15. Gallo, L.M., Modeling of Temporomandibular Joint Function Using MRI and Jaw-Tracking Technologies - Mechanics. Cells Tissues Organs, 2005, (180): p. 54-68.

16. Moog, Moog Inc- Motion Base:www.moog.com/.

17. Servos, Servos Simulation- http://www.servos.com/6axis.aspx.

18. Sarnicola, Sarnicola Simulation Systems: http://www.sarnicola.com/.

19. In Motion Simulation:http://inmotionsimulation.com/.

20. Aeronumerics, Inc.: http://www.aeronumerics.com/.

21. Alio Industries Hexapods: http://www.alioindustries.com/stages_hexapods.html.

22. Mandible-Reconstruction-Project. University of Illinois. [cited; Available from: http://www.itg.uiuc.edu/technology/reconstruction/.

23. AnyBody Modeling Software Manual. [cited; Available from: www.anybodytech.com.

24. Konakanchi, K.S., Musculoskeletal Modeling of Smilodon fatalis for Virtual Functional Performance Testing, 2005, in Department of Mechanical and Aerospace Engineering, University at Buffalo, NY: Buffalo.

25. Rasmussen, J., et al., Muscle Recruitment by Min Max Criterion. Journal of Biomechanics, March 2001. 34(3): p. 409-15.

26. Musculographics-Inc., SIMM Musculographics Inc.

27. Yamaguchi, G.T., et al., A Computationally Efficient Method for solving the Redundant Problem in Biomechanics. Journal of Biomechanics, 1995. 28: p. 999-1005.

28. Davoodi, R., et al. An Integrated Package of Neuromusculoskeletal Modeling Tools in Simulink. in 23rd Annual EMBS International Conference, 2001. Istanbul, Turkey.

29. Bhatt, R.M., et al., DynaFlexPro for MAPLE, in IEEE Control Systems Magazine, 2006. p. 127-38.

30. Mathworks, SimMechanics Help Manual, Mathworks Inc.

31. MSC.visualNastran 4D Manual: www.mae.virginia.edu/meclab/images/visualNastran4D.pdf.

Page 160: By - Automation, Robotics, & Mechatronics Laboratory

133

32. Materialize, Materialize- Mimics Help Manual: www.materilialize.com.

33. Rhinoceros, Rhinoceros: www.rhino3d.com/.

34. WikiPedia, http://en.wikipedia.org/wiki/Motion_capture.

35. Vicon-Peak-Motus, http://www.peakperform.com/.

36. OptiTrack, www.naturalpoint.com/optitrack.

37. PhaseSpace, I., http://www.phasespace.com/snm.html.

38. METAMotion, http://www.metamotion.com/gypsy/gypsy-motion-capture-system-mocap.htm.

39. Nuzoo, http://www.nuzoo.it/.

40. e-Motek, http://www.e-motek.com/entertainment/about_us/mocap.html.

41. Moven-Inc, www.moven.com.

42. Miller, N., et al., Motion Capture from Inertial Sensing for Untethered Humanoid Teleoperation. International Journal of Humanoid Robotics, Jun 2004. 2: p. 547- 65

43. Noraxon-Inc, http://www.noraxon.com/index.php3.

44. Organic Motion.

45. CMU, Facial Motion Capture, http://www.ri.cmu.edu/people/kanade_takeo.html.

46. IBM. IBM Facial Motion Capture, http://www.research.ibm.com/peoplevision/PETS2003.pdf. [cited; Available from: http://www.research.ibm.com/peoplevision/PETS2003.pdf.

47. G-O-M, ATOS and PONTOS 3D Laser scanners, http://www.gom.com/DE/index.html.

48. Kannan, S., Quantitative Analysis of Masticatory Performance in Vertebrates, 2008, in Mechanical and Aerospace Engineering, University at Buffalo, NY: Buffalo.

49. Gonzalez-Morcillo, C., et al., Motion Capture Analysis and Reconstrunction System Based on Soft Computing, University of Castilla La Mancha, 2005: Toledo. p. 6.

50. SimiMotion. Motion Capture System Manual, http://www.simi.com/en/. [cited; Available from: www.simi-motion.com.

Page 161: By - Automation, Robotics, & Mechatronics Laboratory

134

51. Koolstra, J.H., Dynamics of the Human Masticatory Motion. Critical Reviews in Oral Biology and Medicine, 2002. 13(4): p. 11.

52. Lehman-Grimes, S.P., A Review of Temporomandibular Disorder and an Analysis of Mandibular Motion, in Dental Science, University of Tennessee, 2005. p. 151.

53. Shin, G., Course notes titled "IE 536 Work Physiology"- 2007.

54. Zantos, I.C.T., et al., A System for the Acquisition and Analysis of the 3D Mandibular Movement to be used in Dental Medicine, 2006: Porto, Portugal. p. 5.

55. Tsai, L.-W., Robot Analysis: The Mechanics of Serial and Parallel Manipulators, 1999: John Wiley & Sons, Inc.

56. Filho, S.C.T., et al., Dynamic and Jacobian Analysis of a Parallel Architecture Robot: The Hexa, in ABCM Symposium Series in Mechatronics, 2006. p. 166-73.

57. Kim, J.-P., Inverse Kinematics and Dynamic Analyses of 6 DOF PUS Type Parallel Manipulators. KSME International Journal, 2002. 16(1): p. 10.

58. Zhao, Y., et al., Inverse Dynamics of the 6-DOF-out-parallel Manipulator by means of the Principle of Virtual Work (to be published), in Robotica, 2008, Shangai Jiao Tang University: Shangai. p. 10.

59. CMU. Online Tutorials on Virtual and Physical Prototyping. [cited; Available from: http://www.cs.cmu.edu/~rapidproto/mechanisms/chpt4.html.

60. Nakamura, Y., Advanced Robotics: Redundant and Optimization, California: Addison-Wesley Publishing Company Inc.

61. Manipulability Index. [cited; Available from: http://155.69.254.10/users/risc/www/ultra-intro.html.

62. Yoshikawa, T., Manipulability of Robotic Mechanisms. The International Journal of Robotics Research, 1998. 4(2): p. 3-9.

63. Salisbury, J.K., et al., Articulated Hands: Force Control and Kinematic Issues. International Journal of Robotics Research, 1982, 1982. 1(1): p. 4-17.

64. Zanganeh, K.E., et al., Kinematic isotropy and the optimum design of parallel manipulators. International Journal of Robotics Research, 1997. 16(2): p. 185-97.

65. Zee, M.d., et al., Validation of a Musculo-skeletal Model of the Mandible and its application to Mandibular Distraction Osteogenesis. Journal of Biomechanics, June 2006. 40(6): p. 1192-201.

Page 162: By - Automation, Robotics, & Mechatronics Laboratory

135

66. Turnbull, W.D., Mammalian Masticatory Apparatus. Vol. 18.

67. Horsman, M.K., et al., Morphological Muscle Joint Parameters for Musculoskeletal Modeling of the Lower Extremity. Clinical Biomechanics, 2007. 22(2): p. 239-47.