The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The...
Transcript of The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The...
![Page 1: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/1.jpg)
The Line of Action: an Intuitive Interface for Expressive
Character Posing
Martin Guay, Marie-Paule Cani, Rémi Ronfard
LJK, INRIA, Université de Grenoble
![Page 2: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/2.jpg)
[S.Lee and J. Buscema, Drawing
Comics the Marvel Way, 1998]
![Page 3: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/3.jpg)
Introduction
![Page 4: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/4.jpg)
Martin Guay, SIGGRAPH Asia 2013
3D Character Posing
Placing a 3D character in a 3D world.
![Page 5: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/5.jpg)
Martin Guay, SIGGRAPH Asia 2013
3D Character Posing
Intuitive: Skeleton parametrization
[Burtnyk, N., at al, Interactive skeleton techniques for enhancing motion dynamics in key frame animation, 1976.]
![Page 6: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/6.jpg)
Martin Guay, SIGGRAPH Asia 2013
3D Character Posing
More Intuitive: Inverse Kinematics (IK)
[Girard, M., et al., Computational modeling for the computer animation of legged figures, 1985.]
[Zhao, J., et al., Inverse kinematics positioning using nonlinear programming for highly articulated figures, 1994]
![Page 7: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/7.jpg)
Martin Guay, SIGGRAPH Asia 2013
3D Character Posing
More Intuitive: 2D Stickfigures
[Davis. J. et al., A sketching interface for articulated figure
animation, 2003.]
[Wei, X.K., et al., Intuitive interactive human character posing
with millions of example poses, 2011]
[Lin, J., et al., A sketching interface for sitting-pose design. 2010
![Page 8: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/8.jpg)
Martin Guay, SIGGRAPH Asia 2013
[S.Lee and J. Buscema, Drawing Comics the
Marvel Way, 1998]
[Blair, P., Cartoon Animation, 1994]
Expressive Poses
Emotion expressed, body language is as clear---and readable---as possible.
![Page 9: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/9.jpg)
Martin Guay, SIGGRAPH Asia 2013
[S.Lee and J. Buscema, Drawing Comings the
Marvel Way, 1998][Blair, P., Cartoon Animation, 1994]
Expressive Poses
Lines of Action
![Page 10: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/10.jpg)
Posing with lines of action
![Page 11: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/11.jpg)
Martin Guay, SIGGRAPH Asia 2013
Posing with lines of action
“It is the imaginary line that passes through the main action of the character”“It is the imaginary line that dictates how the body will move”“It is the back bone of your character”
©Preston Blair
![Page 12: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/12.jpg)
Martin Guay, SIGGRAPH Asia 2013
Posing with lines of action: Overview
A formal definition of the line of action.
Posing as an optimization problem.
![Page 13: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/13.jpg)
Martin Guay, SIGGRAPH Asia 2013
Line of Action: Definition
Definition: A line of action dictates the shape, in image space, of a
linear sub-chain in the kinematic tree.
©Preston Blair
![Page 14: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/14.jpg)
Martin Guay, SIGGRAPH Asia 2013
Line of Action: Definition
Dictates shape of a body line:
� = � =
�: � �
![Page 15: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/15.jpg)
Martin Guay, SIGGRAPH Asia 2013
Line of Action: Problem
��
� : Bone Position world space�� : Line of Action Position screen space�� : View Projection Transformation
min� � � �� + ����� = �� �� � − �� 2��� = ��� ��� ��� − ����� 2
![Page 16: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/16.jpg)
Martin Guay, SIGGRAPH Asia 2013
Line of Action: Problem
� : Bone Position world space�� : Line of Action Position screen space�� : View Projection Transformation
min� � � �� + ����� = �� �� � − �� 2��� = ��� ��� ��� − ����� 2
![Page 17: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/17.jpg)
Martin Guay, SIGGRAPH Asia 2013
Posing with lines of action: Overview
A formal definition of the line of action.
Posing as an optimization problem.
Select the body line
Resolve Depth Ambiguities
Determine Correspondence (spatial warping)
![Page 18: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/18.jpg)
Line Selection
![Page 19: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/19.jpg)
Martin Guay, SIGGRAPH Asia 2013
Body Line Selection
10 Maximal chains for a humanoid:
![Page 20: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/20.jpg)
Depth Ambiguities
![Page 21: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/21.jpg)
Martin Guay, SIGGRAPH Asia 2013
Resolving Depth Ambiguities
2D to 3D reconstruction is
under-constrained
Many solutions (poses) for the
same initial conditions
![Page 22: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/22.jpg)
Martin Guay, SIGGRAPH Asia 2013
Resolving Depth Ambiguities
2D to 3D reconstruction is
under-constrained
Many solutions (poses) for the
same initial conditions
![Page 23: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/23.jpg)
Martin Guay, SIGGRAPH Asia 2013
Resolving Depth Ambiguities
2D to 3D reconstruction is
under-constrained
Many solutions (poses) for the
same initial conditions
![Page 24: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/24.jpg)
Martin Guay, SIGGRAPH Asia 2013
Resolving Depth Ambiguities
2D to 3D reconstruction is
under-constrained
Many solutions (poses) for the
same initial conditions
![Page 25: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/25.jpg)
Martin Guay, SIGGRAPH Asia 2013
Resolving Depth Ambiguities
Previous Work: Stick figures
[Davis. J. et al., A sketching interface for articulated figure animation, 2003.]
[Wei, X.K., et al., Intuitive interactive human character posing with millions of
example poses, 2011]
[Lin, J., et al., A sketching interface for sitting-pose design. 2010
![Page 26: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/26.jpg)
Martin Guay, SIGGRAPH Asia 2013
Resolving Depth Ambiguities
Solution: constrain transformations to viewing plane
Single axis-angle parametrization of bone rotations
Along the view direction.
![Page 27: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/27.jpg)
Martin Guay, SIGGRAPH Asia 2013
Possibilities
![Page 28: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/28.jpg)
Martin Guay, SIGGRAPH Asia 2013
28
![Page 29: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/29.jpg)
Mapping Both Lines
![Page 30: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/30.jpg)
Martin Guay, SIGGRAPH Asia 2013
Mapping Both Lines
Spatial Warping
Naive approach:
?
∶ �
�� �©Ben Jelter
�� � �
![Page 31: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/31.jpg)
Martin Guay, SIGGRAPH Asia 2013
Mapping Both Lines
Solution: High curvature joint.
![Page 32: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/32.jpg)
Martin Guay, SIGGRAPH Asia 2013
Mapping Both Lines
![Page 33: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/33.jpg)
Results
![Page 34: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/34.jpg)
Results
![Page 35: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/35.jpg)
Results
![Page 36: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/36.jpg)
Results
![Page 37: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/37.jpg)
Martin Guay, SIGGRAPH Asia 2013
37
![Page 38: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/38.jpg)
Martin Guay, SIGGRAPH Asia 2013
Results
![Page 39: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/39.jpg)
Martin Guay, SIGGRAPH Asia 2013
Results
![Page 40: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/40.jpg)
Martin Guay, SIGGRAPH Asia 2013
Muybridge
40
![Page 41: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/41.jpg)
Martin Guay, SIGGRAPH Asia 2013
Results
![Page 42: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/42.jpg)
Martin Guay, SIGGRAPH Asia 2013
Expressive: CSI-shaped curves
Simple curves make the pose as readable as possible.
Freeform curves allow more poses, and nuances.
![Page 43: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/43.jpg)
Martin Guay, SIGGRAPH Asia 2013
Expressive
Single stroke, in a single hand gesture---with direct visual feedback.
(Gesture comes from the heart)
![Page 44: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/44.jpg)
Martin Guay, SIGGRAPH Asia 2013
Limitations
Foot contacts
44
![Page 45: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/45.jpg)
Martin Guay, SIGGRAPH Asia 2013
Limitations
Sketch-Rotate-Sketch
45
![Page 46: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/46.jpg)
Martin Guay, SIGGRAPH Asia 2013
Limitations
Assumed rigid transformations
No stretch,
But bending is possible!
46
![Page 47: The Line of Action: an Intuitive Interface for Expressive Character Posing · 2014-11-29 · The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay,](https://reader030.fdocuments.net/reader030/viewer/2022040919/5e957aafd6a24f44be179415/html5/thumbnails/47.jpg)
Thank You !
Also, thank:
Laura Paiardini for support with Maya,
Anonymous reviewers for useful comments and suggestions,
ERC Expressive grant for funding.