Post on 25-Jan-2016
description
Computer Science Honours Dissertation 499
Realism and Believabilityin MPEG-4 Facial Models
Bernhard TschirrenSchool of Computing
Curtin University of Technology
Project Supervisor: Andrew Marriott
November 2000 Bernhard Tschirren 2
introduction
The FAQbot• Russel - Personality
• Quoc - Gesture Markup
• John - Speech
Realism
November 2000 Bernhard Tschirren 3
introduction
November 2000 Bernhard Tschirren 4
overview
Objectives
Background
Implementation
Results (Pretty Pictures)
Future Work
Conclusion
November 2000 Bernhard Tschirren 5
objectives
Realism• Face, Hair, Eyes, Environment
Realtime - Believability• Consumer OpenGL Card
Complete System• Quick & Easy
Integrate with FAE
November 2000 Bernhard Tschirren 6
background
The FAE• Univ. of Genoa, Italy
• Black-Box
MPEG-4• FDP - Facial Definition Parameters
• Number (major.minor)
• Location (x,y,z)
• Texture (u,v)
November 2000 Bernhard Tschirren 7
background
November 2000 Bernhard Tschirren 8
background
Model Calibration
November 2000 Bernhard Tschirren 9
the face
Face Styler• Creates FDPs & Texture Map
• Requires Orthogonal Photographs
November 2000 Bernhard Tschirren 10
the face
Place Feature Points• Interactive
• Adjust Images (Trans, Rot, Scale)
November 2000 Bernhard Tschirren 11
the face
Texture Map• Cylindrical
• Generate from Input Images
• Positional Certainty
November 2000 Bernhard Tschirren 12
the face
November 2000 Bernhard Tschirren 13
the face
November 2000 Bernhard Tschirren 14
the face
November 2000 Bernhard Tschirren 15
the face
November 2000 Bernhard Tschirren 16
the hair
MPEG-4 Defines 1 Hair FDP!
Added 101 New FDPs
November 2000 Bernhard Tschirren 17
the hair
November 2000 Bernhard Tschirren 18
the hair
November 2000 Bernhard Tschirren 19
the eyes
FAE Supports Iris Texture
Extract Iris From Left Eye
November 2000 Bernhard Tschirren 20
the eyes
November 2000 Bernhard Tschirren 21
the environment
Set Background Image• Provides context (setting)
• Enhances Realism of Scene
November 2000 Bernhard Tschirren 22
fae integration
FAE Integration Layer• Load & Display Hair
• Load & Display Environment
• Optimised Rendering Routines
Face Styler Engine
Face StylerApplication Hair, Environment
Face, EyesFAE
Face StylerFAE Integration
November 2000 Bernhard Tschirren 23
performance
Tested on nVidia RIVA-TNTResolution Depth Refresh Textured Smooth
800×600 16 85 6 281024×768 16 85 6 28
1280×1024 16 60 6 28
Resolution Depth Refresh Textured Smooth800×600 16 85 28 281024×768 16 85 28 28
1280×1024 16 60 28 28
Resolution Depth Refresh Textured Smooth800×600 16 85 85 85
1024×768 16 85 85 851280×1024 16 60 28 57
November 2000 Bernhard Tschirren 24
animation
November 2000 Bernhard Tschirren 25
john stallo
November 2000 Bernhard Tschirren 26
john stallo
November 2000 Bernhard Tschirren 27
groucho marx
November 2000 Bernhard Tschirren 28
female models
November 2000 Bernhard Tschirren 29
lilly
November 2000 Bernhard Tschirren 30
mug shots...
November 2000 Bernhard Tschirren 31
future work
Arbitrary Camera Locations
Perspective Projection
Automatic Image Alignment
Improve Ears
November 2000 Bernhard Tschirren 32
conclusion
Realtime - Believable
Complete System• No Other Software Required
• Easy to Use - Interactive
• Quick to Use - 15min
Integrate with FAE
Realistic - Better than Oscar!
November 2000 Bernhard Tschirren 33
conclusion