Physically Based Sound for Computer Animation and Virtual...

9
Physically Based Sound for Computer Animation and Virtual Environments ACM SIGGRAPH 2016 Course Wednesday, 27 July, 2:00 pm - 5:15 pm, Anaheim Convention Center, Ballroom A Doug James Stanford University Changxi Zheng Columbia University Timothy Langlois Cornell University, Adobe Research Ravish Mehra Oculus Research

Transcript of Physically Based Sound for Computer Animation and Virtual...

Page 1: Physically Based Sound for Computer Animation and Virtual ...graphics.stanford.edu/courses/sound/sig16/PBSound2016_Intro_slid… · Physically based sound is an important emerging

Physically Based Sound for Computer Animation and Virtual Environments!

!ACM SIGGRAPH 2016 Course!

Wednesday, 27 July, 2:00 pm - 5:15 pm, Anaheim Convention Center, Ballroom A

Doug James!Stanford University!

!Changxi Zheng!

Columbia University!!

Timothy Langlois!Cornell University, Adobe Research!

!Ravish Mehra!

Oculus Research

Page 2: Physically Based Sound for Computer Animation and Virtual ...graphics.stanford.edu/courses/sound/sig16/PBSound2016_Intro_slid… · Physically based sound is an important emerging

Physically based sound is an important emerging approach to computer synthesis of realistic synchronized sounds for physically based animation and real-time virtual environments. A major challenge for learning and implementing these sound techniques is the wide range of physically based models and sound phenomena involved, as well as the need for optimizations. Many publications on physically based animation and sound rendering assume mathematical background that many in the graphics community lack. The result is that learning physics-based sound techniques is unnecessarily difficult for many interested students and practitioners.!!The main goal of this course is to make the principles and methods of physically based sound accessible to a broader computer-graphics audience. The course covers sound-source models for sonifying important phenomena from physics-based animation: rigid bodies, brittle fracture, thin-shells, cloth, deformable collisions and contact, fluids, and fire. Material related to rigid-body sound is covered in greater detail in the first half of the course, which addresses fundamental topics such as modeling modal vibrations and sound radiation from surfaces. Further readings are suggested throughout the course notes. Several recent SIGGRAPH papers also serve as supplemental notes for more advanced topics.!!With supporting software and implementation short-cuts, attendees can start using physically based sound immediately after completing the course.

Course Description

Page 3: Physically Based Sound for Computer Animation and Virtual ...graphics.stanford.edu/courses/sound/sig16/PBSound2016_Intro_slid… · Physically based sound is an important emerging

[Chadwick et al. 2009]

Physically Based Computer Animation

Page 4: Physically Based Sound for Computer Animation and Virtual ...graphics.stanford.edu/courses/sound/sig16/PBSound2016_Intro_slid… · Physically based sound is an important emerging

[O’Brien and Hodgins 1999]

Silent Algorithms

Page 5: Physically Based Sound for Computer Animation and Virtual ...graphics.stanford.edu/courses/sound/sig16/PBSound2016_Intro_slid… · Physically based sound is an important emerging

Silent Algorithms

Page 6: Physically Based Sound for Computer Animation and Virtual ...graphics.stanford.edu/courses/sound/sig16/PBSound2016_Intro_slid… · Physically based sound is an important emerging

Vibration

Radiation!(Acoustic Transfer)

Listening

Physics-based Sound Rendering

Page 7: Physically Based Sound for Computer Animation and Virtual ...graphics.stanford.edu/courses/sound/sig16/PBSound2016_Intro_slid… · Physically based sound is an important emerging

Phys

ics-

base

d So

und

Ren

derin

g

[Zheng & James 2008]

[Chadwick & James 2011]

[Zheng & James 2011]

[Zheng & James 2010]

[Chadwick et al. 2009]

[An et al. 2012]

Page 8: Physically Based Sound for Computer Animation and Virtual ...graphics.stanford.edu/courses/sound/sig16/PBSound2016_Intro_slid… · Physically based sound is an important emerging

Schedule!Course Schedule (Brief)

2:00 pm Introduction James

2:05 pm Modal Vibration Zheng

2:25 pm Acoustic Transfer James

3:00 pm Implementing Rigid-Body Sound Zheng

3:15 pm Break –

3:30 pm Acceleration Noise James

3:45 pm Brittle Fracture Zheng

4:00 pm Thin Shells James

4:10 pm Liquids Langlois

4:35 pm Fire James

4:50 pm Sound in VR Mehra

5:15 pm Close –

SIGGRAPH 2016 COURSE NOTES A3 PHYSICALLY BASED SOUND

Page 9: Physically Based Sound for Computer Animation and Virtual ...graphics.stanford.edu/courses/sound/sig16/PBSound2016_Intro_slid… · Physically based sound is an important emerging

Course Materials!on Websitehttp://graphics.stanford.edu/courses/sound!

Slides!Course notes!Code & demos