Pixvana XR Cloud Pipeline - NVIDIAon-demand.gputechconf.com/siggraph/2016/... · Building a...
Transcript of Pixvana XR Cloud Pipeline - NVIDIAon-demand.gputechconf.com/siggraph/2016/... · Building a...
![Page 1: Pixvana XR Cloud Pipeline - NVIDIAon-demand.gputechconf.com/siggraph/2016/... · Building a comprehensive Cloud Video Computation and Delivery Platform for next generation VR Video](https://reader033.fdocuments.net/reader033/viewer/2022050403/5f80d8218781263e98123bd0/html5/thumbnails/1.jpg)
(c) Copyright Pixvana Inc 2016
Pixvana XR Cloud PipelineSiggraph 2016
![Page 2: Pixvana XR Cloud Pipeline - NVIDIAon-demand.gputechconf.com/siggraph/2016/... · Building a comprehensive Cloud Video Computation and Delivery Platform for next generation VR Video](https://reader033.fdocuments.net/reader033/viewer/2022050403/5f80d8218781263e98123bd0/html5/thumbnails/2.jpg)
Overview
Company
FOVAS Streaming Technology
Cloud Processing Pipeline
(c) Copyright Pixvana Inc 2016
![Page 3: Pixvana XR Cloud Pipeline - NVIDIAon-demand.gputechconf.com/siggraph/2016/... · Building a comprehensive Cloud Video Computation and Delivery Platform for next generation VR Video](https://reader033.fdocuments.net/reader033/viewer/2022050403/5f80d8218781263e98123bd0/html5/thumbnails/3.jpg)
Pixvana
Building a comprehensive Cloud Video Computation and Delivery Platform for next generation VR Video
Forest Key, CEO
Product Manager for V1 end-to-end video stacks of both Adobe Flash and Microsoft Silverlight: server, client, authoring, DRM, partner ecosystems. Lucasfilm CGI artist. 2x prior media-tech founder/CEO with public company exits.
Scott Squires, CTO
Former Lucasfilm VFX Supervisor and technology lead, multi-film Academy Award nominee for VFX, recipient of Science & Technology Academy Award.
Bill Hensler, CPO
Engineering lead for Adobe Creative Suite video product and servers technologies, and photography tools at Apple. Early digital video editing tools and hardware pioneer.
Sean Safreed, CMO
Graphics processing and pipeline tooling veteran at Apple, SGI, and founder of leading motion graphics and VFX tools vendor Red Giant (products currently in used by 200k+ artists).
(c) Copyright Pixvana Inc 2016
![Page 4: Pixvana XR Cloud Pipeline - NVIDIAon-demand.gputechconf.com/siggraph/2016/... · Building a comprehensive Cloud Video Computation and Delivery Platform for next generation VR Video](https://reader033.fdocuments.net/reader033/viewer/2022050403/5f80d8218781263e98123bd0/html5/thumbnails/4.jpg)
Introduction to Field of View Adaptive Streaming
View on YouTube: https://youtu.be/_eFKBg5RXK8 (c) Copyright Pixvana Inc 2016
![Page 5: Pixvana XR Cloud Pipeline - NVIDIAon-demand.gputechconf.com/siggraph/2016/... · Building a comprehensive Cloud Video Computation and Delivery Platform for next generation VR Video](https://reader033.fdocuments.net/reader033/viewer/2022050403/5f80d8218781263e98123bd0/html5/thumbnails/5.jpg)
(c) Copyright Pixvana Inc 2016
Field of View
The gray area represents all the pixels that are sent to the user but unseen when streamed to an HMD
![Page 6: Pixvana XR Cloud Pipeline - NVIDIAon-demand.gputechconf.com/siggraph/2016/... · Building a comprehensive Cloud Video Computation and Delivery Platform for next generation VR Video](https://reader033.fdocuments.net/reader033/viewer/2022050403/5f80d8218781263e98123bd0/html5/thumbnails/6.jpg)
Without FOVAS Streaming
Lowest ~ 4 mb Stream Highest ~ 10 mb Stream
MPEG Dash preparation creates multiple versions at varying resolutions & data rates
2
Equirectangular master is encoded at up to 4k resolution
1
Client HMD or web browser (eg: YouTube) gets the entire 360° view but only about 1/6th of view is needed
3
(c) Copyright Pixvana Inc 2016
![Page 7: Pixvana XR Cloud Pipeline - NVIDIAon-demand.gputechconf.com/siggraph/2016/... · Building a comprehensive Cloud Video Computation and Delivery Platform for next generation VR Video](https://reader033.fdocuments.net/reader033/viewer/2022050403/5f80d8218781263e98123bd0/html5/thumbnails/7.jpg)
VR with FOVAS Streaming
Lowest ~ 1 mb Stream Highest ~ 6 mb Stream
FOVAS preparation extends MPEG Dash with additional variations of stream, adapted to viewer’s FOV
2
Equirectangular master is created at up to 10k resolution
1
Client receives a FOV optimized image with higher resolution, with overall lower file size
3
10K
(c) Copyright Pixvana Inc 2016
![Page 8: Pixvana XR Cloud Pipeline - NVIDIAon-demand.gputechconf.com/siggraph/2016/... · Building a comprehensive Cloud Video Computation and Delivery Platform for next generation VR Video](https://reader033.fdocuments.net/reader033/viewer/2022050403/5f80d8218781263e98123bd0/html5/thumbnails/8.jpg)
(c) Copyright Pixvana Inc 2016
SuperNova
Red Giant’s image processing framework for desktop
A library of over 500 GPU shader
Extended to run on Linux servers
Can mix CPU (e.g. OpenCV) and GPU functions
![Page 9: Pixvana XR Cloud Pipeline - NVIDIAon-demand.gputechconf.com/siggraph/2016/... · Building a comprehensive Cloud Video Computation and Delivery Platform for next generation VR Video](https://reader033.fdocuments.net/reader033/viewer/2022050403/5f80d8218781263e98123bd0/html5/thumbnails/9.jpg)
XR Cloud Processor on AWS
S3 Storage
Master
Media Manager
SuperNova Cluster
Hundreds of GPU instances
(c) Copyright Pixvana Inc 2016
![Page 10: Pixvana XR Cloud Pipeline - NVIDIAon-demand.gputechconf.com/siggraph/2016/... · Building a comprehensive Cloud Video Computation and Delivery Platform for next generation VR Video](https://reader033.fdocuments.net/reader033/viewer/2022050403/5f80d8218781263e98123bd0/html5/thumbnails/10.jpg)
Questions?
Sean Safreed Cofounder, CMO
Thank You!
(c) Copyright Pixvana Inc 2016