Pillai Pradeep - Global Rendering Customer Cases :: AWS Rendering Seminar -
-
Upload
amazon-web-services-korea -
Category
Technology
-
view
631 -
download
1
Transcript of Pillai Pradeep - Global Rendering Customer Cases :: AWS Rendering Seminar -
Agenda
• India
• Animation/VFX - Rendering in India
– Major companies
– Major Work
• Rendering on AWS : Client Case Studies
– Client1
– Assemblage Entertainment Pvt. Ltd.
– SixSteps Pvt Ltd.
– Housing.com
• Q&A
~ 39 years of computational chemistry
Estimate On-Prem Cost: 40Million
Novartis: HPC job on AWS
Results on AWS:
87000 cores
Time taken : 9 hours
Cost : $4200
India
Population 1.2 Billion
Area 3,287,240 km²
Capital New Delhi
Largest City Mumbai – Population: 13,922,125
Official languages Hindi and English, 22 others
GDP (nominal) $2.2 trillion
About India
Profile of the client:
Largest CG/Animation/VFX studio
3DAnimation Visual Effects Studio
USA India
Animation Movies
• Special Venue Attraction
Before AWS:
• 5000+ servers
• Multiple Petabytes Tape and Storage boxes
• One of the largest buyer of EMC Isilon Storage and Intel Servers in India
• Rent out servers
- Rush job for a high value customer- Limited by their internal DC capacity- Latest Cores and Large Size server not available- Tight budget and delivery timelines
Engagement and getting them to move to AWS..
CFO Engg
Domain expertise in Rendering
Proof of Concept
scale this
• Now standardized
• No more HW purchase
Meter: Sample Dashboard
• Manages complete cluster lifecycle– Launches servers and Monitors utilization
– Provides burn rate and estimated cost
– Data-driven SPOT deployment
Current Architecture
300 Mbps link
AMI + AWS CloudFormation Template
Lustre Render Nodes
On-Premises Storage
Maya workstations
On-prem farm Storage Servers )
Architecture and workflow notes
• For a 10K render, on-prem farm ran 1K or 2K jobs to iterate
• 3D wireframes modeling done on-prem using Autodesk Maya
• Once iterations done, wireframes/inventory transferred to AWS, and production 10K render job kicks off
• Used Aspera to accelerate wireframe copy
• Leveraged Lustre cluster and render farm scaled up in time
(contd…)
• A typical rendering wireframe/inventory would be around 2 to 4 TB
• Rendered assets transferred from Lustre to on-prem for compositing
• Data in Lustre FS would grow up to about 32 TB
• Customer worked out an arrangement with Pixar for Rendermanlicenses on cloud
AWS Solution
• Hybrid model
1200 c3.8xlarge & r3.8xlarge SPOT instances
high memory req lighting passes
Pixar’sRenderman Rhythm & Hues
• Internet pipe of 300 Mbps (Upload 3D wireframes & Download rendered frames)
• They use ASPERA over it
Price Achieved:
< $0.01per core/hour over a 7½ day period
• Inclusive of:– Compute
– Storage
– Network
– VPN
– Data Transfer
What Next for this client…
EFS
SPOT Fleet SPOT Block
Appstream
GPU enabled workstation Nice
• Direct Connect
Next large project with this client…
• New 24k Render
500 instances of 32-cores 140+ GB RAMs
1500-2000 instances at peak
SPOT Fleet
Multi-Region render
Current Architecture
100 Mbps VPN
AMI + AWS CloudFormation Template
Spot Render node
s
NFS server
On-Premises Storage
Maya –
Modeling
On-prem farm Storage Servers
Nuke –
Compositing
Architecture and workflow notes
• 3D wireframes modeling done on-prem using Autodesk Maya
• Wireframes copied to an NFS server on AWS
• Uses Modo for rendering &
• Muster as scheduler and for Renderfarm Mgmt
• Render farms spread across multiple regions
• Nuke for compositing
• At peak used 900+ instances c3.4xLarge
Profile of the client:
online render farm
Rendering as a Service
• Web Based console
3ds Max, Maya, Softimage
Plugins
Use of AWS:
• Uses AWS Spot instances in the backend
• Web console uses AWS API to Auto-Provision
• Workloads: Various sizes, Configs, S/W on AWS
• Clients include • Animation/VFX Studios, • Design & Engg Firms• Architecture Firms• Auto Manufacturing• Electrical & Electronics Industries
Profile of the client:
Online Real Estate portal
funded Startup
Game changing innovations
Rendering houses with furniture
• Virtual Walk thru
SPOT