The beginning CDN Implementation...
Transcript of The beginning CDN Implementation...
![Page 1: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/1.jpg)
CDN Services for Video Encoding and Delivery
• The beginning
• CDN Implementation Examples – Instant Infrastructure: Flash JumpStart
– Performance and Scale: Customer Origin/HPAC
– Secure Delivery: Token-based authentication
– Fast Flexibility: iSites Video Publishing Tool
– Dealing with complexity and rapid change: Live Mobile Streaming
• Cost issues
• Goals and Next Steps
![Page 2: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/2.jpg)
• Akamai streaming & storage account for Harvard@Home – Delivered RealVideo,
WindowsMedia, Quicktime, Flash FLV
– 100GB Storage – 250GB/mo delivery – $5500/mo
• UIS Live RealVideo streaming account for high-traffic events
• Had excess capacity (!) “We’re already paying for this. Can we use it for anything else?”
• Eventually moved to LLNW for service/cost reasons
History of the Video CDN at Harvard
![Page 3: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/3.jpg)
Initial Use Case: Instant Infrastructure
Flash “JumpStart” Program • Use excess capacity to provide instant Flash streaming
capability to schools/business units
• Provide sFTP accounts to schools to upload directly to CDN
• Five schools, several business units, HUIT – Has been used to replace internal infrastructure
![Page 4: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/4.jpg)
Performance Enhancement & Unlimited Scale
Customer-origin delivery • Local storage behind an HTTP server
– HTTP headers, IP restrictions for security, if needed
• Cost-effective for large collections
• HPAC, HUIT, HKS (pilot), FAS Admissions
![Page 5: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/5.jpg)
Secure/Authenticated Delivery
Limelight MediaVault token-based authentication
– Java code library available, or token-generation available through iSites Video Publishing Tool
– Protection configured at the directory level
- Works with http or rtmp delivery
![Page 6: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/6.jpg)
Fast Flexibility: iSites Video Publishing Tool
• Self-publishing tool available through iSites platform • “Easy as YouTube” but secure, managed, integrated
• Features include:
– Video publishing from file, camcorder, webcam source – Student submissions (at faculty discretion)
– Chaptering & video annotations (shared and private)
– Ability to publish video to any website – Support for Real, WindowsMedia, Quicktime, MPEG4,
Flash, iOS (playback)
– Automatic notifications (new video, new annotations, etc)
– Metadata and indexing features for large collections – Secure Flash streaming from Limelight
![Page 7: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/7.jpg)
CURRICULAR VIDEO
![Page 8: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/8.jpg)
PUBLIC INSTITUTE EVENT SERIES
![Page 9: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/9.jpg)
SHARED ANNOTATIONS/GROUP PROJECTS
![Page 10: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/10.jpg)
LANGUAGE EXERCISES
![Page 11: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/11.jpg)
LANGUAGE EXERCISES
![Page 12: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/12.jpg)
AUTOMATED LECTURE VIDEO PUBLISHING
![Page 13: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/13.jpg)
COURSE TRAILERS���
![Page 14: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/14.jpg)
Uploading Video
![Page 15: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/15.jpg)
VPT: Cloud Interaction
![Page 16: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/16.jpg)
VPT: Cloud Interaction
![Page 17: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/17.jpg)
VPT: Cloud Interaction
![Page 18: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/18.jpg)
VPT: Cloud Interaction
![Page 19: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/19.jpg)
VPT: Cloud Interaction
![Page 20: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/20.jpg)
VPT: Cloud Interaction
![Page 21: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/21.jpg)
VPT: Cloud Interaction
![Page 22: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/22.jpg)
Video Publishing Tool: # of Videos Handled
0
2000
4000
6000
8000
10000
12000
14000
16000
18000
20000
FEB 08
MAY 08
JUL 08
SEP 08
NOV 08
JAN 09
MAR 09
MAY 09
JUL 09
SEP 09
NOV 09
JAN 10
MAR 10
MAY 10
JUL 10
SEP 10
NOV 10
JAN 11
MAR 11
# of videos handled by iSites Video Publishing Tool
All videos (incl Lecture, High Quality ProducLon, YouTube)
User-‐generated video uploads
![Page 23: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/23.jpg)
Video Publishing Tool: # of Sites
0
200
400
600
800
1000
1200
1400
1600
1800
2007 2008 2009 2010
iSites with at Least One Instance of Video Publishing Tool Added (New Per AY)
Non-‐Course
Course
![Page 24: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/24.jpg)
Video Publishing Tool: Content Sources
Sources of iSites Video
End-‐user Uploads
Lecture Audio and Video
YouTube
Direct CDN links (power users, UIS, Live)
RealVideo
![Page 25: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/25.jpg)
Dealing With Complexity
Live Mobile Delivery: The Challenge
• Mobile OSs (iOS, Android, BlackBerry) • Device Codec Support (video/audio) • Screen Size/Resolution • 3G vs Wifi • Delivery Protocols (http/rtmp/rtsp)
• Poor documentation
• Few tools • Not much real expertise around
![Page 26: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/26.jpg)
Live Mobile Delivery: V1.0
Commencement 2010 • Multi-Platform Approach • UIS Helix for Real • Limelight for Flash (FMS) • Wowza on Amazon AWS/EC2 for mobile
– Doesn’t transcode, but is a “swiss army knife” of protocols • RTMP Flash for Web/Android • HTTP Live Streaming (HLS) for iOS • RTSP for Android/BlackBerry
– $241 in AWS charges in all • Multiple bitrates, sizes of H.264/AAC video • Four machines capturing/encoding at different settings
– 60 Oxford and 6 Story Street
![Page 27: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/27.jpg)
Live Mobile Delivery: V1.0
![Page 28: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/28.jpg)
Live Mobile Delivery V2.0
Must Simplify! – Find a vendor to ingest one HD stream, do
whatever magic is necessary
MobileCDN: – HSPH broke ground, worked out the kinks with
HSPH Forum program, available on all mobile devices • Not turn-key, at first
– Ready for Commencement 2011
![Page 29: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/29.jpg)
Live Mobile Delivery V2.0
Device support included everything we tried
2010: 241 Mobile viewers 2011: 2000+ Mobile viewers
![Page 30: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/30.jpg)
What to do about rising costs?
• Costs are variable based on traffic
• Traffic is a good thing – people are using the service
• Traffic is a bad thing – our costs suddenly skyrocket
• Go with the low-cost provider?
hXp://www.enterpriseirregulars.com/24193/cloud-‐compuLng-‐for-‐all-‐budgets/
![Page 31: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/31.jpg)
What rising costs?
$5,500
$3,000 $3,000 $3,200 $3,300
$0
$1,000
$2,000
$3,000
$4,000
$5,000
$6,000
0
2000
4000
6000
8000
10000
12000
2007 2008 2009 2010 2011
Traffic (GB)
Storage (GB)
![Page 32: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/32.jpg)
Ongoing Goals for CDN Services
• Infrastructure replacement and/or supplement, where cost-effective
• Reliability and performance of a global delivery network
• Stay up with the most current infrastructure/features – CDN upgrade cycle is short: latest and greatest usually
available on launch day
![Page 33: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/33.jpg)
Next Steps
• Operationalize mobile live streaming – Web page generation with device detection
– Auto-archiving (w/ content management)
– Auto-provisioning/self-service (“Easy as UStream?”) • Fully integrate with local asset management strategy
• Cost model
– Increases in scale have (so far) negated increases in cost – Expectation #1: some day our monthly bill will go up
– Expectation #2: when that day comes we will have to find a way to pay the bill
• Evaluate internal options for Flash streaming (e.g. on-campus to on-campus traffic)
![Page 34: The beginning CDN Implementation Examplesmedia.govtech.net/JPine/Bouthillier_CDN_Video_ITSummit2011.pdf · CDN Services for Video Encoding and Delivery! • The beginning! • CDN](https://reader036.fdocuments.net/reader036/viewer/2022062919/5f01b9197e708231d400ba2b/html5/thumbnails/34.jpg)
Thank You!
…and thanks to the help and efforts of our partners in…DCE, FAS, GSD, GSE, HAA, HDS, HPAC, HSPH, HUIT, iCommons…and others
Larry Bouthillier
Digital Video Services, HUIT