Seismic shifts in the Codec Landscape - Xilinx LVS... · Private and confidential Seismic shifts in...
Transcript of Seismic shifts in the Codec Landscape - Xilinx LVS... · Private and confidential Seismic shifts in...
Private and confidential
Seismic shifts in the Codec LandscapeFabio Murra – SVP, Product & [email protected]
Copyright © 2019 V-Nova Ltd. All rights reserved
Unique compression technologies to dramatically improve video and image quality to
all screens over any network
•••
Copyright © 2019 V-Nova Ltd. All rights reserved
Copyright © 2019 V-Nova Ltd. All rights reserved Copyright © 2016 V-Nova Ltd. All rights reserved Copyright © 2016 V-Nova Ltd. All rights reserved
Smartphone users in China
Copyright © 2019 V-Nova Ltd. All rights reserved 5Copyright © 2016 V-Nova Ltd. All rights reserved Copyright © 2016 V-Nova Ltd. All rights reserved
4K TV & UHD in China
Copyright © 2019 V-Nova Ltd. All rights reserved
Copyright © 2019 V-Nova Ltd. All rights reserved 7Copyright © 2016 V-Nova Ltd. All rights reserved Copyright © 2016 V-Nova Ltd. All rights reserved
The effects of video compression: degradation of details
Copyright © 2019 V-Nova Ltd. All rights reserved
Compression makes a real difference
P+ (LCEVC h.264)QSV (h.264)
Copyright © 2019 V-Nova Ltd. All rights reserved
P+ (LCEVC h.264)QSV (h.264)
Copyright © 2019 V-Nova Ltd. All rights reserved
Copyright © 2019 V-Nova Ltd. All rights reserved
Copyright © 2019 V-Nova Ltd. All rights reserved
https://medium.com/netflix-techblog/optimized-shot-based-encodes-now-streaming-4b9464204830
Copyright © 2019 V-Nova Ltd. All rights reserved
Copyright © 2019 V-Nova Ltd. All rights reserved
Multiple tools for multiple jobs …
Copyright © 2019 V-Nova Ltd. All rights reserved 15Copyright © 2016 V-Nova Ltd. All rights reserved Copyright ©
Codec Choices – the key dimensions
Better graph
Device Support Reach
Compression EfficiencyQuality
ComplexityCost
Copyright © 2019 V-Nova Ltd. All rights reserved 16
Quality / Compression Efficiency
Copyright © 2019 V-Nova Ltd. All rights reserved 17Copyright © 2016 V-Nova Ltd. All rights reserved Copyright ©
Comparing Video Codec Compression Efficiency
0 20 40 60 80 100 120 140 160
compression
VVCEVCAV1HEVCh.264
Recent experiment comparing reference implementation of popular codecs• Average across UHD and HD clips• 10s self-similar clips• Metric PSNR YUV• GOP = 1s• Big dependency on implementation & test conditions (clips, operating points, parameters, settings, etc)
2% - 10%10% - 28%30% - 42%
https://www.bbc.co.uk/rd/blog/2019-05-av1-codec-streaming-processing-hevc-vvchttps://www.streamingmedia.com/Articles/Editorial/Featured-Articles/HEVC-AV1-VVC-How-to-Make-Sense-of-2019s-World-of-Codecs-133589.aspx
Copyright © 2019 V-Nova Ltd. All rights reserved 18Copyright © 2016 V-Nova Ltd. All rights reserved Copyright ©
Comparing Different Encoder implementations
Source: Codec VMAF quality rankings from Moscow State University
Copyright © 2019 V-Nova Ltd. All rights reserved 19
Cost / Complexity
Copyright © 2019 V-Nova Ltd. All rights reserved 20
Codec Efficiency comes at a cost
0 2 4 6 8 10
complexity
Chart Title
h.264 HEVC AV1 EVC VVC
0 20 40 60 80 100 120 140 160
compression
50x more complex
2.5x more efficient
VVC
EVC
AV1
HEVC
h.264
VVC
EVC
AV1
HEVC
h.264
Copyright © 2017 V-Nova Ltd. All rights reserved Copyright © 2016 V-Nova Ltd. All rights reserved Copyright © 2016 V-Nova Ltd. All rights reserved
Sources: https://aws.amazon.com/medialive/pricing/ / http://www.streamingmedia.com/Articles/Editorial/Featured-Articles/Return-of-the-Codec-Wars-A-New-Hope-a-Streaming-Summer-Sequel-126339.aspx
h.264HEVC
+h.264
VP9+
h.264
AV1+
h.264h.264 + LCEVC
Encoding time 1x ~4x ~3x >500x <1x
HD Cost per hour (approx. – single level) $1 $4.00 $3.00 Not available $0.60
4K Cost per hour (approx. – single level) Not available $16.00 $16.00 Not available $4.00
50 HD channels per year (incl. typical 12-month commitment discounts) $440,000 $1,750,000 $1,320,000 Not available $260,000
5 UHD channels per year (incl. typical 12-month commitment discounts) Not available $700,000 $700,000 Not available $175,000
Note: Annual estimates assume ABR profile with multiple output levels
Codec complexity translates to operational costs
Indicative encoding costs (large operator)
Copyright © 2017 V-Nova Ltd. All rights reserved
Other Costs to consider
> Royalties• Per device, per subscriber, per title• Poorly defined licensing pools and undeclared patent holders
have been a barrier to HEVC adoption> New equipment/integration
• New encoding hardware/software• Operating multiple codecs for different devices is expensive• Required updates to consumer devices and apps
Copyright © 2019 V-Nova Ltd. All rights reserved
Device Support
Copyright © 2019 V-Nova Ltd. All rights reserved 24Copyright © 2016 V-Nova Ltd. All rights reserved Copyright © 2016 V-Nova Ltd. All rights reserved
Usage of Codecs
Source: Bitmovin survey
Copyright © 2019 V-Nova Ltd. All rights reserved
Codec support - HEVC
HEVC support:Global: 16.4%China: 14.2%
Source: http://caniuse.com/
Copyright © 2019 V-Nova Ltd. All rights reserved
Codec support – AV1
AV1 support:
Global: 30.9%China: 2.3%
Copyright © 2019 V-Nova Ltd. All rights reserved
Codec support – H.264
H.264 support
97.1%
Source: http://caniuse.com/
Copyright © 2019 V-Nova Ltd. All rights reserved
Codec support – VP9
VP9 support:
92%
Source: http://caniuse.com/
Copyright © 2019 V-Nova Ltd. All rights reserved
Copyright © 2019 V-Nova Ltd. All rights reserved Copyright © 2016 V-Nova Ltd. All rights reserved Copyright © 2016 V-Nova Ltd. All rights reserved
> Market needs and requirements presented by V-Nova at MPEG in Macau, October 2018
> Request for software-capability extension on top of existing and future video codecs
> Request co-signed and supported by individuals from 28 different companies, including:• Facebook, ONE Media/Sinclair, Zee Entertainment, Times of India, CNN, Astro, J:com, Vodafone, Telekom Malaysia, Measat, Associated Press, SHAREit, Hitachi Visualisation Systems, Canon Europe, …
LCEVC Call for Proposal
Copyright © 2019 V-Nova Ltd. All rights reserved Copyright © 2016 V-Nova Ltd. All rights reserved Copyright © 2016 V-Nova Ltd. All rights reserved
> Enhancement• Applicable to any ‘base’ codec• Similar quality performance to that of the next generation codec
> Low complexity• Reduces the processing costs of encoding• Implementable in software on existing devices
LCEVC (Low Complexity Enhancement Video Coding)
Copyright © 2019 V-Nova Ltd. All rights reserved
Copyright © 2019 V-Nova Ltd. All rights reserved Copyright © 2016 V-Nova Ltd. All rights reserved Copyright © 2016 V-Nova Ltd. All rights reserved
The LCEVC effect
0 2 4 6 8 10
Chart Title
h.264 HEVC AV1 EVC VVC
0 20 40 60 80 100 120 140 160
VVC
EVC
AV1
HEVC
h.264
VVC
EVC
AV1
HEVC
h.264
Efficiency
Complexity
35% - 60%
20% - 40%
1.5 – 4x3 – 5x
Copyright © 2019 V-Nova Ltd. All rights reserved
LCEVC support
VP9 support:
~ 97%
Copyright © 2019 V-Nova Ltd. All rights reserved Copyright © 2016 V-Nova Ltd. All rights reserved Copyright © 2016 V-Nova Ltd. All rights reserved
Impact of LCEVC on live video
Enhanced x.264 (LCEVC)x.264
EXAMPLE: LIVE CBR 1.4 MBPS
Copyright © 2019 V-Nova Ltd. All rights reserved
Difference you can measure
up to 4xthroughput increase
Any codec(H.264, HEVC, VP9, AV1, VVC)
up to 50%Bandwidth savings
Copyright © 2019 V-Nova Ltd. All rights reserved
Difference you can measure
4.5xengagement
50-70% lowerdelivery costs
Up to 8xreach
Copyright © 2019 V-Nova Ltd. All rights reserved
Thank You