The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP
description
Transcript of The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP
The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP
Hayder Radha ,Mihaela van der Schaar
and Yingwei Chen
IEEE TRANSACTIONS ON MULTIMEDIA, VOL.3, NO.1,MARCH 2001
Outline
Introduction SNR FGS Video Coding Method FGS Coding with Adaptive
Quantization Hybrid Temporal-SNR Scalability with
an All FGS Structure Conclusions
Introduction
Video-Coding and Networking Minimal real-time processing and rate
control when large number of unicast Highly adaptable to unpredictable
bandwidth Low-complexity decoding and low-
memory requirements
Introduction(2)
Able to support both multicast and unicast applications
Scalable bitstream must be resilient to packet loss events
SNR FGS Video Coding
[ Rmin = Rb , Rmax = Rb + Re ]
SNR FGS Video Coding(2)
SNR FGS Video Coding -encoder
Two encoders
base layer->motion compensation
enhancement layer->fine-granular Each DCT FGS-residual frame
consists of NBP bitplanes
SNR FGS Video Coding -scanning order
Architecture for the SNR FGS Video Coding -decoder
SNR FGS Video Coding -performance
Compared with traditional SNR scalability video coding
SNR FGS Video Coding -performance(2)
SNR FGS Video Coding -performance(3)
SNR FGS Video Coding -conclusions
FGS exploits temporal redundancy only at the base layer
FGS is good for high motion sequences such as “movie trailers”,certain commercials and news clips with high-action content
SNR FGS Video Coding -conclusions
Base-layer could have a major impact on the overall performance of FGS
[R2,Rmax] could be significantly better than the average performance over the wider range[R1,Rmax]
FGS Coding with Adaptive Quantization
FGS-based AQ is achieved through bitplane shifting
Selected macroblocks within an FGS enhancement layer frame
Selected coefficients within the 8 * 8 blocks
Adaptive Quantization-Selective Enhancement
Adaptive Quantization-frequency weighting
Adaptive Quantization-combine SE with FW
Adaptive Quantization-notice
SE : macroblock-by-macroblock basis FW : use the same FW matrix Selective enhancement is a relative
operation Up-shifting operation does not
guarantee that a particular SE macroblock gets scanned earlier(MSB)
Adaptive Quantization-evaluation
Not improve the rate-distortion performance ,but rather to improve the visual quality
SE can be used to enhance a particular region
FW can reduce some of blockiness, but may softening some of the sharp edges and other finedetails
Adaptive Quantization-evaluation(2)
Hybrid Temporal-SNR Scalability
Temporal scalability : Enhance the motion smoothness of compressed video
F = FBL + FEL
Provide the flexibility of choosing between temporal scalability and SNR scalability (Users’ performance and real-time bandwidth)
all-FGS hybrid temporal-SNR scalability structure
Architecture for the all-FGS hybrid temporal-SNR scalability encoder
Architecture for the all-FGS hybrid temporal-SNR scalability decoder
Performance Evaluation of the Hybrid FGS Scalability Method
Performance Evaluation of the Hybrid FGS Scalability Method
Conclusions
MPEG-4 FGS framework Supporting unicast and multicast
Internet video application Adaptive quantization Hybrid temporal-SNR scalability
method