O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia...
-
Upload
jared-stephens -
Category
Documents
-
view
221 -
download
1
Transcript of O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia...
![Page 1: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/1.jpg)
OBJECTIVE PERFORMANCE EVALUATION OF THE HEVC MAIN STILL PICTURE PROFILE
EE5359
Multimedia Project Proposal
Under Guidance of
Dr. K.R.Rao
By
Deepu Sleeba Philip
1001038966
![Page 2: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/2.jpg)
1. ACRONYMS AND ABBREVIATIONS AMVP: Advanced motion vector prediction AVC: Advanced Video Coding BD-PSNR: Bjontegaard metric calculation CB: Coding Block CIF: Common Intermediate Format CU: Coding Unit CTB: Coding Tree Block CTU: Coding Tree Unit DCT: Discrete Cosine Transforms DST: Discrete Sine Transform EBCOT: Embedded block coding with optimized truncation GIF: Graphics interchange format HEVC: High Efficiency Video Coding HD: High Definition JCT-VC: Joint Collaborative Team on Video Coding MC: Motion Compensation ME: Motion Estimation MPEG: Moving Picture Experts Group
![Page 3: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/3.jpg)
MSP: Main Still Picture Profile MV: Motion Vector NGOV: Next Generation Open Video PNG: Portable Network Graphics PSNR: Peak Signal To Noise Ratio PU: Prediction Unit QP: Quantization Parameter QCIF: Quarter Common Intermediate Format RD: Rate Distortion SAO: Sample Adaptive Offset SAD: Sum of Absolute Differences SATD: Sum of Absolute Transformed Differences (SATD) SHVC: Scalable HEVC SSIM: Structural Similarity SVC: Scalable Video Coding TM: True Motion TU: Transform Unit URQ: Uniform Reconstruction Quantization VCEG: Video Coding Experts Group
![Page 4: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/4.jpg)
OBJECTIVE
Rate-distortion performance analysis of the HEVC MSP profile in comparison to WebP
The peak-signal-to-noise ratio (PSNR) and the average bit rate savings in terms of Bjøntegaard delta rate(BD) is considered
The implementation complexity will be evaluated based on the encoding time.
![Page 5: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/5.jpg)
OVERVIEW OF COMPARISON SCHEMES
JPEG Block based transform coding approach Step1: Picture is partitioned into non-
overlapping 8x8 blocks. Step2:Each of the block is transformed into
freq domain by 2-D DCT. -transmitted by using entropy
coding based on Huffman Codes.
![Page 6: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/6.jpg)
JPEG XR-The image is divided into 4X4 blocks for transform coding stage.
-An integer approximation of 4x4 DCT is used(Photo Core Transform)
-Adaptive Huffman Coding is used for entropy coding
JPEG 2000-Multi resolution approach based on wavelet transform.
Context Adaptive arithmetic coding
![Page 7: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/7.jpg)
HEVC
Initial goal 50% reduction in bit rate at the same quality compared to H.264
Better coding efficiency – more than 35% reduction in bit rate.
Support of stereo and multiview Increased use of parallel processing Resolution :
HEVC: up to 8k UHD(8192X4320) H.264: up to 4K UHD (4096X2160)
![Page 8: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/8.jpg)
ENCODER-DECODER HEVC BLOCK DIAGRAM
Figure.1 [3]
![Page 9: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/9.jpg)
INTRA PREDICTION MODES IN HEVC
HEVC has 35 luma intra prediction modes (Figure 2) Intra prediction can be done at different block sizes,
ranging from 4 X 4 to 64 X 64 (whatever size the PU has) (Figure 3)
HEVC also includes a planar and DC intra prediction modes
• Figure 3:Luma intra prediction modes for different PU sizes in HEVC [8]
Figure 2: Modes and directional orientations
for intra picture prediction for HEVC [1]
![Page 10: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/10.jpg)
WEBP It is based on the intra-frame coding of
the VP8 video format[15]
It is a block-based transformation scheme with eight bits of color depth and a luminance-chrominance model with chroma sub sampling by a ratio of 1:2 (YCbCr4:2:0)
![Page 11: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/11.jpg)
INTRA PREDICTION MODES IN WEBP
WebP has three types of blocks: 4x4 luma 16x16 luma 8x8 chroma
Modes: H_PRED (horizontal prediction): Fills each
column of the block with a copy of the left column, L.
V_PRED (vertical prediction) : Fills each row of the block with a copy of the above row, A.
![Page 12: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/12.jpg)
DC_PRED (DC prediction): Fills the block with a single value using the average of the pixels in the row above A and the column to the left of L[16].
TM PRED (True Motion prediction): In addition to the row A and column L, TM_PRED uses the pixel C above and to the left of the block. Horizontal differences between pixels in A and vertical differences between pixels in L are propagated (starting from C) to form the prediction block.
![Page 13: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/13.jpg)
WEBP ENCODER BLOCK DIAGRAM
Figure 4.[6]
![Page 14: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/14.jpg)
ANIMATED IMAGE
This small gif image of 279x193, this short video weighs as much as 1.5MB.The WebP animation above is generated on-the-fly by Cloudinary when the dynamic URL is accessed. It looks the same as the original image, but weighs only 419KB. This means we saved 72% of file size, bandwidth and load time, compared to the original 1.5MB animated GIF.
Figure 5.Bored_animation.gif [32]
![Page 15: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/15.jpg)
M
m
N
n
nmynmxNM
MSE1 1
2,,*
1
MSE
LPSNR
2
10log10
IMAGE QUALITY MEASUREMENTThe compression quality can be measured by Objective quality measure- PSNR, MSE Structural quality measure- SSIMMSE and PSNR for a NxM pixel image are defined
as
(1)
(2) dB0
where x is the original image and y is the reconstructed image. M and N are the width and height of an image and ‘L’ is the maximum pixel value in the NxM pixel image.
![Page 16: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/16.jpg)
IMPLEMENTATION HEVC compression efficiency will be
measured with the HM Test Model [12]. WebP is downloaded from [19].
The rate distortion in HEVC and WebP for MSP is done by plotting graphs for PSNR and BD rate.
The implementation complexity will be evaluated based on the encoding time.
![Page 17: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/17.jpg)
REFERENCE [1] Joint Collaborative Team On Video Coding Information website-
http://www.itu.int/en/ITU-T/studygroups/2013-2016/16/Pages/video/jctvc.aspx
[2] H.261: Video Codec for Audiovisual Services at px64 kbit/s,” http://www.itu.int/rec/T-REC-H.261-199303-I/en”
[3] G. J. Sullivan et al, “Overview of the High Efficiency Video Coding (HEVC) Standard”, IEEE Transactions Circuits and Systems for Video Technology, Vol. 22, No. 12, pp. 1649-1668, Dec. 2012.
[4] N. Ahmed , T. Natarajan and K.R. Rao, “Discrete Cosine Transform”, IEEE Transactions on Computers, Vol. C-23, pp. 90-93, Jan. 1974.
[5] P.K Ranjan, D. Pacharla, B. Ravindran and D. Mani "Quality evaluation of HEVC Main Still Picture with limited coding tree depth and intra modes", Advances in Computing, Communications and Informatics, New Delhi.
[6] S. Bultje and M. Frost ,Access website http://www.webmproject.org/vp9/ PPT on “WebM and the new Open Video Codec”.
![Page 18: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/18.jpg)
[7] M. Budagavi and V. Sze, http://www.rle.mit.edu/eems/wp-content/uploads/2014/06/H.265-HEVC-Tutorial-2014-ISCAS.pdf, " Design and Implementation of Next Generation Video Coding Systems (H.265/HEVC Tutorial)".
[8] http://www.uta.edu/faculty/krrao/dip/Courses/EE5359/index_tem.html,S.C Kodpadi ,"Comparative study of Intra Frame Coding efficiency in HEVC and VP9" EE5359, UTA, spring 2014
[9] J. Bankoski et al, “Towards a Next Generation Open source Video Codec” SPIE Vol. 8666 Page 2, Dec. 2013.
[10] D. Grois et al, “Performance Comparison of H.265/ MPEG-HEVC, VP9, and H.264/MPEGAVC Encoders”, IEEE PCS 2013, pp 394-397, San José, CA, USA, Dec 8-11, 2013
[11] M.P. Sharabayko et al, "Intra Compression Efficiency in VP9 and HEVC" Applied Mathematical Sciences, Vol. 7, no. 137, pp.6803 – 6824, Hikari Ltd, 2013
[12] HM Reference Software- https://hevc.hhi.fraunhofer.de/HM-doc/
[13]https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/trunk/doc/software-manual.pdf
![Page 19: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/19.jpg)
[14] G. Bjøntegaard, “Calculation of average PSNR differences between RD-curves”, ITU-T Q.6/SG16 VCEG 13th Meeting, Document VCEG-M33, Austin, USA, Apr. 2001.
[15]F. Liang, X. Peng and J. Xu, "A light weight HEVC Encoder for Image Coding" MSRA-MOE joint key lab, Univ. of Sci and Technology of China, Hefei China
[16] J. Bankoski, P. Wilkins and Xu Yaowu "Technical Overview of VP8,an open source video codec for the web", International conference on Multimedia and Expo 2011,pages:1-6
[17] T. Nguyen and D. Marpe, "Objective Performance Evaluation of the HEVC Main Still Picture Profile" IEEE Transactions on circuits and systems for video technology ,15 September 2014 page:1
[18] “The WebM Project.” [Online]. Available: http://www.webmproject.org/
[19] “WebP Google Developers.” [Online]. Available: http://code.google. com/speed/webp/
[20] “Kodak Lossless True Color Image Suite.” [Online]. Available: http://r0k.us/graphics/kodak/
[21]P.K. Bansal, M.N. Shukla and A.S. Motra, "VP8 Encoder-Cost effective implementation", SoftCOM,2012 pages(1-6)
![Page 20: O BJECTIVE P ERFORMANCE E VALUATION OF THE HEVC M AIN S TILL P ICTURE P ROFILE EE5359 Multimedia Project Proposal Under Guidance of Dr. K.R.Rao By Deepu.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649e035503460f94aee3b9/html5/thumbnails/20.jpg)
[22] Z. Xiong et.al, “A comparative study of DCT- and wavelet-based image coding,” IEEE Transactions on Circuits and Systems for Video Tech., vol.9, pp. 692-695, Aug. 1999.
[23] Visual studio download for students for free- www.dreamspark.com [24] Tortoise SVN download- http://tortoisesvn.net/downloads.html [25]MPL
Website-http://www.uta.edu/faculty/krrao/dip/Courses/EE5359/index_tem.html [26] K.R. Rao, D.N. Kim and J.J. Hwang, “Video Coding Standards: AVS China,
H.264/MPEG-4 Part 10, HEVC, VP6, DIRAC and VC-1”, Springer, 2014. [27] http://www.imagemagick.org/script/install-source.php : program for
converting to YUV format. [28] V. Sze ,M. Budagavi and G. J. Sullivan (Editors), "High Efficiency Video
Coding (HEVC): Algorithms and Architectures," Springer,2014 [29] Iain Richardson/Vcodex.com “HEVC An Introduction to High Efficiency
Video Coding” 2013 [30] Iain Richardson, “Video Codec Design: Developing Image and Video
Compression Systems”, Wiley, 2002. [31]http://www.imageprocessingplace.com/root_files_V3/
image_databases.htm [32]http://cloudinary.com/blog/
animated_webp_how_to_convert_animated_gif_to_webp_and_save_up_to_90_bandwidth