NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.
-
Upload
griffin-barrett -
Category
Documents
-
view
219 -
download
1
Transcript of NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.
![Page 1: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/1.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Media Compression
![Page 2: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/2.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
You are Here
Network
Encoder
Sender
Middlebox
Receiver
Decoder
![Page 3: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/3.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Why compress?
“Bandwidth Not Enough” “Disk Space Not Enough”
Size of Uncompressed DVD Movie =
![Page 4: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/4.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Why compress?
“Bandwidth Not Enough” “Disk Space Not Enough”
Size of Uncompressed DVD Movie = 720 x 576 x 3 x 25 x 60 x 120 =208.6GB
![Page 5: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/5.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Optical Disc Formats (1)
CD: ~650 MBDVD:
4.7 (4.38) GB (single layer) 8.5 (7.92) GB (dual layer) Single and dual sided (up to 18 GB) 1X max. read speed: ~10 Mb/s Video codec: MPEG-2
![Page 6: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/6.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
JPEG Compression
![Page 7: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/7.jpg)
Original Image (1153KB)
1:1
![Page 8: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/8.jpg)
Original Image (1153KB)
3.5:1
![Page 9: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/9.jpg)
Original Image (1153KB)
17:1
![Page 10: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/10.jpg)
Original Image (1153KB)
27:1
![Page 11: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/11.jpg)
Original Image (1153KB)
72:1
![Page 12: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/12.jpg)
Original Image (1153KB)
192:1
![Page 13: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/13.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Compression Ratio
Quality Size Ratio
Raw TIFF 1153KB 1:1
Zipped TIFF 982KB 1.2:1
Q=100 331KB 3.5:1
Q=70 67KB 17:1
Q=40 43KB 27:1
Q=10 16KB 72:1
Q=1 6KB 192:1
![Page 14: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/14.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Magic of JPEG
Throw away information we cannot see Color information “High frequency signals”
Rearrange data for good compression
Use standard compression
![Page 15: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/15.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Discard color information
Y
V U
![Page 16: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/16.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Color Sub-sampling
4:4:4
4:2:2
4:2:0
4:1:1
![Page 17: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/17.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
4:2:2 Sub-sampling
Y
V U
![Page 18: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/18.jpg)
Original Image (1153KB)
4:2:0
![Page 19: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/19.jpg)
Original Image (1153KB)
“4:1:0”
![Page 20: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/20.jpg)
![Page 21: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/21.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Discrete Cosine Transform
Demo
![Page 22: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/22.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Quantization
242 65
-54 -10
23 5
-4 -2
13 6
2 1
3 5
-1 -2
8 8
8 8
8 8
8 16
8 8
8 16
16 32
32 64
30 8
-6 -1
2 0
0 0
1 0
0 0
0 0
0 0
/ =
QuantizationTable
DC
AC
![Page 23: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/23.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Differential Coding
30 8
6 -1
2 0
0 0
1 0
0 0
0 0
0 0
25 3
2 1
1 0
0 0
4 0
0 0
1 0
0 0
27 3
2 1
1 0
0 0
4 0
0 0
1 0
0 0
30 8
6 -1
2 0
0 0
1 0
0 0
0 0
0 0
-5 3
2 1
1 0
0 0
4 0
0 0
1 0
0 0
2 3
2 1
1 0
0 0
4 0
0 0
1 0
0 0
![Page 24: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/24.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Zig-zag ordering
27 3
2 1
1 0
0 0
4 0
0 0
1 0
0 0
27, 3, 2, 4, 1, 1, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0
![Page 25: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/25.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Run-Length Encoding
27 3
2 1
1 0
0 0
4 0
0 0
1 0
0 0
27, 3, 2, 4, 1, 1, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0
(27, 1) (3, 1) (2, 1), (4, 1), (1, 2), (0, 5), (1, 1), (0, 4)
![Page 26: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/26.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Idea: Motion JPEG
Compress every frame in a video as JPEG
DVD-quality video = 208.6GB Reduction ratio = 27:1Final size = 7.7GB
![Page 27: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/27.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Video Compression
![Page 28: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/28.jpg)
![Page 29: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/29.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Temporal Redundancy
![Page 30: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/30.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Motion Estimation
![Page 31: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/31.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Bi-directional Prediction
![Page 32: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/32.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Watch for Motion Vectors
Demo
![Page 33: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/33.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
H.261
I-Frame
P-Frame
![Page 34: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/34.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
MPEG-1
B-Frame
![Page 35: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/35.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
MPEG Frame Pattern
Example display sequence: IBBPBBP …
Example encoding sequence: IPBBPBB
![Page 36: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/36.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Compression Ratio
Frame Type Typical Ratio
I 10:1
P 20:1
B 50:1
![Page 37: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/37.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Sequence
sequence header:• width• height• frame rate• bit rate• :
![Page 38: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/38.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
GOP: Group of Picture
gop header:• time• :
![Page 39: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/39.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Picture
pic header:• number• type (I,P,B)• :
![Page 40: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/40.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Picture
![Page 41: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/41.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Slice
![Page 42: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/42.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Macroblock
![Page 43: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/43.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Block
Y Y
Y Y
U
V
1 Macroblock =
![Page 44: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/44.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Structure Summary
![Page 45: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/45.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
For I-Frame
Every macroblock is encoded independently (“I-macroblock”)
![Page 46: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/46.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
For P-Frame
Every macroblock is either I-macroblock a motion vector + error terms wrt a
prev I/P-frame (“P-macroblock”)
![Page 47: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/47.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
For B-Frame
Every macroblock is either I-macroblock P-macroblock a motion vector + error terms wrt a
future I/P-frame 2 motion vectors + error terms wrt
a prev/future I/P-frame
![Page 48: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/48.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
MPEG-1/2 File Formats
(Packetized) Elementary streams, ES & PES Program streams PS (reliable mediums, e.g.,
DVD) Transport streams TS (for lossy mediums, e.g.,
on-air broadcast)MPEG-2 Elementary Encoder
MPEG-2 Elementary Encoder
Packetizer
Packetizer
Systems LayerMUX
Transport Stream
VideoSource
AudioSource
MPEG encoded streams
DataSource
Packetizer
Flow chart © Manish Karir
PES: *.m2v
PES: *.m2a
TS: *.ts *.m2t *.mpg
![Page 49: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/49.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Review: MPEG structure
ES, PS, TSSequenceGOPPictureSliceMacroblockBlock
![Page 50: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/50.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
MPEG Decoding (I-Frame)
EntropyDecoding
Dequantize
IDCT
101000101
![Page 51: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/51.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
MPEG Decoding (P-Frame)
EntropyDecoding
Dequantize
IDCT
101000101
PrevFrame
+
![Page 52: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/52.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
FutureFrame
MPEG Decoding (B-Frame)
EntropyDecoding
Dequantize
IDCT
101000101
PrevFrame
+
AVG
![Page 53: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/53.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
There is more..
Half-pel Motion PredictionSkipped Macroblocketc.
![Page 54: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/54.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
MPEG in Daily Life
MPEG Standards
Bit-rate Usage
MPEG-1 1.5Mbps VCD
MPEG-2 3-45 MbpsDVD, SVCD,
HDTV
MPEG-4 ScalableQuickTime,
DivX, AVCHD
![Page 55: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/55.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Camcorders in Daily Life
Different formats usedDV25 (MiniDV, DVCAM, DVCPRO)
Capacity: 1 hour ~ 13 GB Speed: 25 Mb/s (user data) Color sampling: 4:1:1 Compression ratio: ~10:1
![Page 56: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/56.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Codec Comparison
“M-JPEG” (e.g., DV) versus “MPEG”
No “perfect” codec -> application dependent
Compression Technique
“M-JPEG”(I-frames only)
“MPEG”(Temporal compression)
Compression ratio Low (10:1 to 30:1) High (>100:1)
Editing (frame-accurate)
Easy Difficult
Encoding/decoding complexity
Symmetric Asymmetric
Processing latency Low to Medium High
Multi-generation loss Medium High
![Page 57: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/57.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
High-Definition
Standard by ATSC 18 different sub-formats 720p and 1080i are the most
interesting 1280x720x60p, 1920x1080x60i (30p)
1080p is non-standard, but available 1.4 Gb/s raw bandwidth 10 – 20 Mb/s compressed (distribution,
broadcast) 100 – 135 Mb/s compressed (pro tapes:
DVCPROHD, HDCAM; for editing)
![Page 58: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/58.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Consumer HD
HDV: MPEG-2 19 (720p) / 25 Mb/s (1080i) Tape format http://www.hdv-info.org
AVCHD: H.264 5 to 20 Mb/s Hard disk format http://www.avchd-info.org/
![Page 59: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/59.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Optical Disc Formats (2)
HD DVD (now dead) Capacity: 15 GB and 30 GB 1X speed: 36 Mb/s Video codec: VC-1, H.264, MPEG-2
Blu-ray Capacity: 25 GB and 50 GB 1X speed: 36 Mb/s Video codec: VC-1, H.264, MPEG-2
![Page 60: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/60.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Recent Codec: H.264
Same quality at half the rateEncoding complexity: ~4XHow:
Variable block size motion compensation
Multiple reference frames Deblocking filter ...
Also called MPEG-4 Part 10 or AVC
![Page 61: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/61.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Hands-On
Download source code, compile and play with ffmpeg mpeg_stat Video ‘Surfing_short.m2t’ from course
web site (98 MB, HDV, transport stream)
Try different MPEG-1/2 encoding parameter
![Page 62: NUS.SOC.CS5248-2009 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Media Compression.](https://reader038.fdocuments.net/reader038/viewer/2022102909/56649f065503460f94c1c03d/html5/thumbnails/62.jpg)
NUS.SOC.CS5248-2009Roger Zimmermann (based in part on slides by Ooi Wei Tsang)
Impact on Systems Design
How to package data into packets? How to deal with packet loss? How to deal with bursty traffic? How to predict decoding time? : :