Video Media

48
Video Media Department of Computer Education KMUTNB

description

Video Media. Department of Computer Education KMUTNB. Video Media. Video features in a range of Multimedia application. Entertainment Broadcast television and VCR/DVD recordings Interpersonal Video telephony and videoconferencing Interactive Windows containing short video clips. - PowerPoint PPT Presentation

Transcript of Video Media

Page 1: Video Media

Video Media

Department of Computer EducationKMUTNB

Page 2: Video Media

724401 2

Video MediaM

ultim

ed

iaVideo features in a range

of Multimedia application

• Entertainment – Broadcast television and VCR/DVD

recordings

• Interpersonal– Video telephony and videoconferencing

• Interactive– Windows containing short video clips

Page 3: Video Media

724401 3

Video MediaM

ultim

ed

iaBroadcast Television

• 525 Lines– NTSC American standard– 60 Fields / second– 30 Frames / second

• 625 Lines– PAL European standard /CCIR/SECAM– 50 Fields / second– 25 Frames / second

Page 4: Video Media

724401 4

Video MediaM

ultim

ed

iaScanning illustrated

Time

Volt

ag

e 1 2 3 4 5 6

123456

720 Sample

720 pixel

Page 5: Video Media

724401 5

Video MediaM

ultim

ed

iaType of Scanning

• Progressive = every scan line done in turn.

• Interlaced = every other scan line done.– Creates two fields: odd field and even field.– NTSC: 262.5 lines per field at 60 fields per

sec.– PAL: 312.5 lines per field at 50 fields per

sec.

• Fields are separated in time.

Page 6: Video Media

724401 6

Video MediaM

ultim

ed

iaComputer & TV

1 TV Frame = 2 Field

interlaced scan

1 Computer Frame

Progressive scan

Page 7: Video Media

724401 7

Video MediaM

ultim

ed

iaComputer & TV

Television

Computer1 Frame

1 Frame

1 2 3 4 5 6 7 .. ….. 625

……. …..

……. …..

1 3 5 7 .. ….. 625 2 4 6 8 ……

624

…….

312.5 Even Field

312.5 Odd Field

Page 8: Video Media

724401 8

Video MediaM

ultim

ed

iaVideo capture with both

fieldComputer 1

1 2

3 4

5 6

7 .. …

.. 625

……

. …..

……

. …..

1 3

5 7

.. …..

625

2 4

6 8

……

624

……

.

312

.5

Even

Field

312

.5

Odd

Field

Television Computer 2

1 2

3 4

5 6

7 .. …

.. 624

……

. …..

Page 9: Video Media

724401 9

Video MediaM

ultim

ed

iaVideo capture with one

fieldComputer 1

1 2

3 4

5 6

7 .. ..3

12

….

……

. …..

1 3

5 7

.. …..

625

2 4

6 8

……

624

……

.

312

.5

Even

Field

312

.5

Odd

Field

Television

Discard

1MPEG ( VCD)

From Interlaced to Progressive system discard resolution in half

Page 10: Video Media

724401 10

Video MediaM

ultim

ed

iaScanning Sequence in TV

Interlaced scanning principles

Page 11: Video Media

724401 11

Video MediaM

ultim

ed

iaScanning Sequence in TV

525-line systems : 262.5 each field, 240 visible625-line systems : 312.5 each field, 288 visible

Page 12: Video Media

724401 12

Safe Frame

From Camera View Finder

To TV

To Digital File

Page 13: Video Media

724401 13

Video MediaM

ultim

ed

iaBroadcast Television

• Video resolution and quality

Page 14: Video Media

724401 14

Video MediaM

ultim

ed

ia3 Main Properties of a

Color

• Hue: The actual color of the source, each color has a different frequency/wavelength and eye determines the color from this.

• Saturation: The strength of vividness of the color, a pastel color has a lower level of saturation than a color such as red.

• Brightness : The amount of energy that stimulates the eye and varies on a gray scale from black (lowest) Through to white(highest)

Page 15: Video Media

724401 15

Video MediaM

ultim

ed

iaLuminance & Chrominance

• Luminance : is used to refer to the brightness of a source, and the hue and saturation

• Chrominance: is used to refer to the color characteristics.

Page 16: Video Media

724401 16

Video MediaM

ultim

ed

iaTV Color Signals

Component Signal

Luminance

Chr omi nance

Traditional monochrome TV

White --> Black

Magnitude of the 3 electrical signals that energize the R,G,B Phosphors

0.299R + 0.587G + 0.114B

Page 17: Video Media

724401 17

Video MediaM

ultim

ed

iaComposite Video Signals

Ys = 0.299 Rs + 0.587 Gs + 0.114 BsCr = Rs - YsCb = Bs - Ys

Ys is amplitude of luminance signalRs, Gs, Bs is magnitude of 3 color

component signals

Page 18: Video Media

724401 18

Video MediaM

ultim

ed

iaComposite Video Signals

R

G

B

+

-

-Cr

Ys

Cb

-

Rs

Gs

Bs

monochrome

+

+Composite Video Signal

Page 19: Video Media

724401 19

Video MediaM

ultim

ed

iaChrominance components

From Ys, Cr, CbPAL : Y = 0.299 R + 0.587 G + 0.114 B

U = 0.493 (B - Y) V = 0.877 (R - Y)

NTSC : Y = 0.299 R + 0.587 G + 0.114 B

I = 0.74 (R-Y) - 0.27(B-Y) Q = 0.48 (R-Y) + 0.41(B-Y)

Page 20: Video Media

724401 20

Video MediaM

ultim

ed

iaSignal bandwidth

Baseband spectrum of color television signals in NTSC system 42NTSC : Y = . MHz

2 2 2 2=2 2 2 2 2= 1

Page 21: Video Media

724401 21

Video MediaM

ultim

ed

iaSignal bandwidth

Baseband spectrum of color television signals in PAL system 2 2 2: =5 . 5

2 2 2 2= 3 2 2 2 2=3

Page 22: Video Media

724401 22

Multimedia SummaryM

ultim

ed

iaDigital Video Frames

• Almost always progressive• 3 planes of pixel values (Y, U, and

V)• Pixel depth• Geometry of each plane: width x

height– Chrominance is generally

subsampled.

Page 23: Video Media

724401 23

Video MediaM

ultim

ed

iaDigital video

• The visual perception of the eye have less sensitive for color than luminance

• This means that 2 chrominance signals can tolerate a reduced resolution relative to that used for the luminance signal

• Saving in terms of resulting bit rate and transmission bandwidth

Page 24: Video Media

724401 24

Video MediaM

ultim

ed

iaDigital video standard

• International Telecommunications Union Radiocommunications Branch (ITU-R)

• Formerly known as the Consultative Committee for International Radiocommunications (CCIR)

Recommendation CCIR-601

Page 25: Video Media

724401 25

Video MediaM

ultim

ed

iaCCIR-601

• Standard established for digitizing NTSC and PAL signals

DigitalComponent

AnalogCounterpart

CCIR-601Recommendation

Height Lines NTSC: 480PAL: 576

Width Continuousvoltage changesalong scan line.

Sample at 13.5 MHzResults in 702 pixelsRecommended 720

Pixel depth Voltage range. Gamma-corrected8-bit sample.

Chrominancesubsampling

Bandwidthdifferences

4:2:2, 4:2:0, 4:1:1

Page 26: Video Media

724401 26

1,4

1,3

1,2

Video MediaM

ultim

ed

iaVideo Color Storing

YCr

Cb

1,1

2,4

2,3

2,2

2,1

3,4

3,3

3,2

3,1

4,4

4,3

4,2

4,1

1,4

1,3

1,2

YCr

Cb

1,1

2,4

2,3

2,2

2,1

3,4

3,3

3,2

3,1

4,4

4,3

4,2

4,1

The visual perception of the eye have less sensitive for color than luminance

From Source Storing method

Page 27: Video Media

724401 27

1,4

1,3

1,2

Video MediaM

ultim

ed

iaVideo Color Playback

YCr

Cb

1,1

2,4

2,3

2,2

2,1

3,4

3,3

3,2

3,1

4,4

4,3

4,2

4,1

1,4

1,3

1,2

YCr

Cb

1,1

2,4

2,3

2,2

2,1

3,4

3,3

3,2

3,1

4,4

4,3

4,2

4,1

1,1

1,1

1,1

1,1 3,

13,1

3,1

3,1

3,2

3,2

3,3

3,3

3,4

3,4

Cr,Cb Cr,Cb

Playback process

Page 28: Video Media

724401 28

Video MediaM

ultim

ed

iaVideo Digitization Formats

4:2:2 means 2:1 horizontal downsampling, no vertical downsampling. (Think 4 Y samples for every 2 Cb and 2 Cr samples in a

scanline.) 4:1:1 ought to mean 4:1 horizontal downsampling,

no vertical. (Think 4 Y samples for every 1 Cb and 1 Cr samples in a

scanline.) It is often misused to mean the same as 4:2:0 .

4:2:0 means 2:1 horizontal and 2:1 vertical downsampling. (Think 4 Y samples for every Cb and Cr samples in a scanline.)

Page 29: Video Media

724401 29

Video MediaM

ultim

ed

ia4:2:2

• Use in television Studio• For every 4 luminance samples,

take 2 chrominance samples from odd lines and 2 from even lines.

• Chrom. planes just as tall, half as wide.

• JPEG does this.

Page 30: Video Media

724401 30

Video MediaM

ultim

ed

ia4:2:2

Sample positions with 4:2:2 digitization format

Page 31: Video Media

724401 31

Video MediaM

ultim

ed

ia4:2:2

Sample positions with 4:2:2 digitization format

1,4

1,3

1,2

YCr

Cb

1,1

2,4

2,3

2,2

2,1

3,4

3,3

3,2

3,1

4,4

4,3

4,2

4,1

1,4

1,3

1,2

YCr

Cb

1,1

2,4

2,3

2,2

2,1

3,4

3,3

3,2

3,1

4,4

4,3

4,2

4,1

From Source Storing method

Every 4 pixel

Keep 2 odd

Keep 2 even

Storage size Y+Cr+Cb Storage size Y+0.5Cr+0.5Cb

Page 32: Video Media

724401 32

Video MediaM

ultim

ed

ia4:2:0

• Used in Digital Video broadcast application

• 2 chrominance samples for every 4 luminance samples, odd lines only.

• Chrominance halved in both directions.

• MPEG generally does this.

Page 33: Video Media

724401 33

Video MediaM

ultim

ed

ia4:2:0

Sample positions with 4:2:0 digitization format

Page 34: Video Media

724401 34

Video MediaM

ultim

ed

ia4:2:0

Sample positions with 4:2:0 digitization format

1,4

1,3

1,2

YCr

Cb

1,1

2,4

2,3

2,2

2,1

3,4

3,3

3,2

3,1

4,4

4,3

4,2

4,1

1,4

1,3

1,2

YCr

Cb

1,1

2,4

2,3

2,2

2,1

3,4

3,3

3,2

3,1

4,4

4,3

4,2

4,1

From Source Storing method

Every 4 pixel

Keep 2 odd

Keep 0 even

Storage size Y+Cr+Cb Storage size Y+0.25Cr+0.25Cb

Page 35: Video Media

724401 35

Video MediaM

ultim

ed

ia4:2:0

4:2:0 playback process

1,2

YCr

Cb

1,1 2,

2

2,1

1,2

YCr

Cb

1,1

2,2

2,1Play

Page 36: Video Media

724401 36

Video MediaM

ultim

ed

ia4:2:0

• To avoid flicker effect with the chrominance signal– the receiver uses the same chrominance value

from the sampled lines for the misslines

• Large-screen flicker effects are often reduced by– storing the incoming digitized signals of each

field in a memory buffer– Double the normal rate 100/120 Hz then used

with the stored set of signals used for the 2 field

Page 37: Video Media

724401 37

Video MediaM

ultim

ed

iaHDTV

• High-Definition Television• Older 4/3 aspect ratio 1440 x 1152 pixels• newer 16/9 aspect ratio 1920 x 1152

pixels• 1080 visible lines per frame• 4:2:2 digitization for studio application

– Frame rate 50/60 Hz

• 4:2:0 digitization for broadcast application– Frame rate 25/30 Hz

Page 38: Video Media

724401 38

Video MediaM

ultim

ed

iaSIF

• Source Intermediate Format• Used in Video Cassette Recorders (VCR)• Used Half spatial resolution in both

horizontal and vertical in 4:2:0 format• Frame rate 30 Hz for 525 line, 25 Hz for

625 line• Progressive (non interlaced) scanning• The receiver estimated by interpolating

between each pair of value missing line

Page 39: Video Media

724401 39

Video MediaM

ultim

ed

iaSIF and CIF

Sample positions for SIF and CIF

Page 40: Video Media

724401 40

Video MediaM

ultim

ed

iaSIF and CIF

Sample positions with 4:2:0 digitization format

1,4

1,3

1,2

YCr

Cb

1,1

2,4

2,3

2,2

2,1

3,4

3,3

3,2

3,1

4,4

4,3

4,2

4,1

1,3

Y1,1

3,3

3,1

From Source Storing method

Storage size Y+Cr+CbStorage size 0.25Y+0.0625Cr+0.0625Cb

CrCb

2,2

2,2

Page 41: Video Media

724401 41

Video MediaM

ultim

ed

iaSIF and CIF

Sample positions with 4:2:0 digitization format

1,3

1,3

1,1

Y Cr All 2 ,2

Cb All 2 ,2

1,1

1,3

1,3

1,1

1,1

3,3

3,3

3,1

3,1

3,3

3,3

3,1

3,1

Playback

1,3

Y1,1

3,3

3,1

Storing method

CrCb

2,2

2,2

Page 42: Video Media

724401 42

Video MediaM

ultim

ed

iaWhen Capture from Video

Tape

Sample positions with 4:2:0 digitization format

1,3

Y1,1

3,3

3,1

From Video Tapeor Home use Quality Signal

2,2

2,2 1,

3

YCr

Cb

1,1 3,

3

3,1

Capture to Computer

360x288360x288

VideoTape

VideoClip

Page 43: Video Media

724401 43

Video MediaM

ultim

ed

iaCIF

• Common Intermediate Format• Defined for use in Videoconferencing

applications• Typical bit rate used is a single 64 kbps ISDN

channel• Can multiple channel for high bit rate

4CIF: Y= 720 x 576Cb = Cr = 360 x 288

16CIF: Y= 1440 x 1152Cb = Cr = 720 x 576

Page 44: Video Media

724401 44

Video MediaM

ultim

ed

iaCIF

CIF 6 4 kbpsCIF 6 4 kbps

360x288

360x288

CIF720x576

720x576

CIF

CIFCIF CIF CIF

CIFCIF

256 kbps

256 kbps

6 4 kbps

6 4 kbps

In Videoconference Application

Page 45: Video Media

724401 45

Video MediaM

ultim

ed

iaCommon Digital Video

Sizes

• CCIR-601 720x480 4:2:2, 4:2:0• SIF 360x240 4:2:0• CIF 360x288 4:2:0• 4:3 HDTV 1440x1152 4:2:2, 4:2:0• 9:16 HDTV 1920x1152 4:2:2,

4:2:0• 4CIF, 16CIF, QCIF

Page 46: Video Media

724401 46

Video MediaM

ultim

ed

iaPC video digitization

formats

Page 47: Video Media

724401 47

Video MediaM

ultim

ed

iaMultimedia Communication

Standards

• H.320 Video Teleconferencing Standard– Visual Telephone System over N-ISDN

• H.324– low bit rate multimedia communication terminal

for PSTN and Mobile Radio

• H.321, H.310 – high resolution broadband audiovisual

communication systems via B-ISDN

• H.322, H.323– narrowband visual telephone services on LAN

Page 48: Video Media

724401 48

Video MediaM

ultim

ed

iaReferrence

• Multimedia communication Application, Networks, protocols and standards; fred halsall. Chapter 2 Multimedia information representation page 96-113; ISBN 0201398184

• http://www.sce.carleton.ca/courses/96502• http://www.crs4.it/~luigi/MPEG/ccir601.html• http://www.broadcastengineering.com/archives/

0198/199801be15.html• http://www.cs.unc.edu/~kmp/classes/sp01/comp249