Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun...

22
Update on Update on Uncompressed HD Video Uncompressed HD Video over IP from GLORIAD-KR over IP from GLORIAD-KR Sanggyun Kim Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP GLORIAD-KR HDTV GROUP

Transcript of Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun...

Page 1: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

Update on Update on Uncompressed HD Video Uncompressed HD Video over IP from GLORIAD-KR over IP from GLORIAD-KR

Sanggyun KimSanggyun Kimon behalf of

GLORIAD-KR HDTV GROUPGLORIAD-KR HDTV GROUP

Page 2: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

2http://www.gloriad-kr.org/hdtv

BW.

RES.1Mbps

10Mbps

100Mbps

500Mbps

1Gbps

50Mbps

352x288H.261

720x480 1920x1080

MPEG2

MPEG4H.263

MPEG1

DVD

DV

SD

Uncompressed 1080i HD(995 Mbps, 1.3 Gbps, 1.485 Gbps)

Wireless/wiredLaptop computerAccess GridIPTV

Wired/WirelessDesktop computerMP@HL HDTV

WiredHigh-performance computerUncompressed HDTV

Multimedia over the InternetPowerful system

Bandwidth guaranteeQuality

Page 3: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

3http://www.gloriad-kr.org/hdtv

Networked HDTV

CompressedCompressed UncompressedUncompressed

Res.Res. Up to 1920x1080

BandwidthBandwidth 19.2Mbps 1.485Gbps

CODECCODEC MPEG2 -

PerformancePerformanceHandle one stream withhigh performance server

(Single CPU)

Handle one stream with high performance server

(Dual CPUs)

DelayDelay

En/En/DecodingDecoding 1~2 seconds 0

BufferingBuffering dependent on policyIdeally, 0~5 frames

(0ms~166ms)

AdvantageAdvantage

- Low cost- Low bandwidth

consumption- high quality

-Low delay- Ultra-high quality

DisadvantageDisadvantage

-High delay - sensitive to packet losses

- not fit into interactive applications

-High cost-Large bandwidth consumption

Killer apps.Killer apps. IPTV Broadcasting

Page 4: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

4http://www.gloriad-kr.org/hdtv

One-way delay vs., user perception

Will not notice the delay

Will not need echo cancellation

round-trip-time/2 delay (including Encoding/decoding delay)

Recommended upper E2E delay limit

May 2006. Based on PingER history.ping from the east Asia to the world

Domestic(Korea)

East AsiaNorth America

RussiaEurope

MiddleEast

LatinAmerica

The delay is obvious to all users

Will notice slight hesitation

Etc.

100ms20ms 150ms 200ms 300ms

Page 5: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

5http://www.gloriad-kr.org/hdtv

Advantage of networked uncompressed HDTV over Broadcasting-style and its use

• Advantage- Extremely low processing delay (no codec)- ultra-high presentation quality (no spatial/temporal dependency)- easy access to the application technology- interactivity (1:1, 1:N, small group N:N)

• Use- Broadcasting industry HD distribution, visualization, authoring, and so forth- Digital cinema (combining with JPEG2000) reduce distribution cost, enhance presentation quality

Page 6: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

6http://www.gloriad-kr.org/hdtv

Uncompressed HDTV in the World

USC/ISIUSC/ISI ResearchResearchChannelChannel NTTNTT GLORIAD-KRGLORIAD-KR

ScanningScanning 720p 1080i ? 1080i

In/OutputIn/Output SMPTE292M SMPTE292M SMPTE292M SMPTE292M

HD-SDIHD-SDI DVSDeckLink

AJA Own AJA

SMPTE292MSMPTE292Mover IPover IP

No, butPossible

Yes Yes No

Active samples over IPActive samples over IP Yes No No Yes

Dual-channel Dual-channel No Yes Yes Yes

Hardware audioHardware audio No Embedded Embedded Internal

Software videoSoftware videoxVideo,

SDL ? ? xVideo

Software audioSoftware audio RAT ? ?Yes

(Linux ALSA)

Capture from diskCapture from disk No ? ? No

SoftwareSoftwareUltraGrid

0.4.1 iHD1500 OwnUltraGrid

0.3.1 modfy.

Etc.Etc.

Page 7: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

7http://www.gloriad-kr.org/hdtv

GLORIAD-KR version of UltraGrid

1. Cost-effective system integration and development

- Adopt low-cost HD-SDI Interface (AJA’s OEM_HS)

- Add internal 24-bit 48KHz HW audio to the system : audio capture, separate audio RTP stream, audio playout

- Support dual-port streaming with software packet-striping

- SW-based multi-channel audio playout (PC sound card)

2. System Specification

- Linux (Mandrake, Suse, Fedora Core 5)

- EM64T dual Xeon (at least 2 PCI-X)

- Dual-port 1 Gbps or 10 Gbps network interface

Page 8: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

8http://www.gloriad-kr.org/hdtv

Uncompressed HDTV Transport System: GLORIAD-KR (HDTV-OUT)

Sony HVR-Z1N

HD-SDI converter

6-channel audio

Audio embedder

A/V transport over IP networks

HD-SDI signal converter

HD display

Speakers

Page 9: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

9http://www.gloriad-kr.org/hdtv

Uncompressed 720p HDTV : application technology in UltraGrid (USC/ISI)

Ladan Gharai, “Putting the “Ultra” in UltraGrid: Full rate Uncompressed HDTV Video Conferencing”,

Page 10: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

10http://www.gloriad-kr.org/hdtv

Uncompressed 1080i HDTV : application technology in GLORIAD-KR

Grabber

VideoPacketization

AudioPacketization

Sequencing

RTP/RTCPRTP/RTCP

Network Intf. Network Intf.Network Intf. Network Intf.

Play

VideoPlayout Buffer

AudioPlayout Buffer

RTP/RTCPRTP/RTCP

A/V synchronization

Page 11: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

11http://www.gloriad-kr.org/hdtv

Cost-effectiveness

DVSDVS OEM_HSOEM_HS Software A/V playSoftware A/V playoutout

Dual-portDual-portsupportsupport

HDV Cam. $4,500 $4,500 $4,500 $4,500

1 HD-SDI converter $1,600 $1,600 $1,600 $1,600

2 Servers $4,800 $4,800 ~ $4,800 ~ $4,800

2 10 G NIC $2,600 $2,600 $2,600 $0

2 Frame grabber $14,000 $3,400 $1,700 $1,700

1 HDSDI converter $770 $770 $0 $0

2 Audio A/D Converter

$900 $900 $400 $400

Display $2,400 $2,400 $2,400 $2,400

Total $31,570 $20,970 ~ $18,000 ~ $15,400

Sender & Receiver

50% off over USC/ISI’s UltraGrid

Page 12: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

12http://www.gloriad-kr.org/hdtv

Partners

5 Sites are using GLORIAD-KR version of UltraGrid in the Globe

Page 13: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

Grand Opening for Big Grand Opening for Big GLORIAD(’05.9.5)GLORIAD(’05.9.5)

• The first round-the-world high-performance networks jointly established by Korea, China, Unite States, Russia, Canada and Netherlands

• Improve networked collaboration with e-Science and Grid applications like HEP, Astronomy, Fusion, Geosciences, Medical sciences, and so forth.

Global Ring Network for Advanced applications Development (GLORIAD)

Page 14: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

14http://www.gloriad-kr.org/hdtv

Demonstrations and Experiments with GLORIAD-KR Version

• iGrid 2005, Interactive 3D HD Video Transport and Collaborative Data Analysis for e-Science over UCLP.KISTI, GIST

• C-K Experiments, First C-K Uncompressed HD experiment exploiting GLORIAD network.KISTI, GIST, KAIST, TsingHua Univ, CNIC

• DancingQ 2006, The First Real-time Commercial Culture Event over R&E Network. ANF, KISTI, CRC, i2Cat

• ELSA 2006 Pre-congress, Live Uncompressed HD broadcast of Laparoscopic Liver Surgery.KISTI, Seoul National Univ. Bundang Hospital.

• SC 2006, Software-based A/V play with a low-cost uncompressed internet HDTV KISTI, GIST

Page 15: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

15http://www.gloriad-kr.org/hdtv

Demonstrations and Experiments

Page 16: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

16http://www.gloriad-kr.org/hdtv

Applications and Networking• Applications

- Imagine all areas covered by commercial HDTV

• Networking- Provisioned network in Layer 1 (UCLP) and Layer 2 (VLAN)- Best-effort IP network- Available network bandwidth at least 1 Gbps 2 Gbps or 10 Gbps- Jumbo frame (9,000-byte packets) or, endpoint fragmentation in regional or local network.

Page 17: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

17http://www.gloriad-kr.org/hdtv

DancingQ 2006• DancingQ 2006 (L2+L3), The First Real-time Commercial Culture Event

over R&E Network. - Bound two lightpaths with port-based VLAN (L2)- Add L3 multicast service- Jumbo frame support- 1 Gbps E2E network bandwidth- ANF, KISTI, i2Cat, CRC, KAIST, GIST

Page 18: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

18http://www.gloriad-kr.org/hdtv

• DancingQ 2006 (L2+L3)

Daejeon #2

Daejeon #1(Cisco ONS 15600 )

KREONet2, KISTI, Korea CAnet 4, CANARIE, Canada

Catalyst 6509

CRC /Ottawa (Canada)

GEANT2, Europe

?

RedIRIS, Spain

New York, US

Barcelona

Seoul #1

Seoul #2

1GigE/UTP

HD SenderHD Camera

Cisco C3570G

HD Receiver HD Receiver

Ottawa Cisco ONS

SeattleCisco ONS

?New York

Toronto Cisco ONS

Toronto Nortel OME

Calgary Nortel OME

Seattle Nortel HDXc

Thunder Bay Cisco ONS

CESCA, Spain

Barcelona

SMC 8624T

SMC 8624T

i2CATSSpain

L2 Light Path I

L2 Light Path II

L3 IP Multicast

Seoul (Korea) i2Cat (Spain)

Page 19: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

19http://www.gloriad-kr.org/hdtv

ELSA 2006 Pre-congress

• ELSA 2006 (short-haul L3), Live Uncompressed HD broadcast of Laparoscopic Liver Surgery- Local network - No jumbo frame support (Endpoint Fragmentation and Reassembly) - 1 Gbps E2E network bandwidth- KISTI, Sony, Olympus, SNU Bundang Hospital.

Page 20: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

20http://www.gloriad-kr.org/hdtv

• ELSA 2006 (short-haul L3)

Private Private networknetwork

Fiber 1GFiber 1G

HD SDI Sending HD SDI Sending Machine server Machine server 61.252.62.5561.252.62.55

HD- SDI ReceivingHD- SDI ReceivingMachine serverMachine server

61.252.62.5661.252.62.56

D/A audio converterD/A audio converter

3F Operationg Room3F Operationg Room

B1F Auditorium RoomB1F Auditorium Room

B2F Network system roomB2F Network system room

Fiber 1GFiber 1G

UTP 1GUTP 1G

UTP 1GUTP 1G

SONY Anycast SONY Anycast Station HD-A/V Station HD-A/V

mixermixer

Sony HD Cine-projectorSony HD Cine-projector SRX-R110SRX-R110

Powerpoint

A/D audio converterA/D audio converter Mic

Analog Audio

HD SDI Video

Uncompressed HD

VGA/HD graphic converter

Audio Mixer

Olympus EXERA 2Olympus EXERA 2- HD laparoscope camera- HD laparoscope camera

SONY HDC –X300SONY HDC –X300

Page 21: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

21http://www.gloriad-kr.org/hdtv

Future works would be …

• User interface• Advanced PC-out - OpenGL (deinterlacing, TV-out)• Transport reliability - UDT (UDP-based Transport Protocol) - Reliability and Congestion control• System offloading• Real-time disk I/O - Write to/from HDD• Improved interactivity - Compressed high quality video (H.264, MPEG2 MP@HL) - Audio only(?) : Audio capture using Linux ALSA• Increased sense of presence - Panoramic view, stereoscopic view• Cost-effectiveness - Simultaneous Tx/Rx using just one system• Interoperability - USC/ISI, NTT, Research Channel

Page 22: Update on Uncompressed HD Video over IP from GLORIAD-KR Sanggyun Kim GLORIAD-KR HDTV GROUP Sanggyun Kim on behalf of GLORIAD-KR HDTV GROUP.

22http://www.gloriad-kr.org/hdtv

Thanks !!Thanks !!Visit Visit

http://www.gloriad-kr.org/hdtvfor more information