OptIPuter Teleconferencing Next Steps Dan Sandin Jan 2007

18
University of Illinois at Chicago OptIPuter Teleconferencing Next Steps Dan Sandin Jan 2007

description

OptIPuter Teleconferencing Next Steps Dan Sandin Jan 2007. An Embarrassment of Riches. HDV 25Mb 1 sec Audio interleaved DVCPRO HD 100Mb 300ms Audio interleaved HDSDI 1.5Gb < 200ms? Audio interleaved Y U V HD .8Gb < 100ms? Audio separate - PowerPoint PPT Presentation

Transcript of OptIPuter Teleconferencing Next Steps Dan Sandin Jan 2007

Page 1: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

OptIPuter

Teleconferencing Next Steps

Dan Sandin

Jan 2007

Page 2: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

An Embarrassment of Riches

• HDV 25Mb 1 sec– Audio interleaved

• DVCPRO HD 100Mb 300ms– Audio interleaved

• HDSDI 1.5Gb < 200ms?– Audio interleaved

• Y U V HD .8Gb < 100ms?– Audio separate

• Varrier Stereo Video 225Mb < 100ms– Audio separate

• GigE camera .8Gb <100ms– No audio

Page 3: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

Marketing Categories

• Broadcast– HDSDI– Highest quality, most expensive, low Q/$– Highly standardized, inflexible

• Prosumer– HDV, DVCPRO– Medium to high quality best Q/$– Quite standardized, inflexible

• Industrial– Y U V, Varrier Stereo, GigE– Large range of Q and $– Quite standardized, very flexible

Page 4: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

Organizations

• HDV 25Mb 1 sec– everybody

• DVCPRO HD 100Mb 300ms– qvidium calit2

• HDSDI 1.5Gb < 200ms– research channel UltraGrid Calit2

• Y U V HD .8Gb < 200ms– EVL UltraGrid

• Varrier Stereo Video 225Mb < 100ms– EVL Calit2

• GiGE camera .8Gb <100ms– SARA EVL Calit2

Page 5: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

Bandwidth

• HDV 25Mb 1 sec– Audio interleaved

• DVCPRO HD 100Mb 300ms– Audio interleaved

• HDSDI 1.5Gb < 200ms– Audio interleaved

• Y U V HD .8Gb < 200ms– Audio separate

• Varrier Stereo Video 225Mb < 100ms– Audio separate

• GigE camera .8Gb <100ms– No audio

Page 6: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

Audio

• HDV 25Mb 1 sec– Audio interleaved

• DVCPRO HD 100Mb 300ms– Audio interleaved

• HDSDI 1.5Gb < 200ms– Audio interleaved

• Y U V HD .8Gb < 200ms– Audio separate

• Varrier Stereo Video 225Mb < 100ms– Audio separate

• GigE camera .8Gb <100ms– No audio

Page 7: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

Latency One-Way Transmission Times

• HDV 25Mb 1 sec– Audio interleaved

• DVCPRO HD 100Mb 300ms– Audio interleaved

• HDSDI 1.5Gb < 200ms– Audio interleaved

• Y U V HD .8Gb < 200ms– Audio separate

• Varrier Stereo Video 225Mb < 100ms– Audio separate

• GigE camera .8Gb <100ms– No audio

Page 8: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

Latency Why So Late

• Every frame takes 33 ms• Every piece of hardware and every software module

wants a 2 or 3 frame buffer• For us, it is almost never the network

– We need to change that so it is the network

Page 9: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

Compression and Resolution or Quality

• HDV 25Mb 1 sec– MPEG; long GOP, low Q

• DVCPRO HD 100Mb 300ms– JPEG-like; better Q

• HDSDI 1.5Gb < 200ms– None; best Q largely depends on camera

• Y U V HD .8Gb < 200ms– None; best Q, largely depends on camera

• Varrier Stereo Video 225Mb < 100ms– None; SD but in stereo

• GigE camera .8Gb <100ms– None; camera has Q problems

Page 10: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

Compression and Resolution or Quality

• Uncompressed talking heads HD at 1.5GB is a ridiculous waste of resources– Except for broadcast production– Except for science data– Except for here? or maybe a TV studio, you have

never seen uncompressed HD

• Compression can be done in less than a frame– NTT 4K Jpeg 2000 <500Mb <100ms– spectacular quality !

Page 11: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

SAGE and Teleconferencing

• SAGE Visual casting supports YUV and RGB video• Calit2 and EVL will make a DVCPRO HD to SAGE

converter– Note: need to buy xmit box and receive software from Qvidum

• UltraGrid and Research Channel have expressed interest in doing conversion routines to SAGE Visual Casting

Page 12: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

SAGE and Teleconferencing

• SAGE Visual casting supports YUV and RGB video

Page 13: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

SAGE and TeleconferencingSupport of several systems

• Except for SAGE Visual Casting, a receiver box for each source will be used– Potentially support a large number of video

compression standards

Page 14: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

Audio Afterthoughts

• Echo cancellation can be accomplished with AccuMic PC– Limitations …

Page 15: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

Audio Afterthoughts

• SAGE has to develop an audio standard for visual casting

Page 16: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

Persistent setupfirst pass

• DVCPRO HD using Qvidium boxes

• CALIT2 UCSD, Calit2 UCI, EVL

• AccuMic Echo calculation

• Mono simple PCM audio

Page 17: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

Near Future

• HDMI camera and capture card

• Multi-channel audio with each SAGE window

• Audio localization with each window

Page 18: OptIPuter  Teleconferencing Next Steps   Dan Sandin Jan 2007

University of Illinois at Chicago

Teleconferencing

• Discussion