OPENISE Terminal structure Web-Browser Network/Local Filesystem Video Capture Window MPEG4...

6
OPENISE Terminal structure Web-Browser Network/Local Filesystem Video Captu re Windo w MPEG4 Conferenc ing Window MPEG-4 Player Decoders & Buffers DMIF QoS Data Conferenc ing Chat Shared App Doc Transfer Transfe r MPEG-4 Conferenci ng COM-Interfaces Shared Apps Window s MPEG4 Player Window Browser Window DMIF QoS MPEG-4 player Java based playback of complete MPEG-4 scenes including 3D/Video material MPEG-4 SL-1, Flex-Demux, DMIF modules (real-time) optimized rendering for walkthrough applications involving complex 3D scenes MPEG-4 conferencing module C++ MPEG-4 conferencing module offers video and audio conferencing in a 3D virtual meeting space RT MPEG‑4 video encoder of arbitrarily shaped video images and RT segmentation of the silhouette of person in front of a video camera QoS support for the conferencing application Integration of collaboration tools

Transcript of OPENISE Terminal structure Web-Browser Network/Local Filesystem Video Capture Window MPEG4...

Page 1: OPENISE Terminal structure Web-Browser Network/Local Filesystem Video Capture Window MPEG4 Conferencing Window MPEG-4 Player Decoders & Buffers DMIF QoS.

OPENISE Terminal structure

Web-Browser

Network/Local Filesystem

VideoCaptureWindow

MPEG4 Conferencing

Window

MPEG-4Player

Decoders & Buffers

DMIFQoS

Data Conferencing

Chat

Shared App

Doc Transfer

Transfer

MPEG-4Conferencing

COM-Interfaces

Shared Apps

Windows

MPEG4 Player

Window

Browser Window

DMIFQoS

MPEG-4 player

Java based

playback of complete MPEG-4 scenes including 3D/Video material

MPEG-4 SL-1, Flex-Demux, DMIF modules (real-time)

optimized rendering for walkthrough applications involving complex 3D scenes

MPEG-4 conferencing module

C++ MPEG-4 conferencing module offers video and audio conferencing in a 3D virtual meeting space

RT MPEG‑4 video encoder of arbitrarily shaped video images and RT segmentation of the silhouette of person in front of a video camera

QoS support for the conferencing application

Integration of collaboration tools

Page 2: OPENISE Terminal structure Web-Browser Network/Local Filesystem Video Capture Window MPEG4 Conferencing Window MPEG-4 Player Decoders & Buffers DMIF QoS.

Architecture of the OPENISE Terminal

2nd IST E3 Concertation MeetingBruxelles, 24-25 May 2000

Marco Di Concetto

Central Labs – Networks and Services

Siemens Information and Communication Networks SpA

[email protected]

Page 3: OPENISE Terminal structure Web-Browser Network/Local Filesystem Video Capture Window MPEG4 Conferencing Window MPEG-4 Player Decoders & Buffers DMIF QoS.

DAI

SLSL-1-1 Layer Layer

BifsDecoderBifsDecoder OD DecoderOD Decoder

CompositorCompositorApplicationApplicationExecutiveExecutive

A DecoderA Decoder

IOD DecoderIOD Decoder

)

)

=

SL_PDUsSL_PDUs

ESI

AUs

Time stamps management

MpegJMpegJ V DecoderV Decoder

RendererRenderer

OPENISE MPEG-4 Player Architecture

Current Features

BIFS-Command and BIFS-Anim decoder

JPEG/GIF decoder

MPEG-4 Video decoder

AAC decoder (sound)

Script and MPEG-J interpretors

2D/3D renderer reading either textual format or mp4 files

DMIF FilterDMIF FilterDMIF FilterFlexDeMuxFlexDeMux

Signalling Plane Data PlaneDNI

TCP TCP UDP UDP

RTP RTP

IPIP

RTSP RTSP RTCPRTCP RTCPRTCP

Page 4: OPENISE Terminal structure Web-Browser Network/Local Filesystem Video Capture Window MPEG4 Conferencing Window MPEG-4 Player Decoders & Buffers DMIF QoS.

VR-Conference Terminal Architecture

ConferenceControl

Call Signaling

IP Unicast & Multicast

VR-ConferenceExecutive

A/VReceiver

H.245 T.120

A/VSender

DataConferencing

Web-Browser

Events

GUI

Page 5: OPENISE Terminal structure Web-Browser Network/Local Filesystem Video Capture Window MPEG4 Conferencing Window MPEG-4 Player Decoders & Buffers DMIF QoS.

A/V Receiver part of the VR-Conference Terminal

BIFS/OD & Texture Decoder

MP4-Video Decoder

MP4-Video Decoder

...G.723.1 Decoder

G.723.1 Decoder

...

HTTP RTP/RTCPRTP/RTCP ...RTPRTP ...

DS Buffer

DS Buffer

... TextureBuffer

TextureBuffer

...

Scene Graph

SoundNode

MovieTextureNode

DirectSoundPrimary Sound Buffer

VideoFrameBuffer

Graphics Rendering& Navigation Module

IP Unicast & Multicast

Page 6: OPENISE Terminal structure Web-Browser Network/Local Filesystem Video Capture Window MPEG4 Conferencing Window MPEG-4 Player Decoders & Buffers DMIF QoS.

A/V Sender part of the VR-Conference Terminal

G.723.1Encoder

DatarateController

RTP/RTCP RTP/RTCPDeliveryStatistics

IP Multicast

VideoSegmentation

MP4-Video Encoder

AudioCapture

VideoCapture

GUI

Windows Sockets 2 API

RSVP SP

RSVP SP

ToS Marking