Visible Light Video Sequences Juergen Thiem, Jan Rorive Sony Business Emmanuel Cordonnier ETIAM...

Visible Light Video SequencesVisible Light Video Sequences

Juergen Thiem, Jan RoriveSony Business

Emmanuel CordonnierETIAM

Juergen Thiem, Jan RoriveSony Business

Emmanuel CordonnierETIAM

ApplicationsApplications

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 2

DICOM from X-Ray to VLDICOM from X-Ray to VL

Radiology / Diagnosis Visible image / Therapy


Main Visible Light ModalitiesMain Visible Light Modalities

MicrosurgeryMicrosurgery

Rigid EndoscopyRigid Endoscopy

Flexible EndoscopyFlexible Endoscopy


The Current DemandThe Current Demand

• Presentation

• Publication

• Reporting

• Education


Surgery and Intra Body DiagnosisSurgery and Intra Body Diagnosis

PRE

POST


In Association with Other ImagesIn Association with Other Images


From Still Images to Video ClipsFrom Still Images to Video Clips

• Digital video sequences:– Replacing analogue tapes– For post operation reporting– Carefully selected clips

• Archiving on DVD or Server

• Without workflow disturbance

• Associated to report for referring physicians

• Minimizing the retrieval time

– Including sound (environment, comments)


Today’s VHS SituationToday’s VHS SituationSafe Area

Medical VHS


Digital Video EvolutionDigital Video EvolutionSafe Area

MPEG, DVD, VCD, DiVXMPEG, DVD, VCD, DiVX

DV


Emerging Proprietary SolutionsEmerging Proprietary SolutionsSafe Area

MPEG, DVD, VCD, DiVXMPEG, DVD, VCD, DiVX

MPEG


DICOM PropositionDICOM Proposition

DIC

OM

Netw

ork

Ethernet

DICOM CD

Safe Area

PACS

DICOM WorkstationsDICOM Workstations

HospitalInformation

System<- Worklist

Patientdata


WEB

RADIOLOGY PACS

ARCHIVE

Workload PACSWorkload PACS


The Video SignalThe Video Signal• PAL is the analogue TV transmission standard used in

Europe, and throughout many parts of the world. A uncompressed PAL TV (25 f/s) picture produces a massive 216 Mbit/sec bit stream

• The U.S. uses an analogue TV system called NTSC. This system provides less precise color information, and a different frame rate (30 f/s). An uncompressed NTSC signal requires slightly less transmission capacity at 168 Mbit/sec.

• Data rates becomes even higher when one realizes a High Definition TV (HDTV) picture requires a raw bandwidth exceeding 1 Gbit/sec (1000 Mbit/sec).


MPEG-2MPEG-2

• 1987 Discussion about compression of video• 1988 ISO/IEC Moving Picture Experts Group• 1992 MPEG-2 (TV) and MPEG-3 (HDTV) combined

• 1993 MPEG-2 Main profile defined, compatible with MPEG-1

• 1994 ISO 13818-1 MPEG-2 Systems Definition

• 1997 First interactive Digital Video Broadcast service using MPEG-2

• 1998 Digital Versatile Disk (DVD) using MPEG-2

• 2000 Definition of the DVB Multimedia Home Platform (MHP)

• 2002 Availability of real time MPEG-2 DVD R writers


Other MPEG standardsOther MPEG standards

• MPEG-1, a standard for storage and retrieval of moving pictures and audio on storage media

• MPEG-2, for digital video

• MPEG-4, for multimedia applications (~DivX)

• MPEG-7, content representation standard for information search

• MPEG-21 to define a multimedia framework


Why MPEG-2Why MPEG-2

• Open, established standard

• Compatibility to DVD and Networks

• Low cost technology base

• Family inter-operability & flexibility

• Scalable bit rates

• Industry Support…

• and STABLE ?


MPEG-2 DisseminationMPEG-2 Dissemination

Systems which now use MPEG-2 is extensive and continuously growing:– Digital TV (cable, satellite and terrestrial

broadcast)– Video on Demand– Digital Versatile Disc (DVD)– Personal Computing– Card Payment, test and measurement, etc.


MPEG-2 CompressionMPEG-2 Compression

• Video compression which is backwards compatible with MPEG-1

• Full-screen interlaced and/or progressive video (for TV and Computer displays)

• Enhanced audio coding (high quality, mono, stereo, and other audio features)

• Transport multiplexing (combining different MPEG streams in a single transmission stream)

• Other services (GUI, interaction, encryption, data transmission, etc)


MPEG-2 Group of Pictures (GOP)MPEG-2 Group of Pictures (GOP)


MPEG-2 provides a way to compress the digital video signal to a manageable bit rate.

MPEG-2 CompressionMPEG-2 Compression


MPEG-2 Levels & ProfilesMPEG-2 Levels & Profiles

• Profile = quality of the video

• Level = resolution of the video

• The basic system is known as Main Profile Main Level (MP@ML) which covers video compression to 1-15 Mbps.

High X XHigh-1440 X X XMain X X X XLow X XLevel/Profile Simple Main SNR Spatial High

High X XHigh-1440 X X XMain X X X XLow X XLevel/Profile Simple Main SNR Spatial High


MainProfile@MainLevelMainProfile@MainLevelProfile TableProfile Table Level TableLevel Table

CompatibilityCompatibility

720 x 576 x 25 fps (PAL CCIR 601)

352 x 576 x 25 fps (PAL Half-D1)

720 x 480 x 30 fps (NTSC CCIR 601)

352 x 480 x 30 fps (NTSC Half-D1)


MPEG-2 MP 4:2:0 Image formatMPEG-2 MP 4:2:0 Image format


DICOM WG13 MPEG2 Work ItemDICOM WG13 MPEG2 Work Item

• Several face to face meetings, mainly in Europe, and t-cons

• Supplement 42: MPEG2 Video Sequence Transfer Syntax

• Supplement 47: Visible Light Video Sequences

• Plan to finalize the supplements end 2003, for balloting early in 2004


DVD based media exchange profileDVD based media exchange profile

• The DVD writers (~350€) and DVD-R media (~2€) are really accessible

• CD is more and more accepted and used for image distribution and « portable archive »

• DICOM sup 80 will be balloted soon• WG13 proposes to:

– Use the sup 80 format with VL SOP + potential Key Object Selection for « key » sequences

– Add an informative annex suggesting how to create a « dual format » DVD containing the DICOM data and a Video DVD of the acquired / selected sequences for the distribution to the patient / referring physician


video

DVD

video

DVD

« Dual Format » DICOM / video DVD

« Dual Format » DICOM / video DVD

video

DVD

video

DVD

VIDEO-TSVIDEO-TS

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

directory titles,

overlays

directory titles,

overlays

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

MPEG2 sequenceMPEG2 sequence

DICOM

data

DICOMDIRDICOMDIR

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

DICOM MPEG2 sequence

DICOM MPEG2 sequence


ConclusionConclusion

• The demand for digital video recording in Visible Light Imaging is emerging

• DICOM will contribute to harmonize the different products

• MPEG2 MP@ML is the best compromise

• Network transfer and DVD media exchange

• To be adopted in VL in a couple of months

• Could be applicable elsewhere (US…)

Visible Light Video Sequences Juergen Thiem, Jan Rorive Sony Business Emmanuel Cordonnier ETIAM...

Documents

Transcript of Visible Light Video Sequences Juergen Thiem, Jan Rorive Sony Business Emmanuel Cordonnier ETIAM...