04/18/23 | pag. 1

Department of Electronics & Informatics (ETRO)

Contact:

Prof. Jan Cornelis

Email: jpcornel@etro.vub.ac.be – Tel: +32 2 6292931

VUB-ETRO04/18/23 | pag. 2

Department of Electronics and Informatics (ETRO)

• 138 Collaborators (50% from outside Belgium, 18 nationalities)• Project portfolio 4M€/year (7,5 % of VUB R&D budget in 2005)• Extensive patent portfolio (1/3 of VUB patents in 2005)• Over 50 running partnerships with large companies and SMEs• Associated lab in IBBT, IMEC, IncGeo and DISC• www.etro.vub.ac.be

ETROETRO

IRIS DSSPDSSP LAMILAMI TELETELE

IBBTIBBT

FundamentalResearch

Strategic& AppliedResearch IMECIMEC IncGEOIncGEO DISC

VUB-ETRO04/18/23 | pag. 3

ShowcaseDept. of Electronics and Informatics – Vrije Universiteit Brussel

Personnel ETRO (in FTE)

0,0

10,0

20,0

30,0

40,0

50,0

60,0

70,0

80,0

90,0

100,0

1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005

Year

AAP

Consulant

Resident

IMEC

PostDoc

PhD

ATP

BAP

ZAP

VUB-ETRO04/18/23 | pag. 4

Industrial Collaborations

VUB-ETRO04/18/23 | pag. 5

Department of Electronics and Informatics (ETRO)Image Processing Research Team (IRIS)

• Key competences– Image and video processing– Multimedia coding and

transmission– Machine & computer vision– Pattern recognition

• Applications – multimedia applications, medical imaging, e-Health, industrial visual inspection, humanitarian demining, remote sensing, Positioning and tracking technologies

• Success Stories– Adoption of technologies by JPEG and MPEG-

standards– European expertise centre for humanitarian demining

04/18/23 | pag. 6

IRIS – Multimedia Group

Peter Schelkens, Adrian Munteanu

VUB-ETRO04/18/23 | pag. 7

Focus Scalability and Error Resilience

Internet

Residential Network

Residential Gateway

VUB-ETRO04/18/23 | pag. 8

Scalable Image Coding

• DCT-based techniquesDCT-based techniques– JPEGJPEG

• Wavelet-based codingWavelet-based coding– QT-LQT-L– JPEG2000 (JP3D, JPIP & JPSearch)JPEG2000 (JP3D, JPIP & JPSearch)– Region-of-interest CodingRegion-of-interest Coding

• Coding basedCoding basedon new geometric transformson new geometric transforms– Edgelets, Curvelets, Contourlets … Edgelets, Curvelets, Contourlets … – Advanced Image Coding (AIC)Advanced Image Coding (AIC)

VUB-ETRO04/18/23 | pag. 9

Scalable Video Codingspatial resolution

temporal resolution

4CIF

CIF

QCIF

7.5153060

bit-rates

high

low

VUB-ETRO04/18/23 | pag. 10

Scalable Video Coding

• Advanced motion estimation and compensation– Multi-hypothesis ME/MC (variable block size, subpixel accuracy,

multiple reference frames …)– Motion compensated temporal filtering– Spatial and wavelet domain approaches– Deblocking techniques

• Scalable motion vector coding• Spatial transforms

– DCT– Wavelets – New geometrical transforms

• Entropy coding• Rate-distortion optimisation techniques (e.g. LRA)• Transcoding

– E.g. MPEG-2 to MPEG-4 AVC• Multiview video coding (MVC)

MPEG-7

MPEG-21

MPEG-4AVC

MPEG-1

MPEG-2

MPEG-4

ISO/ IEC

CD-ROM

DVD, Digital TV, HDTV

Multimedia: Baseline,AVC, SVC, MVC, AFX

H.261

H.263(+)

ITU-T

ISDN Videoconferencing

Desktop/mobile video telephony

Metadata

DRM, DIA,…

H.262

H.264

VUB-ETRO04/18/23 | pag. 11

Scalable Coding and Animation of 3D Graphics

VUB-ETRO04/18/23 | pag. 12

Error Resilient Coding

• FEC, LDPC …

• Joint-Source Channel Coding– RD optimisation strategies

(a) (b) (c) (d)(a) (b) (c) (d)1 iteratie 10 iteraties 20 iteraties 30 iteraties

Transmission of uncoded image in packets of 600 bytes over a BEC with 30% erasures and protection with a regular (3,6)-LDPC code

VUB-ETRO04/18/23 | pag. 13

Multiple Description Coding

• MD of texture and motion data

• MD Quantisers

• RD optimisation strategies

Coder

Description 1

Description 2

Received

Received

Original Image

Error

Error

Selected information

Selected information

Decoder

Decoded Image

VUB-ETRO04/18/23 | pag. 14

Distributed Source Coding

• DVC is a potential solution to meet new requirements for video coding– Allows sharing complexity between encoder and decoder– Has inherent robustness against errors– Allows for distributed processing

• Architectural studies• RD Optimisation strategies

VUB-ETRO04/18/23 | pag. 15

E-mobility: Research interests

• What is of interest for us:– Research on Mobile Multimedia, and in

particular on coding systems enabling Mobile Multimedia

– Providing optimized End-to-End Quality of Experience in multimedia systems deployed over heterogeneous networks

– Context awareness (e.g. providing accurate localization services in buildings)