1 · Web view9192 Text of ISO/IEC 14496-4:2004/PDAM 31 Conformance Testing for SVC Profiles...

INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION

ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO

ISO/IEC JTC 1/SC 29/WG 11 N9157Lausanne, CH – July 2007

Source: Leonardo Chiariglione Title: Report of 81st meetingStatus

Report of 81st meeting..........................................................................................................................1Annex A – Attendance list.................................................................................................................16Annex B – Agenda.............................................................................................................................22Annex C Input – contributions...........................................................................................................25Annex D – Output documents............................................................................................................37Annex E – Requirements report.........................................................................................................43Annex F – Systems report..................................................................................................................54Annex G – MDS report......................................................................................................................76Annex H – Video report.....................................................................................................................94Annex I – JVT report........................................................................................................................106Annex J – Audio report....................................................................................................................107Annex K – 3DG report.....................................................................................................................132Annex L – Test report.......................................................................................................................145Annex M – ISG report......................................................................................................................147Annex N – Liaison............................................................................................................................151

Report of 81st meeting

1 OpeningThe 81st MPEG Meeting was hosted by Swiss National Body and EPFL, and Swissmedia as local organizer 02-06 July 2007 at Campus of EPFL, CH-1015 Lausanne/Switzerland.

2 Roll call of participantsThe attendance list appears as Annex 1

3 Approval of agendaThe adopted agenda appears as Annex 2

4 Allocation of contributionsThe list of input contributions is given in Annex 3

1

5 Communications from ConvenorThere was no specific communication

6 Report of previous meetingThe following document was approved

8911 Report of 80th MPEG meeting

7 Processing of NB Position PapersNational Body position papers were presented, discussed and, where appropriate, responses provided:

9326 Responses to National Bodies

8 Work plan

1.1. Media coding

1.1.1. AAC-ELDThe following documents were approved

9237 Technology under consideration for AAC-ELD9238 Workplan for AAC-ELD9239 WD on ISO/IEC 14496-3, MPEG-4 Audio Fourth Edition

1.1.2. Advanced Video CodingThe following document was approved

9198 Text of ISO/IEC FDIS 14496-10:200X Advanced Video Coding (4th edition)

1.1.3. Scalable Video CodingThe following documents were approved

9196 Disposition of Comments on ISO/IEC 14496-10:2005 / FPDAM 39197 Text of ISO/IEC 14496-10:2005 / FDAM 3 Scalable Video Coding9199 Joint Scalable Video Model (JSVM) 119212 JSVM 11 Software9189 SVC Verification Test Plan Version 1

1.1.4. Multiview Video CodingThe following documents were approved

9163 Multiview Video Coding Requirements9213 Text of ISO/IEC 14496-10:200X / PDAM 1 Multiview Video Coding

2

9214 Joint Multiview Video Model (JMVM) 59215 JMVM 5 Software

1.1.5. Frame-based Animated Mesh Compression The following document was approved

9266 Text of ISO/IEC 14496-16:2006/PDAM2 (Frame-based Animated Mesh Compression)

1.1.6. 3D MultiResolution ProfileThe following document was approved

9267 Text of ISO/IEC 14496-16:2006/PDAM3 (3D MultiResolution Profile)

1.1.7. Binary Format for XML (Prefixes and Wild Card extensions)The following documents were approved

9296 DoC on ISO/IEC 23001-1/FPDAM2 (Prefixes and wild cards extensions)9297 Text of ISO/IEC 23001-1/FDAM2 (Prefixes and wild cards extensions)

1.1.8. Video Tool LibraryThe following documents were approved

9224 WD 5 of ISO/IEC 23002-4 Video Tool Library9225 Description of Core Experiments in RVC9226 RVC Simulation Model (RSM) V5.09227 RVC Work Plan9228 RVC Conformance Testing Working Draft 2.09229 Description of Exploration Experiments for Toolbox Extensions

1.1.9. Spatial Audio Object CodingThe following documents were approved

9249 ISO/IEC 23003-1:2007/DCOR 19250 Report on Spatial Audio Object Coding CfP Selection9251 First thoughts on SAOC Verification Test

1.1.10. Free Viewpoint TV codingThe following document was approved

9168 Preliminary FTV Model and Requirements9230 Description of Exploration Experiments in FTV

3

1.1.11. Audio and speech codingThe following documents were approved

9252 Report on Evaluation of Speech and Audio Framework9254 Framework for Exploration of Speech and Audio Coding9253 Workplan for Exploration of Speech and Audio Coding9255 Draft Call for Proposals on Joint Speech and Audio Coding

1.1.12. Ontologies

9325 Possible requirements for a new rights ontology

1.2. Composition coding

1.2.1. Lightweight Scene RepresentationThe following documents were approved

9284 Study Text of ISO/IEC 14496-20/FPDAM 2 (SVGT1.2 Support)9286 TuC for ISO/IEC 14496-20/Amd.29287 WD4.0 of ISO/IEC 14496-20 2nd Edition (1st Ed. + Cor 1 + Amd.1)9288 IuC for LASeR

1.3. Description coding

1.3.1. Visual Descriptions ExtensionsThe following document was approved

9218 Description of Core Experiments for MPEG-7 New Visual Extensions

1.3.2. Visual Signature ToolsThe following documents were approved

9216 Call for Proposals on Visual Signature Tools9217 MPEG-7 Visual XM Document version 31.0

1.3.3. Technologies for digital photo management using MPEG-7 visual toolsThe following documents were approved

9219 Disposition of Comments on ISO/IEC TR 15938-8:2002 / DAM 39220 Text of ISO/IEC TR 15938-8:2002/Amd.3 (Technologies for digital photo management

using MPEG-7 visual tools)

1.3.4. MPEG-7 Query FormatThe following documents were approved

4

9172 Study of ISO/IEC CD 15938-12 Query Format9173 TuC for MPEG Query Format v2.0

1.4. IPMP

1.4.1. IPMP XML MessagesThe following document was approved

9166 Requirements for Additional XML IPMP Messages9298 Study Text of ISO/IEC 23001-3/FCD (IPMP XML

Messages)

1.5. Digital Item

1.5.1. Schema files for MPEG-21 standardsThe following document was approved

9174 Schema Files for MPEG-21 Standards (v7)

1.5.2. Review of DIDThe following documents were approved

9175 DID Open Issues9176 Workplan for CE on DI Semantics

1.5.3. Security in Event Reporting

9180 Request for Amendment 1 of ISO/IEC 21000-15 Security in ER9181 ISO/IEC 21000-15:2006/PDAM 1 Security in ER

1.6. Transport and File formats

1.6.1. Carriage of SVC in MPEG-2 SystemsThe following documents were approved

9273 Request ISO/IEC 13818-1:2006/Amd.3 Carriage of SVC in MPEG-2 Systems9274 Text of ISO/IEC 13818-1:2006/PDAM3 Carriage of SVC in MPEG-2 Systems

1.6.2. ISO Base Media File FormatThe following document was approved

9307 TuC on ISO/IEC 14496-12

5

1.6.3. AVC File Format extensions for SVCThe following documents were approved

9324 DoC ISO/IEC 14496-15/PDAM 2 (SVC File Format)9283 Text of ISO/IEC 14496-15/FPDAM 2 (SVC File

Format)

1.6.4. AVC File Format extensions for MVCThe following document was approved

9308 TuC on ISO/IEC 14496-15 (MVC Extensions)

1.7. Multimedia architecture

1.7.1. Codec Configuration RepresentationThe following document was approved

9223 WD 5 of ISO/IEC 23001-4 Codec Configuration Representation

1.7.2. 3D Graphics Compression ModelsThe following document was approved

9270 WD 2.0 of ISO/IEC 14496-25

1.7.3. Media Streaming MAF ProtocolsThe following document was approved

9301 Study Text of ISO/IEC 29116-1/FCD Media Streaming MAF Protocol

1.7.4. IPTVThe following document was approved

9167 IPTV Requirements

1.7.5. Extensible Multimedia PlatformThe following document was approved

9302 A project to exploit MPEG standards in tune with industry practices and needs (Revised version)

1.7.6. MetaverseThe following document was approved

6

9169 Metaverse: Context and Objectives

1.8. Application formats

1.8.1. Musical Slide Show Application FormatThe following documents were approved

9289 Request of ISO/IEC 23000-4/ Musical Slide Show 2nd Edition9290 Text of ISO/IEC 23000-4/CD Musical Slide Show 2nd Edition

1.8.2. Media Streaming Application FormatThe following document was approved

9182 Study of ISO/IEC FCD 23000-5 Media Streaming MAF

1.8.3. Professional Archival MAFThe following document was approved

9165 Call for Requirements on Professional Archival MAF

1.8.4. Open Release Application FormatThe following document was approved

9183 Study of ISO/IEC FCD 23000-7 OR Application Format

1.8.5. Portable Video Player MAFThe following document was approved

9292 Study Text of ISO/IEC 23000-8/CD Portable Video Player

1.8.6. Digital Multimedia Broadcasting Application FormatThe following documents were approved

9293 Study Text of ISO/IEC 23000-9/FCD (MAF for DMB)9294 TuC on MAF for DMB

1.8.7. Video Surveillance MAFThe following document was approved

9295 Text of ISO/IEC 23000-10/CD (Video Surveillance MAF)

7

1.9. Reference implementation

1.9.1. Symbolic Music Representation Reference SoftwareThe following documents were approved

9279 DoC of ISO/IEC 14496-5/PDAM 16 Symbolic Music Rep. Reference Software9280 Text of ISO/IEC 14496-5/FPDAM 16 Symbolic Music Rep. Reference Software

1.9.2. MPEG-1 and -2 on MPEG-4 Reference SoftwareThe following document was approved

9248 Study on ISO/IEC 14496-5:2001/PDAM 20, MPEG-1 and -2 on MPEG-4 and BSAC Extensions

1.9.3. BSAC Extensions Reference SoftwareThe following document was approved


1.9.4. Reference Hardware DescriptionThe following document was approved

9187 Study of “ISO/IEC DTR 14496-9 3rd Edition Reference Hardware Description”

1.9.5. New Profiles for Professional Applications Reference SoftwareThe following document was approved

9194 Text of ISO/IEC 14496-5:2001 / PDAM 18 Reference Software for New Profiles for Professional Applications

1.9.6. SVC Reference SoftwareThe following document was approved

9195 Text of ISO/IEC 14496-4:2001 / PDAM 19 Reference Software for SVC

1.9.7. Geometry and Shadow Reference SoftwareThe following document was approved

9263 Study Text of ISO/IEC 14496-5:2001/ FPDAM13 (Geometry and Shadow RefSoft)

8

1.9.8. Frame-based Animated Mesh Compressions Reference SoftwareThe following documents were approved

9264 Request for amendment of ISO/IEC 14496-5:2001 (FAMC RefSoft)9265 WD1.0 of ISO/IEC 14496-5:2001 AMD21 (FAMC RefSoft)

1.9.9. LASeR Reference SoftwareThe following documents were approved

9281 DoC of ISO/IEC 14496-5/PDAM 17 LASeR v1 Reference Software9282 Text of ISO/IEC 14496-5/FPDAM 17 LASeR v1 Reference Software

1.9.10. MPEG-21 Reference SoftwareThe following document was approved

9177 MPEG-21 REL Profiles Software Implementation Plan v.79178 DoC for ISO/IEC FCD 21000-8 Reference Software 2nd Edition9179 Text of ISO/IEC FDIS 21000-8 Reference Software 2nd Edition

1.9.11. Photo Player MAF Reference SoftwareThe following document was approved

9221 Disposition of Comments on ISO/IEC 23000-3 / PDAM 1 9222 Text of ISO/IEC 23000-3 / FPDAM 1 Reference Software for Photo Player

MAF

1.9.12. Musical Slide Show MAF Reference SoftwareThe following document was approved

9291 WD1.0 of ISO/IEC 23000-4/Amd.1 MSS MAF Conf. and Ref. Software

1.9.13. M3W Reference SoftwareThe following documents were approved

9299 Text of ISO/IEC 23004-8/CD Reference Software and Conformance9300 M3W Reference Software and Conformance Plan

1.10. Conformance

1.10.1. Audio BIFS v3 ConformanceThe following document was approved

9275 Text of ISO/IEC 14496-4/FPDAM 22 AudioBIFS v3 Conformance

9

1.10.2. Symbolic Music Representation ConformanceThe following documents were approved

9240 DoC on 14496-4:2004/PDAM 29, SMR Conformance9241 ISO/IEC 14496-4:2004/FPDAM 29, SMR Conformance

1.10.3. New Profiles for Professional Applications ConformanceThe following document was approved

9191 Text of ISO/IEC 14496-4:2004/PDAM 30 Conformance Testing for New Profiles for Professional Applications

1.10.4. SVC Profiles ConformanceThe following document was approved

9192 Text of ISO/IEC 14496-4:2004/PDAM 31 Conformance Testing for SVC Profiles

1.10.5. MPEG-1 and -2 Audio in MPEG-4 ConformanceThe following document was approved

9244 Study on ISO/IEC 14496-4:2004/FPDAM 20, SLS and MPEG-1/2 on MPEG-4 Conformance

1.10.6. BSAC ConformanceThe following document was approved

9246 Status of BSAC Extension Conformance and Reference Software

1.10.7. Audio Scalable to Lossless ConformanceThe following documents were approved


9245 Status of SLS conformance

1.10.8. Geometry & Shadow ConformanceThe following document was approved

9258 Study Text of ISO/IEC 14496-4:2004/ FPDAM21 (Geometry and Shadow Conformance)

1.10.9. Frame-based Animated Mesh CompressionThe following documents were approved

10

9259 Request for Amendment of ISO/IEC 14496-4:2004 (FAMC Conformance)9260 WD 1.0 of ISO/IEC 14496-4:2004 AMD32 (FAMC Conformance)

1.10.10. MultiResolution Profile ConformanceThe following documents were approved

9261 Request for Amendment of ISO/IEC 14496-4:2004 (MultiResolution Profile Conformance)9262 WD 1.0 of ISO/IEC 14496-4:2004 AMD33 (MultiResolution Profile Conformance)

1.10.11. Laser ConformanceThe following documents were approved

9276 Study Text of ISO/IEC 14496-4/FPDAM 25 LASeR & SAF V1 Conformance

9277 Request for ISO/IEC 14496-4/Amd.27 LASeR V2 Conformance9278 Text of ISO/IEC 14496-4/PDAM 27 LASeR V2Conformance

1.10.12. Musical Slide Show MAF ConformanceThe following document was approved

9291 WD1.0 of ISO/IEC 23000-4/Amd.1 MSS MAF Conf. and Ref. Software

1.10.13. M3W ConformanceThe following documents were approved

9299 Text of ISO/IEC 23004-8/CD Reference Software and Conformance9300 M3W Reference Software and Conformance Plan

1.11. Maintenance

1.11.1. Systems coding standardsThe following document was approved

9285 Study of ISO/IEC 14496-20/DCOR2

1.11.2. Video coding standardsThe following document was approved

9193 Text of ISO/IEC 14496-5:2001/Amd.1/DCOR 1

1.11.3. Audio coding standardsThe following documents were approved

11

9235 ISO/IEC 14496-3:2006/AMD2:2006/DCor 3, ALS9236 Study on ISO/IEC 14496-3/DCOR 5, DST and MP3on4 and LTP9242 ISO/IEC 14496-4:2004/AMD13:2007/DCOR 1, LD AAC test sequences9243 ISO/IEC 14496-4:2004/DCOR 5, Audio Corrections9247 Study on ISO/IEC 14496-5:2001/AMD 10:2007/DCOR 1, BSAC and SLS, ALS Corrections

9 Liaison matters The following liaison statements were issued

9309 Liaison Statement to AES9310 Liaison Statement to ITU-T re Joint Speech & Audio Coding9311 Liaison Statement to 3GPP re Joint Speech & Audio Coding9312 Liaison Statement to 3GPP29313 Liaison Statement to IEC TC1009314 Liaison Statement to ITU-T IPTV Focus Group re "Toolbox for Content Coding"9315 Liaison Statement to SMPTE re RVC9316 Liaison Statement to SCTE9317 Liaison Statement to AVS9318 Liaison Statement to ITU-T SG9 re FTV9319 Liaison Statement to DVB9320 Liaison Statement to 3GPP TSG SA WG4 re DIMS/LASeR9321 Liaison Statement to OMA9322 Liaison Statement to ITU-T IPTV Focus Group re Presentation Formats for IPTV9324 Liaison Statement to WG1

The following document was approved

9327 List of Organisations with which MPEG entertains liaisons (as of July 2007)

10 Organisation of this meeting

1.12. Tasks for subgroupsTasks were assigned to subgroups as follows

S P AReqs

4 10 MVC20 Laser profiling

7 3 Video annotationImage and Video Signature Tools

21 2 New DID6 Rights ontology

A 6 Professional Archival MAFY Stereoscopic MAFZ Cross media interactive presentation

B 3 IPMP XML messages

12

C 3 Stereoscopic videoColourFTVIPTVJoint audio and speech codingMetaverse

Systems2 1 3 Carriage of SVC4 4 22 Audio BIFS conformance

23 Synthesised texture conformance24 File format conformance25 Laser v1 conformance26 Open Font Format Conformance27 Laser v.2 conformance

5 14 Open Font Format Reference Software16 Symbolic Music Representation Reference Software17 Laser Reference Software

15 1 SVC File Format20 1 Lightweight Scene Representation

21 9 1 Mime type registrationA 4 1 Musical Slide Show MAF conformance & RS

2 Protected Musical Slide Show MAF8 Portable Video Player MAF9 DMB MAF

10 Video Surveillance MAFB 1 2 Extension on encoding of wild cards

3 IPMP XML messagesE 8 M3W Reference Software and Conformance29116 1 MS MAF Protocols

Joint management of content description and presentationX MPEG eXtensible Middleware

MDS7 12 Query Format

Schemas21 2 Revisiting DID

8 1 Reference software18 1 Digital Item Streaming

SchemasA 2 Protected Music Player MAF

5 Media Streaming MAF6 Professional Archival MAF7 Open Release MAF

Video4 2 4 Simple Profile level 67 3 3 Visual Signature ToolsA 3 1 Photo Player Reference Software

2 Photo Player ConformanceB 4 Codec Configuration DescriptionC 2 Fixed-point 8x8 IDCT and DCT

13

4 Video Tool Library4 1 Video Tool Library Conformance

JVT 4 New AVC Profiles for Professional Applications Conformance New AVC Profiles for Professional Applications Reference SWScalable Video Coding ConformanceScalable Video Coding Reference SW

10 3 Scalable Video Coding4 Multi-View Video Coding

Audio 4 3 8 MP4 box for original audio file information3 9 AAC-ELD4 20 SLS conformance

29 SMR Conformance5 16 SMR Reference Software

15 BSAC and SLS Reference Software20 MPEG-1/-2 on MPEG-4 reference software

23 SMRA 6 Professional Archival MAFD 1 1 MPEG Surround Reference Software

2 MPEG Surround Conformance3 Spatial Audio Object Coding

X Audio and Speech Coding3DG

4 4 xx FAMC (Frame based Animated Mesh Compress.) Conformance21 Geometry and shadow Conformance32 Multiresolution profile conformance

5 xx FAMC (Frame based Animated Mesh Compress.) Reference software13 Geometry and shadow Reference Software21 Multiresolution profile Reference Software

16 2 Frame-based animated mesh compression3 3D Multiresolution profile

25 3D Graphics Compression modelTest

4 10 3 SVC verification tests ISG

4 9 2 Reference Hardware Description3 Reference Hardware Description

7 6 Reference softwareLiaison

JPEG

1.13. Joint meetingsThe following joint meetings were held

Groups What Day Where TimeReq. Vid Video and image signature reqs Mon Vid 15:00-16:00Req, Sys Laser profiling Mon Req 17:00-17:30

14

Req, Vid MVC, FTV, MPEG-C pt3, colour Tue Req 09:00-12:00Req, Mds, Sys, Vid MAFs Tue Req 14:00-16:00Req. Mds DID, IPMP messages, Ontology Tue Req 16:00-18:00Req, Aud FTV, Joint Audio & Speech Wed Aud 12:00-13:00Aud, ISG AAC-ELD Wed Aud 11:00-12:00Aud, Vid Decoder Description Thu Aud 14:00-15:00

11 Administrative matters

1.14. Schedule of future MPEG meetings The following meeting schedule was approved

# City Country yy mm dd-dd81 Lausanne CH 07 07 02-0682 Shenzhen CN 07 10 22-2683 Antalya TR 08 01 14-1884 Lausanne CH 08 04-05? 28-02?85 Hannover DE 08 07 21-2586 Seoul KR 08 10 13-17

1.15. Promotional activities The following documents were approved

9159 Lausanne press release9184 MPEG-21 DIA 2nd Edition Tutorial Presentation

12 Planning of future activitiesThe following document was approved

9156 List of ad hoc groups established at the 81st MPEG meeting

13 Resolutions of this meetingThese were approved

14 A.O.BThere was no other business

15 ClosingThe meeting closed at 2007/07/06T19:30

15

Annex A – Attendance list

Nr 1st NAME Last NAME AFFILIATION

CO

UN

TR

Y

217 Jeong Hnan AHN KR1 Taleb ANISSE ERICSSON AB SE

224 Olivier AVARO STREAMEZZO FR2 Bart BARENBRUG PHILIPS 3D SOLUTIONS NL3 Gero BASE SIEMENS AG CT IC2 MC DE4 Tanya BEECH QINETIQ UK

240 Pierfrancesco BELLINI UNIVERSITY OF FLORENCE IT236 Michele BELLUOMINI IT5 Miroslaw BOBER VISUAL INFORMATION

LABORATORYUK

6 Yann BODO JOOST TECHNOLOGIES B.V. NL7 Jan BORMANS IMEC BE8 Sebastien BRANGOULO JOOST TECHNOLOGIES B.V. NL9 Paul BRASNETT MITSUBISHI ELECTRIC ITE-VIL UK10 Bernard BROWER ITT US11 Sabina BRUFANI SISVEL SPA IT12 Fons BRULS PHILIPS NL13 Tim BRUYLANTS VRIJE UNIVERSITEIT BRUSSEL -

IBBTBE

14 Ian BURNETT UNIVERSITY OF WOLLONGONG AU15 Jihun CHA ETRI KR16 Hyouk Jean CHA LG ELECTRONICS KR17 Ti Eu CHAN INSTITUTE FOR INFOCOMM

RESEARCHSG

248 Wo CHANG NIST US18 Weizhong CHEN HUAWEI TECHNOLOGIES CO, LTD CN19 Yi-Wen CHEN NATIONAL CHIAO-TUNG

UNIVERSITY/ITRIUS

20 Filippo CHIARIGLIONE CEDEO.net IT21 Leonardo CHIARIGLIONE CEDEO.net IT22 Ik-Hwan CHO INHA UNIVERSITY KR218 Ayoung CHO KR222 Maeng-Sub CHO KR23 Hyon-Gon CHOO ETRI KR24 Takeshi CHUJOH TOSHIBA CORPORATION JP25 Sung-Moon CHUN ECT INC. KR26 Richard CLARK ELYSIUM LTD UK27 Daniel COMALRENA ENST-TELECOM PARIS FR28 Giovanni CORDARA TELECOM ITALIA IT29 Bill CROW MICROSOFT CORPORATION US234 Wiebe DE HAAN PHILIPS NL30 Saar DE ZUTTER GHENT UNIVERSITY - IBBT BE

16

31 Jaime DELGADO UNIVERSITAT POLITECNICA DE CATALUNYA

ES

32 Jwalant DESAI WIPRO TECHNOLOGIES IN33 Sylvain DEVILLERS FRANCE TELECOM FR34 Dandan DING ZHEIJIANG UNIVERSITY CN35 Stefan DOEHLA FRAUNHOFER IIS DE36 Mario DOELLER UNIVERSITY OF PASSAU DE233 Frédéric DUFAUX EPFL CH37 Jean-Claude DUFOURD STREAMEZZO FR38 Touradj EBRAHIMI EPFL CH39 Regis FARIA LSI-TEC BR40 Per FROJDH ERICSSON SE41 Toshiaki FUJII NAGOYA UNIVERSITY JP245 David FUSCHI IT230 Marc GAUVIN SDAE ES42 Ralf GEIGER FRAUNHOFER IIS DE43 Jean H.A. GELISSEN PHILIPS NL44 Diego GIBELLINO TELECOM ITALIA IT45 Aharon GILL ZORAN MICROELECTRONICS LTD IL46 Patrick GIOIA FRANCE TELECOM FR47 Daniele GIUSTO CNIT @ POLARIS IT48 Bernhard GRILL FRAUNHOFER IIS DE49 Marc GUEZ VUCHER SCPP FR50 Onur GULERYUZ DOCOMO USA LABS US51 Miska HANNUKSELA NOKIA CORPORATION FI52 Junichi HARA RICOH COMPANY, LTD JP53 Noboru HARADA NTT JP54 Shinya HASEGAWA SHARP CORP. JP55 Oliver HELLMUTH FRAUNHOFER IIS DE56 Tan HENDRY I & C UNIVERSITY KR57 Juergen HERRE FRAUNHOFER IIS DE58 Arianne HINDS RICOH IBM INFOPRINT

SOLUTIONS COMPANYUS

221 Kang HOGAB DRM Inside KR59 Haibin HUANG INSTITUTE FOR INFOCOMM

RESEARCHSG

243 Walt HUSAK Dolby US60 Chi Jung HWANG CHUNGNAM NATIONAL UNIV. KR61 Michael ISNARDI SARNOFF CORPORATION US62 Satoshi ITO TOSHIBA JP63 Takashi ITOH FUJITSU LABORATORIES LTD JP64 Kota IWAMOTO NEC CORPORATION JP238 Vincent JACQUET FR223 Song JAEYEON KR65 Euee Seon JANG HANYANG UNIVERSITY KR219 Dong Seok JEONG INHA University KR66 Jaebum JUN HANYANG UNIVERSITY KR67 Klaus JUNG LURATECH IMAGING GMBH DE68 Yang-Won JUNG LG ELECTRONICS KR69 Itaru KANEKO TOKYO POLYTECHNIC JP

17

UNIVERSITY70 Akihiko SUGIYAMA NEC CORPORATION JP71 Leong Mun KEW INSTITUTE FOR INFOCOM

RESEARCHSG

72 Byoungjun KIM HANGYANG UNIVERSITY KR73 Dong Soo KIM LG ELECTRONICS KR74 Hui Yong KIM ETRI KR75 Hyunkgyu KIM HANGYANG UNIVERSITY KR76 Jinwoong KIM ETRI KR77 Jong Lak KIM DSP GROUP INC. KR78 JungHoe KIM SAMSUNG AIT KR79 Kyuheon KIM KYUNGHEE UNIVERSITY KR80 Minsoo KIM DSP VIDEO KOREA KR81 Munchurl KIM I&C UNIVERSITY KR82 Tae Hyeon KIM LG ELECTRONICS KR83 Taehyun KIM DRM INSIDE KR84 Yong Han KIM UNIVERSITY OF SEOUL KR85 Youngseop KIM DANKOOK UNIVERSITY KR214 Sang-Kyun KIM Myongi University KR231 Jaeseung KIM KR237 Haeknang KIM KR86 Hideaki KIMATA NTT CORPORATION JP87 Kristofer KJOERLING CODING TECHNOLOGIES AB SE88 Patrick KLIE LEIBNIZ UNIVERSITAET

HANNOVERDE

89 Naoki KOBAYASHI NTT JP90 Takuyo KOGURE MATSUSHITA ELECTRIC IND. CO.

LTDJP

91 Asai KOHTARO MITSUBISHI ELECTRIC JP92 Adi KOUADIO EPFL CH93 Panos KUDUMAKIS QUEEN MARY UNIV. LONDON UK94 Chaker LARABI UNIVERSITY OF POITIERS FR95 Jean LEFEUVRE ENST-TELECOM PARIS FR96 Alex Chungku LEE HUMAX KR97 Hyunkook LEE LGE KR98 Sinwook LEE HANYANG UNIVERSITY KR99 Sun Young LEE HANGYANG UNIVERSITY KR103 Sangyoun LEE YONSEI UNIVERSITY KR104 Gun-Ill LEE SAMSUNG ELECTRONICS KR215 Tae-Jin LEE KR246 Sihyoung LEE KR100 Chee Mun Kelvin LEE INSTITUTE FOR INFOCOMM

RESEARCHSG

101 Gwo Giun LEE NATIONAL CHENG KUNG UNIVERSITY

US

102 Daniel LEE EBAY US105 Tilman LIEBCHEN LG ELECTRONICS DE106 Taebeom LIM KOREA ELECTRONICS

TECHNOLOGY INSTITUTEKR

229 Youg-Knon LIM Net & TV KR

18

107 He-Yuan LIN NATIONAL CHENG KUNG UNIVERSITY

US

108 Fernando LOPES ISEC/IPC - IT COIMBRA PT109 Ning LU INTEL CORP. US110 Ajay LUTHRA MOTOROLA US244 Khaled MAMMOU FR111 Masatsugu KITAMURA FOR MORE CONVENIENT AV LIFE JP112 Marco MATTAVELLI EPFL CH113 Neil MC KENZIE DEDICON NL114 James MEANY BOEING US115 Choi MIRAN ETRI KR116 Joerg MOHR FRAUNHOFER IIS DE213 Francisco MORAN

BURGOSUPM ES

117 Takehiro MORIYA NTT JP118 Fulvio MOSCHETTI EPO DE119 Karsten MULLER FRAUNHOFER HHI DE120 Markus MULTRUS FRAUNHOFER IIS DE121 Tokumichi MURAKAMI MITSUBISHI ELECTRIC

CORPORATIONJP

122 Tomakazu MURAKAMI HITACHI, LTD JP123 Johan MUSKENS PHILIPS NL124 Hiroya NAKAMURA JVC (VICTOR COMPANY OF

JAPAN, LIMITED)JP

125 Sua Hong NEO PANASONIC SINGAPORTE LABS PTE LTD

SG

241 Paolo NESI UNIVERSITY OF FLORENCE IT126 Jean François NEZAN IETR FR127 Didier NICHOLSON THALES FR128 Takashi NISHI OKI ELECTRIC INDUSTRY CO, LTD JP129 Toshiyuki NOMURA NEC JP130 Ryoma OAMI NEC CORPORATION JP131 Robert O'CALLAGHAN MITSUBISHI ELECTRIC ITE UK132 Tobias OELBAUM TECHNISCHE UNIVERSITAT

MUNCHENDE

133 Yukiko OGURA IPSJ/ITSCJ JP134 Henney OH LG ELECTRONICS KR135 Weon Geun OH ETRI KR210 Eunmi OH Samsung AIT KR136 Jens-Rainer OHM RWTH AACHEN UNIVERISTY DE137 Tatiana ONALI UNIVERSITY OF CAGLIARI IT235 Takao ONOYE JP138 Werner OOMEN PHILIPS APPLIED TECHNOLOGIES NL139 James ORWELL KINGSTON UNIVERSITY UK140 Hiroshi OSAWA JUGEMU CO, LTD JP141 Keunsoo PARK KOREAN BROADCASTING

SYSTEMKR

142 Fernando PEREIRA IST-IT PT143 Cristian PERRA UNIVERSITY OF CAGLIARI IT144 Marius PREDA INT FR

19

145 Françoise PRETEUX GET/INT FR146 Heiko PURNHAGEN CODING TECHNOLOGIES AB SE147 Honggang QI INSTITUTE OF COMPUTING

TECHNOLOGYCN

148 Schuyler QUACKENBUSH AUDIO RESEARCH LABS US242 Thomas RATHGEN TECHNISCHE UNIVERSITAT

ILMENAUDE

149 Mickael RAULET IETR IMAGE GROUP FR220 Yuriy REZNIK QUALCOMM Inc. SAN DIEGO US228 Justin RIDGE NOKIA US150 Eva RODRIGUEZ UNIVERSITAT POLITECNICA DE

CATALUNYAES

239 Davide ROGAI UNIVERSITY OF FLORENCE IT151 Robert ROSSI MICROSOFT US247 Janet ROUNTREE US152 Muham. Syah

HouariSABIRIN I&C UNIVERSITY KR

153 Masanori SANO NHK JP154 Peter SCHELKENS VRIJE UNIVERSITEIT BRUSSEL -

IBBTBE

155 Juergen SCHMIDT THOMSON DE156 Andreas SCHNEIDER CODING TECHNOLOGIES AB DE157 Markus SCHNELL FRAUNHOFER IIS DE158 Florian SCHREINER TECHNISCHE UNIVERSITAT

MUNCHENDE

159 Akihide SEI JEITA JP160 Shun-Ichi SEKIGUCHI MITSUBISHI ELECTRIC

CORPORATIONJP

161 Chong Kok SENG PANASONIC SINGAPORE SG162 Takanori SENOH NATIONAL INSTITUTE OF INFO &

COMM TECHJP

163 Hee-Cheol SEO ETRI KR216 Jeong-Il SEO KR226 Louis SHARPE US227 Xiaojin SHI US164 Osamu SHIMADA NEC CORPORATION JP165 Shinya SHIMIZU NTT JP166 Taichiro SHIODERA TOSHIBA JP167 David SINGER APPLE US168 Ralph SPERSCHNEIDER FRAUNHOFER IIS DE169 Sridhar SRINIVASAN MICROSOFT US170 Toshiyasu SUGIO MATSUSHITA ELECTRIC JP171 Gary SULLIVAN MICROSOFT CORPORATION US172 Huifang SUN MITSUBISHI ELECTRIC RESEARCH

LABSUS

173 Teruhiko SUZUKI SONY CORP. JP174 Norimatsu TAKESHI MATUSHITA ELECTRIC

INDUSTRIAL CO, LTDJP

175 Masayuki TANIMOTO NAGOYA UNIVERSITY JP176 Akiyuki TANIZAWA TOSHIBA CORPORATION JP

20

177 Frederik TEMMERMANS VRIJE UNIVERSITEIT BRUSSEL - IBBT

BE

178 Patric THEUNE PHILIPS 3D SOLUTIONS NL179 David THEVENIN EXPWAY FR180 Christian TIMMERER KLAGENFURT UNIVERSITY AT181 Steven TONDEUR VRIJE UNIVERSITEIT BRUSSEL BE225 Ruben Liesa TOUS ES182 Chun-Jen TSAI NCTU/ITRI US183 Chrisa TSINARAKI TUC/MUSIC GR184 Yi-Shin TUNG HON-HAI PRECISION IND.CO

(FOXCONN)US

185 Alexis TZANNES AWARE, INC. US232 Mauri VAANANEN NOKIA FI186 Jan VAN DER MEER PHILIPS NL187 Yuri VATIS LEIBNIZ UNIVERSITAT

HANNOVERDE

188 Frédéric VEXO EPFL - VRLAB CH189 David VIRETTE FRANCE TELECOM FR190 Ye-Kui WANG NOKIA FI191 Xin WANG CONTENTGUARD, INC. US192 Jiangtao WENG ORTIVA WIRELESS US212 Karol WHUHOWICZ PL193 Kai WILLNER NOKIA CORPORATION FI194 Lowell WINGER LSI CA195 Steffen WITTMANN PANASONIC DE196 Ingo WOLF DEUTSCHE TELEKOM DE197 Keun Yang WON ETRI KR198 Lianhuan XIONG HUAWEI TECHNOLOGIES CO, LTD CN199 Lijing XU HUAWEI TECHNOLOGIES CO, LTD CN200 Akio YAMADA NEC JP201 Yoshihisba YAMADA MITSUBISHI JP202 Tomoo YAMAKAGE TOSHIBA CORPORATION JP203 Tomoyuki YAMAMOTO SHARP CORP. JP211 Ye YAN QUALCOMM Inc. SAN DIEGO US204 Yoshiyuki YASHIMA NTT JP205 Jeong-Ju YOO ETRI KR206 Kyoungro YOON KONKUK UNIVERSITY KR207 Lu YU ZHEIJIANG UNIVERSITY CN208 Toni ZGALJIC UK209 Zhishou ZHANG INSTITUTE FOR INFOCOMM

RESEARCHSG

21

Annex B – Agenda

Item1 Opening 2 Roll call of participants 3 Approval of agenda4 Allocation of contributions 5 Communications from Convenor6 Report of previous meeting 7 Processing of NB Position Papers8 Work plan 1 Media coding 1 MPEG-4 Visual Simple Profile Level 6 2 AAC-ELD 3 New Profiles for Professional Applications 4 Scalable Video Coding 5 Multiview Video Coding 6 Geometry and Shadow 7 Fixed point implementation of DCT/IDCT 8 Bitstream Syntax Description Language 9 Video Tool Library 10 Spatial Audio Object Coding 11 Free Viewpoint TV coding 12 Audio and speech coding 2 Composition coding 1 Lightweight Scene Representation 3 Description coding 1 Schema definition 2 Visual Descriptions Extensions

Video annotation exploration 3 Technologies for digital photo management using MPEG-7 visual tools 4 Improvements to Geographic Descriptor 5 MPEG-7 Query Format 4 Systems support 1 Fragment Request Unit 5 IPMP 1 REL Open Release Profile 2 IPMP XML Messages 3 REL Distribution and Capture Profile 6 Digital Item 1 Schema files for MPEG-21 standards

2 Review of DID 7 Transport and File formats 1 Transport of MPEG Surround data in AAC 2 File Format extensions for Description of Timed Metadata 3 Flute Hint Track 4 AVC File Format extensions for FRExt 5 AVC File Format extensions for SVC 6 MP4FF box for Original Audio File Information

22

7 Digital Item File Format 8 Digital Item Streaming 8 Multimedia architecture 1 Codec Configuration Representation 2 3D Graphics Compression Models 3 Media Streaming MAF Protocols 4 Extensible Multimedia Platform 9 Application formats 1 Musical Slide Show Application Format 2 Media Streaming Application Format 3 Professional Archival MAF 4 Open Release Application Format 5 Portable Video Player MAF 6 Digital Multimedia Broadcasting Application Format 7 Video Surveillance MAF 10 Reference implementation 1 Symbolic Music Representation Reference Software 2 Reference Hardware Description 3 New Profiles for Professional Applications Reference Software 4 SVC Reference Software 5 File Format Reference Software 6 Morphing & Textures Reference Software 7 MPEG-J GFX Reference Software 8 LASeR Reference Software 9 Open Font Format Reference Software 10 MPEG-7 Systems Reference Software 11 MPEG-21 REL Reference Software 12 Photo Player MAF Reference Software 13 Musical Slide Show MAF Reference Software 14 Binary MPEG format for XML Reference Software 15 Prefixes and wild card extensions Reference Software 16 MPEG Surround Reference Software 17 M3W Reference Software 11 Conformance 1 Audio BIFS v3 Conformance 2 Symbolic Music Representation Conformance 3 MPEG-4 Visual Simple Profile Level 6 Conformance 4 New Profiles for Professional Applications Conformance 5 SVC Profiles Conformance 6 MPEG-1 and -2 Audio in MPEG-4 Conformance 7 BSAC Conformance 8 1-bit Oversampled Audio Conformance 9 Audio Scalable to Lossless Conformance 10 File Format Conformance 11 Geometry & Shadow Conformance 12 Synthesized Texture Conformance 13 MPEG-J GFX Conformance 14 Laser Conformance 15 Open Font Format Conformance 16 Perceptual 3D Shape Conformance 17 Improvements to Geographic Descriptor Conformance

23

18 Binary MPEG format for XML Conformance 19 MPEG Surround Conformance 20 M3W Conformance 21 Codec Configuration Representation Conformance 12 Maintenance 1 Systems coding standards 2 Video coding standards 3 Audio coding standards 4 Visual description coding standards 5 Audio description coding standards 6 MDS standards9 Liaison matters

10 Organisation of this meeting 1 Tasks for subgroups 2 Joint meetings

11 Administrative matters 1 Schedule of future MPEG meetings 2 Promotional activities

12 Planning of future activities13 Resolutions of this meeting 14 A.O.B 15 Closing

24

Annex C – Input contributions

No. Authors Title

14558 Wo Chang Document Register for SC29/WG11 Meeting Lausanne, Switzerland

14559 Gerrard Drury Giovanni Cordara AHG on Review of MPEG-21 DID

14560 Hideaki Kimata Karsten M.ler AHG on FTV (Free Viewpoint Television)

14561 Yi-Shin Tung Chung-Neng Wang AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

14562 Euee S. Jang Yoshihisa Yamada AHG on Reconfigurable Video Coding

14563 Miroslaw Bober Ryoma Oami Robert O'Callaghan

AHG on MPEG-7 Visual and Photo Player MAF

14564Tobias Oelbaum Mathias Wien Vincent Bottreau Nathalie Cammas Alex Eleftheriadis Justin Ridge

AHG on SVC Verification Test

14565 Miroslaw Bober Jens-Rainer Ohm Thomas Wiegand AHG on Video Annotation

14566 Young-Kwon Lim Cyril Concolato AHG on Scene Representation

14567 David Singer Visharam Mohammed AHG on MPEG File Formats

14568 Young-Kwon Lim Hui Yong Kim Jean Cha AHG on MAF Under Development in Systems

14569 R. Sperschneider AHG on Audio Standards Maintenance

14570 S. Quackenbush Eunmi Oh AHG on SAOC CfP, AAC-ELD and Speech and Audio Exploration

14571 Kyoungro Yoon Mario Doeller AHG on MPEG-7 Query Format

14572 Jeong-Hwan Ahn Ning Lu AHG on 3DG documents, experiments and software maintenance

14573 3GPP TSG SA WG4 via SC 29 Secretariat Liaison Statement from 3GPP TSG SA WG4 [SC 29 N 8462]

14574 3GPP TSG SA WG4 via SC 29 Secretariat Liaison Statement from 3GPP TSG SA WG4 [SC 29 N 8463]

14575 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 23000-3 [SC 29 N 8461]

14576 JTC 1 Secretariat via SC 29 Secretariat Summary of Voting on ISO/IEC TR 15938-8:2002/DAM 3 [SC 29 N 8485]

14577 IEC TC 100 via SC 29 Secretariat IEC CDV 61883-1 [SC 29 N 8507]

14578 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-10:2005/FDAM 1 [SC 29 N 8508]

25

http://mpeg.nist.gov/reg/_update.php?docnum=14578


mailto:[email protected]

http://mpeg.nist.gov/mpeg/docs/81_Lausanne/contrib/m14578.zip






















mailto:??


mailto:??



mailto:??






mailto:??


mailto:??



mailto:??


mailto:??

mailto:??


mailto:??

mailto:??

mailto:??



mailto:??

mailto:??


mailto:??




mailto:??


mailto:??


mailto:??





http://mpeg.nist.gov/reg/_list81.php?k=6,kv=1





14581 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:2004/FPDAM 22 [SC 29 N 8518]

14582 SC 29 Secretariat Summary of Voting on ISO/IEC 23001-1:2006/FPDAM 2 [SC 29 N 8519]

14583 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/PDAM 17

14584 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:2004/PDAM 29 [SC 29 N 8499]


14586 ITU-R SG 6/WP 6J via SC 29 Secretariat Liaison Statement from ITU-R SG 6/WP 6J [SC 29 N 8520]

14587 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 21000-8 (2nd Edition) [SC 29 N 8558]

14588

Weon-Geun OhIk-Hwan ChoA-Young ChoJu-Kyoung JinWon-Keun YangJun-Woo LeeDong-Seok Jeong

Clarification of MPEG-7 VCE-6 testset



14591 French National Body French NB comment on JPXML and MPEG-B BSDL

14592 Onur G. GuleryuzM. Reha Civanlar

Royalty Cost Optimization with Reconfigurable Video Coding

14593Weon-Geun OhHyeong-yong JeonChi-jung Hwang

Modification of VCE 6 Independent Data Set


An Image Identifier based on Feature points for Complex conditions

14595

Inseon JangJeongil SeoSeungkwon BeackKyeongok Kang

Report on the SAOC RM0 Evaluation Test at ETRI

26













































































14596 Gero BäseThomas Rathgen

Study text of ISO/IEC 23000-10 WD Video Surveillance MAF

14597 Schuyler Quackenbush 80th MPEG Audio Report

14598 Schuyler Quackenbush Report on Spacial Audio Object Coding CfP Subjective Listening Test

14599 Schuyler Quackenbush Pooled Results of Speech and Audio Listening Tests.

14600 Teruhiko Suzuki Problem report on MPEG-4 visual reference software

14601 JTC 1 Secretariat via SC 29 Secretariat Summary of Voting on ISO/IEC DTR 14496-24 [SC 29 N 8546]


14603 Chrisa TsinarakiStavros Christodoulakis MPEG-7 FASP Extension Proposal

14604Davide RogaiPierfrancesco BelliniPaolo Nesi

Cross-Media Interactive Presentation MAF

14605 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-3:2005/FDAM 5

14606 SC 29 Secretariat Summary of Voting on ISO/IEC ISO/IEC 23000-3/PDAM 1

14607 Jean-Claude Dufourd Study of ISO/IEC 14496-20/FPDAM2

14608 Jean-Claude Dufourd Update of LASeR Reference Software

14609 Jean-Claude Dufourd Study of ISO/IEC 14496-4/FPDAM25

14610 Jean-Claude Dufourd Report of LASeR related activities in other standards organizations

14611

Pedro CarvalhoHelder CastroMaria Teresa AndradeGiorgiana CiobanuChristian TimmererHermann Hellwagner

Input to AHG on Review of MPEG-21 DID

14612 Xin Wang Security and DRM Requirements for Professional Archival MAF

14613Noboru HaradaTakehiro MoriyaYutaka Kamamoto

Updated overviwe document for Professional Archival MAF

14614Harada Noboru Takehiro Moriya Yutaka Kamamoto

Proposed text to WD of Professional Archival MAF

14615 Tokumichi Murakami Requirement of Real-Color Video Coding for

27
















































































Kohtaro AsaiShun-ichi SekiguchiShuic

Consumer Application

14616

Shun-ichi SekiguchiShuichi YamagishiYoshihisa YamadaKoht

On Performance Comparison between 4:4:4 coding and 4:2:0 coding

14617 David Singer Improved meta box support in the ISO file format

14618

Weon-Geun OhA-Young ChoIk-Hwan ChoJu-Kyoung JinJun-Woo LeeDong-Seok Jeong

Experiment Results of Image Identifier for Basic Group

14619Weon-Geun OhWon-Keun YangDong-Seok Jeong

Improved CE Results of MGST Based Descriptor for MPEG-7 VCE-6 Complex Condition

14620 Ye-Kui WangMiska M. Hannuksela On SVC file format

14621 Eva RodriguezJaime Delgado Derivative rights for the REL ORC Profile

14622 Eva RodriguezJaime Delgado Security requirements for Event Reporting

14623Jaime DelgadoEva RodriguezJordi Sesmero

Software implementation of security in Event Reporting

14624 Eva RodriguezJaime Delgado

Contribution to MPEG-21 REL Reference Software: Schema checker for the ORC

14625 Eva RodriguezJaime Delgado

Contribution to MPEG-21 REL Reference Software: Validation rules checker for the

14626

Taka Senohkenji YamamotoRyutaro OiTomoyuki MishinaMakoto Okui

Consideration of image depth information

14627

Maeng-Sub ChoJin-Seo KimBon-ki KooSang-Kyun Kim

Initiating a new application format for Consistent Color Reproduction

14628

Maeng-Sub ChoJin-Seo KimBon-Ki KooSang-Kyun Kim

Parameter set for effective and consistent color reproduction

14629 Gwo Giun Lee Functional units of AVC inter prediction for

28














































































He-Yuan LinMing-Jiun Wang RVC video tool library

14630Gwo Giun LeeHe-Yuan LinMing-Jiun Wang

A CAL-based conformance testing environment for RVC video tool library

14631 Hideaki KimataShinya Shimizu

Proposal on MVC Requrements for different cameras

14632Kenji OtoiYoshihisa YamadaKohtaro Asai

Proposed text of the RVC FUs for MPEG-4 AVC and MPEG-2

14633

Taejin LeeMinje KimJeongil SeoKyeongok KangYoungcheol ParkHochong Park Kim Rin Chul

Report on Speech and Audio Coding Listening Test at ETRI

14634Ying ChenYe-Kui WangMiska M. Hannuksela

On MVC file format

14635

Weon-Geun OhIk-Hwan ChoA-Young ChoJun-Woo LeeJu-Kyoung JinDong-Seok Jeong

New Proposal and experiment result for VCE-6

14636 Min-Jeong LeeHeung-Kyu Lee

Cross verification result for ETRI VCE-6 proposal

14637Sang-ki KimHyobin LeeSangyoun Lee

CE Report for VCE-5

14638

Yo-Sung HoKwan-Jung OhCheon LeeSangBeom LeeSan-Tae Na

Depth Map Generation and Depth Map Coding for MVC

14639Yo-Sung HoKwan-Jung OhCheon Lee

Geometrical Compensation for MVC

14640

Hee-Cheol SeoMiran ChoiHyunki KimMyung-Gil JangSoojong LimJeong HeoYeo-Chan Yoon

Weak Points of Current MPEG-7 Query Format Schema

29


























mailto:

mailto:























mailto:















14641Masanori SanoHideki SumiyoshiNobuyuki Yagi

A proposal for MP7QF based on QueryCondition part

14642 Pierfrancesco Bellini;Paolo Nesi Updated SMR conformance bitstreams

14643 Pierfrancesco Bellini;Paolo Nesi Updated SMR reference Software

14644 Houari SabirinMunchurl Kim

Proposed text for Protected Musical Slide Show MAF PDAM

14645 Houari SabirinMunchurl Kim

MPEG-7 core description profile and visual descriptors for Video Surveillance MAF

14646 Kazuya Takeda SLPA (Selective Listening Point Audio) for FTV Audio

14647 Toshiaki Fujii Proposal on EE for FTV

14648Toshiaki FujiiHideaki KimataShigeyuki Sakazawa

Requirements for FTV

14649 Hyouk Jean Chaon behalf of KNB

KNB preliminary comments on 23000-8 CD Portable video player MAF

14650NezanM. Raulet O. Déforges

PREESM in the RVC framework

14651Thomas RathgenPeter AmonAndreas Hutter

On the SVC File Format

14652

Khaled MamouNikolce StefanoskiTitus ZahariaJörn OstermannFrançoise Prêteux

FAMC’s layer-based scalable extension

14653


FAMC: bitstream description for the layer-based scalable extension

14654

Khaled MamouTitus ZahariaFrançoise PrêteuxNikolce StefanoskiJörn Ostermann

FAMC with progressive transmission and scalable rendering functionalities

14655Raulet MickaëlPelcat MaximeBlestel Médéric

From AVC to SVC: minor and major modifications in a RVC decoder implementation

14656 Osamu Shimada A proposal for an additional SAOC

30








































mailto:[email protected].










































Toshiyuki NomuraAkihiko SugiyamaOsamu Hoshuyama

functionality of separating real-environment signals

14657Hyungyu KimChungku YieEuee S. Jang

Result of RVC CE 1.1

14658

Sunyoung LeeJaebum JunSinwook LeeByoungjun KimHyungyu KimChungku YieEuee S. Jang

CDDL-Based decoder description for constructing ADM and syntax parsing

14659 Hyon-Gon ChooFilippo Chiariglione Requirements for XML IPMP Messages

14660 Jean Le FeuvreJean-Claude Dufourd On LASeR BitStream Exchange

14661Matthias GruhneMario DoellerIngo Wolf

Proposal for the MP7QF Query Management Tools

14662 Jean Le FeuvreCyril Concolato BIFS and LASeR harmonisation

14663 Next Generation Broadcasting Standard Forum Korea Revised requirement for Stereoscopic MAF

14664 Next Generation Broadcasting Standard Forum Korea

Proposal for technical specification of Stereoscopic MAF

14665 Next Generation Broadcasting Standard Forum Korea

Requirement for Packaged media Stereoscopic MAF

14666 Hyon-Gon Choo;Filippo Chiariglione;

Study on ISO/IEC 29116 FCD Media Streaming MAF Protocol

14667 Jani PeltotaloMiska M. Hannuksela

Comments on Amd2 of ISO base media file format

14668JungHoe KimMiyoung KimEunmi Oh

Listening test results for Exploration of Speech and Audio Coding

14669Oliver HellmuthJuergen HerreLeonid Terentiev

Report on Spatial Audio Object Coding Subjective Tests at Fraunhofer IIS

14670

Miyoung KimJungHoe KimMyungHoon LeeJeongil Seo

Status of BSAC Extension Conformance and Reference Software

14671 Miyoung KimEunmi Oh

Crosscheck of FT Core Experiment on AAC-ELD

31





























































mailto:


mailto:



14672Mario DoellerMatthias Gruhne Ingo wolf

Proposal for additional Query Types and Operators for MP7QF

14673 Kelvin Lee Updated status of SLS conformance

14674 Jooyoung LeeHyon-Gon Choo Study of TuC on IPMP XML Messages

14675 Kota IwamotoRyoma Oami

Revision of the Core Experiment Description for VCE-7

14676K. GrünebergTh. Schierl Th. Wiegand

Proposal for MPEG-2 Transport Stream Extensions for Scalable Video Coding

14677 Kota IwamotoRyoma Oami

Suggestion of Dataset Size Reduction for VCE-7

14678

Jihun ChaYoung-Kwon LimWon-Sik CheongYeSun JoungKyungAe Moon

Request of user defined values for the predefined SLConfigDescriptor

14679 Kota IwamotoRyoma Oami Contribution to the Test Dataset for VCE-7

14680

Jihun ChaYoung-Kwon LimWon-Sik CheongYeSun JoungKyungAe Moon

First ideas on the harmonization of BIFS and LASeR

14681Gavin SchutzTeruhiko SuzukiMike Dolan

Reply to 29n8427 on MPEG-2 Systems DCOR1

14682Diego GibellinoGiovanni CordaraJean-Claude Dufourd

On LASeR Main Profile

14683 Gavin SchutzThomas Edwards

Liaison on 29n8430 - ISO Base Media File Format - URI Identified Metadata

14684 Jeroen KoppensWerner Oomen

Report on Spatial Audio Object Coding Subjective Tests at Philips

14685 Frans de BontWerner Oomen

MPEG-1/2 Layer 1/2 over MPEG-4 conformance bitstreams

14686 Gavin Schutz Liaison input on 29n8435 - RVC

14687 Karol Wnukowicz Cross verification report of the experiments on image signature (VCE-6)


Philips cross-check results of subjective quality of AAC-ELD

14689 Ruben Tous Proposal for new Query Operators in MP7QF

32
























































































Jaime Delgado

14690 Ruben TousJaime Delgado

Proposal for the new JOIN operation in MP7QF

14691

Saar De ZutterFrederik De KeukelaereGerrard DruryChristian TimmererXin Wang

Editors' input to ISO/IEC FDIS 21000-8 Reference Software (2nd edition)

14692 Karol WnukowiczWladyslaw Skarbek

A proposal for image signature based on trajectory of features

14693 Andreas SchneiderHeiko Purnhagen Update on MPEG surround conformance

14694Andreas SchneiderHeiko PurnhagenAlex Groeschel

Proposed correction to MPEG-4 audio conformance

14695 Leonid Terentiev Report on Spatial Audio Object Coding Subjective Tests at Fraunhofer IIS

14696

Jonas EngdegårdLars VillemoesHeiko PurnhagenOliver HellmuthAndreas HölzerKarsten LinzmeierJeroen Breebaart

CT/Fraunhofer IIS/Philips Submission to the SAOC CfP

14697

Heiner Kirchhoffer Detlev Marpe Khaled Mamou Karsten Müller Thomas Wiegand

Proposed Modifications to Residual Coding Part of Frame-based Animated Mesh Compression

14698Stefan DöhlaHerbert ThomaHarald Fuchs

On CTS-Offset and hierarchical B-frames in ISO media file format

14699

Fons BrulsJan van der MeerChris Varekamp Arnaud BourgeYann Picard

Additional Requirements for stereoscopic video in MPEG-C part 3

14700

Fons Bruls Jan van der MeerChris Varekamp Arnaud BourgeYann Picard

Proposal to amendment MPEG-C Part 3

14701 Kristofer KjörlingHeiko Purnhagen

Proposed additional test-items for the speech and audio exploration.

14702 Kristofer Kjörling Additional corrections for the defect report

33

































mailto:

mailto:

mailto:

































Heiko PurnhagenJeroen KoppensMatthias Neusinger

on MPEG Surround.

14703 Jonas EngdegårdHeiko Purnhagen

Report on Spatial Audio Object Coding Subjective Tests at Coding Technologies

14704 David VirettePierrick Philippe

Listening test results for Speech and Audio Coding exploration

14705 FrNB Preliminary comments on ISO/IEC 14496-3:2005/FPDAM9

14706Quqing Chen [email protected] Zhi-bo ChenLouis Chevallier

Requirement of Video Annotation

14707

Jaime DelgadoMarc GauvinEva RodriguezVictor Rodriguez

Requirements for a Machine Readable Rights Ontology

14708Davide RogaiPierfrancesco BelliniPaolo Nesi

Input to AhG on MPEG-21 DID Review

14709Fredrik HennPer EkstrandArijit Biswas

Coding Technologies cross-check of AAC-ELD subjective audio quality

14710

Marius Preda Ivica Arsov Blagica Jovanova Françoise Preteux

Compression performances of MPEG-4 3D Graphics for large databases

14711Marius Preda Blagica Jovanova Françoise Preteux

MPEG-4 3D graphics tools for third party scene representation

14712Marius Preda Remi Arnaud Francoise Preteux

Support for an RF profile for MPEG-4 3D graphics by COLLADA

14713 Paul BrasnettMiroslaw Bober

Further Improvements to the Image Identifier XM (VCE6)

14714 Xin Wang An Update on IPTV Requirements

14715 Florian Schreiner Chun Hui Suen

Contribution to ISO/IEC FCD 23000-7 Open release

14716 Yuriy A. ReznikRavi Chivukula

Listening test results for speech-audio coding explorations

14717 Jaeyeon SongYoung-kwon Lim The first ideas on LASeR in IPTV

14718Mauri VaananenJuha OjanperaMiikka Vilermo

On the conformance of AAC decoders with LTP tool

34

















































































14719 Thomas Edwards Proposed SMPTE 2029 - Uniform Resource Names for SMPTE Resources

14720 David VirettePierrick Philippe

Additional information for AAC-ELD instantaneous block switching CE

14721 Lazar BivolarskiYuriy A. Reznik ISO/IEC 23002-2 in RVC Implementation

14722 Lazar Bivolarski ISO/IEC 23002-1 IDCT Implementation in CAL Testbed Update

14723Markus Schmidt Markus Schnell Ralf Geiger

Listening test results for AAC-ELD

14724 Markus Schnell Fredrik Henn Proposed Changes for AAC-ELD

14725 Ralf Geiger Jürgen Herre

On the sensitivity of T-Tests for MUSHRA Scores

14726

Ralf Geiger Markus Schnell Jürgen Herre Manfred Lutzky Kristofer Kjörling

Proposed Annex for AAC-ELD: Delayless Mixing

14727

Ralf Geiger Stephan Schreiner Virgilio Bacigalupo Markus Lohwasser Tobias Albert

On the Complexity of Block Switching

14728 Markus Schnell Ralf Geiger

Proposed Update on AAC-ELD Filterbank Description

14729

Ralf Geiger Ralph Sperschneider Manfred Lutzky Jürgen Herre Kristofer Kjörling Heiko Purnhagen

Proposed Profile for AAC-ELD

14730Hui Yong KimHyon-Gon ChooMunchurl Kim

(Editors' Input) Updated text of FCD 23000-9 MAF for DMB

14731

Eunmi OhJungHoe KimKiHyun ChooHosang SungMiyoung Kim

Response to CfI on speech and audio coding

14732 Seung Jun YangHui Yong KimHeekyung LeeHan-Kyu Lee

Updated proposal on TV-Anytime Metadata in ISO/IEC 23000-9 MAF for DMB

35



































































Munchurl KimYong Han Kim

14733Yang-Won JungHenney OhHyo Jin Kim

LGE Submission to SAOC CfP

14734

Henney OhYang-Won JungDongSoo KimHyunKook Lee

LGE Listening test report on SAOC RM selection

14735Henney OhYang-Won JungHyo Jin Kim

Comments on SAOC evaluation

14736 Sihyoung Lee, Seungji Yang, Yong Man Ro, Enhancement of PVP MAF for e-learning

14737

Dong Soo KimHyun-Kook LeeHee-Suk PangHenney OhYang-Won Jung

Listening Test results on Speech and Audio Exploration

14738 Kyoungro YoonMario Doeller

Report of the Ad-hoc Group on MPEG-7 Query Fomat

14739 Christophe Lucarz Simulator in the Eclipse environment for RVC

14740 ITU-T SG 9 via SC 29 Secretariat Liaison Statement from ITU-T SG 9 [SC 29 N 8597]

14741 DVB via SC 29 Secretariat Liaison Statement from DVB [SC 29 N 8598]

14742 French National Body French NB comment on AFX profiling


VCE-6 Experimental Conditions following Reflector Discussions

14744 Kyoungro YoonMario Doeller

AHG's Input for SoCD on MPEG-7 Query Format

14745

Tae-Beom LimKyoungro yoonJongseol LeeSaim ShinSeokPil Lee

Proposal for arithmetic and comparison operators

14746Patrick GioiaAnne Le BrisRomain Cavagna

Report on CE2: Space Partitioning Implementation in IM1

14747 Joseph Thomas-Kerr Report on CE on RMC Bitstream Syntax Description

14748 Gero Bäse none Thomas Rathgen Video Surveillance MAF file and camera identification

36




























































mailto:[email protected],%[email protected],%[email protected],%[email protected],%20thkimphd@l
















14749 Chrisa TsinarakiStavros Christodoulakis

Shortcomings of the current MP7QF Query Output Format

14750 Chrisa TsinarakiStavros Christodoulakis MP7QF Conditions & Operators

14751 the DVD Forum via SC 29 Secretariat Liaison Statement from the DVD Forum [SC 29 N 8602]

37









Annex D – Output documents

No. Source Title

9154 Convener List of Documents from the Lausanne, Switzerland Meeting

9155 Convener Resolutions of the Lausanne, Switzerland

9156 Convener List of AHGs Established at the 81st Meeting in Lausanne, Switzerland

9157 Convener Report of the 81st Meeting in Lausanne, Switzerland

9158 Convener Guidelines for Electronic Distribution of MPEG and WG 11 Document

9159 Convener Press Release of the 81st Meeting in Lausanne, Switzerland

9160 Convener Meeting Notice of the 82nd Meeting in Shenzhen, China

9161 HoD Guide for WG 11 Meeting Hosts

9162 HoD MPEG 101

9163 Requirements Multiview Video Coding Requirements

9164 Requirements MAFs Overview

9165 Requirements Call for Requirements on Professional Archival MAF

9166 Requirements Requirements for additional XML IPMP Messages

9167 Requirements IPTV Requirements

9168 Requirements Preliminary FTV Model and Requirements

9169 Requirements Metaverse: Context & Objectives

9170 Convener AHG on FTV

9171 Convener AHG on Ontologies

9172 MDS Study of ISO/IEC CD 15938-12 Query Format

9173 MDS TuC for MPEG Query Format v2.0

9174 MDS Schema Files for MPEG-21 Standards (v7)

9175 MDS DID Open Issues

9176 MDS Workplan for CE on DI Semantics

9177 MDS MPEG-21 REL Profiles Software Implementation Plan v.7

9178 MDS DoC for ISO/IEC FCD 21000-8 Reference Software 2nd Edition

9179 MDS Text of ISO/IEC FDIS 21000-8 Reference Software 2nd Edition

9180 MDS Request for Amendment 1 of ISO/IEC 21000-15 Security in ER

9181 MDS ISO/IEC PDAM/1 21000-15 Security in ER

9182 MDS Study of ISO/IEC FCD 23000-5 Media Streaming MAF

9183 MDS Study of ISO/IEC FCD 23000-7 OR Application Format

9184 MDS MPEG-21 DIA 2nd Edition Tutorial Presentation

9185 Convener AHG on MPEG Query Format

38

http://mpeg.nist.gov/reg/_listwg11_69.php?k=3,kv=1



9186 Convener AHG on Review of the MPEG-21 DI

9187 ISG Study of “ISO/IEC DTR 14496-9 3rd Edition Reference Hardware Description”

9188 Convener AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2.

9189 Testing SVC Verification Test Plan Version 1

9190 Convener AHG number for the AHG on SVC Verification Testing

9191 Video Text of ISO/IEC 14496-4:2004/PDAM 30 Conformance Testing for New Profiles for Professional Applications

9192 Video Text of ISO/IEC 14496-4:2004/PDAM 31 Conformance Testing for SVC Profiles

9193 Video Text of ISO/IEC 14496-5/Amd.1/DCOR 1

9194 Video Text of ISO/IEC 14496-5:2001 / PDAM 18 Reference Software for New Profiles for Professional Applications

9195 Video Text of ISO/IEC 14496-4:2001 / PDAM 19 Reference Software for SVC

9196 Video Disposition of Comments on ISO/IEC 14496-10:2005 / FPDAM 3

9197 Video Text of ISO/IEC 14496-10:2005 / FDAM 3 Scalable Video Coding

9198 Video Text of ISO/IEC 14496-10:200X / FDIS Advanced Video Coding (4th edition)

9199 Video Joint Scalable Video Model (JSVM) 11

9200 Convener Terms of Reference

9201 Convener MPEG Standards

9202 Convener Table of unpublished FDIS

9203 Convener Work plan and time line

9204 Convener Work item assignment

9205 Convener MPEG Standard Editors

9206 Convener Software assets

9207 Convener Conformance assets

9208 Convener Content assets

9209 Convener URI assets

9210 Convener Standards under development for which a call for patent statements is issued

9211 Convener List of Organisations with which MPEG entertains liaisons

9212 Video JSVM 11 Software

9213 Video Text of ISO/IEC 14496-10:2005 / PDAM 4 Multiview Video Coding

9214 Video Joint Multiview Video Model (JMVM) 5

9215 Video JMVM 5 Software

9216 Video Call for Proposals on Image and Video Signature Tools

9217 Video MPEG-7 Visual XM Document version 31.0

9218 Video Description of Core Experiments for MPEG-7 New Visual Extensions

39

9219 Video Disposition of Comments on ISO/IEC TR 15938-8:2002 / DAM 3

9220 Video Text of ISO/IEC TR 15938-8:2002/Amd.3 (Technologies for digital photo management using MPEG-7 visual tools)

9221 Video Disposition of Comments on ISO/IEC 23000-3 / PDAM 1

9222 Video Text of ISO/IEC 23000-3 / FPDAM 1 Reference Software for Photo Player MAF

9223 Video WD 5 of ISO/IEC 23001-4 Codec Configuration Representation

9224 Video WD 5 of ISO/IEC 23002-4 Video Tool Library

9225 Video Description of Core Experiments in RVC

9226 Video RVC Simulation Model (RSM) V5.0

9227 Video RVC Work Plan

9228 Video RVC Conformance Testing Working Draft 2.0

9229 Video Description of Exploration Experiments for Toolbox Extensions

9230 Video Description of Exploration Experiment in FTV

9231 Convener AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

9232 Convener AHG on Reconfigurable Video Coding

9233 Convener AHG on MPEG-7 Visual and Photo Player MAF

9234 Convener AHG on Video Annotation

9235 Audio ISO/IEC 14496-3:2006/AMD2:2006/Dcor 3, ALS

9236 Audio Study on ISO/IEC 14496-3/DCOR 5, DST and MP3on4 and LTP

9237 Audio Technology under consideration for AAC-ELD

9238 Audio Workplan for AAC-ELD

9239 Audio WD on ISO/IEC 14496-3, MPEG-4 Audio Fourth Edition

9240 Audio DoC on 14496-4:2004/PDAM 29, SMR Conformance

9241 Audio ISO/IEC 14496-4:2004/FPDAM 29, SMR Conformance

9242 Audio ISO/IEC 14496-4:2004/AMD13:2007/DCOR 1, LD AAC test sequences

9243 Audio ISO/IEC 14496-4:2004/DCOR 5, Audio Corrections

9244 Audio Study on ISO/IEC 14496-4:2004/FPDAM 20, SLS and MPEG-1/2 on MPEG-4 Conformance

9245 Audio Status of SLS conformance

9246 Audio Status of BSAC Extension Conformance and Reference Software

9247 Audio Study on ISO/IEC 14496-5:2001/AMD 10:2007/DCOR 1, BSAC and SLS, ALS Corrections

9248 Audio Study on ISO/IEC 14496-5:2001/PDAM 20, MPEG-1 and -2 on MPEG-4 and BSAC Extensions

9249 Audio ISO/IEC 23003-1:2007/DCOR 1

40

9250 Audio Report on Spatial Audio Object Coding CfP Selection

9251 Audio First thoughts on SAOC Verification Test

9252 Audio Report on Evaluation of Speech and Audio Framework

9253 Audio Workplan for Exploration of Speech and Audio Coding

9254 Audio Framework for Exploration of Speech and Audio Coding

9255 Audio Draft Call for Proposals on Joint Speech and Audio Coding

9256 Convener AHG on Audio Standards Maintenance

9257 Convener AHG on AAC-ELD, Speech and Audio Exploration and SAOC

9258 3DGC Study Text of ISO/IEC 14496-4:2004/ FPDAM21 (Geometry and Shadow Conformance)

9259 3DGC Request for Amendment of ISO/IEC 14496-4:2004 (FAMC Conformance)

9260 3DGC WD 1.0 of ISO/IEC 14496-4:2004 AMD32 (FAMC Conformance)

9261 3DGC Request for Amendment of ISO/IEC 14496-4:2004 (MultiResolution Profile Conformance)

9262 3DGC WD 1.0 of ISO/IEC 14496-4:2004 AMD33 (MultiResolution Profile Conformance)

9263 3DGC Study Text of ISO/IEC 14496-5:2001/ FPDAM13 (Geometry and Shadow RefSoft)

9264 3DGC Request for amendment of ISO/IEC 14496-5:2001 (FAMC RefSoft)

9265 3DGC WD1.0 of ISO/IEC 14496-5:2001 AMD21 (FAMC RefSoft)

9266 3DGC Text of ISO/IEC 14496-16:2006/PDAM2 (Frame-based Animated Mesh Compression)

9267 3DGC Text of ISO/IEC 14496-16:2006/PDAM3 (3D MultiResolution Profile)

9268 3DGC 3D Graphics Core Experiments Description

9269 3DGC 3D Graphics Compression FAQ 20.0

9270 3DGC WD 2.0 of ISO/IEC 14496-25

9271 3DGC DoC on ISO/IEC 14496-25

9272 Convener AHG on InvestigatingVideo Standardization by Applications

9273 Systems Request ISO/IEC 13818-1/Amd.3 Carriage of SVC in MPEG-2 Systems

9274 Systems Text of ISO/IEC 13818-1/PDAM3 Carriage of SVC in MPEG-2 Systems

9275 Systems Text of ISO/IEC 14496-4/FPDAM 22 AudioBIFS v3 Conformance

9276 Systems Study Text of ISO/IEC 14496-4/FPDAM 25 LASeR & SAF V1 Conformance

9277 Systems Request for ISO/IEC 14496-4/Amd.27 LASeR V2 Conformance

9278 Systems Text of ISO/IEC 14496-4/PDAM 27 LASeR V2Conformance

9279 Systems DoC of ISO/IEC 14496-5/PDAM 16 Symbolic Music Rep. Reference Software

9280 Systems Text of ISO/IEC 14496-5/FPDAM 16 Symbolic Music Rep. Reference Software

41

9281 Systems DoC of ISO/IEC 14496-5/PDAM 17 LASeR v1 Reference Software

9282 Systems Text of ISO/IEC 14496-5/FPDAM 17 LASeR v1 Reference Software

9283 Systems Text of ISO/IEC 14496-15/FPDAM 2 (SVC File Format)

9284 Systems Study Text of ISO/IEC 14496-20/FPDAM 2 (SVGT1.2 Support)

9285 Systems Study of ISO/IEC 14496-20/DCOR2

9286 Systems TuC for ISO/IEC 14496-20/Amd.2

9287 Systems WD4.0 of ISO/IEC 14496-20 2nd Edition (1st Ed. + Cor 1 + Amd.1)

9288 Systems IuC for LASeR

9289 Systems Request of ISO/IEC 23000-4/ Musical Slide Show 2nd Edition

9290 Systems Text of ISO/IEC 23000-4/CD Musical Slide Show 2nd Edition

9291 Systems WD1.0 of ISO/IEC 23000-4/Amd.1 MSS MAF Conf. and Ref. Software

9292 Systems Study Text of ISO/IEC 23000-8/CD Portable Video Player

9293 Systems Study Text of ISO/IEC 23000-9/FCD (MAF for DMB)

9294 Systems TuC on MAF for DMB

9295 Systems Text of ISO/IEC 23000-10/CD (Video Surveillance MAF)

9296 Systems DoC on ISO/IEC 23001-1/FPDAM2 (Prefixes and wild cards extensions)

9297 Systems Text of ISO/IEC 23001-1/FDAM2 (Prefixes and wild cards extensions)

9298 Systems Study Text of ISO/IEC 23001-3/FCD (IPMP XML Messages)

9299 Systems Text of ISO/IEC 23004-8/CD Reference Software and Conformance

9300 Systems M3W Reference Software and Conformance Plan

9301 Systems Study Text of ISO/IEC 29116-1/FCD Media Streaming MAF Protocol

9302 Systems A project to exploit MPEG standards in tune with industry practices and needs (Revised version)

9303 Convener Ad Hoc Group on Scene Representation

9304 Convener Ad Hoc Group on MPEG File Formats

9305 Convener Ad Hoc Group on MAF Under Development in Systems

9306 Convener AHG on 3DG documents, experiments and software maintenance

9307 Systems TuC on ISO/IEC 14496-12

9308 Systems TuC on ISO/IEC 14496-15 (MVC extensions)

9309 Liaison Liaison Statement to AES

9310 Liaison Liaison Statement to ITU-T re Joint Speech & Audio Coding

9311 Liaison Liaison Statement to 3GPP re Joint Speech & Audio Coding

9312 Liaison Liaison Statement to 3GPP2

9313 Liaison Liaison Statement to IEC TC100

9314 Liaison Liaison Statement to ITU-T IPTV Focus Group re "Toolbox for Content Coding"

42

9315 Liaison Liaison Statement to SMPTE re RVC

9316 Liaison Liaison Statement to SCTE

9317 Liaison Liaison Statement to AVS

9318 Liaison Liaison Statement to ITU-T SG9 re FTV

9319 Liaison Liaison Statement to DVB

9320 Liaison Liaison Statement to 3GPP TSG SA WG4 re DIMS/LASeR

9321 Liaison Liaison Statement to OMA

9322 Liaison Liaison Statement to ITU-T IPTV Focus Group re Presentation Formats for IPTV

9323 Liaison Liaison Statement to WG1

9324 Systems DOCR on ISO/IEC 14496-15/PDAM 2 (SVC File Format)

9325 Requirements Possible Requirements for a New Rights Ontology

9326 Liasion Responses to National Bodies

9327 Liasion List of Organisations with which MPEG entertains liaisons (as of July 2007)

43

Annex E – Requirements report

Source: Fernando Pereira (Instituto Superior Técnico, Lisboa-Portugal)

Note: Requirements agenda for the Lausanne Jose MPEG meeting is annexed at the end of this report.

1. Requirements documents approved at this meeting

N 9163 MVC RequirementsN9164 MAFs OverviewN9165 Call for Requirements on Professional Archival MAFN9168 Preliminary FTV Model and RequirementsN9166 Requirements for Additional XML IPMP MessagesN9167 IPTV RequirementsN9169 Metaverse: Context and ObjectivesN9325 Revised Requirements for a Machine Readable Rights Ontology

2. MPEG-4

2.1. Multiview Video Coding (MVC) (joint with Video)14631, Hideaki Kimata, Shinya Shimizu, Proposal on MVC Requirements for different cameras The MVC requirements additions proposed in this contribution have been included in the MVC Requirements doc (N9163).

2.2. 4:4:4 Content Coding (joint with Video)14615, Tokumichi Murakami, Kohtaro Asai, Shun-ichi Sekiguchi, Shuic, Requirement of Real-Color Video Coding for Consumer Application This contribution claims that 4:4:4 coding is becoming more and more competitive regarding 4:2:0 coding, notably for consumer applications. As such, there is a need to study the 4:4:4 coding performance in existing AVC profiles with 4:4:4 coding capabilities. Based on collected evidence, actions may have to be proposed, e.g. a new level in existing profile or even a new profile.

2.3. Laser (joint with Systems)14682, Diego Gibellino, Giovanni Cordara, on LASeR Main ProfileThis contribution brought support to the definition of the Laser Main profile and to the removal of the Laser Full profile. Following this, it was decided to promote the Main profile to a Laser amendment. The current Laser profiling situation is thus:Version 1: MINI profile (FULL profile has been removed)Version 2: CORE profile hierarchical to MINI & MAIN profile hierarchical to CORE

44

3. MPEG-7

3.1. Video and Image Signatures (joint with Video)After MPEG identified the need for unique visual descriptions to support a number of applications related to the detection of duplicated visual media, experiments have shown that existing MPEG-7 visual descriptors do not fulfill all the requirements of a visual signature descriptor. Following this observation, requirements for image and video signatures have been defined, notably uniqueness, robustness, independence, fast matching, fast Extraction and compactness. Based on these requirements, a Call for Proposals with different deadlines for image (October 2007) and video (April 2008) signatures has been issued at this meeting.

3.2. Video Annotation (joint with Video)14706, Quqing Chen, Zhi-bo Chen, Requirement of Video AnnotationNone of the authors was present at the meeting to present this contribution.

4. MPEG-21

4.1. Digital Item Declaration14559, Gerrard Drury Giovanni Cordara, AHG on Review of MPEG-21 DIDThis contribution reported the conclusions of the AHG on MPEG-21 DID which targeted 1. Investigate whether the current DID (ISO/IEC 21000-2) requirements fit with today’s industry, and if not review the requirements.2. Collect information on how DID is currently used.3. Identify current deficiencies with DID and propose ways to address these deficiencies.4. Investigate feasibility of producing royalty-free DID.

14611, Pedro Carvalho, Helder Castro, Maria Teresa Andrade, Giorgiana Ciobanu, Christian Timmerer, Hermann Hellwagner, Input to AHG on Review of MPEG-21 DID This contribution reports an analysis of the fulfillment of the MPEG-21 DID requirements by the DID specification made by experts of the ENTHRONE project.

14708, Davide Rogai, Pierfrancesco Bellini, Paolo Nesi, Input to MPEG-21 DID ReviewThis contribution reports another analysis of the fulfillment of the MPEG-21 DID requirements by the DID specification made by experts of the AXEMIS project.

Following the contributions above, it was decided to: 1. Define the first DI Interoperability Experiment to learn while using ‘real DIs’ (see MDS report) 2. Issue a document with DID Open Issues, notably DI & file format and DI presentation (see

MDS report)

4.2. Rights Ontologies (joint with MDS)14707, Jaime Delgado, Marc Gauvin, Requirements for a Machine Readable Rights OntologyThis contribution proposed some requirements for a possible new rights ontology. Following the discussions, it was decided there was a need to define more precisely the requirements with examples and a need to understand the relation with existing relevant MPEG standards, notably REL and RDD. If possible, it would be useful to define the model used to derive the proposed requirements.

45

After a couple of joint meetings with MDS, it was decided to create an AHG with the task to discuss and refine the possible new requirements based on output document N9325. This document contains the result of the discussions made during the week in the sessions dedicated to the topic addressed in this document based on input document m14762. Its content does not currently reflect the consensus within MPEG.

5. MPEG-A

5.1. Professional Archival MAF14612, Xin Wang, Security and DRM Requirements for Professional Archival MAF 14613, Noboru Harada, Takehiro Moriya, Yutaka Kamamoto, Updated overview document for Professional Archival MAF

These contributions brought revised requirements for the Professional Archival MAF. However, it was still felt there is a further need to refine and focus the requirements for this MAF as well to gather enough critical mass for the technical development of this MAF. Recognizing that multimedia archival is an important application domain and Multimedia Applications Formats (MAFs) may play a relevant role in bringing some degree of interoperability to this domain, the Requirements subgroup is calling for requirements related to all applications in the area of multimedia archival. With that purpose, a Call for Requirements has been issued at this meeting (N9165).

5.2. Stereoscopic MAF14663, Next Generation Broadcasting Standard Forum Korea, Revised requirement for Stereoscopic MAF 14664, Next Generation Broadcasting Standard Forum Korea, Proposal for technical specification of Stereoscopic MAF 14665, Next Generation Broadcasting Standard Forum Korea, Requirement for Packaged media Stereoscopic MAF This set of contributions brought further input regarding the Stereoscopic MAF promoted to ‘under consideration’ at last meeting. The authors proposed two MAFs derived from the previous Stereoscopic MAF, the so-called ‘Mobile stereoscopic’ MAF and ‘High resolution stereoscopic’ MAF. Regarding, the so-called ‘Mobile stereoscopic’ MAF there is a need to complete the missing requirements; regarding the so-called ‘High resolution stereoscopic’ MAF, there is a need to bring precise requirements to understand its precise application domain target and the difference regarding the so-called ‘Mobile stereoscopic’ MAF.

5.3. Cross-Media Interactive Presentation MAF14604, Davide Rogai, Pierfrancesco Bellini, Paolo Nesi, Cross-Media Interactive Presentation This contribution proposed the Cross-Media Interactive Presentation MAF which by consensus was promoted to ‘under consideration’.

5.4. Summary on MAFsThe global MAF situation after the Lausanne Jose MPEG meeting is summarized in the MAFs Overview document (N9164) as follows:

1. MAFs Finalizeda. Music Player MAF (including protection) b. Photo Player MAF

46

c. Musical Slide Show MAF (without protection)2. MAFs Under Development

a. Photo Player MAF (under Video) b. Musical Slide Show MAF, including protection (under Systems) c. Media Streaming MAF (under MDS) d. Professional Archival MAF (under MDS) e. Open Release MAF (under MDS) f. Portable Video Player MAF (under Systems) g. MAF for Digital Multimedia Broadcasting (under Systems)h. Video Surveillance MAF (under Systems)

3. MAFs Under Considerationa. Advanced Surveillance MAFb. Protected Photo Player MAFc. Digital Video/Cinema MAFd. Stereoscopic MAFe. Cross-Media Interactive Presentation

The MAFs under consideration for which there was no input in recent meetings may be removed from this status at next MPEG meeting.

6. MPEG-B

6.1. XML IPMP Messages14659, Hyon-Gon Choo, Filippo Chiariglione, Requirements for XML IPMP Messages Ontologies This contribution proposed requirements for additional XML IPMP messages. XML IPMP Messages are simple and natural extensions to the current IPMP Information Descriptor defined in ISO/IEC 21000-4 (IPMP Components). XML IPMP Messages are extensions of binary IPMP-X messages to XML messages. The additional XML IPMP Messages requirements have been approved. Additional XML IPMP Messages will be specific in MPEG-B Part 3.

7. MPEG-C

7.1. Part 3

7.2. 14699, Fons Bruls, Jan van der Meer, Chris Varekamp, Arnaud Bourge, Yann Picard, Additional Requirements for stereoscopic video in MPEG-C part 3

This contribution proposed some changes to the requirements for Stereoscopic Video (MPEG-C part 3). Following the discussions, it was concluded that no changes to the requirements were needed.

8. Explorations

8.1. Freeviewpoint Television (FTV)14560, Hideaki Kimata, Karsten M.ler, AHG on FTV (Free Viewpoint Television)

47

14648, Toshiaki Fujii, Hideaki Kimata, Shigeyuki Sakazawa, Requirements for FTV14626, Taka Senoh, Kenji Yamamoto, Ryutaro Oi, Tomoyuki Mishina, Makoto Okui, Consideration of image depth informationThese contributions brought inputs for the improvement of the ‘Preliminary FTV Model and Requirements’ document from last meeting, notably in terms of:

FTV clear definition (notably difference regarding MVC) Application scenarios Basic technical approach FTV architecture and model Normative elements Requirements (overall and for each normative element)

Based on these contributions, a revised version of the ‘Preliminary FTV Model and Requirements’ document has been issued (N9168). This document still adopts a very much video centric point of view, and thus there is a strong need to improve and complete it from the audio (and eventually systems) perspective(s).

14646, Kazuya Takeda, SLPA (Selective Listening Point Audio) for FTV AudioThis contribution proposed audio FTV requirements and was presented in a joint meeting with the Audio subgroup. Following this joint meeting, the Audio subgroup drafted some FTV audio requirements which have been included in the revised version of the ‘Preliminary FTV Model and Requirements’ document.

14647, Toshiaki Fujii, Proposal on EE for FTV This contribution proposed an experiment for FTV. This input was instrumental to highlight the need to collect adequate FTV test material including accurate depth maps (or software able to extract these depth maps) and to define test conditions for the evaluation of FTV technologies.

An AHG has been created (N9170) with the purpose of improving the ‘Preliminary FTV Model and Requirements’ document, collect test material and define adequate test conditions.

8.2. Colour Reproduction Metadata14627, Maeng-Sub Cho, Jin-Seo Kim, Bon-ki Koo, Sang-Kyun Kim, Initiating a new application format for Consistent Color Reproduction 14628, Maeng-Sub Cho, Jin-Seo Kim, Bon-Ki Koo, Sang-Kyun Kim, Parameter set for effective and consistent color reproductionThese contributions addressed the problem of consistent colour reproduction in different types of displays proposing some metadata to address this problem. After discussion, it was concluded that these problem has been addressed in MPEG since a long time, notably in MPEG-1, MPEG-2, MPEG-4 and MPEG-7 for the colour description and in MPEG-21 DIA for the terminal capabilities description. The authors were encouraged to review the set of relevant available tools already specified by MPEG and make further contributions in the future if there are still needs in this area that have not been yet adequately addressed.

8.3. IPTV Requirements14714, Xin Wang, An Update on IPTV RequirementsThis contribution collects the requirements brought to MPEG by other bodies in the IPTV domain (based on the output document issued 2 meetings ago).

48

The number of requirements collected showed that MPEG needs to understand the IPTV landscape to understand what can be the core contribution of MPEG in the IPTV space.

14717, Jaeyeon Song, Young-kwon Lim, The first ideas on LASeR in IPTVThis contribution brought first ideas for Laser Requirements relevant for IPTV. One requirement has been included in the output IPTV Requirements document following the discussion of this document.

Following the discussions, it was decided to address the collected IPTV requirements in the following way: Top-Down by classifying the requirements according to the following categories:

o Not relevant for MPEG – Why ? Do we expect another body to do the work ? If yes, identify it … for possible liaison …

o Relevant for MPEG 2.1) Relevant for MPEG and already addressed – Where ? 2.2) Relevant for MPEG and to be addressed – How ? 2.3) Relevant for MPEG but not to be addressed – Why ?

Bottom-Up by directly identifying the issues more relevant for MPEG and for which there are available human resources, e.g. as already done with the Laser requirements

Following the work at this meeting, a revised version of the IPTV Requirements document has been issued (N9167).

8.4. Metaverse14760, Jean H.A. Gelissen, Metaverse Context and ObjectiveThis contribution proposed a new MPEG standardization activity based on the concept of metaverse. The Metaverse is a virtual (3D) world where people can work, interact, play, travel, learn and augment the real life. The broad acceptance of virtual words (serious games) and the relation to the real world brings emerging opportunities and challenges. A Metaverse activity would target the provision of a standardized global framework and associated interfaces, metadata definitions and the like, to enable the interoperability between virtual worlds, e.g. Second Life, and the real world.Following the discussions, it was decided to issue an output document (N9169) based on this input document with a disclaimer stating that this work is not yet endorsed by MPEG. However, MPEG recognized the importance of the issues addressed regarding opportunities for MPEG standardization and kindly asks MPEG members and the community at large to provide input contributions regarding the opportunities highlighted in this document by the next meeting.

49

9. 81st MPEG (Lausanne) Agenda Requirements

10. Room: Paris

TIME TOPIC ROOM

Monday

9:00-end Opening Plenary Meeting

Lunch

Opening and Requirements Agenda for the Week

14:00-15:00

IPTV Requirements

14714, Xin Wang, An Update on IPTV Requirements

14717, Jaeyeon Song, Young-kwon Lim, The first ideas on LASeR in IPTV

Reqs

15:00-16:00 Video and Image Identifier/Signature Requirements MPEG-7 Visual

BoG

17:00-18:00

Various (joint with Systems)

14682, Diego Gibellino, Giovanni Cordara, on LASeR Main Profile

14659, Hyon-Gon Choo, Filippo Chiariglione, Requirements for XML IPMP Messages

Reqs

18:00-20:00 HoDs Meeting HoD

50

Tuesday

9:00-12:00

Various (joint with Video)

Color

14615, Tokumichi Murakami, Kohtaro Asai, Shun-ichi Sekiguchi, Shuic, Requirement of Real-Color Video Coding for Consumer Application

14627, Maeng-Sub Cho, Jin-Seo Kim, Bon-ki Koo, Sang-Kyun Kim, Initiating a new application format for Consistent Color Reproduction

14628, Maeng-Sub Cho, Jin-Seo Kim, Bon-Ki Koo, Sang-Kyun Kim, Parameter set for effective and consistent color reproduction

MVC

14631, Hideaki Kimata, Shinya Shimizu, Proposal on MVC Requirements for different cameras

14626, Taka Senoh, kenji Yamamoto, Ryutaro Oi, Tomoyuki Mishina, Makoto Okui, Consideration of image depth information

FTV

14560, Hideaki Kimata, Karsten M.ler, AHG on FTV (Free Viewpoint Television)

14648, Toshiaki Fujii, Hideaki Kimata, Shigeyuki Sakazawa, Requirements for FTV

14647, Toshiaki Fujii, Proposal on EE for FTV

14740, Liaison Statement from ITU-T SG 9

MPEG-C Part 3

14699, Fons Bruls, Jan van der Meer, Chris Varekamp, Arnaud Bourge, Yann Picard, Additional Requirements for stereoscopic video in MPEG-C part 3

Stereoscopic MAF

14663, Next Generation Broadcasting Standard Forum Korea, Revised requirement for Stereoscopic MAF

14664, Next Generation Broadcasting Standard Forum Korea, Proposal for technical specification of Stereoscopic MAF

14665, Next Generation Broadcasting Standard Forum Korea, Requirement for Packaged media Stereoscopic MAF

Reqs

12:00-14:00 Lunch 14:00-16:00

MPEG-A

MAFs UNDER DEVELOPMENT (with MDS, Systems)

Professional Archival MAF

14612, Xin Wang, Security and DRM Requirements for Professional Archival MAF

14613, Noboru Harada, Takehiro Moriya, Yutaka Kamamoto, Updated overview document

Reqs

51

for Professional Archival MAF

MAFs UNDER CONSIDERATION (with MDS, Video, Systems)

Stereoscopic MAF

14663, Next Generation Broadcasting Standard Forum Korea, Revised requirement for Stereoscopic MAF

14664, Next Generation Broadcasting Standard Forum Korea, Proposal for technical specification of Stereoscopic MAF

14665, Next Generation Broadcasting Standard Forum Korea, Requirement for Packaged media Stereoscopic MAF

NEW MAF PROPOSALs (with MDS, Systems)

MAF on Cross-Media Interactive Presentation

14604, Davide Rogai, Pierfrancesco Bellini, Paolo Nesi, Cross-Media Interactive Presentation MAF

16:00-18:00

Various (joint with MDS)DID

14559, Gerrard Drury Giovanni Cordara, AHG on Review of MPEG-21 DID

14611, Pedro Carvalho, Helder Castro, Maria Teresa Andrade, Giorgiana Ciobanu, Christian Timmerer, Hermann Hellwagner, Input to AHG on Review of MPEG-21 DID

14708, Davide Rogai, Pierfrancesco Bellini, Paolo Nesi, Input to MPEG-21 DID Review

IPMP

14659, Hyon-Gon Choo, Filippo Chiariglione, Requirements for XML IPMP Messages

Event Reporting

14622, Eva Rodriguez, Jaime Delgado, Security requirements for Event Reporting

Ontologies

14707, Jaime Delgado, Marc Gauvin, Requirements for a Machine Readable Rights Ontology

Reqs

18:00-19:00 Liaison Meeting

Social Event

Wednesday

09:00-end plenary Plenary Meeting

12:00-13:00Various (joint with Audio)

14646, Kazuya Takeda, SLPA (Selective Listening Point Audio) for FTV Audio

Requirements for Joint Audio and Speech

Audio

52

Lunch

14:00-15:00Metaverse (joint with MDS)

14760, Jean H.A. Gelissen, Metaverse Context and ObjectiveReqs

15:00-17:00

Discussing DID (joint with MDS) Reqs

BoGs

Thursday

9:00-10:00

Feedback from FTV BoG

Refine the existing doc with basic approach, definition of FTV, applications scenarios and requirements

14740, Liaison Statement from ITU-T SG 9

also

14699, Fons Bruls, Jan van der Meer, Chris Varekamp, Arnaud Bourge, Yann Picard, Additional Requirement for stereoscopic video in MPEG-C part 3

Reqs

10:00-11:00

Feedback on Cfp on Visual Signatures

also

14706, Quqing Chen, Zhi-bo Chen, Requirement of Video Annotation

MPEG-7 Visual

11.00-12:00IPTV Requirements (joint with Systems)

Feedback on IPTV Requirements BoGReqs

12:00-13:00 Feedback on Ontologies BoG Reqs

Lunch

14:00-15:00Feedback on possible Call for Requirements for the Professional Archival MAF (joint

with MDS) Reqs

15:00-16:00 Feedback on DID (joint on MDS) Reqs

BoGs

18:00-end Chairs Meeting

53

Friday

9:00-9:15Concluding MPEG-4

MVC Requirements – Kimata san Reqs

- Concluding MPEG-7 Reqs

Concluding MPEG-21 Reqs

9:15-10:00

Concluding MPEG-AMAFs Overview - Florian

Professional Archival Call for Requirements – Noboru sanReqs

10:00-10:10Concluding MPEG-B

XML IPMP Messages Requirements - Filipo

10:10–11:00

Explorations

IPTV Requirements – Xin

Preliminary FTV Model and Requirements – Kimata san

AHG on FTV – Kimata san

Liaison to ITU-T SG 9 – Kimata san

Metaverse: Context & Objective – Jean + recommendation

AHG on Ontologies – Marc

Reqs

-12:00 -14:00 Lunch

14:00-end plenary Plenary Meeting

54

Annex F – Systems report

Source: Olivier Avaro (Streamezzo)Contributors: David Singer (Apple), Young-Kwon Lim (Net&TV), Jean Gelissen (Philips), Gero Baese (Siemens)

1 OverviewThe main outputs of the meeting from the Systems Sub-group perspective are:

No. Title TBP AvailableX 13818-1 MPEG-2 Systems9273 Request ISO/IEC 13818-1:2006/Amd.3 Carriage of SVC in MPEG-2 Systems No 06/07/079274 Text of ISO/IEC 13818-1:2006/PDAM3 Carriage of SVC in MPEG-2 Systems No 13/07/07X 14496-4 Conformance testing9275 Text of ISO/IEC 14496-4/FPDAM 22 AudioBIFS v3 Conformance No 06/07/079276 Study Text of ISO/IEC 14496-4/FPDAM 25 LASeR & SAF V1 Conformance No 06/07/079277 Request for ISO/IEC 14496-4/Amd.27 LASeR V2 Conformance No 06/07/079278 Text of ISO/IEC 14496-4/PDAM 27 LASeR V2Conformance No 06/07/07X 14496-5 Reference Software9279 DoC of ISO/IEC 14496-5/PDAM 16 Symbolic Music Rep. Reference Software No 06/07/079280 Text of ISO/IEC 14496-5/FPDAM 16 Symbolic Music Rep. Reference Software No 06/07/079281 DoC of ISO/IEC 14496-5/PDAM 17 LASeR v1 Reference Software No 06/07/079282 Text of ISO/IEC 14496-5/FPDAM 17 LASeR v1 Reference Software No 06/07/07X 14496-12 ISO Base Media File Format9307 TuC on ISO/IEC 14496-12 No 06/07/07X 14496-15 AVC File Format9324 DoC on ISO/IEC 14496-15/PDAM 2 (SVC File Format) No 06/07/079283 Text of ISO/IEC 14496-15/FPDAM 2 (SVC File Format) No 13/07/079308 TuC on ISO/IEC 14496-15 (MVC extensions) No 06/07/07X 14496-20 Lightweight Application Scene Representation9284 Study Text of ISO/IEC 14496-20/FPDAM 2 (SVGT1.2 Support) Yes 06/07/079285 Study of ISO/IEC 14496-20/DCOR2 No 06/07/079286 TuC for ISO/IEC 14496-20/Amd.2 No 06/07/079287 WD4.0 of ISO/IEC 14496-20 2nd Edition (1st Ed. + Cor 1 + Amd.1) Yes 06/07/079288 IuC for LASeR No 06/07/07X 23000-4 Musical Slide Show MAF9289 Request of ISO/IEC 23000-4/ Musical Slide Show 2nd Edition No 06/07/079290 Text of ISO/IEC 23000-4/CD Musical Slide Show 2nd Edition No 06/07/079291 WD1.0 of ISO/IEC 23000-4/Amd.1 MSS MAF Conf. and Ref. Software No 06/07/07X 23000-8 Portable Video Player9292 Study Text of ISO/IEC 23000-8/CD Portable Video Player No 06/07/14X 23000-9 Digital Multimedia Broadcasting Application Format9293 Study Text of ISO/IEC 23000-9/FCD (MAF for DMB) No 06/08/079294 TuC on MAF for DMB No 06/07/07X 23000-10 Video Surveillance MAF9295 Text of ISO/IEC 23000-10/CD (Video Surveillance MAF) No 13/07/07X 23001-1 Binary MPEG Format for XML9296 DoC on ISO/IEC 23001-1/FPDAM2 (Prefixes and wild cards extensions) No 06/07/079297 Text of ISO/IEC 23001-1/FDAM2 (Prefixes and wild cards extensions) No 13/07/07X 23001-3 IPMP XML Messages9298 Study Text of ISO/IEC 23001-3/FCD (IPMP XML Messages) No 13/07/07X 23004-8 Reference Software9299 Text of ISO/IEC 23004-8/CD Reference Software and Conformance No 06/07/079300 M3W Reference Software and Conformance Plan No 06/07/07X 29116-1 Media Streaming MAF Protocol

55

9301 Study Text of ISO/IEC 29116-1/FCD Media Streaming MAF Protocol No 13/07/07X Exploration9302 A project to exploit MPEG standards in tune with industry practices and needs

(Revised version)No 06/07/07

11. General issues

11.1. GeneralThe meeting report from Hangzou has been approved.The following demonstrations have been made:

None.

11.2. List of standards under developmentPr Pt Edit. Project Description CfP WD CD FCD FDIS

2 1 2006 Cor.1 Reference to AVC Specification

07/04 07/10

2 1 2006 Amd.3 SVC in MPEG-2 Systems 07/07 07/10 08/044 4 2004 Amd.23 Synthesized Texture

conformance06/07 07/01 07/04 07/10

4 4 2004 Amd.24 File Format Conformance 06/04 06/10 07/04 07/104 4 2007 Amd.25 LASeR V1 Conformance 06/04 06/10 07/04 07/104 4 2007 Amd.26 Open Font Format

Conformance07/04 07/10 08/01 08/07

4 4 2007 Amd.27 LASeR Amd.1 Conformance

06/10 07/07 07/10 08/04

4 5 2007 Amd.14 Open Font Format Ref. Soft 07/10 08/04 08/10 09/014 5 2007 Amd.16 Symbolic Music Rep. Ref.

Soft06/10 07/01 07/07 08/01

4 5 2007 Amd.17 LASeR Ref. Soft 06/10 07/01 07/07 08/014 15 2005 Amd.2 SCV File Format Extensions 05/10 06/07 07/07 08/014 20 2004 Cor.2 Profile Removal 07/04 07/104 20 2004 Amd.2 SVGT1.2 Support 05/10 07/04 07/1021 9 200x Amd.1 MP21 Mime Type 07/04 07/10 08/01A 4 200x Amd.1 MSS MAF Conf. and Soft 07/07 07/10 08/01 08/04A 4 200x Amd.2 Protected Musical Slide

Show07/04 07/07 07/10 08/04

A 8 200x 1st Ed. Portable Video Player MAF 06/10 07/04 07/10 08/01A 9 200x 1st Ed. Digital Multi. Broadcasting

MAF06/10 07/01 07/04 07/10

A 10 200x 1st Ed. Video Surveillance MAF 07/04 07/07 07/10 08/04B 3 200x 1st Ed. IPMP XML Messages 06/10 07/04 07/10E 8 200x 1st Ed. Ref. Soft. and Conformance 07/01 07/07 07/10 08/01

29116 1 200x 1st Ed. Media Streaming MAF Protocols

06/10 07/04 07/10

X 1 200x 1st Ed. MPEG eXtensible Middleware

TDB

56

11.3. Standing Documents

Pr Pt Documents No. Meeting1 1 MPEG-1 White Paper – Multiplex Format N7675 05/07 Nice1 1 MPEG-1 White Paper – Terminal Architecture N7676 05/07 Nice1 1 MPEG-1 White Paper – Multiplexing and

SynchronizationN7677 05/07 Nice

2 1 MPEG-2 White Paper – Multiplex Format N7678 05/07 Nice2 1 MPEG-2 White Paper – Terminal Architecture N7679 05/07 Nice2 1 MPEG-2 White Paper – Multiplexing and

SynchronizationN7680 05/07 Nice

2 11 MPEG-2 White Paper – MPEG-2 IPMP N7503 05/07 Poznan4 1 MPEG-4 White Paper – MPEG-4 Systems N7504 05/07 Poznan4 1 MPEG-4 White Paper – Terminal Architecture N7610 05/10 Nice4 1 MPEG-4 White Paper – M4MuX N7921 06/01 Bangkok4 1 MPEG-4 White Paper – OCI N8148 06/04 Montreux4 6 MPEG-4 White Paper – DMIF N8149 06/04 Montreux4 11 MPEG-4 White Paper – BIFS N7608 05/10 Nice4 12 MPEG-4 White Paper – ISO File Format N8150 06/04 Montreux4 14 MPEG-4 White Paper – MP4 File Format N7923 06/01 Bangkok4 15 MPEG-4 White Paper – AVC FF N7924 06/01 Bangkok4 13 White Paper on MPEG-4 IPMP N7505 05/07 Poznan4 13 MPEG IPMP Extensions Overview N6338 04/03 München4 17 White Paper on Streaming Text N7515 05/07 Poznan4 18 White Paper on Font Compression and Streaming N7508 05/07 Poznan4 20 Presentation Material on LASER N6969 05/01 Hong-

Kong4 20 White Paper on LASeR N7507 05/07 Poznan4 22 White Paper on Open Font Format N7519 05/07 Poznan7 1 MPEG-7 White Paper - MPEG-7 Systems N7509 05/07 Poznan7 1 MPEG-7 White Paper – Terminal Architecture N8151 06/04 Montreux21 9 MPEG-21 White Paper – MPEG-21 File Format N7925 06/01 BangkokB X MPEG-B White Paper – BinXML N7922 06/01 BangkokE X MPEG Multimedia Middleware Context and

ObjectivesN6335 04/03 München

E X 1rst M3W White paper N7510 05/07 PoznanE X 2nd M3W White Paper : Architecture N8152 06/04 MontreuxE X Tutorial on M3W N8153 06/04 MonreuxE X M3W White Paper : Multimedia Middleware

ArchitectureN8687 06/10 Hanzhou

E X M3W White Paper : Multimedia API N8688 06/10 HanzhouE X M3W White Paper : Component Model N8689 06/10 HanzhouE X M3W White Paper : Resource and Quality

ManagementN8690 06/10 Hanzhou

E X M3W White Paper : Component Download N8691 06/10 HanzhouE X M3W White Paper : Fault Management N8692 06/10 HanzhouE X M3W White Paper : System Integrity

ManagementN8693 06/10 Hanzhou

57

11.4. Mailing Lists Reminder

Topic Information Kindly Managed by

General Systems

List

Liste Reflector : [email protected]:

http://lists.uni-klu.ac.at/mailman/listinfo/gen-sysmailto:[email protected]?subject=subscribe

List-Archive: http://lists.uni-klu.ac.at/pipermail/gen-sysList-Help: mailto:[email protected]?subject=help

University of Klagenfurt

BiM


http://lists.uni-klu.ac.at/mailman/listinfo/mpeg7-sysmailto:[email protected]?subject=subscribe

List-Archive: http://lists.uni-klu.ac.at/pipermail/mpeg7-sysList-Help: mailto:[email protected]?subject=help


File Format


http://lists.uni-klu.ac.at/mailman/listinfo/mp4-sysmailto:[email protected]?subject=subscribe

List-Archive: http://lists.uni-klu.ac.at/pipermail/mp4-sysList-Help: mailto:[email protected]?subject=help


LASeR


http://lists.uni-klu.ac.at/mailman/listinfo/mpeg-lasermailto:[email protected]?subject=subscribe

List-Archive: http://lists.uni-klu.ac.at/pipermail/mpeg-laserList-Help: mailto:[email protected]?subject=help


MAF

Liste Reflector : [email protected]:http://lists.uni-klu.ac.at/mailman/listinfo/maf-sysmailto:[email protected]?subject=subscribeList-Archive: http://lists.uni-klu.ac.at/pipermail/maf-sysList-Help: mailto:[email protected]?subject=help


MPEG-2 on File Format

#1: Please subscribe via http://lists.uni-klu.ac.at/mailman/listinfo/isoff-transport. Please use only that email address for posting messages with which you're subscribed. Otherwise the email won't be delivered. #2: The email address for posting messages is: [email protected]


58



http://lists.uni-klu.ac.at/mailman/listinfo/isoff-transport

mailto:[email protected]?subject=help


mailto:[email protected]?subject=subscribe

http://lists.uni-klu.ac.at/mailman/listinfo/maf-sys




http://lists.uni-klu.ac.at/pipermail/mpeg-laser



http://lists.uni-klu.ac.at/mailman/listinfo/mpeg-laser




http://lists.uni-klu.ac.at/pipermail/mp4-sys



http://lists.uni-klu.ac.at/mailman/listinfo/mp4-sys




http://lists.uni-klu.ac.at/pipermail/mpeg7-sys



http://lists.uni-klu.ac.at/mailman/listinfo/mpeg7-sys




http://lists.uni-klu.ac.at/pipermail/gen-sys



http://lists.uni-klu.ac.at/mailman/listinfo/gen-sys


#3: The archive is accessible via http://lists.uni-klu.ac.at/mailman/private/isoff-transport/ for list members only.

11.5. FAQThe FAQ were updated as needed.

11.6. AOBNone.

12. MPEG-2 Systems (13818-1)

12.1. 13818-1:2005 Amd.3 Carriage of SVC

12.1.1. Topics1. Transport of Scalable Video Coding

12.1.2. ContributionsM14676 and previous contribution from Marrakech in this topic: Proposal for MPEG-2 Transport Stream Extensions for Scalable Video Coding. A scaled-down version of the proposal was used to produce text of PDAM:

a. Removal of the concept and terminology of tierb. Re-use existing concepts in MPEG-2 Systems for scalability

Technical Work in Progress.

13. MPEG-4 Systems (14496-1)

13.1. 14496-1 XXX

13.1.1. Topics1. User Defined SLConfig Descriptor

13.1.2. ContributionsM14678 : Request of user defined values for the predefined SLConfigDescriptor. Decision to use the specification as it is but to use the MP4 RA for registering their pre-defined value.

Technical Work Finalized

14. MPEG-4 Conformance (14496-4)

14.1. 14496-4 Amd.22

14.1.1. Topics2. Audio BIFS Conformance

59

http://lists.uni-klu.ac.at/mailman/private/isoff-transport/

14.1.2. ContributionsM14581: Summary of Voting on ISO/IEC 14496-4:2004/FPDAM 22 [SC 29 N 8518].No comment. Text of FDAM was produced

Technical Work Finalized.

14.2. 14496-4 Amd.23

14.2.1. Topics1. Synthesized Texture Conformance

14.2.2. ContributionsNone.


14.3. 14496-4 Amd.24

14.3.1. Topics1. File Format Conformance



14.4. 14496-4 Amd.25 LASeR V1 Conformance

14.4.1. Topics1. LASeR Conformance

14.4.2. ContributionsM14609: Study of ISO/IEC 14496-4/FPDAM25. Taken as input to produce updated version of the study.


14.5. 14496-4 Amd.26 Open Font Format Conformance

14.5.1. Topics2. Open Font Format Conformance



14.6. 14496-4 Amd.27 LASeR V2 Conformance

14.6.1. Topics1. LASeR V2 Conformance



60

15. MPEG-4 Reference Software (14496-5)

15.1. 14496-5 Amd.14

15.1.1. Topics1. Open Font Format Reference Software

15.1.2. ContributionsNone


15.2. 14496-5 Amd.16

15.2.1. Topics1. Symbolic Music Representation Reference Software

15.2.2. ContributionsM14585 : Summary of Voting on ISO/IEC 14496-5:2001/PDAM 16 [SC 29 N 8503]. See DoC.M14643 : Updated SMR reference Software. Open font format was integrated. Will be used as basis for producing the FPDAM.


15.3. 14496-5 Amd.17

15.3.1. Topics1. LASeR Reference Software

15.3.2. ContributionsM14583 : Summary of Voting on ISO/IEC 14496-5:2001/PDAM 17. See DoC.M14608 : Update of LASeR Reference Software. Used as a basis for producing the FPDAM.


16. ISO File Format (14496-12)

16.1. 14496-12/Amd.2

16.1.1. Topics1. Flute Hint Track

16.1.2. 14667 (Nokia) Comments on AMD2Thank you. The editor will take these into account when preparing the final publication version with the secretariat.

16.2. 14496-12 TuC

16.2.1. 14617 (Apple) Improved metabox supportThis looks interesting but more text and more study is needed:

61

a) when items are both protected and built from each other, what do the extent offset and length mean (before or after de-protection)?

b) when items are built from other items, can the targets in turn be built from items, or must they be from 'raw data' (we think the latter, like hints)

We'd like to include this in the TuC for Part12 and study how FFSec and Flute amendments could have been better (and could be in the future, via amendment), without delaying them.

16.2.2. 14698 (FhG) CTS Offsets and hierarchical B-FramesYes, this is a problem. We have two solutions:a) today's CTTS box, with a new 'offset' information which brings the CTS times back so that there is one at time zerob) a new CTTS box with signed offsets, such that one is at time 0, but with an offset box saying how far later in time to slide CTS times to align them with DTS (so that for every frame CTS is after DTS)Most people don't need CTS and DTS related, but some do.The editor to provide text into TuC on (a) if possible, as it doesn't involve re-designing, but adding (and there may be a system that already does this).The rules of how to behave in the absence of the offset need to be clear. We also need to be clear that (i) no two CTS timestamps can be the same (ii) one ends up at time 0.

16.2.3. 14683, 14719 (SMPTE) Liaison on URI-labeled metadataThank you. No response needed, it seems, and we will continue with this work.

16.3. Misc

16.3.1. 14657 AHG ReportOK.

16.3.2. High sample-rate audio conformance filesWe will patch the conformance files and submit a COR, and also in the TuC add a sentence that if the sampling rate cannot be represented in 16 bits, and the codec knows it anyway, write 0.

16.4. DVB unofficial Joint meeting

16.4.1. 14741 DVB LiaisonThank you. We will consider a response in the Friday plenary.

DVB has complex metadata storage needs. They have many kinds of metadata (DVB, TV Anytime, MPEG-7, etc.) so the support for multiple metadata containers might be needed. Also, metadata might be recorded off-air, and so temporally changing metadata may well be needed, and also it might be discontinuous (e.g. a play interrupted by a news broadcast). Timed metadata tracks, and multiple metabox support might be needed. An unofficial background document was supplied, which will be uploaded to MPEG as a supplementary document to the liaison.Questions of the validity (expiration) period of the metadata etc. arose, and particularly the interaction of timed metadata and movie fragments.It does seem as though multiple-metabox (meco) and multiple-track go together; if the metadata is combined into a DVB wrapper, then fewer, maybe one track would be needed.We explained I-based (each metadata sample stands alone), and "IP" metadata (difference frames) and searching. We also explained that movie fragments are not required to extend each track the same amount.DVB has a need for synchronized multiple timelines (which looks like it will take more exploration), derived from MHP?

62

If they go with separate boxes for different metadata kinds, there may be a need for a UUID handler type, so that proprietary unregistered metadata is possible.We indicated that our mp71 brand was probably a mistake; we explained brands as 'umbrellas', possibly having requirements on both files and readers.The DVB proposed MPEG-2 TS Hint Track was presented; then the DMB-MAF. They are similar in nature but different in detail; and they have different assumptions (single/multi-program, and encryption, for example).Multi-program streams effectively have no true ‘sync’ samples; can we provide an empty table?There are differences of detail here: what is a sample (sequence/GOP/packet)? Preceding and trailing bytes? Where is PMT/PAT? What is a sync sample? Do we allow constructors? and so on.What would we like to happen? It seems that there is general desire for a harmonious solution here and an eventual common ‘base’ specification at MPEG, which the DVB and DMB solutions could then build on.Finally, RTP recording. They want to specify a format for RTP recording that is technically identical to the RTP hint track but marked (so as to warn the reader) that they are recordings. There may be a few other points of detail (the track enabled bits etc.). Both formats (RTP and M2TS) might need “an error occurred here” (e.g. a special constructor).Proposal:We form a mailing list and mpeg ahg for “Transports and Recording in the ISO base media file format” (MP2TS and recorded RTP). Two volunteers form an analysis of differences in the M2TS proposals. We allow both DVB and DMB-MAF to go ahead on their regular schedule, and we start a fairly fast-track amendment to add an MPEG-2 TS Annex and a recorded RTP stream format to Part12.The reply liaison should attach the TuC for Part12.

17. MPEG-4 AVC File Format (14496-15)

17.1. 14496-15:2004/Amd.2

17.1.1. Topics1. SVC File Format Extensions

17.1.2. 14620 (Nokia) On the SVC File FormatIndeed, tierID goes to 16 bits, we make sure that underscores are consistent, and we deal with alignment.We accept a maximum distance on tl_switching in the group, which assures a switch (with zero implying a layer IDR). A metadata statement can say when it could be lower for a given picture.On recovery points, we agree that:

we will have a PRange box, reporting the max and min Pwe will have a DRangebox, reporting the max and min Din the DRange box, we will give the independent max T, Q for the max D, and the

independent min T,Q for the min DBoth boxes are mandatory.For Quality Layer, we agree to a metadata statement that applies to a single NAL Unit, which gives the value of the lowest Quality Layer that includes this NAL Unit. We welcome NB comments on generalizing this to make a statement about more than one NAL Unit at once (e.g. an aggregation or the whole sample). The config info box belongs as a statement in the sample entry.

63

On re-timing, this is still harder than it looks. We are not happy with metadata as it will repeat data endlessly, and also cross-linking tiers and metadata feels wrong.We're not happy with new sample tables because of issues with Part 12, movie fragments, etc.That means we'd better work out sample groups; we have a new sample group with a loop of tierID, DTSDelta pairs.On Iroi_type we certainly need a statement where it is defined, that timed metadata must be used to associate NAL units with a 24bit roi_id when iroi_type is equal to 2.

17.1.3. 14651 (Siemens/TUI) On the SVC File formatThank you. All accepted (at least in principle, with some rewording).

17.1.4. In EmailGoing through the latest version of the FF document, we found the following comments on the definition of the Operating point :

"an operating point is e.g. represented by specific values of DTQ" and "alternatively by a specific value of priority_id".

I understand that it is "e.g" but we would prefer the following type of formulation :"an operating point can be represented:

either by specific values of DTQ or by specific values of PDTQ or by specific values of P."

This would also cover the case where P is not mapped directly from DTQ but is carrying e.g. quality layers.

Regards, Isabelle.

OK, we can do an edit like this in the informative note that this is.

17.1.5. Open QuestionsFrom the JVT:

1. The NAL Unit header is re-organized and the fields re-named.2. There is a profile/level for the base layer, and a profile/level for the SVC streams3. There is a new SPS for SVC, NAL Unit type is 154. Is a stream with IDR only at the top layer a valid stream? Do we handle this case?5. Prefixes are generally allowed now; we don't need to restrict to VCL NAL Units.

New NU Header:nal_unit_header_svc_extension( ) { C Descriptor

reserved_one_bit All u(1)idr_flag All u(1)priority_id All u(6)no_inter_layer_pred_flag was layer_base_flag All u(1)dependency_id All u(3)quality_id All u(4) was u(2)temporal_id All u(3)use_ref_base_pic_flag was use_base_prediction_flag All u(1)discardable_flag All u(1)output_flag new All u(1)reserved_three_2bits All u(2)

}


64

17.2. 14496-15:2004/Amd.3? MVC FF

17.2.1. Topics1. MVC File Format Extensions

17.2.2. 14634 (Nokia) On the MVC File FormatThank you. We need to call for requirements and ideas for the MVC File Format for the next meeting. In the meantime we take this as a TuC for Amd3 (MVC file format).

18. LASeR (14496-20)

18.1. 14496-20/Amd. 2

18.1.1. Topics1. Lightweight Application Scene Representation (SGVT1.2 Support)

18.1.2. ContributionsM14573 / M14574 / S4-070501 (not yet submitted): Liaison statements from 3GPP. See liaison answers.

M14610: Report of LASeR related activities in other standards organizations. For information.

M14607: Study of ISO/IEC 14496-20/FPDAM2. Adopted as a base of the study output in Lausanne.

M14660: On LASeR BitStream Exchange. Successful progress on bitstream exchange. Some clarifications were found while doing the bitstream exchange.

M14682: On LASeR Main Profile. Support for main. Accepted. Will be integrated in Amd.3.

M14662, M14680: BIFS and LASeR harmonization and First ideas on the harmonization of BIFS and LASeR. Areas of work were refined:

a) Going from LASeR scene <-> BIFS sceneb) Transcoding from LASeR profile <-> BIFS profilec) Definition of high level XML format from which BIFS and LASeR content can be produced.


18.2. 14496-20/Cor 2

18.2.1. Topics1. Profile Removal

65



19. 21000-09 MPEG-21 File Format

19.1. MPEG-21 File Format Amendment

19.1.1. Topics1. Mime Type


20. 21000-14 Conformance

20.1. MPEG-21 File Format Conformance

20.1.1. Topics1. Conformance


21. MPEG-A MAF (23000)

21.1. 23000-4 Musical Slide Show MAF

21.1.1. Topics1. Protected Musical Slide Show MAF

21.1.2. ContributionsM14644: Proposed text for Protected Musical Slide Show MAF PDAM. Taken as input for producing text of 2nd edition. Clarification will be needed in the text to distinguish 1st edition to 2nd edition. This will be done by the definition of a new brand.


21.2. 23000-8 Portable Video Player MAF

21.2.1. Topics1. Portable Video Player MAF

21.2.2. ContributionsM14649: KNB preliminary comments on 23000-8 CD Portable video player MAF. All comments were approved and study text was produced accordingly.

M14736: Enhancement of PVP MAF for e-learning. Broaden the scope of PVP MAF without putting irrealistic burden on the player. The contributions was accepted and editors will integrated in the study text.

66


21.3. 23000-9 Digital Multimedia Broadcasting MAF

21.3.1. Topics1. Digital Multimedia Broadcasting MAF

21.3.2. ContributionsM14730: (Editors' Input) Updated text of FCD 23000-9 MAF for DMB. Taken as input for producing study text. Clarifications on what is optional / mandatory in the specification.

M14732: Updated proposal on TV-Anytime Metadata in ISO/IEC 23000-9 MAF for DMB. Used as basis to update the study text.


21.4. 23000-10 Video Surveillance MAF

21.4.1. Topics1. Video Surveillance MAF 1st Edition

21.4.2. ContributionsM14596: Study text of ISO/IEC 23000-10 WD Video Surveillance MAF. Taken as input for production of CD text. Taken as input for production of CD text.M14748: Video Surveillance MAF file and camera identification. Noted.M14645: MPEG-7 core description profile and visual descriptors for Video Surveillance MAF. Agreement to use MPEG-7 in the break-out. Detailed discussion on what technology to include was discussed in break-out and document in study.

BoG Video Surveillance MAF- Software:

University Kingston could possibly provide software and also dedicate some time to work on it - could we have a software spec in an in and out sense by the end of the week? not enough time, spec for ref software will be started by James

- check photo player MAF design for binary representation of metadata- Study of SMAF text :

timed metadata possibility of the file format will not be used for metadata describing the content but only with the time/date of every frameuse of classification schemas should be allowed if those schemas are made availableMDS description on file level + MDS description on track level together will form a valid MPEG-7 filetrack start time and duration needed on track level in addition to VideoSegmentsVideoSegments will not be required to existthere will be a camera location description on the same level as the camera identification tagmetadata for content "a" will now become "user data" for free text annotation

- to be done in editing periodMAF fragment drawing to be changed (video track optional and optional metadata on track level to be added); file level metadata becomes two boxesfigure 5 will be improved by change of wording according the MAF file figure

67

possibly add 2CIF picture format (then picture aspect ratio box of ISO base file format would be needed)track level metadata box: camera identifier first bits for UUID further bits for user defined purposestimed metadata format to be included

- updates on MAF overview document (advanced surveillance MAF)no action this time


22. MPEG-B

22.1. 23001-1 Binary Format Amd.2

22.1.1. Topics1. Extension on Encoding of Wild Cards

22.1.2. ContributionsM14582: Summary of Voting on ISO/IEC 23001-1:2006/FPDAM 2 [SC 29 N 8519] – MPEG-B. See DoC.

Technical Work Finalized.

22.2. 23001-1 Binary Format Cor.2

22.2.1. Topics1. Misc. Editorial Corrections on MPEG-B Part 1



22.3. 23001-3 Binary to XML Mapping of IPMP-X

22.3.1. Topics1. Binary to XML Mapping of IPMP-X

22.3.2. ContributionsM14659: Requirements for XML IPMP Messages. See req. report.M14674 : Study of TuC on IPMP XML Messages. Approved to be integrated in the study text of IPMP XML Messages.


68

23. MPEG-E Multimedia Middleware (23004)

23.1. Multimedia Middleware

23.1.1. Topics1. MPEG Multimedia Middleware



24. Supplementary Media Technology (29116-1)

24.1. Media Streaming MAF Protocols

24.1.1. Topics1. Media Streaming MAF Protocols

24.1.2. ContributionsM14666: Study on ISO/IEC 29116 FCD Media Streaming MAF Protocol.


25. ExplorationM14714: An Update on IPTV Requirements. Document reviewed jointly with requirements. Further work will be done in breakout.

M14717: The first ideas on LASeR in IPTV. Requirements on presentation format extracted from this technical solution and integrated in IPTV requirements. In particular:

- Requirements on scene representation format;- Requirements on convergence with mobile;- Requirements in dealing with multiple screen display.

Technical solution will be considered later when MPEG IPTV specification will be developed.

69

26. Latest References and Publication Status

Pr Pt Standard No. Issue Status Doc. With Purpose ISO Award

2 1 ISO/IEC 13818-1/Amd.7 Published 2000/12 Done2 1 ISO/IEC 13818-1:2000 (MPEG-2 Systems 2nd Edition) 00/12 Published 2000/12 Proposed2 1 ISO/IEC 13818-1:2000/COR1 (FlexMux Descr.) N3844 01/01 Pisa Published 2002/03 N/A2 1 ISO/IEC 13818-1:2000/COR2 (FlexMuxTiming_ descriptor) N4404 01/12 Pattaya Published 2002/12 N/A2 1 ISO/IEC 13818-1:2000/Amd.1 (Metadata on 2) & COR1 on Amd.1 N5867 03/07

TrondheimPublished 2003/12 Proposed

2 1 ISO/IEC 13818-1:2000/Amd.2 (Support for IPMP on 2) N5604 03/03 Pattaya Published 2004/03 N/A2 1 ISO/IEC 13818-1:2000/Amd.3 (AVC Carriage on MPEG-2) N5771 03/07

TrondheimPublished XXXX Proposed

2 1 ISO/IEC 13818-1:2000/Amd.4 (Metadata Application CP) N6847 04/10 Palma FDAM ITTF to be published N/A2 1 ISO/IEC 13818-1:2000/Amd.5 (New Audio P&L Sig.) N6585 04/07

RedmondFDAM ITTF to be published N/A

2 1 ISO/IEC 13818-1:2000/COR3 (Correction for Field Picture) N6845 04/10 Palma COR ITTF to be published N/A2 1 ISO/IEC 13818-1:2000/COR4 (M4MUX Code Point) N7469 05/07 Poznan COR ITTF to be published N/A2 1 ISO/IEC 13818-1:2000/COR5 (Corrections related to 3rd Ed.) N7895 06/01

BangkokCOR ITTF to be published N/A

2 1 ISO/IEC 13818-1:2006 (MPEG-2 Systems 3rd Edition) 06/xx Published ITTF TBP2 1 ISO/IEC 13818-1:2006/Amd.1 (Transport of Streaming text) N8369 06/07

KlagenfurtFDAM ITTF to be published TBP

2 1 ISO/IEC 13818-1:2006/Amd.2 (Carriage of Auxialiry Video Data) N8798 07/01 Marrakech

FDAM ITTF to be published TBP

2 11 ISO/IEC 13818-1:2003 (IPMP on 2) N5607 03/03 Pattaya Published 2003/12 Proposed4 1 ISO/IEC 14496-1 (MPEG-4 Systems 1st Ed.) N2501 98/10 Atl. City Published 1999/12 Done4 1 ISO/IEC 14496-1/Amd.1 (MP4, MPEG-J) N3054 99/12 Hawaii Published 2001/11 Done4 1 ISO/IEC 14496-1/Cor.1 N3278 00/03

Noordwijk.Published 2001/11 N/A

70

4 1 ISO/IEC 14496-1:2001 (MPEG-4 Systems 2nd Ed.) N3850 01/01 Pisa Published 2001/11 N/A4 1 ISO/IEC 14496-1:2001/Amd.1 (Flextime) Published 2002/10 Done4 1 ISO/IEC 14496-1:2001/Cor.1 N4264 01/07 Sydney COR ITTF N/A4 1 ISO/IEC 14496-1:2001/Cor.2 N5275 02/10 Shangai COR ITTF N/A4 1 ISO/IEC 14496-1:2001/Cor.3 N6587 04/07

RedmondCOR ITTF N/A

4 1 ISO/IEC 14496-1:2001/Amd.2 (Textual Format) N4698 02/03 Jeju Island

AMD ITTF N/A

4 1 ISO/IEC 14496-1:2001/Amd.3 (IPMP Extensions) N5282 02/10 Shanghai

Published 2004-05 N/A

4 1 ISO/IEC 14496-1:2001/Amd.4 (SL Extension) N5471 02/12 Awaji Published 2003/12 N/A4 1 ISO/IEC 14496-1:2001/Amd.7 (AVC on 4) N5976 03/10

BrisbannePublished 2004-08 N/A

4 1 ISO/IEC 14496-1:2001/Amd.8 (ObjectType Code Points) N6202 03/12 Hawaii AMD ITTF to be published N/A4 1 ISO/IEC 14496-1:200x/Amd.1 (Text Profile Descriptors) N7229 05/04 Busan PDAM ITTF Final Text

EditingN/A

4 1 ISO/IEC 14496-1:200x/Cor4 (Node Coding Table) N7473 05/07 Poznan PDAM ITTF to be published N/A4 1 ISO/IEC 14496-1 (MPEG-4 Systems 3rd Ed.) N5277 02/10

ShanghaiIS ITTF to be published Proposed

4 1 ISO/IEC 14496-1:200x/Amd.1 (Text Profile Descriptors) N7229 05/04 Busan PDAM ITTF Final Text Editing

N/A

4 1 ISO/IEC 14496-1:200x/Cor.1 (Clarif. On audio codec behavior) N8117 06/04 Montreux

COR ITTF Final Text Editing

N/A

4 1 ISO/IEC 14496-1:200x/Amd.2 (3D Profile Descriptor Extensions) N8372 06/07 Klagenfurt

PDAM ITTF to be published N/A

4 1 ISO/IEC 14496-1:200x/Cor.2 (OD Dependencies) N8646 06/10 Hangzhou

COR ITTF to be published N/A

4 1 ISO/IEC 14496-1:200x/Amd.3 (JPEG 2000 support in Systems) N8860 07/01 Marrakech


4 4 ISO/IEC 14496-1:200x/Amd.22 (AudioBIFS v3 conformance) N9295 07/07 Lausanne


4 4 ISO/IEC 14496-1:200x/Amd.17 (ATG Conformance) N8861 07/01 Marrakech


4 5 ISO/IEC 14496-1:200x/Amd.12 (File Format) N9020 07/04 San Jose PDAM ITTF to be published N/A

71

4 6 ISO/IEC 14496-6:2000 Published 2000/12 N/A4 8 ISO/IEC 14496-8 (MPEG-4 on IP Framework) N4712 02/03 Jeju Published 2004-05 Proposed4 11 ISO/IEC 14496-11 (MPEG-4 Scene Description 3rd

Edition) N6960 05/01

HongKongFDIS SC29 Final Text

EditingProposed

4 11 ISO/IEC 14496-11/Amd.1 (AFX) N5480 02/12 Awaji FDAM ITTF Integration in 1st

Ed.N/A

4 11 ISO/IEC 14496-11/Amd.2 (Advanced Text and Graphics) N6205 03/12 Hawaii FDAM ITTF Integration in 1st

Ed.N/A

4 11 ISO/IEC 14496-11/Cor.1 N6203 03/12 Hawaii COR SC29 N/A4 11 ISO/IEC 14496-11/Cor.3 Valuator/AFX related correction N6594 04/07

RedmondCOR ITTF Integration in 1st

Ed.N/A

4 11 ISO/IEC 14496-11/Amd.3 Audio BIFS Extensions N6591 04/07 Redmond

FDAM ITTF Integration in 1st

Ed.Proposed

4 11 ISO/IEC 14496-11/Amd.4 XMT and MPEG-J Extensions N6959 05/01 HongKong

FDAM ITTF Integration in 1st

Ed.N/A

4 11 ISO/IEC 14496-11/Cor.3 (Audio BIFS Integrated in 3rd Edition) N7230 05/04 Busan COR ITTF Final Text Editing

N/A

4 11 ISO/IEC 14496-11/Cor.5 (Misc Corrigendum) N8383 06/07 Klagenfurt

COR SC29 N/A

4 11 ISO/IEC 14496-11/Amd.5 Symbolic Music Representation

N8657 06/10 Hangzhou

FDAM ITTF TBP

4 11 ISO/IEC 14496-11/Cor.6 (AudioFx Correction) N9021 07/04 San Jose COR SC29 N/A4 12 ISO/IEC 14496-12 (ISO Base Media File Format) N5295 02/10

ShanghaiPublished 2004-02 Proposed

4 12 ISO/IEC 14496-12/Amd.1 ISO FF Extension N6596 04/07 Redmond

FDAM ITTF FDAM 04/11/30 N/A

4 12 ISO/IEC 14496-12/Cor.1 (Correction on File Type Box)

N7232 05/04 Busan COR ITTF Final Text Editing

N/A

4 12 ISO/IEC 14496-12/Cor.2 (Miscellanea) N7901 06/01 Bangkok


N/A

4 12 ISO/IEC 14496-12/Cor.3 (Miscellanea) N9024 07/04 San Jose COR ITTF Final Text Editing

N/A

4 12 ISO/IEC 14496-12/Amd.1 (Description of timed metadata)

N8659 06/10 Hangzhou

FDAM ITTF N/A

72

4 12 ISO/IEC 14496-12/Amd.2 (Flute Hint Track) N9023 07/04 San Jose FDAM ITTF N/A4 13 ISO/IEC 14496-13 (IPMP-X) N5284 02/10

ShanghaiIS ITTF to be published Proposed

4 14 ISO/IEC 14496-14 (MP4 File Format) N5298 02/10 Shanghai

Published 2003-11 Proposed

4 14 ISO/IEC 14496-14/Cor.1 (Audio P&L Indication) N7903 06/01 Bangkok


N/A

4 15 ISO/IEC 14496-15 (AVC File Format) N5780 03/07 Trondheim

Published 2004-04 Proposed

4 15 ISO/IEC 14496-15/Amd.1 (Support for FREXT) N7585 05/10 Nice FDAM ITTF Final Text Editing

N/A

4 15 ISO/IEC 14496-15/Cor.1 N7575 05/10 Nice COR ITTF N/A4 15 ISO/IEC 14496-15/Cor.2 (NAL Unit Restriction) N8387 06/07

KlagenfurtCOR ITTF N/A

4 17 ISO/IEC 14496-17 (Streaming Text) N7479 05/07 Poznan FDAM ITTF TBP4 18 ISO/IEC 14496-18 (Font Compression and Streaming) N6215 03/12 Hawaii Published 2004-07 Proposed4 18 ISO/IEC 14496-18/Cor.1 (Misc. corrigenda and

clarification)N8664 06/10

HangzhouCOR ITTF N/A

4 19 ISO/IEC 14496-19 (Synthesized Texture Stream) N6217 03/12 Hawaii Published 2004-07 Proposed4 20 ISO/IEC 14496-20 (LASeR) N7588 05/10 Nice FDAM Editor TBP4 20 ISO/IEC 14496-20/Cor.1 (Misc. corrigenda and

clarification)N8666 06/10


4 20 ISO/IEC 14496-20/Amd.1 (LASeR Extension) N9029 07/04 San Jose FDAM ITTF N/A4 22 ISO/IEC 14496-22 (Open Font Format) N8395 06/07

KlagenfurtFDAM Editor Final Text

EditingTBP

7 1 ISO/IEC 15938-1 (MPEG-7 Systems) N4285 01/07 Sydney Published 2002/07 Done7 1 ISO/IEC 15938-1/Amd.1 (MPEG-7 Systems Extensions) N6326 04/03 Munich FDAM ITTF FDAM 04/11/28 N/A7 1 ISO/IEC 15938-1/Cor.1 (MPEG-7 Systems Corrigendum) N6328 04/03 Munich COR Editor N/A7 1 ISO/IEC 15938-1/Cor.2 (MPEG-7 Systems Corrigendum) N7490 05/07 Poznan COR ITTF N/A7 1 ISO/IEC 15938-1/Amd.2 (BiM extension) N7532 05/10 Nice FDAM ITTF N/A7 2 ISO/IEC 15938-2 (MPEG-7 DDL) N4288 01/07 Sydney Published 2002/02 Done7 7 ISO/IEC 15938-7/Amd.2 (Fast Access Ext. Conformance) N8672 06/10

HangzhouFDAM ITTF N/A

21 9 ISO/IEC 21000-9 (MPEG-21 File Format) N6975 05/01 FDIS ITTF FDIS 05/01/21 Done

73

HongKong21 16 ISO/IEC 21000-16 (MPEG-21 Binary Format) N7247 05/04 Busan FDIS ITTF FDIS 05/04/22 TBPA 1 ISO/IEC 23000-4 (Musical Slide Show MAF) N9037 07/04 San Jose FDIS ITTF TBPB 1 ISO/IEC 23001-1 (XML Binary Format) N7597 05/10 Nice FDIS ITTF TBPB 1 ISO/IEC 23001-1/Cor.1 (Misc. Editorial and technical

clar.)N8680 06/10


B 1 ISO/IEC 23001-1/Cor.2 (Misc. Editorial and technical clar.)

N9049 07/04 San Jose COR ITTF N/A

B 1 ISO/IEC 23001-1/Amd.1 (Reference Soft. & Conf.) N8886 07/01 Marrakech

FDAM ITTF N/A

B 1 ISO/IEC 23001-1/Amd.1 (Exten. On encoding of wild cards)

N9296 07/07 Lausanne


B 2 ISO/IEC 23001-1 (Fragment Request Unit) N9051 07/04 San Jose FDIS ITTF TBPE 1 ISO/IEC 23008-1 Architecture N8892 07/01

MarrakechFDAM ITTF N/A

E 2 ISO/IEC 23008-2 Multimedia API N8893 07/01 Marrakech

FDAM ITTF N/A

E 3 ISO/IEC 23008-3 Component Model N8894 07/01 Marrakech

FDAM ITTF N/A

E 4 ISO/IEC 23008-4 Ressource & Quality Management N8895 07/01 Marrakech

FDAM ITTF N/A

E 5 ISO/IEC 23008-5 Component Download N9053 07/04 San Jose FDAM ITTF N/AE 6 ISO/IEC 23008-6 Fault Management N9054 07/04 San Jose FDAM ITTF N/AE 7 ISO/IEC 23008-7 System Integrity Management N9055 07/04 San Jose FDAM ITTF N/A

74

27. Resolutions of Systems

Cf. WG11 resolution.

28. List of Reviewed ContributionsN° Title Authors14567 AHG on MPEG File Formats David Singer Visharam Mohammed14573 Liaison Statement from 3GPP TSG SA WG4 [SC 29 N 8462] 3GPP TSG SA WG4 via SC 29 Secretariat14573 Liaison Statement from 3GPP TSG SA WG4 [SC 29 N 8462] 3GPP TSG SA WG4 via SC 29 Secretariat14574 Liaison Statement from 3GPP TSG SA WG4 [SC 29 N 8463] 3GPP TSG SA WG4 via SC 29 Secretariat14574 Liaison Statement from 3GPP TSG SA WG4 [SC 29 N 8463] 3GPP TSG SA WG4 via SC 29 Secretariat14581 Summary of Voting on ISO/IEC 14496-4:2004/FPDAM 22 [SC 29 N 8518] SC 29 Secretariat14582 Summary of Voting on ISO/IEC 23001-1:2006/FPDAM 2 [SC 29 N 8519] –

MPEG-BSC 29 Secretariat

14583 Summary of Voting on ISO/IEC 14496-5:2001/PDAM 17 SC 29 Secretariat14585 Summary of Voting on ISO/IEC 14496-5:2001/PDAM 16 [SC 29 N 8503] SC 29 Secretariat14596 Study text of ISO/IEC 23000-10 WD Video Surveillance MAF Gero Bäse et al.14604 Cross-Media Interactive Presentation MAF Davide Rogai et al.14607 Study of ISO/IEC 14496-20/FPDAM2 Jean-Claude Dufourd14608 Update of LASeR Reference Software Jean-Claude Dufourd14609 Study of ISO/IEC 14496-4/FPDAM25 Jean-Claude Dufourd14610 Report of LASeR related activities in other standards organizations Jean-Claude Dufourd14617 Improved meta box support in the ISO file format David Singer14620 On SVC file format Ye-Kui Wang et al.14634 On MVC file format Ying Chen et al.14643 Updated SMR reference Software Pierfrancesco Bellini et al.14644 Proposed text for Protected Musical Slide Show MAF PDAM Houari Sabirin et al.14645 MPEG-7 core description profile and visual descriptors for Video

Surveillance MAFHouari Sabirin et al.

14649 KNB preliminary comments on 23000-8 CD Portable video player MAF Hyouk Jean Cha et al.14651 On the SVC File Format Thomas Rathgen et al.14659 Requirements for XML IPMP Messages Hyon-Gon Choo et al.

75

14660 On LASeR BitStream Exchange Jean Le Feuvre et al.14662 BIFS and LASeR harmonization Jean Le Feuvre et al.14663 Revised requirement for Stereoscopic MAF Next Generation Broadcasting Standard Forum

Korea14664 Proposal for technical specification of Stereoscopic MAF Next Generation Broadcasting Standard Forum

Korea14665 Requirement for Packaged media Stereoscopic MAF Next Generation Broadcasting Standard Forum

Korea14666 Study on ISO/IEC 29116 FCD Media Streaming MAF Protocol Hyon-Gon Choo et al.14667 Comments on Amd2 of ISO base media file format Jani Peltotalo et al.14674 Study of TuC on IPMP XML Messages Jooyoung LeeHyon-Gon Choo14676 Proposal for MPEG-2 Transport Stream Extensions for Scalable Video

CodingK. Grüneberg et al.

14676 Proposal for MPEG-2 Transport Stream Extensions for Scalable Video Coding

K. Grüneberg et al.

14678 Request of user defined values for the predefined SLConfigDescriptor Jihun Cha et al.14680 First ideas on the harmonization of BIFS and LASeR Jihun Cha et al.14682 On LASeR Main Profile Diego Gibellino et al.14698 On CTS-Offset and hierarchical B-frames in ISO media file format Stefan Döhla et al14714 An Update on IPTV Requirements Xin Wang 14717 The first ideas on LASeR in IPTV Jaeyeon Song & al.14719 Proposed SMPTE 2029 - Uniform Resource Names for SMPTE Resources Thomas Edwards14730 (Editors' Input) Updated text of FCD 23000-9 MAF for DMB Hui Yong Kim et al.14732 Updated proposal on TV-Anytime Metadata in ISO/IEC 23000-9 MAF for

DMBSeung Jun Yang et al.

14736 Enhancement of PVP MAF for e-learning Sihyoung Lee, Seungji Yang, Yong Man Ro,14741 Liaison Statement from DVB [SC 29 N 8598] DVB via SC 29 Secretariat14748 Video Surveillance MAF file and camera identification Gero Bäse none Thomas Rathgen

76



Annex G – MDS report

Source: Ian Burnett, Chair

1.0 Introduction

MDS commenced with an overview of the weeks planned activities:

77

2.0 Notes on discussions on Input Documents

79

These contemporaneous notes summarise the activities of the MDS subgroup during the 81 st MPEG meeting. Over the week several break out activities dealt with tasks in the areas of the Digital Item, MPEG Query Format, and the Open Release MAF/REL Profile. Notes of these meetings are given at the end of this section.

14715 Florian Schreiner Chun Hui Suen Contribution to ISO/IEC FCD 23000-7 Open release

Input:This input analysed the requirements of the OR MAF in terms of the MPEG-7 metadata that might be utilised. The first detailed was the CreationCoordinates. They propose a LicenseURI being added to the Creation element from MDS. For the Agent element, a set of MDS descriptors were chosen. For Related Material, a series of mpeg7 namespace elements were chosen.Actions:It was suggested that the LicenseURI element might be taken from MPEG-21 IPMP Components. However, in any case it would b specific to the MAF rather than being generally an element that should be added to MPEG-7 MDS.OR MAF summary

CC seem happy with the OR MAF format based on email discussions Response to be sent Tuesday

MDS will create a resolution stating that our understanding is that CC are happy with the proposal and we will keep them up to date with the progress.

14603

Chrisa Tsinaraki Stavros Christodoulakis MPEG-7 FASP Extension Proposal

Input:This input describes a perceived inconsistency between the description model and the filtering model for MPEG-7 MDS FASP. It suggests an extension to bring the two inline. Actions:This proposal met with some opposition. It was suggested that text for MDS would be needed. However, it seems that it is unlikely that this proposal will achieve consensus.

14640

Hee-Cheol Seo Miran Choi Hyunki Kim Myung-Gil Jang Soojong Lim Jeong Heo Yeo-Chan Yoon Weak Points of Current MPEG-7 Query Format Schema

14641Masanori Sano Hideki Sumiyoshi Nobuyuki Yagi A proposal for MP7QF based on QueryCondition part

14661

Matthias Gruhne Mario Doeller Ingo Wolf Proposal for the MP7QF Query Management Tools

14672Mario Doeller Matthias Gruhne Ingo wolf


14689 Ruben Tous Jaime Delgado Proposal for new Query Operators in MP7QF14690 Ruben Tous Jaime Delgado Proposal for the new JOIN operation in MP7QF14744 Kyoungro Yoon Mario Doeller AHG's Input for SoCD on MPEG-7 Query Format

14745Tae-Beom Lim Kyoungro yoon Jongseol Lee Saim Shin SeokPil Lee Proposal for arithmetic and comparison operators

14749Chrisa Tsinaraki Stavros Christodoulakis Shortcomings of the current MP7QF Query Output Format

14750

Chrisa Tsinaraki Stavros Christodoulakis MP7QF Conditions & Operators

80























Input:These inputs were discussed in the BoG. Opportunity was given to present in the full MDS session, however contributors universally preferred to us the time to develop the QF work further.

14621 Eva Rodriguez Jaime Delgado Derivative rights for the REL ORC Profile

Input:This input considers how derivative rights should be made to work effectively in the ORC profile of the REL. The preferred option is to support ‘embed and aggregate rights’.Actions:This proposal seems to suggest that there is an issue with the ORC profile’s inclusion of derivative rights. Is there a need for this if the intention is to support the intention of CC licenses?

14624 Eva Rodriguez Jaime Delgado




Input:These adapt the REL reference software to the ORC profile needs.Actions:These will be included in the REL reference software (not the 2nd edition) and the OR MAF reference software.

14623

Jaime Delgado Eva Rodriguez Jordi Sesmero Software implementation of security in Event Reporting

Input:This software implements security for ER as per the input m14622 to requirements. The work addresses unfulfilled requirements for ER. The solution is given in m14622 and was described in the San Jose meeting.Actions:This requires an Amendment to Event Reporting. There will be a Request for the amendment and the PDAM will be issued from this meeting.

14691

Saar De Zutter Frederik De Keukelaere Gerrard Drury Christian Timmerer Xin Wang


Input:This input details the editorial changes for the reference s/w proposed FDIS which will be issued from this meeting.Actions:The document is being sent to the reflector for checking...According to the schedule in section 4 the remainder of input documents were considered in joint meetings, primarily with Requirements. The results and actions from those inputs is thus to be found in the Requirements subgroup meeting.

81









DIGITAL ITEM DECLARATION DISCUSSIONS81TH MPEG MEETING

2-6 JULY 2007

2. Recommendations

1. The input contributions be further discussed during the Lausanne meeting and a decision made as to whether the DID requirements require modifying.

2. Discuss and decide on whether it is the requirements on DID that are deficient or whether it is requirements on other parts of MPEG-21 or whether there is a need for some integration requirements.

3. If new requirements are identified above, decide where the work should take place.

3. Background

An AHG meeting was held before the beginning of the meeting. There were 4 mandates: 1. Investigate whether the current DID (ISO/IEC 21000-2) requirements fit with today's industry,

and if not review the requirements.

2. Collect information on how DID is currently used.

3. Identify current deficiencies with DID and propose ways to address these deficiencies.

4. Investigate feasibility of producing royalty-free DID.

During the Sunday AhG the mandates have been discussed and input document M14611 has been presented.

No discussions held about mandate 4.

Input on mandate 2 has been provided (6 known adoptions of MPEG-21 DID).

The discussion about mandate 1-3 leaded to several open issues that need to be further investigated during the week:

a) The role of MAFs is still to be clarified: with MAFs, the structure of DIs can be provided to guarantee interoperability for a certain application domain. It is still not clear whether some further work on the normative part of DID about the analysis of the structure of DIs can help for a wider adoption of MPEG-21 technology.b) Is it possible to provide a “normative decoder procedure” for a Digital Item as it is used for coding AV standards?c) DIs are generally used in the back end of server systems as a convenient container structure and users rarely realise they have a DI in front of them. For DIs to be used like an MP3 or an MPEG-2 video file, there is the key issue that DIs have no innate 'presentation' and hence users receiving them need to a) agree on a DI structure and its usage and then b) have an application aware of that DI structure. This is, of course, the nature of an 'agnostic'

82

standard such as the DI. Is it useful to standardise the 'back-end' storage/delivery of a DI and its constituent parts?d) What is the meaning of interoperability for DIs - is cross application-domain interoperability required? e) If the container is agnostic to usage then presentation is not usefully standardised. However, will users ever find DIs useful if there is no standard presentation?

4. Notes from 3 July 16-18 (joint MDS & Req session)

Input documents have been presented, providing a detailed analysis of the current DID requirements. The comments provided are reported in session Error: Reference source not found.Some hints emerged from the discussion: Interoperability:

o An example of interoperability provided. Interoperability inside DID seems to be reached only at a “namespace” level, for descriptors and resources encompassed by DID.

o A proposal was made: assessing interoperability of DIs starting from concrete examples: Axmedis and Enthrone DIs. They have been envisaged for different application scenarios, difficulties in fulfilling this request.

Deficiencies of current DID:o Difficulties with DI parsing.o Need to revisit relationship between file format and DI, especially when

protected resources are embedded in the DID. Open issues

o What is the correct way to mix XML DID and the needs for a FF.o Are profiles a possible solution to achieve interoperability among DIs?

(apparently not).o Are there any elements in the current DID standard difficult to use or applicable

to limited scenarios? (The example of “Choice/Selection” was cited, whose usage is limited to server applications).

5. Notes from 4 July 11-12 (MDS session)

Interoperability: o An example of interoperability provided. Interoperability inside DID seems to

be reached only at a “namespace” level, for descriptors and resources encompassed by DID.

o A proposal was made: assessing interoperability of DIs starting from concrete examples: Axmedis and Enthrone DIs. They have been envisaged for different application scenarios, difficulties in fulfilling this request.

Deficiencies of current DID:o Difficulties with DI parsing - The expected behaviour of an XML parser is to

resolve the XInclude before validating the XML structure against a given set of schemas (in the MPEG-21 case, the DIDL XML Schema);

o Need to revisit relationship between file format and DI, especially when protected resources are embedded in the DID - Problem of changing ISO FF for

83

accommodating the DID: the FF doesn’t keep the structure of the DI. In case resources are embedded into the file, problems raise in referencing and managing these resources.

o Streaming of the DI. Open issues

o What is the correct way to mix XML DID and the needs for a FF.o Are profiles a possible solution to achieve interoperability among DIs?

(apparently not).o Are there any elements in the current DID standard difficult to use or applicable

to limited scenarios? (The example of “Choice/Selection” was cited, whose usage is limited to server applications).

o Normative decoding procedure?o Presentation layero Semantics of DIs – Experiment Axmedis/Enthrone

6. Notes from 4 July 15-17 (joint MDS & Req session)

A CE on DI Semantics will be issued to assess interoperability between DI used in different application scenarios.A list of open issues will be drafted and circulated by email.

84

It should be noted that there was a lack of consensus on the extent of the OR MAF requirements. Some members wish to see the OR MAF cover existing open licensing scheme requirements. However, other MPEG experts are keen to see the OR MAF extended to cover broader requirements which encompass Rights such that there is a continuum from open licenses through to full DRM systems. No consensus on this was arrived at within the MDS group and discussions were not completed. One suggestion is to alter the name of the OR MAF. It is expected that NB comments may address these issues at the 82nd meeting and discussions will continue then.

3.0 MDS Output Documents and Resolutions – Lausanne 81st Meeting

Part 12 Query FormatThe MDS subgroup recommends approval of the following documents

No. Title TBP Available15938-12 MPEG-7 Query Format

9172 Study of ISO/IEC CD 15938-12 Query Format No 07/07/279173 TuC for MPEG Query Format v2.0 No 07/07/06

The MDS subgroup requests that, if at all possible, National Bodies might consider the Study of ISO/IEC CD 15938-12 Query Format when preparing their ballot comments on the CD.

7. Resolutions related to MPEG-21

GeneralThe MDS subgroup recommends approval of the following documents

No. Title TBP Available21000 General

9174 Schema Files for MPEG-21 Standards (v7) Yes 07/07/06

7.1.1.

The MDS subgroup notes that the document N9174 is a new version of an ongoing working document containing the ‘electronic’ versions of schemas for the current MPEG-21

87

parts at IS/FDIS. The MDS subgroup requests that the versions of the schemas be updated on the ITTF WWW site at http://standards.iso.org/ittf/PubliclyAvailableStandards/MPEG-21_schema_files/.

Part 2 Digital Item Declaration The MDS subgroup recommends approval of the following documents

No. Title TBP Available21000-2 Digital Item Declaration

9175 DID Open Issues No 07/07/069176 Workplan for CE on DI Semantics No 07/07/06

Part 5 Rights Expression Language The MDS subgroup recommends approval of the following documents

No. Title TBP Available21000-5 Rights Expression Language

9177 MPEG-21 REL Profiles Software Implementation Plan v.7 No 07/07/06

1.1.3. The MDS subgroup requests the addition of Xin Wang as an editor of ISO/IEC 21000-5 Amd3.

Part 8 Reference Software The MDS subgroup recommends approval of the following documents

No. Title TBP Available21000-8 Reference Software

9178 DoC for ISO/IEC FCD 21000-8 Reference Software 2nd Edition No 07/07/069179 Text of ISO/IEC FDIS 21000-8 Reference Software 2nd Edition No 07/07/27

The MDS subgroup thanks the National Bodies of Austria, Belgium, and Japan for their useful comments on ISO/IEC FCD 21000-8.

Part 15 Event reporting The MDS subgroup recommends approval of the following documents

No. Title TBP Available21000-15 Event reporting

9180 Request for Amendment 1 of ISO/IEC 21000-15 Security in ER No 07/07/069181 ISO/IEC PDAM/1 21000-15 Security in ER No 07/07/06

8. Resolutions related to MPEG-A

Part 5 Media Streaming Player Application FormatThe MDS subgroup recommends approval of the following documents

No. Title TBP Available23000-5 Media Streaming MAF

9182 Study of ISO/IEC FCD 23000-5 Media Streaming MAF No 07/07/06

88

Part 7 Open Release Application FormatThe MDS subgroup recommends approval of the following documents

No. Title TBP Available23000-7 Open Release Application Format

9183 Study of ISO/IEC FCD 23000-7 OR Application Format No 07/07/06

The MDS subgroup requests that, if at all possible, National Bodies might consider the Study of ISO/IEC FCD 23000-7 OR Application Format when preparing their ballot comments on the FCD.

9. Resolutions related to MPEG-B

PromotionThe MDS subgroup recommends to approve the following documents

No. Title TBP AvailablePromotion

9184 MPEG-21 DIA 2nd Edition Tutorial Presentation Yes 07/07/06

10.Ad hoc group form

9185 AHG on MPEG Query FormatMandate: To address the following issues:

1. Complete editing of the MPEG-7 Query Format SoCD2. Finalise text changes on the Base Data model for the Query Format3. Complete definition of new Query types4. Conclude syntactic definition of the Join operator

Chairman: Kyoungro Yoon (yoonk *at* konkuk.ac.kr)Mario Doeller (Mario.doeller_*at*_uni_passau.de)

Duration: Until 82nd Meeting Meetings AHG meeting will be held on the weekend prior to 82nd meeting. Other business

will be conducted by e-mail or telephone conference.Reflector: [email protected]: To subscribe send email to [email protected]

9186 AHG on Review of the MPEG-21 DIMandate: To address the following issues:

1. Investigate whether the current DID (ISO/IEC 21000-2) requirements satisfy current industry needs and if not review the requirements

2. Identify current deficiencies in the DI and propose solutions3. Investigate solutions to the issues identified in N9175: DID Open Issues 4. Conduct CE on DI Semantics according to N9176

Chairman: Giovanni Cordara (giovanni.cordara*at*telecomitalia.it)Co-Chair: Gerrard Drury (gerrard*at*enikos.com)

Duration: Until 82nd Meeting Meetings AHG meeting will be held on the weekend prior to 81st meeting. Other business

will be conducted by e-mail or telephone conference.

89

Reflector: [email protected]: To subscribe visit: http://listserv.imec.be/mailman/listinfo/mpeg-21

90

4.0 MDS Final Schedule – Lausanne 81st Meeting

v3.0

MPEG MDS Chair: Ian S Burnett

MPEG-7, MPEG-21, MAF v3.0 Number Source Title

Monday Morning (9h00-13h00) MPEG Plenary Plenary room

Monday Afternoon (13h30-20h00)

Kick-off of MPEG MDS activities (11h30-12h30) MDS Room Rome

Agenda, Goals and Issues for the Week for MDS Group Ian S Burnett

Review of AHG resolutions, CE results and action points (11h00-12h30) MDS Room Rome

14571 Kyoungro Yoon Mario Doeller AHG on MPEG-7 Query Format

14559Gerrard Drury Giovanni Cordara AHG on Review of MPEG-21 DID


14587 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 21000-8 (2nd Edition) [SC 29 N 8558]

Define BoGs and Mandates (11h20-11h30) MDS Room Rome BoG1 = ? MPEG-7 QF OR MAF/REL Tues am Monday Afternoon (14h00-18h00) OR MAF (14h00 - 15h00) MDS Room Rome

14715 Florian Schreiner Chun Hui Contribution to ISO/IEC FCD 23000-7









mailto:??

mailto:??


mailto:??

Suen Open release MPEG-7 Query Format (15h00 - 18h00) MDS Room Rome

14603Chrisa Tsinaraki Stavros Christodoulakis MPEG-7 FASP Extension Proposal

14640

Hee-Cheol Seo Miran Choi Hyunki Kim Myung-Gil Jang Soojong Lim Jeong Heo Yeo-Chan Yoon

Weak Points of Current MPEG-7 Query Format Schema

14641Masanori Sano Hideki Sumiyoshi Nobuyuki Yagi

A proposal for MP7QF based on QueryCondition part

14661Matthias Gruhne Mario Doeller Ingo Wolf

Proposal for the MP7QF Query Management Tools

14672Mario Doeller Matthias Gruhne Ingo wolf


14689 Ruben Tous Jaime Delgado Proposal for new Query Operators in MP7QF

14690 Ruben Tous Jaime Delgado Proposal for the new JOIN operation in MP7QF

14744 Kyoungro Yoon Mario Doeller AHG's Input for SoCD on MPEG-7 Query Format

14745

Tae-Beom Lim Kyoungro yoon Jongseol Lee Saim Shin SeokPil Lee

Proposal for arithmetic and comparison operators

14749Chrisa Tsinaraki Stavros Christodoulakis

Shortcomings of the current MP7QF Query Output Format

14750Chrisa Tsinaraki Stavros Christodoulakis MP7QF Conditions & Operators

Tuesday Morning (9h00-13h00)

REL/ER/Refs/w (9h00 - 11h00) MDS Room Rome

14621 Eva Rodriguez Jaime Delgado Derivative rights for the REL ORC Profile





14623Jaime Delgado Eva Rodriguez Jordi Sesmero

Software implementation of security in Event Reporting

14691

Saar De Zutter Frederik De Keukelaere Gerrard Drury Christian Timmerer Xin Wang


Joint with Video and ISG on BSDL for Part B RVC (11h00 - 13h00)

92










































Tuesday Afternoon (14h00-18h00) MAFs (14h00 -16h00)

14612 Xin Wang Security and DRM Requirements for Professional Archival MAF

14613Noboru Harada Takehiro Moriya Yutaka Kamamoto

Updated overviwe document for Professional Archival MAF

14663Next Generation Broadcasting Standard Forum Korea

Revised requirement for Stereoscopic MAF


Proposal for technical specification of Stereoscopic MAF


Requirement for Packaged media Stereoscopic MAF

14604Davide Rogai Pierfrancesco Bellini Paolo Nesi

Cross-Media Interactive Presentation MAF

MDS/Reqts issues (16h00 - 18h00) Reqts

14559Gerrard Drury Giovanni Cordara AHG on Review of MPEG-21 DID

14611

Pedro Carvalho Helder Castro Maria Teresa Andrade Giorgiana Ciobanu Christian Timmerer Hermann Hellwagner

Input to AHG on Review of MPEG-21 DID

14708Davide Rogai Pierfrancesco Bellini Paolo Nesi

Input to AhG on MPEG-21 DID Review

14659Hyon-Gon Choo Filippo Chiariglione

Requirements for XML IPMP Messages

14707

Jaime Delgado Marc Gauvin Eva Rodriguez Victor Rodriguez

Requirements for a Machine Readable Rights Ontology

Wednesday Morning (09h00-13h00) MPEG Plenary (9h00-11h00) Plenary room DI Break Out Discussions

Wednesday Afternoon (14h00-17h45) MPEG Metaverse discussions(14h00-15h00) ReqtsDI discussions cont'd (15h00-17h00) ReqtsThursday Morning

93










mailto:??

mailto:??




















(9h00-12h30)OR MAF Issues (10h30 - 11h30) RDD Reqts (12h00-13h00) Reqts Thursday Afternoon (14h00-19h00) Prof Archival Call (14h00-15h00) ReqtsDI Interoperability (15h00-16h00) ReqtsPlenary MDS and Reports of BoG (16h00 - 18h00) MDS Room Rome Further review of Output documents, AHGs, CEs, DoC, Std (18h00+++) MDS Room Rome Friday Morning (09h00-13h00)

Wrapping up (09h00 - 13h00) MDS Room Rome

Approval of resolutions, AHGs and Output documents

Friday Afternoon (14h00-21h00) MPEG Plenary Plenary room Contact: Ian S Burnett

x

94

Annex H – Video report

Source: Jens-Rainer Ohm, Gary J. Sullivan (Video), Miroslaw Z. Bober (MPEG-7 Visual)

1 MPEG-4 Video Software Corrigendum

Errors in MPEG-4 Video software (start code emulation in studio profile which was already corrected in the standard text) were reported in M14600. It was decided to go for a new corrigendum directly (no defect report before) because currently no other problems with studio profile software are envisaged.

Document reviewed:14600 Teruhiko Suzuki Problem report on MPEG-4 visual reference software

Documents approved:No. Title TBP Available

14496-5 Reference Software 9193 Text of ISO/IEC 14496-5:2001/Amd.1/DCOR 1 N 07/08/31

11. Development of AVC

The video subgroup approved the documents that were produced during the 24th JVT meeting which was held in parallel in Geneva. Main work items of JVT were

– Finalization of SVC amendment– Preparation of MVC PDAM– Preparation of software and conformance PDAM for New Professional Profiles– Preparation of software and conformance PDAM for Scalable Video Coding

By issuing the FDAM (N9197), the SVC amendment is finalized, further developments relate to software, conformance and performance of verification tests. Further issues being further explored by JVT in AHG study, core experiments or JSVM implementation relate to requirements that are not or not fully fulfilled by the current design, in particular

– Bit-depth scalability– Color sampling scalability– Fine-granular scalability

Application perspectives of such functionalities might require an update of the SVC applications & requirements document (probably next meeting).

The PDAM on Multiview Video Coding amendment (N9213) includes a well-aligned set of high-level syntax, HRD and buffer management specifications, fulfilling the MVC requirements such as view random access, view scalability, low-delay modes etc. The Joint Multiview Video Model (JMVM) 5 (N9214) includes further technology under consideration for improving compression performance, such as illumination compensation, combined motion/disparity vector encoding.

Documents approved:No. Title TBP Available

14496-4 Conformance testing95

9191 Text of ISO/IEC 14496-4:2004/PDAM 30 Conformance Testing for New Profiles for Professional Applications

N 07/07/06

9192 Text of ISO/IEC 14496-4:2004/PDAM 31 Conformance Testing for SVC Profiles

N 07/10/07

14496-5 Reference Software 9194 Text of ISO/IEC 14496-5:2001 / PDAM 18 Reference Software for

New Profiles for Professional ApplicationsN 07/07/13

9195 Text of ISO/IEC 14496-4:2001 / PDAM 19 Reference Software for SVC

N 07/10/07

14496-10 Advanced Video Coding9196 Disposition of Comments on ISO/IEC 14496-10:2005 / FPDAM 3 N 07/07/139197 Text of ISO/IEC 14496-10:2005 / FDAM 3 Scalable Video Coding N 07/09/159198 Text of ISO/IEC FDIS 14496-10:200X Advanced Video Coding

(4th edition)N 07/09/15

9199 Joint Scalable Video Model (JSVM) 11 N 07/09/159212 JSVM 11 Software N 07/09/159213 Text of ISO/IEC 14496-10:200X / PDAM 1 Multiview Video

CodingN 07/07/20

9214 Joint Multiview Video Model (JMVM) 5 N 07/07/209215 JMVM 5 Software N 07/08/10

12. MPEG-7 Visual

12.1. MPEG-7 Visual related work in San JoseThe MPEG-7 breakout group was active during the whole week. Input documents related to the Visual part in 15938-3 and Photo Player MAF (23000-3) are listed in the table below. All of these documents were reviewed and discussed.

14588

Weon-Geun OhIk-Hwan ChoA-Young ChoJu-Kyoung JinWon-Keun YangJun-Woo LeeDong-Seok Jeong

Clarification of MPEG-7 VCE-6 testset


Modification of VCE 6 Independent Data Set

14594Weon-Geun OyyyhHyeong-yong JeonChi-jung Hwang

An Image Identifier based on Feature points for Complex conditions

14618

Weon-Geun OhA-Young ChoIk-Hwan ChoJu-Kyoung JinJun-Woo LeeDong-Seok Jeong

Experiment Results of Image Identifier for Basic Group

14619Weon-Geun OhWon-Keun YangDong-Seok Jeong

Improved CE Results of MGST Based Descriptor for MPEG-7 VCE-6 Complex Condition

14636 Min-Jeong LeeHeung-Kyu Lee Cross verification result for ETRI VCE-6 proposal

14637Sang-ki KimHyobin LeeSangyoun Lee

CE Report for VCE-5

14675 Kota Iwamoto Revision of the Core Experiment Description for VCE-796

Ryoma Oami

14677 Kota IwamotoRyoma Oami Suggestion of Dataset Size Reduction for VCE-7

14679 Kota IwamotoRyoma Oami Contribution to the Test Dataset for VCE-7

14687 Karol Wnukowicz Cross verification report of the experiments on image signature (VCE-6)

14692 Karol WnukowiczWladyslaw Skarbek

A proposal for image signature based on trajectory of features

14706Quqing Chen Zhi-bo ChenLouis Chevallier

Requirement of Video Annotation

14713 Paul BrasnettMiroslaw Bober Further Improvements to the Image Identifier XM (VCE6)


VCE-6 Experimental Conditions following Reflector Discussions

Current Work Items Review of the CE’s results

VCE-5 - Evaluation of MPEG-7 Face Recognition Technology on IR Images

VCE-6 - Image Signatures VCE-7 – Video Signatures

Photo Player MAF S/W development – second version Awaiting bug fix – Systems promised to provide a solution within 2 weeks

Editorial Work Call for Proposals on Visual Signature Tools Visual CE Document XM Version 31 ISO/IEC 23000-3:2007/FPDAM 1 [PP Ref S/W] DoC on Part-8 Amd

Joint meeting with Requirements Review requirements and prepare CFP on Visual Signature Tools

VCE-5 Improved results on complex data (occlusion, etc) Equal error rate reduced to 21%

VCE6: Image Signatures - Simple Case XM method improved Last meeting: 98.86% detection at below 1ppm false alarm rate This meeting: 99.74% detection at below 0.1%ppm false alarm rate CfP requirement:

Complex Case (significant image cropping, etc) Good progress, but still above 1ppm target Expecting to reach the target next meeting

We make testing more demanding Independence test-set increased from 60k images to 100k images Detection test-set increased from ~4k to 10k base images Other changes under discussion

VCE7: Video Signatures - Work is focusing on test condition and data collection 25 hours of additional test data received from NEC – many thanks! We have approximately 40 hours of test data now Modified CE conditions to reduce content required to ~200 hours

97

KBS is considering making available some content for MPEG-7 testing

CfP on Image and Video Signature Tools Human fingerprints can be measured and recorded without having to alter the finger,

which is one of their great advantages. They provide a reproducible and reliable but passive means of identification – in contrast

to a tattoo, for example, which must be actively added. This distinction is also important in the identification of visual content: the Visual

Signature Tools will be based on intrinsic measurements like the fingerprint, rather than extrinsic labels like the tattoo.

The following test scenarios and materials are envisaged: Image Signatures:

Dataset of approx. 130.000 images Independence tested on 8.45 billion image pairs Robustness tested on 10.000 base images + their modified versions

Video Signatures 200 hours of video content required 10.000 longer clips 50.000 shorter clips

Currently, the following timelines are planned: Image Signature

Final Call for proposals: 2007.07.13 Submission deadline: 2007.10.10 (by 23.59 Hours GMT) Evaluation of answers: 2007.10.20 – 26 (During the 82nd MPEG meeting and the

weekend before: proponents are strongly advised to present their proposals in person.)

PDAM: 2007/10 FPDAM: 2008/04 FDAM: 2008/10 AMD: 2009/01

Video Signature Preliminary Call for test data & proposals: 2007.07.13 Collection of video test data: 2007.10.10 Finalisation of experimental conditions / Final Call for Proposals: 2008.01.18 Submission deadline: 2008.04.16 (by 23.59 Hours GMT) Evaluation of answers: 2008.04.26 – 05.02 (During the 84th MPEG meeting and

the weekend before: proponents are strongly advised to present their proposals in person.)

PDAM: 2008/04 FPDAM: 2008/10 FDAM: 2009/04 AMD: 2009/07

One input document on video annotation was considered (M14706). In this context, while all relevant types of metadata are available within the MPEG-7 framework, proper embedding, storage and transport of metadata with the video stream is a topic that requires further clarification for specific application domains.

12.2. Output documents related to MPEG-7 Visual

No. Title TBP Available98

15938-3 Visual9216 Call for Proposals on Visual Signature Tools N 07/07/139217 MPEG-7 Visual XM Document version 31.0 N 07/07/209218 Description of Core Experiments for MPEG-7 New Visual

ExtensionsN 07/07/06

15938-8 Extraction and Use of MPEG-7 Descriptions9219 Disposition of Comments on ISO/IEC TR 15938-8:2002 / DAM 3 N 07/07/139220 Text of ISO/IEC TR 15938-8:2002/Amd.3 (Technologies for

digital photo management using MPEG-7 visual tools)N 07/07/06

12.3. Output documents related to MPEG-A Photo Player MAF

No. Title TBP Available23000-3 Photo Player Application Format

9221 Disposition of Comments on ISO/IEC 23000-3 / PDAM 1 N 07/07/069222 Text of ISO/IEC 23000-3 / FPDAM 1 Reference Software for

Photo Player MAFN 07/07/27

13. 23002 MPEG-C Video Technologies

13.1. 23002-3

Document reviewed:

14700

Fons Bruls Jan van der MeerChris Varekamp Arnaud BourgeYann Picard

Proposal to amendment MPEG-C Part 3

It is stated that the simple stereo application which can currently be implemented by using MPEG-C part 3 could incur quality problems in cases where scenes with large depth changes (i.e. large occlusion areas) need to be processed. To overcome this limitation, it is proposed to transmit multiple videos for multiple foreground or background layers. An option to transmit „partial background“ only for the occluded areas (instead of encoding the background multiple times) is presented. Even though this partially resolves the problem of highly increased data rate, the idea seems not to be fully worked out yet. More study is needed, in particular- could smaller-size frames be used for the additional background- duplicate transmission of motion vectors – how much overhead does this cost?Since there would certainly not be a major change to the standard, and similar cases (requesting small improvements to existing standards under the perspective of well defined application requirements) are more frequently brought to the attention of the video subgroup, it was decided to install an „AHG on investigating video standards by application needs“ with the mandate to perform technical study on such issues.

13.2. 23001-4 and 23002-4 Reconfigurable Video Coding (RVC)

(High-level summary, for details on particular documents see ISG report)

General

14592 General Royalty Cost Optimization with Reconfigurable Video Coding

14650 General PREESM in the RVC framework14739 General Simulator in the Eclipse environment for RVC

99

Review of M14592 Information about the possible use of RVC w.r.t. licensing. Presents „rate-distortion-

royalty“ optimization curves (using Lagrangian methods). Registry needed for the purpose of implementation of royalty collection or allowing usage of tools. Tools could get paid based on their contribution to RD reduction. Interesting perspective for licensing RVC, but nothing technically to be done by MPEG.

Review of M14650 Multiprocessor platform for CALTROP project A working demo has given. The work will continue till the next meeting.

Review of M14739 Another simulator with Moses to replace Moses Recommendation: to put in RSM Implementation

Status of WD/RSM/Workplan (Marco) FU naming

Recommendation: to create a FAQ section on naming convention in VTL WD.

RVC repository structure VTL WD: FUs will be listed in one table listing RSM Implementation: will have two directories of FUs {algorithm, data

management} Recommendation: changes will be made to RSM Implementation (with an

editing period, Editor: Christophe) FU description format in VTL WD

Recommendation: to use ‘Pseudo code’ style format and to move ‘Cal-style’ format

Liaison with SMPTE

14686 General SMPTE liaison to JTC1/SC29/WG11 on RVC

todo

CE 1 (to be discussed on Tuesday)

14757 MPEG-B RVC Core Experiment Report on Extension to support non-MPEG standards

14657 MPEG-B Result of RVC CE 1.1

14658 MPEG-B CDDL-Based decoder description for constructing ADM and syntax parsing

14747 MPEG-B Report on CE on RMC Bitstream Syntax Description Review of M14757

Cal-based FU implementation started Will continue till next meeting

Review of M14657 Review of M14658 Review of M14747

Recommendation: to continue CE till next meeting with a thorough evaluation plan

CE 2 (to be discussed on Tuesday)

14629 MPEG-C Functional units of AVC inter prediction for RVC video tool library

14632 MPEG-C Proposed text of the RVC FUs for MPEG-4 AVC and MPEG-2

100

Review of M14629 Proposal of 5 FU descriptions (with CAL implementation) for inter prediction of

AVC Recommendation: to adopt the proposal in VTL WD

Review of M14632 Recommendation: to change the FU description in Pseudo code format and

adopt in VTL WD

EE related (to be discussed on Tuesday)

14756 MPEG-C RVC Exploration Experiments Report on new 8x8 Inverse Transform and Quantization Tools

Review of M14756 Will continue till next meeting

Conformance testing and implementation issues

14630 MPEG-C A CAL-based conformance testing environment for RVC video tool library

14655 MPEG-C From AVC to SVC: minor and major modifications in a RVC decoder implementation

14721 MPEG-C ISO/IEC 23002-2 in RVC Implementation14722 MPEG-C ISO/IEC 23002-1 IDCT Implementation in CAL Testbed Update Review of M14630

Recommendation: to adopt in conformance WD Review of M14655

Recommendation: – to reflect the SVC FU development plan to workplan– to setup an EE on SVC

Review of M14721 and M14722 Recommendation: to adopt FU description in VTL WD and RSM

Joint meeting with Systems on RVC and M3W Recommendation: to put an introductory section on the link between RVC framework

and M3W in MPEG-B WD

Discussion of Core Experiments and in particular the issue of parserTwo technologies:- CALML parser (where the linkage between BSDL and parser can be implemented

differently, such that only BSDL and CALML parser would establish conformance points)- CDDL parser- There would be a difference about normative conformance point – would the entire parsing

implementation be normative, or only the interfaces at BSDL and CALML- Delay CD on 23001-4 until implementation of CALML parser is available and CE have been

performed- Both parser concepts should be verified with CAVLC/CABAC- Delay CD on 23002-4 until it is more complete- CE document and work plan (incl. list of FU that will be in 23002-4) by end of week

• Codec Configuration Description (23001-4) – Issue of parser not finalized yet in CE– Implementation of CALML parser will be available shortly after meeting (concept

appears appropriate, but no proof by implementation yet)– Issue of CALML/BSDL vs. CDDL to be resolved in CE

101

– None of the two concepts has been implemented with more advanced entropy codecs such as CAVLC and CABAC

• A delay of 23001-4 CD by one more meeting cycle is requested

• CE1: Decoder Description Language• Candidates

– CDDL – XML-based DDL

• All participants have agreed on clear evaluation criteria (different in each of the sub-experiments), in particular to judge

– Language capability– Compactness– Implementation capabilities

• Video Tool Library (23002-4)– Decision taken to stay with pseudocode formulation – CAL based finite-state

machine formulation would better fit into non-normative annex showing concrete implementation

– Until now, only MPEG-4 SP is (almost) complete, but we expect more tools from other standards until October (see work plan)

– Issue of parser may have implication (additional FU definitions)• Also, delay by one more meeting cycle requested

Work plan:• Very precise analysis about current development status, and plans/commitments to

develop FUs– First version of library shall contain tools for MPEG-2 MP, MPEG-4 SP and ASP,

AVC BP and HP– Further FUs for SVC and Integer DCT/IDCT are already under investigation– Additional plan to investigate implementation of non-MPEG tools (AVS intra and

inter)• Major FU developments will be finalized until January• Additional tools for testing, code generation etc. under scope of work plan as well

Output document processing CCD WD 5.0 (Editor: CJ)

Introductory section on the link between RVC and M3W

VTL WD 5.0 (Editor: Yishin) FU naming: To create a FAQ section on naming convention in VTL WD The names of All FUs will be listed in one table and maintained. New FU descriptions

– M14629 Functional units of AVC inter prediction for RVC video tool library– M14632 Proposed text of the RVC FUs for MPEG-4 AVC and MPEG-2– M14721 ISO/IEC 23002-2 in RVC Implementation

RSM (Editors: Marco & Christophe) Restructuring of Toolbox

– two directories of FUs {algorithm, data management} Inclusion of Eclipse environment New FU implementations in CAL

– M14629 Functional units of AVC inter prediction for RVC video tool library102

– M14632 Proposed text of the RVC FUs for MPEG-4 AVC and MPEG-2– M14721 ISO/IEC 23002-2

Conformance WD 2.0 (Editor: Gwo Giun) M14630 A CAL-based conformance testing environment for RVC video tool library

New CE CE 1 decoder description language

– CE 1.1 Syntax Parser Formation and Description (Editor: Christophe/Hyungyu)– CE 1.2 Description of Network of FUs (Editor: Christophe/Hyungyu)– CE 1.3 Capability to support non-MPEG standards (Editor: Lu)

CE 2 Abstract FU description– CE 2.1 Description and implementation of FUs that are listed in VTL WD (Editor: Yishin )

Documents reviewed:

14592 Onur G. GuleryuzM. Reha Civanlar

Royalty Cost Optimization with Reconfigurable Video Coding


Functional units of AVC inter prediction for RVC video tool library


A CAL-based conformance testing environment for RVC video tool library

14632Kenji OtoiYoshihisa YamadaKohtaro Asai

Proposed text of the RVC FUs for MPEG-4 AVC and MPEG-2

14650NezanM. Raulet O. Déforges

PREESM in the RVC frameworkTool for rapid prototyping and deployment on different architectures. Supports parallelization and scheduling. Unlike other tools (e.g. Ptolemy, Moses), multiprocessor platforms are supported.

14655Raulet MickaëlPelcat MaximeBlestel Médéric

From AVC to SVC: minor and major modifications in a RVC decoder implementation

14657Hyungyu KimChungku YieEuee S. Jang

Result of RVC CE 1.1

14658

Sunyoung LeeJaebum JunSinwook LeeByoungjun KimHyungyu KimChungku YieEuee S. Jang

CDDL-Based decoder description for constructing ADM and syntax parsing

14686 Gavin Schutz Liaison input on 29n8435 - RVC

14721 Lazar BivolarskiYuriy A. Reznik ISO/IEC 23002-2 in RVC Implementation

14722 Lazar Bivolarski ISO/IEC 23002-1 IDCT Implementation in CAL Testbed Update

14739 Christophe LucarzSimulator in the Eclipse environment for RVCPresents a new simulation environment which overcomes some limitations that the Moses interface has.

14747 Joseph Thomas-Kerr Report on CE on RMC Bitstream Syntax Description

14756 Dandan Ding

RVC Exploration Experiments Report on new 8x8 Inverse Transform and Quantization ToolsPresents the textual and algorithm description of the tools that were implemented. IDCT and inverse quantization were exchanged successfully. No performance analysis (in concrete numbers) given.

103

14757 Dandan Ding

RVC Core Experiment Report on Extension to support non-MPEG standardsDescribes work items necessary to implement AVS intra decoder. In principle, the dataflow from the CAL model can be used, but all FUs like IDCT, scan, inverse quant., de-blocking filter would need to be exchanged replacing the existing VTL FUs. So far, only IDCT and IQ were implemented in the toolbox style. In the continuing CE, it would also be important to explore the common usage of parsing and VLD description mechanisms.

Output Documents:

No. Title TBP Available23001-4 Codec Configuration Representation

9223 WD 5 of ISO/IEC 23001-4 Codec Configuration Representation N 07/07/1323002-4 Video Tool Library

9224 WD 5 of ISO/IEC 23002-4 Video Tool Library N 07/07/209225 Description of Core Experiments in RVC N 07/07/069226 RVC Simulation Model (RSM) V5.0 N 07/08/039227 RVC Work Plan N 07/07/069228 RVC Conformance Testing Working Draft 2.0 N 07/07/209229 Description of Exploration Experiments for Toolbox Extensions N 07/07/06

14. Explorations – Free Viewpoint Television

A joint meeting on FTV was held with the Requirements SG. In this context, a certain level of clarification was achieved about what FTV actually is (in terms of representation between input and output):- Multiple videos from array of cameras in (plus additional data such as depth and camera

parameters)- Arbitrary views (as allowed by the available view range of cameras) out- FTV is a representation format (normative) plus (possibly non-normative) devices at

transmission and receiver end, such as view renderer or view projection/interpolation.- The goal of FTV is generation quasi continuous views, while MVC as currently standardized

by JVT is about best compressing a discrete set of views, which most probably will appear as a core element of FTV.

An actual technical solution for FTV is not decided (and will may only be decided after a possible CfP). According to the technical inputs that were brought so far, it is most likely that in addition to a representation of the input views, a method of depth representation will be required. Problems arising in this context are – the lack of test sequences with reliable depth data, and even the lack of a reliable method for

generating depth data,– the mutual influence between the quality of depth data, the quality of decoded video data an

the quality of view rendering,– the circumstance that no references are available for interpolated views, unnatural artifacts

may occur during view navigation, and in general the quality can only be judged by extensive viewing tests.

To get more insight into these issues, it was decided to set up an exploration experiment, which also could bring MPEG into an adequate position to perform a CfP (generation/gathering of test material, evaluation methodology):

104

– to get judgments about the quality of available test materials for the purpose of FTV testing (and define requirements for test materials and acquire new ones),

– to get more insight into the relationship of multiple view video coding, depth map representations and view synthesis,

– to generate results on various levels of quality to be used in the set up of evaluation procedures.

Documents reviewed

14626

Taka Senohkenji YamamotoRyutaro OiTomoyuki MishinaMakoto Okui

Consideration of image depth information (already presented in JVT & AHG)Requests that depth information should be given by actual object distance. See notes in JVT report.

14631 Hideaki KimataShinya Shimizu

Proposal on MVC Requirements for different camerasAdopted (was in principle already approved by last meeting)

14638

Yo-Sung HoKwan-Jung OhCheon LeeSangBeom LeeSan-Tae Na

Depth Map Generation and Depth Map Coding for MVC (already presented in JVT & AHG)

14639Yo-Sung HoKwan-Jung OhCheon Lee

Geometrical Compensation for MVC (already presented in JVT & AHG)

14647 Toshiaki Fujii Proposal on EE for FTV

14648Toshiaki FujiiHideaki KimataShigeyuki Sakazawa

Requirements for FTV

14740 ITU-T SG 9 via SC 29 Secretariat Liaison Statement from ITU-T SG 9 [SC 29 N 8597]

Output document:No. Title TBP Available

Exploration – Free Viewpoint TV Coding9230 Description of Exploration Experiment in FTV N 07/07/06

15. Other issues - Color

14615Tokumichi MurakamiKohtaro AsaiShun-ichi Sekiguchi

Requirement of Real-Color Video Coding for Consumer ApplicationClaims that „dirty color effects“ become visible in cases of 4:2:0 color coding. Even for consumer products, many cameras are equipped with 4:4:4 sensors. For 4:2:0 there is an upper bound in quality of color, even if rate is increased. Possibility of further improving 4:4:4 coding? No evidence is brought for that – in fact, this issue was already thoroughly investigated in the context of PP definitions.However, in principle everything is there from the new professional professional profiles. Proponent should check whether the appropriate level is available in new professional profiles.

14616 Shun-ichi SekiguchiShuichi YamagishiYoshihisa YamadaKoht

On Performance Comparison between 4:4:4 coding and 4:2:0 codingInvestigated performance 4:4:4 Predictive Profile vs. High Profile. Shows that even at bitrates that are suitable for consumer applications the „transition point“ from which 4:4:4 is better than 4:2:0 is at rates which are interesting for consumer applications. „Transition point“ between RGB and YUV coding seems to be at higher rates, however

105

(Question: Can YUV and RGB SNR be directly compared? The transformation is not lossless in case of 8 bit data).

14627

Maeng-Sub ChoJin-Seo KimBon-ki KooSang-Kyun Kim

Initiating a new application format for Consistent Color ReproductionRequest that colour information metadata should be transferred along with the video data. For example, color transformations that would be useful for specific monitor types. No evidence is brought that the tools avalable in the MPEG standards (-2,-4,-7,-AVC) are not sufficient for this purpose. It is not a matter of a MAF, because everything a display manufacturer does from the colour metadata should be his own business and non-normative.

14628

Maeng-Sub ChoJin-Seo KimBon-Ki KooSang-Kyun Kim

Parameter set for effective and consistent color reproduction

106

Annex I – JVT report

107

Annex J – Audio report

Source: Schuyler Quackenbush, Chair, Audio Subgroup

1 Opening of the meeting.............................................................................................................32 Administrative matters...............................................................................................................3

2.1 Approval of previous meeting report 32.2 Approval of agenda and allocation of contributions 32.3 Task Groups 32.4 Communications from the Chair 32.5 Joint meetings 32.6 Received National Body Comments and Liaison matters 3

3 Record of AhG meetings...........................................................................................................33.1 AhG Meeting on Spatial Audio Object Coding Sunday 1300-1700 3

4 Audio plenary, joint meeting and task group activities.............................................................64.1 Review of AHG reports 64.2 Received national body comments and liaison matters 64.3 Joint Meetings6

4.3.1 Audio, ISG on Complexity of AAC-ELD-BS CE Wed 1100-1200...............................64.3.2 Audio, Req on FTV and Speech and Audio Wed 1200-1300.........................................64.3.3 Audio, ISG on tools for video coding tools repository Thu 1400-1500..........................6

4.4 Task Group discussions 74.4.1 MPEG-4 ELD..................................................................................................................74.4.2 Speech and Audio Exploration......................................................................................104.4.3 SAOC.............................................................................................................................134.4.4 MPEG-1, MPEG-2, MPEG-4 and MPEG Surround audio, conformance, reference software..................................................................................................................................13

5 Meeting deliverables................................................................................................................145.1 Recommendations for final plenary 145.2 Establishment of Ad-hoc Groups 145.3 Approval of output documents 155.4 Responses to Liaison and NB comments 155.5 Press statement 15

6 Future activities.......................................................................................................................156.1 Schedule of future meetings 156.2 Agenda for next meeting 156.3 All other business 156.4 Closing of the meeting 15

Annex A Participants.................................................................................................................16Annex B Audio Contributions and Schedule.............................................................................17Annex C Task Groups...............................................................................................................20Annex D Output Documents......................................................................................................21Annex E Agenda for the 82nd MPEG Audio Meeting...............................................................22

108

16. Opening of the meetingThe MPEG Audio Subgroup meeting was held during the 81st meeting of WG11, July 2-6, 2007, Lausanne, Switzerland. The list of participants is given in Annex A.

17. Administrative matters17.1. Approval of previous meeting reportThe 80th Audio Subgroup meeting report was registered as a contribution, and was approved.

17.2. Approval of agenda and allocation of contributionsThe agenda and schedule for the meeting was discussed, edited and approved. It shows the documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary. The Chair brought relevant documents from Requirements, Systems and MDS to the attention of the group. It was revised in the course of the week to reflect the progress of the meeting, and the final version is shown in Annex B.

17.3. Task GroupsTask groups were convened for the duration of the MPEG meeting, as shown in Annex C. Results of task group activities are reported below.

17.4. Communications from the ChairThe Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.

17.5. Joint meetingsThe joint meetings with Audio over the course of the week are listed here and are reported on below.Groups What Where Day TimeAudio, ISG Complexity of AAC-ELD-BS CE Audio Wed 1100-

1200Audio, Req FTV – audio issues

Speech and AudioAudio Wed 1200-

1300Audio, ISG Video Codec Configuration

DescriptionAudio Thu 1400-

1500

17.6. Received National Body Comments and Liaison mattersThe NB Comments and Liaison documents for the meeting that require a response are as shown below.No. Title Response by

(There were none.)

18. Record of AhG meetings18.1. AhG Meeting on Spatial Audio Object Coding Sunday 1300-1700Jeongil Seo, ETRI, presented

14595

Inseon JangJeongil SeoSeungkwon BeackKyeongok Kang


109






Oliver Helmuth, FhG, presented

Heiko Purnhagen, Coding Technologies, presented

Henney Oh, LGE, presented

Werner Oomen, Philips, presented

Schuyler Quackenbush, Audio Research Labs, presented

14598 Schuyler Quackenbush

Report on Spacial Audio Object Coding CfP Subjective Listening Test

It was suggested that the listening test analysis spreadsheet be enhanced to Present test_a_s separately from test_a_1, test_a_2 and test_a_3. Present per-signal results, but only for proponent systems. Present mean results (averaged over all signals), for all systems under test

The Chair noted that the following still have to be discussed as part of the evaluation process: Side information rate limit Complexity limits

Yang-Won Jung, LGE, presented

This proposal only covered technology for stereo to stereo signal remixing (test_c). It documented that

Side information rate limits were satisfied for all test items (not more than 85% of the 3 kb/s per object limit was used by any test item).

Complexity limits were satisfied (less than 12% of MPEG Surround decoding for the set of items in test_c).

It further discussed several unique features of the proposal: Does not need downmix matrix Only needs object signal that is desired to be controlled (e.g. vocal signal for karaoke

application) Very low complexity

Juergen Herre, FhG, presented

14669Oliver HellmuthJuergen HerreLeonid Terentiev


14703 Jonas EngdegårdHeiko Purnhagen


14734

Henney OhYang-Won JungDongSoo KimHyunKook Lee




14733Yang-Won JungHenney OhHyo Jin Kim


14696

Jonas EngdegårdLars VillemoesHeiko PurnhagenOliver HellmuthAndreas HölzerKarsten LinzmeierJeroen Breebaart


110

mailto:

mailto:

mailto:













This contribution highlighted aspects of the proposal system architecture and its supported functionality.Complexity is dominated by the decorrelator in the stereo pre-processor module. This decorrelator is comparable to those found in the MPEG Surround decoder (which may have up to 4). Hence, to a first approximation, the SAOC decoder has a complexity that is 20 % of the MPEG Surround decoder.Side-information bitrate was always below the limit of 3 kb/s per object. The average side information rate per object is 50% of the 3 kb/s /object or 9 kb/s per test item. Yang-Won Jung, LGE, presented

This contribution raises the question of how listeners grade the systems under test in the case that rendering was not accurate but sound quality was very good, as compared to when rendering was accurate but sound quality was not very good. It furthermore questions whether the technology submitted to the CfP is sufficiently good for key application areas (e.g. karaoke or teleconferencing) to be successful in the marketplace.The contribution suggests that there be two listening tests: one for overall quality and another for rendering accuracy. The Chair noted that the subjective tests done by the Audio Subgroup has always had to encompass more than one dimension of quality: testing of classical perceptual coders require that the listener judge the trade-off that may be made in the codec between output signal bandwidth and output signal distortion. Juergen Herre, FhG, suggested that listeners always have to incorporate multiple aspects of coder distortion into a single measure of subjective quality, and that two distinct tests, one for audio quality and one for rendering quality, would not be appropriate.The contribution asks for additional verification tests. The Chair asked the group whether this means do a test now or at the end of the standardization process. There was considerable discussion on how listening tests might specifically address the karaoke application.It was the consensus of the AhG that

There not be any additional testing at this time. The CE process should be modified to address issues raised by this contribution, e.g.

better listener instructions and listener training for the case of systems that have both audio coding artefacts and audio sound stage distortions.

The be an output document such as “First thoughts on verification test for SAOC” that captures tentative quality targets for performance of the finished SAOC specification.

Osamu Shimada, NEC, presented

This

contribution notes that objects may not be available as separate signals, and suggests that technology for separating objects into two signals, e.g. a mono signal with two talkers separated into two signals with one talker each, may be very useful for the teleconferencing application. It further showed how this concept could be integrated into the envisioned SAOC architecture.The Chair noted that this looked like an excellent first Core Experiment for SAOC.The Chair summed up the recommendations of the AhG as follows:

That the proposal from Coding Technologies, FhG and Philips be the SAOC Reference Model

14735Henney OhYang-Won JungHyo Jin Kim


14656

Osamu ShimadaToshiyuki NomuraAkihiko SugiyamaOsamu Hoshuyama

A proposal for an additional SAOC functionality of separating real-environment signals

111




The CE process should be modified to address issues raised by this contribution, e.g. better listener instructions and listener training for the case of systems that have both audio coding artefacts and audio sound stage distortions.

The be an output document such as “First thoughts on verification test for SAOC” that captures tentative quality targets for performance of the finished SAOC specification.

19. Audio plenary, joint meeting and task group activities19.1. Review of AHG reportsThere were no requests to review any of the AHG reports.

19.2. Received national body comments and liaison mattersLiaison documents were reviewed and the drafting of the responses was delegated.

19.3. Joint Meetings 19.3.1. Audio, ISG on Complexity of AAC-ELD-BS CE Wed 1100-

1200

Marco Matavelli, ISG Chair, discussed a tool for assessing complexity of algorithms that is independent of implementation platform. This tool requires that the algorithm (e.g. AAC-ELD with and without the block switching tool) be implemented in ANSI C. The tool reports e.g. the frequency of usage of primitive C-language operators. Thursday at 2PM, the ISG Chair gave a demonstration of the complexity evaluation tool. This tool evaluates the number of arithmetic operations and number of memory accesses in a compiled program, and does so on a per-function The tool requires ANSI-C source code, which is then compiled using the tool, and the report generated by the tool. The Audio Subgroup will contact ISG for next steps.

19.3.2. Audio, Req on FTV and Speech and Audio Wed 1200-1300

Audio Chair presented text for requirements for joint speech and audio coding. The Requirements chair felt that the requirements were precise and consistent, and as such could be endorsed by Requirements.Masayuke Tanimoto, Nagoya University, presented14646 Kazuya Takeda SLPA (Selective Listening Point Audio) for FTV AudioThis contribution presented the basic concepts of Free Viewpoint TV (FVTV) as far as video capture, processing and presentation are concerned. It is anticipated that FTV will support pan and zoom functions in video presentation.It is desired that the audio component of an audio-visual presentation should remain consistent with the video presentation, so that the functionality of “zoom” and “pan” also should be supported. It was suggested that audio capture might be close-capture microphones at the sources, or distant microphones arrays, perhaps at the cameras.An audio demonstration from Nagoya Univeristy is available at http://www.sp.m.is.nagoya-u.ac.jp/~niwa/fvlp.html.Audio experts should review and add to N8944, “Preliminary Requirements for FTV,” which is expected to be re-issued at this meeting.

19.3.3. Audio, ISG on tools for video coding tools repository Thu 1400-1500

The ISG Chair gave a tutorial overview of the video tool repository, and also the CAL tool that permits the tool repository to be assembled into a working multimedia compression system. CAL is a dataflow language, in which “actors” are functional units that are “fired” when all data tokens are available. Actors encapsulate their own data state, and all input and output tokens are communicated with other actors via FIFOs. Ptollemy II and Moses are two frameworks that support CAL.

112




MPEG has developed an XML-based language (MPEG-B) that specifies the communication between CAL elements. CAL can be written either in the CAL language or in JAVA, but cannot be ANSI-C.

19.4. Task Group discussions19.4.1. MPEG-4 ELD

Werner Oomen, Philips, presented14688 Jeroen Koppens, Werner

OomenPhilips cross-check results of subjective quality of AAC-ELD

This contribution presented a listening test that assessed the performance of the following systems:Label Description Bitrate

[kbit/s]Delay [ms]

Ref Hidden reference - -3.5 kHz LP

3.5 kHz low-pass filtered test items - -

7.0 kHz LP

7.0 kHz low-pass filtered test items - -

AAC-LD MPEG-4 AAC-LD 32 42.6AAC-ELD

AAC-ELD as defined by ISO/IEC 14496-3:2005/FPDAM9, Enhanced low delay AAC'

32 33.3

G722.1C ITU-T G.722.1C 32 40AMR-WB

ITU-T G.722.2 24 25

The listening test results showed subjective quality as follows, where the ranking is significant at the 95% level of significance and where AAC-ELD is as specified in 14496-3:2005/FPDAM9, Enhanced low delay AAC:

AAC-ELD at 32 kb/s > AAC-LD at 32 kb/s > G.722-1 Annex C at 32 kb/s > AMR-WB at 24 kb/s

Heiko Purnhagen, Coding Technologies, presented14709 Fredrik Henn, Per Ekstrand,

Arijit BiswasCoding Technologies cross-check of AAC-ELD subjective audio quality

The listening test results showed subjective quality as follows, where the ranking is significant at the 95% level of significance, where AAC-ELD is as specified in 14496-3:2005/FPDAM9, Enhanced low delay AAC:


Markus Schnell, FhG, presented14723 Markus Schmidt , Markus Schnell , Ralf Geiger Listening test results for AAC-ELDThe listening test results showed subjective quality as follows, where the ranking is significant at the 95% level of significance, where AAC-ELD is as specified in 14496-3:2005/FPDAM9, Enhanced low delay AAC:


DiscussionThe Chair summarized the main point of these three contributions as follows:

ELD delivers superior performance relative to LD, and does so with lower delay. ELD delivers superior performance relative to other widely used state of the art codecs.

Ralf Geiger, FhG, presented14725 Ralf Geiger , Jürgen Herre On the sensitivity of T-Tests for MUSHRA Scores

113












The contribution noted that t-test may present a false conclusion due to statistical variation. Schuyler Quackenbush, ARL, presented this contribution on behalf of Yuriy Reznik, Qualcomm,14755 Yuriy Reznik Brief comment on complexity of MDCTThe main point of the contribution is that computation of a cascade of 8 shorter transforms should require approximately 30% less number of operations than computation of a longer transform. Ralf Geiger, FhG, presented14727 Ralf Geiger , Stephan Schreiner , Virgilio Bacigalupo ,

Markus Lohwasser , Tobias AlbertOn the Complexity of Block Switching

This contribution presents evidence on the complexity of actual implementations of codecs that implement block switching. It notes that, in practice, use of short blocks introduces an additional coding mode, plus the transitions to and from the short block modes, and that all of these modes need to be optimized.Specific numbers were presented, as follows:Complexity

AAC-LC on floating-point DSP had a Peak/Average ratio for block-switching coder of 125%

AAC-LC on fixed-point DSP had a Peak/Average ratio for block-switching coder of 115%

Code size AAC-LC on fixed-point DSP had a Code Size ratio for Long-only/Block-switching of

120%

DiscussionDavid Virette, France Telecom, noted that complexity relates to the specific set of tools that comprise the codec. The Chair noted that, while a complexity increase of 25% is significant, it will likely not prohibit adoption of technology in the marketplace. However, increase in complexity should be evaluated relative to the corresponding increase in performance.Markus Schnell, FhG, presented14724 Markus Schnell , Fredrik Henn Proposed Changes for AAC-ELDThis contribution proposes to make numerous small syntax changes that eliminate unused AAC-related syntax elements. They are:

Always include SBR configuration information when you transmit the ELD configuration information.

Eliminate unused AAC-related syntax elements, which can result in more than 1 kb/s savings when running the coder at a 48 kHz sampling rate.

Support both fine and coarse quantizers for SBR time-frequency grid.

The proposed changes retain the ability to generate the identical output waveforms as used in previous AAC-ELD listening tests, but with lower compressed rate.A consensus position on this contribution was deferred until discussion of 14705, Preliminary comments on ISO/IEC 14496-3:2005/FPDAM9 and resolution of its open issues.Ralf Geiger, FhG, presented14726 Ralf Geiger , Markus Schnell , Jürgen Herre ,

Manfred Lutzky , Kristofer KjörlingProposed Annex for AAC-ELD: Delayless Mixing

This contribution is a proposed informative annex on using frequency-domain mixing of AAC-ELD streams as a means of mixing without any additional delay. This only requires that an AAC-ELD bitstream be decoded and inverse quanitzed to obtain MDCT coefficients, which can be linearly combined to perform the mix. It also shows how SBR parameters can be combined in the parameter domain.Anisse Taleb, Ericsson, noted that, in practice, other aspects of an MXU transport system may dominate the delay due to the mixing operation.There was some discussion of the contribution text. The Chair summarized the requested edits as follows:

114












The referenced 3GPP specification is extremely short. Instead of referencing this, the text will be slightly reworded and included in the Informative Annex.

The word “essential” will be changed to “highly desirable” The words “without introducing additional …” will be changed to indicate “lowest

possible delay” Remove text that such as “no block switching” that might conflict with the possible

adoption of the AAC-ELD-BS Core Experiment technology.

A consensus position on this contribution was deferred until discussion of 14705, Preliminary comments on ISO/IEC 14496-3:2005/FPDAM9 and resolution of its open issues.David Virette, France Telecom, presented14720 David Virette, Pierrick

PhilippeAdditional information for AAC-ELD instantaneous block switching CE

This contribution gives information on the additional delay, additional complexity and increased in quality associated with the proposed block switching algorithm. A comparative listening test shows improvement for AAC-ELD-BS relative to AAC-ELD for signals es01, ei02, es03 and si02 at the 95% level of significance. The contribution presented several comparisons of complexity. They showed moderate increases or decreases of complexity, and concluded that the complexity of block switching was such that it did not preclude adoption in the marketplace. It further noted that quite successful audio codecs (e.g. MP3 and AAC) use block switching, so that block switching is obviously not an impediment to market adoption.Concerning applications that use frequency-domain mixing, the contribution showed how zero-delay mixing could be achieved via

Exploiting masking to conceal some pre-echo mixing errors Using predictive signal estimation to estimate areas where non-perfect reconstruction

would otherwise occur.

Quality issuesThe Chair asked interested experts, including Ralf Geiger and David Virette, to have a break-out that that verifies exactly what tools constitute the AAC-ELD-BS and AAC-ELD systems in the listening test presented in this contribution.Juergen Herre, FhG, noted that the differences relate to using the FhG encoder for one system and the FT encoder for the other as opposed using the FhG encoder for both systems. The impact of this lack of control in the experimental process will be studied by audio experts. The Chair requested that interested experts study these two issues and report back to the Audio Subgroup Wednesday at 2PM.Complexity issuesThe contribution reported increases in execution time for block switching versus long-only using the 3GPP aacPlus (HE-AAC-V2) encoder or decoder of less than 3%. However Bernhard Grill, FhG, said that this code is optimized for sound quality and not computational efficiency. However, Anisse Taleb, Ericsson, noted that the 3GPP complexity data uses weighted MOPS which maps very well to actual complexity of DSP implementations.Frequency-domain mixing issuesRalf Geiger, FhG, asked whether the pre-echo issues get better or worse as bitrate increases. Juergen Herre noted that there is some complexity increase due to window compensation steps and also to a signal estimation step when perfect reconstruction is not possible under the constraint of zero delay.JungHoe Kim, Samsun, presented14671 Miyoung Kim, Eunmi Oh Crosscheck of FT Core Experiment on AAC-ELDThis contribution presented a cross-check listening test using the same waveforms as was used in the previous contributions. Comparative listening test shows improvement for AAC-ELD-BS relative to AAC-ELD for signals es01, ei02 and si01, sm02 at the 95% level of significance. The statistic used was the two-sided t-test.

115





These results agreed with the France Telecom results for es01 and es02, but differed from the FT results for si01, si02 and sm02.David Virette, France Telecom, presented14705 FrNB Preliminary comments on ISO/IEC 14496-3:2005/FPDAM9This contribution presented a preview of what the FNB comments might be on the ballot on ISO/IEC 14496-3:2005/FPDAM9Support for Core Experiment for Enhanced Low Delay AACThe FNB supports adoption of this Core Experiment.SBR signalling and transportThe FNB does not support these changes, and additionally cannot support changes in the AAC-ELD syntax that diverges from the AAC syntax. SummaryThe Chair noted the open issues and proposed that the break-out groups report back Wednesday at 2PM and that discussion of this CE continue at that time.Report by break-outDavid Virette, France Telecom, presented a slide that summarized the results of the break-out.

WAV files have been generated using the bitstreams from the last meeting’s RM0. This is done in a way that is not compliant, such that the RM decoder cannot decode the bitstreams, but correctly synchronizes the based codec data with the SBR data. It was the consensus of the group that this does not materially affect the subjective quality results.

There is agreement that the block switching tool improves the quality of test item si02 (castenets). This is based on listening done at the MPEG meeting in which the comparison was done between the FT with block switching enabled and without blocks switching enabled. There is ongoing discussion as to the improvement of the speech items, since aspects of the listening tests presented in the contributions are

There is agreement that block switching has an impact on zero-delay mixing.

The Chair asked that this break-out continue but focus on discussing a process that will lead to a consensus position on this issue. He further noted that this issue must be resolved prior to writing the DoC on AAC-ELD FPDAM, which will be done at the next MPEG meeting.Further discussion and discussion in closing Audio plenaryThe chair explained to the French HoD that the France Telecom proposal has brought all information required by the core experiment methodology and fulfilled all required steps of this procedure (N7140). But the Chair added that it is up to the audio subgroup to decide whether the core experiment is accepted or not, and in the case of this core experiment on the Block Switching in AAC-ELD, there was no consensus in the audio subgroup to accept or reject the proposed technology.After considerable break-out discussion, the following was agreed to:

That the experimental method associated with the additional evidence brought by FT to this meeting was not an ideal controlled experiment (in that it was not Coder A vs. Coder A + Block Switching).

It was agreed by audio experts (including those from France Telecom and Fraunhofer) that Block Switching improves the quality of at least one item (si02), but that for other items (including speech items es01 and es02) the result was inconclusive.

That the quality of the proposed technology on speech items has to be further assessed to as a means to conclude this core experiment.

That the complexity information provided to this meeting is correct, although not all experts agree on the interpretation of this information.

It was the consensus position of the Audio Subgroup to take the following action: Draft a workplan in which FT and FhG collaborate to get additional performance

information Put all candidate technology contributed to this meeting into a “Technology under

consideration for AAC-ELD” document.

116

This position was acceptable to the French National Body.

19.4.2. Speech and Audio Exploration

Taejin Lee, ETRI, presented14633 Taejin Lee, Minje Kim, Jeongil Seo, Kyeongok

Kang, Youngcheol Park, Hochong Park , Kim Rin Chul


This presented results from a number of test sites, bit rates and M/S modes.JungHoe Kim, Samsung, presented14668 JungHoe Kim, Miyoung Kim,

Eunmi OhListening test results for Exploration of Speech and Audio Coding

This presented test results for 16, 20 and 24 kb/s rates for stereo. David Virette, France Telecom, presented14704 David Virette, Pierrick

PhilippeListening test results for Speech and Audio Coding exploration

This presented test results for 16, 20 and 24 kb/s rates for stereo. The contribution noted that the following signals appear to be the most critical:Mix content (critical for both codec)Mix02Mix03Mix04Mix09Music content (critical for AMR WB+)Mu02Mu05Mu08Mu12Speech content (critical for HE AAC v2)Sp02Sp03Sp04Sp05

Yuriy Reznik, Qualcomm, presented14716 Yuriy A. Reznik, Ravi

ChivukulaListening test results for speech-audio coding explorations

This presented test results for 16kb/s rates for stereo. Dong Soo, Kim, LGE, presented14737 Dong Soo Kim, Hyun-Kook Lee, Henney

Oh, Yang-Won JungListening Test results on Speech and Audio Exploration

This presented test results for 20 and 24 kb/s for both mono and stereo.Schuyler Quackenbush, Audio Research Labs, presented14599 Schuyler Quackenbush Pooled Results of Speech and Audio Listening Tests.This contribution pooled all the listening test data into a single pivot table. It presented results by

Test site for each rate and mode (mono or stereo), pooled over all test items and listeners. System under test, pooled over all sites, all test items and all listeners. System under test for each test item, pooled over all sites and all listeners

DiscussionThe following table summarizes the various bitrates and modes tested by the several test sites.

Test SiteBitrate

(kb/s)Mode (Mono/Stereo)

ETRI 16 M117













Kwangwoon 16 METRI 16 SKwangwoon 16 Sorange 16 SQCOM 16 SSAIT 16 SLGE 20 MUOS 20 MYonsei 20 MLGE 20 Sorange 20 SSAIT 20 SUOS 20 SYonsei 20 SLGE 24 MLGE 24 Sorange 24 SSAIT 24 S

The Chair will continue to revise the pooled data spreadsheet and bring it to the group for approval as part of an output document.Kristofer Kjörling, Coding Technologies, presented14701 Kristofer Kjörling, Heiko

PurnhagenProposed additional test-items for the speech and audio exploration.

This contribution purposes additional test items, as shown here:Item name Contents Length Sampling

rateMono/stereo

Music_1 Heavy metal drums and guitars 19.5 sec

48kHz Stereo

Music_2 Classical music, orchestra 13.0 sec

48kHz Stereo

Music_3 Wide stereo pop-recording, instrumental

16.3 sec

48kHz Stereo

Music_4 Wide stereo pop-recording, with vocals

22.2 sec

48kHz Stereo

Music_5 Wide stereo rock recording, guitar and vocals

24.7 sec

48kHz Stereo

speechOverMusic_1 Sports commentator 12.6 sec

48kHz Stereo

speechOverMusic_2 Female speech with background orchestra

11 sec 48kHz Stereo

speechOverMusic_3 Radio announcement 20.3 sec

48kHz Stereo

speechOverMusic_4 Radio commercial, children 17.0 sec

48kHz Stereo

speechOverMusic_5 Radio jingle 19.5 sec

48kHz Stereo

These items were intended to strengthen the speech over music items. Furthermore, the stereo items are felt to be superior to the current Framework items. The Chair noted that, with this contribution, there is a total of 38 item in the proposed test set.

118





It was noted that we could have different items for stereo and mono. The Chair proposed a listening breakout to take a first step toward selecting a test set.Eunmi Oh, Samsung, presented14731 Eunmi Oh, JungHoe Kim, KiHyun Choo, Hosang

Sung, Miyoung KimResponse to CfI on speech and audio coding

This presented performance of New Technology that performs joint speech and audio coding. It noted that the selected state of the art codecs do not perform well for certain items, and proposed that these might be selected as critical items. Anisse Taleb, Ericsson, noted that another means to identify critical items is to select the ones for which the performance of the two state of the art codecs are very different. The contribution noted that there is a need for efficient, low-rate coding in mobile applications. Furthermore, in this application area, signals can have mixed content (e.g. speech, music and speech plus music). Traditionally, there are two distinct coding schemes: perceptually-based coding using frequency-domain noise shaping, and source-model-based coding using short- and long-term linear predictive models. The contribution proposed using a Modulated Lapped Transform having a flexible time/frequency resolution that can be responsive to the instantaneous signal statistics. It was noted that the proposed technology could be viewed as a superset of the classic AAC architecture. The complexity and delay of the New Technology is comparable to that of the state of the art codecs. Eunmi Oh noted that the current Framework document does not indicate low delay as an objective. Numerous experts noted that there is listening test results were presented only for stereo signals. There was interest in seeing performance for mono signals as well. Anisse Taleb, Ericsson, noted that the performance of the core coding engine would be best revealed using mono signals.The listening test data for 16, 20 and 24 kb/s stereo showed that the New Technology was better than or not different than the performance of the Virtual Codec. DiscussionYuriy Reznik, Qualcomm, noted that the good performance at 16 kb/s was very encouraging. Other experts also indicated that the technology was very interesting.The Chair put to the group that the contribution prompts the Audio Subgroup to consider what the next steps should be in this exploration effort.Kristofer Kjörling, Coding Technologies, requested that the group be able to evaluate the Samsung technology during the AhG period. Bernhard Grill, FhG, further requested that mono performance be made available. The Chair noted that next steps could be

Selection of test set for use with a Call for Technology Further investigation of Samsung New Technology, e.g. with mono signals Consensus on Requirements for a Call for Technology

Ericsson indicated that it is willing to cross-check 16, 20 and 24 kb/s stereo NT performance. Qualcomm is also willing to participate in such a cross-check.Samsung is willing to make these available during the week. Samsung will consider making additional material available, and will respond on Thursday morning.

19.4.3. SAOC

Regis Faria, LSI-TEC, presented14753 Regis

FariaNew reference architecture for wide spatial audio object coding and spatial sound frameworks

This presented a much broader architecture for sound scene rendering. The Chair noted that MPEG creates specification at points of interoperability. The Chair encouraged the presenter to continue discussions with interested experts.SAOC RM0 Complexity

119







Juergen Herre, FhG, presented additional information on the complexity of the CT, FhG, Philips SAOC proposal. This is summarized in the following table. Note that, in all cases, the proposal is below the complexity benchmarks indicated in the SAOC Evaluation document.

PCU PCU PCU Max. % Act. %Test case SAOC Max. MPS (of MPS) (of MPS)

a) (stereo to 5.1) 5,70 7,5 25 30 22,80

a) (stream comb.) 0,76 7,5 25 30 3,05

b) (mono to binaural) 3,29 3,6 12 30 27,40

c) (stereo to stereo) 12,82 19,2 12 160 106,86

19.4.4. MPEG-1, MPEG-2, MPEG-4 and MPEG Surround audio, conformance, reference software

Werner Oomen, Philips, presented14685 Frans de Bont, Werner

OomenMPEG-1/2 Layer 1/2 over MPEG-4 conformance bitstreams

This contribution defines conformance streams for Layer I and II. These streams are available now. It is the consensus of the Audio Subgroup to append this text to a Study on ISO/IEC 14496-4:2004/FPDAM 20, SLS Conformance.Heiko Purnhagen, Coding Technologies, presented14694 Andreas Schneider, Heiko Purnhagen, Alex

GroeschelProposed correction to MPEG-4 audio conformance

This contribution makes the conformance text less ambiguous and more in line with the text in the audio specification. It was the consensus of the Audio Subgroup to issue this as a DCOR at this meeting. Kelvin Lee, I2R, presented14673 Kelvin

LeeUpdated status of SLS conformance

This contribution presents a report on progress in SLS conformance. The current status is that 28 bitstream types have been defined and are available. Of these, 24 have been cross-checked. Still to be done is to produce and cross-check 4 types bitstreams for SLS with AAC Scalable core. This conformance effort led to discovery of errors in the reference software, and the associated bugfixes will be incorportated into the ISO/IEC 14496-5:2001/AMD 10:2007/DCOR 1, BSAC and SLS.JungHoe Kim, Samsung, presented14670 Miyoung Kim, JungHoe Kim,

MyungHoon Lee, Jeongil SeoStatus of BSAC Extension Conformance and Reference Software

This contribution reports that all BSAC-related conformance bitstreams have been generated and all except one have been cross-checked. It is expected that this will be cross-checked during this MPEG meeting. Reference Software is available. It was the consensus of the Audio Subgroup to add this to AMD 20, and to add all other maintenance bugfixes, specifically corrections to Parametric Coding for High Quality Audio.Pierfrancesco Bellini;, UNFI, presented14642 Pierfrancesco Bellini;, Paolo Nesi Updated SMR conformance bitstreamsThis contribution reports that the following progress has been made:

All streams converted to MP4 files All XML is encoded with BIM

120















In SMR conformance, 23 bitstreams are defined, 17 available, 0 are cross-checked. The editor is working to engage companies to perform the cross-check.Kristofer Kjörling, Coding Technologies, presented14702 Kristofer Kjörling, Heiko Purnhagen, Jeroen

Koppens, Matthias NeusingerAdditional corrections for the defect report on MPEG Surround.

This proposed two categories of changes:1. Bitstream syntax changes that permit more sensible decoding of 7.1 channel bitstreams by

5.1 channel decoders in the case of residual data. 2. Minor editorial corrections to the MPEG Surround text.

It was the consensus of the Audio Subgroup to incorporate these changes into a DCOR from this meeting.Mauri Vaananen, Nokia, presented14718 Mauri Vaananen, Juha Ojanpera, Miikka

VilermoOn the conformance of AAC decoders with LTP tool

This contribution presented a method for reliable conformance testing of decoders using the LTP tool. Since the proposed change may affect fielded encoders and decoders, a study was done:

Old encoders New decoders k=15 conformance is achievable, at worst with reset every 80 frames

New encoders Old decoders k=15 conformance is achievable, at worst with reset every 60 frames

New encoders New decoders k=16 conformance is achievable in every case

The proposed change is to remove the 16-bit rounding in LTP feedback loop. Give guidance to encoders for how to control noise in fixed-point implementations.

It is consensus of the Audio Subgroup to put his change into a Study on DST and MP3on4 and LTP.Old BusinessRalph Sperschneider noted

That N7694 is an outstanding proposed DCOR on conformance, and the Audio Subgroup agreed that this is to be incorporated into the same DCOR.

That, similarly, N7691, is an outstanding proposed DCOR, but to 14496-3. On review was judged to be without merit and will not be pursued.

That AMD 13, Parametric coding for high quality audio, is missing some conformance test sequences. The Audio Subgroup agreed to issue a DCOR to correct this.

That additional text be added to Study on 14496-3/DCOR 5, DST and MP3on4 to correct advice concerning conversion from mp3on4 format to “classic” mp3 format bitstreams (i.e. using “variable rate” mode to directly decode MP4 access units).

20. Meeting deliverables20.1. Recommendations for final plenaryThe Audio recommendations were presented and approved.

20.2. Establishment of Ad-hoc GroupsThe following ad-hoc groups were established by the Audio subgroup:

No. Title Mtg9256 AHG on Audio Standards Maintenance No9257 AHG on AAC-ELD, Speech and Audio Exploration and SAOC Yes

121











20.3. Approval of output documentsAll output documents, shown in Annex D, were presented in Audio plenary and were approved.

20.4. Responses to Liaison and NB commentsThe responses to Liaison and NB comments were prepared and approved.

20.5. Press statementThere was no Audio part of the press statement.

21. Future activities21.1. Schedule of future meetingsAd Hoc group meetings are indicated in Section 20.2. Unless otherwise indicated, Ad Hoc group meetings will be held at the location of the next MPEG meeting on the weekend preceding that meeting.

21.2. Agenda for next meetingThe agenda for the next MPEG meeting is shown in Annex E.

21.3. All other businessThere was none.

21.4. Closing of the meeting The 81st Audio Subgroup meeting was adjourned Friday at 13:45, with the Chairs “MPEG Headache” intact

122

Annex A Participants

First Name Last NameCountry Affiliation

Taejin Lee KR ETRIPierfrancesco Bellini Italy DSI-UNIFITi Eu Chan SG I2RKok Seng Chong SG Panasonic

Jwalant Desai IndiaWipro Technologies

Regis Faria BR LSI-TECRalf Geiger DE Fraunhofer IISBernhard Grill DE Fraunhofer IISOliver Hellmuth DE Fraunhofer IISJürgen Herre DE Fraunhofer IISHaibin Huang SG I2RYang-Won Jung KR LG ElectronicsDong Soo Kim KR LG ElectronicsJunghoe Kim KR Samsung AIT

Kristofer Kjörling SCoding Technologies

Kelvin Lee SG I2RTilman Liebchen DE LG ElectronicsTakehiro Moriya JP NTTMarkus Multrus DE Fraunhofer IISSua Hong Neo SG PanasonicPaolo Nesi I UNIFI DSIToshiyuki Nomura JP NECTakeshi Norimatsu JP PanasonicEunmi Oh KR SamsungHenney Oh KR LG Electronics

Werner Oomen NLPhilips Applied Technologies

Heiko Purnhagen SECoding Technologies

Schuyler Quackenbush USA ARLYuriy Reznik USA Qualcomm

Andreas Schneider DECoding Technologies

Markus Schnell DE Fraunhofer IISJeongil Seo KR ETRIOsamu Shimada JP NECRalph Sperschneider DE Fraunhofer IISAnisse Taleb SE Ericsson AB

Lijing u CNHuawei Technologies

Mauri Vaananen FINNokia Res. Center

David Virette FR France Telecom

R&D

124

Annex B Audio Contributions and Schedule

Sunday Paris X1300-1800 AhG on SAOC14595 Inseon Jang, Jeongil Seo,

Seungkwon Beack, Kyeongok Kang


X

14669 Oliver Hellmuth, Juergen Herre, Leonid Terentiev


X

14684 Jeroen Koppens, Werner Oomen


X

14703 Jonas Engdegård, Heiko Purnhagen


X

14734 Henney Oh, Yang-Won Jung, DongSoo Kim, HyunKook Lee


X

14598 Schuyler Quackenbush Report on Spacial Audio Object Coding CfP Subjective Listening Test

X

14733 Yang-Won Jung, Henney Oh, Hyo Jin Kim


X

14696 Jonas Engdegård, Lars Villemoes, Heiko Purnhagen, Oliver Hellmuth, Andreas Hölzer, Karsten Linzmeier, Jeroen Breebaart


X

14735 Henney Oh, Yang-Won Jung, Hyo Jin Kim


X

14656 Osamu Shimada, Toshiyuki Nomura, Akihiko Sugiyama, Osamu Hoshuyama

A proposal for an additional SAOC functionality of separating real-environment signals

X

Monday0900-1200 MPEG Plenary London1200-1300 Lunch1300-1400 Audio Plenary Coire

WelcomeApproval of previous meeting report

14597 Schuyler Quackenbush 80th MPEG Audio Report XAhG Reports

14569 R. Sperschneider AHG on Audio Standards Maintenance

X

14570 S. Quackenbush Eunmi Oh AHG on SAOC CfP, AAC- X

mailto:??

mailto:??






mailto:

mailto:

mailto:




















ELD and Speech and Audio ExplorationLiaisonOutgoing Liaison statements

To IEC TC100 re: work in MPEG and AES on specifications for the signaling / carriage of MPEG Surround side information over PCM channels

To ITU-T re speech and audio

1330-1800 AAC-ELD14688 Jeroen Koppens, Werner

OomenPhilips cross-check results of subjective quality of AAC-ELD

X

14709 Fredrik Henn, Per Ekstrand, Arijit Biswas

Coding Technologies cross-check of AAC-ELD subjective audio quality

X

14723 Markus Schmidt , Markus Schnell , Ralf Geiger

Listening test results for AAC-ELD

X

14725 Ralf Geiger , Jürgen Herre On the sensitivity of T-Tests for MUSHRA Scores

X

14755 Yuriy Reznik Brief comment on complexity of MDCT

X

14727 Ralf Geiger , Stephan Schreiner , Virgilio Bacigalupo , Markus Lohwasser , Tobias Albert

On the Complexity of Block Switching

X

14724 Markus Schnell , Fredrik Henn

Proposed Changes for AAC-ELD

X

14726 Ralf Geiger , Markus Schnell , Jürgen Herre , Manfred Lutzky , Kristofer Kjörling

Proposed Annex for AAC-ELD: Delayless Mixing

X

14720 David Virette, Pierrick Philippe

Additional information for AAC-ELD instantaneous block switching CE

X

14671 Miyoung Kim, Eunmi Oh Crosscheck of FT Core Experiment on AAC-ELD

X

14705 FrNB Preliminary comments on ISO/IEC 14496-3:2005/FPDAM9

X

Tuesday0900-1300 Speech and Audio14633 Taejin Lee, Minje Kim,

Jeongil Seo, Kyeongok Kang, Youngcheol Park, Hochong Park , Kim Rin Chul


X

14668 JungHoe Kim, Miyoung Listening test results for X

126

































Kim, Eunmi Oh Exploration of Speech and Audio Coding

14704 David Virette, Pierrick Philippe

Listening test results for Speech and Audio Coding exploration

X

14716 Yuriy A. Reznik, Ravi Chivukula

Listening test results for speech-audio coding explorations

X

14737 Dong Soo Kim, Hyun-Kook Lee, Henney Oh, Yang-Won Jung

Listening Test results on Speech and Audio Exploration

X

14599 Schuyler Quackenbush Pooled Results of Speech and Audio Listening Tests.

X

14701 Kristofer Kjörling, Heiko Purnhagen

Proposed additional test-items for the speech and audio exploration.

X

14731 Eunmi Oh, JungHoe Kim, KiHyun Choo, Hosang Sung, Miyoung Kim

Response to CfI on speech and audio coding

X

1300-1400 Lunch1400-1600 MPEG-4 and MPS14670 Miyoung Kim, JungHoe

Kim, MyungHoon Lee, Jeongil Seo

Status of BSAC Extension Conformance and Reference Software

X

14673 Kelvin Lee Updated status of SLS conformance

X

14685 Frans de Bont, Werner Oomen

MPEG-1/2 Layer 1/2 over MPEG-4 conformance bitstreams

X

14694 Andreas Schneider, Heiko Purnhagen, Alex Groeschel

Proposed correction to MPEG-4 audio conformance

X

14718 Mauri Vaananen, Juha Ojanpera, Miikka Vilermo

On the conformance of AAC decoders with LTP tool

X

14642 Pierfrancesco Bellini;, Paolo Nesi

Updated SMR conformance bitstreams

X

14702 Kristofer Kjörling, Heiko Purnhagen, Jeroen Koppens, Matthias Neusinger

Additional corrections for the defect report on MPEG Surround.

X


X


X

1800-1830 Liaison Liaison statement to IEC TC100, ITU-T

127









































1930- Social Bus 2 to Ouchy, 500M east along lake. Meet at fountain.

Wednesday0900-1100 MPEG Plenary London1100-1200 Joint meeting: Audio, ISG Complexity of AAC-ELD

CE on block switchingX

1200-1300 Joint meeting: Audio, Req Requirements for Speech and Audio coding

X

14646 Kazuya Takeda SLPA (Selective Listening Point Audio) for FTV Audio

X

1300-1400 Lunch1400 AAC-ELD Breakout reportContinued discussion X

1500- SAOC14753 Regis Faria New reference architecture for

wide spatial audio object coding and spatial sound frameworks

X

1600- Review and add to N8944, “Preliminary Requirements for FTV.”

X

Thursday0900-1000 Review of Req FTVPreliminary resolutions X0900-1000 Breakout:Speech and Audio listeningDraft output documents

1300-1400 Lunch1400-1430 Joint meeting: Audio, ISG RVC and CAL tutorialDemonstration of ISG complexity assessment tool.

X

1500-

1800- Chairs meeting

Friday Audio plenary0900-1300 Recommendations for final

plenaryX

Establishment of new Ad-hoc groups

X

AhG Mandates XGet document numbers X

1000 Approve Responses to NB comments

X

1030 Approval of output documents

X

128











Review of Audio presentation to MPEG plenary

X

Agenda for next meeting XA.O.B. XClosing of the Audio meeting

X

1300-1400 Lunch1400- MPEG Plenary London

129

Annex C Task Groups

1. MPEG-D SAOC2. Speech and Audio3. MPEG-4 AAC-ELD4. MPEG-4 audio, conformance, reference software5. MPEG-D MPS

130

Annex D Output DocumentsNo. Title TBP Available

14496-3 Audio9235 ISO/IEC 14496-3:2006/AMD2:2006/Dcor 3, ALS No 07/07/069236 Study on ISO/IEC 14496-3/DCOR 5, DST and MP3on4 and LTP No 07/07/069237 Technology under consideration for AAC-ELD No 07/07/069238 Workplan for AAC-ELD No 07/07/069239 WD on ISO/IEC 14496-3, MPEG-4 Audio Fourth Edition No 07/07/06

14496-4 Conformance testing9240 DoC on 14496-4:2004/PDAM 29, SMR Conformance No 07/07/069241 ISO/IEC 14496-4:2004/FPDAM 29, SMR Conformance Yes 07/07/06

9242 ISO/IEC 14496-4:2004/AMD13:2007/DCOR 1, LD AAC test sequences

No 07/07/06

9243 ISO/IEC 14496-4:2004/DCOR 5, Audio Corrections No 07/07/06


No 07/07/06

9245 Status of SLS conformance No 07/07/069246 Status of BSAC Extension Conformance and Reference Software No 07/07/06

14496-5 Reference Software

9247 Study on ISO/IEC 14496-5:2001/AMD 10:2007/DCOR 1, BSAC and SLS, ALS Corrections

No 07/07/20


No 07/07/06

23003-1 MPEG Surround9249 ISO/IEC 23003-1:2007/DCOR 1 No 07/07/069250 Report on Spatial Audio Object Coding CfP Selection No 07/07/279251 First thoughts on SAOC Verification Test No 07/07/06

Exploration – Audio and speech coding9252 Report on Evaluation of Speech and Audio Framework No 07/07/279253 Workplan for Exploration of Speech and Audio Coding No 07/07/069254 Framework for Exploration of Speech and Audio Coding No 07/07/069255 Draft Call for Proposals on Joint Speech and Audio Coding No 07/07/06

131

Annex E Agenda for the 82nd MPEG Audio Meeting

Agenda Item1. Opening of the meeting2. Administrative matters

2.1. Approval of agenda and allocation of contributions2.2. Communications from the Chair2.3. Joint meetings2.4. Review of task groups and mandates2.5. Approval of previous meeting report2.6. Review of AhG reports 2.7. Received national body comments and liaison matters

3. Plenary issues4. Task group activities

4.1. MPEG Maintenance, including MPEG-1, MPEG-2, MPEG-4, SMR and MPEG Surround issues

4.2. AAC-ELD4.3. Spatial Audio Object Coding4.4. Speech and Audio Exploration

5. Discussion of unallocated contributions6. Meeting deliverables

6.1. Recommendations for final plenary6.2. Establishment of new Ad-hoc groups6.3. Approval of output documents6.4. Responses to NB comments6.5. Responses to Liaison statements6.6. Press statement

7. Future activities8. Agenda for next meeting9. A.O.B10. Closing of the meeting

132

Annex K – 3DG report

Source: Marius Preda (INT)

1 Opening of the Meeting

21.5. Approval of the agenda

21.6. Goals for the weekThe goals of this week are:

Review FAMC results and edit the PDAM Review 3DGCM related contributions and edit the WD Review on-going AFX experiments Promote the 3DGC profiles Issue FDAM of Geometry and Shadow reference software Issue FDAM of Geometry and Shadow conformance Issue WD 1.0 of FAMC reference software Issue WD1.0 of FAMC conformance Review Liaisons to MPEG 3DG Review and promote 3DG related demonstrations Investigate future developments of MPEG 3D Graphics

The output documents related to 3D Graphics Compression are:

No. Title TBP Available14496-4 Conformance testing

9258 Study Text of ISO/IEC 14496-4:2004/ FPDAM21 (Geometry and Shadow Conformance)

No 07/07/06

9259 Request for Amendment of ISO/IEC 14496-4:2004 (FAMC Conformance)

No 07/07/06

9260 WD 1.0 of ISO/IEC 14496-4:2004 AMD32 (FAMC Conformance) No 07/07/06

9261 Request for Amendment of ISO/IEC 14496-4:2004 (MultiResolution Profile Conformance)

No 07/07/06

9262 WD 1.0 of ISO/IEC 14496-4:2004 AMD33 (MultiResolution Profile Conformance)

No 07/07/06



No 07/07/06

9264 Request for amendment of ISO/IEC 14496-5:2001 (FAMC RefSoft) No 07/07/069265 WD1.0 of ISO/IEC 14496-5:2001 AMD21 (FAMC RefSoft) No 07/07/06

No. Title TBP Available14496-16 Animation Framework eXtension (AFX)

9266 Text of ISO/IEC 14496-16:2006/PDAM2 (Frame-based Animated No 07/08/06

133

Mesh Compression)


No 07/07/06

9268 3D Graphics Core Experiments Description No 07/07/069269 3D Graphics Compression FAQ 20.0 Yes 07/07/13

No. Title TBP Available14496-25 3D Graphics Compression Model

9270 WD 2.0 of ISO/IEC 14496-25 Yes 07/07/20

21.7. Standards from 3DG

Std Pt Edit. Project Description CfP WD CDPDAMDCOR

FCDFPDAM

FDISFDAMCOR

4 4 2004 Amd.21 Geometry and Shadow conformance

06/07 06/10 07/04 07/10

4 5 2001 Amd.13 Geometry and Shadow reference software

06/07 06/10 07/04 07/10

4 16 2006 Amd.2 Frame-based Animated Mesh Compression

07/01 07/07 07/10 08/04

4 16 2006 Amd.3 Multi-resolution Profile

07/01 07/07 07/10 08/04

4 25 200x 3D Graphics Compression Model

07/10 08/01 08/07

4 4 2004 Amd.32 FAMC conformance 07/07 07/10 08/04 08/104 5 2001 Amd.21 FAMC reference

software07/07 07/10 08/04 08/10

4 4 2004 Amd.33 Multi-resolution Profile conformance

07/07 07/10 08/04 08/10

21.8. Room allocation3DG : Berne

21.9. Allocation of contributions

N° Title Schedule ActivityD1 Monday D1

MPEG Plenary D1 09:00~11:30

MPEG General

3DG Plenary D1 11:30~13:00 3DG General

Roll call, Agenda, Goals, FAQ, Marius Preda

134

N° Title Schedule Activityetc., Clarify the status on www.mpeg-3dgc.org maintenance

14572Report of AHG on 3DGC documents, experiments and software maintenance

Jeong-Hwan AhnNing Lu

Lunch Break D1 13:00~14:00

Reference Software D1 14:00~14:15

Clarify the status on release version of the RefSoft all

3DGCM D1 14:15~15:30

14710 Compression performances of MPEG-4 3D Graphics for large databases


14712 MPEG-4 3D graphics tools for third party scene representation

Marius Preda Blagica Jovanova Françoise Preteux

Coffee Break 15:30~16:00

3DGCM D1 16:00~16:30

14711 Support for an RF profile for MPEG-4 3D graphics by COLLADA

Marius Preda Remi Arnaud Francoise Preteux

NB Comments D1 16:30~17:00

14742 French National Body French NB comment on AFX profiling FrNB

D2 Tuesday D2

Core Experiments D2 09:00~10:30 CE1

14652 FAMC’s layer-based scalable extension


14654 FAMC with progressive Khaled Mamou

135

N° Title Schedule Activity

transmission and scalable rendering functionalities

Titus ZahariaFrançoise PrêteuxNikolce StefanoskiJörn Ostermann

14653FAMC: bitstream description for the layer-based scalable extension


Coffee Break 10:30~11:00

Core Experiments D2 11:00~11:30 CE2

14746Report on CE2: Space Partitioning Implementation in IM1

Patrick GioiaAnne Le BrisRomain Cavagna

CE2

Profiles D2 11:30~11:45

Multi-Resolution Profile AMD 3


Liaison D2 16:00~17:00

Liaison Statements LiaisonD3 Wednesday D3

MPEG Plenary D3 09:00~12:00

MPEG General

3DG Plenary D3 12:00~13:00

3DG General

14697

Proposed Modifications to Residual Coding Part of Frame-based Animated Mesh Compression

Heiner Kirchhoffer Detlev Marpe Khaled Mamou

Karsten Müller Thomas Wiegand


136

N° Title Schedule Activity

FAMC PDAM 3 Editing all D3 14:30~18:00

D4 Thursday D4

3DGCM Editing D3 09:00~12:00


Review of 3DG documents D4 14:00~18:00 3DG General

ISO/IEC 14496-16 AMD 3Multi-Resolution Profile all

Core Experiment CE 1 ReviewCE 2 Review

all

ISO/IEC 14496-16 AMD 2 FAMC allISO/IEC 14496-25 all

D5 Friday D53DG output documents preparation

D4 09:00~12:00 3DG General

AhGs and resolutions all


MPEG Plenary D5 14:00~ MPEG General

21.10. Attendance list

Name Country CompanyJeong-Hwan Ahn Korea Samsung AITMarius Preda France INTFrançoise Prêteux France INTKhaled Mamou France INTPatrick Gioia France France Telecom

R&DEuee S. Jang Korea Hanyang Univ.Byoungjun Kim Korea Hanyang Univ.Francisco Moran Burgos

Spain UPM

Frederic Vexo Swiss EPFLJaeBum Jun Korea Hanyang Univ.SinWook Lee Korea Hanyang Univ.Karsten Muller Germany FHG-HHINing Lu US Intel

CorporationPatrick Klie Germany Leibniz

137

Universtat Hannover

Detlev Marpe Germany FHG-HHI

138

22. General issues

22.1. General Discussion

22.1.1. ExperimentsLast meetings resolutionFor each new specification development activity, 5 National Bodies should commit resources to that activity. Contributions should be made at each meeting from those NBs until that activity is finalized.3DGC will no longer have Exploration Experiments.3DGC will only have Core Experiments for any official experiments.The condition for the CE is to have at least 2 active participants (companies or universities having support from companies on that experiment) dedicating resources to do the work and making contributions at each meeting.If a participant does not make any contribution at a meeting, then that participant will not be considered as active.The activity in the CE does not necessarily imply adoption into the standard.

Clarify the status on www.mpeg-3dgc.org maintenance All

Samsung can maintain the web site up to end of 2007 only. Potential solutions: FT and UPM. Patrick Gioia will be the maintainer of the new web site (once transferred). FT will investigate on transferring the web site and on finding open source solutions for data protection.

14572 Report of AHG on 3DGC documents, experiments and software maintenance

Jeong-Hwan AhnNing Lu

The crosschecking was successful. New files were added in the zip file.

14710 Compression performances of MPEG-4 3D Graphics for large databases


An analysis of different binarisation tools for 3D graphics scene representation based on XML was provided as a result on an experiment performed on 1700 3D objects (database available for further experiments). The compression results of 3DMC were presented against different binarisation scheme.

Resolution- Refer 3DMCe as the compression tool for 3D mesh objects in Part 25.- Encourage contributions referring to other 3D mesh compression tools and analyzing their results on the proposed database.

14712 MPEG-4 3D graphics tools for third Marius Preda

139

party scene representation

Blagica Jovanova Françoise Preteux

An analysis of the MPEG-4 3D graphics tools that may be applicable to X3D and COLLADA was presented. Plug-in scheme are proposed for 3DMC and BBA to X3D and COLLADA content.

Resolution- Update the WD for referring to the following MPEG-4 ES: 3DMC and BBA.- Encourage contributions on implementation of ICs, FAMC and WSS.

14711 Support for an RF profile for MPEG-4 3D graphics by COLLADA

Marius Preda Remi Arnaud Francoise Preteux

This contribution presents a request on establishing one (or several) RF profiles for 3D Compression tools in Part 25.

Resolution:Consider the problem in 2 steps:- Start by building effective technical profile(s) without considering the royalties issue.- Cut the profiles built at previous step in such a way to ensure a RF status.

Remark: Investigate how MPEG can make awareness on RF profiles.

14742 French National Body French NB comment on AFX profiling FrNB

This contribution recommends initiating the discussion on the possibility to define RF profiles.

Resolution:See previous resolution.

14652 FAMC’s layer-based scalable extension


Note: Presented by Patrick Klie.

The contribution presents the combination between LD and FAMC. The errors obtained by use of the skinning model in FAMC are here predicted based on layer based decomposition. This combination improves the performances of LD technique alone with 38%.

Resolution:

140

Extend the FAMC to include LD in order to ensure full resolution scalability.

14654 FAMC with progressive transmission and scalable rendering functionalities

Khaled MamouTitus ZahariaFrançoise PrêteuxNikolce StefanoskiJörn Ostermann

The contribution presents the scalability functionalities (resolution, quality) for different combinations between FAMC and LD.

Resolution:Support the following three combinations (when design the bitstream syntax):- Skinned based prediction + DCT + LD- Skinned based prediction + LIFT+ LD- Skinned based prediction + LDClose the CE. Continue the implementation in the RefSoft and provide the Conformance bitstreams.

14653 FAMC: bitstream description for the layer-based scalable extension


This contribution presents the updates in the bitstream syntax that consider the integration of LD and FAMC.Resolution:- Investigate on the hierarchical decomposition of I, P, B.- Specify the simplification procedure in a normative Annex.- Specify the bitstream syntax for LD+DCT, LD+LIFT.- Review the entire document Thursday after noon.

14746 Report on CE2: Space Partitioning Implementation in IM1

Patrick GioiaAnne Le BrisRomain Cavagna

CE2

This contribution presents an implementation of the scene partition concepts in IM1.Scene graph partition is semantic data that are attached to different nodes in the scene graph in order to improve the transmission and rendering. For some scheme, the size of the data is big enough that dedicated compression methods may be necessary. Open issues are on the mechanism of attaching this information to the scene graph (a node is proposed) and the need of dedicated compression schema.

141

Resolution:Continue the investigation on the appropriate manner to represent the data with respect to targeted applications.

Multi-Resolution Profile AMD 3

No input contribution. The document is mature and we can proceed with conformance bitstream.

A plan for providing the bitstreams was set up.

14697Proposed Modifications to Residual Coding Part of Frame-based Animated Mesh Compression

Heiner Kirchhoffer Detlev Marpe Khaled Mamou Karsten Müller Thomas Wiegand

The document contains modification of the previous CABAC (normative changes, non-normative changes) as well as in improved method for encoder.Normative:- the DCT predictor is based on a couple (p, f) where p is a offset to an already transmitted coefficient and f is the size of the spectrum used for prediction.- signaling the predictor: if same predictor is used a flag is sent instead

- organize the significance map in blocks and propose the combination between unary code and exp-Golomb codes

Non-normative:- propose an encoder implementation that reduce the size of data to be transmitted (the encoder becomes more complex) by introducing a new cost function.

- overall improvement by CABAC 7%- overall improvement of the proposed encoder 9,9%- impact by CABAC wrt to coordinates residual is 11%-16%

Complexity issues: reduce the complexity twice with respect to the previous version of the arithmetic encoder. The optimized encoder software is made available by the contributors in the case that reference software for encoder will be provided with FAMC.

Resolution:Add the proposed modifications in the current FAMC.

FAMC PDAM 3 Editing all D3 14:30~18:00A new decoder schema was produced.The text should be carefully reviewed with respect to technical discussions reported above (editing period of 4 weeks)

3DGCM Editing D3 09:00~12:00

142

The 3DGC elementary streams were introduced in the document and the manner how to plug them to XMT, COLLADA and X3D was specified.The text should be carefully reviewed with respect to technical discussions reported above (editing period of 2 weeks)

23. AFX (14496-16) activities

23.1. Core Experiments

23.1.1. CE1. Mesh Animation CompressionLast meeting resolutionIn the next phase of the CE it will be investigated how the skinning model will be combined with the scalable approach. A switch may be used to choose between DCT, Wavelet compression of the errors and the scalable approach.Issue a new version of the working draft with the currently proposed technology (including streaming and CABAC).

23.1.1.1. Related contributions

Contributions m14652, m14654, m14653 address the issues of combining skinned based ptrediction and layer decomposition.

Contribution m14697 addresses the issue of CABAC integration.

Resolution for CE1Update the text of the bitstream description to integrate the above contributions.Close the CE.Initiate the activity on the Reference Software and Conformance.

23.1.2. CE2. Space PartitioningLast meeting resolutionPerform exploratory stage with the proposed work plan. (details can be found in the CE description)

23.1.2.1. Related Contributions

m14746 presents the results of implementation of different scene partition mechanisms in IM1.

Resolution for CE2Investigation of how attaching the semantic information to the scene graph (a node was initially proposed) and the need of dedicated compression schema.

23.2. Profiles

143

23.2.1. Proposal for 3D MultiResolution ProfileThe document is mature.

ResolutionPromote the document in PDAMRequest a new AMD for Conformance bistreams of this profile.

23.3. Promotions

none

24. GFX (14496-21) activities

24.1. Reference Software & Conformance

No activity on this issue.

25. 3D Graphics Compression Model (14496-25) activities

A selection of 3DGC elementary streams that may be applicable to other representation scheme was provided.The manner how to plug 3DMC and BBA was indicated for XMT, COLLADA and X3D.See also the comments on related contributions.

ResolutionAccept the list of streams.Accept the coupling mechanism of 3DGC and BBAUpdate the current WD.

26. Resolutions of 3DG

26.1. Output documents

26.1.1. The 3DG subgroup recommends to approve the following documents

No. Title TBP Available Editor14496-4 Conformance testing

9258Study Text of ISO/IEC 14496-4:2004/ FPDAM21 (Geometry and Shadow Conformance)

No 07/07/06 Jeong-Hwan Ahn

9259 Request for Amendment of ISO/IEC 14496-4:2004 No 07/07/06 Marius

144

(FAMC Conformance) Preda

9260 WD 1.0 of ISO/IEC 14496-4:2004 AMD32 (FAMC Conformance)

No 07/07/06 Khaled Mamou

9261 Request for Amendment of ISO/IEC 14496-4:2004 (MultiResolution Profile Conformance)

No 07/07/06 Marius Preda

9262 WD 1.0 of ISO/IEC 14496-4:2004 AMD33 (MultiResolution Profile Conformance)

No 07/07/06 Patrick Gioia




9264 Request for amendment of ISO/IEC 14496-5:2001 (FAMC RefSoft)

No 07/07/06 Marius Preda

9265 WD1.0 of ISO/IEC 14496-5:2001 AMD21 (FAMC RefSoft)

No 07/07/06 Khaled Mammou

No. Title TBP Available14496-16 Animation Framework eXtension (AFX)

9266

Text of ISO/IEC 14496-16:2006/PDAM2 (Frame-based Animated Mesh Compression)

No 07/08/06 Marius Preda, Titus Zaharia



9268 3D Graphics Core Experiments Description No 07/07/06 Patrick Gioia

92693D Graphics Compression FAQ 20.0 Yes 07/07/13 Ning Lu,

Patrick Klie

No. Title TBP Available14496-25 3D Graphics Compression Model

9270 WD 2.0 of ISO/IEC 14496-25 Yes 07/07/20 Marius Preda

26.2. Resolutions The 3DGC subgroup recommends nominating Khaled Mamou (INT) as project editor of

ISO/IEC 14496-4/Amd 32 (FAMC conformance). The 3DGC subgroup recommends nominating Patrick Gioia (FT) as project editor of

ISO/IEC 14496-4/Amd 33 (MultiResolution Profile conformance). The 3DGC subgroup recommends nominating Khaled Mamou (INT) as project editor of

ISO/IEC 14496-5/Amd 21 (FAMC RefSoft). The 3DGC subgroup recommends nominating Mark Callow (HI Corporation) as project

editor of ISO/IEC 14496-21:2006/Cor.1.

26.3. Establishment of 3DG Ad-Hoc Groups

N9143 AHG on 3DG documents, experiments and software maintenance

Mandate: 1. Maintain and edit 3DG documents2. Coordinate 3DG CE activity3. Coordinate 3DG related conformance and reference software

145

Chairmen: Jeong-Hwan Ahn (Samsung AIT),Ning Lu (Intel Corporation)

Duration: Until 82nd Meeting Meetings Sunday before 82nd meetingReflector: mpeg-3dgc AT gti. ssr. upm. EsSubscribe: http://www.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc

27. Closing of the MeetingSee you in Shenzhen.

146

http://www.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc

Annex L – Test report

Source: Tobias Oelbaum

Opening of the Meeting

Goals for the weekThe goals of this week are:

Finalize the verification test plan for SVC

Test Activities

Scalable Video Coding - Verification TestsThe SVC Verification Test Plan has been finalized. The test plan includes the description of the AVC anchors that will be generated, the coding conditions for anchor and SVC encoding, a description of the subjective tests that will be conducted and the respective timeline. A first part of the tests will be conducted beginning of October while a second part of the tests will be conducted in December. The reason for splitting the test into two parts is the high amount of encoding time that is needed for the HD test cases. The only coding technology that will be used as anchor is AVC. AVC anchors will be generated using the same version of the JSVM reference software that is also used to generate the SVC bitstreams. AVC anchor bitstreams will be generated according to three different simulcast settings that will show the gain that can be reached with SVC.Results of the verification test will be available at the 82nd and 83rd MPEG meeting.

Test SequencesNew HD test sequences were presented in document m14764 (late contribution). These test sequences were especially designed to contain many colours and colours at the extremes of the colour space to be used for colour-sensitive evaluation. Those sequences were produced by DECSDP (Digital Eizou Common Specification Development Project) and will be available for use inside MPEG.

Test Resolutions

Output Documents 9189 SVC Verification Test Plan Version 1.0

AdHoc GroupsThe following AHG was set up:

N8993 AHG on SVC Verification Test

147

Mandate:1. To discuss test setups based on applications scenarios of the SVC

profiles2. To refine the verification test document3. To prepare the verification test

Chairman: Tobias Oelbaum (TU München, [email protected])Mathias Wien (RWTH Aachen, [email protected])Associate Chairs:Vincent BottreauNathalie CammasAlex EleftheriadisJustin Ridge

Duration: Until 82nd Meeting Meetings Yes (Sunday before the 82nd Meeting)Reflector: [email protected]: To subscribe or unsubscribe, go to

http://mailman.rwth-aachen.de/mailman/listinfo/mpeg-svt

148

Annex M – ISG report

Source: Marco Mattavelli (EPFL)

1 OverviewThe main work items of the Implementation Studies Subgroup in Lausanne are:

1. The contributions to the Reconfigurable Video Coding (RVC) activity jointly with the video group for contribution review, review of results for the on going core experiments, editing of the RVC WD documents and work-plan, dissemination of the RVC technology to the audio group.

2. MPEG-4 Part 9 Reference HW description:

The editing of the Study of the Third Edition of the TR

Input contributions to ISG group w.r.t. the above items are summarized according to the following table:

Input Contributions to ISG subgroup jointly revised with the video group

Number

Category Title

14592 General/Reqs Royalty Cost Optimization with Reconfigurable Video Coding

14629MPEG-C Functional units of AVC inter

prediction for RVC video tool library

14630MPEG-C A CAL-based conformance

testing environment for RVC video tool library

14632 MPEG-C Proposed text of the RVC FUs for MPEG-4 AVC and MPEG-2

14650 MPEG-B PREESM in the RVC framework

14655MPEG-C From AVC to SVC: minor and

major modifications in a RVC decoder implementation

14657 MPEG-B Result of RVC CE 1.1

14658MPEG-B CDDL-Based decoder

description for constructing ADM and syntax parsing

14686 General SMPTE liaison to JTC1/SC29/WG11 on RVC

14721 MPEG-C ISO/IEC 23002-2 in RVC Implementation

14722MPEG-C ISO/IEC 23002-1 IDCT

Implementation in CAL Testbed Update

149

14739 MPEG-C Simulator in the Eclipse environment for RVC

14747 MPEG-B Report on CE on RMC Bitstream Syntax Description

14756MPEG-C RVC Exploration Experiments

Report on new 8x8 Inverse Transform and Quantization Tools

Detailed Report

27.1. The contribution to the activity on Reconfigurable Video Coding (RVC).

Most of the ISG time in Lausanne has been spent in joint meetings with Video for the RVC subgroup work. The main issues of discussion were the evaluation of the results of the on-going core experiments concerning the evolution and progress of the technology currently described in the WD. Major results reported are:

The update of the limitations and bugs of the implementation of the MPEG-4 SP in terms of CAL FUs.

The list of all implementations of FUs in CAL for MPEG-4, MPEG-2 and MPEG-4 AVC. The list of new FUs needed to implement SVC when AVC baseline FUs are available. New results of compression of DDL. No conclusive results were reported about the implementation of the flexible decoder based

for both technologies on the table: o BSDL bitstream descriptions and transformations to CALML and CAL.o DDL parser description and generation of a CDDL parser.

Update of proposed methodologies for the conformance testing of RVC FUs. Updates of the proposals for the efficient partitioning of FU for B-pictures, multiple

reference frames, intra prediction and for SVC. Update of the description of the RVC framework tool support and definition of future tool

support. Studies of new FU for the implementation of SVC. Example of usage of the CAL simulator and editors in the Eclipse environment for the

migration from Moses to a non-integrated component based simulation environment. Studies for the development of a CAL to C code generator.

Discussions were held to solve the problem of the FU naming convention. A final specification has been agreed and has been included in the WD as well as some examples and FAQ. A new section has been added to the WD.Another discussion was held to define an appropriate convention for the structure and naming of the MPEG Tool Repository. The final agreement was to include all FUs together in a unique directory without any partitioning into different categories. Only two categories “data management” and “algorithmic” has been retained. The new RSM will be structured according this decision within 4 weeks from the end of the Lausanne meeting.A long discussion was held about the form to be adopted for the Textual Documentation of FUs. Two hypotheses have been considered. The first is to provide a textual description that corresponds to the actual CAL implementation in the standard MPEG RVC Toolbox. This would have implied that documentation would have been in terms of “actions” activated by input “tokens” and the

150

associated state machine. The second was to provide simple textual description of the algorithm without any detail of the specific “actions” triggered by the I/O tokens. This second option is less precise and does not correspond to the CAL SW of the Toolbox, but results simpler to be provided and is already available for most of the FUs. This second option has been selected by the majority of the group. The decision however was that if precise documentation of “actions” and state machines this could have been included in VTL descriptions. Example will be included in the WD.

A joint meeting with System group was held to discuss the compatibility of the RVC framework with the Multimedia Middleware (M3W). The conclusion of the discussion was that for the moment the “wrapping” of the RVC process by the system layer is not specified in the RVC framework so this process of providing APIs compatible with the M3W specification is left to the implementer.

A tutorial of the current RVC technology has been presented to the audio group. The tutorial was followed by a long session of question and answers showing the interest of the RVC technology also for the audio group.

Concerning the promotion of the current WD to CD the groups decided to postpone the promotion to next October meeting so as to conclude the core experiments on the specification of the flexible parser.

27.2. The progress in the development of the MPEG-4 “Part 9 Reference Hardware Description”

The ISG activity at the Lausanne meeting concerning the Reference HW description has been limited since no new module submissions has been received at the meeting and has mainly been devoted to the editorial work for third edition of the technical report.

28. ResolutionsThe above activities have led to the following resolutions and output document approval.

Resolutions related to MPEG-4

Part 9 Reference Hardware Description

The Implementation Studies Subgroup recommends to approve the following documents

No. Title TBP Available14496-9 Reference Hardware Description

N9187 Study of “ISO/IEC DTR 14496-9 3rd Edition Reference Hardware Description”

N 07/07/06

Resolutions related to MPEG-B

The video and ISG subgroups recommend to approve the following documents

151

No. Title TBP Available23001-4 Codec Configuration Representation

9223 WD 5 of ISO/IEC 23001-4 Codec Configuration Representation N 07/07/13

Resolutions related to MPEG-C

Part 4 Video Tool Library

The video and ISG subgroups recommend to approve the following documents

No. Title TBP Available23002-4 Video Tool Library

9224 WD 5 of ISO/IEC 23002-4 Video Tool Library N 07/07/209225 Description of Core Experiments in RVC N 07/07/069226 RVC Simulation Model (RSM) V5.0 N 07/08/039227 RVC Work Plan N 07/07/069228 RVC Conformance Testing Working Draft 2.0 N 07/07/209229 Description of Exploration Experiments for Toolbox Extensions N 07/07/06

152

Annex N – Liaison

Source: Kate Grant, Chair

The Liaison group received the following input documents and discussed them at their meeting on Tuesday July 3rd

No. TitleLiaison Statements

14573 Liaison Statement from 3GPP TSG SA WG4Specific questions regarding their adoption of a functionally equivalent version of Activate/Deactivate14574 Liaison Statement from 3GPP TSG SA WG4Request to review a number of events and issue of namespace, and comment on alignment of text 14577 Liaison Statement from IEC TC100CDV under ballot for information, transmission protocol for audio-visual data and control commands which provides for the interconnection of digital audio and video equipment, using IEEE 139414586 Liaison Statement from ITU-R SG6 WP/6JAcknowledgment of information sent relating to colour spaces and thanks for action on information provided previously14681 Liaison Statement from SMPTESMPTE: no comments on latest draft of 13818-1:2006 DCOR114683 Liaison Statement from SMPTEComments on N9025 and information on use of URI-labelled metadata in SMPTE documents14686 Liaison Statement from SMPTESMPTE welcome regular participation in the RVC project (having published VC-1 and VC-3), will review work at September meeting14740 Liaison Statement from ITU-T SG9Provide draft J.ftvreq - system model and requirements for FTV video transmission14741 Liaison Statement from DVB (TM FF)DVB have identified the need to store transport streams (in addition to several other features) while defining a file format based on ISO Base Media and asking for guidance on current proposals14751 Liaison Statement from DVD Forum Confirmation that issues with 13818-1:2006 DCOR1 now resolved.14754 Liaison Statement from ITU-T IPTV Focus GroupInvite MPEG to provide text for the inclusion of MPEG 2 Video and MPEG 1 Layer 2 Audio into document under development “Toolbox for Content Coding" 14758 Liaison Statement from 3GPP TSG SA WG4LASeR / DIMS inconsistencies identified in latest DIMS version and MPEG asked toReference rather than copy similar text from DIMS, align definitions and comment on enclosed draft

The Liaison group received the following input documents after the Tuesday meeting:

14758 Liaison Statement Regarding potential changes to RDD to meet new requirements

153

from IFPI 14765 Additional material

from DVB re m14741

Overview of the requirements of metadata storage in the DVB file format and questions relating to the storage of metadata using the provisioning in the ISO base file format

The Liaison group prepared the following output documents:

No. TitleLiaison Statements

9309 Liaison Statement to AESRe: Appointment of new Liaison contact Erik Schuijers (MPEG -> AES) 9310 Liaison Statement to ITU-T re Joint Speech & Audio CodingInformation on N9254 Framework for Speech and Audio Coding and asking for comments9311 Liaison Statement to 3GPP re Joint Speech & Audio CodingInformation on N9254 Framework for Speech and Audio Coding and asking for comments9312 Liaison Statement to 3GPP2Information on N9254 Framework for Speech and Audio Coding and asking for comments9313 Liaison Statement to IEC TC100Request to IEC TC 100 to support the signalling and carriage of MPEG Surround side information over PCM channels via AES3.within its consumer specification IEC60958-3

9314 Liaison Statement to ITU-T IPTV Focus Group re "Toolbox for Content Coding"

Suggested draft text on MPEG-2 Video and MPEG-1 Layer 2 Audio for inclusion in the "Toolbox for Content Coding". 9315 Liaison Statement to SMPTE re RVCProvide update on RVC progress, latest version of workplan and WDs on Codec Configuration Representation and Video Tool Library for consideration at next meeting9316 Liaison Statement to SCTEProvide update on RVC progress, latest version of workplan and WDs on Codec Configuration Representation and Video Tool Library asking for comments9317 Liaison Statement to AVSProvide update on RVC progress, latest version of workplan and WDs on Codec Configuration Representation and Video Tool Library asking for comments9318 Liaison Statement to ITU-T SG9 re FTVUpdate on WG11 work on FTV, and on AHG progressing work on FTV Model and Requirements9319 Liaison Statement to DVBWG11 setting up an email reflector to discuss the MPEG-2 transport and RTP questions and welcome joint approach and the desire for industry harmonization. TuC document enclosed.9320 Liaison Statement to 3GPP TSG SA WG4 re DIMS/LASeRAligning some event descriptions and definitions, provide additional clarifications and attach current text for comment9321 Liaison Statement to OMAWG11 want to maintain the compatibility between RME (based on 3GPP DIMS technology) and ISO/IEC 14496-20 and collaborate actively with OMA to facilitate this.9322 Liaison Statement to ITU-T IPTV Focus Group re Presentation Formats for

IPTVInformation on BIFS and LASeR and some identified requirements for presentation engines. WG11 experts will participate in next meeting. 9324 Liaison Statement to WG1

154

Re: JPXML (and its relationship with MPEG-B BSDL) inviting WG 1 to collaborate. Also information on call for Requirements on the Professional Archival MAF.

Other Documents:9326 Response to National Bodies Responses to the French NB9327 List of Organisations with which MPEG entertains liaisons (as of

July 2007)Updated with latest information

155

1 · Web view9192 Text of ISO/IEC 14496-4:2004/PDAM 31 Conformance Testing for SVC Profiles...

Documents

Transcript of 1 · Web view9192 Text of ISO/IEC 14496-4:2004/PDAM 31 Conformance Testing for SVC Profiles...