INTERNATIONAL ORGANISATION FOR STANDARDISATION · Web viewDesignation FDIS/FDAM Doc Number...

INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION

ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO

ISO/IEC JTC 1/SC 29/WG 11 N4372December 2001

Source: Leonardo Chiariglione – ConvenorTitle: Report of 58th WG 11 meetingStatus:

1 Opening The 58th WG11 meeting was held in Pattaya, TH at the kind invitation of TISI, the Thai Industrial Standards Institute, on 2001/12/03T09:00 – 07T23:35.

2 Roll call of participants Annex 1 gives the attendance list

3 Approval of agenda Annex 2 gives the approved agenda

4 Allocation of contributions Annex 3 gives the list of contributions

5 Communications from Convenor There were no communications

6 Report of previous meeting The Sydney report could not be approved because it had not been completed

7 Processing of NB Position Papers The following NB papers were considered and responses provided

7738 FNB comments for the 58th WG11 meeting

7758 FNB Comments on the FBA Stream Syntax

7679 FNB New Profiles & Levels indication values in IOD

7809 GNB comments for the 58th WG11 meeting

7782 JNB comment on JVT activity

7785 JNB The request of amending the definition of the supporting tool by Core Scalable

1

Profile described in 14496-2 :2001

7766 UKNB Comment on 14496-2:2001

7585 UKNB Comments accompanying the ballot on the IPMP sections of PDAM ISO/IEC 14496-1:2001 / AMD3

7583 UKNB Comments accompanying the ballot on the MPEG-21 IPMP CD

7582 UKNB Comments accompanying the ballot on the MPEG-21 IPMP CD

7607 USNB Contribution: Subdivision 4 of the ISO/IEC 21000

7608 USNB Contribution: Digital Cinema Issues

7609 USNB Contribution: Liaison between ISMA and WG 11

8 MPEG Phase 2

8.1 Requirements 8.2 Amendments 8.3 Corrigenda The following corrigenda wew approvedISO/IEC 13818-1:2000/COR2 (N4404)ISO/IEC 13818-7:1997/DCOR2 (N4381).A document collecting known MPEG-2 Video problemsMPEG-2 Video Implementers Guide List of Problem Reports (N4465) was approved.

8.4 Workplan This was approved.

9 MPEG Phase 4

9.1 Requirements 9.2 Systems 9.2.1 Standard

The following standard was approved

ISO/IEC 14496-1:2001 3rd Edition N4406

9.2.2 Extension 1

9.2.3 Extension 2

9.2.4 Extension 3

9.2.5 Extension 4

The following amendment was approved

ISO/IEC 14496-1:2001/PDAM4 N4415

2

9.2.6 Extension 5


ISO/IEC 14496-1:2001/PDAM5 N4418

9.2.7 Extension 6


ISO/IEC 14496-1:2001/PDAM6 N4420

9.2.8 Corrigenda

The following corrigendum was approved

ISO/IEC 14496-1:2001/DCOR2 N4407

9.3 Visual 9.3.1 Standard

9.3.2 Extension 1

The Results of the MPEG-4 Visual Studio Profile Verification Tests (N4457) was approved.

9.3.3 Extension 2

FGS Verifrication Test results were not available. A new MPEG-4 Visual Fine Granularity Scalability Tools Verification Test Plan (N4456) was approved.

9.3.4 Extension 3


14496-2:2001 PDAM3 (New Levels and tools for MPEG-4 Visual) N4470

9.3.5 Corrigenda

A document collecting known MPEG-4 Video problemsMPEG-4 Video Implementers Guide List of Problem Reports (N4464) was approved.

9.4 Audio 9.4.1 Standard

9.4.2 Extension 1

9.4.3 Extension 2

9.4.4 Corrigenda


ISO/IEC 14496-3:2001/DCor 1:2002 N4386

3

9.5 Conformance Testing 9.5.1 Standard

9.5.2 Amendment 1


ISO/IEC 14496-4:2001/FPDAM1 N4421

9.5.3 Corrigenda


ISO/IEC 14496-4:2001/DCOR1 N4423

9.6 Reference software 9.6.1 Standard

9.6.2 Extension 1

9.6.3 Extension 2


ISO/IEC 14496-5:2001/FPDAM2 N4426

9.6.4 Corrigenda

9.7 DMIF 9.7.1 Standard

9.7.2 Corrigenda

9.8 Optimised software 9.8.1 Technical Report

The following Technical report was approved

ISO/IEC 14496-7 DTR

N4513

9.9 4 on IP Framework 9.9.1 Standard


ISO/IEC 14496-8 FDIS N4427

9.10 Hardware Reference Description

4

9.10.1 Technical Report

9.11 New video compression work The report of the Video Call for New Tools to Further Improve Coding Efficiency (N4454) was approved. The new work started as a joint activity with the ITU-T Video Coding Experts Group (VCEG). A Joint Video Team was established with the terms of refebrence given in N4400. Ajay Luthra was appointed as an associate chair on the JVT.As a result of the discussions with VCEG it was found necessary to update the MPEG software copyright license to accommodate the case when the software is donated without the originator retaining any right.The JVT produced the JVT Coding Joint Working Draft 1, Including JM 1.0 Description as N4466.

9.12 Digital Cinema The Digital Cinema test report was approved and discussions continued. Two “Requests for Industry Contributions” made publishedRequest for Industry Contributions on MPEG Standard for Distribution of Digital Cinema Theatrical Content (N4462)Request for Industry Contributions on MPEG Standard for Archiving of Digital Cinema Theatrical Content (N4463)

9.13 Explorations 9.13.1 Fine Granularity Scalability

Work was suspended until FGS verification tests are completed.

9.13.2 3D Video

A potential new activity was presented by a JEITA delegation and exploration was begun. Preliminary requirements for 3D Video support in MPEG (N559) were produced

9.14 Workplan This was approved.

10 MPEG Phase 7

10.1 Requirements 10.2 Systems 10.2.1 Standard

10.2.2 Version 2

Work continued on version 2 of the standard

10.3 Description Definition Language 10.3.1 Standard

10.4 Visual 10.4.1 Standard

10.4.2 Version 2


10.5 Audio

5

10.5.1 Standard

10.5.2 Version 2


10.6 Description Schemes 10.6.1 Standard

10.6.2 Version 2


10.7 Reference software 10.7.1 Standard


FDIS 15938-6 N4475

10.7.2 Version 2

10.8 Conformance Testing 10.8.1 Standard


CD 15938-7 N4527

10.9 Extraction and use of visual descriptors 10.9.1 Technical Report

10.10 Workplan

11 MPEG phase 21

11.1 Requirements 11.2 Vision, Technologies and Strategy11.3 Digital Item Declaration The following standard was approved

ISO/IEC FCD 21000-2 N4530

11.4 Digital Item Identification and Description The following standard was approved

ISO/IEC CD 21000-3 N4532

11.5 Intellectual Property Management and Protection11.6 Rights Expression Language and Rights Data Dictionary

6

The Call for Proposals for a Rights Expression Language and a Rights Data Dictionary received responses from: Content ID Forum (cIDf) ContentGuard, Inc. DSTC Pty. Ltd. IPR Systems, Nokia, RealNetworks, Inc. LG Electronics MarkAny Inc. and MarkTek Inc. Panasonic Singapore Laboratories Pte. Ltd. Rightscom, on behalf of <indecs> 2rdd Consortium Universitat Pompeu Fabra - Distributed Multimedia Applications GroupWork to develop an MPEG-21 REL and RDD could start.

11.7 Digital Item Usage Environment Description 11.8 Reference software 11.9 Other MPEG-21 parts 11.10 Workplan

12 Overall WG11 workplan This was approved

13 Explorations

13.1 Lossless audio coding This exploration having last for more than a year, it was decided that at the next meeting a decision should be made on whether to close the exploration or promote it to a formal activity.

14 Liaison matters These were the input liaison documents (numbers refer to “M” documents)

7615 ISO/IEC 14772-1/FPDAM 1.2 (SC 29 N 4465)7616 ISO/IEC 14772-1/FPDAM 1.2 (SC 29 N 4465)7556 Liaison Statement from CEN/ISSS to WG 11 (SC 29 N 4384)7606 Summary of Response to Request for SC 29 Approval of Category A Liaison between

SC 29/WG 11 and ISMA7734 Web3D Liaison statement to MPEG7735 Web3D X3D Profile proposal to MPEG7577 Liaison Statement from CEN/ISSS (SC 29 N 4408)7654 OeBF Liaison Statement and Rights Language Requirements7581 IEC CDV 61883-1(2nd Edition): Consumer audio/video equipment -- Digital interface

-- Part 1: General (SC 29 N 4421)7578 IEC CDV 61883-7: Consumer Audio/Video Equipment -- Digital Interface -- Part 7:

Transmission of Rec. ITU-R BO.1294 System B (SC 29 N 4415)7579 IEC CDV 62289: Helical-scan digital video cassette recording format using 12,65 mm

magnetic tape and incorporating MPEG-2 compression -- Format D-10 (SC 29 N 4416)

7627 IEC NP: DTV profiles for uncompressed digital video interfaces (SC 29 N 4478)7555 ISMA Contribution on DRM Direction in ISMA7576 ISO DIS 5758: Cinematography -- Labelling of containers for motion-picture film and

7

magnetic material -- Minimum information for exchange of materials (SC 29 N 4405)7770 Liaison Statement from IFPI on Licensing Cost of WG11 Specifications7769 Liaison Statement from IFPI on Meeting Locations7584 Liaison Statement from ITU-R SG 6/WP 6Q to WG 11 on the Draft New

Recommendations (SC 29 N 4430)7626 Liaison Statement from ITU-T SG 16 to SC 29/WG 11 on Security Issues of

Mediacom 2004 and MPEG-21 (SC 29 N 4477)7571 Liaison Statement from TV-Anytime Forum (SC 29 N 4401)7839 Liaison to WG11 from SMPTE regarding Digital Cinema

The following liaisons were approvedTitle No.Liaison to SMPTE from WG11 regarding Digital Cinema N4460Liaison to TC100 N4482Liaison to CEN/ISSS N4483Liaison to TV-Anytime N4484Liaison to ITU-R SG 6/WP 6Q N4485Liaison to ITU-T SG 16 on Security Issues of Mediacom 2004 and MPEG-21 N4486Liaison to OeBF N4487Liaison to Web3D N4488Liaison to IFPI on Meeting Locations N4489Liaison to IFPI on Licensing Cost of WG11 Specifications N4490Statement of benefits from establishing a class C liaison with IMTC N4492Statement of benefits from establishing a liaison with TC37/SC4 N4493Statement of benefits from establishing a class C liaison with M4IF N4494Liaison to ITU-T SG 16 on MPEG-4 on IP N4495Liaison to DVB on MPEG-2 IPMP N4496Liaison to 3GPP2 TSG-C N4497Liaison to ITU-T on the creation of the JVT N4555Liaison statement to the IETF AVT Working Group on MPEG-4 on IP N4556Liaison to IMTC Media Coding AG regarding VCEG and MPEG Video Coding cooperation

N4557

Liaison letter to IETF regarding JVT Video packetisation N4558

15 Administrative matters

15.1 Schedule of future MPEG meetings The following schedule was approved

No. yy mm dd City Country

58 01 12 03-07 Pattaya TH

59 02 03 11-15 Jeju KR

60 02 05 06-10 Fairfax, VA US

61 02 07 22-26 Klagenfurt AT

62 02 10 21-25 Shanghai CN

63 02 12 02-06 ? ?

8

64 03 03 10-14 ? ?

65 03 07 21-25 Trondheim NO

15.2 Promotional activities The progress in creating the MPEG-7 Alliance was noted.

16 Organisation of this meeting

16.1 Tasks for subgroups Tasks were assigned to achieve the goals of standard and document approval as follows

Req MPEG-4 MPEG-4 requirements

o Add MPEG-4 Audio Ext. 1 requirementso Add AVC requirements

MPEG-4 OverviewMPEG-7 MPEG-7 requirements MPEG-7 OverviewMPEG-21 MPEG-21 requirements MPEG-21 Overview CfP for DIA

Sys Where are conformance bitstreams for all standardsList of unpublished approved standardsMPEG-21. Study of “7 on 2” FPDAMMPEG-41. XMT

Study of FPDAM2. IPMP extension

FPDAM3. Multiuser and Animation Framework

Contribution to PDAM4. Conformance FlexTime and XMT

FPDAM5. Reference Software of FlexTime and XMT

FDAM6. “4 on IP” FW

FDISMPEG-71. V. 2

WD2. Conformance

Contribution to CDMPEG-211. IPMP Framework

Draft2. IPMP extension

FCD

9

MDS Where are conformance bitstreams for all standardsList of unpublished approved standardsMPEG-71. V. 2

WD2. Conformance

Contribution to CDMPEG-211. Digital Item Declaration

FCD2. Digital Item Identification and Description

CD3. RDD

WD4. REL

WD

Vid Where are conformance bitstreams for all standardsList of unpublished approved standardsMPEG-41. Verification Tests

Review Studio Profile Results Assess FGS VT situation

2. Test Reports Review Digital Cinema Test Report DC scenarios with possible solutions

3. VTC alpha plane PDAM

7. Conformance of Studio profile and FGS PDAM

8. Reference Software of Studio profile and FGS PDAM

4. Optimised Reference Software DTR

5. JVT Resolutions

MPEG-71. V. 2

WD2. Conformance

Contribution to CD

Aud Where are conformance bitstreams for all standardsList of unpublished approved standardsMPEG-41. Extension 1

WDMPEG-71. V. 2

WD2. Conformance

Contribution to CD

SNH Where are conformance bitstreams for all standards

10

List of unpublished approved standardsMPEG-41. Animation Framework and MUW

Contribution to PDAM

Test MPEG-41. Final Report of Studio Profile VT2. Status Report of FGS VT3. Final Report of Digital Cinema Tests

ISG Inventory of reference software for all standards1. MPEG-12. MPEG-23. MPEG-4

a. Reference Software (part 5)b. Optimised Reference Software (part 5)c. HDL softwared. DSP software?

4. MPEG-75. MPEG-21H.26L complexity analysisMPEG-7 part 6 FDIS

Liais Updated table of committees in liaisonReview input docsCollect inputs to produce outgoing docsCollect inputs to produce NB responses

16.2 Joint meetings The following joint meetings were held

Group 1 Group 2 What Where Day TimeReq MDS RDD/REL MDS Mon 14:45-15:15Req Video, Test JVT, other Vid Req Vid Mon 16:00-18:00SNH Sys BIFS Corr. Sys Mon 18:00-19:00Req Sys, MDS MPEG-21 techn FW Req Tue 09:00-10:00Req Sys IPMP Req Req Tue 10:00-11:00SNH Sys Interp. Compr. Sys Tue 10:00-13:00Req MDS MPEG-21 DIA Req Tue 11:00-12:00Req MDS MPEG-7 Req Req Tue 12:00-13:00Req Sys MPEG-4 Sys P&L Req Tue 14:00-15:00Req MDS RDD/REL MDS Wed 11:15-12:30SNH Vid VTC SNH Wed 15:00-16:00ISG MDS XM MDS Thu 09:00-09:30SNH Sys AFX/MUW WD Sys Thu 09:00-11:00SNH Vid, Sys Synth. Tex. Sys Thu 11:00-12:00

17 Planning of future activities The following ad hoc groups were established

4524 AHG on 3D Video coding in MPEG

11

4503 AHG on AFX PDAM/VM editing and Core Experiments4504 AHG on AFX SW implementation4401 AHG on Audio part of MPEG-7 Conformance4543 AHG on Developing MPEG-21 Software and SYstems Model (YM)4461 AHG on Digital Cinema4552 AHG on Editing MPEG-7 PDTR on extraction and use of mpeg-7 descriptions4550 AHG on Editing MPEG-7 Visual XM4539 AHG on Editing the MPEG-21 DID FCD Study and DII&D CD Study4540 AHG on Editing the MPEG-21 RDD WD4541 AHG on Editing the MPEG-21 REL WD4538 AHG on Editing the MPEG-7 MDS Extensions WD and XM4553 AHG on Editorial Convergence of MPEG-4 Reference Software4474 AHG on Exploration of Interframe Wavelet Technology in Video Coding4473 AHG on Fine Granularity Scalability4438 AHG on Group on IM14402 AHG on Issues in Lossless Audio Coding4451 AHG on MP4 Extensions4395 AHG on MPEG AAC4440 AHG on MPEG IPMP Extensions4394 AHG on MPEG-2 Audio Reference Software4542 AHG on MPEG-21 Core Experiments4523 AHG on MPEG-21 Digital Item Adaptation4520 AHG on MPEG-21 Requirements4522 AHG on MPEG-21 Technical Architecture4453 AHG on MPEG-4 Advanced Text and 2D Graphics4397 AHG on MPEG-4 Audio Conformance4396 AHG on MPEG-4 Audio DCorr Text and Reference Software4398 AHG on MPEG-4 Audio Extension 1 Core Experiments4436 AHG on MPEG-4 BIFS4452 AHG on MPEG-4 BIFS Complexity Evaluation4435 AHG on MPEG-4 Conformance4439 AHG on MPEG-4 Content on MPEG-2 Systems and IP Network4479 AHG on MPEG-4 Part 9: Reference Hardware Description Phase 14472 AHG on MPEG-4 Studio Profile Conformance and Reference Software4437 AHG on MPEG-4 Textual Format4519 AHG on MPEG-7 Applications & Promotion to Industry4399 AHG on MPEG-7 Audio4434 AHG on MPEG-7 Systems and DDL4551 AHG on MPEG-7 Visual Core Experiments4521 AHG on REL/RDD Requirements4480 AHG on the Complexity Analysis of JVT Codec4478 AHG on XM Development

18 Resolutions of this meeting These were approved

19 A.O.B There were no other businesses.

12

20 Closing The meeting closed with thanks to the hosting organisation.

13

Annex 1Attendance list

Surname First name Affiliation Country1 Burnett Ian University of Wollongong Australia2 Iannella Renato IPR Systems Australia3 Ruskin Paul University of Wollongong Australia4 Hellwagner Hermann University Klagenfurt Austria5 Bormans Jan IMEC Belgium6 Delfosse Eric IMEC Belgium7 Lafruit Gauthier IMEC Belgium8 Salomie Ioan Alexandru VUB Belgium9 Van De Walle Rik Ghent University Belgium

10 Cheng Spencer Cloakware Canada11 Mignot Alain SGDL Systems Inc. Canada12 Winger Lowell VideoLocus Inc. Canada13 Hannuksela Miska Nokia Corporation Finland14 Vaananen Mauri Nokia Research Center Finland15 Avaro Olivier France Telecom R & D France16 Benjelloun Touimi Abdellatif France Télecom R&D France17 Boissonade Patrick France Télecom R&D France18 Concolato Cyril ENST France19 Cotarmanach Alexandre France Telecom R & D France20 Cotten Gildas CANON CRF France21 Curet Dominique France Telecom R & D France22 Daguet Christophe France Telecom R & D France23 Devillers Sylvain Philips Research France France24 Dublanchet Frederic Canal Plus Technologies France25 Dufourd Jean-Claude ENST France26 Fisher Yuval Envivio France27 François Edouard THOMSON multimedia France28 Gicquel Jean-Charles France Telecom R & D France29 Gioia Patrick France Telecom R & D France30 Herrmann Laurent Philips France31 Le Maguet Yann Philips France32 Legrand Marc Philips France33 Loras Frédéric France Telecom R & D France34 Lorette Anne Thomson Multimedia France35 Mary Didier FIAPF/AGICOA France36 Peeters Geoffroy IRCAM France37 Perrot Philippe Canal Plus Technologies France38 Pierrick Philippe Envivio France39 Preda Marius INT France40 Preteux Francoise INT France41 Rault Jean-Bernard France Telecom R & D France42 Santini Nicolas Philips France43 Seyrat Claude Expway France44 Virette Davis France Telecom R & D France

14

45 Benzler Ulrich Robert Bosch GmbH Germany46 Bitzer Joerg Houpert Digital Audio Germany47 Dietz Martin Coding Technologies GmbH Germany48 Eckes Christian Fraunhofer IMK Germany49 Feiten Bernhard Deutsche Telekom Berkom Germany50 Fuchs Harald Fraunhofer Institut Germany51 Grahn Holger Blaxun Interactive AG Germany52 Grill Bernhard Fraunhofer Institut Germany53 Herre Juergen Fraunhofer Institut Germany54 Herrmann Stephan TU - Muenchen Germany55 Hutter Andreas Siemens AG- Muenchen Germany56 Linzmeier Karsten Fraunhofer Institut Germany57 List Peter Deutsche Telekom Germany58 Meltzer Stefan Coding Technologies GmbH Germany59 Ohm Jens-Rainer RWTH Aacher Germany60 Purnhagen Heiko Universität Hannover Germany61 Schlockermann Martin Panasonic European

LaboratoriesGermany

62 Smolic Aljoscha HHI- Berlin Germany63 Sperschneider Ralph Fraunhofer Institut Germany64 Spille Jens Thomson Multi Media Germany65 Thoma Herbert Fraunhofer Institut Germany66 Wiegand Thomas Heinrich-Hertz-Insitut Berlin Germany67 Wolf Ingo T-Nova Berkom Berlin Germany68 Lifshitz Zvi Optibase Ltd Israel69 Balestri Massimo Telecom Italia Lab Italy70 Chiariglione Leonardo Telecom Italia Lab Italy71 De Petris Gianluca Telecom Italia Lab Italy72 Flaiani Roberto Aethra Italy73 Adachi Satoru NTT DoCoMo Japan74 Asai Kohtaro Mitsubishi Japan75 Azami Tomohiro JVC Japan76 Day Neil Mpeg-7 Alliance Japan77 Etoh Minoru NTT DoCoMo, Inc. Japan78 Fujita Takehiro Hitachi,Ltd. Japan79 Garner Philip N. Canon Inc. Japan80 Givotovsky Nicholas Dentsu Japan81 Gohshi Seiichi NHK Japan82 Hasida Koiti AIST Japan83 Iida Takahito Dentsu Japan84 Iida Takahito Dentsu Inc. Japan85 Imura Koji Matsushita Communication

IndustrialJapan

86 Ito Norio Sharp Japan87 Kadono Shinya Matsushita Japan88 Kambayashi Toru Toshiba R&D Center Japan89 Kamei Toshio NEC Japan90 Kaneko Itaru Waseda University Japan91 Kato Sadaatsu NTT DoCoMo Japan

15

92 Kazui Kimihiko Fujitsu Labs. Japan93 Kikuchi Yoshihiro Toshiba Japan94 Kimata Hideaki NTT Japan95 Kogure Takuyo Matsushita Japan96 Koyama Hitoshi NEC Japan97 Matsuyama Takashi Kyoto Univ. Japan98 Matsuyama Satoshi Sharp Japan99 Moriya Takehiro NTT Japan

100 Murakami Tokumichi Mitsubishi Japan101 Nakachi Takayuki NTT Japan102 Nakamura Takao NTT Japan103 Nakanishi Tadashi NTT Japan104 Nomura Toshiyuki NEC Japan105 Nomura Koji NetDimension Japan106 Sakamoto Hideki NTT Japan107 Sano Masanori NHK Japan108 Schultz Craig A. Fuji Xerox Japan109 Sekiguchi Shun-ichi NTT DoCoMo Japan110 Senoh Takanori Matsushita Japan111 Sonehara Noboru NTT Japan112 Sugihara Yoshinori JEITA Japan113 Sugiyama Kenji JVC Japan114 Suzuki Yoshinori Hitachi, Ltd. Japan115 Suzuki Teruhiko Sony Japan116 Suzuki Mitsuyoshi Mitsubishi Electric

CorporationJapan

117 Tada Hiroyuki Matsushita Japan118 Takagi Koichi KDDI Japan119 Takagi Shin'ichi Waseda University Japan120 Takahashi Toshiya Matsushita Japan121 Takashima Youichi NTT Japan122 Toguri Yasuhiro Sony Japan123 Ueno Takafumi Panasonic Japan124 Watanabe Shuichi Sharp Japan125 Yagasaki Yoichi Sony Japan126 Yamada Akio NEC Japan127 Yamada Yoshihisa Mitsubishi Japan128 Yamashita Ryozo ASCII Corp. Japan129 Chae Jong Jin MarkAny Inc. Korea130 Chang Doim LG Electronics Korea131 Chang Joonho Serome Technology Korea132 Cheong Won-Sik ETRI Korea133 Choi Yanglim SAIT Korea134 Choi Min-Seok Hanyang University Korea135 Choi Bum Suk ETRI Korea136 Han Mahnjin SAIT Korea137 Ho Yo-Sung K-JIST Korea138 Jang Euee S. SAIT Korea139 Jeon Byeungwoo Sung Kyun Kwan University Korea

16

140 Jeong Junho KyungHee University Korea141 Joe Moon-Jeung LG Electronics Korea142 Jung Seok-Yoon SAIT Korea143 Jung Gil Ho MarkAny Inc. Korea144 Kim Daijin POSTECH Korea145 Kim Do Hyun LG Eelectronics Korea146 Kim Do Kyoon Samsung AIT Korea147 Kim Do-Nyun LG Electronics Korea148 Kim Hae-Kwang Sejong University Korea149 Kim Heon Jun LG Electronics Korea150 Kim In Kwon Varovision Co. LTD Korea151 Kim James D. K. SAIT Korea152 Kim Jong-Nam KBS Korea153 Kim Kyeong-Soo KBS Korea154 Kim Kyuheon ETRI Korea155 Kim Munchurl ICU Korea156 Kim Nam Kyu Varovison. Co. LTD Korea157 Kim Sang-Kyun SAIT Korea158 Kim Sang-Wook SAIT Korea159 Kim Whoi-Yul Hanyang University Korea160 Kim Woo-Shik SAIT Korea161 Kim Yong Han University of Seoul Korea162 Kwon Tae-Kyung Sejong University Korea163 Lee Seung Wook ETRI Korea164 Lee Shinjun SAIT Korea165 Lee Sanghong KT Korea166 Lee Sangyoun KT Korea167 Lee Jae-Ho Hanyang University Korea168 Lee Nam-Yeol Sejong University Korea169 Lim Young-Kwon NET & TV Co., LTD. Korea170 Moon Kyung Ae ETRI Korea171 Oh Seoung-Jun KwangWoon University Korea172 Park Yoog Chu LG Eelectronics Korea173 Park Soo-Jun ETRI Korea174 Park Gwang Hoon KyungHee University Korea175 Park Du Sik SAIT Korea176 Park Yong-Chul LG Electronics Korea177 Park Hong Sik Varovision. Co. LTD Korea178 Park Dong Kwon Dongguk University Korea179 Park In-Soo KATS Korea180 Seo Sangyong KT Korea181 Shin Jae-Seob Samsung/MPEGSolutions Korea182 Shin Jitae KyungHee University Korea183 Sim Dong-Gyu Varovision Co. LTD Korea184 Song Young-Won LG Electronics Korea185 Song Joon-Ho Varovision Co. LTD Korea186 Sull Sanghoon Korea University Korea187 Won Chee Sun Dongguk University Korea188 Woo Sang Oak SAIT Korea

17

189 Yoon Kyoung Ro LG Eelectronics Korea190 Yoon Jong-Ku KATS Korea191 Mooij Wim Irdeto Access Netherlands192 Oomen Werner Philips Consumer Electronics Netherlands193 Van der Meer Jan Philips Consumer Electronics Netherlands194 Gelissen Jean H.A. Philips Research Laboratories NL195 Middelink Marc Klein Philips NL196 Grini Iver Octaga Norway197 Johansen Tom-Ivar Tandberg Telecom AS Norway198 Perkis Andrew NTNU Norway199 Zhang Jijun Norwegian Univ. of Science

and TechnologyNorway

200 Pereira Fernando IST Portugal201 Santos Ernesto INESC Porto Portugal202 Huang Zhong Yang Panasonic Singapore Labs Singapore203 Lee Chak Joo Panasonic Singapore Labs Singapore204 Ming Ji Panasonic Singapore

Laboratories Pte. Ltd.Singapore

205 Neo Sua Hong Panasonic Singapore Laboratories Pte Ltd

Singapore

206 Shen Shengmei Panasonic Singapore Laboratories Pte. Ltd.

Singapore

207 Wee Foo Teck Panasonic Singapore Laboratories Pte. Ltd.

Singapore

208 Xue Zhong Panasonic Singapore Labs Singapore209 Martinez Jose M. Universidad Politecnica de

Madrid - GTISpain

210 Moran Francisco Universidad Politecnica de Madrid

Spain

211 Villegas Paulo Telefonica I + D Spain212 Christopoulos Charilaos Ericsson Sweden213 Frojdh Per Ericsson Radio Systems AB Sweden214 Kjörling Kristofer Coding Technologies Sweden215 Lindquist Morgan Ericsson Sweden216 Rivas Francisco Ericsson Sweden217 Ebrahimi Touradj EPFL Switzerland218 Barlas Chris Rightscom UK219 Bober Miroslaw Mitsubishi Electric ITE-VIL UK220 Cieplinski Leszek Mitsubishi Electric ITE-VIL UK221 Grant Kate Nine Tiles UK222 Hill Keith Rightscom UK223 Hughes David IFPI UK224 Jessop Paul IFPI Secretariat UK225 Jost Uwe CRE UK226 Koenen Rob InterTrust Technologies

InternationalUK

227 Kudumakis Panos CRL UK228 Lacy Jack interTrust Technologies

InternationalUK

229 Mitchell Steve InterTrust Technologies UK

18

International230 Morrell Philippa IFPI Secretariat UK231 Parrott D Reuters UK232 Rose T Reuters UK233 Rump Niels Rightscom UK234 Steliaros Michael Superscape UK235 Stride Jean British Standards Institution UK236 Thomas Keith IFPI UK237 Watt S UK238 Wragg Barney Universal Music Group UK239 Alvarez Jose Broadcom Corporation USA240 Block Bruce Recording Industry

Association of AmericaUSA

241 Bourges-Sevenier Mikael Nexternet Inc. USA242 Chang Wo NIST USA243 Dawson Dave Motion Picture Association of

AmericaUSA

244 DeMartini Thomas Xerox/ContentGuard, Inc. USA245 Dinsdale Scott FIAPF USA246 Edwards Eric Sony Electronics Inc USA247 Fellers Matthew Dolby Laboratories Inc USA248 Flaks Jason Dolby Laboratories Inc USA249 Gandee Brad Xerox - ContentGuard USA250 Givotovsky Nicholas MMG Ltd. USA251 Heil Stephen Microsoft USA252 Hughes David Sony Music Entertainment USA253 Isailovic Jordan JRI Technology USA254 Karczewicz Marta Nokia Research Center USA255 Kuo J C Tvia USA256 Li Weiping WebCast Technologies, Inc. USA257 Lindbergh David Polycan, Inc. USA258 Luthra Ajay Motorola USA259 McMahon Tom SMPTE-Demografx USA260 Miki Toshio DoCoMo Communications

LaboratoriesUSA

261 Nalebuff Martha Microsoft USA262 Narasimhan Sam Motorola USA263 Park Jin Tvia, Inc. USA264 Peach Allan Demografx USA265 Powell Ged DoCoMo Communications

LaboratoriesUSA

266 Quackenbush Schuyler AT & T USA267 Rambhia Avni e-Vue, Inc. USA268 Rehm Eric Singingfish / Thomson

multimediaUSA

269 Schirling Pete IBM Research USA270 Schwartz Todd Intel Corporation USA271 Shen Ji Real Networks Inc USA272 Singer David Apple USA273 Smith John R. IBM T. J. Watson Research USA

19

Center274 Sullivan Gary Microsoft USA275 Sun Huifang Mitsubishi Electric Research

LaboratoriesUSA

276 Swaminathan Viswanathan Sun Microsystems Inc. USA277 Tescher Andrew G. Microsoft USA278 Tsai Chun-Jen PacketVideo Corp. USA279 van Beek Peter Sharp Laboratories of

AmericaUSA

280 Vetro Anthony Mitsubishi Electric Research Laboratories

USA

281 Viscito Eric Globespan Semiconductors USA282 Walker Toby Sony Corp. USA283 Wang Xin ContentGuard Inc. USA284 Wang Limin Motorola USA285 Wood Stephen IBM TJ Watson Research USA286 Yoram Yaacovi Microsoft USA287 Zeng Wenjun PacketVideo Corporation USA288 Zhang Honglang Nokia USA

20

Annex 2Document list

No. Title Author(s)

7552 Document Register for SC29/WG11 Meeting #58 in Pattaya, Thailand Mike Rubinfeld

7553 Table of Replies on ISO/IEC 14496-1:2001/FDAM 1 (SC 29 N 4363) SC 29 Secretariat

7554 Systems Meeting Report

Olivier Avaro (France Telecom R&D), Jean-Claude Dufourd (ENST), Jan Van der Meer (Philips), Mike McGinty (Telanetix), Michelle Kim (IBM), Young-Kwon Lim MP4Cast), Zvi Lifshitz (Optibase), Claude Seyrat (Expway), David Singer (Apple), Michael Wollborn (Bosch)

7555 ISMA Contribution on DRM Direction in ISMAPete Schirling for the ISMA DRM workgroup

7556 Liaison Statement from CEN/ISSS to WG 11 (SC 29 N 4384) SC 29 Secretariat

7557 Comments on MPEG-4 IPMP CD Steve Mitchell, Jack Lacy7558 Study of MPEG-4 IPMP Extensions CD Editor: Avni Rambhia

7559 A Study of IPMP Data Structure Syntax Bruce Chaplin, David Kosiba, Ivan McLean

7560 A Study of IPMP Message Syntax Bruce Chaplin, David Kosiba, Ivan McLean

7561 New IPMP System Architecture Diagram Bruce Chaplin, David Kosiba, Ivan McLean

7562 A Study of Descriptor ID Values Bruce Chaplin, David Kosiba, Ivan McLean

7563 A Study of IPMP Tool Message Type Values Bruce Chaplin, David Kosiba, Ivan McLean

7564 New IPMP Tool Mssages for Querying Parametric Capabilities Bruce Chaplin, David Kosiba, Ivan McLean

7565Usage Scenario for MPEG Intellectual Property Management & Protection (IPMP) Application to Digital Cinema

Chuck Harrison (FFA)

7566 Proposed definitions for the Intent Messages as defined by ISO/IEC 14496-1:2000 / AMD3

[email protected], [email protected], [email protected]

7567 Definition for a Secure Message class for ISO/IEC 14496-1:2000 / AMD3


7568 Mapping of Mpeg4 IPMP Extension into Mpeg2 system

Ming Ji, SM Shen, ZY Huang (Panasonic Singapore Laboratories Pte Ltd), Taka Senoh, Takuyo Kogure (Matsushita Electric Industrial Co., Ltd)

7569 Proposal on improvement of the current MPEG4 IPMP Extension CD

Ming Ji, SM Shen, ZY Huang (Panasonic Singapore Laboratories Pte Ltd), Taka

21

mailto:[email protected]
















Senoh, Takuyo Kogure (Matsushita Electric Industrial Co., Ltd)

7570 Further benefit of IPMPXML Itaru Kaneko

7571 Liaison Statement from TV-Anytime Forum (SC 29 N 4401) TV-Anytime Forum via SC 29 Secretariat

7572 Programme of 3rd MPEG-7 Awareness Event: USA October 2001 MPEG-7 Awareness Event Committee

7573 VIM Texture Syntax Yosef Yomdin, Yoram Elichai, Ittay Sharon, Ehud Spiegel

7574 VIM Texture Integration Yosef Yomdin, Yoram Elichai, Shlomo Birman, Ehud Spiegel

7575 Report of the MPEG IPMP AHG Meeting – Santa Clara Mike McGinty

7576

ISO DIS 5758: Cinematography -- Labelling of containers for motion-picture film and magnetic material -- Minimum information for exchange of materials (SC 29 N 4405)

ISO/TC 36 via SC 29 Secretariat

7577 Liaison Statement from CEN/ISSS (SC 29 N 4408) CEN/ISSS via SC 29 Secretariat

7578

IEC CDV 61883-7: Consumer Audio/Video Equipment -- Digital Interface -- Part 7: Transmission of Rec. ITU-R BO.1294 System B (SC 29 N 4415)

IEC TC 100 via SC 29 Secretariat

7579

IEC CDV 62289: Helical-scan digital video cassette recording format using 12,65 mm magnetic tape and incorporating MPEG-2 compression -- Format D-10 (SC 29 N 4416)


7580 The use of VTC error resilience for view-dependent texture decoding Eric Delfosse, Gauthier Lafruit

7581IEC CDV 61883-1(2nd Edition): Consumer audio/video equipment -- Digital interface -- Part 1: General (SC 29 N 4421)


7582 NB Comments accompanying the ballot on the MPEG-21 IPMP CD Niels Rump for the UKNB

7583 UKNB Comments accompanying the ballot on the MPEG-21 IPMP CD Niels Rump for the UKNB

7584Liaison Statement from ITU-R SG 6/WP 6Q to WG 11 on the Draft New Recommendations (SC 29 N 4430)

ITU-R SG 6/WP 6Q via SC 29 Secretariat

7585UKNB Comments accompanying the ballot on the IPMP sections of PDAM ISO/IEC 14496-1:2001 / AMD3

Jack Lacy for the UKNB

7586 Study of subdivision surface in AFX WD 1.0

Mikael Bourges-Sevenier (Nexternet Inc.), Henning Biermann (NYU), Denis Zorin (NYU), Peter Schroeder (CalTech), Andrei Khodakovsky (calTech)

22

















7587 Skin & Bone implementation in reference software Marius Preda, Françoise Prêteux

7588 Streamed animation within Animation Framework eXtension (AFX) Marius Preda, Françoise Prêteux

7589 Bones-Based Animation specification proposal for AFX CE

Ryozo Yamashita, Koji Nomura, Hideaki Kimata, Takashi Matsuyama, Koiti Hasida

7590 Proposed changes to the XMT-A textual format Jean-Claude Dufourd

7591 Summary of Voting on ISO/IEC 14496-1:2001/PDAM 3 (SC 29 N 4445) SC 29 Secretariat

7592 Summary of Voting on ISO/IEC CD 21000-2 (SC 29 N 4446) SC 29 Secretariat

7593 Summary of Voting on ISO/IEC CD 21000-4 (SC 29 N 4447) SC 29 Secretariat

7594Summary of Response to Proposal of Subdivision of the SC 29 Project, 21000-3 (SC 29 N 4448)

SC 29 Secretariat


SC 29 Secretariat


SC 29 Secretariat


SC 29 Secretariat

7598Open Digital Rights Language (ODRL) - Submission to the MPEG-21 CfP for a RDD-REL

Renato Iannella

7599 Summary of Voting on ISO/IEC 13818-1:2000/DCOR 2 (SC 29 N 4444) SC 29 Secretariat

7600 Minor changes to InputSensor and mapping of KeySensor/StringSensor Cyril Concolato, Jean-Claude Dufourd

7601 MPEG-21 Digital Item Identification and Description WD 2.5

Niels Rump for the AhG for editing the DID CD and the DIID WD

7602 MPEG-7 TeM decoder developed at Lancaster University (version LUv1-1) Rui J. Lopes

7603 Testing Mike Rubinfeld

7604Standard Support for Progressive Encoding, Compression and Interactive Visualization of Surface Light Fields

R. Grzeszczuk, S. Molinov, A. Smirnov, M. H. Chu, W-C. Chen, J-Y. Bouguet

7605 Various Fixes for Pattaya Yuval Fisher

7606Summary of Response to Request for SC 29 Approval of Category A Liaison between SC 29/WG 11 and ISMA (SC 29 N 4462)

SC 29 Secretariat

23












7607 USNB Contribution: Subdivision 4 of the ISO/IEC 21000 A. G. Tescher for USNB

7608 USNB Contribution: Digital Cinema Issues A. G. Tescher for USNB

7609 USNB Contribution: Liaison between ISMA and WG 11 A. G. Tescher for USNB

7610 <indecs>2rdd Chris Barlas for the <indecs>2rdd Consortium

7611 Experimental Results of Face Description Using 2nd-order PCA Mixture Model

Hyun-Chul Kim, Daijin Kim, Sung Yang Bang (POSTECH), Young-Sik Choi, Sang-Youn Lee (Korea Telecom)

7612 Proposed MPEG-21 Digital Item Declaration FCD

Todd Schwartz for the AHG on Editing the MPEG-21 DID CD and DII&D WD

7613 Study on Text of ISO/IEC 21000-2 CD Todd Schwartz, for the AHG on Editing the MPEG-21 DID CD and DII&D WD

7614 Study on Text of ISO/IEC 21000-2 CD Todd Schwartz, for the AHG on Editing the MPEG-21 DID CD and DII&D WD

7615 ISO/IEC 14772-1/FPDAM 1.2 (SC 29 N 4465) SC24 via the SC 29 Secretariat

7616 ISO/IEC 14772-1/FPDAM 1.2 (SC 29 N 4465) SC24 via the SC 29 Secretariat

7617 Thoughts on building a Rights Expression Language David Parrott

7618 Thoughts on building a Rights Expression Language David Parrott

7619 Levels for Visual Profiles Fernando Pereira, Paulo Nunes

7620 Proposal for MPEG-7 Requirements Document V.16 Fernando Pereira (editor)

7621 OD framework and MPEG-4 IPMP Extensions Jean Le Feuvre

7622Report on CE on MPEG-21 Digital Item Identification & Resolution System Interoperability

Hideki Sakamoto (NTT), Takao Nakamura (NTT), Masanori Yamada (NTT), and Hiroshi Yasuda (Tokyo Univ.)

7623 Report of the AHG on MPEG-21 Digital Item Usage Environment Description Anthony Vetro (on behalf of the AHG)

7624 MPEG-21 Requirements on Digital Item Usage Environment Description Anthony Vetro (on behalf of the AHG)

7625 Optimal Intervals for Fuzzy Categories of Color Temperature Wladyslaw Skarbek

7626Liaison Statement from ITU-T SG 16 to SC 29/WG 11 on Security Issues of Mediacom 2004 and MPEG-21 (SC 29 N 4477)

ITU-T SG 16 via SC 29 Secretariat

7627 IEC NP: DTV profiles for uncompressed digital video interfaces (SC 29 N 4478) IEC TC 100 via SC 29 Secretariat

7628 cIDf Specifications Ver. 1.1: Response to CfP Hideki Sakamoto (NTT), Youichi Takashima

24





















for an RDD-REL (NTT), Hiroshi Yasuda (University of Tokyo)

7629 Report of the AHG on Editing the MPEG-21 DID CD and DII&D WD Todd Schwartz, for the AHG

7630 Report of the AHG on Editing the MPEG-21 DID CD and DII&D WD Todd Schwartz, for the AHG

7631 Identification of Errors in Decoder Software of MPEG-2 Layer III LSF (Distribution 10) Walter Voessing, Jens Spille

7632 Results of the Core Experiments for Standard Support for Automatic Face Recognition Ara Nefian, Bob Davies, Omid Moghadam

7633 Report of the IPMP Ad Hoc meeting – Ottawa – November 12-14 Jack Lacy

7634 Study of Text of PDAM ISO/IEC 14496-1:2000 PDAM3 Avni Rambhia

7635 IPMP Ahg Disposition of NB Comments on PDAM ISO/IEC 14496-1:2000 PDAM3 Avni Rambhia

7636 Requirements for the Persistent Association of Identifiers

Niels Rump (Rightscom), Hideki Sakamoto (cIDf) for the AhG on Persistent Association of Identifiers with Content

7637 Report of AHG on MPEG-4 Audio Heiko Purnhagen, Andreas Hölzer

7638 Report of the AHG On Evaluation of “Expert Viewing” Methodologies n D-Cinema

Jordan Isailovic, Dave Dawson, for the AdHoc Group

7639 Definitions of Digital Cinema Expert Visual Test Methodologies

Dave Dawson, Editor - AHG On Evaluation of “Expert Viewing” Methodologies in D-Cinema

7640 XrML: Response to MPEG 21 CfP for RDD-REL Brad Gandee, Xin Wang, Thomas DeMartini

7641 Encoding Visual XML Descriptors into their Binary Equivalents

Grzegorz Galinski/[email protected], Andrzej Buchowicz



7643A Proposal for a new MPEG-21 Core Experiment through the use of media resource delivery

Andrew Perkis, NTNU, Francisco Rivas, Ericsson MediaLab

7644 MPEG-21 requirements input based on media resource delivery

Andrew Perkis, NTNU, Jijun Zhang, NTNU, Arne Lie, SINTEF/NTNU, Francisco Rivas, Ericsson MediaLab, Mathias Johansson, FRAMKOM

7645 Report of AHG on Digital Cinema Video Technology John Woods

7646 Goldilocks and the Three Important Clarifications Yuval Fisher

7647 Clarification of differences between ECMAscript and MPEG-4 Scripts Yuval Fisher

25




















7648 WD of ISO/IEC 14496-1:2001.1 Edition Yuval Fisher

7649 Representing Surfaces from Structured Light Scanners using the MeshGrid format

Ioan Alexandru Salomie, Augustin Gavrilescu, Adrian Munteanu, Ilse Ravyse, Gauthier Lafruit, Peter Schelkens, Rudi Deklerck, Jan Cornelis

7650 Extending the MeshGrid stream to enable View-dependent coding

Ioan Alexandru Salomie, Augustin Gavrilescu, Adrian Munteanu, Ilse Ravyse, Gauthier Lafruit, Peter Schelkens, Rudi Deklerck, Jan Cornelis

7651 Request for use of error resilience tools with MPEG-4 Simple Scalable Profile Paola Hobson

7652 Report of the Ad-hoc Group on the Bitstream Syntax Description Language (BSDL) Sylvain Devillers, on behalf of the AhG

7653 MPEG-21 Draft Requirements on BSDL and Content Adaptation Sylvain Devillers, Myriam Amielh

7654 OeBF Liaison Statement and Rights Language Requirements

Chris Barlas, Bob Matthews, Yoram Yaacovi, Tom Diaz

7655 MPEG-7 Multimedia Description Schemes XM (Version 9.0)

John R. Smith, Peter van Beek, Ana B. Benitez, Joerg Heuer, Jose Martinez, Philippe Salembier, Yoshiaki Shibata, Toby Walker

7656 MPEG-7 Multimedia Description Schemes XM (Version 9.0)

John R. Smith, Peter van Beek, Ana B. Benitez, Joerg Heuer, Jose Martinez, Philippe Salembier, Yoshiaki Shibata, Toby Walker

7657 MPEG-7 Multimedia Description Schemes XM (Version 9.0) John R. Smith on behalf of MDS group

7658 Requirements for Registration Authority for MPEG-7 Classification Schemes (draft) John R. Smith on behalf of MDS group

7659 Main2D and Advanced Main2D Profiles: Levels definitions Steve Wood, Michelle Kim

7660 XMT: Study of text of ISO/IEC 14496-1:2001/FPDAM2 Steve Wood, Michelle Kim

7661 Extensible Media Commerce Language (XMCL) Jeff Ayars

7662 MarkAny Rights Expression Language: MAREL

Jong Jin Chae, Gil Ho Jung, Han Ho Lee, Jong Uk Choi

7663 New prediction method to improve B-picture coding efficiency S.Kondo, S.Kadono and M.Schlockermann

7664 Improved 2D-VLC coding for High-Bitrate S.Kadono and M.Schlockermann

7665 Improved Video Coding using H.26L ME/MC Techniques M.Hagai, S. Kadono and M.Schlockermann

7666 H.26L Implementation Evaluation M.Hagai, K.Abe, S. Kadono, S.Kajita and M.Schlockermann

26




















7667 Report of the Ad-hoc Group on Requirements for Joint Video Project Ajay Luthra

7668 Implementation of MPEG-4 DMIF Remote Retrieval Instance and Streaming Server

Yaser Pourmohammadi / [email protected], Kambiz Asrar-Haghighi and Hussein Alnuweir



7670 A proposal of the model bind to content and ID Hideki Sakamoto, Youichi Takashima

7671 MPEG Content Related ID Registration in System Level for MPEG RDD Requirement

ZY Huang, SM Shen, Ming Ji (Panasonic Singapore Laboratories Pte Ltd), Taka Senoh, Takuyo Kogure (Matsushita Electric Industrial Co., Ltd)

7672Rights Markup Extensions for the Protection of Indigenous Knowledge: Response to CfP for an RDD-REL

Jane Hunter

7673 Text of ISO/IEC 15938-1/FDIS - Editors version

Claude Seyrat, Michael Wollborn, Adam Lindsay, Ali Tabatabai, Andreas Hutter, Carsten Herpel, Young-Kwon Lim, Olivier Avaro

7674An expert viewing method to assess the degree of visual degradation in Digital Cinema applications

Vittorio Baroncini, Chair of Test sub-group

7675 DMAG contribution to RDD-REL: IPRonto Enric Peig, Jaime Delgado, Isabel Gallego, Roberto García, Rosa Gil, Rubén Tous

7676 Proposal for Audio Quality Descriptors Joerg Bitzer, Stefan Kudras

7677 LGE Proposal for RDD-REL Moon Jeung Joe, Hyun-Woo Choi, Young-Won Song

7678 Report of AHG on Issues in Lossless Audio Coding Takehiro Moriya

7679 New Profiles & Levels indication values in IOD French National Body

7680 Clarification on URLs in BIFS Sylvain Delagrange, Laurent Herrmann (Philips)

7681 Droppable Access Unit and Random Access Indications in XMT

Sylvain Delagrange, Laurent Herrmann (Philips)

7682 Improved readability and tutorial of VTC reference code

Eric Delfosse (IMEC), Gauthier Lafruit (IMEC), Avni Rambhia (e-Vue)

7683 Contributions to MPEG-7 Reference Software J. Errico, M. Ferman, D. Messing, I. Sezan, P. van Beek

7684Report of Core Experiment result on MPEG-7 Color Temperature Browsing Descriptor (VCE-6)

Soo-Jun Park

7685Report of Core Experiment result on MPEG-7 Color Temperature Descriptor for Display Preference (VCE-7)

Soo-Jun Park

27




















7686 Use Case Scenarios for MPEG-21 DIUEDMikio Sasaki (DENSO CORPORATION), Simon Robins (Genimedia SA), Youngsik Huh (Samsung AIT)

7687 Bug fixed in the Microsoft version of MPEG-4 OM reference software

Yan Lu/[email protected], Wen Gao, Feng Wu, Hanqing Lu

7688 Rights Language Evaluation Criteria Martha Nalebuff, Bob Atkinson, M. Paramasivam

7689 Extension of the Face Recognition Descriptor Using a Confidence Factor T.Kamei, A.Yamada

7690 A Result of Core Experiment VCE-5 for Color Layout A.Yamada

7691 MPEG-7 Visual part of eXperimentation Model Version 11.1

A.Yamada, L.Cieplinski, J.-R.Ohm, W.Kim, M.Pickering

7692 Report of AHG on Editing PDTR on Extraction and Use of MPEG-7 Descriptions

A.Yamada, L. Cieplinski, J.-R. Ohm, W. Kim, M. Pickering, P. van Beek, A. B. Benitez, J. Heuer, J. Martinez, P. Salembier, J. Smith, T. Walker and Y. Shibata

7693 A Study text of PDTR on Extraction and Use of MPEG-7 Descriptions

A.Yamada, L. Cieplinski, J.-R. Ohm, W. Kim, M. Pickering, P. van Beek, A. B. Benitez, J. Heuer, J. Martinez, P. Salembier, J. Smith, T. Walker and Y. Shibata

7694 Definition of an object-oriented 3-D sound scene description scheme Guillaume Potard and Dr Ian Burnett

7695 Proposal of GMVC syntax Hideaki Kimata

7696Proposal of Global Motion Compensation enhancing Global Motion Vector Coding scheme

Hideaki Kimata

7697 Summary of Voting on ISO/IEC DTR 14496-7.2 (SC 29 N 4497) SC 29 Secretariat

7698 Summary of Voting on ISO/IEC FCD 14496-8 SC 29 Secretariat

7699 CE-1 Core Experiment Results for shape-sequence descriptor

Sangyoun Lee, YoungSik Choi, Sang Yong Seo, Wooyoung Lim, Hae-Kwang Kim

7700 Proposal for texture sequence descriptors for a video segment

Sangyoun Lee, YoungSik Choi, Sang Hong Lee, Nam-Yeol Lee, Sang-Bum Cho, Hae-Kwang Kim

28
















Annex 3Agenda

1. Opening 2. Roll call of participants 3. Approval of agenda 4. Allocation of contributions 5. Communications from Convenor 6. Report of previous meeting 7. Processing of NB Position Papers

8. MPEG Phase 2 8.1 Requirements 8.2 Amendments 8.6 Corrigenda 8.7 Workplan 9. MPEG Phase 4 9.1 Requirements 9.2 Systems 9.2.1 Standard 9.2.2 Extension 1 9.2.3 Extension 2 9.2.4 Extension 3 9.2.5 Extension 4 9.2.6 Corrigenda 9.3 Visual 9.3.1 Standard 9.3.2 Extension 1 9.3.3 Extension 2 9.3.4 Corrigenda 9.4 Audio 9.4.1 Standard 9.4.2 Extension 1 9.4.3 Extension 2 9.4.4 Corrigenda 9.5 Conformance Testing 9.5.1 Standard 9.5.2 Amendment 1 9.5.3 Corrigenda 9.6 Reference software 9.6.1 Standard 9.6.2 Extension 1 9.6.3 Corrigenda 9.7 DMIF

29

9.7.1 Standard 9.7.2 Corrigenda 9.8 Optimised software 9.8.1 Technical Report 9.9 4 on IP Framework 9.9.1 Standard 9.10 Hardware Reference Description 9.10.1 Technical Report 9.11 New video compression work 9.12 Digital Cinema 9.13 Explorations 9.13.1 Fine Granularity Scalability 9.14 Workplan 10. MPEG Phase 7 10.1 Requirements 10.2 Systems 10.2.1 Standard 10.2.2 Version 2 10.3 Description Definition Language 10.3.1 Standard 10.4 Visual 10.4.1 Standard 10.4.2 Version 2 10.5 Audio 10.5.1 Standard 10.4.2 Version 2 10.6 Description Schemes 10.6.1 Standard 10.4.2 Version 2 10.7 Reference software 10.7.1 Standard 10.4.2 Version 2 10.8 Conformance Testing 10.8.1 Standard 10.9 Extraction and use of visual descriptors 10.9.1 Technical Report 10.10 Workplan 11. MPEG phase 21 11.1 Requirements 11.2 Vision, Technologies and Strategy11.3 Digital Item Declaration 11.4 Digital Item Identification and Description 11.5 Intellectual Property Management and Protection

30

11.6 Rights Expression Language 11.7 Rights Data Dictionary 11.8 Digital Item Usage Environment Description 11.9 Reference software 11.10 Other MPEG-21 parts 11.11 Workplan 12. Overall WG11 workplan 13. Explorations 13.1 Lossless audio coding

14. Liaison matters 15. Administrative matters 15.1 Schedule of future MPEG meetings 15.2 Promotional activities 16. Organisation of this meeting 16.1 Tasks for subgroups 16.2 Joint meetings 17. Planning of future activities 18. Resolutions of this meeting 19. A.O.B 20. Closing

31

Annex 4Requirements report

Source: Rob Koenen, Keith Hill (for MPEG-21)

MPEG-4

MPEG-4 Part 2 (Visual) Requirements, Profiles and Levels7785 Amending definition of the supporting tool by Core Scalable Profile in 14496-2 - JNB7766 Comment on 14496-2:2001 - The National Body of KoreaThese two contributions report a problem with Core Scalable Profile: the tool “Object Based Temporal Scalability” is missing in the definition of Core Scalable Object Type. The following was decided:

1) The problem was acknowledged as editorial oversight;2) A resolution from Requirements was drafted alerting NBs to the problem;3) The Video Group would put it in list of problems, (Implementers Guide Study Document);4) It would be corrected in the first upcoming corrigendum

7651 Request for use of error resilience tools with MPEG-4 Simple Scalable – P.HobsonThe contribution proposes a change in Simple Scalable Profile definition, to add error resilience tools in the enhancement layer.The tools suggested do not impose significant complexity. The meeting thought it is a good proposal, also companies with an interest in implementing the profile thought so. The Requirements Group suggested to include all error resilience tools, not just the resynch markers as requested in the contribution.The proposed change Can break existing implementations, however.The following was decided:

1) Requirements group will do resolution asking NB’s to comment.2) The Group intends to move forward with a amendment at next meeting in the absence of

objections.3) Will send liaison statement to 3GPP2 who have shown interest in the Profile.

Standardization of 3D-Video Description – R. Yamashita, T. Matsuyama, K. HasidaThe interesting contribution proposes that MPEG work on 3D video description and coding. The Requirements Group was interested in the application and welcomed the real-world usage examples. There were discussions on what the exact interface points were that MPEG would need to standardize. Suggestions included

Camera parameters Curved surface coding Multiview coding

First requirement gathering work started at the meeting, and continued in a new AHG.

7619 Levels for Visual Profiles - Fernando Pereira, Paulo NunesThis contribution is an extremely informative collection of all the Profile and Level information available in MPEG-4 Visual. A great document, very helpful to implementers; the Requirements Group decided to make it into an output document and to recommend public availability.

MPEG-4 Part 10 (JVT) Requirements The draft requirements as edited by the JVT were approved by the Requirements Group.

32





Ajay to deliver to Rob by Thursday. Need to discuss status and header with Gary.Will be approved between 9 and 10 am on Friday morning.

MPEG-4 Systems Profiles and LevelsIt was decided to remove old and dysfunctional scene graph levels definitions because they are inadequate and not implemented (not even by the originators). because they are broken in Scene. New level definitions will be supplied in their place.

7706 Request for fixing the definition of profiles and levels in Systems – J.-C. DufourdContributino suggest a fix for a bug in definition of profiles and levels in MPEG-4 Systems. The fix is to change “max 127 Transform2D nodes” into “max 127 Transform2D nodes or instances thereof through DEF and USE and PROTO and EXTERNPROTO” everywhere in level definitions.The Requirements Group decided to follow the suggestion. It requires a Corrigendum, the earliest opportunity is the DCOR2 that is underway. Jean-claude Dufourd was tasked with putting it into the edit list. Future Level definitions will need to follow the same approach.

7605 Various Fixes for Pattaya - Yuval FisherLevel 1 – Only one active MatteTexture node in the scene at any time. Total pixel area of MatteTexture equal to the total macro block pixel area allowed by the adopted visual profile. No BLUR function for s > 2. We can use twice screen area for CIF.

Level 2 - Total pixel area of MatteTexture equal to the total macro block pixel area allowed by the adopted visual profile. No BLUR function for s > 2. The contributor suggests the use this level in HDTV too, but more pixel area would be required. (The Maximum of [2xCCIR 601] and [pix area of max num MBs]). The Requirements Group agreed to rather add another Level: Level 3 for HDTV. There was consensus to not define that now, but at a later stage, when needed.

7659 Main2D and Advanced Main2D Profiles: Levels definitions – Wood, KimWith the addition of 2 Level definitions for Main2D Profile, the requirements for adopting this profile in the standard have now been fulfilled.

In addition there is a request for AdvancedMain2D (‘Advanced and a half’) but it is unclear why this should be created. There is no evidence that it is sufficiently different from the existing profiles. Fortunately, we have one more meeting to resolve the issue. It will now be included in the Profiles in the PuC document. Main2D will be taken out of the PuC.

7749 scene broadcast & multicast - alexandre cotarmanac'h, dominique curetThe contribution suggests the solution of a problem that exists in broadcasting MPEG-4 content. The question was whether a call for proposals was required. The Requirements Group agreed that the nature of the work was not such that it warrants a CfP; rather, the decision was to do the technical work in MPEG, and to write technical requirements in the context of the Systems Group. No new functional requirements were needed.

7735 Web3D X3D Profile proposal to MPEG - Aaron Walsh (Web3D)

33





Good updates for the Profile were received. The bitstream exchange requirements still need to be fulfilled. This can be done before the next meeting, when the amendment will progress to FDAM status.

Formatted Text It was agreed by the Requirements Group that formatted text is not supported by MPEG-4 in a way that predictable text output can be achieved with sufficiently powerful lay-out options. After some discussion, it was agreed that a more thorough requirements study should be done, after which a Call for Proposals could be issued. The Call is anticipated for the next meeting. It was agreed to explicitly look at existing solutions, and to involve experts in the work. The requirements works would include text and advanced 2D graphics, where also some deficiencies exist.

JVT Requirements 7667 Report of the Ad-hoc Group on Requirements for Joint Video Project - Ajay LuthraThe AHG Report was acknowledged, and, after more discussions, a first Requirements Document was approved by both the JVT and MPEG’s Requirements Group.

7782 JNB comment on JVT activity - JNBComment requests at least doubling compression ratio, and for scalability interlaced coding to be added to the requirements, as well as complexity to be considered. The Requirements Group noted that efficiency improvements are hard to quantify. Current performance seems to be in the requested range. While the group agrees with requirements for scalability and interlace in principle, it is unclear if all these can be achieved in the first phase of the project. This is left to the JVT to address.

7755 Requirements for the Joint Video Project - S.Adachi, et. al.The contribution proposes requirements along the lines of the JNB contribution, while being more specific. Work would continue an in break-out group, and was consolidated in the JVT Group.In general, the remark was again that it is hard to quantify certain things such as improvement gains, and to make decisions dependent on that.

7851 Issues on MPEG-4 part 10 - Jan van der Meer, Yann Le Maguet, Marc LegrandGood Contribution for complexity issues, includes useful core experiments. The group agreed it was a bit early to define profiles at this level of detail. There were relevant level definitions. An open dialog with the Implementation Studies Group is beneficial.

7789 JVT requirements on backward compatibility with MPEG-4 Visual - Yoshinori SuzukiThis was a good contribution for discussing whether or not to proceed. The Requirements Group understood that some of the results were obtained without ¼ pel MC, multiple reference frames and arithmetic coding. This means that it was quite far from the actual performance. (note that Baseline ITU contains 5 reference frames and 4x4 MC).

7665 Improved Video Coding using H.26L ME/MC Techniques - M.Hagai, et.al.The contribution states that MPEG-4 basics plus a number of modified H.26L tools gives a quality that comes close to H.26L. The contribution gave an insight into the source of the performance increases.

7841 Syntax Requirements for Enhanced Compression - Weiping Li, Fan LingThis contribution demonstrates the possibility to create a specific type of compatibility, by defining object type at the video level. The tools are not necessarily compatible.

34





The discussion on compatibility reaches the conclusion that it has not been shown that similar performance to H.26L can be achieved while largely maintaining compatibility. Interesting contributions have shown that it is possible to switch tools in and out of the MPEG-4 Part 2 codec and then achieve more or less the same quality. The consensus is that the amount of tools that needs to be changed is such, that no backward compatibility can be achieved if the decoder is to remain simple. Of course backward compatibility is always possible – it can always be achieved by s single bit that switches between Part 2 and Part 10. This brought the discussion to a different kind of compatibility: decoders could support both part 2 and part 10. It is even conceivable that Profiles be defined that, e.g., include both Advanced Simple and JVT object types.

Liaison from IMTC – Dave Lindbergh (no number)A liaison from IMTC on Requirements was discussed. It asked for:

1. Single common video codec standards2. Set of relatively few profiles, but no individually selectable options,3. File format4. Single nickname5. Common royalty-free baseline, and other patents should be economically supportable6. Reasonable complexity7. Matching performance for equal compute cycles8. Best standards9. 50% bitrate reductions for equal quality10. A standard consisting of Text + SW11. Draft versions posted to be publicly available

With the same remarks about point 9 as were made before, the meeting largely agreed with the liaison. JVT to write liaison in return.

Digital CinemaAfter having gone through a round of proposals and evaluations, it now becomes clear that market demand for a new codec is not fully understood. Liaisons will be sent to interested parties, asking for clarification. Separate liaisons are drafted for Archive and Distribution applications.

Lossless Audio Coding7678 Report of AHG on Issues in Lossless Audio Coding - Takehiro Moriya There was discussion on where the exact need resides for lossless coding. Also, there are somewhat differing opinions on what the exact goal should be, e.g.truly lossless, almost truly lossless, or aurally lossless. It was not clear who the customer would be. However, the fact that there are products in the market that address lossless coding, and that sell, is an indication that a need apparently exists. This need must be documented before proceeding. It was decided to use one more AHG period for such a study.

MPEG-7

Requirements7620 Proposal for MPEG-7 Requirements Document V.16 - Fernando Pereira (editor)Updates were discussed and approved

7741 Report of MPEG-7 Applications and Promotions to Industry AHG - Neil Day 7760 Update on MPEG-7 Applications and Demos - Neil Day on behalf of MAPI AHG7710 Proposal for MPEG-7 Overview update - Jose M. Martinez (editor)7759 Draft Web Layout for MPEG-7 Info Center - Neil Day on behalf of MAPI AHG

35







7727 MPEG-7 Interoperability test Bed (M7ITB) Status Report - Wo ChangMost of the ‘Marketing/PR’ issues should move to the MPEG-7 Alliance. The question whether MPEG should host an MPEG-7 testbed was discussed. The Requirements Group agreed that this is a function that is better fulfilled outside of MPEG. Conformance should come first anyway.

MPEG-7 ProfilesThe Requirements Group discussed whether TV Anytime could help MPEG in its thinking about MPEG-7 Profiles. TVA has adopted a subset of MPEG-7, and does not think about profiles (yet). There are also no compliance requirements or rules for interoperability yet, but work on that has started. Companies common to TVA and MPEG-7 tried to harmonize but did not fully succeed.

Is it worthwhile to make profile out of the subset chosen by TVA, and turn that into a profile? This would be difficult, because TVA has defined additional DSs that duplicate functionality of MPEG-7 DSs, and the MPEG-7 profile wouldn’t be useful without them.

The Toplevel element performs a limiting function, and provides a natural subsetting of tools. It may not be enough for achieving our Profiling goals, but a closer look at the tools would be needed.

7823 A Text Indexing Profile for MPEG-7 MDS - Eric RehmThis contribution proposes an MDS-only ‘Simple’ Profile, a Summary profile (superset of Simple) and a Logging Profile (again a superset). The Requirements Group considered the proposals to be based on a very useful approach. The Profiles are ‘clean’ and do not break the schema; mandatory elements are always included. In a sense, Simple Profile is a schema itself. It was decided to start the MPEG-7 Profiles under Consideration document with these profiles. It would also include Profile ideas developed in the Audio Group.

It was noted that Profiling ands Conformance should be consistent.

The new version of the Profiles and Conformance document is now to include a section on Profiles under Consideration, and will have:

approach to profiling requirements for profile definition potential profiles with

o supporting companieso conformance commitmentso and whatever else we think is needed for profiling in MPEG-7

A session on Conformance with all groups gave an overview of the status.

MPEG-21

20.1 Requirements – General7596 Summary of Response to Proposal of 21000-5 (SC 29 N 4451) - SC 29 Secretariat7597 Summary of Response to Proposal of 21000-6 (SC 29 N 4452) - SC 29 SecretariatSome NB’s are against splitting MPEG-21 in too many parts. The Requirements Group is of the opinion that it will facilitate distributing the work, and that the different parts are independently useful.

7607 USNB Contribution: Subdivision 4 of the ISO/IEC 21000 - A. G. Tescher for USNB

36




The Requirements Group agrees with the USNB that name change is needed for MPEG-21 IPMP, but did not particularly like the name suggested by the USNB (IPMP Framework) as that is too close to what MPEG-21 as a whole means. The suggestion was made to use ‘IPMP Tool Representation and Communication System’. This was laid down in a Requirements Group resolution.

7764 Draft MPEG-21 Requirements Document - Jan Bormans It was good to have a draft MPEG-21 requirements document that now starts containing some substance. The document should include:1. Detailed requirements for what is already in progress2. Similarly detailed requirements for what needs to be addressed in the futureThis is very much like the situation in MPEG-4 and MPEG-7

7803 Peer-2-Peer Digital Items - Paul Ruskin (UoW), Ian S Burnett (UoW)Want to transfer Session State information. Will address in MPEG-21 Requirements Document and possibly DIA Requirements context.

7804 Packaging Context Information Using Digital Items - Ruskin, Burnett (UoW)Proposes elegant solution of transporting context (environment) information: to use a Digital Item. Basically and answer to the requirements in M7803.

Technical Integration of the different parts and Persistent AssociationThere are a number of work items that need coordination and harmonization:

1. Digital Item Declaration – stable (part 2)2. Digital Item ID& Description (CD!) (part 3)3. MPEG-21 /MPEG-4 IPMP (part 4)4. REL (part 5)5. RDD (part 6)6. Persistent association of identifiers (DII&D) content.7. MPEG-7 Descriptions

The question was raised if we need to solve the MPEG-wide IPMP problem in MPEG-21. The conclusion was that MPEG-21 is indeed the right place.The REL/RDD will allow us to replace currently opaque data with normative data. Each time you do that it enhances interoperability.

There is a reasonable understanding on: How DID and DII&D interact Where REL expressions would go in Declaration (but how would it work exactly?) Where REL/RDD would be useful in IPMP

There was the question whether we can do subsetting/profiling of RDD/REL yes, but note that RDD is currently EMPTY.IPMP will try to describe how the IPMP framework and REL/RDD work together. This will be done with experts from MDS.

7568 Mapping of MPEG-4 IPMP Extension into MPEG-2 system - Ming Ji, et.al. 7853 MPEG-2 IPMP and its Potential Application to DVB CPCM - Ming Ji, et. al.The contributions proposed a solution to MPEG-2/DVB Requirements. It had already been proposed to DVB. It is also relevant for TV-Anytime.The Requirements Group agrees that it is highly useful to have a mapping of IPMP to MPEG-2, which must also be compatible with MPEG-4 on MPEG-2. It should address:

37




1. MPEG-2 content in MPEG-2 Systems protected by this system2. MPEG-4 content in MPEG-2 Systems protected by this system (using the MPEG-4 over

MPEG-2 spec)3. Mixed MPEG-2 and MPEG-4 content over an MPEG-2 System – may not be a DVB

requirement, but is definitely and MPEG requirement.

A liaison was drafted for DVB, stating that MPEG has the technology and is prepared to amend the MPEG-2 spec (MPEG-2 IPMP) to enable this DRM functionality in MPEG-2.

7754 Advantage, disadvantage of current IPMP extension as MPEG-21/IPMP – I. Kaneko The Requirements Group thinks that (as stated above) an IPMP extension to MPEG-2 is desirable to enable DRM for MPEG-2 services.

7555 ISMA Contribution on DRM Direction in ISMA - Pete Schirling for ISMA DRM WGLast week ISMA decided to go forward with DRM in ISMA. ISMA has commitment to use open standards, and wants to use MPEG-4 IPMP. Will track development from ISMA point of view. We will send a liaison to ISMA on the matter.

There is stall an open issue in synching keys and media data on MPEG-4. This should be addressed in the MPEG-4 IPMP extension

7808 Report of Ad Hoc on Persistent Association - Paul JessopSee 7636

7636 Requirements for the Persistent Association of Identifiers - Rump, Sakamoto for AhG (The following are meeting notes that record the essence of the discussions)The issue is really the persistent association of information, not necessarily identifiers, with the media data.

It was agreed that a Digital item is not the same as a resource (which can be part of a Digital Item)Complete DI’s also need to be able to be managed, this can conceivably be done with the use of persistent information associated with some but not all of its resources. The DID currently specifies association but not persistent binding

We need to make a distinction between: 1) Associations that survive a wide range of transformations (such as DA conversion) –

Property of the resource2) Associations that are intended to persist only within an IPMP governed environment –

Property of the resource or the Digital Item. IPMP system governs integrity of the resource and the Digital Item

Thee needs to be a path from persistent information to an ID to the Description of the Digital Item (including the Rights description)This path can be:

Very indirect (through multiple resolutions) Very direct (Information directly bound to resource) … and everything in between

Classes of information to be bound (all ‘Descriptions’ in MPEG-21):1. Identifiers (URIs in MPEG-21) 2. Rights expressions:

38





From simple (single-bit ‘do not copy’) To complex

4. Offers 5. Tracing information (information about ‘past life’ of the Digital Item)

I further AHG study work, the following needs to be tackled: Extracting requirements strictly for the binding itself Determine whether other requirements are already met by DID and DII&D Make sure the requirements take into account indirect binding through explicit language

7708 Proposed Usage Scenarios for Persistent Association of Meta-data in the Determination of legitimate versus Illegitimate Digital Items - Barney WraggThis was a great analysis of the situation, leading to fruitful discussions and some conclusions. Again, meeting notes follow.The contribution distinguishes three content types:

Open – no permissions associated Legitimate Content – pre-described usage permissions Illegitimate Content – there is a watermark, which indicates there should be permissions

associated with it.

Watermarking a DI – what does it mean? It means watermarking a resource in the DI

Are the tools present or not? Watermarking – standardize? (Old discussion …) There are risks associated to global secrets.

They can still be protected by legislation? Use parametric tools from ‘structured IPMP’ for this?

Fingerprinting – standardize? There are some conceivable attacks on fingerprints; fool the IPMP system into thinking it’s a different piece of content, with different metadata (rights) associated with it.

For further study where (some of it during the Pattaya meeting) What elements in MPEG-21 support this scenario?

o Identificationo Resolutionso Authentication of descriptions

Requirements for fingerprinting and watermarking (even if MPEG doesn’t standardize the requirements are still useful)

Look at current IPMP tools under development (e.g. parametric tools)o What is the scenario with watermark algorithms that can be

changed/updated? How does it work with content already deployed? How do terminals get the new tools? – Algorithm resolution service, unique ID for these?

IPMP in MPEG-21This was a brainstorm on how IPMP would be incorporated in MPEG-21. This discussion was broad; below some notes.

So how does IPMP work? A short walk through:Preconditions

1. Declaration arrivesProcessing

2. Declaration is parsed

39


3. Parser encounters an IPMP descriptor that identifies a scheme. DID parser parses the IPMP scheme the IPMP scheme identifier together with the protected content (or the means to obtain it) to the IPMP System. Note that the protected content can be another DID, a DID fragment or a resource

4. DID parser encounters a D containing and MPEG-7 Description, and invokes MPEG-7 parser, parsing the description to it. MPEG-7 Description may itself be protected, and the protection scheme can be identified by a sub descriptor within the parent descriptor.

The discussion brings up the potential need for an MPEG-21 Systems Standard? If anywhere, the integration of the different pieces of MPEG-21 should be described there. An AHG is formed to create a much-needed technical architecture-level view of MPEG-21.

There was agreement that a unified view of MPEG-21 is required. MPEG-21 does not need infinite flexibility, but it does need clear ways to do everything that needs to be done – in at least one way.A ‘draft requirements document for persistent association of information with digital items’ was output at the meeting.

REL and RDDThe technical work on the RDD/REL was handed over to the MDS Group. Requirements discussions continue in the Requirements Group.

7672 Rights Markup Extensions for the Protection of Indigenous Knowledge - Jane HunterThe recommendation of this contribution is to add 3 types of customary constraints: Test, Warning, Request. These would be needed to support protection of Indigenous Knowledge. Jane was to seek further input from indigenous communities.

It was noted that the requirements are broader than indigenous communities, but extend to other situations as well.

7617 Thoughts on building a Rights Expression Language - David ParrottThe contribution has many aspects, among which an interesting approach using style sheets to transform rights in certain situations. It proposes more than just language, also a governance infrastructure. It was agreed that doing the contribution justice would be hard without the author present, but would still be attempted in the ongoing work.

7688 Rights Language Evaluation Criteria – M. Nalebuff, B. Atkinson, M. ParamasivamThis contribution was already briefly discussed in the evaluation AHG. It is an interesting approach to clustering the requirements, giving more insight. It was agreed that some requirements are more important than others; MPEG expresses this through consistent use of the words “Shall”, “Should” and “May”. Also agreed that was no immediate action was required.

7840 Comments to the Call For Proposals for a RDD and a REL - Phil LelyveldThe Requirements Group agreed with the contributor that MPEG-21 shall support the requirements as expressed in this contribution, i.e. that the REL/RDD should go beyond simple one-step content distribution. In fact, the views expressed in the contribution are very much in line with the views that underpin the MPEG-21 standard.

7654 OeBF Liaison Statement and Rights Language Requirements - Chris Barlas, et.al.The OeBF liaison was welcomed by the meeting. MPEG keeps being of the opinion that it will be beneficial to have a single REL and RDD across industries, and is open to working with parties such as OeBF to make that happen. The Requirements Group accepted the invitation to have a joint AHG meeting in January, and looks forward to a continued and fruitful liaison.

40






DI Adaptation7623 Report of the AHG on MPEG-21 DIEUD - Anthony Vetro (on behalf of the AHG)7624 MPEG-21 Requirements on DIEUD - Anthony Vetro (on behalf of the AHG)7644 MPEG-21 requirements input based on media resource delivery – A. Perkis et.al. 7686 Use Case Scenarios for MPEG-21 DIUED - Sasaki, Robins, Youngsik Huh7652 Report of the Ad-hoc Group on the BSDL - Sylvain Devillers, on behalf of the AhG7653 MPEG-21 Draft Requirements on BSDL and Content Adaptation - Devillers, Amielh7763 The use of BSDL for view-dependent 3D VTC applications – Roberto Osorio, et.al.

Many discussions took place to define the scope and extent of the Call for Proposals for Digital Item Adaptation – as we will call this part of the MPEG-21 Standard from here on.DIA will constitute a description of environment, used in the client, but increasingly also in the network, to allow intelligent adaptation of Digital Items to the consumption circumstances.The view is that the difference between server and network may blur, and that server functionality may eventually percolate into the network. There is a clear relation with QoS, but the tools are of different. One may be used without the other.

In the context of this discussion, there was some concern over an ‘explosion’ of MPEG-21 parts. It would be difficult to explain and difficult to manage. The counter-example that was cited to work well was MPEG-4 Systems, which is a single part with many tools that have a common goal. It was also noted that MPEG-4 Systems might be too diverse, and is hard to manage as a single entity. In any case, the relation between the different parts needs to be made clear (and normative), which goes back to the MPEG-21 Architecture and MPEG-21 Systems discussion, see above.Some people believed even DIA itself should consist of different parts. There was consensus that we do not need to decide now about how the DIA exactly fits into the standard; we can take that decision after proposals have been reviewed. The meeting leaned towards one single part though.It was decided to do a Preliminary CfP now, a final CfP in March, with proposals due in May, reserving the right to update the Call in March meeting.

The individual contributions were discussed in break-out sessions and incorporated into the DIA Requirements Document.

41






Annex 5Systems report

Source: Systems Chair and Break-out group ChairsEditor: Olivier Avaro (France Telecom R&D)

Contributors:Olivier Avaro (France Telecom R&D), Jean-Claude Dufourd (ENST), Jan Van der Meer (Philips), Craig A. Schultz (AccessTickect), Michelle Kim (IBM), Young-Kwon Lim (MP4Cast), Zvi Lifshitz (Optibase), Claude Seyrat (Expway), David Singer (Apple).

OverviewThe main results of the meeting from the Systems Sub-group perspective are:

MPEG-2 Systems 13818-1Study Text of ISO/IEC 13818-1:2000/FPDAM1 N4403 NoText of ISO/IEC 13818-1:2000/COR2 N4404 NoWD 1.0 of IPMP framework on MPEG-2 Systems N4405 NoMPEG-4 Systems 14496-1:2001ISO/IEC 14496-1:2001 3rd Edition N4406 NoText of ISO/IEC 14496-1:2001/DCOR2 N4407 NoMPEG-4 Systems 14496-1:2001 Amd. 2 (XMT)Study Text of ISO/IEC 14496-1:2001/FPDAM2 N4408 NoMPEG-4 Systems 14496-1:2001 Amd. 3 (IPMP)Draft MPEG-21 Architecture N4410 NoStudy Text of ISO/IEC 21000-4/CD N4411 NoStudy Text of ISO/IEC 14496-1:2001/PDAM3 N4412 NoDraft DoC of ISO/IEC 14496-1:2001/PDAM3 N4413 NoMPEG-4 Systems 14496-1:2001 Amd. 4 (AFX and MuW)Request for Amendment 4 for ISO/IEC 14496-1:2001 N4414 NoISO/IEC 14496-1:2001/PDAM4 N4415 YesCore experiment on interpolator compression N4416 NoMPEG-4 Systems 14496-1:2001 Amd. 5 (MP4)Request for Amendment 5 of ISO/IEC 14496-1:2001 N4417 NoText of ISO/IEC 14496-1:2001/PDAM5 N4418 YesRequest for Amendment 6 of ISO/IEC 14496-1:2001 N4419 NoText of ISO/IEC 14496-1:2001/PDAM6 N4420 YesMPEG-4 Systems 14496-4 (Conformance)Text of ISO/IEC 14496-4:2001/FPDAM1 N4421 NoWD 3.0 of ISO/IEC 14496-4:2001/Amd2 N4422 NoText of ISO/IEC 14496-4:2001/DCOR1 N4423 NoMPEG-4 Systems 14496-5 (Reference Software)MPEG-4 Systems Software Status N4424 NoMPEG-4 Systems Software Implementation Workplan N4425 NoText of ISO/IEC 14496-5:2001/FPDAM2 N4426 YesMPEG-4 Systems 14496-8 (4/IP Framework)Text of ISO/IEC 14496-8/FDIS N4427 NoRTP payload formats for carriage of MPEG-4 content over IP Networks N4428 YesMPEG-7 Systems 15938-1 (Systems)

42

Draft Call for Proposal on MPEG-7 Systems Extensions N4429 No“How to” integrate specific decoders in BiM N4430 NoGeneralFAQ Revision 18.0 N4431 YesProblem statement on stream synchronization. N4432 NoProblem statement on time discontinuity handling at SL level. N4433 No

General issues

GeneralM7554 : The Systems meeting report has been approved.

Reference Software Implementation and demonstrationsThe following demonstrations have been made :

M7850 : Demonstration of content created by ENST. Cartoons and various other demonstrations showing the power of BIFS authoring tools from ENST. M7811 : Client-server systems with 3D BIFS and life video. Envivio demonstration : Various 2D BIFS scenes with audio and video demonstrating “quality” content. Philips Demonstration : Demonstration of MPEG-4 Core2D content on a Pocket PC.

Web siteThe Systems Web site at http://garuda.imag.fr/MPEG4/ still needs major redesign and updates. Resources and process should be discussed in the general MPEG Systems reflector between now and next MPEG meeting.

FAQThe FAQ were updated and output at this meeting.

AOBNone.

MPEG-2 Systems (13818-1)

13818-1:2000/Cor2Topics

Elementary Stream ManagementBuffer model for PID2.

Status

DCOR2 2001-07. COR2 2001-12.

Contributions

Elementary Stream ManagementFinalization of the COR2 (No national body comments).

13818-1:2000/Amd. 1Topics

43

Elementary Stream Management1. Transport of metadata over MPEG-2.

Status

Inputs and comments requested.Study of FPDAM 2001-12. FDAM 2002-03. AMD 2002-05.

Contributions

Elementary Stream ManagementThere are virtually no input contributions on the transport of MPEG-7 metadata on MPEG-2 Systems. This can be very damageable to the deployment of the MPEG-7 standard in this environment. Contributions on that topic are highly welcomed. A study of FPDAM has been produced for he transport of metadata on MPEG-2 Systems.

13818-1:2000/Amd. 2Topics

IPMP2. IPMP Tool Representation and Communication Systems mapping on MPEG-2 Systems

Status

Inputs and comments requested.2001-12. WD.

Contributions

IPMPM7568, M7853: Mapping of IPMP on MPEG-2 and its potential application to DVB/CPCM. Proposed changes to the message interface as well as proposed messages to be added as study items. New amendment of the MPEG-2 specification initiated.


14496-1:2001 3rd EditionTopics

Integrated version 3. Integration of 14496-1:2001, 14496-1:2001/Amd1, 14496-1:2001/Cor1

Status

3rd Edition 2001-12.

Contributions

Integrated version M7648 : The document will be taken as the basis to produce the third edition of ISO/IEC 14496-1.

14496-1:2001/Cor2Topics

44

Various corrigenda

Status

DCOR2 2001-12. COR2 2002-03

Contributions

Various corrigenda M7846 : This document will be taken as the basis for DCOR2.M7816 : Reformulation in delta style of what is in Cor2 WD. Approved for inclusion.M7749 : Current SL does not allow identification of the expected next packet. This is problematic for the carousel mechanism. The proposal is to add two fields to the SL layer (what is the version number and what is the version number of the next expected packet). The requirement is more general (e.g. it applies to IPMP as well). Process will be set up to solve this issue (cf. Systems resolution).M7647: The specification needs to be corrected since it does not support ECMAScript fully. This will go in COR2. If some people requires the functionality not supported by the MPEG-4 binary version of ECMAScript, they should demonstrate the need of it and propose a new amendment.M7605 : Bug reports. All points have been discussed and enhanced for inclusion in COR2, but the inclusion of MatteTexture that have been discussed with requirements (see reports on BIFS Profile).M7758 : Late contribution from Alexandre Cotarmanac’h. Comments wrt Systems : editorial clarifications on the Systems spec. w.r.t. Systems specification and FBA. Approved. Proposed correction so that a BIFS Anim can not contain a mixture of FBA streams, BIFS Anim of IFS2D. Will be included in COR2.M7777 : Usage of 3DMC in BIFS. Proposed amendment to expose feature inside a model coded by 3DMC in order to animate it. The functionality fits in the MPEG-4 requirements but needs to be added so that it does not break existing bitstream. Contribution expected for the MuW/AFX amendment.M7776 : Bug report of BIFS Coding Technology. There could be a bug in the algorithm of the arithmethic encoder. The algorithm have some limitations. At the decoder side, decoder crashes are also reported. The bug in the implementation has been fixed and Im1 will be updated.M7615 : VRML amendment. To be studied on the BIFS reflector.M7553 : The comments of the FNB have already been integrated in COR1. No action needed.M7706 : Request for fixing the definition of profiles and levels in Systems. The problem is agreed. Existing levels will be fixed accordingly. New levels will be design taken into this complexity dimension.M7646 : The first two clarifications are accepted. The third one is rejected.M7750 : Accepted.

Other issues Problem with the event model : no conclusion within VRML. Proposal from Yuval to be discussed. Results of the discussion will be sent to VRML. Obsolete levels definition in Systems : The understanding of the Systems group on how to define levels had evolved since the last two years. Currently some standardized levels definition in Systems can not be meaningfully exploited. There inadequacy was also confirmed by the originator of these levels. Since these levels could create confusion, they will be removed. Object type indication : Do we deprecate 0xFF ? Proposed text for Cor2. Complete solution will be discussed on the BIFS reflector.

14496-1:2001/Amd. 2Topics

45

MPEG-4 Textual Format4. XMT-A5. XMT-

Scene Description6. Media Sensor7. MediaControl8. MediaBuffer9. MatteTexture

Elementary Stream Management10.OD Framework additions (OD execute, Segment Descriptors)11.MP4 additions

Profiles and Levels12.Web3D Core (Scene Graph and Graphics) profile.13.Basic2D, Core2D, Advanced2D (Scene Graph and Graphics) profile.

Status

Inputs and comments requested.PDAM 2000-10. FPDAM 2001-07. Study of FPDAM 2001-12. FDAM 2002-03.

Contributions

MPEG-4 Textual FormatM7660 : Study text. Taken as starting point for output doc.M7590, M7681 : Comments on XMT. Disposition documented into the output study doc.

Scene descriptionNone.

Elementary Stream ManagementNone.

Profile and LevelsM7679 : Signaling of the profile and levels in the IOD. Will be included in the amendment.M7680 : Accepted with modifications. To be appended to 9.2.2.7.3. “In case the URL field does not comply to the OD URL syntax, the behavior is unspecified, unless specified”. M7605 : Levels proposal for MatteTexture. Accepted. Will be included in the current amendment with modification: the proposal has dependency on the visual. This will be changed and the pixel area will be “hard coded” in the level definition.M7735 : Proposal of graphic and scene graph profiles. Set of functionality proposed as a minimum set and has been agreed. Bit stream are not here currently so the profile won’t be included in the amendment. Since the amendment has been postponed to March, it is still possible to add this profile at the next MPEG meeting provided the streams are produced. MPEG-4 extensions should be added : updates, compression features, as well as visual and audio nodes (Movie Texture, Sound and Audio Clip).M7659 : Proposed level 1 and level 2 for Main2D. Accepted for inclusion in the amendment. Proposal extension of Advanced Main2D proposal. (cf. resolution in Sydney). Since the complexity process has not been made, it is not possible to progress this profile to amendment or to merge it with Advanced 2D. Advanced Main 2D will be documented in the profile under consideration.

46

Joint meeting with ISGPurpose : Start evaluation of the complexity of Advanced Main 2D. The context of this complexity evaluation was described to ISG as well as some background on Flextime. Work will continue on a dedicate AHG.

14496-1:2001/Amd. 3Topics

IPMP Extensions

Status

Inputs and comments requestedWD 2001-03. PDAM 2001-07. Study of PDAM 2001-12. FPDAM 2002-03. FDAM 2002-07.

Contributions

IPMP Extensions M7817: IPMP trust model. Modify proposed SDL and XML schema to support both the “Attacker and protection” trust model as well as the “Threat model and Protection Profile” trust model. Add to study in section referring to the skeleton message regarding trust model.M7570: Further benefit of IPMP XML. Informative - regarding the benefit of mapping messages to XML.M7591: Summary of Voting on ISO/IEC 14496-1:2001/PDAM 3 (SC 29 N 4445) SC 29 Secretariat. Disposition found in IPMP Ahg Disposition of NB Comments on PDAM ISO/IEC 14496-1:2000 PDAM3 - M7635.M7585: UKNB Comments accompanying the ballot on the IPMP sections of PDAM ISO/IEC 14496-1:2001 / AMD3 Jack Lacy for the UKNB. Disposition found in IPMP Ahg Disposition of NB Comments on PDAM ISO/IEC 14496-1:2000 PDAM3 - M7635.M7575: Report of the MPEG IPMP AHG Meeting - Santa Clara Mike McGinty. Report accepted with numerous mentioned work areas highlighted for action.M7633: Report of the IPMP Ad Hoc meeting - Ottawa - November 12-14 Jack Lacy. Report accepted with numerous mentioned work areas highlighted for action.M7634: Study of Text of PDAM ISO/IEC 14496-1:2000 PDAM3 Avni Rambhia. Accepted as input to continue CD study.M7558: Study of MPEG-4 IPMP Extensions CD Editor: Avni Rambhia. I don't know about this one, it was covered at Santa Clara but for some reason, it was not listed in the meeting report. In any event, pertinent sections were included into the study document as either additions, edits or areas needing further work..M7635: IPMP AHG Disposition of NB Comments on PDAM ISO/IEC 14496-1:2000 PDAM3 Avni Rambhia. Accepted as input to continue CD study. M7557: Comments on MPEG-4 IPMP CD Steve Mitchell, Jack Lacy. Covered at Santa Clara also. Pertinent sections were included into the study document as either additions, edits or areas needing further work.M7559: A Study of IPMP Data Structure Syntax Bruce Chaplin, David Kosiba, Ivan McLean. Covered in M7575.M7560 A Study of IPMP Message Syntax Bruce Chaplin, David Kosiba, Ivan McLean. Covered in M7575.M7561 New IPMP System Architecture Diagram Bruce Chaplin, David Kosiba, Ivan McLean. Covered in M7575.

47

M7562: A Study of Descriptor ID Values Bruce Chaplin, David Kosiba, Ivan McLean. Covered in M7575.M7563: A Study of IPMP Tool Message Type Values Bruce Chaplin, David Kosiba, Ivan McLean. Covered in M7575.M7564: New IPMP Tool Mssages for Querying Parametric Capabilities Bruce Chaplin, David Kosiba, Ivan McLean. Covered in M7575.M7569: Proposal on improvement of the current MPEG4 IPMP Extension CD SM Shen, et al. Covered in M7575.M7566: Proposed definition for the intent messages as defined by ISO/IEC 14496-1:2000 / AMD3 [email protected], [email protected], [email protected]. Covered in M7575.M7567: Definition for a Secure Message class for ISO/IEC 14496-1:2000 / AMD3. [email protected], [email protected], [email protected]. Covered in M7575.M7565: Usage Scenario for MPEG Intellectual Property Management & Protection (IPMP) Application to Digital Cinema Chuck Harrison (FFA). Covered in m7575.M7621: OD framework and MPEG-4 IPMP Extensions Jean Le Feuvre. Covered in m7633.

Joint meeting with Requirements and MDSPurpose of the meeting was to develop the MPEG-21 architecture starting with IPMP technology. List of the technology relevant to this architecture:14.Digital items declaration (stable);15.Digital items ID and description;16.MPEG-21/MPEG-4 IPMP (part 4);17.REL;18.RDD;19.Persistent association of identifiers (DIID&D) content.

All these technology have been presented shortly.

Discussion about where IPMP should be ? There are general requirements for IPMP across MPEG.

There is a solution developed with specific mappings to MPEG-2 and MPEG-4, it’s the IPMP framework. MPEG-21 is the right place to develop this technology.

Are there any requirements that exists and that are not solved by the IPMP framework?

To be improve interoperability, this framework needs the REL/RDD. This will be use to whitened opaque data. We need to describe how this architecture uses the REL/RDD developed in MPEG-

21.

Joint meeting with Requirements and MDS Presentation of the mapping of the IPMP framework on MPEG-2. Issues raised on compatibility

with the MPEG-4 on MPEG-2 specification. This shall be addressed by the technical solution. M7754 : showing that it is advantageous to have IPMP in MPEG-21. This is agreed and

technical will be carried on to make this integration happen. M7555 : liaison from ISMA. They will provide specific requirements on IPMP framework. So

far they think IPMP is headed in the right direction.

14496-1:2001/Amd. 4Topics

48







Scene Description20.Multi-user applications21.Animation Framework Extension

Elementary Stream Management22.FlexMux Extensions

Status

Inputs and comments requestedPDAM 2001-12. FPDAM 2002-03. FDAM 2002-07. AMD 2002-09.

Contributions

Scene DescriptionM7751, M7752 : Desription of the MUCommandStream and nodes. Accepted for inclusion in the amendment.

M7600 : InputSensor improvements, clarifications, mappings. Agreed with a small addition: an SFTime field like TouchSensor.touchTime.

SFVec4f (from AFX WD) : Agree that SFVec4f/MFVec4f is acceptable provided specification is updated about quantization, BIFS anim and predictive MFField. Clarification text about Valuator not supported. Clarification text about SFVec4f need not be implemented in strictly 2D/3D (non-AFX) profiles in the same way as SFVec3f need not be implemented in 2D profiles.

M7774: The contribution was presented and there was some technical discussions. CE results were generated by only one party, and neither generated nor evaluated by the other party. Because of the lack of contributions, the group needed to setup precise process to be able to converge. The algorithm and measures have changed since Sydney, thus justifying another round of testing. The group acknowledged the results presented (alleged to be substantially better), and these will be cross-checked. The schedule is in reverse order:

- MPEG meeting (March 11);- one week before the meeting: deadline for contribution (CE result cross-checking) (March

4);- one month before the meeting: deadline for CE results (Feb 11);- two months before the meeting: freeze of test data (Jan 11);- from now, two weeks to check the error measurement program and provide final technical

description of the technology (Dec 24);- from now, one week to fix IM1 implementation of predictiveMFField codec (Dec 17).

To avoid deadlock, each party will provide 50% of the test data base. Proposed streams are checked against requirements before inclusion in the test data base. Each party will provide at least :

Type Number of streamsL1 L2 L3 L4 O

Coordinate 10 10 10 10 20Orientation 10 10 10 10 20

Position 10 10 10 10 20If no test data or insufficient test data is provided by a party, only available data will be used.Spectrum of comparison is less than 10% difference, 10 to 30, more than 30. The comparison is the average of the min and max of this function: (PMF - Samsung)/PMF inside the level domain.

49

M7790: New BIFS Updates. All contributions were reviewed and discussed. The node/route/proto/OD ID spaces in the various nodes need to be clarified. MUAnimStream may not be needed (can find the zoneID through the AnimationStream URL).

Review of AFX: The Systems group reviewed text and asked for text in “amendment form”. Also reviewed in details VIM and its mapping. Curve was identified as needing an extension. It is complex, but complete and useful in other applications. The rest of the technologies were already discussed in Sydney, with fewer changes. The rationale for the list of nodes in AFX has been discussed and agreed upon.

Joint Meeting with SystemsDiscussion about requirements not covered or badly covered within Systems : Formatted text : fonts, formatting, layout 2D Graphics : gradients, arcs, line ends, ovals, rounded rectangles, …

An AHG will be set up to : 1. Develop requirements about advanced text and 2D graphics representation;2. Identify technology that maybe missing or unsuficient in the MPEG-4 specification;3. Get people involved;4. Look at existing technologies.

Stream synchronizationThe problem statement and process is documented in an output document.

Elementary Stream ManagementM7746, M7748 : Extension of FlexMux is proposed (M7746) and the RTP payload format including this extension is also proposed (M7748). Major technical issue is to extend the size of FlexMux packet more than 256 bytes and introduce dynamic signaling of FlexMux configuration. The proposed technologies were on the table more than one year are also implemented in IM1 framework properly. Therefore, it is promoted to be a part PDAM4.

14496-1:2001/Amd. 5Topics

Elementary Stream Management23.MP4 (Base text)

Status


Contributions

Elementary Stream ManagementM7721 : Allow alternative tracks. Accepted, with the words "at one point in time" added after "streamed".

14496-1:2001/Amd. 6Topics

Elementary Stream Management24.MP4 (MPEG-4 specific part)

50

Status


Contributions

Elementary Stream ManagementM7680: OD URL referring to an MP4 File Issue. The MPEG-4 systems specification is quite unclear on how to use the MP4 file format as container for sub-parts of an MPEG-4 presentation. Need to clarify this point. Proposed solution : add the following text in section 13.2.3.4 Object Descriptor Atom of 14496-1:2001:"An OD URL may point to an MP4 file. Implicitly, the target of such a URL should be the OD/IOD located in the 'iods' atom in that file. If an MP4 file contains several object descriptors, only the OD/IOD in the 'iods' atom can be accessed from a remote MPEG-4 presentation." Accepted.

MPEG-4 Conformance (14496-4)

14496-4:2001/Amd1Topics25.Conformance for 14496-1:2001/Amd1 (Flextime)

Status

Inputs and comments requestedPDAM 2001-03. FPDAM 2001-12. FDAM 2002-07.

Contributions

None.

14496-4:2001/Amd2Topics26.Conformance for 14496-1:2001/Amd2 (XMT)

Status

Inputs and comments requestedWD.

Contributions

M7716, M7701 : Contribution of conformant streams. Decision for automatic generation of the per-profile tables in the conformance document, by using the mp4tool features (xml info file) and some XSL style sheet. This means most of the cross checking will be done during the generation of the tables. The tables are then to be humanly checked for missing features (by the next meeting). For the general feature table, the Systems group encourages contributions from the SoNG project to fill the remaining gaps and flesh out the general sequence set.

Location of the streams and process : The streams will be moved out from FZI. FT R&D (Alexandre Cotrmanac’h) and SoNG (Iver) are kindly proposing their services, and they are going to check the feasibility of hosting the conformance sequences. The France Telecom site (ftp.ccett.fr) has been selected. This repository will contain 2 sections, one moderated with cross-checked bitstreams (this section will be publically readable as per the request of ISO) and one upload section. The MPEG login and password is

51

ftp://ftp.ccett.fr/

suggested as an access control mean. The only way to go from the upload to the moderated section is to have a third-party check your streams. The output of the crosschecking process is “Pass” or “Fail” (about decoding only) with detailed report with strongly recommended comments about the rendering result. Part of the AHG mandate should be to keep track of third party checking.

M7822 : Break up Tables for BIFS Streams by Features and Profiles. Accepted.

14496-4:2001/Cor1Topics27.Minor clarification on the textual dump format.

Status

DCOR1 2001-12. COR1 2002-03.

Contributions

None.

MPEG-4 Reference Software (14496-5)

14496-5:2001/Amd1Topics28.Reference Software for 14496-1:2001/Amd1 (Flextime)

Status

PDAM 2001-03. FPDAM 2001-07. FDAM 2002-03.

Contribution

None.

14496-5:2001/Amd2Topics29.Reference Software for 14496-1:2001/Amd2 (XMT and DMIF)

Status

PDAM 2001-07. FPDAM 2001-12. FDAM 2002-07.

Contribution

M7847 : Summary of Voting on ISO/IEC 14496-5:2001/PDAM 2. No action needed.

14496-5:2001/Amd3Topics30.Reference Software for 14496-1:2001/Amd1 (AFX and MuW)

Status

WD.

Contribution

M7815 : IM1 Core code + authoring tools version 5.6. Candidate WD for this amendment. M7668 : Implementation of MPEG-4 DMIF Remote Retrieval Instance and Streaming Server . Candidate WD for this amendment (informative).

52

M7745 : FlexMux implementation within IM1. Confirm that implementation of new FlexMux spec exists.

Transport of MPEG-4 over IP Network (14496-8)

14496-8 Topics31.IETF RFC for transport of MPEG-4 over IP32.Framework for the carriage of MPEG-4 content over IP network.

Status

CD 2001-03. FCD 2001-07. FDIS 2001-12.

Contributions

M7698 : No NB comments on 14496-8 FCD are received. 14496-8 FDIS is produced.


15938-1/Amd 1Topics

Architecture

MPEG-7 binary format extensions

Delivery of MPEG-7 Description33.Transport of metadata over MPEG-2 (See MPEG-2)34.Transport of metadata within MPEG-4

Status

WD.

Contributions

MPEG-7 binary format extensionsM7642: Not reviewed by Systems group : Contributions about Specific video codec in BiM has been reviewed by Video Group. See Video group report.M7726: The contribution describes the updating model defined in MPEG-7 Systems and stress some lacks. It propose to consider its improvement for the future Amd1 of ISO/IEC 15938-1. The document has been reviewed and a work item added to the WD 2.0 of the MPEG-7 Systems Amd1 specification.M7798: The contribution describes a mechanism to associate a reference to a particular node of a payload. This reference refers to a particular fragment of an other access unit. Therefore a terminal can manage a set of reference to recover the referred description sub part. This feature can be used in case of a multi-stream environment, for storing descriptions sub parts on an hard drive or download description sub parts via an IP network. The contribution has been already subject to a mini experiment and the results can be found in M7457. Questions: why not place the reference directly in the payload (by the use for instance of deferredNodes) ? One answer is to ease the filtering of access units. The document has been reviewed and is proposed for Amd1 of ISO/IEC 15938-1.

53

M7844: The contribution was not readable as the archive seemed corrupted.M7845: The document has been reviewed. It proposes the use of “reference/pointer” as an option to “value” for FUPayload in FragmentUpadte Unit. A potential use of this proposal is in distributed metadata environment. The group decided that:1. There is a need to check with the requirement document to see whether there is a need, in

MPEG-7 systems, to support distributed metadata applications. In case the need for supporting distributed metadata is identified new proposals and solutions are encouraged and solicited;

2. Proposal m7845 and m7798 are related.

Joint Meeting with Visual and Audio : Presentation of the BiM extension framework. Audio would need some references. An output document will be generated that describe an “How to” include a decoder into the BiM framework. Configuration of the specific decoders can be out-of-band. A draft call for proposal on BiM extension will be issued.

MPEG-21 (21000)

21000-xTopics

Architecture

Status

Contributions

ArchitectureNone. Contribution on the MPEG-21 architecture are expected for the next MPEG meeting. Preliminary discussions have started as reported in the requirement report.

21000-4Topics

IPMP

Status

CD 2001-07. FCD 2002-03. FDIS 2002-07

Contributions

IPMPJoint meeting with Requirements and MDS on MPEG-21 Architecture(See requirements report)

Other activities Time Discontinuity M7744, M7747 : This contributions state the problem (M7744) and a possible solution (M7747) of time discontinuity when the streams are switched at SL layer. However, it is not clear whether this functionality is crucial at this layer because the transport layer could handle time discontinuity. Therefore, more contributions and/or interests on this issues are solicit (cf. resolutions).

54

QoS Traffic DescriptorM7740 : This contribution is proposing an extension of QoS_Descriptors of DMIF to adapt the traffic shaping characteristics of existing networks. The decision is not so clear at this moment. This needs more investigation.

Joint meeting with JVTA first meeting has been held between Systems and JVT. The Systems sub-group will work jointly with JVT to define the transport of the new video coding algorithm. The following list of actions have been identified:

Definition of terminology and concepts; Define a “Network Adaptation Layer” for :

MP4 (File format); MPEG-2; and RTP (IETF).

Concerning the definition of payload format in IETF, the agreed goal is that only one payload format should be defined for Part 10. A liaison will be sent to IETF to inform them about our plans. An AHG (Carriage of JVT codec) will be set to discuss further these issues.

55

Systems Standard Monitoring

Standard Title Status Document with

Purpose Topics

MPEG-2 Systems

13818-1/Amd.7

Generic coding of moving pictures and associated audio information: Systems AMENDMENT 7: Transport of ISO/IEC 14496 data over ISO/IEC 13818-1

Published 2000-12-01

Elementary Stream Management35.MPEG-4 Over MPEG-2

13818-1:2000Generic coding of moving pictures and associated audio information:Systems


MPEG-2 Systems Edition 2000

13818-1:2000/COR1

Generic coding of moving pictures and associated audio information: SystemsTECHNICAL CORRIGENDUM 1

COR2001-01-19

Submitted to ITU on 2001-

02-05

Prepare the final textfor publication

Elementary Stream Management36.FlexMux Descriptor

13818-1:2000/COR2

Generic coding of moving pictures and associated audio information: SystemsTECHNICAL CORRIGENDUM 2

COR2001-12-07 ITTF Prepare the final text

for publication

Elementary Stream Management37.Buffer model for PID2.

MPEG-2 DSM-CC

13818-6/COR1

Generic coding of moving pictures and associated audio information -- Part 6: Extensions for DSM-CCTECHNICAL CORRIGENDUM 1


Elementary Stream Management38.Editorial correction

13818-6/Amd.3

Generic coding of moving pictures and associated audio information --Part 6: Extensions for DSM-CCAMENDMENT 3: Transport buffer model in support of synchronized user-to-network download protocol

Published 2001-12

Elementary Stream Management39.Transport buffer model in

support of synchronized user-to-network download protocol.

56


Purpose Topics

13818-6/COR2

Generic coding of moving pictures and associated audio information -- Part 6: Extensions for DSM-CCTECHNICAL CORRIGENDUM 2

COR2000-07-17

Regis Crinon (Editor) To be consolidated to

2nd Edition

Elementary Stream Management40.Editorial correction

MPEG-4 Systems

14496-1 Coding of audio-visual objects -- Part 1: Systems

Published1999-12-15

Elementary Stream Management41.Systems Decoder Model42.Object Descriptor

Framework 43.Synchronization of

Elementary streams44.Multiplexing of Elementary

streams 45.Object Content Information46.IPMPScene Description47.BIFSSyntactic Description LanguageProfiles and Levels

14496-1:1999/Amd.1

Coding of audio-visual objects --Part 1: SystemsAMENDMENT 1: Systems extensions

Published 2001-11

Elementary Stream Management48.MPEG-4 File Format

(MP4)Scene Description49.Application Window as a

BIFS node50.Advanced Audio BIFS51.Material Keying52.Advanced coding (PROTO,

Integration of Mesh, coding

57


Purpose Topics

of MField).Application Engine (MPEG-J)Profiles and Levels

14496-1:1999/COR1

Coding of audio-visual objects -- Part 1: SystemsTECHNICAL CORRIGENDUM 1

Published 2001-11

Miscellaneous correction to 14496-1

14496-1:2001 Coding of audio-visual objects --Part 1: Systems

Published 2001-11

MPEG-4 Systems Edition 2001 53.Integration of 14496-1,

14496-1/Amd.1, 14496-1 COR 1

14496-1:2001/Amd.1

Coding of audio-visual objects --Part 1: SystemsAMENDMENT 2: Extended BIFS

Published2001-10

Elementary Stream Management54.Flextime55.RebuferingScene Description56.Flextime nodes57.ServerCommand58.ExternProto59.Advanced BIFS CodingProfiles and Levels

14496-1:2001/COR1

Coding of audio-visual objects --Part 1: SystemsTECHNICAL CORRIGENDUM1

COR2001-07-20 ITTF

To be consolidated to 3rd Edition after Miscellaneous correction

to 14496-1

14496-1 3rd

EditionCoding of audio-visual objects --Part 1: Systems

Yuval Fisher (Editor)

To send to the secretariat before the

17/12/2001

MPEG-4 Systems 3rd

Edition60.Integration of 14496-

1:2001, 14496-1:2001/Amd1, 14496-1:2001/Cor1

58


Purpose Topics

MPEG-4 Conformance

14496-4:2000 Coding of audio-visual objects --Part 4: Conformance testing

Published 2000-12-15 Conformance for 14496-1

14496-4/Amd1

Coding of audio-visual objects --Part 4: Conformance testingAMENDMENT 1: Conformance testing extensions

Submitted to secretariat 2001-10

ITTF

To be consolidated to 2nd Edition after

FDAM ballot approval

Conformance for 14496-1/Amd1

14496-4:2001 Edition

Coding of audio-visual objects --Part 4: Conformance testing

Wait for Approval of

14496-4/FDAM1

ITTF

To be publishedAfter

14496-4:2000/FDAM 1 approval

MPEG-4 Conformance Edition 2001 61.Integration of 14496-4,

14496-4/Amd.1.MPEG-4 Reference Software

14496-5 Coding of audio-visual objects --Part 5: Reference software


Reference Software for 14496-1

14496-5/Amd1

Coding of audio-visual objects --Part 5: Reference softwareAMENDMENT 1: Reference software extensions

FDAM2000-07-xx ITTF

Wait for consolidation to 2nd

edition.

Reference Software for 14496-1/Amd1

14496-5/COR1

Coding of audio-visual objects --Part 5: Reference softwareTECHNICAL CORRIGGENDUM 1

COR2001-01-19 ITTF

Wait for consolidation to 2nd

edition.

Miscellaneous correction to 14496-5

14496-5:2001 Coding of audio-visual objects --Part 5: Reference software

FDIS2001-07-17 ITTF

Scheduled for publication by mid-February

MPEG-4 Reference Software Edition 2001 62.Integration of 14496-5,

14496-5/Amd.1, 14496-1/Cor1.

MPEG-4 Transport of MPEG-4 over IP Networks14496-8 Coding of audio-visual objects --

Part 8: Transport of MPEG-4 over IP Network (14496-8

FDIS2001-12-07

ITTF Prepare the final textfor publication

Elementary Stream Management63.IETF RFC for transport of

59


Purpose Topics

MPEG-4 over IP64.Framework for the carriage

of MPEG-4 content over IP network.

MPEG-7 Systems

15938-1 Multimedia content description interface Part 1: Systems

FDIS2001-07-17

Claude Seyrat (Editor)

FDIS editing due by 2001-12-21

MPEG-7 ArchitectureMPEG-7 dynamic descriptionsMPEG-7 binary format

15938-2 Multimedia content description interface Part 1: DDL

FDIS ballot by

2002-02-06

ITTF,Jane Hunter

(Editor)

To be published after FDIS approval

proof check due by 2002-01-30

MPEG-7 DDL

60

List of reviewed contribution

N° Title Authors7553 Table of Replies on ISO/IEC 14496-

1:2001/FDAM 1 (SC 29 N 4363)SC 29 Secretariat

7554 Systems Meeting Report Olivier Avaro (France Telecom R&D), et al.7555 ISMA Contribution on DRM Direction

in ISMAPete Schirling for the ISMA DRM workgroup

7557 Comments on MPEG-4 IPMP CD Steve Mitchell, Jack Lacy7558 Study of MPEG-4 IPMP Extensions CD Editor: Avni Rambhia7559 A Study of IPMP Data Structure Syntax Bruce Chaplin, David Kosiba, Ivan McLean7560 A Study of IPMP Message Syntax Bruce Chaplin, David Kosiba, Ivan McLean7561 New IPMP System Architecture

DiagramBruce Chaplin, David Kosiba, Ivan McLean

7562 A Study of Descriptor ID Values Bruce Chaplin, David Kosiba, Ivan McLean7563 A Study of IPMP Tool Message Type

ValuesBruce Chaplin, David Kosiba, Ivan McLean

7564 New IPMP Tool Mssages for Querying Parametric Capabilities

Bruce Chaplin, David Kosiba, Ivan McLean

7565 Usage Scenario for MPEG Intellectual Property Management & Protection (IPMP) Application to Digital Cinema

Chuck Harrison (FFA)

7566 Proposed definition for the intent messages as defined by ISO/IEC 14496-1:2000 / AMD3


7567 Definition for a Secure Message class for ISO/IEC 14496-1:2000 / AMD3


7568 Mapping of Mpeg4 IPMP Extension into Mpeg2 system

SM Shen, et al.

7569 Proposal on improvement of the current MPEG4 IPMP Extension CD

SM Shen, et al.

7570 Further benefit of IPMPXML Itaru Kaneko7575 Report of the MPEG IPMP AHG

Meeting – Santa ClaraMike McGinty

7585 UKNB Comments accompanying the ballot on the IPMP sections of PDAM ISO/IEC 14496-1:2001 / AMD3

Jack Lacy for the UKNB

7590 Proposed changes to the XMT-A textual format

Jean-Claude Dufourd

7591 Summary of Voting on ISO/IEC 14496-1:2001/PDAM 3 (SC 29 N 4445)

SC 29 Secretariat

7591 Summary of Voting on ISO/IEC 14496-1:2001/PDAM 3 (SC 29 N 4445)

SC 29 Secretariat

7600 Minor changes to InputSensor and mapping of KeySensor/StringSensor

Cyril Concolato, Jean-Claude Dufourd

7602 MPEG-7 TeM decoder developed at Lancaster University (version LUv1-1)

Rui J. Lopes

7605 Various Fixes for Pattaya Yuval Fisher























N° Title Authors7605 Addition of MatteTexture in Advanced

2DYuval Fisher (Envivio)

7615 ISO/IEC 14772-1/FPDAM 1.2 (SC 29 N 4465)

SC24 via the SC 29 Secretariat

7621 OD framework and MPEG-4 IPMP Extensions

Jean Le Feuvre

7633 Report of the IPMP Ad Hoc meeting – Ottawa – November 12-14

Jack Lacy

7634 Study of Text of PDAM ISO/IEC 14496-1:2000 PDAM3

Avni Rambhia

7635 IPMP Ahg Disposition of NB Comments on PDAM ISO/IEC 14496-1:2000 PDAM3

Avni Rambhia



7646 Goldilocks and the Three Important Clarifications

Yuval Fisher

7647 Clarification of differences between ECMAscript and MPEG-4 Scripts

Yuval Fisher

7648 WD of ISO/IEC 14496-1:2001.1 Edition

Yuval Fisher

7659 Main2D and Advanced Main2D Profiles: Levels definitions

Steve Wood, Michelle Kim

7660 XMT: Study of text of ISO/IEC 14496-1:2001/FPDAM2

Steve Wood, Michelle Kim



7673 Text of ISO/IEC 15938-1/FDIS - Editors version

Claude Seyrat, et al.

7679 New Profiles & Levels indication values in IOD

French National Body



7681 Droppable Access Unit and Random Access Indications in XMT

Sylvain Delagrange, Laurent Herrmann (Philips)

7698 Summary of Voting on ISO/IEC FCD 14496-8

SC 29 Secretariat

7701 Philips contribution to BIFS conformance related to 2D profiles

Laurent Herrmann, Sylvain Delagrange, Guillaume, Brouard, Pierre-Yves Roux

7706 Request for fixing the definition of profiles and levels in Systems

Jean-Claude Dufourd

7707 Report of AHG on BIFS Jean-Claude Dufourd7716 Core2D streams Jean-Claude Dufourd7721 Grouping of Alternative Tracks in the

ISO Media File FormatPer Fröjdh, Torbjörn Einarsson

7726 Updating mechanisms in MPEG-7 Claude Seyrat
























N° Title AuthorsSystems

7731 Report of AHG on Systems Conformance

Yuval Fisher, Laurent Hermann

7735 Web3D X3D Profile proposal to MPEG Aaron Walsh (Web3D)7740 compatibility of traffic descriptor to the

current networksdoug young suh, junho jung, jitae shin, joo myoung seok, jong hyup lee

7744 discontinuity handling dominique curet, stephanie relier, catherine roux

7745 FlexMux implementation within IM1 antoine maisonneuve, dominique curet, catherine roux, stephanie relier

7746 Enhancement of the FlexMux specification

catherine roux, stephanie relier, dominique curet

7747 SL packet header extension stephanie relier, catherine roux, dominique curet

7748 RTP payload for FlexMux dominique curet7749 scene broadcast & multicast alexandre cotarmanac'h, dominique curet7749 scene broadcast & multicast alexandre cotarmanac’h, dominique curet7750 predictive coding & BIFS-Anim alexandre cotarmanac’h7751 Desription of the MUCommandStream

and its message protocolIver Grini (Octaga AS) for the SoNG project

7752 Desription of the Multiuser Nodes and their impact on MPEG-4 content

Iver Grini (Octaga AS) for the SoNG project

7754 Advantage and disadvantage of current IPMP extension as MPEG-21/IPMP

Itaru Kaneko

7758 FNB Comments on the FBA Stream Syntax

Marius Preda, Françoise Prêteux for the FNB

7774 Result of Core Experiment on Interpolator Compression

Do Kyoon Kim, Sang Oak Woo, Seok Yoon Jung, Gyung Ja Jang, ShinJun Lee, Mahnjin Han, Euee S. Jang

7776 Extended bug report of BIFS Coding Technology

Mahnjin Han, Do Kyoon Kim, Sang Oak Woo, Shin Jun Lee, Seok Yoon Jung

7777 Usage of 3DMC in BIFS Mahnjin Han, Mikael Bourges-Sevenier, Do Kyoon Kim

7790 Extending the BIFS message protocol Iver Grini (Octaga AS), Jean-Claude Dufourd (ENST) for the SoNG project

7793 Report of AHG on MPEG-4 content on MPEG-2 System and IP Network

Young-Kwon Lim (net&tv), Jan van der Meer (Philips), Carsten Herpel (THOMSON multimedia)

7798 Details of Fragment Reference for MPEG-7 Systems Amd.1

Tomohiro Azami

7805 Report of AHG on MPEG-7 Semantic Interoperability

Jane Hunter

7811 Demonstration of Streaming of MPEG-4 3-D Scenes with Live Video

Aljoscha Smolic, Yong Guo, Jens Guether, Thorsten Selinger

7814 IM1 AHG Report Zvi Lifshitz7815 IM1 Core code + authoring tools

version 5.6Zvi Lifshitz

7816 Comments on ISO/IEC 14496-1:2001/DCOR2 (Scene Carousel)

Zvi Lifshitz






























N° Title Authors7817 IPMP Trust Model Spencer Cheng7822 Break up Tables for BIFS Streams by

Features and ProfilesLaurent Herrmann (Philips)

7844 A Method for Synchronization between Media Delivery Time and MPEG-7 Content Description Delivery Time.

A. Tabatabai, H. Rising, Mohammed Zubair Visharam, Toby Walker, D. Singer

7845 A proposal for Fragment References in MPEG-7 Access Units

A. Tabatabai, Toby Walker, Mohammed Zubair Visharam

7846 WD2.0 of ISO/IEC 14496-1:2001/COR2

Yuval Fisher, David Singer, William Belknap, Guido Franceschini

7847 Summary of Voting on ISO/IEC 14496-5:2001/PDAM 2

SC 29 Secretariat

7849 Report of the AHG on MPEG-7 Systems

Carsten Herpel, Adam Lindsay, Jan Van der Meer, Claude Seyrat, Jane Hunter, M. Wollborn, Ali Tabatabai

7850 Demo of ENST content production Jean-Claude Dufourd, Cyril Concolato7853 MPEG-2 IPMP and its potential

application to DVB CPCMSM Shen, et al.










Annex 6MDS report

Source: John Smith

Overview:The main activities related to MPEG-7 during the week were as follows: 1. Produce MPEG-7 MDS Extensions Working Draft (WD) MPEG-7 MDS Ver. 22. Contribute MPEG-7 MDS conformance to MPEG-7 Conformance Committee Draft (CD)3. Develop requirements for Registration authority for MPEG-7 classification schemes 4. Analyze recommendations of AHGs (2) 5. Analyze results of CEs (1)6. Revise MPEG-7 MDS FAQ7. Edit and approve the documents (WD, CD, AHGs, new CEs, etc.)

The main activities related to MPEG-21 during the week were as follows: 1. Produce Digital Item Declaration (DiD) Final Committee Draft (FCD) 2. Produce Digital Item Identification & Description (DII&D) Committee Draft (CD)3. Evaluate submitted technologies for Rights Expression Language (REL) 4. Produce first MPEG-21 Rights Expression Language WD5. Produce first MPEG-21 Rights Data Dictionary WD6. Analyze recommendations of AHGs (3) 7. Analyze results of CEs (4)8. Revise MPEG-21 MDS FAQ 9. Edit and approve the documents (WD, CD, AHGs, new CEs, etc.)

MPEG MDS Group activities

During the kick-off session, the workplan for the week for MPEG-7 and MPEG-21 development was discussed and approved. Furthermore, the following points were discussed: Organization of work into one track for MPEG-7 and MPEG-21 topics Scheduling of MDS group plenary meetings for Wednesday and Thursday Plan for generating MPEG-7 WD ver. 2 Plan for generating MPEG-21 DID FCD and DII&D CD Plan for evaluating XrML and ODRL as candidate technologies for basis of MPEG-21 REL

Mini-core experiments for Use Cases for Rights Expression Homework assigned for XrML and ODRL proponents to create rights expression Creation of team of MDS language experts for evaluating results

Plan for generating MPEG-21 RDD WD Plan for generating MPEG-21 REL WD

Review of MDS MPEG-7 and MPEG-21 AHG reports

Num. Contributions7761 Report of Ad Hoc Group on Editing the MPEG-7 MDS XM and FDIS7805 Report of AHG on MPEG-7 Semantic Interoperability7630 Report of the AHG on Editing the MPEG-21 DID CD and DII&D WD

Num. Contributions7702 Report on AHG on MDS MPEG-21 Core Experiments7732 Report on AHG on developing MPEG-21 Software and Systems Model (YM)

7761 Report of Ad Hoc Group on Editing the MPEG-7 MDS XM and FDIS, John R. Smith on behalf of MDS group.Results: Completed MPEG-7 MDS FDIS:

o Revisions based on disposition of comments produced in Sydney meeting (see DoC on ISO/IEC 15938-5 FCD – w4244)

o Improvements to organization of relationso Correction of errors in syntactic and semantic definitions of description toolso validation of MDS description exampleso Synchronization with audio and visual tools

Completed XM:o Incorporated candidate tools for MPEG-7 MDS v.2

The description examples in the MDS FDIS were individually extracted and validated 160 description examples made available at

http://pmedia.i2.ibm.com:8000/mpeg7/schema/ The FDIS schemas for the different parts of the MPEG-7 standard also posted

7805 Report of AHG on MPEG-7 Semantic Interoperability, Jane Hunter/Eric RehmResults: The semantics of MPEG-7 terms should be expressed as a formal ontology; This ontology should be represented in a machine understandable and widely accepted

ontology language i.e., RDF Schema/DAML+OIL; MPEG-7 terms should be selected so as to maximize potential semantic interoperability

with other key metadata vocabularies (e.g., Dublin Core, SMPTE, EBU, NewsML, TV-Anytime);

Each MPEG-7 term should have a single unique semantic definition. Avoid re-use of MPEG-7 terms in different Ds or DSs with different meanings – introduces semantic ambiguity.

From MPEG-7 to Dublin Core, SMPTE, EBU, TV-Anytime; Express relationships between metadata terms from different domains in single merged

ontology; Base it on the top-level ABC or IEEE SUO (Standard Upper Ontology) Use DAML+OIL Further work required to complete MPEG-7 RDF Schema/DAML+OIL Ontology Need to continue tracking of W3C Semantic Web ActivitiesRecommendation to Close AHG due to lack of participation – interested individuals can continue this work outside of AHG

7630 Report of the AHG on Editing the MPEG-21 DID CD and DII&D WD, Todd Schwartz, for the AHGResults: Completed DID CD and Study of CD, DII&D WD Proposed method for identifying resource formats in DID CD Study, Investigated processing actions.

7702 Report on AHG on MDS MPEG-21 Core Experiments WD,

Ian Burnett (Univ of Wollongong), Andrew Perkis (NTNU)Results:Went through two core experiments. Had some discussions on use of SMIL and XMT in digital items for synchronization. Recommendations. Define requirements and Use cases for Dynamic Digital Items (to Requirements). Resolve re-use of CHOICE in DiD, describing of choice rather than the selection for

DII&D. Develop set of requirements for synchronization in MPEG-21 DII&D, evaluate id SMIL or existing MPEG tools are suitable solutions for synchronization in MPEG-21 DII&D.

URN identifiers of form "urn:mpeg:mpeg21:diid:ss.nn", …

7732 Report on AHG on developing MPEG-21 Software and Systems Model (YM) WD, Paul Ruskin (University of Wollongong)Results: Develop system functional requirements for MPEG-21 YM, including design of APIs

and planning of implementation.

Review of MDS Core Experiments results

Num. Contributions7818 Report of CE on the Linguistic DS7702 Report on AHG on MDS MPEG-21 Core Experiments7703 Report on CE on Content Delivery and Terminal Capabilities

7622Report on CE on MPEG-21 Digital Item Identification & Resolution System Interoperability

7818 Report of CE on the Linguistic DSKoiti Hasida, et al.Core experiment has made extensions to the Linguistic DS specification in the XM. Some questions were raised about the specification, such as is it possible to extend Relation DS rather than revise Relation DS? The group decided to review the new elements in further detail later in the week.

7703 Report on CE on Content Delivery and Terminal CapabilitiesIan Burnett (Univ of Wollongong)Developments from Univ. Wollongong – content adaptation, embedding of XMT and SMILLGE – transcoding, temporal synchronization and implications for Dynamic Digital Item.NTU /Ericsson – resulting in input for digital item adaptation.

7622 Report on CE on MPEG-21 Digital Item Identification & Resolution System InteroperabilityHideki Sakamoto (NTT), Takao Nakamura (NTT), Masanori Yamada (NTT), and Hiroshi Yasuda (Tokyo Univ.)Use of URN-based identifiers used in DID documents. Evaluation of three scenarios for identification and resolution.Recommendations. Determine how identifiers are assigned for identification system (action – investigate whether other solutions are possible. create requirements). Addition of some DID examples used in this CE.

MPEG-21 DII&D

Num. Contributions7601 MPEG-21 Digital Item Identification and Description WD 2.5

7601 MPEG-21 Digital Item Identification and Description WD 2.5Niels Rump for the AhG for editing the DID CD and the DIID WDOpen issues for DII&D(1) What is purpose of DII_DS element?(2) Unique identification of things other than digital items?

MPEG-21 Technical Framework (joint with Requirements/Systems/MDS)

First draft of MPEG-21 System Architecture. System elements include DID Parser and IPMP system; each has well-defined interface. The DID parser interacts with MPEG-7 parser, IPMP parser, REL parser, and possibly others. The DID parser also interacts with ID resolver. There is further interaction between DDL parser and IPMP system. May need a secure interface between DID parser and IPMP parser.

Comments: (1) need to determine systems aspects such as bitstream representation, transport, delivery, (2) need to develop the flow of information.

Comments: the IPMP parser should be slave to DID parser.Comments: need preconditions (i.e., declarations arrive by some means)

Processing steps:(1) Declaration is parsed by DID parser. In some cases, the entire description may also

be encrypted or signed.(2) While parser a component within the declaration, the DID parser encounters a

descriptor that identifies an IPMP scheme (by some means that is yet to be developed). That was used to protect the content. The DID parser passes the IPMP scheme identifier together with the protected resource to the IPMP system. Note that the protected content can be another DID, or a fragment of a DID, or a resource.

(3) The DID encounters a description containing an MPEG-7 descriptor, and invokes the MPEG-7 parser and passes. The MPEG-7 description can itself be another DID, or fragment of DID, or a resource.

Comments: can be mapped to OID in MPEG-4 or to MPEG-2.

MPEG-21 content modeling architecture. DID has identifiers, descriptions, and references to resources. Rights expressions can be included as descriptions or resources.

Comments: Not clear understanding of what is a resource. Resource seems to be defined as the content-part of the digital item. Comments: most rights expression languages are self-protecting.

Need normative interfaces – do we also require MPEG-21 Systems Standard? – missing a place where all of the MPEG-21 interfaces are defined.

Recommendation to create following AHG: Chairs: Todd Schwartz and Craig SchultzAHG MPEG-21 Technical Architecture:(1) To improve the draft MPEG-21 Technical Architecture of the different elements in the

MPEG-21, starting with

i. DIDii. DII&D

iii. IPMPiv. REL/RDD

(2) To specify the IPMP DS to be included in MPEG-21 part 4(3) To specify which interfaces are missing in MPEG-21, and to propose them, using the

YM as a source of information.

MPEG-21 DiD

Num. Contributions7614 Study on Text of ISO/IEC 21000-2 CD7592 Summary of Voting on ISO/IEC CD 21000-2 (SC 29 N 4446)

7614 Study on Text of ISO/IEC 21000-2 CDTodd Schwartz, for the AHG on Editing the MPEG-21 DID CD and DII&D WD

7592 Summary of Voting on ISO/IEC CD 21000-2 (SC 29 N 4446)Todd SchwartzPresented NB comments on DiD CD (group consensus to accept editorial changes)Summary of proposed changes form Editor

Accept editorial revisions Accept update of DIDL namespace Accept change from all CAPS for element names (changes also to figures and

description examples) Accept to add editorial note making change to allow Container children Accept to change name of "uri" attribute to "target" Accept to add editorial change regarding XPointer Accept to add editorial note to add optional "context" element to "override".

MPEG-21 Digital Item Adaptation (with Requirements/MDS)

Num. Contributions

7623Report of the AHG on MPEG-21 Digital Item Usage Environment Description

7624 MPEG-21 Requirements on Digital Item Usage Environment Description7644 MPEG-21 requirements input based on media resource delivery

7652Report of the Ad-hoc Group on the Bitstream Syntax Description Language (BSDL)

7653 MPEG-21 Draft Requirements on BSDL and Content Adaptation7763 The use of BSDL for view-dependent 3D VTC applications7670 A proposal of the model bind to content and ID7803 Peer-2-Peer Digital Items7804 Packaging Context Information Using Digital Items

All All input documents considered in single group discussion: Objective to have CfP for Digital Item Usage Environment in May 2002. User environment, BSDL, and new requirements

Content adaptation in network and terminals and dynamic digital items BSDL is API to adapt DI resources (individual bitstreams), can be in client and network Start of potentially large work item Requirements from network side

o Need to ensure QoSo BDSL requirements for content adaptation for server, network, and cliento Difference between server and network will blur, server functionality will percolate

into the network (programmable nodes).o Clear relation lies with QoS but tools are differento One may be used without the othero Be careful to avoid explosion of parts of MPEG-21o Need requirements showing linkage of different parts of MPEG-21 (i.e., including

BSDL and DIUED)o Possible to progress multiple working drafts. Start from a single call asking for

solutions to fulfill requirements (common requirements document).o Make preliminary call now for May and reserve right to revise in Marcho Many requirements are proposed for content adaptation and resource delivery.o Do the descriptions need to be normative?o Use case for Dynamic Digital Items – many cameras of sports event, many types of

clients. Build digital items that can be adapted to different devices. Given additional resources, digital item needs to be updated – hence dynamic digital items. Also, allows processing in network.

o Need to have link between digital item representation and environment allowing for dynamic digital items.

o Propose to create BoG to draft requirements which will return to Requirements on Wed. This is a joint

MPEG-7 Requirements (with Requirements/MDS)

Num. Contributions TV Anytime adoption of MPEG-7 tools

7823 A Text Indexing Profile for MPEG-7 MDS7805 Report of AHG on MPEG-7 Semantic Interoperability7807 An RDF/DAML+OIL Schema Representation of MPEG-7 Semantics7710 Proposal for MPEG-7 Overview update

---- TV Anytime adoption of MPEG-7 toolsPeter van BeekMetadata group in TVA has defined DSs in a way similar to what MDS group has done – specific to PVR-type devices and applications.The TVA tools are more restricted and more "light-weight". Have defined Program Description Schemes (similar to MPEG-7 Media-Meta in MDS). Use a number of basic types in MPEG-7 such as TitleType, PersonType, AgentType, PlaceType, and so forth. Have also adopted Classification DS and Terms from MPEG-7 MDS. To describe users have adopted UserPreference DS and UsageHistory DS tools in entirety. The Summarization DS was proposed to TVA but was not adopted because preferred to have a single tool combining Summarization DS and Segment DS. How to deal with dependencies among tools when subset was adopted? TVA adopted a number of MDS tools but has not

changed the tools. TVA has not defined profiles and are only beginning to develop ideas on conformance. Was this a missed opportunity? Companies worked very hard to harmonize and reach the current solution in which some MDS tools were adopted, however, were not successful in harmonizing more completely with TVA.

7823 A Text Indexing Profile for MPEG-7 MDS Eric RehmProduced "profiles" or schema subsets that address text indexing and video logging. These sub-schemas are "clean" in the sense they have removed only optional elements. How to make profiles operational. There is an MPEG-7 "profiles" document, which could be updated based on this input on "simple" and "logging" profile. Suggestion to test out "profiles" in application space, i.e., MPEG-7 Alliance.

7805 Report of AHG on MPEG-7 Semantic Interoperability7807 An RDF/DAML+OIL Schema Representation of MPEG-7 Semantics

See above.

7710 Proposal for MPEG-7 Overview updateNot presented.

MPEG-7 Proposals

Num. Contributions7722 Proposal for a Message Digest Descriptor7723 Proposal for a modified Description Metadata Header

7722 Proposal for a Message Digest DescriptorJoerg Bitzer, Stefan Kudras.Proposed a descriptor based on MD5 for computing a hash value for audio-visual content. The objective is to provide a check whether the content has been corrupted or changed in any way. Questions were raised about how the functionality differs from checksum methods, and how it relates to other authentication schemes. The recommendation was given to better examine the requirements of the MD descriptor in the context of MPEG-7 and MPEG-21. The proponent agree to develop requirements and make contribution to the next meeting.

7723 Proposal for a modified Description Metadata HeaderJoerg Bitzer, Stefan Kudras.Proposed a description scheme for describing Change History. The DS includes information about version, changes, and comments. The DS as proposed modifies the Description Metadata DS. Concerns were raised about this modification and the proponent agreed to work with members of the MDS group to re-implement as extension of DescriptionMetadata DS. The recommendation was given to incorporate the new tool into the MPEG-7 MDS XM ver. 10.

MPEG-7 Amendment Items and Actions

Num. Contributions7658 Requirements for Registration Authority for MPEG-7 Classification Schemes (draft)

Num. Contributions MPEG-7 MDS Conformance

7658 Requirements for Registration Authority for MPEG-7 Classification Schemes (draft)John R. SmithThe requirements for RA for MPEG-7 CSs were reviewed. The objective of the RA is to allow parties to

register classification schemes. The decision was made that the parties shall be required to supply the classification schemes as valid instances of MPEG-7 Classification Scheme DS, and to require that term or definition elements be included. The requirements also allow for parties to add terms to the registered schemes in a backwards compatible fashion.

---- MPEG-7 MDS ConformanceJohn R. Smith

The issue of conformance with respect to MPEG-7 MDS was discussed. The group agreed that MDS conformance testing does not apply to extraction or use of MDS descriptions. However, conformance applies to MPEG-7 MDS descriptions, which involves syntactic checking by DDL parser and semantic validation according to ISO/IEC 15938-5 MDS.

MPEG-7 XM Software

Num. Contributions7824 An MPEG-7 MDS Search Engine for Research Use

MDS Contribution to MPEG-7 XM Software FDIS

---- MDS Contribution to MPEG-7 XM Software FDISXM Software status Clarify status of modules "to be removed" (verification column) Missing glue/other components Components without a mandate or owner (Pyramid?) should this go into the reference

SWDeadline for completion of SW ISG requests Dec 31 MDS requests Jan 15Verification of code and functionality No information received (except for a few)Mapping of SW components to Part 5 (MDS) Section number and proper name of MDS component Should be done today/tomorrow (doc to be finished by end of the week)

MPEG-7 MDS Version 2

Num. Contributions7818 Report of CE on the Linguistic DS7819 Simple Tools for Abstraction and Instantiation

7818 Report of CE on the Linguistic DSGroup considered again the proposed changes for Linguistic DS. The decision was made to limit

amendments (to Relation DS) to Linguistic DS.

7819 Simple Tools for Abstraction and Instantiation

Provides functionality to copy / substitute attributes Functionality - some overlap with other tools Impact of extension on existing DSType

The decision was made to limit the abstraction and instantiation functionality to Linguistic DS for nowConclusions: Advance Linguistic DS to WD (text available for Linguistic DS is available (almost ready)

(please include example descriptions)Updated software contribution to be provided (search/retrieval engine) - February 1 deadlineAdvance Abstraction/Instantiation tools to XM - Software components will be integrated in Linguistic

DS module

MPEG-7 MDS Plenary

ContributionsReport of Breakout Group on MPEG-21 RDD EditingReport of Breakout Group on MPEG-21 REL evaluation

RDD Report of Breakout Group on MPEG-21 REL evaluation Worked on developing first WD based on <indecs>2rdd data dictionary as starting point for RDDGoal of standardizing:

A model The relation between the RDD and the core set of descriptive terms in the REL A core set of terms

AHG will be created to address among other editing tasks: Mapping of other terms and requirements to RDD model, Formal representation of genealogies Identifying procedures for purposes of governance, and other issues

REL Report of Breakout Group on MPEG-21 REL evaluation Recommendation to adopt XrML as initial basis of MPEG-21 REL architecture Mini-Core Experiment was formed based on Use Cases for Rights Expressions to evaluate

XrML and ODRL as possible starting points for MPEG-21 REL:o Proponents created XML fragments for rights expressions using proposed Rights

expression languageso Evaluated by MDS language and schema experts in 3-day breakout groupo Participation also from MPEG-7 and MPEG-21 people and RDD and REL points of

view XrML was deemed as a better starting point

o XrML was considered to be more mature and more formally developed allowing for high precision in expressing rights;

Unanimous decision of MDS language experts was that XrML would make the best basis for the initial working model for further review

Agreement that further development is needed (would be true for either starting point)

Questions were raised from group about the rationale for the recommendations from the expert reviewers. The reviewers clarified their assessments. The breakout group was asked to reconvene to better gather the conclusions from the experts and articulate the rationale. After resuming the MDS group discussion, the recommendation was made for the group to develop a roadmap for continuing technical development. The breakout group reconvened again and eveloped REL roadmap for exploring how the other rights expression languages and elements apply to REL requirements. The roadmap identifies further actions and defines AHG and Core Experiment activities as follows:

Exploring integration of other rights elements into REL Studying further integration of RDD and REL Examining possible profiles for the REL Defining inheritance semantics

New Core Experiments (CEs):

The following MPEG-21 experiments were approved during the Pattaya meeting:

DSs Organizations Application Related documentsWork plan for CE on the MPEG-21 REL

Vivendi Universal Music Group Content GuardIPR SystemsNokiaReal NetworksLGEMicrosoftPanasonic

• Recommendations for modifications and inclusions for the REL• Possible profiles for the REL• Definition of inheritance semantics• Other outputs are expected as the CEs allow full exploration of the RELMeasurementsThe Core Experiment will provide results based on the following issues:Review possible elements/concepts that could be taken from other submissions• Default interpretation of the element implicitly specified by the context• 1 to 1 relationship between Semantic entities and syntactic elements• Expression of UID• Expression of roles• Sequencing• Inheritance of rights and permissions• Minimising overhead).

[1] REL Working Draft N4533[2] Requirements for the Rights Expression W4336 [3] Open Digital Rights Language M7598[4] <indecs>2RDD M7610[5] cIDf Specifications Version 1.1 M7628[6] XrML: Response to MPEG-21 CfP for RDD-REL M7640[7] MarkAny Rights Expression Language: MAREL M7662[8] MPEG Content Related ID Registration in System Level for MPEG RDD Requirement M7671[9] Rights Markup Extensions for the Protection of Indigenous Knowledge M7672[10] LGE Proposal for a Rights Data Dictionary and a Rights Expression Language M7677[11] DMAG contribution to MPEG-21 RDD-REL M7675

MPEG-21 Multimedia Description Schemes in Core Experiments.

List of MDS Output documents:

Title No.MPEG-7 Multimedia Description Schemes Extensions WD 4525MPEG-7 Multimedia Description Schemes XM (v10.0) 4526Text of ISO/IEC 15938-7 CD — Information Technology — Multimedia Content Description Interface — Part 7: Conformance 4527

MPEG-7 MDS FAQ (v4.0) 4528Requirements for Registration Authority for MPEG-7 Classification Schemes 4529MPEG-21 Digital Item Declaration FCD 4530DoC on ISO/IEC 21000-2 CD 4531MPEG-21 Digital Item Identification & Description CD 4532MPEG-21 Rights Expression Language WD 4533MPEG-21 Rights Data Dictionary WD 4534MPEG-21 MDS FAQ (v2.0) 4535MPEG-21 MDS Core Experiments 4536Workplan for CE on the MPEG-21 REL 4537

Next targets for the Jeju, KR meeting:

MPEG-7

Produce the MPEG-7 MDS Extensions CD. Produce the MPEG-7 Conformance FCD (with audio, video, and systems)

MPEG-21

Perform the Core experiments approved during the Pattaya meeting and review the results. Study and improve the FCD on Digital Item Declaration and address NB comments. Study and improve the CD on Digital Item Identification and Description and produce FCD. Continue development of MPEG-21 RDD and REL Continue development of the MPEG-21 Software and Systems architecture

Annex 7Visual Group Report

Source: G. Sullivan, M. Bober

During the Pattaya MPEG meeting, Video issues were addressed in relation to the following efforts: MPEG-2 (implementers’ guide / problem reports) MPEG-4:

o Enhanced compression joint projecto New Levels and Tools amendmento FGS profileo Studio profileo Reference softwareo Optimized reference softwareo Implementers’ guide / problem reports

MPEG-7 Exploration Topics

o Enhanced Fine Granularity Scalabilityo Digital Cinemao 3-D Videoo Interframe Wavelet Video Technology

MPEG-2

Reports of Problems

The prior status of MPEG-2 video problem reports as contained in the Sydney output document N4348 was reviewed and a refined version of this study document was produced as N4465 as guidance to implementers of the standard and as an effort intended to mature into a future corrigendum. National bodies were requested to comment on the contents of the implementers’ guide / problem report.

MPEG-4

New JVT Project for Enhanced Compression Quality

Following the favorable test results conducted for the Sydney meeting, MPEG established a joint partnership with ITU-T Study Group 16 Question 6 (VCEG) at the Pattaya meeting to form a Joint Video Team (JVT) for the development of a new part of 14496 and a corresponding technically aligned ITU-T Recommendation. Terms of reference for this joint work were approved by MPEG, VCEG, and Study Group 16 (N4400).

Joint sessions were held with the Test subgroup and a report of the results of subjective assessment of responses to the call for new video tools to further improve coding efficiency was produced (N4454).

Joint sessions were held with the Requirements group and the JVT to consider input contributions on requirements (incl. M7667, M7755, M7782, M7851, M7854, M7789, M7841) and establish a set of requirements for the new project (N4508).

Joint sessions were held with the Implementation Studies Group regarding the need for complexity analysis of the working draft design. An ad hoc group (N4480) was established to progress the work in this area.

Technical proposals on the content of the new design (incl. M7786, M7848, M7717, M7837, M7663, M7665, M7695, M7696, M7720, M7664, M7666, M7718, M7719, M7737, M7736) were forwarded to the JVT by the contributors for consideration.

The first JVT WD design, including Joint Model 1.0 example encoding cescription (N4466), was recommended for approval (allowing an editing period for production of the draft).

New Levels and Tools Amendment

Regarding the 14496-2 WD 1 of Amendment 3 text (N4351) issued at the Sydney meeting containing New Levels and Tools for MPEG-4 Visual (a new level 0 of the Simple Scalable Profile, a new level 3b of the Advanced Simple Profile, and the addition of an alpha channel tool for VTC), a text was produced (N4470) for promotion to PDAM status at this meeting.

Studio Profile and Fine Granularity Scalability Profile

a. Verification Testing

The status of work on verification testing of the Studio Profile 14496-2:2001/AMD2:2001 (N3904) was reviewed jointly between the Video and Test subgroups. We were pleased to see the completion of this testing effort, and issued a report of this achievement (N4457).

The Studio Profile tests (N4457) included testing of the following tools: 4:4:4 chrominance format 10 bit precision operation (this is judged sufficient without additional testing of 12 bit

precision operation) High bit rate operation (beyond that of MPEG-2 4:2:2 300 Mbits/s)

and calls for testing of the following functionalities: Multiple dubbing with shift operation Chroma-key processing Contrast change

The status of work toward verification testing of the Fine Granularity Scalability Profile 14496-2:2001/AMD2:2001 (N3904) was reviewed jointly between the Video and Test subgroups. Unfortunately the prior plan (N4293) for tests to have been completed had not been achieved. A new test plan (N4456) was produced, and the group expressed its high expectations for the completion and results to be reported to the March MPEG meeting.

The Fine Granularity Scalability test plan (N4456) calls for testing of the following tools: FGS FGST

and calls for testing of the following functionalities: Verifying quality over dynamic channels (over a relatively long period), including operation

in the following three model scenarios:o IP network with priorityo IP network with best effort

o IP network with best effort and error correction Verifying quality in comparison against Simulcast

b. Conformance

Regarding the 14496-4:2001/PDAM1 text (N4127) issued at the Singapore meeting, no action was taken by the video group at this meeting. It is noted that the Systems group has recommended 14496-4:2001/FPDAM1 text (N4421) for approval.

c. Reference Software

Regarding the 14496-5 FPDAM1 (N4278) issued at the Sydney meeting, no action was taken by the video group at this meeting as the ballot period had not closed.

d. Ad-Hoc Group Formation

Ad-Hoc groups were formed to progress the work on the MPEG-4 Studio Profile (N4472) and on MPEG-4 Fine Granularity Scalability (N4473).

Reference Software

Given the recent work on the addition of amendments for adding Studio Profile and Fine Granularity Scalability profile capability to the 14496-5 reference software, it was agreed that editorial work to converge the reference software source codebase was desired, and an ad hoc group (N4553) was established to progress the work in that area.

Optimized Reference Software

Regarding the 14496-7 PDTR text (N4344) issued at the Sydney meeting containing fast motion estimation, fast global motion estimation, and fast static sprite generation, a DTR text of 14496-7 was produced (N4554) with an associated disposition of comments report (N4513).

Reports of Problems

Several contributions were provided (M7792, M7766, M7785) that listed some possible problem areas in regard to MPEG-4 Visual. These contributions were studied along with the prior status in the Sydney output document N4349, and a study document was produced as N4464 as guidance to implementers of the standard and as an effort toward the potential creation of corrigenda to correct any confirmed errors. National bodies were requested to comment on the contents of the implementers’ guide / problem report, including two items in particular:

A correction to include error resilience tools in the MPEG-4 Visual Simple Scalable Profile and the Core Scalable Profile, in order to rectify the problems caused by the exclusion of this important capability

A correction to include object-based temporal scalability in the Core Scalable Profile, which is missing from the current standard

The group also expressed an ongoing need for an effort to unify and simplify the text of the standard to the maximum possible extent, noting in particular that the current structure of 14496-2 (MPEG-4 Visual) currently consists of three distinct documents (now with another on the way) as shown in the table below.

Designation FDIS/FDAMDoc Number

Subject

14496-2:2001 N4350 Text replacing the 1999 MPEG-4 Visual standard [N2502], first amendment [N3056], and two corrigenda [N3307, N3664]

14496-2:2001/AMD1:2001 N3898 Studio Profile Extension14496-2:2001/AMD2:2001 N3904 Streaming Video Profiles Extension

MPEG-7

Main issues addressed during the meeting: Review and approval of Core Experiment results Review of input documents Conformance WD issued Study of the PDTR on Extraction and use of MPEG-7 Descriptions Joint work with other subgroups

Review and approval of Core Experiment Results

– Colour Temperature Descriptor approved for XM (version 2)– CE on Binary representation of visual descriptors

– Most descriptors checked and correct functioning confirmed, one bug detected and corrected

– All visual specific codecs were implemented in Java– The following Core Experiments will continue:o VCE-1 on Shape Sequence Descriptoro VCE-2, VCE-3 (Sensor parameters and 3D coordinate systems) o VCE-4 on Face Recognitiono VCE-5 Binary Representation of Visual Descriptorso VCE-6 Colour Temperature (for Display Adaptation)

Review of Input Documents

The following documents were reviewed and appropriate action taken7611 Experimental Results of Face Description Using 2nd-order PCA Mixture Model7625 Optimal Intervals for Fuzzy Categories of Color Temperature7632 Results of the Core Experiments for Standard Support for Automatic Face Recognition7642 Encoding Visual XML Descriptors into their Binary Equivalents

7684 Report of Core Experiment result on MPEG-7 Color Temperature Browsing Descriptor (VCE-6)

7685 Report of Core Experiment result on MPEG-7 Color Temperature Descriptor for Display Preference (VCE-7)

7689 Extension of the Face Recognition Descriptor Using a Confidence Factor7690 A Result of Core Experiment VCE-5 for Color Layout7691 MPEG-7 Visual part of eXperimentation Model Version 11.17692 Report of AHG on Editing PDTR on Extraction and Use of MPEG-7 Descriptions7693 A Study text of PDTR on Extraction and Use of MPEG-7 Descriptions7699 CE-1 Core Experiment Results for shape-sequence descriptor7700 Proposal for texture sequence descriptors for a video segment

7712 Report of VCE-6 on MPEG-7 color temperature browsing descriptor7713 Report of VCE-7 on MPEG-7 Color Temperature Descriptor for Display Preference7714 Illuminant Independence Consideration for MPEG-7 Color Descriptors7733 Report of Core Experiment result on Shape Sequence Descriptor (VCE-1)7772 The Ground Truth Set of VCE-6 (Color Temperature Browsing)

7780 MPEG-7 Report of Core Experiment result on MPEG-7 Color Temperature Browsing Descriptor (VCE-6)

7781 Report of Core Experiment result on MPEG-7 Color Temperature Descriptor for Display Preference (VCE-7)

7806 Report of the AHG on editing the MPEG-7 Visual XM and FDIS documents7813 MPEG-7 Visual part of Overview document Version 5.07838 Report of the AHG on editing the MPEG-7 Overview document

New proposals

New proposals on Illumination Invariant colour descriptor were reviewed. Experts concluded that more work is needed before Core Experiment can be started.

Conformance work

WD of MPEG-7 conformance (Visual Part) was discussed and issued

Joint work with other subgroups

Joint meeting with Systems – issues discussed: More efficient support for video descriptions in binary format Specific codecs to support components of descriptions

Other Work

MPEG-7 Visual FAQ was written Visual Part of the MPEG-7 Overview was revised to reflect recent changes

Main documents issued

MPEG-7 Visual FAQ (N4549) Visual part of MPEG-7 Overview Description of MPEG-7 Visual Core Experiments (N4546)

Exploratory Phase Work

Enhanced Fine Granularity Scalability

Several contributions (M7859, M7715, M7788) were presented on techniques for enhanced fine granularity scalability. The video group expressed its interest in the investigation suggested to MPEG by the JVT regarding the presentation by Feng Wu of Microsoft Research Asia on a proposal of JVT-based Fine Granularity Scalability (FGS) video coding and the associated general area of the potential for advanced FGS technology for a tentative phase 2 of the JVT video coding standards development process. The Video group encouraged the proponents and other parties

interested in FGS to define and conduct core experiments and to provide the results. If the results are evaluated to be substantial, the video group expects to request the creation of a Phase 2 JVT workplan with consideration to be given to the inclusion of such advanced FGS capability, starting in May 2002. A set of preliminary experiment conditions for was produced for the tentative JVT phase 2 project regarding FGS technology (N4471).

Proposals for Digital Cinema

Proposals and demonstrations were provided on the subject of technology for Digital Cinema video (M7608, M7638, M7639, M7645, M7674, M7839, M7848). Joint sessions were conducted with the Requirements subgroup to identify the requirements of the application and with the Test subgroup to establish test conditions for evaluating this technology. The following actions were taken:

A request for industry contributions on an MPEG standard for distribution of Digital Cinema Theatrical Content was produced (N4462)

A request for industry contributions on an MPEG standard for archival of Digital Cinema Theatrical Content was produced (N4462)

A report on the results of the assessment of responses to the Digital Cinema Call for Proposals (N4455).

An ad hoc group (N4461) was established to conduct further investigation of digital cinema technology.

3-D Video Technology

In response to a contribution on the subject, and following joint sessions with the Requirements group, a definition of preliminary requirements for 3D Video support in MPEG was produced (N4559), an ad hoc group was established (N4524), and further work on this subject was encouraged.

Interframe Wavelet Technology

In response to an ad hoc report indicating that new interframe wavelet video coding technology may be a promising area for MPEG standardization (M7645), an ad hoc group was established (N4474) to conduct further investigation of this area of technology.

Annex 8Audio report

Source: S. Quackenbush, Chair, Audio Subgroup

Opening of the meetingThe MPEG Audio Subgroup meeting was held during the 58th meeting of WG11 in Pattaya, Thailand, Dec 3-7, 2001. The list of participants is given in Annex A-1.

Administrative matters

Approval of agendaThe agenda, shown in Annex A-II, was discussed, edited and approved.

Singapore meeting reportThe Audio Subgroup Sydney meeting report, July 2001, had been previously distributed by email and was approved.

Allocation of contributionsAll contributions (see Annex A-IV) were allocated to the agenda and were discussed either in the task groups or in Audio plenary. The Chair brought other relevant documents from Requirements, Systems and MDS to the attention of the group.

Communications from the ChairThe Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.

Joint meetingsThe joint meetings with Audio over the course of the week are listed here and are reported on below.Group 1 Group 2 What Where When TimeAudio Requirements Requirements for

lossless codingAudio Wed 14:00-

15:00Audio ISG MPEG-7 reference

softwareAudio Wed 15:00-

16:00All MPEG-7 conformance Req Thu 14:00-

15:00Audio Systems BIM codecs Audio Thu 16:00-

17:00

Received National Body Comments and Liaison mattersThere were no NB Comments and one Liaison documents, as shown below.Document Title Source Author of Response7584 Liaison Statement from ITU-R SG 6/WP 6Q

to WG 11 on the Draft New Recommendations (SC 29 N 4430)

ITU-R SG 6/WP 6Q

Liaison

Task GroupsSix task groups were convened for the duration of the MPEG meeting, as shown in ANNEX-III. Results of task group activities are reported below.

Record of Audio plenary, joint meetings and task group activities

Audio plenary discussionsThe chair presented m7584, a liaison from ITU-R SG 6. It informed MPEG that there is a new name for the MUSHRA test and that ITU-R has continued interested in the MPEG work on audio metadata.Jens Spille presented m7631, “Identification of Errors in Decoder Software of MPEG-2 Layer III LSF (Distribution 10).” He will chair an AhG to resolve the identified errors in the reference software.Takehiro Moriya presented m7771, “Lossless audio coding schemes based on MPEG-4standard.” In the Monday plenary the Convenor noted that the Lossless coding investigation has been underway for some time, and recommended that it come to some definite conclusion by the end of the next AhG period.Bernhard Grill presented m7812, “Removal of narrow-band CELP restriction in scalable MPEG-4 Audio systems.” The document had listening test results that indicated merit for a wide-band CELP base coder in scalable MPEG-4 audio systems. After some discussion the Audio group agreed to include this capability in the corrigendum to MPEG-4 Edition 2001, but not to include it in any currently defined profile. In this respect, it does not affect any existing decoder.

Joint MeetingsJoint meeting with Requirements on requirements for lossless coding

The objective of this meeting was to formulate specific goals for an AhG activity on exploring the performance and applicability of lossless coding. This resulted in the following AhG mandates:

1. Collect technical evidence on the performance of lossless coding technology, particularly as it might be used to enhance existing MPEG technology.

2. Collect information on application areas and potential customersThe future of the lossless coding work will be decided at the next MPEG meeting: either to move on to an effort that may result in standardization, or to discontinue the explorations.

Joint meeting with ISG on MPEG-7 reference software

Joint meetings were held with ISG. This led to a concrete plan to specific and complete workplan for the full integration of version 1 reference software. Although all low level descriptor (LLD) extraction routines are currently available in Matalb, there may be more than one matlab script for a given LLD, so the correct routines need to be identified and the redundant ones removed. Furthermore, all code needs to be documented. Specifically, documentation for each D/DS as ASCII text file needs to be placed in the documents directory of the XM:

Use ./newsrc/Doc/Audio/DummyType.txt as a template Put in edited version in ./newsrc/Doc/Audio/*.txt

Joint meeting with all on MPEG-7 conformance

The several MPEG subgroups shared their perspective on MPEG-7 conformance. Audio learned that the DDL view of conformance makes use of “enhanced XML description generation module” that permits the comparison of two descriptions via a simple textual “diff” operation. This may be useful for syntactic level conformance testing. Requirements indicated that there will be an MPEG-7 “profiles under consideration” document, and Audio indicated that their only profile under consideration is an “audio only” profile. This may be somewhat of a misnomer as this must contain certain elements of MDS, e.g. Root Node and most likely Segment and perhaps other elements.

Joint meeting with Systems on BIM codecs

Systems presented a brief overview of BiM (Binary Metadata), and gave a more detailed presentation on their ideas of how signal processing techniques (i.e. codecs) could be used to enhance BiM compression. The current idea is to aassociate an XML schema type (i.e. D or Ds) with a specific BiM codec. The Audio chair urged MPEG-4 Audio experts to consider contributing to this effort. In order to get this work started, Systems has created N4430, “How to integrate specific decoders in BiM.” One issue to be resolved is how to instantiate a unique or a parameterised BiM codec (e.g. how to signal “decoderSpecificInfo”).

Task group discussionsMPEG-2 AAC Ralph Sperschneider

A draft corrigendum for MPEG-2 Part-7 (AAC) was prepared. Corrigenda working drafts for MPEG-2 Part-4 (AMD 1 & AMD 3, AAC Conformance) and MPEG-4 Part-5 (AMD 1, AAC Software) were updated. The status of the conformance test sequences was updated and a work plan was set up.

MPEG-4 V3 Heiko Purnhagen

The following issues were addressed in the “MPEG-4 V3” task group during the Pattaya meeting:The task group reviewed the Audio Call AhG recommendations as documented in: M7778 “Report of the AHG on Audio Coding Exploration”In addition, the following relevant input documents were reviewed: M7820 “Detailed technical description of Philips Parametric proposal for MPEG4-V3” M7724 “Core experiment on MPEG4-V3 Parametric Coding, Huffman Coding” M7725 “Core experiment on MPEG4-V3 Parametric Coding, Noise Gain Coding” M7767 “Report of MPEG-4 Audio BWE RM0 test results”The Philips parametric coding proposal (M7820) was successfully verified and accepted as RM0. In addition, both CE proposals (M7724, M7725) were successfully verified (by France Telecom) and accepted during the meeting in accordance with the “MPEG-4 Audio core experiment test methodology” (N1748, Stockholm, 1997). Based on this decision, both proposals were integrated in the submitted RM0 software and text (M7820) and RM1 (N4379) was prepared as a “working draft of MPEG-4 Audio Edition 2001 Extension 1” (formerly referred to as MPEG-4 Audio Version 3). Further details are described in the CE status and workplan document (N4380).Based on the preliminary report of the RM0 selection test (M7767) and the AHG report (M7778), a final RM0 selection test report (N4378) was prepared. The Coding Technologies proposal for bandwidth extension was selected as RM0 (subject to delivery of text and software). In addition, it was found that this proposal already fulfills the final acceptance criterion defined in the call for proposals (N3992) on bandwidth extension for audio. The timeline for delivery of RM0 text and software and also the timeline for Core Experiments was discussed in the task group and in audio plenary and is documented in a workplan (N4380). It starts with delivery of RM0 by 01-Feb-2002 and allows for 3 rounds of CEs until the final approval (FDIS) scheduled for the March 2003 MPEG meeting. It was agreed that the timelines for progression of “parametric coding” and “bandwidth extension” do not have to be aligned, but rather could be different.The following output documents were prepared, reflecting the work performed and status achieved during this meeting: N4378 “Report of MPEG-4 Audio BandWidth Extension RM0 Test” N4379 “MPEG-4 Audio Extension 1 WD” N4380 “Workplan for MPEG-4 Audio Extension 1 Core Experiments”

MPEG-4 Edition 2001 Mauri Väänänen

The group reviewed contribution document m7835 “Study on Text of ISO/IEC 14496-3:2001 DCor1”, as a starting point for the corresponding output document. Mostly this included corrections that had already been agreed on the ad-hoc group. The other relevant input document, m7812

“Removal of narrow-band CELP restriction in scalable MPEG-4 Audio systems” had already been reviewed in Audio plenary with a decision to include the proposed changes to the Corrigendum. A few other corrections were also identified, reviewed and added to the text during the week. Many of the corrections were copied from ISO/IEC 13818-7:1997 DCor2, which was also being prepared during the week. Finally the text of 14496-3:2001 DCor1 seemed sufficiently stable that it was decided to release the DCor from this meeting, with an editing period until January 28, 2002 (the same as for ISO/IEC 13818-7:1997 DCor2).

MPEG-4 Audio Conformance Ralph Sperschneider

Corrigenda working drafts for MPEG-4 Part-4 (Audio V1 and V2 Conformance) were updated. The status of the MPEG-4 conformance test sequences was reviewed. It turned out that especially for AAC the progress in providing MPEG-4 conformance test sequences is closely related to the successful completion of the MPEG-2 AAC work.

MPEG-7 V1 and V2 Phil Garner

Contributions M7676 and M7801 were reviewed. The Audio quality proposal is now quite advanced and has progressed to working draft. Software is also available, although the right thing to do with this will not be clear until the version 1 software issues are resolved (e.g. stand-alone Matlab code, Matlab code called by the XM, or C++ code tightly integrated into the XM). The core experiment continues, with Dolby labs and T-Nova offering to perform independent review and validation.Conttibution M7802 was reviewed. This is a minor modification to Spoken Content. Whether the modification is a matter for extension or corrigendum is a matter for future discussion.A working draft of MPEG-7 Audio Extension 1 has been produced, N4390.

MPEG-7 Audio Conformance Frank Klefenz

Meeting deliverables

Press statementAn outline of the Audio part of the press statement was prepared and approved.

Dispositions of CommentsThere were no DoC at this meeting.

Responses to Liaison and NB commentsThere were no Liaison or NB comment responses.

Recommendations for final plenaryA list of Audio recommendations were reviewed and approved.

Establishment of new Ad-hoc GroupsThe following ad-hoc groups were proposed for establishment by the Audio subgroup:Title Chair No. MtgAHG on MPEG-2 Audio Reference Software Jens Spille NoAHG on AAC R. Sperschneider YesAHG on MPEG-4 Audio DCorr Text and Reference Software

M. Väänänen Yes

AHG on MPEG-4 Audio Conformance R. Sperschneider YesAHG on MPEG-4 Audio Extension 1 Core Experiments

S. Quackenbush Yes

AHG on MPEG-7 Audio J. Bitzer NoAHG on Audio part of MPEG-7 Conformance F. Klefenz Yes

AHG on Issues in Lossless Audio Coding T. Moriya No

Approval of output documentsAll output documents, shown in Annex-IV, were presented in Audio plenary and were approved.

Future activities

Schedule of future meetingsAd Hoc group meetings are shown in the table listing the Ad Hoc groups.

Agenda for next meetingThe agenda for the next MPEG meeting, shown in Annex V, was reviewed and approved.

All other businessThere was none.

Closing of the meeting Audio plenary was closed at 13:00hrs. The Chair urged everyone to go for a relaxing swim as a way to prepare for closing plenary!

21 Annex A-I: ParticipantsFirst Name Last Name CountryAffiliation e-mail addressJoerg Bitzer DE Houpert Digital Audio [email protected] Burnett AU Univ of Wollongong [email protected] Dietz DE Coding Technologies [email protected] Fellers US Dolby [email protected] Garner JP Canon [email protected] Grill DE FhG IIS-A [email protected] Jost UK Canon [email protected] Kim KR Samsung [email protected] Kjörling SE Coding Technologies [email protected] Klefenz DE FhG AEMT [email protected] Klein MiddelinkNL Philips [email protected] Linzmeier DE FhG IIS-A [email protected] Meltzer DE Coding Technologies [email protected] Moriya JP NTT [email protected] Neo SG Panasonic [email protected] Oomen NL Philips [email protected] Philippe FR Envivio [email protected] Purnhagen DE Uni Hannover [email protected] Quackenbush US AT&T [email protected] FR France Telecom R&D [email protected] Sperschneider DE FhG IIS-A [email protected] Spille DE Thomson Multimedia [email protected] Väänänen FI Nokia Res. Center [email protected] Virette FR France Telecom R&D [email protected] Wolf DE T-Nova Berkom [email protected] Flaks US Dolby [email protected] Peeters FR CUIDADO - Ircam [email protected]

Annex A-II: Agenda for the Pattaya Audio MeetingAgenda Item Contributions1. Opening of the meeting2. Administrative matters

2.1. Approval of agenda2.2. Approval of Sydney meeting report2.3. Allocation of contributions2.4. Communications from the Chair

2.4.1. Goals of 58th Meeting2.5. Joint meetings2.6. Review of AhG reports 7637 7678 7778 7825

7831 77752.7. Review of task group mandates2.8. Received national body comments and liaison matters 75842.9. Plenary issues 7631 7771 7812

3. Task group activities3.1. MPEG-2 AAC

3.1.1. text 78263.1.2. conformance 7827 7828 78303.1.3. ref software 7829

3.2. MPEG-4 V3 7724 7725 7767 78203.3. MPEG-4 E2001 7812 78353.4. MPEG-4 V1 and V2 Conformance 7832 7833 78343.5. MPEG-7 V1 and V2 7676 7801 78023.6. MPEG-7 Conformance 15938-7 (FCD Mar 02)

4. Discussion of unallocated contributions5. Meeting deliverables

5.1. Press statement5.2. Dispositions of comments5.3. Responses to NB comments5.4. Liaison statements5.5. Recommendations for final plenary5.6. Establishment of new Ad-hoc groups5.7. Approval of output documents

6. Future activities6.1. Agenda for next meeting

7. A.O.B.8. Closing of the meeting

Annex A-III: Task Groups

1. MPEG-2 AACChair Ralph SperschneiderMandates:1.1. Review contributions1.2. Review outstanding issues1.3. Prepare ISO/IEC 13818-7:1997/DCor 21.4. Prepare Study on ISO/IEC 13818-4:1998/Amd 1:1998/DCor 11.5. Prepare Study on ISO/IEC 13818-4:1998/Amd 3:2000/DCor 11.6. Prepare Study on ISO/IEC 13818-5:1997/Amd 1:1999/DCor 11.7. Prepare Status and Workplan on AAC Conformance

2. MPEG-4 V3Chair Heiko PurnhagenMandates:2.1. Review Audio Call AhG recommendations2.2. Review contributions, including:

2.2.1. verify low complexity Huffman table CE2.2.2. verify noise gain coding CE2.2.3. bring recommendations wrt CE to Audio plenary

2.3. Prepare Report of MPEG-4 Audio BWE RM0 Test2.4. Prepare Workplan for MPEG-4 Extension 1 Core Experiments2.5. Prepare WD on MPEG-4 Audio Extension 1

3. MPEG-4 Edition 2001Chair Mauri VäänänenMandates:3.1. Review contributions3.2. Resolve issues on definition audio access unit in both 14496-1 and 14496-3 3.3. Prepare Study on ISO/IEC 14496-3:2001/DCor 1

4. MPEG-4 Audio ConformanceChair Ralph SperschneiderMandates:4.1. Review contributions4.2. Prepare Study on ISO/IEC 14496-4:2000/DCor 14.3. Prepare Study on ISO/IEC 14496-4:2000/Amd1:2001/DCor 14.4. Prepare Status and Workplan for MPEG-4 Audio Conformance

5. MPEG-7 V1 and V2Chair Phil GarnerMandates:5.1. Review contributions5.2. Review status of reference software5.3. Prepare Workplan for MPEG-7 Core Experiments

6. MPEG-7 Conformance 15938-7 (FCD Mar 02)Chair Frank KlefenzMandates:6.1. Prepare Audio Contribution to MPEG-7 Conformance (see N3999)

6.2. Prepare Status and Workplan for MPEG-7 Audio Conformance

Annex A-IV: Input and Output Documents

Contributed documentsThe following documents were contributed to the Audio Subgroup and were considered during this meeting:Number Section Source Title7631 Audio Walter Voessing, Jens Spille Identification of Errors in Decoder

Software of MPEG-2 Layer III LSF (Distribution 10)

7637 Audio Heiko Purnhagen, Andreas Hölzer Report of AHG on MPEG-4 Audio7678 Audio Takehiro Moriya Report of AHG on Issues in

Lossless Audio Coding7724 Audio Werner Oomen Core experiment on MPEG4-V3

Parametric Coding, Huffman Coding

7725 Audio Werner Oomen, Erik Schuijers Core experiment on MPEG4-V3 Parametric Coding, Noise Gain Coding

7767 Audio Schuyler Quackenbush (AT&T), Sang-Wook Kim (Samsung), Thomas Buchholz(T-Systems Nova), Jan Berg (Lulea Univ. Tech), Heiko Purnhagen (Uni. Hannover)

Report of MPEG-4 Audio BWE RM0 test results

7771 Audio Takehiro Moriya, Sang-Wook Kim Lossless audio coding schemes based on MPEG-4standard

7778 Audio S. R. Quackenbush Report of the AHG on Audio Coding Exploration

7812 Audio Bernhard Grill, Karsten Linzmeier Removal of narrow-band CELP restriction in scalable MPEG-4 Audio systems

7820 Audio Werner Oomen Detailed technical description of Philips Parametric proposal for MPEG4-V3

7825 Audio Ralph Sperschneider on behalf of the AhG on MPEG-2/4 AAC

AHG Report on MPEG-2/4 AAC


Study on text of ISO/IEC 13818-7:1997/DCor 2


Study on Text of ISO/IEC 13818-4:1998/Amd 1:1998/DCor 1






Status and Workplan for MPEG-2 AAC Audio Conformance

7831 Audio Ralph Sperschneider on behalf of the AhG on MPEG-2/4 AAC Conformance

AHG Report on Audio part of MPEG-2/4 AAC Conformance


Study on Text of ISO/IEC 14496-4:2000/DCor 1



















Conformance7833 Audio Ralph Sperschneider on behalf of the

AhG on MPEG-2/4 AAC Conformance

Study on Text of ISO/IEC 14496-4:2000/Amd1:2001/DCor 1

7834 Audio Ralph Sperschneider on behalf of the AhG on MPEG-2/4 AAC Conformance

Status and Workplan for MPEG-4 Audio Conformance

7835 Audio Andreas Hölzer on behalf of the AHG on MPEG-4 Audio

Study on Text of ISO/IEC 14496-3:2001/DCor 1

7676 Audio Joerg Bitzer, Stefan Kudras Proposal for Audio Quality Descriptors

7775 Audio Philip Garner Report of ad hoc group on MPEG-7 Audio

7801 Audio Joerg Bitzer, Stefan Kudras Report on CE on MPEG7 AudioQuality Descriptors

7802 Audio Uwe Jost, Phil Garner Proposal to clarify the meaning of the "Probablility" descriptor in SpokenContent

Output DocumentsThe Audio Subgroup produced the following output documents. Those approved for public release are indicated by the entry “Yes.”

Title No. PublicReport of MPEG-4 Audio BandWidth Extension RM0 Test 4378MPEG-4 Audio Extension 1 WD 4379Workplan for MPEG-4 Audio Extension 1 Core Experiments 4380Text of ISO/IEC 13818-7:1997/DCor 2:2002 4381Study on Text of ISO/IEC 13818-4:1998/Amd 1:1998/DCor 1 4382

Study on Text of ISO/IEC 13818-4:1998/Amd 3:2000/DCor 1 4383

Study on Text of ISO/IEC 13818-5:1997/Amd 1:1999/DCor 1 4384

Status and Workplan for AAC Audio Conformance 4385Text of ISO/IEC 14496-3:2001/DCor 1:2002 4386Study on Text of ISO/IEC 14496-4:2000/DCor 1 4387Study on Text of ISO/IEC 14496-4:2000/Amd1:2001/DCor 1 4388Status and Workplan for MPEG-4 Audio Conformance 4389MPEG-7 Audio Extension 1 WD 4390Workplan for MPEG-7 Core Experiments 4391Audio Contribution to MPEG-7 Conformance CD 4392 YesStatus and Workplan for MPEG-7 Audio Conformance 4393








Annex A-V: Agenda for the Jeju Island MPEG Audio MeetingAgenda Item Contributions1. Opening of the meeting2. Administrative matters

2.1. Approval of agenda2.2. Approval of Pattaya meeting report2.3. Allocation of contributions2.4. Communications from the Chair2.5. Joint meetings2.6. Review of AhG reports2.7. Review of task group mandates2.8. Received national body comments and liaison matters2.9. Audio plenary topics

3. Task group activities3.1. MPEG-2 Reference Software3.2. MPEG-4 Extension 1 Core Experiments3.3. MPEG AAC3.4. MPEG-4 Audio Conformance3.5. MPEG-7 Core Experiments3.6. MPEG-7 Conformance

4. Discussion of unallocated contributions5. Meeting deliverables

5.1. Press statement5.2. Dispositions of comments5.3. Responses to NB comments5.4. Liaison statements5.5. Recommendations for final plenary5.6. Establishment of new Ad-hoc groups5.7. Approval of output documents

6. Future activities6.1. Agenda for next meeting

7. A.O.B.8. Closing of the meeting

Annex 9SNHC report

Author: Euee S. Jang, Chair of SNHC subgroup

SNHC Meeting SummarySNHC objectives were: to check the conformance status of Version 2 tools (i.e., FBA and 3DMC), to discuss and evaluate the AFX CE results and update VM to discuss the AFX S/W development and produce workplan till Pattaya. and to review the FAQ of SNHC and e-mail reflectors.

SNHC Objectives & Work ItemsThe outline of more detailed meeting objectives and work is given below:MPEG-4 Version 2A. 3D Model Coding

1. Integration issue in SystemsMPEG-4 Ext. 4 AFXA. Animation Framework eXtension

1.Review CE contributions2.Update VM & WD3.S/W development

SNHC Contributions & Related ReviewAFX – Subdivision Surfaces

1. m7170 “3D model coding with Subdivision Surfaces-based wavelets”, Patrick Gioia

2. m7369 “Adaptive bitstream structure for zerotree-encoded geometric wavelet coefficients”, Patrick Gioia

3. m7425 “Progressive Geometry Compression”, Mikael Bourges-Sevenier, Andrei Khodakovsky, Peter Schröder, Wim Sweldens

4. m7450 “Hierarchical Subdivision Surfaces from a modeling perspective”, Michael Steliaros

5. m7465 “Truly Hierarchical Coding of 3D Models with Subdivision Surfaces”, Francisco Moran, Michael Steliaros

6. m7469 “Implementation of Subdivision Surfaces features in AFX software”, Mikaël Bourges-Sévenier, Henning Biermann, Denis Zorin

AFX – VTC7. m7327 “Incorporation of VTC Source Code into Blaxxun Contact v4.3”,

Gauthier Lafruit, Eric DelfosseAFX – Texturing

8. m7313 “Synthetic Video and Photo-Realistic 2D Animation”, Yosef Yomdin, Ehud Spiegel

9. m7237 “Standard Support for Progressive Encoding, Compression and Interactive Visualization of Surface Light Fields”, Radek Grzeszczuk, Jean-Yyes Bouguet, Micheal H. Chu, W-C. Chen, Omid A. Moghadam

10. m7444 + m744511. m7447 “Proposal for Image-based Rendering in AFX”, Mahnjin Han, Alexey

Ignatenko, Alexander Zhirkov, Leonid LevkovichAFX – MeshGrid & Solids animation

12. m7305 “Flexible MeshGrid representation and coding”, Ioan Alexandru Salomie, Augustin Gavrilescu, Adrian Munteanu, Gauthier Lafruit, Ilse Ravyse, Mihnea Galca, Rudi Deklerck, Jan Cornelis

13. m7536 “Flexible Animation using MeshGrid Models”, Ioan Alexandru Salomie, Ilse Ravyse, Augustin Gavrilescu, Gauthier Lafruit, Rudi Deklerck, Jan Cornelis

14. m7382 “Solid Model Representation”, Alain Mignot, Mikaël Bourges-SévenierAFX – Skin and bone

15. m7486 “Node syntax harmonization between bone-based animation and h-Anim 2001”, Marius Preda, Françoise Prêteux

16. m7487 “New Node Syntax Supporting Inverse Kinematics in Bone-Based Animation”, Marius Preda, Françoise Prêteux

AFX – Physics-based animation17. m7410 “Physics Based Animation’ Nodes for MPEG-4 BIFS”, Matt Adcock,

Chris Gunn, David Walsh and Matthew Hutchins

Output Document EditorsDocument Editor

SNHC Homepage review Mahnjin HanVM/WD Editor MBS, Michael Steliaros, Alexandru Salomie, Alain

Mignot, Marius Preda, Patrick GioiaAFX S/W development plan

Michael Steliaros, James D.K. Kim, Mikael Bourges-Sevenier

MPEG-4 overview (AFX) VM/WD editorsAFX CE description Marius Preda, Mahnjin Han, Michael SteliarosSNHC FAQ review Gauthier LaFruit, Ehud Spiegel, Yosi Yomdin, Omid,

Hideaki Kimata, Radek, Yamashita-sanPresentations Mahnjin Han

SNHC & Joint MeetingsSNHC group had the following work schedule along with joint meetings with other groups:

MONDAY (1-15-01)9 A.M. – 2 P.M. Monday Plenary

3 – 6 P.M. SNHC Plenary Roll CallApproval of agendaSNHC deliverablesAmd. 1 FBA ConformanceAmd. 1 3DMC ConformanceRef. S/W ArchitectureMPEG-4 S/W rewritingAFX and MUW issues

TUESDAY (1-16-01)9 – 10 A.M. Joint meeting (Systems) BIFS-related issues10 A.M. – 6 P.M SNHC Plenary AFX-CE contributions review

WEDNESDAY (1-17-01)9 – 10:30 A.M. Monday Plenary11:30 A.M. – 6 P.M

SNHC Plenary CE Decision making and VM updateOrganizational issuesNew CE designAFX S/W development plan

THURSDAY (1-18-01)10 A.M. – 1 P.M SNHC Plenary Still Texture discussion

General SNHC issuesMay interim meeting planningdeliverablesbyte alignment of 3DMC & FBAreview of VM updatesIPMP

2 – 3 P.M. Joint meeting (Systems) Im-1FRIDAY (1-19-01)

9 – 10 A.M. SNHC Plenary AFX S/W workplanSNHC resolutionsAHG groups

2 – 9 P.M. MPEG Plenary

Discussion

MPEG-4 3DMC extension to animationThere was a contribution document (M7446) stating that the 3DMC in BIFS can not directly support the animation combined with Interpolators. It was noted that the DEF names are not carried inside the 3DMC bitstream, hence the association of interpolators with the corresponding 3D mesh object was not possible at the decoder. The problem was acknowledged by the group and decide to solicit the opinion from BIFS experts in Systems group, while asking the proposers to bring more detailed input by the next meeting.

MPEG-4 Animation Framework eXtension (AFX)AFX CE Review: A2 (Subdivision Surfaces): In this core experiment, two methods are considered to represent subdivision surfaces: extended loop and extended Catmull-Clark. In addition to the basic functionality, the core experiment contains the hierarchical coding of subdivision surfaces. All the related contribution documents are reviewed during the meeting. The core experiment was not completed at the time and will continue till next meeting. A4 (Texturing): This core experiment contained matters related to VTC. And there were a few contributions made to Pattaya. Jointly with Video and Requirements group, the discussion continued. As an integral part of AFX, VTC will be implemented to the AFX S/W package.A5 (Solid model representation): There was a contribution on the CE. With some application example with Canadian space project, the proponents also showed that the implementation in CVS is complete. The decision is made that the basic node definitions for solid models will be placed in VM. The CE will continue till next meeting where further enhancement on node definition and implementation are anticipated. A6 (Mesh Grid representation): Modeling and animation of MeshGrid objects are shown as CE results. It, however, is noted that animation of MeshGrid objects may be done through existing framework within AFX. Further study will be conducted till next meeting. S/W implementation in

CVS will be continued till next meeting. All the node definitions will be updated in WD while the CE is complete.A7 (Skin & Bone): There was a request to harmonize the syntax between AFX and H-Anim specifications. Angular parameters are questioned whether Euler angle representation is better than Quaternion representation. There was also a suggestion to support IK in the node syntax. After a lengthy discussion, the group decided to continue the CE for more study.A8 (Multitexture): There are currently two small experiments: light field mapping and image based rendering under the CE. The proposal for light field mapping contained node definition and corresponding compression within it. Further study will be conducted as core experiment till next meeting. The proponent has showed capabilities with image-based rendering. How to integrate IBR into the existing AFX framework still remained as work to do till next meeting.Verification Model 4.0 & Working Draft 1.0: VM 4.0 has been updated both technically and editorially (N4221). The working draft for AFX is integrated with MUW in Systems specification (N4272).AFX S/W implementation: S/W implementation is a crucial part of AFX development. The group acknowledged the continuing delay in implementation progress due to the formal release of Contact3D version 5.0. The interim solution is to use Contact5.0 (executables). Because of some limitations, there is an effort to change the data repository from CVS. Further workplan can be found in N4222.

SNHC Homepage reviewSome discussion to improve the SNHC homepage has taken place. New version of home page is expected to appear before next meeting.

SNHC PresentationsThe group found that most contribution are presented by electronic presentation materials. Hence, it is decided to collect the materials during the meeting and to make them available in the SNHC homepage (http://www.sait.samsung.co.kr/snhc).

SNHC FAQ updateFAQ 5.0 of SNHC was reviewed by SNHC members and got fixed with new Q&As (N4018).

Output DocumentsRefer to Clause 7.

Ad Hoc Groups till next meetingRefer to Clause 7.

ParticipantsMany thanks to the following individuals who participated in SNHC meetings:

Name Company Country E-mailMatt Adcock CSIRO AU Matt. Adcock @cmis.csiro.au Mikael Bourges-Sevenier

iVast/Web3D Consortium

US m ikael @ivast.com

Patrick Gioia France Telecom FR patrick [email protected] Radek Grzeszczuk Intel US [email protected] Han Samsung AIT KR [email protected] Ho K-Jist KR [email protected] S. Jang Samsung AIT KR [email protected] D.K. Kim Samsung AIT KR [email protected] Kimata NTT JP [email protected]










Gauthier Lafruit IMEC BE [email protected] Mignot SGDL Systems CA [email protected] Moghadam Intel US [email protected] Preda INT FR [email protected] Radin Emblaze IL [email protected] Salomie VUB BE [email protected] Spiegel Vimatix IL [email protected] Steliaros Superscape UK [email protected] Oak Woo Samsung AIT KR [email protected] Yamashita ASCII JP [email protected] Yomdin Vimatix IL [email protected]












Annex 10Test group report

Source: Vittorio Baroncini, Chair

IntroductionDuring the 58th MPEG meeting, held in Pattaya (TH), the Test Subgroup produced the following documents:

Results of Subjective Assessment of Responses to Video Call for New Tools to Further Improve Coding Efficiency (N4454),

Results of Assessment of Responses to Digital Cinema Call for Proposals (N4455), MPEG-4 Visual Fine Granularity Scalability Tools Verification Test Plan (N4456), Results of the MPEG-4 Studio Profile Verification Test (N4457), Digital Cinema “Expert Viewing” Test Methodologies (N4458), Request for Content in Preparation for a Digital Cinema Call For Proposals (N4459).

In particular the first two documents of the above list are the final version of two documents released at the Sidney meeting, classified as containing a preliminary results of the tests.

Competition testsDuring the Pattaya meeting the report describing the preliminary results of the Video Call for New Tools to Further Improve Coding Efficiency (N4240), has been deeply revised and the revised version has been approved by the Video and Test groups.This process led to the edition of document N4454, that has been retained to remain an internal MPEG document.

Coding EfficiencyDuring the Pattaya meeting the report describing the preliminary results of the Video Call for New Tools to Further Improve Coding Efficiency (N4240), has been deeply revised and the revised version has been approved by the Video and Test groups.This process led to the edition of document N4454, that has been retained to remain an internal MPEG document.The main outcome of these test is that, among the other competitors to MPEG, the H26L proposal performs very well compared to MPEG-4. In particular, at higher bitrates (512kbit and 1024 kbits), the performance of H.26L at 512 kbit is comparable to the performance of MPEG-4 at 1024 kbit.

D-CinemaThe report from the Pattaya meeting (document N4142) showed that no clear winner was coming out from these tests. This was retained somehow contradictory to some of the proponents that were looking at MPEG-4 studio profile more to a competitor than a reference model; furthermore, during the Pattaya meeting a number of claims on the tests, already raised at the Sidney meeting, have been reiterated by some proponents. Nevertheless a new report of the test (N4455) have been approved as final version of the test results, but, at the same time, it has been retained to remain an internal MPEG document, and several further comments have been reported in the final part of document N4455.

Verification testsAt the Sidney meeting two verification test were expected to provide results to this meeting, dealing with the Studio Profile and the Fine Granularity Scalability.

Studio Profile

Document N4457 describes the results of the Studio Profile verification tests.This verification process begun on July 1999 (Vancouver meeting).Two companies participated to this process: Sony and NHK.The results of this test showed that : for multi generation dubbing of HDTV level images, there are no differences between the no

dubbing case and five times dubbing case, For multi generation dubbing of SDTV level images, there are no differences between the no

dubbing case and five times dubbing case except for the quality of the Simple Studio of the “Gate and Garden” sequence; the "Gate and Garden" sequence is critical including high-frequency components, and slight degradation of the image quality occurred,

the quality differences between the test sequences that are encoded at half of the maximum bitrate and reference sequences are quite small, therefore, encoding at half of the maximum bitrate is sufficient to cope with high-quality applications requirements,

the wide bitrate extent of Studio Profile still provides a consistent margin to deal with the quality requirements of professional applications,

composition by chroma-key tests, has shown that encoding by the 4:4:4 chrominance format is superior to the 4:2:2 format,

contrast change tests, has shown that the 10 bits pixel depth encoding process is superior to the 8 bits one.

Therefore it may be concluded that the results of formal subjective tests of MPEG-4 Studio Profile shows that the defined Profile@Levels meet the requirements for high quality applications.

Fine Granularity ScalabilityDocument N4456 describes the prolonging of the, formerly agreed, schedule of the Fine Granularity Scalability verification test.This further extension of the original schedule was due to two major reasons:

- one of the hard drives used to exchange the test material failed working as connected to the FUB site; this failure made impossible the execution of the dynamic tests.

- the results of the static tests were judged not to be satisfactoryAccording to the new schedule, both the static tests and the dynamic tests will be conducted again, and the results will be provided at the next Jeju meeting.

Activity on Digital CinemaThe video and the test groups undertook a consistent activity on the Digital Cinema.This work has been oriented in several directions, among which the relevant one (for the test group) has led to a draft text dealing with a new methodology to subjectively assess the results obtained by companies participating to d-cinema core experiments.The output document entitled <Digital Cinema “Expert Viewing” Test Methodologies> (N4458), has been approved by both video and test group, as a guidance in the assessment of digital cinema video material, in a way to avoid the use of naïve viewers and to save time; on the other hand the proposed method is expected to produce a higher accuracy in the evaluation results.In accordance with activity made inside the video group, the test group has approved the document <Request for Content in Preparation for a Digital Cinema Call For Proposals> (N4459), that will allow to make available to companies working inside the core experiments on d-cinema, new video material well representing the actual content of the “feature films”.To better achieve results in this area, an AhG on digital cinema has been established (doc. N4461) chaired by W. Husak and E. Edwards, with the following mandates:1. Compile and post industry feedback from call for Industry Distribution and Archive

contributions and prepare study document for next meeting 2. Preparations for future testing & logistics for core experiments

3. Compile and post industry feedback on document - Digital Cinema “Expert Viewing” Test Methodologies [N4458] for the purpose of furthering understanding of subjective testing methodologies of Digital Cinema content

4. Prepare study document for the next MPEG meeting.

Annex 11ISG report

Source: ISG ChairEditor: Stephan Herrmann, Marco Mattavelli (EPFL)

OverviewThe main work items of the Implementation Studies Subgroup in Pattaya are:

1. MPEG-7 XM reference software development for video/audio descriptors and Descriptor Schemes and related editing activity for the MPEG-7 Part 6: Reference Software FCD

2. Reference Hardware description for MPEG-43. Update of the reference Software section of the MPEG-7 Overview document.4. JVT Codec complexity

Input contributions w.r.t. the above items are summarized according to the following table:

MPEG-7 XM developmentM7791 Report of AHG on XM Development Stephan Herrmann

MPEG-4 Reference HardwareM7864 MPEG-4 Part 9 Contributions Site Robert Turney

Detailed Report

MPEG-7 XM reference software developmentFour joint meetings have been taken place during the week between the ISG team involved in the XM development and video, MDS, audio and BiM groups. The main outcomes of the discussions can be summarized as follows:

Joint Meeting ISG-Video

The status of the integration of video Ds has been analyzed. Almost all Ds are fully integrated, documented and verified. Only one descriptor is not compilable due to changes in a sub descriptor. However, because the proponents are not active anymore within MPEG, new responsible persons committed to update the code.Furthermore, an schedule was fixed to integrate the modules for version 2.

Joint Meeting ISG-Systems

In this joint meeting, the integration of the BiM tools was discussed. The BiM tools consist of two packages, the BiM codec, to convert XML to the corresponding binary representation and the TeM tool to create access Unitis of the descriptors. The TeM code was provided during the meeting and integrated into the XM software. A schedule for upgrading the code to support the required xerces library version was fixed.The BiM codec was not accessible during the meeting and will be provided right after the meeting. Because the BiM codec is written in Java, it will be an extra tool coming with the source code of the XM software.

Joint meeting ISG-Audio

Audio group informed ISG about the status of the reference software, which is in major parts written using MatLab. Audio and ISG agreed to copy the MatLab files into the XM source code. Therefore, the Audio components must be renamed to indicate which code module refers to which D or DS, and to have different names for different files. The deadline for this work has been agreed for the 31.December 2001.For the integration of the version 2 DSs an integration schedule has been fixed.

Joint ISG-MDS

The status of the few missing modules has been clarified and commitments for the submission of glue components and the few documentation modules have been agreed. End of December has been agreed for the final update of software to FDIS and the corresponding software verification.

Editing of the "Study of ISO/IEC FCD 15938-6 Information Technology -Multimedia Content Description Interface- Part 6: Reference Software"

A major part of the meeting was dedicated to draft a DoC document incorporating the request of the Japan and US NB comments on the MPEG-7 FCD reference software text. The new draft version of the document has been released on this meeting. An editing period of one week has been fixed to allow fixing bugs before voting of the new FDIS document.

Meeting outcomes about Reference Software development

In conclusion main achievements of the meeting concerning the Reference Software development are: 1. The update of Work schedules for the XM integration (video tools, audio tools and DS)

including the new steps "code update" according to FDIS, and "final verification".2. The initial draft of the Study of the MPEG-7 Reference Software FCD, including modifications

asked by NB comments. 3. The schedule for integration the Version 2 modules has been agreed with the video and the MDS

group.

Reference hardware description for MPEG-4There were no activities on this meeting concerning this item. However, Ad Hoc group was re-established to continue the activity on the next meeting.

MPEG-7 Overview DocumentA significant part of the meeting was used to do some editorial work on the reference Software section of the MPEG-7 Overview document. This work was concluded during the meeting.

JVT Codec complexityAn Ad Hoc group was established to study the implementation complexity of the JVT codec and to identify techniques to reduce this complexity. During the joint meeting with video group it was discussed how to proceed for the complexity analysis. It was identified that first the features to be analyzed should be specified in a complexity model.

Annex 12Liaison report

Source: Jan Borman

The Liaison Group considered the following input documents:

No. Title

M7556 Liaison Statement from CEN/ISSS to WG 11 (SC 29 N 4384)

M7571 Liaison Statement from TV-Anytime Forum (SC 29 N 4401)

M7577 Liaison Statement from CEN/ISSS (SC 29 N 4408)

M7584 Liaison Statement from ITU-R SG 6/WP 6Q to WG 11 on the Draft New Recommendations (SC 29 N 4430)

M7606 Summary of Response to Request for SC 29 Approval of Category A Liaison between SC 29/WG 11 and ISMA (SC 29 N 4462)

M7609 USNB Contribution: Liaison between ISMA and WG 11

M7626 Liaison Statement from ITU-T SG 16 to SC 29/WG 11 on Security Issues of Mediacom 2004 and MPEG-21 (SC 29 N 4477)

M7654 OeBF Liaison Statement and Rights Language Requirements

M7734 Web3D Liaison statement to MPEG

M7769 Liaison Statement from IFPI on Meeting Locations

M7770 Liaison Statement from IFPI on Licensing Cost of WG11Specifications

M7839 Liaison to WG11 from SMPTE regarding Digital Cinema

M7866 IEC NP: Multimedia systems and equipment -- Multimedia home server -- Interchangeable volume/file structure adaptation for broadcasting receivers

To strengthen the relationship with the ITU-T SG16 Mediacom2004 initiative, and given the conflict of dates between the March ITU-T SG16 Mediacom 2004 and MPEG Korea meetings, it was decided to hold a joint technical meeting dedicated to the possible collaborations between MPEG-21 and Mediacom 2004. This meeting will take place February 11th 2002 in Geneva.

INTERNATIONAL ORGANISATION FOR STANDARDISATION · Web viewDesignation FDIS/FDAM Doc Number...

Documents

Transcript of INTERNATIONAL ORGANISATION FOR STANDARDISATION · Web viewDesignation FDIS/FDAM Doc Number...