INTERNATIONAL ORGANISATION FOR STANDARDISATION · Web viewm6439 3GPP TSG-SA WG4 - liaison on MPEG-4...

INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION

ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO

ISO/IEC JTC 1/SC 29/WG 11 N3618October 2000

Source: Leonardo Chiariglione – ConvenorTitle: Report of 54th WG 11 meetingStatus:

1 OpeningThe 54th meeting was held at La Baule, FR on 00/10/23-27 at the kind invitation of AFNOR. At the Wednesday plenary Mr. J. Guichard, head of the Direction Interactions Humaines at France Telecom R&D, highlighted the role of Multimedia in the telecommunication business.

2 Roll call of participants The liust of participants is given in Annex I.

3 Approval of agendaThe approved agenda is given in Annex 2.

4 Allocation of contributions The list of input contributions is given in Annex 3.

5 Communications from Convenor There were no specifc communications.

6 Report of previous meeting The reports of the Geneva and Beijing meetings were approved

7 Processing of NB Position Papers NB input papers were processed and responses provided.

8 MPEG Phase 2

8.1 AmendmentsThe Content description data amednment was approved ad FDAM

8.2 WorkplanThis was approved.

1

9 MPEG Phase 4

9.1 Version 19.2 Version 3XMT was approved ad PDAM.

9.3 CorrigendaCorrigendum 1 to ISO/IEC 14496-1:2000 was approved as DCOR1


10 MPEG Phase 7The MPEG-7 standard was approved as CD as follows:

Title No.Text of CD 15938-1 (Systems) 3701Text of CD 15938-2 (Description Definition Language) 3702Text of CD 15938-3 (Visual) 3703Text of CD 15938-4 (Audio) 3704Text of CD 15938-5(Multimedia Description Schemes) 3705Text of CD 15938-6 (Reference SW) 3706


11 MPEG phase 21The following two calls for propoisals were approvedCall for proposals for Digital Item Declaration N3756Call for proposals for Digital Item Identification and Description

N3757

11.1 WorkplanThis was approved

12 Overall WG11 workplan This was approved

13 ExplorationsThe following Calls for proposals were issued:Call for Proposals for new tools to further improve video coding efficiencyDraft Digital Cinema Call for ProposalsCall For Evidence for New Tools for Audio Coding

14 Liaison mattersInput documents were processed and responses provided.

15 Administrative matters

15.1 Schedule of future MPEG meetings This was approved as follows

2

No. yy Mm dd City Country54 00 10 23-27 La Baule FR55 01 01 15-19 ? ?56 01 03 05-09 Singapore SG57 01 07 23-27 Eilat IL58 01 10 15-19 Washington, DC US59 01 12 03-07 ? ?60 02 03 18-22 ? ?61 02 07 ? (Montreal, QC) CA62 02 10 ? ? ?

16 Organisation of this meeting

16.1 Tasks for subgroupsTasks were assigned as followsRequirements MPEG-4 Requirements

MPEG-4 Overview MPEG-7 Requirements MPEG-7 Overview MPEG-21 requirements MPEG-21 use cases MPEG-21 Study of PDTR MPEG-21 CfPDigital Cinema CfP

Systems Carriage of Metadata on MPEG-2 TS Carriage of MPEG-4 over RTP MPEG-4 v.2 conformance MPEG-4 new edition status FlexTime XMT FlexTime conformance XMT conformanceProcessing of IPMP CfP responses Processing of Multiuser CfP responses MPEG-7 Systems CD MPEG-7 DDL CD Study of MPEG-21 PDTR Study of MJ2000

MDS MPEG-7 MDS CD Study of MPEG-21 PDTR

Video MPEG-2 Interlace/progressive FDAM MPEG-4 v.2 conformance MPEG-4 new edition status MPEG-4 v.3 MPEG-4 v.4 MPEG-4 v.3 conformance MPEG-4 v.4 conformance MPEG-7 Video CD Video coding efficiency CfP

3

Audio Reference software MPEG-4 v.2 conformance MPEG-4 new edition status MPEG-7 Audio CCD Audio CfE

SNHC MPEG-4 v.2 conformance MPEG-4 new edition status Processing of CfP responses SNHC FAQ

Test V.3 verification tests V.4 verification tests Video CfP material Digital Cinema CfP material

ISG MPEG-7 XM CD Liaisons Study input documents

Produce output documents HoD Friday plenary support Munchurl Kim, Jean Stride

La Baule meeting accounts Meeting schedule MPEG FTP site - study of what is missing, meet with Mike and understand JTC1 organisation MPEG FTP siteMeeting scheduleUpdate requirements for meeting hosts

16.2 Joint meetingsThe following joint meetings were held

Group 1 Group 2 What Where When

Requirements Systems MPEG-4 IPMP Systems Mon 16:00-18:00

SNHC Systems, Requirements

Graphic profile Systems Mon 19:00-20:00

Video Test Video CfP Video Tue 09:00-09:30

MDS ISG MPEG-7 SW MDS Tue 09:00-10:00

Systems Audio, Video MP4 on IP Systems Tue 10:00-11:00

MDS DDL, Audio, Video Schema design MDS Tue 10:00-12:00

4

ISG Audio XM integration schedule

Audio Tue 15:00-16:00

ISG Systems Parser implementation

ISG Tue 17:00-18:00

SNHC Req, ISG Graphics profiles Req Wed 08:00-09:00

Req Systems MPEG-4 IPMP Systems Wed 12:00-13:00

MDS Systems, Req MPEG-7 architecture Req Wed 14:00-15:00

Req MDS MPEG-7 profiles Req Wed 15:00-16:00

Audio ISG XM integration schedule

ISG Wed 16:00-17:00

Req Systems Metadata on MP2 Req Thu 08:00-09:00

SNHC Req Generic anim framework

Req Thu 10:30-11:00

MDS SNHC, Video MPEG-7 SNHC tools MDS Thu 11:00-12:00

SNHC Systems IM1 Systems Thu 14:00-15:00

Systems Req IPMP Req Thu 16:00-17:00

Video Test, Req Digital Cinema Req Thu 17:30-18:00

17 Planning of future activities The following ad hoc groups were established3709 AHG on 3DMC conformance3711 AHG on AFX S/W implementation3710 AHG on AFX VM editing and Core Experiments3655 AHG on Audio call for Evidence3653 AHG on Audio part of MPEG-4 Conformance3638 AHG on Audio, Video, and MDS harmonization3762 AHG on Conformance and Interoperability in MPEG-73680 AHG on core experiments for visual descriptors in MPEG-73663 AHG on Digital Cinema3681 AHG on editing the document of the MPEG-7 Visual part of XM and WD3636 AHG on Editing the MDS XM & CD3763 AHG on evaluation to the responses to MPEG-21 Call for Proposals for Digital Item

Declaration3708 AHG on FBA conformance3678 AHG on Fine Granularity Scalability in MPEG-4 video

5

3739 AHG on IM13640 AHG on Metadata Integration3764 AHG on MPEG support of the Digital Media Standards Summit3765 AHG on MPEG-21 Outreach3767 AHG on MPEG-21 PDTR Study3766 AHG on MPEG-21 User Privacy Issues3654 AHG on MPEG-4 Audio 2000 Edition3652 AHG on MPEG-4 Audio Reference Software 3737 AHG on MPEG-4 BIFS3736 AHG on MPEG-4 Conformance3740 AHG on MPEG-4 Content on MPEG-2 Systems and IP Network3743 AHG on MPEG-4 IPMP Extensions3738 AHG on MPEG-4 Textual Format3760 AHG on MPEG-7 Applications & Promotion to Industry3656 AHG on MPEG-7 Audio 3735 AHG on MPEG-7 data binary representation3734 AHG on MPEG-7 DDL3742 AHG on MPEG-7 Intellectual Property Management & Protection (IPMP)3637 AHG on MPEG-7 MDS Core Experiments 3733 AHG on MPEG-7 Systems3741 AHG on multi-user applications3677 AHG on software integration and verification in MPEG-4 video3761 AHG on Study of MPEG-7 Mobile Applications3682 AHG on the Call for Proposals for new tools to further improve video coding efficiency3679 AHG on the Studio Profile in MPEG-4 video3639 AHG on the TV-Anytime Application3660 AHG on XM Development

18 Resolutions of this meeting These were approved

19 A.O.BThere was no other business

20 ClosingThe meeting was closed at 01/10/27T22:58,

6

Annex 1Attendance list

1st Name Last Name Affiliation CountryHerrrmann BEATDaniel LEDERMANNKen LEVYWolfgang PUTZIlse RAVYSEFaouzi ACAYA CAEIKA Digital media institutErnest WAN CANON/CISRA AUMikhail SHNAIDER Telstra AUIan BURNETT Univ of Wollang AUMark PICKERING Univ. of New South Wales AU

Van De WALLE BEJan DEVOS Happy Machines n.v. BEYan BURMANS IMGC BEP. HAIGHTON Videospheres CATouradj EBRAHIMI EPFL CHMarco MATTAVELLI EPFL CHJean-Pierre EVAIN UER CHLi BO Beijing University CNLifang Wu Beijing university CNYang SHIQIANG Tsinghua University CNUlrich NIEDERHEIER DEHolger GRAHN Blaxxun Interactive AG DEPeter SCHICKEL Blaxxun Interactive AG DECarsten HERPEL Deutsche Thomson Brandt DEBodo TEICHMANN DIRECKTKONTO DEKlaus DIEPOLD Dynapel Laboratories DEBernhard GRILL FhG Erlangen DEJuergen HERRE FhG Erlangen DEFrank KLEFENS FhG Erlangen DEGabriele SPENGER FhG Erlangen DER. SPERSCHNEIDER FhG Erlangen DEKartsen MULLER HHI DEThomas SIKORA HHI DEStephan HERRMANN MUT DEMarkus Werner SEED DEJoerg HEUER Siemens AG DEAndreas HUTTER Siemens AG DEAndreas Aust Thomson Multimedia DEHeiko PURNHAGEN Universität Hannover DEMichael WOLLBORN Universität Hannover DEPhilippe SALEMBIER UPC ESJose MARTINEZ

SANTCHEZUPM ES

Francisco MORAN BURGOS UPM ES

7

1st Name Last Name Affiliation CountryJyri HUOPANIEMI Nokia Research Center FIJani LAINEMA Nokia Research Center FIMauri VÄÄNÄNEN Nokia Research Center FIMarc VUCHET BONDET FRDidier MARY FRMarie-joelle ANTOINE AFNOR FRF. DUBLANCHET Canal+ Technologies FRDavid LEPORINI Canal+ Technologies FRHervé MURRET Canal+ Technologies FRLilian LABELLE CANON research FRJ. Michel TRIVI Creative FRJC. DUFOURD ENST FRPhilippe HOOGVORST ENST FRRenaud CAZOULAT Envivio FREric DENIAU Envivio FRYannick LEDUC Envivio FRAlex MACAULAY Envivio FRMichael ROPERT Envivio FRJules SIGNES Envivio FRGrégoire PAU Expway FRThierry SERGENT Expway FRClaude SEYRAT Expway FRCédric THIENOT Expway FRAndré CHAUBEAU FIAPF FROlivier AVARO FR Telecom FRMatthieu CARRE FR Telecom FRAlexandre COTARMANAC'H FR Telecom FRMarc EMERIT FR Telecom FRB. FOULONNEAU FR Telecom FRJérome FOURNIER FR Telecom FRPatrick GIOIA FR Telecom FRAlain GUYADER FR Telecom FRMariette MAURIZOT FR Telecom FRPierrick PHILIPPE FR Telecom FRJean-Bernard RAULT FR Telecom FRCatherine ROUX FR Telecom FRBertrand THEBAULT FR Telecom FRDominique CURET FR Telecom R&D FROlivier AUBAULT FT R&D FRMarius PREDA INT FRFrançoise PRETEUX INT FRTitus ZAHARIA INT FRVincent PUIG IRCAM FRMinh Phung BUI THI LIP6/UPMC FRPhilippe JOLY LIP6/UPMC FRRosa RUILOBA LIP6/UPMC FRSébastien LELONG NOOS FRStéphane SANCHEZ NOOS FR

8

1st Name Last Name Affiliation CountryPhilippe GENTRIC Philips FRLaurent HERRMANN Philips FRBenoit MORY Philips FRYves RAMANZIN Philips FRNicolas SANTINI Philips FRJean LECHARNY SYMAH Vision FRPierre CLEMENT Thomcast FREdouard FRANCOIS THOMSON multimedia FRPhilippe GUILLOTEL THOMSON multimedia FRPaul KERBIRIOU THOMSON multimedia FRFrançois LE CLERC THOMSON multimedia FRGérard MOZELLE THOMSON multimedia FRLionel OISEL THOMSON multimedia FRPhilippe ROBERT THOMSON multimedia FRAhik MAN EMC ILAvidan AKIRAB Neomagic LTD ILZvi LIFSHITZ Optibase ILMassimo BALESTRI CSELT ITFabio BELLIFEMINE CSELT ITL. CHIARIGLIONE CSELT ITGuido FRSCHINI CSELT ITMarco GANDINI CSELT ITAlessandro BUGATTI Università di Brescia ITItaru KANEKO ASCII Corp. JPTutomu ANDO Canon Inc. JPYasuo FUKUDA Canon Inc. JPMikio SASAKI DENSO JPNeil DAY Digital Garage Inc. JPYoshinori SUGIHARA EIAJ JPKoiti HASIDA ETL JPMasatsugu KITAMURA FMCAVL JPCraig SCHULTZ Fuji JPYoshioica MAICOTO Fujitsu Labs JPMasami MIZUTANI Fujitsu Labs JPKilho SHIN Fuji-Xerox JPTakehiro FUJITA Hitachi Ltd JPYuichiro NAKAYA Hitachi Ltd JPYasuyuki OOKI Hitachi Ltd JPYoshinori SUZUKI Hitachi Ltd JPTohru YOKOYAMA Hitachi Ltd JPYoshihisa GONNO IBLabs JPTomohiro AZAMI JVC JPKoichi EMURA Matsushita JPShinya KADONO Matsushita JPTakuyo KOGURE Matsushita JPTakanori SENOH Matsushita JPKohtaro ASAI Mitsubishi JPTokumichi MURAKAMI Mitsubishi JP

9

1st Name Last Name Affiliation CountryHirofumi NISHIKAWA Mitsubishi JPMasahiro IWADARE NEC JPHitoshi KOYAMA NEC JPRyoma OAMI NEC JPAkio YAMADA NEC JPMasahiro SHIBATA NHK JPYoshiaki SHISHIKUI NHK JPTatsuya FUJII NTT JPTetsuro FUJII NTT JPSanae HOTANI NTT JPTakehiro MORIYA NTT JPHideki SAKAMOTO NTT JPShun-Ichi SEKIGUCHI NTT JPYoichi TAKASHIMA NTT JPShigeru FUKUNAGA Oki JPHajime MIYASATO Pioneer JPTakeshi NAKAMURA Pioneer JPTakayuki KUNIEDA RICOH JPKiyoshi SUZUKI RICOH JPEtsuko SUGIMOTO Sanyo JPYasuaki TOKUMO Sharp JPYoshiaki TOMIOKA Sharp JPShuichi WATANABE Sharp JPFrank BOSSEN Sony JPPeter KUHN Sony JPMasayuki NISHIGUCHI Sony JPYoshiaki SHIBATA Sony JPTeruhiko SUZUKI Sony JPKatsumi TAHARA Sony JPToby WALKER Sony JPYoichi YAGASAKI Sony JPOsamu HORI Toshiba JPToshimitsu KANEKO Toshiba JPYoshihiro KIKUCHI Toshiba JPToshinori ODAKA Toshiba JPHisashi YAMADA Toshiba JPTomoo YAMAKAGE Toshiba JPTerumasa AOKI U. Tokyo JPMayumi NAKATA U. Tokyo JPHiroshi YASUDA U.Tokyo JPJake YANG KRLee SANG YOUN Corea Telecom KRChang Yeol LEE Dongeui University KRChee Sun WON Dongguk University. KRWon-Sik CHEONG ETRI KRSu-Young CHI ETRI KRHyun Sung CHANG ETRI KRMunchurl KIM ETRI KR

10

1st Name Last Name Affiliation CountryWook Joong KIM ETRI KRSoo-Jun PARK ETRI KRWhoi-Yul KIM Hanyang University KRJin-Hak LEE Hyundai Electrics Industries KRHyun-Soo KANG Hyundai Electronics Ind. KRSanghoon SULL KR University KRSeoung Jun OH KwangWoon University KRHeon-Jun KIM LG Elite KRJin-Soo LEE LG Elite KRJung-Min SONG LG Elite KRYoung-Won SONG LG Elite KRKyoungro YOON LG Elite KRJhong Geon KIM MetaRights Inc. KRYoung-Kwon LIM Mp4cast KRMahnjin HAN SAIT KREuee-Seon JANG SAIT KRJames KIM SAIT KRSang-Kyun KIM SAIT KRSang-Wook KIM SAIT KRSung-Hee PARK SAIT KRSang WOO SAIT KRYanglim CHOI Samsung Electronics KRKang Wook CHUN Samsung Electronics KRYung-Lyul LEE Samsung Electronics KRKi Won YOO Samsung Electronics KRYun-Yu YU Samsung Electronics KRKim Tai WOO Sealtronic Technology KRHae-Kwang KIM Sejong University KRHan Seung JUNG Seoul National University KRJae-Yong LEE Serome Technology KRJoon-Ho CHANG Serome Technology Inc. KRJae-Won CHUNG Serome Technology Inc. KRDominique YON CISAC LiaisonAndré DUCROT ISO/IEC JTC 1/SC 24 LiaisonYuval FISCHER Web3D Consortia LiaisonAaron WALSCH Web3D Consortia LiaisonRalf FUNKEN NLC. CHRISTOPOULOS Ericsson Research NLFrancisco RIVAS Ericsson Research NLWin MOOIJ Irdeto NLRob KOENEN KPN Research NLRobert FRANODEULE Mindport NLPeter MULDER NOB NLJan Van der MEER Philips Digital Networks NLJean GELISSEN Philips Research NLM. van der SCHAAR Philips Research NLJ. A. E. HOLTMANS Telematica Instituut NLAndrew PERKIS Norwegian University NO

11

1st Name Last Name Affiliation CountryAntonio SANTOS PTFernando PEREIRA IST PTMarie DAHLOVIST Teracom SEBo LAN JVC Asia SGYasuhiro YAMADA JVC Asia SGKai-Kuang MA Nanyang Technological University SGAh Peng TAN Panasonic SGLei WANG Panasonic SGJ. GRANT Baxall UKJ. STRIDE BSI UKW. CHIU Canon Research Centre UKP. GARNER Canon Research Centre UKT. ROSE Canon Research Centre UKP. KUDUMAKIS CRL UKP. JESSOP IFPI UKD. ARMATI InterTrust Technologies UKN. RUMP InterTrust Technologies UKEdouard HARTLEY Lancaster University UKA. LINDSAY Lancaster University UKK. HILL MCPS UKM. BOBER Mitsubishi Electric Information

TechnologyUK

L. CIEPLINSKI Mitsubishi Electric Information Technology

UK

D. WHITE NDS UKK. GRANT Nine Tiles UK

STELIAROS Superscape (UK) Ltd. UKPing Wu Tandberg UKA. BRAY UBQT Media UKW. CHRISTMAS University of Surrey UKDavid SINGER Apple Computer Inc. USHsi-Jung WU Apple Computer Inc. USBarry G HASKELL AT&T USOliver MORGAN Avid Technology Inc. USAna BENITEZ Columbia University USFaramarz AZADEGAN Conexant Systems Inc. USRon GOODMAN Creative Advanced Technology Center USAllan PEACH DemoGraFX USGuanghua ZANG DiamondBack Vision Inc USWilliam SEVERSON DiamondBack Vision Inc. USDonal MEAD Digital Electronic Cinema USJean LE FEUVRE E-Vue Inc. USPaolo MONTALTO E-Vue Inc. USChristopher WENDT E-Vue Inc. USEric PETAJAN Face2Face. USTed Shapiro FIAPF/MPA USMark ROWE Hewlett-Packard Company USAshish BANERJI Hughes Electronics US

12

1st Name Last Name Affiliation CountryChao-Kung YANG Hughes Electronics USPete SCHIRLING IBM USMichelle KIM IBM Corp. USDulce PONCELEON IBM Corp. USZon-Yin SHAE IBM Corp. USJohn SMITH IBM Corp. USStephen WOOD IBM Corp. USMark BUXTON Intel Corp. USYen-Kuang Long

CHEN Intel Corp. US

Regis CRINON Intel Corp. USVaughn IVERSON Intel Corp. USHong JIANG Intel Corp. USMohamed OULD YAHYA Intelsat USJordan ISAILOVIC JRI Technology USKristine KNEIB KNK-mpeg.com USZachary COFFIN KPMG Consulting USThomas MEIER Ligos Corp. USMark PALEY Liquid Audio Inc. USS. QUACKENBUSH Lucent Technologies USDavid COLLIER Macrovision Corp. USJong Jin CHAE MarkAny Inc. USWou FENG Microsoft Corp. USGary SULLIVAN Microsoft Corp. USSimon WINDER Microsoft Corp. USYoungmoo KIM MIT USTihao CHIANG Mitsubishi USMichael CASEY Mitsubishi Electronics America USHuifang SUN Mitsubishi Electronics America USAnthony VETRO Mitsubishi Electronics America USAjay LUTHRA Motorola USSam NARASIMHAN Motorola USGuy CHERRY Ncube Inc. USFathy YASSA NeoMagic USWo CHANG NIST USMike RUBINFELD NIST USMichael SEVERA PacketVideo USChun-Jen TSAI PacketVideo USWei WU PacketVideo. USSylvie JEANNIN Philips Electronics USBrigitte SCHUSTER Philips Electronics North America USJim FLEMING Recording Industry Association of

AmericaUS

Michael McGINTY Red Dot Net USBruce BLOCK RIAA USHoward EDINGER Sarnoff Corp. USDean MESSING SHARP USIbrahim SEZAN Sharp Labs of Amercia US

13

1st Name Last Name Affiliation CountryPeter Van BEEK Sharp Labs of America USEric REHM Singingfish.com USHawley RISING Sony Corp of America USAli TABATABAI Sony Corporation of America USKris HUBER Sorenson Laboratories USV. SWAMINATHAN Sun Microsystems Inc. USJiuhuai LU Tektronix Inc. USIzzat IZZAT THOMSON Consumer Electronics Inc. USB. MANJUNATH University of California USWeiping LI Webcast Technologies Inc. USMathieu GoldMan WoeldWide Packets Inc. USBrad GANDEE Xerox Corp. USRobert Turney Xilinx Inc. USM. BOURGES-SEVENIER Web3D Consortium Web3D

14

Annex 2Agenda

1. Opening2. Roll call of participants 3. Approval of agenda4. Allocation of contributions 5. Communications from Convenor 6. Report of previous meeting 7. Processing of NB Position Papers 8. MPEG Phase 28.1 Standard8.2 Amendments8.2.1 Systems8.2.2 Video 8.3 Corrigenda8.3.1 Video8.4 Workplan 9. MPEG Phase 49.1 Version 19.1.1 Standard9.1.1.1 Systems9.1.2 Corrigenda9.2 Version 29.2.1 Systems9.2.2 Audio9.2.3 Reference software9.2.4 DMIF9.2.5 Conformance Testing9.2.6 Corrigenda9.3 Version 39.3.1 Requirements9.3.2 Tools9.3.2.1 Systems9.3.2.2 Video9.3.2.4 SNHC9.3.3 Verification Models9.3.4 Patent statements9.3.5 Amendments

15

9.3.5.1 Systems Video9.4 Version 49.4.1 Requirements9.4.2 Tools9.4.2.1 Systems9.4.2.2 Video9.4.3 Verification Model9.4.4 Patent statements9.4.5 Amendments9.5 Version 59.5.1 Requirements9.5.2 Tools9.5.2.1 Systems9.5.2.2 SNHC9.5.3 Verification Model9.6 Workplan10. MPEG Phase 710.1 Requirements10.2 Tools10.2.1 Systems10.2.2 Description Definition Language10.2.3 Video10.2.4 Audio10.2.5 Description Schemes10.2.6. Reference software10.3 Patent statements10.4 Committee Drafts10.4 Workplan 11. MPEG phase 2111.1 Requirements11.2 Technical Report11.3 Workplan 12. Overall WG11 workplan 13. Explorations 14. Liaison matters 15. Administrative matters 15.1 Schedule of future MPEG meetings

16

15.2 Promotional activities 16. Organisation of this meeting 16.1 Tasks for subgroups16.2 Joint meetings 17. Planning of future activities 18. Resolutions of this meeting 19. A.O.B 20. Closing

17

Annex 3Document list

No. Source Title6376 Pete Schirling Document Register for 54th meeting in La Baule, FR6377 SC 29 Secretariat Late Vote on ISO/IEC 14496-2/PDAM 4 (SC 29 N 3737)6378 SC 29 Secretariat Late Vote on ISO/IEC 14496-2/PDAM 3 (SC 29 N 3736)6379 Olivier Avaro et al. Systems Meeting Report6380 Zvi Lifshitz Rationales for children° field in TemporalTransform6381 SC 29 Secretariat Summary of Voting on Request for Revision of ISO/IEC 14496-1

(SC 29 N 3779)6382 SC 29 Secretariat Summary of Voting on Request for Endorsement of CISAC as JTC

1 Registration Authority (RA) of ISO/IEC 14496-1 (SC 29 N 3780)

6383 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5/FPDAM 1 (SC 29 N 3798)

6384 Jean-Claude Dufourd Update of m6129 (on mux hint format) after the Beijing meeting6385 SC 29 Secretariat Late Vote on ISO/IEC 14496-5/FPDAM 1 (SC 29 N 3803)6386 SC 29 Secretariat Resolutions, ITU-R Assembly, 2000-05-01/05, Istanbul, Turkey

(SC 29 N 3811)6387 ITU-R Invitation from ITU-R to the Meetings of WP 6D, 6E, 6M, 6P, 6Q,

6R, 6S and SG 6, 2000-09-13/26, Geneva, Switzerland (SC 29 N 3812)

6388 Guido FRschini Improvement to the SL for the carriage of TSs6389 Guido FRschini Improvement to the SL for packet framing6390 Guido FRschini Modification to the 'simple' mapping6391 SC 29 Secretariat Table of Replies on ISO/IEC 13818-6/FDAM 1.2 (SC 29 N 3821)6392 Viswanathan Swaminathan Input for Security Considerations Section in RTP Framework for

MPEG-46393 Koenen, Bormans/Hill, Kim, Ohm,

SalembierPresentations of MPEG tutorial at IBC 2000

6394 DVD Forum Liaison statement from DVD Forum on MPEG-2 amendment for video supplemental information

6395 David Singer Proposed extension of the MP4 file format6396 U.S. National Body Proposed revisions to requirements for carriage of metadata in

MPEG-2 Systems streams6397 Euee S. Jang Overview of responses to the generic animation framework CFP

(N1714)6398 Niels Rump for the AHG MPEG-7 IPMP AHG6399 Joco Valentim, Paulo Nunes, Luis

Ducla-Soares, Fernando PereiraIST MPEG-4 Video Compliant Framework

6400 US National Body Proposed Requirements for a Content Identification System6401 A. G. Tescher for USNB MPEG-21 Recommendations6402 A. G. Tescher for USNB Digital Media Standards Workshop6403 Fernando Pereira Reviewing Sections 11 and 12 of the MPEG-7 MDS Working

Draft6404 Fernando Pereira Reviewing Sections 11 and 12 of the MPEG-7 MDS XM6405 James A. Wheaton, Erling H. Wold Statistical Measurements of Audio for Improved Content

Description6406 A. G. Tescher for USNB Effect of errors in ISO/IEC 13818-2:2000 on AMD1 to ISO/IEC

13818-2:20006407 A. G. Tescher for USNB ISO/IEC 13818-1:2000 AMD1 (carriage of metadata and

descriptions over MPEG-2 systems)6408 A. G. Tescher for USNB USNB Contribution: DVD forum issues6409 A. G. Tescher for USNB USNB Contribution: Suggested liaison with ITU-T SG166410 A. G. Tescher for USNB USNB Contribution: MPEG-4 over IP issues6411 A. G. Tescher for USNB USNB Contribution: Advanced Simple Profile Issues6412 A. G. Tescher for USNB USNB Contribution: Watermarking6413 A. G. Tescher for USNB USNB Contribution: Test procedures for Digital Cinema

18

No. Source Title6414 A. G. Tescher for USNB USNB Contribution: Test procedures for MPEG-4 subjective tests6415 A. G. Tescher for USNB USNB Contribution: MPEG-7 technical issues6416 A. G. Tescher for USNB MPEG-7 CD recommendation6417 Whoi-yul Kim, Jae-ho Lee The result of Cross-check for Face Description(VCE-4)6418 Whoi-Yul Kim, Sun-Kyoo Hwang Cross-verification Results for Core Experiment VCE-16419 Whoi-Yul Kim, Jae-Ho Kwak Cross-verification Results for Core Experiment VCE-76420 Keith Hill Report from the AHG on MPEG-21 Multimedia Framework6421 Yuval Fisher MediaControl Specification6422 LeFeuvre, Jean, Rambhia, Avni IPMP Interfaces for the MPEG-4 Terminal6423 Ajay Luthra Report of the AHG for the Call for Proposal for new tools to

further improve video coding efficiency6424 Audrey Tam, Gulisong Nasierding,

Clement Leung,Report of CE on Structured Index DS

6425 Gyu-Tae Baek, Sang-Youn Lee, Young-Sik Choi and Sang-Hong Lee, Hae-Kwang Kim, Seoung-Jun, Oh

Shape-Sequence Descriptors for a spatio-temporal regi

6426 Lei Wang*, Mark Pickering** Experimental Results of FaceRecognition Descriptor (VCE4)6427 Jose M. Martinez MPEG-7 Dictionary: MedMet sections (version 0.1)6428 Guido FRschini Proposed text for rebuffering6429 Guido FRschini Preroll and rebuffering6430 Y. Shibata, P. Garner, L. Cieplinski

and C. SaracenoReport of AHG on Audio, Video and MDS Harmonization

6431 Y. Shibata Additional DDL Representation Guidelines regarding Global Element Declaration

6432 Y. Shibata Study of MPEG-7 Root Elements6433 Y. Shibata and T.Walker Guidelines for DDL representation of MPEG-7 DSs and Ds ver.1.16434 P N Garner, J P A Charlesworth SpokenContent Developments6435 P N Garner, A de Cheveigne', Y

ShibataA Base Class Hierarchy for MPEG-7

6436 P Garner Systems issues for Spoken Content6437 S. R. Quackenbush Report of the AHG on Audio Call for Evidence6438 ITU-R WP 6P Liaison Statement from ITU-R WP 6P on MPEG Studies of

Digital Cinema (SC 29 N 3845)6439 3GPP TSG-SA WG4 Liaison Statement from 3GPP TSG-SA WG4 on MPEG-4

Conformance Points (SC 29 N 3846)6440 Mikio Sasaki, Hideaki Nanba, Kazuoki

MatsugataniAdaptive Communication using Metadata

6441 Mikio Sasaki, Fumihiko Murase A Proposal for Retrieval Experiments using Dependency Information

6442 Mikio Sasaki, Shun-ichi Sekiguchi, Koichi Emura, Charis Christopoulos

Report of the MPEG-7 Mobile Applications AHG

6443 Douglas Armati, Jack Lacy, Niels Rump, Talal Shamoon

Flexible and Robust IPMP Solutions Using the MPEG-4 IPMP Hooks

6444 Akio Yamada Results of core experiment VCE-16445 Akio Yamada Results of core experiment VCE-26446 Akio Yamada A Proposal of Extended Color Dataset, Queries and Ground Truths

for Corel Photos6447 Jan van der Meer Carriage of SL headers within RTP6448 Jan van der Meer Mime types for carriage of MPEG-4 streams over RTP6449 Jan van der Meer Proposed draft for Carriage of MPEG-4 streams over RTP6450 Jan van der Meer Proposed draft for Carriage of Metadata over MPEG-26451 Jens-Rainer Ohm Report of AHG on Fine Granularity Scalability in MPEG-4 Video6452 Kudumakis P., Balestri M., Guimaraes

J., Lenoir P., Voukelatos S., Dal Lago S., on behalf of the OCCAMM Project

OPIMA: A response to Call for Proposals for IPMP Solutions

6453 Zvi Lifshitz Comments on ISO/IEC 14496-1/FDAM26453 Zvi Lifshitz Comments on ISO/IEC 14496-1/FDAM26454 The National Body of JP (JNB) JNB comments on ISO/IEC 14496-2 FPDAM3 Studio Profile

19

No. Source Title6455 Neil Day Presentation Programme for First MPEG-7 Awareness Event6456 Neil Day, Witold Reichhart, Caterina

Saraceno, [email protected] of MPEG-7 Applications and Promotions to Industry Adhoc

6457 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-2:2000/DCOR 1: Information technology -- Generic coding of moving pictures and associated audio information: Video, TECHNICAL CORRIGENDUM 1 (SC 29 N 3829)

6458 SC 29 Secretariat Summary of Voting on 13818-2:2000/FPDAM 1: Information technology -- Generic coding of moving pictures and associated audio information: Video, AMENDMENT 1: Video elementary stream (SC 29 N 3854)

6459 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-1/FPDAM 2 (SC 29 N 3855)

6460 IEC TC 100 IEC CD 61883-6: Consumer audio/video equipment - Digital interface - Part 6: Audio and music data transmission protocol (SC 29 N 3856)

6461 Yoshiaki Shishikui, Shinichi Sakaida, Osamu Mizuno

Hierarchical Huffman Coding for Binary shape in MPEG-4 Studio Profile

6462 Rosa Ruiloba, Michel Rynderman, Philippe Joly, Yousri Abdeljaoued

Report of CE on Video Editing DS

6463 Takehiro Moriya, Bernhard Grill Report of AHG on MPEG-4 Audio second edition6464 Jean Stride for UK National

CommitteeUK National Body position on Watermarking

6465 Heiko Purnhagen, Bodo Teichmann Report of AHG on MPEG-4 Audio Reference Software6466 Takanori Senoh, Takuyo Kogure,

Hisataka TakiProposal on the Renewability of IPMP System

6467 The National Body of JP JNB Comment on ISO/IEC 14496-2/FPDAM 46470 ITU-R WP 6M Liaison Statement from ITU-R WP 6M to SC 29/WG 11 on

Collaboration with WG 11 (SC 29 N 3857)6471 Takayuki Kunieda, Kiyoshi Suzuki,

Yuki WakitaA Study of the inter-operability issues in standardization process

6472 Frank Klefenz, Juergen Herre, Andras Katai

Continuation of Check Site Test Report on MPEG-7 Core Experiment on Melody Similarity

6473 Takanori Senoh, Takuyo Kogure, Hisataka Taki

Proposal on the Renewability of IPMP System

6474 Jean H.A. Gelissen Request to adapt a new technology to improve the FGS efficiency.6475 Mihaela van der Schaar, Hayder Radha Motion-Compensation based Fine-Granular Scalability6476 P. van Beek, A.B. Benitez, J. Heuer, J.

Martinez, P. Salembier, J. Smith, T. Walker

MPEG-7 Multimedia Description Schemes XM (Version 4.1)

6477 P. van Beek, A.B. Benitez, J. Heuer, J. Martinez, P. Salembier, J. Smith, T. Walker

MPEG-7 Multimedia Description Schemes WD (Version 4.1)

6478 P. van Beek, A.B. Benitez, J. Heuer, J. Martinez, P. Salembier, J. Smith, T. Walker

Ad Hoc Group Report on Editing the MDS XM and WD

6479 E. Oltmans, J.P. Evain, J.M. Martinez, P. Mulder

Metadata Integration: Dictionary, current status, and open issues

6482 E. Oltmans, J.P. Evain, J.M. Martinez, P. Mulder

AHG report on Metadata Integration

6483 Rene van der Vleuten, Mihaela van der Schaar

Quality Field for MPEG-4 Fine Granularity Scalability

6484 Carsten HERPEL, Paul KERBIRIOU, David SAHUC

Some corrigenda items for ISO/IEC 14496-1:2000

6485 I. Sezan, J. P. Evain (Chairmen) Report of The AhG on the TV-Anytime Application6486 Kumar Swaminathan, Ashish Banerji Evaluation of Lossless Data Compression Techniques for Digital

Cinema Archival and Distribution6487 Ralph Sperschneider, for the AHG Study on MPEG-4 Version 2 Audio Conformance FPDAM6488 Ralph Sperschneider, for the AHG Status and Workplan for V1 and V2 Audio Conformance

20

No. Source Title6489 Ralph Sperschneider, for the AHG Report of the Ad-hoc Group on the Audio part of MPEG-4

Conformance6490 Mihaela van der Schaar All FGS temporal-SNR-spatial scalability6491 Eric Rehm Internet Streaming Media Metadata Interchange with MPEG-7

MDS6492 Eric Rehm Proposal for Additional MDS Media Format and Coding Elements

for Internet Streaming Media6493 Z. Shae, J. Subrahmonia, J. Pitrelli, L.

Schomaker, E. Petajan, A. Divakaran, A. Vetro, T. Chen, S. Sethuraman, B. Tseng, X. Wang, F. Hendriks

Proposal for electronic ink document information description scheme

6494 A. Mufit Ferman (on behalf of CE participants)

Report on the Core Experiment on USge History DS

6495 Ana B. Benitez, Alejandro Jaimes, Corinne Jvrgensen, Shih-Fu Chang

Report of CE on Multilevel Indexing Pyramid

6496 Ana B. Benitez, Toby Walker, Peter Mulder

Report of AHG on MPEG-7 DS Core Experiments

6497 Ana B. Benitez, Shih-Fu Chang Segment Relations for MPEG-76498 Ana Benitez, Hawley Rising,

Alessandro Bugatti, Corinne Joergensen, Riccardo Leonardi, Koiti Hasida

Report of CE on Semantic DS

6499 Jane Hunter MPEG-7 DDL Working Draft 4.16500 Jane Hunter Proposal for the Integration of Dublin Core and MPEG-76501 Jane Hunter Report of Liaison between MPEG-7 and XML Schema6502 Jane Hunter Report of Liaison between MPEG and Dublin Core6503 Yo-Sung Ho, Dae-Hee Kim, Jeong-

Woo Lee, Jun-Geun JeonMPEG-4 Studio Profile: Suggestion on compression of the uncompressed mode - Higher Order DPCM

6504 Yo-Sung Ho, Dae-Hee Kim, Jeong-Woo Lee, Jun-Geun Jeon

MPEG-4 Studio Profile: Suggestion on compression of the uncompressed mode - Scanning Order


MPEG-4 Studio Profile: Suggestion on compression of the uncompressed mode - ADPCM


MPEG-4 Studio Profile: Suggestion on compression of the uncompressed mode - ADPCM

6507 Sanghoon Sull, Hyeokman Kim Naming Convention for MDS6508 Sanghoon Sull, Hyeokman Kim Identifying HighlightLevel in Summary DS6509 Eric Petajan, Tolga Capin FBA conformance adhoc report6510 Eric apetajan, Mahnjin Han Inclusion of 3DMC and FBA compression tools in Graphics

Profiles6511 Eric Petajan, Zon-Yin Shae, Ajay

Divakaran, Tsuhan ChenMPEG-7 Issues Regarding MPEG-4 Synthetic Objects

6512 Zvi Lifshitz Comments on ISO/IEC 14496-1:2000/COR1 WD1.06513 Yuval Fisher Little Technical Fixes Here and There6514 Peter van Beek (on behalf of CE

participants)Report of CE on EPG DS

6515 Jim Errico, Peter van Beek, Ibrahim Sezan

Update of MPEG-7 XM Software for User Preference DS: A Content Filtering Agent

6516 Yuval Fisher Overlap of MatteTexture Functionality in the Visual Spec6517 Takuyo Kogure Extended IPMP system with ID registration procedure6518 Terumasa Aoki A New IPMP System combined with Digital Watermarking6519 Itaru Kaneko/ASCII Open B to B architecture of MPEG-4/IPMP(Response to CfP

N3543)6520 Olivier Avaro, Rob Koenen, Mike

McGintyReport of AHG on Evaluation of responses to the Call for Proposals for IPMP Solutions

6521 Jean-Claude Dufourd, Francoise Preteux

New proposal for "gesture" sensors

6522 Jean-Claude Moissinac, Jean-Claude Dufourd

Results of experiments with cartoons in MPEG-4

6523 Kilho Shin, Masaki Kyojima Rights authentication for MPEG-4 content, Ticket Authenctication

21

No. Source TitleProtocols

6524 Kilho Shin, Masaki Kyojima Rights authentication for MPEG-4 content6525 Masatsugu Kitamura Response to CfP(N3543)6526 Mark Pickering, Michael Frater, John

ArnoldResults of Core Experiment VCE-5: Face Detection

6527 Renato Iannella Rights Language for IPMP using ODRL6528 Y.Yagasaki, W.Li Report on the Ad Hoc group on Software Integration and

Verification in MPEG-4 Video6529 Yoichi Yagasaki Ad hoc Group Report on the Studio Profile in MPEG-4 Video6530 Corinne Joergensen, Deborah Karpuk,

Toby WalkerProposed Modifications for the Description of People and Places

6531 Toby Walker Proposed Revisions to the Graph DS6532 Toby Walker Proposal for a MetaMeta DS6533 Toby Walker Proposed Improvements for Controlled Terms and Classification

Schemes6534 Takehiro Fujita, Yoshiaki Shibata Results of Core Experiment VCE-16535 Lifang Wu, Lansun Shen, Kebin Jia,

Xin Xing, Kongqiao Wang, Jun RenImprovement of Automatic Human Face Detection

6536 Lifang Wu, Lansun Shen, Kebin Jia, Xin Xing, Kongqiao Wang, Jun REn

Results of Core Experiments on Face Detection

6537 Ernest Wan, Joerg Heuer, Ulrich Niedermeier, Andreas Hutter

A Context-free Method for Generating Bitstreams for MPEG-7 Descriptions

6538 ITTF Table of Replies on ISO/IEC 14496-1/FDAM 1 (SC 29 N 3858)6539 ITTF Table of Replies on ISO/IEC FDIS 14496-4 (SC 29 N 3859)6540 Dulce Ponceleon, Jan Pieper, Gilad

CohenGuidelines/Documentation for Fast Audio Moving Storyboard XM software(SequentialSummaryDS)

6541 Dulce Ponceleon, Jan Pieper, Savitha Srinivasan

Guidelines for Textual Summaries (Sequential Summary XM software)

6542 Yasuo FUKUDA Results of Core Experiment VCE-2.6543 Dulce Ponceleon, Osamu Hori, Masaru

Sugano, Tom McGee, Nevenka Dimitrova, Eric Rehm

Proposal: MPEG-7 SequentialSummaryDS meets TVAnytime

6544 Osamu Sunohara, Yoichi Yagasaki Proposal to extend the bit precision of the IDCT output for the Studio Profile

6545 Osamu Sunohara, Yoichi Yagasaki Proposal to support coding of the RGB components for the Studio Profile

6546 Osamu Sunohara, Yoichi Yagasaki Proposal to support an extended precision of 12bits per sample for the Studio Profile

6547 Stephan Herrmann Report of AHG on XM Development6548 Yuwen He, Wei Qi, Shiqiang Yang,

Yuzhuo ZhongExperiment Results for Feature-based Fast and Robust Global Motion Estimation Technique for Sprite Coding

6549 Yuwen He, Wei Qi, Shiqiang Yang, Yuzhuo Zhong

Experiment Results for Feature-based Fast and Robust Global Motion Estimation Technique for Sprite Coding

6550 Yuwen He, Wei Qi, Shiqiang Yang, Yuzhuo Zhong

Experiment Results for Feature-based Fast and Robust Global Motion Estimation Technique for Sprite Coding

6551 Bernhard Feiten, Silvia Pfeiffer Status of the CE Silence6552 Alexis Michael Tourapis, Oscar C. Au Verification Results of the Feature-based Fast and Robust Global

Motion Estimation Technique (FFRGMET) for Sprite Coding6553 Feng Wu Cross-verification Results of Feature-based Fast and Robust

Global Motion Estimation Technique (FFRGMET) for Sprite Coding

6554 Claude Seyrat, Cedric Thienot, Gregoire Pau

X-Bin a generic and extensible binary encoding format for MPEG7 Descriptions

6555 Philippe Gentric Audio frames concatenation6556 Philippe Gentric Short hinted files6557 Philippe Gentric Video mapping to system clarification6558 Sung-Hee Park, Sang-Wook Kim ER_BSAC related modifications in MPEG-4 conformance

FPDAM16559 Jose M. Martinez, Ibrahim Sezan, Thesauri for MPEG-7: Media, Creation and USge Information.

22

No. Source TitleMasahiro Shibata

6560 Jens-Rainer Ohm, Aljoscha Smolic, Bela Makai

Results of VCE-3 on Scalable Color Optimization

6561 Philippe Salembier Proposal of Template for NB comment on MPEG-7 MDS CD6562 SangWoo Ahn, Munchurl Kim,

Yongsuk Kim, JinSoo Choi, Jae-Gon Kim, Kyeong-Ok Kang and, Jinwoong Kim

Delivery of MPEG-7 description data over MPEG-2 Transport Stream

6563 Mahnjin Han, Sungjin Kim, Do Kyoon Kim, Sang O. Woo, Euee S. Jang

Proposal for addition of 3DMC related issues in ISO/IEC 14496-1:2000/COR1

6564 Mahnjin Han, Sungjin Kim, Do Kyoon Kim, Euee S. Jang

Addition of 3DMC to Version 3 Complete Graphics Profile

6565 Yongsuk Kim, Munchurl Kim, SangWoo Ahn, Jin Soo Choi, Jae-Gon Kim, Kyeong-Ok Kang and, Jinwoong Kim

Delivery of MPEG-7 description data in MPEG-4 Systems over MPEG-2 Transport Stream

6566 Mahnjin Han, Jean-Claude Dufourd Report of the AHG on 3DMC Conformance6567 Frank Bossen Studio Profile: compressing the uncompressed mode6568 Frank Bossen, Don Mead Report of AHG on Digital Cinema6569 Frank Bossen, Don Mead Digital Cinema Requirements6570 Frank Bossen, Don Mead Digital Cinema Evaluation Procedures6571 Frank Bossen, Don Mead Digital Cinema Draft Call for Proposals6572 Tsutomu Ando DMIF secure channel support request for IPMP solution6573 Tsutomu Ando, Hiroshi Inoue,

Masashiko Takaku, Satoshi WakaoAdvanced IPMP descriptor for IPMP solution

6574 Michael Wollborn, Sven Bauer, Andreas Engelsberg, Jens Rainer Ohm

BiM - A binary format for MPEG-7 data

6575 Tsutomu Ando, Hiroshi Inoue, Masashiko Takaku, Satoshi Wakao

New descriptors for back channel communication for IPMP solution

6576 Heon Jun Kim, Jungmin Song VCE-7 result: Spatial Coherency Bit Optimization6577 AHG on binary and dynamic MPEG-7

data representationReport of AHG on binary and dynamic MPEG-7 data representation

6578 Heon Jun Kim, Jungmin Song, Jin-Soo Lee

Cross Verification of Improvement of Color Structure Descriptor

6579 Kyoungro Yoon Review of the Semantic DS CE6580 Kyoungro Yoon Review of the Structured Index CE6581 Cedric Thienot, Claude Seyrat,

Gregoire Pau.a DDL-based HTML Documentation generator for DSs and Ds

6582 Tomohiro Azami, Ichiro Ando, Masahito Tsutsumi

Re-definition and study of Connection DS

6583 Young-Kwon LIM Report of AHG on MPEG-4 content on IP network6584 Young-Kwon LIM (AHG on MPEG-4

content on IP network)Requirements for carriage of MPEG-4 content on IP networks

6585 Benoit Mory, Nicolas Santini, Franck Laffargue

Binary format for MPEG-7 descriptions (BiM) : a new approach

6586 Claude Seyrat, Jane Hunter Report of the MPEG-7 DDL Ad Hoc Group6587 M. Mattavelli Report of the AHG on identifying key applications of MPEG-7

normative Ds and DSs to be included in the XM as non normative examples.

6588 Riccardo Leonardi, Alessandro Bugatti, Yoshiaki Shibata

Report on Ordering Key DS CE

6589 Oscar Fernandez, Clara Garcia, Jose M. Martinez

Informative Report about the current status of the GTI MedMet Cataloguing Tool

6590 Sylvie Jeannin, Miroslaw Bober Report of the AHG on MPEG-7 Visual Core Experiments6591 Anthony Vetro Additional Attributes to Support Transcoding and Comments6592 Sylvie Jeannin, Leszek Cieplinski, Jens

Rainer Ohm, Munchurl KimReport of the AHG on Editing the MPEG-7 Visual XM and WD Documents

6593 Sylvie Jeannin, Leszek Cieplinski, Jens Rainer Ohm, Munchurl Kim

MPEG-7 Visual Part of Exprimentation Model, Version 7.1

23

No. Source Title6594 Sylvie Jeannin, Leszek Cieplinski, Jens

Rainer Ohm, Munchurl KimMPEG-7 Visual Part of Working Draft, Version 4.1

6595 Itaru Kaneko Regarding interoperability, security and standardization of IPMP.6596 Sylvie Jeannin, Charilaos

Chistopoulos, Joerg Heuer, Aljoscha Smolic

Results of VCE-6 on Spatial 2D Coordinate System

6597 Sylvie Jeannin Motion Trajectory: Information on XM Software Modules and Content Set

6598 Frederic BOUILHAGUET, Jean-Claude DUFOURD

Analysis of the integration of MP4 I/O in IM1

6599 Zvi Lifshitz IM1 software platform AHG report6600 Zvi Lifshitz IM1 Core code + authoring tools version 5.16601 Zvi Lifshitz Comments on M6447, M6448, M6449 (MPEG-4 over IP)6602 Jose M. Martinez Introduction to MPEG-7: Content, Objectives and Technical

Roadmap (mix)6603 Laurent Herrmann), Alex MacAuley,

Renaud CazoulatProposal for new 2D Profiles in MPEG-4 Systems

6604 Jyri Huopaniemi, Riitta Vaananen Comment on Advanced AudioBIFS conformance6605 French National Body French NB comment on Advanced Simple video profile6606 Koiti Hasida, Masahiro Shibata CE on Linguistic DS (Language DS)6607 French National Body French NB comment on GOV display order6608 Jeff McVeigh, Mark Buxton Report of AHG on Video Elementary Stream Supplemental

Information6609 Weiping Li, Fan Ling, Shipeng Li,

Feng Wu, Mihaela van der Schaar, Hong Jiang, and Sherman Chen

Comments on ISO/IEC 14496-2 FPDAM4

6610 D.Curet FNB comment for the La Baule meeting6611 M.Veillard, E.Le Gall, C.Roux,

D.CuretFlexMux signaling

6613 J. Heuer, A. Hutter, U. Niedermeier, E. Wan

Results of CE on BiM: A generic context sensitive encoding scheme (CSE) for MPEG-7 descriptions and MPEG-7 description schemes

6612 E.Le Gall, C.Roux, D.Curet, M.veillard A FlexMux tool with lower overhead6614 C.Roux, D.Curet, M.veillard, E.Le Gall FlexMux streams: an RTP payload6616 Leszek Cieplinski Cross-verification results for VCE-76617 Leszek Cieplinski Cross-verification results for VCE-46615 J. Heuer, A. Kaup Bitplane Coding of the ScalableColor Descriptor6618 D.Curet, J.C.Chevet, C.Wendt Update to the graphical representation of Object descriptor & SL

syntaxes6619 John R. Smith, Uma Srinivasan Report of the AHG on Conceptual Modeling6620 Gerard Mozelle, Andre Ducrot Liaison from ISO/IEC JTC1/SC24 to MPEG6621 Adam Lindsay (on behalf of the AhG) Report of the Ad-hoc Group on MPEG-7 Audio Core Experiments6622 Steve Wood, Peter Westerink MPEG-4 Systems Issues6623 Steve Wood ISO/IEC 14496-1:2000/COR1 WD2.06624 Michelle Kim, Mikael Bourges-

Sevenier, Rich Rafey, Steve WoodWorking Draft 4.0 of ISO/IEC 14496-1 / AMD3

6625 Koiti Hasida Revision of Segments and Links to Fit Language6626 Adam Lindsay Comments on the Melody CE6627 Michelle Kim, Jeff Boston, William

Luken, Etienne Roy, Steve WoodXMT Authoring and Playback Demo

6628 James H. Errico, Dean S. Messing, Peter van Beek, M. Ibrahim Sezan

Validation of Colour Structure Descriptor plus Two Performance Enhancements

6629 Michael Casey Sound Effects Core Experiment Results6630 A. Kris Huber, Gary Sullivan Motion vector decoding DCOR items6631 A. Kris Huber Loco-I lossless coding results on some MPEG sequences6632 Cedric Thienot, Claude Seyrat,

Gregoire PauA first analysis of an MPEG-7 decoder architecture and APIs

6633 O Morgan Incoming Liaison from SMPTE

24

No. Source Title6635 O Morgan SMPTE Metadata Dictionary RP210.1 RP210.2 RP210.36634 O Morgan SMPTE Carriage of KLV Metadata over MPEG-2 Systems V66636 O Morgan SMPTE 335M Metadata Dictionary Structure6637 O Morgan SMPTE 336M Data Encoding Using KLV6638 O Morgan AHG on MPEG7 Systems6639 Françoise Duclos, Laurent Fournier,

Françoise Preteux, Titus ZahariaMPEG-7 Mobile Applications: New Scenarios

6640 O Morgan MPEG7 Systems WD 1.1 Input to LaBaule6642 O Morgan KLV for Binary Encoding of MPEG76641 O Morgan MPEG7 Systems AHG: Carriage of Metadata over MPEG26643 O Morgan KLV for Binary Coding of Dictionary6644 Boris Felts, Julien Signes Evolution proposal for the conformance of BIFS6645 Hawley K. Rising III, Ali Tabatabai,

Dave SingerA Generic Framework for the Design of Textual and Binary MPEG-7 System.

6646 Hawley K. Rising III Graph Rewriting Rules and their Application to Restrictions of Relations and Semantic DS

6647 Hawley K. Rising III, Ali Tabatabai, Mohammed Zubair Visharam

Report on Experiment on Application Specific Description Languages

6648 Hawley K. Rising III, Ali Tabatabai, Mohammed Zubair Visharam

An Efficient Binary Coding Scheme for DDL Instance Documents

6649 Viswanathan Swaminathan Input Text for Corrigenda and Reference Software status for MPEG-J

6650 Gary Sullivan Liaison Statement from ITU-T Advanced Video Coding Experts Group

6651 Osama Alshaykh, Mark Banham, Iraj Sodagar, Chun-Jen Tsai

Request for a New Level of Simple Scalable for Wireless Devices

6652 Euee S. Jang, Michael Bourges-Sevenier

AHG report of the generic animation framework

6653 Yuval Fisher Report of the AHG on Bitstream Exchange6654 Youngmoo Kim Status of Melody CE6655 Youngmoo Kim Validation of Independent Components Analysis DS6656 Web3D Consortium Liaison Statement from Web3D Consortium to WG 11 on Proposal

for Core Scene Graph Profile (SC 29 N 3879)

25

Annex 4Requirements report

Source: Rob Koenen, Keith Hill (MPEG-21)

MPEG-2 (Metadata over MPEG-2)m6400 US National Body - Proposed Requirements for a Content Identification

Systemm6396 U.S. National Body - draft for Carriage of Metadata over MPEG-2m6634 O Morgan, members of Proposed revisions to requirements for carriage of

metadata in MPEG-2 Systems streamsm6407 A. G. Tescher for USNB - ISO/IEC 13818-1:2000 AMD1 m6633 O Morgan, members of SMPTE ST13.14/MPEG liaison - Incoming liaison

from SMPTEm6641 O Morgan - MPEG7 Systems AHG: Carriage of Metadata over MPEG2

The Group integrated the requirements from SMPTE and ATSC into the document ‘Requirements for the carriage of metadata and descriptions over MPEG-2 Systems’ (N3745). Adequate wording was found for all the requirements from SMPTE and ATSC. Due to lack of time the work was not yet started.

MPEG-4

MPEG-4 ProfilesVisual

m6399 Valentim, Nunes, Ducla-Soares, Pereira - IST MPEG-4 Video Compliant Framework

This contribution showed that MPEG-4 Conformance is not enough to test the Profile/Level combinations to their full complexity. This was found undesirable, but also hard to change at this point in time. The Requirements group adopted 3.1.6, expressing its concern.

m6439 3GPP TSG-SA WG4 - liaison on MPEG-4 Conformance Points (SC 29 N 3846)

After discussions, the following answer to 3GPP was written:MPEG is sympathetic towards 3GPP’s requests, and shares the desire to create an interoperability point that can be used across content for mobile devices and other content types.

MPEG is willing to define such a conformance point, and in doing so to accommodate all the restrictions suggested by 3GPP, including the QCIF form factor, even though this is somewhat in conflict with the MPEG-4 design philosophy. MPEG does, however, greatly value the hierarchy between Simple and Advanced Simple, and therefore wants to impose an additional restriction. This restriction does not impact the decoder at all, and in fact decoders will become simpler and cheaper to implement. It implies a modified decision criterion in the encoder, however. MPEG is willing to work with you on understanding the implications of this extra restriction.

m6651 Alshaykh, et. al.- Request for a New Level of Simple Scalable for Wireless Devices

26

The description of the market for Simple Scalable Market is understood, and the requirements for this market as well.The Requirements group does, however, not want to break hierarchy, as would happen when two types of scalability would be allowed in L0. Level 1 only allows one type at the time.About the request to remove BVOPs in a L0 for Simple Scalable: first investigate whether

1) it really helps and 2) 2) there is no alternative profile that suits the requirements (e.g. FGS). If 1) removing B-

VOP’s helps indeed and 2) there is no alternative solution, then the request will be reconsidered.

Proponents where happy with the outcome and will study further, perhaps bringing new proposals t a next meeting.

m6467 The National Body of JP - JNB Comment on ISO/IEC 14496-2/FPDAM 4The inclusion of ¼ pel and GMC in Advanced Simple was already decided, if the implementation conditions were met. The Requirements Group does indeed want to keep compatibility with Simple @ L0. Also, the group wants to keep B-VOP and MPEG-2 dequant in the lower levels. Will bit streams for Simple @ L1 be decodable by Advanced Simple @ L0? The Requirements group does not feel it is required for lower levels of hierarchically higher Profiles to be able to decode higher levels of lower profiles.Add Simple Object type to Advanced Simple ProfileConcern about AS L1 not being able to decode S L3 we will make level The discussion further highlighted that:

1) In principle, tools stay the same across all levels2) If people don’t want these tools, they should use the Simple Profile.

m6411 A. G. Tescher for USNB - USNB Contribution: Advanced Simple Profile Issues

The Requirements group beliefs that all US concerns have been addressed, some of them during this meeting’s discussions, some of them already in the past.As for ISG perform a complexity study on each one of the two proposed tools relative to the tools in the Advanced Simple Profile: M3576 gives a study for the complexity of GMC. For Quarter pel Motion Compensation, the ISG has made studies and contributions in the Fribourg and Stockholm meetings. As a result of the studies during the Stockholm meeting, a different approach was pursued, which was presented in the Fribourg meeting. The results of this study can be found in M3146.

As for The proposers show the coding efficiency gain of each one of the two proposed tools in the context of the Advanced Simple Profile. Proof of performance of these tools can be found in M3146, m3699, m2625 for Quarter pel, m3576, 4085 for GMC. The subjective tests with the Advanced Coding Efficiency Profile give additional evidence.

As for ¼ pel MC and GMC are considered as two separate tools, not grouped together. the contributions referenced above deal with ¼ pel and GMC separately.

m6605 French National Body - French NB comment on Advanced Simple video profile

The Group thanked the French NB for the support, and requested it to repeat this in the ballot vote. As for the request to change the name to Rectangular Advanced Coding Efficiency, the requirements Group Pro believed that while it may reflect the functionality better, it would be confusing as it woud be the second name change. Also, people are already communicating about the

27

profile using the current name. Lastly, ‘Simple’ means ‘Rectangular’ in an MPEG-4 context. It was decided not to change the name.

m6609 Weiping Li, et.al. - Comments on ISO/IEC 14496-2 FPDAM4New techniques (MC in the enhancement layer) could give better performance in some application spaces. Claims go up to 1.5 db improvement. Including this technology now is impossible, including it later would mean there would be even more profiles, as we do not want to wait with the existing ones. The Requirements Group decided to wait and see what will happen. New Profiles can be proposed using the existing procedures.

Discussions in the Level proposals revealed that the Requirements Group does not want the Level definitions to be too different across the Profiles. To some extent this is already the case, but an extra Level was added to the Advanced Simple to bring more balance. Also, the Levels of the enhancement layers now include a – from the receiving terminal point of view – more realistic maximum bitrate.

Systems Profiles

m6459 SC 29 Secretariat - Summary of Voting on ISO/IEC 14496-1/FPDAM 2

The 3D Audio Graphics Profile was accepted into Systems V.3. Sphere, Cylinder, Box and Cone nodes were deleted from that Profile, as the Profile is Audio-only. The 3D Audio Scene Graph Profile was also accepted into Systems V.3. For both Profiles, it was considered that the requirements had been met, notably that there was enough industrial support and that there were conformance commitments.

m6656 Web3D Consortium via SC 29 Secretariat - liaison Statement from Web3D Consortium to WG 11 on Proposal for Core Scene Graph Profile

The Requirements Group was happy with this submission, which does not just have a well thought-through Profile definition but also Level information, something that is missing from some of the other Systems Profiles.The proposal went to the Profiles Under Consideration document (N3748), the 'official' document in which we collect potential new Profiles. It was split into a Scene Graph and a Graphics Profile, and Level information was separated from the Profile information. Both Profiles are called 'Web3D Core' at the moment.

The procedure is now that support should be gathered from industry, conformance commitments are needed and missing details should be worked out. The exact timing and the appropriate amendment was not yet determined, but it could go in V.4 if the necessary requirements are fulfilled (mature spec, NB support, company support, conformance commitments). There was a discussion on whether or not to exclude MovieTexture. The idea was that the visual capabilities, that need to be supported when this node is present, might be too heavy. The conclusion was that limiting visual complexity should be done through combining the Profile with Visual Profiles, and that thus the node in itself incurs no complexity, so that it could remain.

m6603 L. Herrmann, et.al. - Proposal for new 2D Profiles in MPEG-4 SystemsFirst, the proposal for a Basic AV (Scene Graph and Graphics) Profile – even simpler than simple. In principle, the proposal was considered a good idea, but the Requirements Group thinks that we should not limit visual capabilities in the Scene Graph Profile. This means only one level is needed in the current proposal.

28

The proposal gives a good overview of Core 2D Scene Graph and Core 2D Graphics and their relation to the other profiles.

The contribution was merged into the Profiles under Consideration Document. Other companies should express their support, and give feedback on the exact definitions.

Profiling SNHC tools

m6564 Mahnjin et.al. - Addition of 3DMC to Version 3 Complete Graphics Profilem6510 Petajan, Han - Inclusion of 3DMC and FBA compression tools in Graphics

ProfilesIt looks logical to use Graphics Profiles to Profile AFX tools. It also seems a good idea to then include all these tools in the Systems part of the Standard, both the nodes and their compression tools. W.r.t. the tools for compression of face and body animation parameters, and indexed face set: it should be possible to invoke them without the need to implement a Visual Profile, if the corresponding nodes are in the Graphics Profile.

The philosophy is thus that from now on, the visual SNHC objects should be limited in complexity through Graphics Profiles, and not visual Profiles. There is still an open question if it is useful to use Visual Profiles for ‘stand-alone’ objects, i.e. objects that can be created without use of Systems. Pro: they can be created stand-alone. Con: it means that these objects will reside in two types of Profiles (Graphics and Visual), which is confusing and perhaps detrimental to interoperability.

IPMP Responses to the CfP were received and evaluated in the Systems Group. Three joint meetings took place, in which the Requirements Group was informed about the progress. There was consensus to proceed with an amendment. There is still much discussion on the exact content of this amendment. Concerns with respect to the implications of something being normative were clarified. It is clear that ISO will never enforce its standards. MPEG standards are there to conform to if you choose to do so.

MPEG-4 OverviewThe MPEG-4 Overview was updated with minor changes and some additions.

MPEG-7

Requirements MPEG-7 Promotion to Industry m6455 Neil Day - Presentation Programme for First MPEG-7 Awareness Eventm6456 N. Day, et.al. - Report of MPEG-7 Applications and Promotions to Industry

AHGm6602 J. Martinez - Introduction to MPEG-7: Content, Objectives and Technical

RoadmapThe Awareness Event was briefly discussed in its last details.A new High Level Overview was approved, but needed to be further edited by Jose Martinez & Neil Day.The Detailed Overview lacked Contributions from the groupsIt was considered very helpful to write Application/User oriented documents explaining MPEG-7 from a particular use perspective (for example: TV-Anytime and Mobile applications). To write these, help would be sought from the respective user communities.

29

MPEG-7 Architecture and Profilingm6432 Y. Shibata - Study of MPEG-7 Root Elementsm6471 T. Kunieda, et.al. - A Study of the inter-operability issues in standardization

processThere was again a good discussion on the difficult topic of Profiling in MPEG-7. Much depends on what is normative behavior, and this links to the question of how to do conformance. Conformance is easy to define for DS’s, Schema and Descriptions, but not for decoders. For example, is an extension of an MPEG-7 Schema Conformant/compliant? Or only partly? To find answers to these questions, a new document was created, the MPEG-7 Conformance Definition and Profiles Document, and an AHG was set-up to develop this document.The document should, when it is fully developed, answer questions like: What is normative behavior and conformance for Descriptions What is normative behavior and conformance for Decoders What is normative behavior and conformance for Schema’s (Do we need this?? Or is this part of

Descriptions?) How do we creat subsets if the MPEG standard, and do we use Profiles? Do we use the Level

concept? Do we need / can we have multiple dimensions in Profiling? What if I want to extend the DSs that exist?

The question was raised whether MPEG-7 allows application-specific extensions; this is conceivable, if defined by DDL within complexity bounds, and it is possible to specify such complexity bounds.

Mobile Applications in MPEG-7: specific Requirements

m6442 Mikio Sasaki, et. al. - Report of the MPEG-7 Mobile Applications AHG

It was decided to have a separate document for the mobile applications area, in which MPEG-7 issues are explained and discussed from the mobile application’s point of view. The AHG would continue, with the mandate updated to specifically look at profiling from the point of view of the mobile terminal.

m6440 Mikio Sasaki, H. Nanba, K. Matsugatani - Adaptive Communication using Metadata

m6441 Mikio Sasaki, Fumihiko Murase - A Proposal for Retrieval Experiments using Dependency Information

After discussion, and clarification by proponents, it was decided to investigate the usefulness of standardizing a Dependency DS, and to see is standardization is useful, or if tools already exist that can achieve this functionality. This can be done in a CE.

m6639 F. Duclos, et.al. – MPEG-7 Mobile Applications: New ScenariosThis document proposed to extend the information in Person DS, because Person DS would not be complete enough to describe a user. It was explained that the person DS was not meant for users, and that we have had very specific discussions in the past about describing users, even with a request for NB comments. It was then decided to only standardize user preferences pertaining to AV content, and nothing more, because of privacy reasons. (See resolution 3.1.12 of the Seoul meeting, and the Seoul and Vancouver meeting reports).

30

To the proposal to define an “Organization DS”, the same answer applies as for Peron DS, following the principles of the earlier discussion

Should terminal capabilities be standardized in MPEG-7? The first answer to this is that it should not be a part of MPEG-7, but may be worked on by other bodies, but that we should investigate if our content description matches such externally developed specs. (E.g. in W3C)

MPEG-21SummaryMPEG-21 Multimedia Framework – Considerable progress in the development of MPEG-21 was achieved at this meeting. Specifically the following documents were produced:

A revised and improved version of the Proposed Draft Technical Report (PDTR) called a ‘Study’ (n3755)

A Call for Proposals for Digital Item Declaration (n3756) A Call for Proposals for Digital Item Identification and Description (n3757)

The following new work items related to MPEG-21 were initiated: An ‘ad-hoc’ group to focus attention on MPEG-21 outreach to other multimedia initiatives

and standards bodies (n3765) An ‘ad-hoc’ group to initiate a Digital Media Standards Summit which could be held in New

York in April 2001 (see n3764) An ‘ad-hoc’ group to examine User privacy issues within the context of a multimedia

framework (n3766)

Two further ‘ad-hoc’ groups were established to continue existing streams of work: Evaluation of the responses to the CfP for Digital Item Declaration (n3763) Further development of the PDTR Study (n3767)

MPEG-21 Multimedia FrameworkFollowing the public publication for comment of the Provisional Draft Technical Report (PDTR) on the multimedia framework at the last meeting in Beijing a considerable amount of interest has been developing in this latest MPEG initiative. Many presentations have been given to various industry forums about the multimedia framework since July. National standards bodies have also been issued with the PDTR for ballot in December to approve its status.During the La Baule meeting, work continued to refine the requirements expressed in the PDTR, and to develop various parts of the report which were felt to be weak. This will be formally published as a Study on the PDTR after an editing period of two weeks following the end of the La Baule meeting. It will be released as a public document for comment and continue to be reviewed and developed at subsequent meetings until it reaches the status of an ISO approved Technical Report.It was decided not to create a separate Requirements Document for MPEG-21, as the Technical Report should also cover these requirements. When the TR is final, a Requirements Document may again become necessary. (See resolution 3.1.9)

MPEG-21 Calls for ProposalsMPEG-21 prepared and published two Calls for Proposals during the La Baule meeting, based upon two of the architectural elements which have been defined within the multimedia framework. The first is Digital Item Declaration. This element describes how the digital item (a structured digital object with a standard representation and description within the framework, which is also the fundamental unit of transaction and distribution) can be organised based on a logical structure or ‘package’. Specifically it will specify how many different content types can be assembled into a

31

true multimedia container so that it can be managed in a predictable way by rendering applications, networks, terminals, IPMP systems, etc. The Call is expected to attract different categories of proponents to respond, including those commercial organisations that have developed entirely proprietary solutions to other multimedia initiatives led by standards bodies. A copy of the CfP is available (n3756) giving the full timetable for proponents to submit responses. The deadline for submission is 5th January 2001 and responses will be assessed prior to the next MPEG meeting scheduled for 15th – 19th January 2001.The second Call addresses Digital Item Identification and Description and invites the submission of technology relevant to the multimedia framework. It will specifically invite proponents to submit solutions for enabling the identification of transactions related to digital items including those required for the automated management of rights. The requirements for identification and description associated with the Call have deliberately described in a loose way to encourage a wide range of submissions. However, certain things have been deliberately excluded from the scope of the Call including:

1. Creation identifiers – these are generally well provided for already under the auspices of ISO TC46 SC9 and any overlap with their work should be avoided

2. Watermarking technologies – while the persistent association of an identifier with Digital Items will be a requirement of a multimedia framework this Call does not address the security and protection of identifiers. This will be the subject of a future Call within the context of Intellectual Property Management and Protection.

The Call is expected to attract a range of proponents with a commercial interest in the implementation of identification systems to support the trade of digital items. This is almost certainly going to encompass organisations that are responsible for managing rights transactions and which, for the purpose of automation, they will be required to uniquely identify. A copy of the CfP (n3757) gives the full timetable for proponents to submit responses. The deadline for submission will be set following the January 2001 meeting up until 26th February 2001 and responses will be assessed prior to the subsequent MPEG meeting scheduled for 5th – 9th March 2001 in Singapore.

MPEG-21 Outreach and SummitThe task of defining the multimedia framework within the context of MPEG-21 has always accepted that the contribution of other multimedia initiatives would be required in order to achieve integration and cohesion between the architectural elements that require standardisation. MPEG cannot achieve the task alone and for this reason an ‘ad-hoc’ group activity has been created with the goal of working with other organisations.As a second ‘ad-hoc’ activity, some participants in MPEG-21 believe it would be useful to help coordinate a digital multimedia standards summit. Some organisations who are understood to be interested in participating in such an event include WIPO, ISO, IEC and ITU. A time and location for holding such a summit meeting has provisionally been proposed for April 2001 in New York City.

Studies

Digital Cinema Requirements m6571 Frank Bossen, Don Mead - Digital Cinema Draft Call for Proposalsm6569 Frank Bossen, Don Mead - Digital Cinema RequirementsA new version was of the Digital Cinema Requirements Document was issued. Changes are Adding requirements for still compression Adding a definition of visually lossless Further editorial and relatively minor changes

32

Most of the discussions in the break-out were on testing. The Requirements Group was kept informed on the testing plans.

Watermarkingm6464 Jean Stride for UK National Committee - UK National Body position on

Watermarkingm6412 A. G. Tescher for USNB - USNB Contribution: WatermarkingAn NB comment from the UK asked not to standardize watermarking now, but to develop requirements first. After a lively discussion, it was decided to give the subject one more chance. Some good proposals were made to warrant standardization of generic watermarking technology in MPEG, but the combined case that these proposals make is not yet convincing enough to the Requirements Group. More of such proposals are needed. It was decided not to continue the discussions in an Ad Hoc Group (this has been tried unsuccessfully), but to create the “Applications and Requirements for Standardized Watermarking Technology” document will be created and to rely on proponents of watermarking standardization to make contributions and make that document more solid.

33

Annex 5Systems report

Source: Olivier Avaro

OverviewThe main results of the meeting from the Systems Sub-group perspective are:

Text of ISO/IEC 14496-1:2000 N3712Text of ISO/IEC 14496-6:2000 N3713Draft text of the Systems part of ISO/IEC 14496-5:2001 N3744Text of ISO/IEC 14496-1:2000/DCOR1 N3714Systems Software Status N3715Systems Software Implementation Workplan and Demo Pack N3716Requirements for carriage of MPEG-4 content on IP networks N3717Framework for the carriage of MPEG-4 over IP based protocols N3718Carriage of MPEG-4 streams over RTP N3719Open issues on carriage of MPEG-4 over IP based protocols N3720WD 1.0 of Corrigendum for 14496-4 N3721DoC on Request for Endorsement of CISAC N3722DoC of ISO/IEC 14496-1:2000/FPDAM 1 N3723Text of ISO/IEC 14496-1:2000/FDAM 1 N3724Text of ISO/IEC 14496-4/PDAM 2 N3768Text of ISO/IEC 14496-1:2000/PDAM2 N3725VM 1.0 of ISO/IEC 14496-1:2000 Amd.2 N3726Overview of responses to ‘IPMP Solutions CfP’ N3727Request for ISO/IEC 14496-1:2000/Amd 3 (IPMP) N3728WD 1.0 ISO/IEC 14496-1:2000/Amd 3 N3729Text of ISO/IEC CD 15938-1 Information technology - Multimedia content description interface – Part 1 Systems

N3701

Text of ISO/IEC CD 15938-2 Information technology - Multimedia content description interface – Part 2 Description definition language

N3702

Open issues on MPEG-7 Systems N3730Draft mini Experiment Process for the evaluation of MPEG-7 Binary and Dynamic Descriptions

N3731

FAQ Revision 16.0 N3732

A detailed report can be found below.

General issuesThe following contributions have been reviewed:

N° Title6379 Systems Meeting Report6393 Presentations of MPEG tutorial at IBC 20006391 Table of Replies on ISO/IEC 13818-6/FDAM 1.2 (SC 29 N 3821)6382 Summary of Voting on Request for Endorsement of CISAC as JTC 1 Registration Authority (RA) of

ISO/IEC 14496-1 (SC 29 N 3780)6381 Summary of Voting on Request for Revision of ISO/IEC 14496-1 (SC 29 N 3779)6383 Summary of Voting on ISO/IEC 14496-5/FPDAM 1 (SC 29 N 3798)

34

6385 Late Vote on ISO/IEC 14496-5/FPDAM 1 (SC 29 N 3803)

M6379: Beijing meeting report. Approved without comment.M6393: For information to the group.M6382 : Request from the JNB that CISAC be the RA for IPMP Extensions. Detailed answer in the disposition of comments (N3722).M6391, M6383, M6385 : Vote results that have been taken into account in the production of the output documents.

MPEG-2 Systems

Amendment 1(Report in the section on MPEG-7 Delivery)

MPEG-4 Systems (14496-1)

GeneralThe following contribution has been reviewed :

N° Title6395 Proposed extension of the MP4 file format6556 Short hinted files

M6395 : This extension was approved and should be part of an amendment of the MP4 specification.M6556 : The wording in the standard document reported was indeed unclear and the text will be fixed accordingly.Other items may deal with amendment of the MP4 standard : Clarify the text about the user-data atom count (at most one); Standardize the RTP hint track format; Handle of the bit-length problem in audio; Add the 'file-type' atom from MJ2; Clarify 'optimized for server' hint tracks and the presence of media tracks; Support for MPEG-7; Add fragmented movie support.

14496-1:2000 Corrigendum 1The following contributions have been reviewed :

N° Title6623 ISO/IEC 14496-1:2000/COR1 WD2.06622 MPEG-4 Systems Issues6513 Little Technical Fixes Here and There6649 Input Text for Corrigenda and Reference Software status for MPEG-J6484 Some corrigenda items for ISO/IEC 14496-1:20006512 Comments on ISO/IEC 14496-1:2000/COR1 WD1.06563 Proposal for addition of 3DMC related issues in ISO/IEC 14496-1:2000/COR1

M6623 : Input Corrigendum WD. Adopted as a starting point.M6622: Several issues for corrigendum. Duplication of AU: accepted provided the last sentence is removed. Allowing a sequence of JPEG instead of one: accepted . JPEG_DecoderConfig: rejected.M6513, M6484, M6512 : Little fixes to edition 14496-1:2000. Accepted. But URL Field in the script node to be discussed in the BIFS AHG.

35

M6649: Input text for the corrigendum on MPEG-J: accepted. Some discussion on reference software: MPEG-J source and demo binaries are on ftp.fzi.de.M6563: USE and DEF shall not be used with 3DMC. Examples of use of 3DMC. Accepted but text will be reviewed.As a result, text of ISO/IEC 14496-1:2000/DCOR1 has been published.

Transport of MPEG-4 over IP NetworksThe following contributions have been reviewed :

N° Title6410 USNB Contribution: MPEG-4 over IP issues6584 Requirements for carriage of MPEG-4 content on IP networks6448 Mime types for carriage of MPEG-4 streams over RTP6392 Input for Security Considerations Section in RTP Framework for MPEG-46388 Improvement to the SL for the carriage of TSs6389 Improvement to the SL for packet framing6390 Modification to the 'simple' mapping6447 Carriage of SL headers within RTP6449 Proposed draft for Carriage of MPEG-4 streams over RTP6555 Audio frames concatenation6557 Video mapping to system clarification6601 Comments on M6447, M6448, M6449 (MPEG-4 over IP)6614 FlexMux streams: an RTP payload6611 FlexMux signaling6612 A FlexMux tool with lower overhead

The framework document has been improved to clearly specify the conformance point to MPE-4 terminal. It has been agreed to use MPEG-4 SL a logical conformance point. This means that the payload format providing a logical mapping to MPEG-4 SL packet will be compliant to MPEG-4 terminal. Therefore, all the payload format RFCs should have a section describing a logical mapping from RTP packets to MPEG-4 SL packets explicitly to be considered in the context of this framework.

Generic payload format Internet-Draft has been revised to allow carriage of multiple SL packets in one RTP payload. Major technical issues discussed during the meeting are as follows:

Interleaving shall not be mentioned. If there is a contribution that can draw a consensus after this meeting, I-D shall be improved and submitted to IETF by authors (Philippe?). The revised I-D will be an input to the next MPEG meeting.

There shall be no mapping between sequenceNumber in SL packet header and RTP header. sequenceNumber in SL packet header will be preserved, if present. But it is recommended to use similar features provided by RTP such as timestamp and sequence number.

If SL packet doesn’t carry time stamp, appropriate value of RTP time stamp must be calculated. But it is strongly recommended to use time stamp in any SL header if it is carried by RTP. (This issue is not resolved. Open issue)

If interleaving is defined, it should be based on packetSequenceNumber, not AUsequenceNumber.

Need to decide on RTP timestamps semantics, delivery time stamp or CTS? Use CTS offset for subsequent SL packets within one RTP payload? DTS as well? Yes.

(for both CTS and DTS). Timestamp flag in the first SL packets within RTP packet shall be removed? But it causes

confusion for the case there is no CTS or DTS originally. ==> No. But revision of SL will allow this.

36

ftp://ftp.fzi.de/

MIME type for MP4 file has been done. “video” shall be used for the top level MIME type. “audio” can be used optionally for the case of the content with audio without visual presentation.

M6388, M6389, and M6390 were reviewed during the Paris AHG meeting. The decision from the AHG meeting was to propose an AMD to MPEG-4 system on time stamp flag in SL packet header as proposed in m6388. m6389 also proposed to have flags in SL packets to indicate concatenation of AUs in one SL packet but it is not taken as a proposal to an AMD to MPEG-4 system at this meeting because generic payload format has been improved to carry multiple SL packets in one RTP packet. m6390 is describing the way of making simple mapping to a subset of generic payload format.M6392 was reviewed at the Paris AHG meeting. It was made as an response to the concerns from IETF people on the was accepted as a reference text on the security section for the all RTP payload format proposals.M6612To propose new syntax of FlexMux having longer length field to carry SL packet larger than 255 bytes. But carrying large SL packet in one FlexMux packet is not aligned with the design goal of FlexMux. Furthermore, the examples in the contribution are not really valid because MPEG-2 PES packet can carry multiple FlexMux packets.M6611 To propose in-band signaling mechanism for FlexMux MuxCodeTable by carrying SMTEntryDescriptor and MuxCodeTable in FCR channel (index=238). Current specification doesn’t have in-band signaling mechanism. Out-band signaling method such as DMIF signaling or SDP shall be used to change FlexMux configuration. For the 4onIP case, signaling MuxCodeTable is done by SDP but it cannot be exactly synchronized with RTP stream. But changing the USge of FlexMux to solve the problem from only 4onIP scenario is not favorable because FlexMux is also a part of MPEG-2 system (4on2). Therefore, we should find out in-band signaling mechanism for 4onIP scenario minimizing the implication to FlexMux specification. This issue will remain open and be a part of the mandate of 4onIP AHG.M6614 Proposal of payload format for FlexMux stream is reviewed. Authors’ will registered it as an Internet Draft, but it still need improvement.M6555 Proposal for audio frame concatenation was discussed jointly with Audio. The conclusion was to improve Civanlar’s proposal to carry multiple SL packets in one RTP packet.M6557 Proposal for clarifying the definition of video AU for the case of VOL header. It was agreed to put VOL header together with the next I-VOP in one AU.M6584 Requirement for 4onIP was finalized at the Paris AHG meeting and there is no change at this meeting.M6601 : This contribution was reviewed while addressing the documents it refers to.

14496-1:2000 Amendment 1Topics

Elementary Stream Management1. Flextime

Scene Description2. Media Sensor3. Flextime (Temporal Transform, Temporal Group)4. ServerCommand5. MediaControl6. ExternProto7. Advanced BIFS Coding

37

Profiles and Levels

Software Implementation8. Software Implementation9. DemonstrationDemo. Pack.

Dispositions of contributions

The following contributions have been reviewed :

N° Title6459 Summary of Voting on ISO/IEC 14496-1/FPDAM 2 (SC 29 N 3855)6421 MediaControl Specification6429 Preroll and rebuffering6618 Update to the graphical representation of Object descriptor & SL syntaxes6380 Rationales for children° field in TemporalTransform6428 Proposed text for rebuffering

M6459: See the disposition of comments in N3723.M6421: Update of the specification supported by an NB. Changes agreed in Beijing has been implemented. A new field has been added (Isactive). M6429 : Clarification on preRoll and rebuffering. Taken into account in the discussion and conclusion of M6421.M6380: Clarifications were already included in the study and goes to the informative annex of the amendment.M6428: qos_qualifier is accepted, semantics is clarified further, final text will be included in this amendment.Due to unsolved technical issues reported in the meeting, MediaControl and associated nodes will be delayed to a future version of the Systems standard.M6618: The graphical representation have been reviewed and accepted. They will be integrated in 14496-1:2000 Amendment 1.


MPEG-4 Textual Format10.XMT-A11.XMT-12.Matte Texture

Profiles and Levels

Software Implementation13.Software Implementation14.Demonstration15.Demo. Pack.

Dispositions of contributions


N° Title6624 Working Draft 4.0 of ISO/IEC 14496-1 / AMD36516 Overlap of MatteTexture Functionality in the Visual Spec

38

M6624 : Input text for the XMT spec. Used as a starting point for the production of the CD.M6516 : Investigation whether the Matte texture specification overlap with the Visual spec. Matte texture will be included in VM of amendment 2.


Elementary Stream Management16.IPMP Extensions

Profiles and Levels

Software Implementation17.Software Implementation18.Demonstration19.Demo. Pack.

Dispositions of contributions on IPMP


N° Title6466 Proposal on the Renewability of IPMP System6443 Flexible and Robust IPMP Solutions Using the MPEG-4 IPMP Hooks6517 Extended IPMP system with ID registration procedure6422 IPMP Interfaces for the MPEG-4 Terminal6518 A New IPMP System combined with Digital Watermarking6452 OPIMA: A response to Call for Proposals for IPMP Solutions6519 Open B to B architecture of MPEG-4/IPMP(Response to CfP N3543)6523 Rights authentication for MPEG-4 content, Ticket Authenctication Protocols6525 Response to CfP(N3543)6527 Rights Language for IPMP using ODRL6572 DMIF secure channel support request for IPMP solution6573 Advanced IPMP descriptor for IPMP solution6595 Regarding interoperability, security and standardization of IPMP.6520 Overview of responses to ‘IPMP Solutions CfP’ (N3543).

The disposition on these contributions are documented in document N3727 but for the ones below.M6595: Discussions topics on interoperability, security and standardization.N3727 describes the answers received to the call, the time they were received, the way they were reviewed and the understanding of the topic proposed as understood by the Systems sub-group.The process during the week was to develop an architecture highlighting the normative interfaces addressed by all contributions, to document the high level functionality addressed by these interfaces and to exercise these interfaces in application walkthrough. The following functionality were identified :20.Renewability of IPMP plug-ins (Interfaces : A, C) for control plug-ins and other Plug-ins

=> Shall we open it to renewability of other things ? We can design it specifically so that it can not do everything

21.Interoperability between IPMP Systems and Applications (Interfaces : A, F-B, E)22.Interoperability between IPMP Systems and Network Layers (Interface D)23.IPMP Data filter before the IPMP Systems (Interface A)This are the points that are worth investigating (from a technical and buisness perspective).The following decisions were made :

39

24.APIs (Inputs, outputs and behavior) definition, if they were to be defined, would be defined in IDL. This will give the possibility to download OS dependent plug-ins. (Additional information like OS, and bytecode format may be needed).

25.APIs, if they were to be defined will be defined in Java as well, and java byte code format will be identified as a standardized byte code format. This will give a full interoperable framework, although not suitable for some devices.

26.The esthetic of the API will be inspired from the DMIF APIs.

IPMP Profiles : Currently, the Core OD profile uses the IPMP messages and descriptors (the hooks) as defined in 14496-1:2000. There is a conformance specification 14496-4:2000 for MPEG-4 to this profile. Concerns were raised about the text of the conformance. Evidence should be brought that the conformance specification is not complete. More profiles may be defined later. There is no need to define profile yet.

Dispositions of contributions on profiles


N° Title6564 Addition of 3DMC to Version 3 Complete Graphics Profile6510 Inclusion of 3DMC and FBA compression tools in Graphics Profiles6656 Liaison Statement from Web3D Consortium to WG 11 on Proposal for Core Scene Graph Profile (SC 29 N

3879)6603 Proposal for new 2D Profiles in MPEG-4 Systems

M6564: New profile to have 3DMC tools supported in MPEG-4 scene. The time frame for standardization : 14496-1:2000 Amendment 3. So far it will be incubated in the profile under consideration document (output from Requirement).M6656: Proposal of Core 3D profile from Web3. Parameters for levels definition are useful. Feedback expected by Web3D from MPEG people. The time frame for standardization : 14496-1:2000 Amendment 3. Key sensor : under consideration. Answer expected on the multi-users world activity. Decision will be taken in the next meeting whether we make it in V4 or we delay the amendment.M6603: New 2D profiles. Nested structure proposed. Things need to be split into Video/Audio/Graphics/Scene graph profile. Proponents will work on this and provide this for incubation in the profiles under consideration.M6510 : See SNHC meeting report.

MPEG-4 Conformance and bitstream exchange

14496-4 Conformance

N° Title6644 Evolution proposal for the conformance of BIFS

M6644 : Revision on the log file format. A WD Corrigendum for the conformance has been initiated.

MPEG-4 Reference Software (14496-5)

GeneralThe following document has been reviewed:

N° Title6598 Analysis of the integration of MP4 I/O in IM1

40

6600 IM1 Core code + authoring tools version 5.16384 Update of m6129 (on mux hint format) after the Beijing meeting

M6598 : Report that interleaving is not efficiently implemented in Ref. software. No further action needed.M6384 : Record of agreement on a discussion that was dealt in Beijing on the muxhint format. Formally approved in La Baule.M6600 : Update of IM1 Core code and associated authoring tools.

The usual documents on Im1 status and implementation work plan have been produced

DemonstrationsThe following document have been presented :

N° Title6627 XMT Authoring and Playback Demo

M6627: XMT demo. presenting many tools for conversion between XMT-A, XMT-O, mp4, VRML formats.

Other demonstrations were presented : Blaxxun, T-Nova and CSELT : presentation of first results from the European IST project SoNG. The

demonstration showed a 3D player (Im1 core and blaxxun contact player) including video decoder with (T-Nova) or without (CSELT) shape;

Telstra : presentation of a music catalog encoded in an MPEG-4 scene with three different bit rates and associated interfaces (cable, ADSL, mobile);

Envivio : presentation of Mediacontrol functionality; Web 3D : Mattetexture (not presented, lack of appropriate logistic in the room).

MPEG-4 Exploratory activities

Multi-user applicationThe Call for proposal on multi-user technology has been extended up to the 2nd of January 2001.

MPEG-7 Systems

MPEG-7 SystemsThe following contributions have been reviewed:

N° Title6640 MPEG7 Systems WD 1.1 Input to LaBaule6537 A Context-free Method for Generating Bitstreams for MPEG-7 Descriptions6554 X-Bin a generic and extensible binary encoding format for MPEG7 Descriptions6574 BiM – A binary format for MPEG-7 data6585 Binary format for MPEG-7 descriptions (BiM) : a new approach6613 Results of CE on BiM: A generic context sensitive encoding scheme (CSE) for MPEG-7 descriptions and

MPEG-7 description schemes6637 SMPTE 336M Data Encoding Using KLV6642 KLV for Binary Encoding of MPEG76648 An Efficient Binary Coding Scheme for DDL Instance Documents6645 A Generic Framework for the Design of Textual and Binary MPEG-7 System.6647 Report on Experiment on Application Specific Description Languages

All document have been reviewed and served has a basis for the production of the MPEG-7 Systems CD.

41

MPEG-7 DDL

N° Title6499 MPEG-7 DDL Working Draft 4.1

M6499 : The DDL breakout reviewed the Working Draft 4.1 and adjusted MPEG-7 extensions. The DDL breakout made changes in order to make the DDL fully compliant with XML Schema. Any MPEG-7 schema will be validated by any XML Schema. However an MPEG-7 parser will provide a higher level of checking: Arrays have been extended in order to express new kind of constraints. It is possible to constrain the number of dimensions while not constraining their size. Due to the new orientation of the MPEG-7 design (mostly a type centric approach) the DDL breakout replaced the refEltName extension by the refType. This extension allows to constrain the type of an element referenced by an IDREF.

Joint meeting with MDS/Audio/Video

The DDL breakout participated to a joint meeting with the MDS, Audio and Video group. During this meeting the groups raised concerns and asks for clarification about specific DDL extensions.

The DDL breakout took into account the desire of other groups to have the mechanism of Key/KeyRef. This construct have been added to the DDL. However the DDL recommends to use it carefully where ID and IDREF constructs can not provide the desired functionality. Indeed, this functionality is costly in terms of processing power for the parsers.

The DDL breakout recommends to use keys when :- adding an ID attribute is superfluous i.e. it already exists one field or a combination of fields

that are unique within the referenced descriptor and that,- the global scope of IDs makes them difficult to manage for large descriptions.

The DDL breakout provided a new construct for matrices definition which allows extended functionality while preserving XML Schema compatibility. The new feature allows to constrain the number of dimension of a matrix while not constraining their size. However if a size is not defined in the schema it should be defined later either within sub types or within description with the mpeg7:dim attribute.

The DDL breakout recently decided to adopt XML Schema wildcards because of its need in the last version of other groups. In the meantime, the groups renounces to use it. However this feature has proved to be useful in the context of MPEG-7. The DDL AHG recommends to keep this feature in the DDL.

Because MPEG-7 is taking a type centric approach for its design, and because key/keyRefs provides an element name reference checking, the DDL AHG replaced the refEltName extension by the refType extension and IDREF should be used in conjunction with the refType extension which replaces the refEltName much more appropriate to the element centric approach.

Key and Keyref clarifications

During the joint meetings, groups asked for clarification about keys and keyrefs.

42

A key is independent of the type of the attributes and elements involved, i.e. something declared as of type integer may also serve as a key, unlike ID and IDREF. The equality and inequality conditions appealed to in checking these constraints applies to the value of the fields selected, so that for example 3.0 and 3 would be conflicting keys if they were both decimal, but non-conflicting if they were both strings, or one was a string and one a decimal. Basically, the comparison between keyref and key or unique is by value equality not by string equality.

The selector (Xpath expression) is defined relatively to instances of the element being declared. This must identify a node set of subelements (i.e. elements or contained within the declared element) to which the constraint applies.

The fields specify XPath expressions relative to each element selected by a selector. This must identify a single node (element or attribute, not necessarily within the selected element) whose content or value, which must be of a simple type, is used in the constraint. It is possible to specify an ordered list of fields, to cater to multi-field keys, keyrefs, and uniqueness constraints.

The value of a key must be unique and not nullable (see next for definition), and the name that is associated with the key, pNumKey, makes the key referenceable from elsewhere.

About nullable element

In general, the absence of an element does not have any particular meaning: It may indicate that the information is unknown, or not applicable, or the element may be absent for some other reason. Sometimes it is desirable to represent an unshipped item, unknown information, or inapplicable information explicitly with an element, rather than by an absent element.

Open issues

About Xpath in instances – OK to check Xpath syntax using pattern but if needed more sophisticated checkings have to be carefully evaluated in a later stage of the MPEG-7 standard. Forward info about Datatype Xpath in W3C on the DDL mailing lists !

A first attempt to provide an regular expression for an Xpath expression has been done by XML Schema WG. This definition might be improved to better reflect the needs of the MDS group:

<simpleType name="XPathExprApprox"><annotation>

<documentation>An XPath expression</documentation><documentation>A utility type, not for public use</documentation>

</annotation> <restriction base="string"> <pattern value="(/|//|\.|\.\.|:|::|\||(\c-[.:/|])+)+">

<annotation> <documentation>A VERY permissive definition,

might not be right</documentation></annotation>

</pattern></restriction>

</simpleType>

43

About timeDuration – The DDL AHG should investigate the timeDuration simpleType and the constraint it should refer. The DDL AHG will possibly request comments from the XML Schema WG. Additional checkings might be needed if not provided by XML Schema.

MPEG-7 DeliveryThe following contributions have been reviewed:

6400 Proposed Requirements for a Content Identification System6396 Proposed revisions to requirements for carriage of metadata in MPEG-2 Systems streams6407 ISO/IEC 13818-1:2000 AMD1 (carriage of metadata and descriptions over MPEG-2 systems)6562 Delivery of MPEG-7 description data over MPEG-2 Transport Stream6450 Proposed draft for Carriage of Metadata over MPEG-26565 Delivery of MPEG-7 description data in MPEG-4 Systems over MPEG-2 Transport Stream6634 SMPTE Carriage of KLV Metadata over MPEG-2 Systems V6

The requirements for the carriage of metadata in MPEG-2 Systems streams have been updated and the technical contributions have been studied. Despite the valuable inputs, there was not yet enough technical consensus to produce text for an amendment to MPEG-2 or MPEG-4 Systems. This will be postponed to the Pisa meeting.

44

Annex 6MDS report

Source: Philippe Salembier, John Smith, Ana Benitez, Toby Walker

Overview:The main activity during the week has been to: 1. Review the results of the core experiments approved during the Beijing meeting,2. Select the DSs for inclusion in the XM and in the CD,3. Edition of the CD,4. Define the workplan for software integration of the DS promoted to the XM,5. Review input contributions, 6. Define new Core experiments.

Kick-off of the workDuring the kick-off session, the workplan for the week was discussed and approved. Furthermore, the following points were discussed: Edition of the CD: Explanation of the process WD CD FCD. In order to improve the quality of the MDS XM & WD documents, reviewers have been

assigned to specific sections. The reports and comments were discussed during the week section by section. The following people have reviewed the MDS XM and WD (version 4.0): Basic Elements: Yoshi Shibata, Perfecto Herrera Content Description: Rosa Ruiloba, Fernando Pereira Content management: Erik Oltmans, Michael Wollborn Navigation and Access: Munchurl Kim Content Organization: Josep R. Casas Schema tools: Masahiro Shibata, Cedric Thienot USNB (all sections) A. Benitez, M. Casey, M. Ferman, M. Grossman, Y. Li, T. Nakassis,

S. Quackenbush, E. Rehm, H. Rising, J. Smith, J. Turpin, P. Van Beek.

After discussing the various AHG recommendations, it was decided to create 3 breakout groups for the week: Metadata integration: Chair: Erik Oltmans, Mandate: 1) study and proposed solution(s) for

the duplication of terms in the dictionary, 2) improve the framework for integration. Classification Schemes: Chair: Jose Martinez, Mandate: Further define the classification

schemes and the way to handle them. Possible solutions include enumerated list, normative / informative classification schemes, informative annex.

Schema design: Chair: Yoshi Shibata, Mandate: Resolve open issues of the AHG in particular concerning Schema Design: DS design policy, Global element, Type inheritance.

Review of Validation and Core Experiments results

Num. Contributionsm6424 Report of CE on Structured Index DSm6462 Report of CE on Video Editing DSm6494 Report on the Core Experiment on USge History DSm6495 Report of CE on Multilevel Indexing Pyramidm6498 Report of CE on Semantic DSm6514 Report of CE on EPG DS

45

Num. Contributionsm6588 Report on Ordering Key DS CEm6606 CE on Linguistic DS (Language DS)

All these contributions were discussed during the AHG meeting the Sunday before the meeting and the AHG made recommendations for promotion to the XM and WD.

Basic elements:

m6424 Report of CE on Structured Index DSAudrey Tam, Gulisong Nasierding, Clement Leung,During the presentation of the CE results, the group felt that the Structured Index had many similarities with the Structured Annotation (6Ws). The recommendation was to merge the Structured Index DS with the Structured Annotation DSs. This was done during the week and reviewed by the group on Thursday. The new Structured Annotation DS (including the features from the Structured Index DS) was recommended to be promoted to XM. XM software plan has been developed with the objective that upon completion of the software development, the DS could replace the current Structure Annotation DS in the Study of the CD at the next meeting.

m6495 Report of CE on Multilevel Indexing PyramidAna B. Benitez, Alejandro Jaimes, Corinne Jvrgensen, Shih-Fu ChangThe Multilevel Indexing Pyramid is a tool allowing the classification of visual and audio attributes referring to visual and audio content into ten levels: four syntactic levels – type/technique, global distribution, local structure, and global composition- and six semantic levels – generic object, generic scene, specific object, specific scene, abstract object, and abstract scene. Although the interest of this tool was demonstrated in the CE, the discussion revealed that potential overlap exists between this tool and several tools already available in the Working Draft (StructuredAnnotation DS, Semantic DS and some Met/Med DSs). The group recommended that further studies be carried out to clearly identify whether the Multilevel Indexing Pyramid provides new functionalities with regard to existing tools and to define how the Multilevel Indexing Pyramid could be integrated in the WD minimizing the overlap with other tools.

m6606 CE on Linguistic DS (Language DS)Koiti Hasida, Masahiro ShibataThe goal of this DS is to describe the semantic of Linguistic data such as written text, speech, etc. The CE studied the necessity of the functionality of this DS to describe written documents such as scripts, proposed a set of tools and illustrated possible applications. The CE results were discussed during the week and reviewed on Thursday. No objection were raised on the final syntax and semantics and the DS was included in the XM.

Content Management:

m6514 Report of CE on EPG DSPeter van Beek (on behalf of CE participants)The CE report gave some motivations and background information for the Electronic Program Guide DS. The CE mainly focussed on the design of the basic building blocks describing the content. It did not propose tools to describe the channels nor the high level structure of the EPG. These tools are currently under development in the TV AnyTime forum and MPEG will consider and study the TVA proposal once it will be available (probably before the next MPEG meeting). The CE resulted in minor extensions of several DSs in the content management and the user preferences sections.

Content Description:

m6462 Report of CE on Video Editing DSRosa Ruiloba, Michel Rynderman, Philippe Joly, Yousri AbdeljaouedThe Video Editing DS is composed of two main parts. The analytical part describes the video editing work of already edited sequences whereas the synthetic part describes how to create new sequences from rushes. The CE was finalized for the analytical part but not the synthetic part. The proponents were asked to extract the

46

DSs addressing the analytical part during the week for inclusion in the XM. This specification was reviewed and approved on Thursday. The Synthetic part of the DS will continue under CE.

m6498 Report of CE on Semantic DSAna Benitez, Hawley Rising, Alessandro Bugatti, Corinne Joergensen, Riccardo Leonardi, Koiti HasidaThe CE results were presented and discussed. The group identified some tools that can be considered as stable (already included in the XM and software was contributed). These tools include Semantic DS, SemanticBase DS, Object DS, Event DS, Semantic Place DS, and Semantic relations. They will be included in the CD. The remaining tools (Concept DS, Semantic State DS, USge Label DS, and the graphical relations) are introduced in the XM but will also continue under CE.

m6588 Report on Ordering Key DS CERiccardo Leonardi, Alessandro Bugatti, Yoshiaki ShibataThis CE proposed some updates in the Syntax and Semantics of the Ordering Key DS. These updates were accepted in the XM. However, the tools will continue in the CE to clarify some aspects with regards to the DS syntax (in particular, its use of some XPath features).

User interaction:

m6494 Report on the Core Experiment on USge History DSA. Mufit Ferman (on behalf of CE participants)The CE report reviewed the motivations of this work (requirements document) and gave an overview of past activities. Then, the CE proposed a new specification of the USge History which combines most of the advantages of past proposals. The group accepted this proposal for inclusion in the XM. Future work will include software implementation, and also the definition of classification scheme for action (list of possible USge).

Description Schemes Promoted to XM and CDThe following table summarizes the group decision with regard to promotion to XM and CD (note that some promotions to CD result from XM Software integration between the Beijing and the La Baule meeting).

Description Scheme Section in MDS (editor)

Decision Comments

VideoEditing DS: Analytical components Synthetic components

Content Description(A. Benitez)

Promote to XMContinue CE

Improved specification was prepared and reviewed for these components on Thursday. The synthetic components of the Video Editing DS continue in a CE.

Linguistic DS: Basic structure

Basic Elements (T. Walker)

Promote to XM

The operatorType will not be promoted to the XM. It is very related to semantic relations.

Multilevel Indexing Pyramid Basic Elements(T. Walker)

No decision

Possible future work: CE comparing the

pyramid with Structured Index DS, Linguistic DS, and plain keyword search

Propose the Pyramid to a more general scope applying to entire

47

semantic descriptionsElectronicProgramGuide DS: Update to content manag. DSs:

Title, MediaTitle, Synopsis, Keyword, Genre, Language

New content manag. DSs: Character, Person, Year, SubtitleLang, CloseCaption, AudioSigning, Live, Repeat, FirstShowing, LastShowing, ConditionalAccess, Encrypted and PayPerView

Updates to UserPreference DS

Content Management(J. Martinez)

User Interaction(P. van Beek)

Promote to CD

Promote to CD

Promote to CD

Ordering Key DS Content Description(A. Benitez)

Update XM

The proposed specification uses XPath and Xpointer. The CE will continue investigating a way to express the OrderingKey DS using the Graph DS if XPath/XPointer are not supported by the DDL.

Semantic DS SemanticBase DS Object DS Event DS PersonObject DS MediaOccurrence DS SemanticPlace DS Semantic relations

SemanticState DS Concept DS USgeLabel D

Content Description(A. Benitez)

Promote to CDPromote to CDPromote to CDPromote to CDPromote to CDPromote to CDPromote to CDPromote to CD

Update XMPromote to XMUpdate XM

The Semantic DS was partly integrated into XM software.

StructuredIndex DS: Integration with 6Ws

Basic Elements(T. Walker)

Promote to XM

The Structured Index DS was integrated with the Structured Annotation DS

48

(6-Ws). USgeHistory DS User

Interaction(P. van Beek)

Promote to XM

Promotions from XM to CD for XM software integrationRoot elements: Schema Tools

(J. Smith)Promote to CD

Top-level elements: Schema Tools (J. Smith)

Promote to CD

AudioVisual Content Entities:

Schema Tools (J. Smith)

Promote to CD

Package DS Schema Tools (J. Smith)

Promote to CD

ControlledTerm DTerm DClassificationScheme DS

Basic Elements(T. Walker)

Promote to CDPromote to CDPromote to CD

Probability data types Basic (T. Walker)

Promote to CD

Availability DS Content Management(J. Martinez)

Promote to CD

DependencyStructure DS Basic Elements(T. Walker)

Promote to CD

Graph DS Basic Elements(T. Walker)

Promote to CD

MediaQuality DS Content Management(J. Martinez)

Promote to CD

MediaTranscodingHint DS Shape Hint DS Motion Intensity D Motion Uncompensability D Motion Hint DS Spatial Resolution Hint D CodingHint DS

Content Management(J. Martinez)

Promote to CD

VideoText DS Content Description(A. Benitez)

Promote to CD

Affective DS Content Description(A. Benitez)

Promote to CD

CollectionStructure DS ClusterModel DS MixedCollection DS ConceptCollection DS

Content Organization(J. Smith)

Promote to CD

49

User Preferences DS ParentalGuidance MediaFormat

User Preferences(P. van Beek)

Promote to CD

Description Schemes Promoted to XM or CD.

Basic elements

Num. Contributionsm6530 Proposed Modifications for the Description of People and Placesm6531 Proposed Revisions to the Graph DSm6646 Graph Rewriting Rules and their Application to Restrictions of Relations and Semantic

DSm6533 Proposed Improvements for Controlled Terms and Classification Schemes

m6530 Proposed Modifications for the Description of People and PlacesCorinne Joergensen, Deborah Karpuk, Toby WalkerThis contribution provided some information on standard practices used to specify Persons (Agent) and Places in the field of library and information science. It was agreed to expand the relevant informative sections of the MDS documents to include standard cataloguing elements, to add informative guidelines on how to instantiate the DSs, and to provide references to existing library cataloguing practice.

m6531 Proposed Revisions to the Graph DSToby WalkerThis proposal presented several minor extensions to the Graph DS in response to the issues raised by USNB review of the MDS documents. The main issues were: 1) constrain the type of nodes and relations in a graph, 2) the use of the Relation Property DS and 3) Check of the consistency of the relations in a graph. After discussion, the group agreed to merge the RelationLink DS and the Edge DS into a single Relation. The proposed constraining mechanism uses RefEltName. The status of this "RefEltName" feature in the DDL specification was not known during the discussion and should be checked.

m6646 Graph Rewriting Rules and their Application to Restrictions of Relations and Semantic DSHawley K. Rising IIIThis contribution highlighted the power of graph structures (Graph DS) for creating descriptions, and also for combining, editing, updating, and restricting descriptions based on graphs. In the contribution, several graph rewriting rules and examples were discussed. The use of graphs and graph rewriting to restrict the vocabularies of entities and their relations in writing descriptions was also illustrated. The group recommended that a CE be started at the end of the week (see N3632).

m6533 Proposed Improvements for Controlled Terms and Classification SchemesToby WalkerThe functionality of the Classification Schemes (CS) is to control the vocabulary of the description. The proposal reviewed the current specification of the CS and proposed solutions to improve the specification. The main modifications involve new features to the CS to support multimedia thesauri, a richer set of term relations, definition of relations in (CS), and a placeholder for formal representations of the meaning of terms. These proposals were accepted by the group. Also, the issue of standardizing the thesauri was analyzed. After discussion within the MDS group and also at the MPEG chair meeting, it is recommended to define (when possible) a set of normative enumerated lists or of default thesauri. Their use, however, should not be normative, and each application should be able to use a different set of dictionaries. The use of registration authority for non-normative dictionaries should be further investigated.

Schema Tools

50

Num. Contributionsm6532 Proposal for a MetaMeta DSm6432 Study of MPEG-7 Root Elements

m6532 Proposal for a MetaMeta DSToby WalkerThis proposal highlighted the necessity to have information about the metadata (who has created the description, when, for which purpose, etc). During the discussion, it became apparent that this proposal had some overlap with activities related to the definition of the root elements. It was felt that some further investigation and harmonization were needed. A CE on this subject was approved at the end of the week (see N3634).

m6432 Study of MPEG-7 Root ElementsY. ShibataThis proposal suggested a set of new attributes to be included in the root elements and some improvements on the root elements syntax. Some of the proposed attributes addressed Systems issues and it was decided not to include this type of information in the root elements but to include them in the Access Unit DS defined in the Systems CD. During the discussion, the lack of understanding of conformance in the MPEG-7 framework became apparent. A new AHG dealing with conformance and profiles was approved by the Requirements group at the end of the week (N3762).

Content Management

Num. Contributionsm6559 Thesauri for MPEG-7: Media, Creation and USge Informationm6589 Informative Report about the current status of the GTI MedMet Cataloguing Toolm6491 Internet Streaming Media Metadata Interchange with MPEG-7 MDSm6492 Proposal for Additional MDS Media Format and Coding Elements for Internet Streaming

Mediam6591 Additional Attributes to Support Transcoding and Comments

The following contributions were discussed while reviewing the MDS XM / WD section on Content Management:m6559 Thesauri for MPEG-7: Media, Creation and USge Information.

Jose M. Martinez, Ibrahim Sezan, Masahiro Shibatam6589 Informative Report about the current status of the GTI MedMet Cataloguing Tool

Oscar Fernandez, Clara Garcia, Jose M. Martinezm6491 Internet Streaming Media Metadata Interchange with MPEG-7 MDS

Eric Rehmm6492 Proposal for Additional MDS Media Format and Coding Elements for Internet Streaming Media

Eric RehmMost of the modifications suggested by these contributions were already discussed during the AHG on editing the MDS XM & WD and were already taken into account for version 4.1 of the MDS XM & WD. The proposed list of normative dictionaries were reviewed and were approved. As mentioned before, MPEG will specify a set of normative dictionaries but their USge will not be mandatory and each application will have the opportunity to use non-normative dictionaries.

m6591 Additional Attributes to Support Transcoding and CommentsAnthony VetroThis contribution proposed the addition of two new features (transparent blocks, quantization). Also the interest of the IntraFrameDistance and AnchorFrameDistance description was discussed. Finally, the proposal also suggested to merge the MediaCoding and the MediaFormat entities. All these suggestions were approved by the group.

Content Description

51

Num. Contributionsm6493 Proposal for electronic ink documentm6497 Segment Relations for MPEG-7

m6493 Proposal for electronic ink documentZ-Y Shae, J. Subrahmonia, J. Pitrelli, L. Schomaker, et al.This contribution discussed the interest of electronic ink documents and the necessity to describe them. Major applications include distance education, conferencing, pen systems and electronic whiteboards. The goal of the proposed set of DSs is not only to describe what is written or drawn but also the gesture. Is was suggest to define a new Segment called "InkSegment". InkSegment is a subclass of Moving Region. In the same proposal, several extensions of MediaLocators were also defined. At the end of the week, a new CE in the area of InkDocument was approved (N3633).

m6497 Segment Relations for MPEG-7Ana B. Benitez, Shih-Fu ChangThis contribution proposed a set of Segment relations. The relations are the classical spatial/temporal and topological relations. This proposal was also reviewed by the video group. Two sets of definition were proposed for topological relations. It was decided to use the definition based on set operations.

Navigation and Access

Num. Contributionsm6508 Identifying HighlightLevel in Summary DS

m6508 Identifying HighlightLevel in Summary DSSanghoon Sull, Hyeokman KimThis contribution proposed to add an ID attribute to HighlightLevel in Summary DS. This attribute is necessary in order to be able to refer to a subtree of a hierarchical summary tree. The group agrees to make this minor change.

m6425 Shape-Sequence Descriptors for a spatio-temporal regions, Gyu-Tae Baek, Sang-Youn Lee, Young-Sik Choi and Sang-Hong Lee, Hae-Kwang Kim, Seoung-Jun, Oh.This proposal involved defining a type of Dynamic Visual Object Image and was previously presented to the Video group. The proposed descriptor summarizes the changing 2-D shape of object over time. The summary is represented by a single 2-D image. The MDS group pointed out several places where this functionality seems to be currently supported, including using the object summary image as a key-frame in a video summary, or allowing the image to be a “keyFor” a moving region. Since the proposal does not provide any parameterized representation of the moving object, it does not seem possible to apply matching methods to or other types of automatic processing of the Visual Object image. It is also not apparent how the proposed tool would be appropriate for Video group. The recommendation was given for the presenter to (1) gain a better understanding of the relevant sections of the MDS specification (Segment, Summary), (2) discuss with appropriate MDS members who have knowledge of the relevant sections, and (3) consider alternative implementations using existing tools.

Review of individual section of the MDS XM / WDDuring the week, all sections of the XM and WD were reviewed by the group. This review took into consideration the comments included in the report of the AHG on MDS XM & WD editing (Input document M6478). During the week, it was agreed with the audio and the video groups to specify the TemporalInterpolation tool in the Video CD and the ScalableSeries Tool in the Audio CD.

Metadata integration, TVA

52

Num. Contributionsm6479 Metadata Integration: Dictionary, current status, and open issuesm6500 Proposal for the Integration of Dublin Core and MPEG-7m6543 Proposal: MPEG-7 SequentialSummaryDS meets TVAnytime

m6479 Metadata Integration: Dictionary, current status, and open issuesE. Oltmans, J.P. Evain, J.M. Martinez, P. MulderThis contribution made a review of the current status of the dictionary. The dictionary is useful to allow comparison with other metadata standard but also to detect inconsistencies in the definition of DSs or Ds. The major issue concerning the dictionary definition is the duplication of terms. As MPEG has chosen to strongly structure the description, the semantic of a DS or D may depend on its context. As a result, entities with the same name can have different meaning depending on the context they are used. The work was continued in a Breakout Group. It was concluded that, depending on the DS or D, one of the following solutions could be used: 1) compressed the entries in the dictionary when the elements and their semantics are exactly the same, 2) rename the entry if the semantic significantly differs. In terms of editing the CD, this work will useful to improve the semantics of some tools and maybe to rename some entities.

m6500 Proposal for the Integration of Dublin Core and MPEG-7Jane Hunter(Analyzed and Presented by Eric Rehm)This proposal discussed how schemes coming from two different metadata standards (syntax based on the XML Schema) could be combined. The proposed solution was based on name space. An alternative solution was also discussed by Eric Rehm. It relied on the use of XSL to transform the schema of one metadata standard to the schema of another standard. Another solution that may be further investigated is the use of Packages. During the discussion, it was pointed out that this kind of information should be collected into a document that could help people having to combine MPEG-7 with other metadata standard.

m6543 Proposal: MPEG-7 SequentialSummaryDS meets TVAnytimeD. Ponceleon, O. Hori, M. Sugano, T. McGee, et al.This contribution was mainly informative: its goal was to inform the MDS group about an initiative of a certain number of companies to propose the SequentialSummary to the TV AnyTime group.

Joint meeting with ISG on Software integration

Num. Contributionsm6547 Status of Software integration for DS

m6547 Status of Software integration for DSStephan HerrmannThe review of the document revealed that the software packages of most MDS tools in the XM have been delivered to the ISG group. Because of the large amount of software contributed between the Beijing and the La Baule meeting, it was not possible to integrate and check all packages. This will be done in the future.

m6540 Documentation for Fast Audio Moving Storyboard XM softwareDulce Ponceleon, Jan Pieper, Gilad Cohen

m6541 Documentation for Textual Summaries from Speech TranscriptDulce Ponceleon, Jan PieperThese two contributions were examples of documentation to be provided with the software. After discussion, it was agreed to create a template for documentation on the basis of these proposals. The template can be found in N3659.

Workplan for software integration

Toby Walker, Ana BenitezThe following workplan for software integration was approved by the ISG and MDS groups:

Description Organization Extraction Search Tool Integration

53

Scheme Tool Due DateVideo Editing DS

R. Ruiloba (Lab. d’Informatique de Paris 6 / UPMC)

M. Rynderman (Avid Tech. Inc.)

Description generation of analytic information for cuts and gradual transitions.

N/A January 10, 2001

Ordering Key DS

A. Bugatti (Uni. of Brescia)

N/A Search application with ordering key.

January 10, 2001

Semantic DSState DSConcept DSUSgeLabel

D

H. Rising (Sony)A. Benitez (Columbia University)

N/A Browsing and search application for semantic descriptions.

January 10, 2001

Linguistic DS K. Hasida (ETL) N/A Semantic transcoding using the DS.

January 10, 2001

Structured Annotation D

C. Leung (Victoria Uni. of Technology)

N/A Retrieval application using syntactic relations.

January 10, 2001

InkSegment DS(in Core Experiment)

Zon-Yin Shae (IBM)

Extraction of information from electronic ink documents.

Search application using the InkSegment DS

January 10,2001

Joint meeting with DDL, Audio, Video on XML Schema design

Num. Contributionsm6435 A Base Class Hierarchy for MPEG-7m6432 Study of MPEG-7 Root Elementsm6433 Guidelines for DDL representation of MPEG-7 DSs and Ds ver.1.1m6431 Additional DDL Representation Guidelines regarding Global El. Decl.m6581 a DDL-based HTML Documentation generator for DSs and Ds

Status of DDL, XML SchemaC. SeyratThe chair of the AHG on DDL explained the recent modifications of the XML Schema and the update of the DDL (Introduction of Unique, key, keyref, wildcard). Because of the recent update of the XML Schema, all schema defined by MPEG-7 will have to be modified. Eric Rehm volunteered to investigate the possibility to use XSL for automatic conversion. In terms of MPEG-7 extensions, the current strategy of the DDL group is to use the AppInfo construct of the XML Schema. As a result, MPEG-7 specific extension can be parsed by a generic XML Schema parser.

m6435 A Base Class Hierarchy for MPEG-7P N Garner, A de Cheveigne, Y ShibataThis contribution proposed a complete hierarchy of type inheritance and body / header structures. This proposal was discussed but the activity continued in a breakout group. The final results were reviewed on Thursday afternoon and will be included in the Schema Tools section of the MDS CD.

m6433 Guidelines for DDL representation of MPEG-7 DSs and Ds ver.1.1Y. Shibata and T. Walker

54

m6431 Additional DDL Representation Guidelines regarding Global El. Decl.Y. ShibataThe guidelines were reviewed. The issue of Type-centric versus Element-centric design approach was discussed. The group decision was to adopt a type centric approach and to define a type inheritance hierarchy. The guidelines document was updated accordingly (N3625).

m6581 a DDL-based HTML Documentation generator for DSs and DsCedric Thienot, Claude Seyrat, Gregoire Pau.This contribution discussed the interest of including the documentation and even some examples in the schema definition itself. It is then possible to use a software tool to automatically extract the documentation and to create a set of HTML files and link the various components in the file. This tool could of great help for developers. In terms of the specification of the Schema in the standard, it was decided not to specify <annotation> and <documentation> in the normative sections defining the syntax. However, in the future, the creation of a documented Schema can be envisaged.

Joint meeting with Systems and Requirements

Num. Contributionsm6619 Report of the AHG on Conceptual Modelingm6441 A Proposal for Retrieval Experiments using Dependency Information

During the first part of the meeting, the MPEG-7 System Architecture was discussed. The global architecture was reviewed and the use of MP4 file format was discussed. A diagram illustrating some possible conformance points was also proposed. Finally, the notion of access units was introduced and its relation with roots elements was highlighted. It was decided that root elements should not include Systems related attribute, but it was also recognized that, at the next meeting, harmonization needs to be made between access units and root elements. In the second part of the meeting (only with requirements), the group discussed the meaning of conformance and interoperability. Is was decided to create an AHG at the end of the week to work on these two issues (N3762).

m6441 A Proposal for Retrieval Experiments using Dependency InformationMikio Sasaki, Fumihiko MuraseThis document proposed an experiment to evaluate the use of Dependency information in mobile applications such as location-sensitive video push. The experiment will analyze the use of Dependency Code for Media (DCM) binary encoding of metadata to speed-up matching and retrieval. Problems were pointed out that the proposed material involves a compilation and encoding of descriptions and should be considered as a systems-level. Also the proposed Dependency Information was fixed and too limited. It is not apparent how to extend the given information to accommodate many other dimensions of description. Recommendation was made to develop the semantics of the Dependency Information DS for the CE, to develop an extensible structure that would use additional Ds and DSs, to investigate a wider variety of application needs by enriching the description of the context and to analyze whether this kind of information need new tools or can already be handled by the current set of MPEG-7 tools.

m6619 Report of the AHG on Conceptual ModelingJohn R. Smith, Uma SrinivasanThis AHG has produced a complete conceptual model, has tracked and analyzed the principal concepts involved and MPEG-7, and has produced a set of guidelines to distinguish between DSs and Ds and also between global and local elements. The mandates of the AHG are considered as being very successfully completed.

Joint meeting with SNHC:

Num. Contributionsm6511 MPEG-7 Issues Regarding MPEG-4 Synthetic Objects

55

m6511 MPEG-7 Issues Regarding MPEG-4 Synthetic ObjectsEric Petajan, Zon-Yin Shae, Ajay Divakaran, Tsuhan ChenThis contribution highlighted the interest of the SNHC work for MPEG-7. It was agreed that there is currently a lack of tools in MPEG-7 to describe synthetic objects and that SNHC tools are of great interest in this context. On the one hand side, it was decided to work on naming issues in the context of the AHG on Audio, Video and MDS harmonization. On the other hand side, the technical work will be pursued in the framework of the Video group.

New Core & Validation experiments:

The following experiments were approved during the Beijing meeting:

DSs Organizations Application Related documentsVideoEditing DS LIP6/UPMC

Avid TechnologyVideo editing and browsing document structure

Reports: M6180, M6462Workplans: M5994, N3417, M3469Proposals: M5992, M5993

OrderingKey DS Uni. of Brescia Sony Lab Electronique

Philips

Efficient browsing of segments and objects, among other, based on ordering criteria

Reports: M6027, M5440, M5460, M5464, M5618, M5822, M6227, M6588Workplan: N3429, N3473

Semantic DS Sony Uni. of Brescia ETL SUNY/Buffalo Columbia Univ. LIP6/UPMC

Retrieval and browsing of multimedia material based on semantic descriptions

Reports: M6062, M5936, M5781, M6355, M6498Workplan: N3424, N3474Proposals: M5941, M5937

Graph Rules, Classification Schemes, and Restrictions

Sony Lancaster

University

Graph matching application.

Proposal: M6646

InkSegment DS IBM Siemens Nijmegen Institue

for Cognition and Information

Carnegie Mellon University

Beijing Polytechnic Univ.

Index and search of electronic ink documents.

Proposal: M6493

Description metadata

Sony SingingFish IBM NHK

Cataloguing application.

Proposals: M6532, M6432

56

DependencyInformation DS

DENSO Corp. Matsushita Sharp

Retrieval application of multimedia based on dependency information.

Proposal: M6441

Description Schemes in Core Experiments.

List of Output documents:

Number TITLE

3624 MPEG-7 Multimedia Description Schemes XM (v5.0)3625 Guidelines for DDL representation of MPEG-7 DSs and Ds (v2.0)3626 Template for NB comments on CD 15938-5 3627 Workplan for MDS Software integration3628 MPEG-7 MDS Core Experiments3629 Workplan for CE on VideoEditing DS3630 Workplan for CE on OrderingKey DS3631 Workplan for CE on Semantic DS3632 Workplan for CE on Graph rules, Classification schemes and Restrictions3633 Workplan for CE on InkSegment DS3634 Workplan for CE on Description Metadata3635 Workplan for CE on DependencyInformation DS3705 Text of ISO/IEC 15938-5/CD Information Technology – Multimedia Content

Description Interface – Part 5 Multimedia Description Schemes

(Note: Documents N3624 and N3705 will be released on the 1st of December 2000)

List of AHG approved by the MDS group:

No. TITLE3636 AHG on Editing the MDS XM & CD3637 AHG on MPEG-7 MDS Core Experiments 3638 AHG on Audio, Video, and MDS harmonization3639 AHG on the TV-Anytime Application3640 AHG on Metadata Integration

Targets for the next meeting: Edit and deliver the MDS CD. Perform the software integration of the DSs that have been promoted during the La Baule

meeting. Perform the Core experiments approved during the La Baule meeting and review the results. Continue the harmonization and integration work with relevant standards. Harmonization of Audio, Visual and MDS entities. Study the CD and update the XM. Define and plan new core experiments.

57

Video Subgroup Report for the 54th MPEG Meeting in LaBauleSource: T. Sikora

MPEG-4

21 Version 2 Reference Software

Work on software /bitstream verification was discussed. Only marginal bugs were found and further integration will continue in the context of FGS and Studio profile. Minor bug fixing on the Version 2 software will continue until Pisa meeting. It is expected that after the Pisa meeting the Version 2 software will reach FDAM status.

Version 1 and 2 Encoder Optimization

The Optimization Model (OM) includes tools which optimize MPEG-4. A number of tools are currently under consideraton for further optimization, including fast global motion estimation and fast on-line sprite generation. At the meeting the fast global motion estimation was accepted for inclusion into the OM. OM version 2.0 was issued. In order to further optimize the quality of MPEG video, work on R-D optimization was initiated and a Core Experiment was defined.

Version 3 Studio Application

A number of technical details are still under consideration for the definition of the studio profile. Lossless coding, shape and sprite coding will be supported by this part of the standard. At the meeting JPese National body comments were discussed and a study of FPDAM was issued. A DAM is targeted for January 20001. The study of FPDAM includes the following updates,

Marker bits, max sprite size Lossless DPCM coding Hierarchical Huffman Coding for Binary shape Downloadable VLC Table IDCT precision extension RGB and 12 bits per sample signal Correction of some editorial errors

With respect to subjective Verification Tests and Conformance activities the following schedules were defined:

Test Schedule:

Until January 2001 : Preliminary study for test methodology, preparation & collection of test sequences

January 2001 : 1st Test document

59

March 2001 : Finalization of test process

Until July 2001 : Perform tests

July 2001 : Evaluation of test results

Conformance Schedule:

January 20001: WD

Until March 2001: Generation of Bitstreams for Conformance

March 2001: PDAM

Fine Granularity Scalability

At the meeting National Body comments were discussed and a study of the FPDAM as well as VM 18.0 of the standard was released. DAM is targeted for January 20001. A possible Version 2 of FGS was discussed to incorporate further additions and improvements to FGS. Current FGS profile meets the requirements for streaming video over variable bandwidth channels. However, for high quality video distribution, FGS is a desired functionality but coding efficiency needs further improvement. Potential Version 2 technologies include enhancement layer motion compensation.

Also for FGS a Test and Conformance schedules and details were defined. The schedules follow those of the Studio Profile. For the Verification Tests the following details were approved:

Test 1 : Comparison FGS/Multicast 3 Test 2 : Dynamic Channel Conditions:

- Network with priority setting- Best effort network- Wireless network

Test Sequences : As in Core Experiments. Result Evaluation based on subjective Assessment First draft defined jointly with Test Subgroup

Call for Proposals for Coding Efficiency

Results of a Call for Evidence indicated, that there may be technology available to improve coding efficiency. As a result MPEG issued a Preliminary Call for Proposals at the Bejing meeting. At the LaBaule meeting a final Call for Proposals was issued to solicit input to a formal subjective test. The primary purpose is to test the quality of coded video at low and medium bit rates. MPEG-4 anchor sequences will be generated by HHI and EVue. The schedule foresees anchor sequences to be available and proposals registered by January Pisa meeting. The Tests will take place at Intel US premises prior to the March MPEG meeting and results of the tests will be available at the March meeting.

60

MPEG-7

At the meeting the following technologies were promoted to WD/C

• VisualTemporalArray descriptor• Optimization of ExtensionFlag in Color Layout descriptor• Face Recognition descriptor • Spatial 2D Coordinate System descriptor• Improvements to Colour structure descriptor • Bit-plane coding for scalable histogram• 3D Shape

Based on decisions in the group the descriptors for Bounding box, Container descriptors group, VisualTemporalArray, GridLayout, 2D/3D Multiview were removed from the CD.A number of descriptors were updated for consistency.

Detailed review of the CD and XM documents lead to a good quality CD document. This review process included personal reviewers for each descriptor and multistage reviewing.Overlaps between decriptions were detected, e.g. region locator and bounding box.

61

Annex 8Audio report

Source: S. Quackenbush, Chair Audio Subgroup

Opening of the meetingThe MPEG Audio Subgroup meeting was held during the 54th meeting of WG11 in La Baule, FR, October 23-27, 2000. The list of participants is given in Annex A-1.

Administrative matters

Approval of agendaThe agenda, shown in Annex A-II, was discussed, edited and approved.

Beijing meeting reportThe Audio Subgroup Beijing meeting report, July, 2000, had been previously distributed by email and was approved.

Allocation of contributionsAll contributions (see Annex A-IV) were allocated to the agenda and were discussed either in the task groups or in Audio plenary. The Chair brought other relevant documents from Requirements, Systems and MDS to the attention of the group.

Communications from the ChairThe acting Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.

Joint meetingsThe joint meetings with Audio over the course of the week are listed here and are reported on below.Group 1 Group 2 What Where WhenSystems Audio, Video MP4 on IP Systems Tue 10:00 –

11:00MDS DDL, Audio, Video Schema design update MDS Tue 10:00 –

12:00ISG Audio XM integration ISG Tue 15:00 –

16:00ISG Audio XM integration

scheduleISG Wed 16:00 –

17:00

Received National Body Comments and Liaison mattersThere was one Liaison documents, shown below.Document Title Source Author of Response6460 IEC CD 61883-6: Consumer audio/video equipment -

Digital interface - Part 6: Audio and music data transmission protocol (SC 29 N 3856)

IEC TC 100 Barry Haskell

Task Groups

62

Six task groups were convened for the duration of the MPEG meeting, as shown in ANNEX-III. Results of task group activities are reported below.

Record of Audio plenary, joint meetings and task group activities

Audio plenary discussionsAudio plenary discussions consisted of review and approval of work done by the task groups.

Joint meeting discussionsMPEG-4 on IP

The groundwork for this meeting began in the Monday afternoon audio plenary when the Chair called contribution M6555 “Audio frames concatenation,” to the attention of the group. The author, Philippe Gentric, was present and presented the contribution. The main point of his contribution was that current IETF drafts for carrying MPEG-4 audio over IP do not achieve sufficiently low RTP packetization overhead in the case that the MPEG-4 audio data is from a 2 kb/s speech coder. In the ensuing discussion the tables shown in Annex A-VI were constructed. The joint meeting with Systems began with a review of these tables, which made it quite clear that carrying 2 kb/s coded speech using the Civanlar draft incurred an 800% overhead, while using the LATM draft required a 100% overhead. Neither is a competitive solution for the application segment of delay-insensitive streaming of low-rate speech signals. The Systems subgroup repeated points from the AHG report on MP4 on IP, which were that the recommended requirements for MP4 on IP were:

One generic payload format Other formats should be a subset of this format

These requirements are also in ietf-avt-rtp-mpeg4-es-xx.txt. After much discussion, both in this joint meeting and later in Audio plenary, the Audio subgroup endorsed the following principles for making progress on a unified MP4 on IP IETF draft:

a new or revised IETF draft that has multiple SL packets per RTP packet, which o Reduces packetization overhead, especially for 2 kb/s coded signalso Supports error resilient streamingo Supports any MPEG-4 Elementary Stream

•that the SL packet interface can be common to all IETF drafts for MP4onIP.

XM integration

ISG talked about how applications would run on the XM. They envision three types of applications:

Media based MPEG-7 database: extracted directly from media via procedures that are typically tightly

integrated into the XM. The normative metadata resides in an internal C++ representation, but can also be written to a file in an XML or BiM representation.

Query: query is a media segment that represents the query target. As in database generation, the normative meta-data is extracted directly from the media and stored into an internal C++ representation.

Match: show best match(es) by operating on internal C++ representation of meta-data.

DDL based MPEG-7 database: extraction can be outside of XM, via C++ code, other code (e.g. matlab)

or via interface to widely available 3rd party product (e.g. a speech recogniser). The extraction procedure reads media files and writes the XML instantiations that are the normative MPEG-7 meta-data. The XML instantiations are read into the XM, populate a

63

DOM tree and are loaded into an internal C++ representation for subsequent matching operations

Query: query is an XML instantiation, which is read by the XM, populates a DOM tree and is loaded into an internal C++ representation for subsequent matching operations

Match: show best match(es) by operating on internal C++ representation of meta-data.

Transcoding Query: query is an XML instantiation, which is read by the XM, populates a DOM tree and

is loaded into an internal C++ representation for subsequent matching operations Match: media is read into XM and meta-data extraction is done as the media is read. The

media segments that match the query target are indicated. An example of such an application is to extract and display the desired keyframes from video sequences.

The Audio subgroup and ISG agreed that Audio subgroup’s part in the XM integration of Spoken Content is complete, as it has provided the necessary code for the XM, and that ISG has to integrate that code into the XM code base. The Spoken Content CE is an example of a DDL based application, in which

An external extraction procedure with interfaces to a 3rd party speech recogniser reads media files and writes a file of XML instantiations of the normative meta-data.

The XM DDL parser reads the XML produced by the extraction procedure and, via DOM interface, (actually generic DS interface), fills C++ classes for use by the query process.

The Audio subgroup agreed that most audio Ds and DSs will be DDL applications. As such, The extraction phase can be either tightly integrated into the XM or executed by a procedure

external to the XM, and computed via any of the followingo C++ codeo Matlab scriptso Documented C++ interfaces to commercial 3rd party applications (e.g. a speech

recogniser).The extraction phase reads media files and writes normative XML instantiations of the appropriate Ds

and DSs, which comprise the MPEG-7 database that can be queried. The query is posed as an XML instantiation of the appropriate Ds and DSs. In the matching process, the XM reads in the database of XML instantiations and populates

a DOM tree and then reads in the query target XML instantiations and populates a DOM tree. An interface to the DOM tree writes the data to an internal C++ representation. Application-specific procedures operate on the C++ representation to present the best match(es) to the query target.

The matching phase will be tightly integrated into the XM.

The schedule for integration into the XM is as follows: External extraction procedure: All audio CE completed by Jan 10, 2001. Tightly integrated matching procedure All audio CE completed by TBD

Task group discussionsMPEG-4 V2 conformance, 14496-4/Amd 1 (FDAM Jan 01) – contributed by Ralph Sperschneider

Conformance textM6487 has been used as starting point.

64

Comments made in M6558 have been reviewed. More detailed information on scalable reference waveforms should be added. Some details regarding the test sequence definition for epConfig==2 needs to be revised. The revised description has been included.Comments made in M6604 have been reviewed. The proposal was withdrawn. Open issues related to HILN have been reviewed and included.The test procedure for RMS (“full accuracy” decoders) has been reviewed.

Conformance work planM6488 has been used as starting point.The tables reflecting the test sequences have been updated.The time schedules have been revised.

Proposed corrections on Audio conformanceN3486 has been used as starting point.Corrections made in N3485 (ISO/IEC 14496-3:1999/Cor.1:2001) have been reviewed w. r. t. their impact of Audio conformance, appropriate information stated in N6463 has been used as a starting point.Some corrections with respect to a common file name convention have been added.

MPEG-4 Reference Software 14496-5/Amd 1 (FDAM Oct 00)

Thursday from 09:30 to 13:00, interested Audio subgroup members met with Markus Werner of SEED and reviewed the proposed agenda and scope of work for the MPEG-4 Audio VM framework re-write. The program of work that was agreed on at that meeting is show in the ANNEX A of N3646, “Status and Workplan for MPEG-4 Audio Reference Software.” The Chair is happy to note that three more companies indicated interest in supporting the re-write effort. The major goals of the framework re-write are that the top-level code will

Read MP4 file format. Route Access Units to a single, unified, interface to the various underlying audio object type

decoders. Write audio files in any of several formats.

The re-write task is expected to be completed by the time of the march MPEG meeting, and so the corrigendum to replace the existing MPEG-4 audio reference software with the new software could be started at that meeting.

MPEG-4 Corrigenda and 2nd Edition

At the Beijing MPEG meeting the Audio subgroup began a corrigendum against MPEG-4 version 1 audio. Since there is only one ballot cycle for a corrigendum, and since the ballot for this corrigendum, 14496-3/1999:DCOR1, closes 2001-01-06, it is important to note the national bodies are able to issue comments on this ballot item. A poll taken in Audio plenary indicated that the following national bodies could make ballot comments:

NB Meeting Date Contact JNB Dec 2000 Takehiro MoriyaKNB (by email) Sang-Wook KimGNB (by email) Jurgen Herre

As part of a related effort, there will be an AhG activity to roll the Audio Version 1 and Version 2 text into a single document that also incorporates the changes indicated in the corrigendum. This will issue at the same time that 14496-3/1999:DCOR1 issues. Since these changes are only editorial (the combination of Version 1 and Version 2 text) or have already been approved by ballot

65

elsewhere (the 14496-3/1999:DCOR1 ballot), the MPEG-4 Audio Edition 2001 can issue without any balloting.

MPEG-7 Audio 15938-3 (CD Oct 00)

Phil Garner, Canon, was named editor of the MPEG-7 Audio text. Other editors may be named at future meetings. A small but dedicated group worked on incorporating DDL changes and stylistic changes into the document. In addition, the melody and the silence description schemes were promoted into the CD and the scalable series description scheme was moved from MDS back to Audio. The document will have an editing period to end November 27th.The timetable for progression of the MPEG-7 Audio standard is as follows:MPEG-7 progressionMilestone Date of

MPEG Closing Plenary

Notes

CD 2000-10-27 delivered to SC29 2000-12-01, issue ballot with comments on CD, CD ballot with comments due 2000-03-01

Study of CD

2001-01-19 Process early ballot comments.

FCD 2001-03-09 Receive ballot with comments on CD, issue ballot with comments on FCD

FDIS 2001-07-13 Receive ballot with comments on FCD, issue ballot without comments on FDIS

MPEG-7 Audio core experiments and other business – contributed by Adam Lindsay

Tues: 1000-1300MDS-Video-Audio-DDL Joint status of XML Schema/DDLWe saw several inputs of general relevance to MPEG-7. One big issue of note is that the DDL is tracking current changes in XML schema, which is expected to be draft recommendation soon, therefore more stable. However, there are no guarantees that it won't change again.Tues: 1330-1500Reviewing input documentsVincent presented XM integration problems for Timbre DS. Basic audio functionalities are unavailable.Agreement was reached on Silence: best to let minimal parameters to identify application/semantics of segmentation. Thus only the "major silences," or the silences that are not extremely sensitive to parameter changes, are reflected by this slightly edited DS.Tues 15:00-18:30Joint with ISG re: XMThis was a long, hard process, in which Schuyler finally got them to agree to MATLAB as an extraction tool for the purpose of XM integration.Wed 12:20-18:00Melody inputThe MIT Presentation and demo sparked lots of competing suggestions, but the proposal at hand was the one that received review and technical input. Still, the discussion provoked questions like, what is the "sweet spot" between terseness and flexibility. We saw a demo (unofficial, as there was no input document) of a similar query-by-humming application from FR Telecom. It demonstrated a very different strategy for melodic search using a much larger database. In light of this further demonstration, and considering the subgroup chair's encouragement to exercise their prerogative as "experts," the breakout group spent some time reaching a rough consensus on a more complex Melody DS, building on an informal document from Ron Goodman, Creative.

66

Thu 09:30 – 18:00On Thursday morning we heard a brief report on the XM joint meeting: We are to provide, by 10 Jan, applications that output XML descriptions. As a next step, these XML descriptions would be read into the XM and a matching system executed (this would represent the most complex part of XM integration).In a discussion on what's still needed in the standard we heard a few suggestions on providing facilities for non-normative extensions to the standard. A company considering MPEG-7 may wish to include a data field for private data or data that has no reason to be standardized (e.g. audio fingerprints). Not seeing a clear means for extension within the audio part of the standard, they may pass over the standard. The traditional MPEG-7 response to this is that the standard is highly extensible, via the DDL, which may aid in partial interoperability via its highly structured data fields.It was noted that the MDS document's example of a controlled term list holds a hierarchy "upside down." This is odd, and we should seek more explanation, as our dictionaries will depend heavily on this construct.The subgroup should consider a music industry profile.The breakout group committed to applications of the DSs to make contributions to the "monster description" example instantiation. Perhaps Zero Crossing Rate should be included in the Audio Descriptor Framework.The remainder of the meeting was dedicated to document editing and review.

Audio Call for Evidence

The task group revised the Audio Call document to add Annex I. This Annex lists the registrants, indicates what MPEG-4 “reference quality” materials each of them needs, indicates who will supply these materials and when they will be supplied. In addition it proposes that the materials be made available via a passworded FTP site hosted at the University of Hanover. Details on the FTP site will be posted on the Audio Call AhG reflector.

MPEG Audio web page / FAQ / FTP site / press statement

The only activity of this group was to draft the press statement.

Meeting deliverables

Press statementThe Chair prepared the Audio part of the press statement, which was reviewed an approved in Audio plenary.

Dispositions of CommentsThere were none.

Responses to Liaison and NB commentsThere were none prepared by the Audio subgroup.

Recommendations for final plenaryA list of Audio recommendations were reviewed and approved.

Establishment of new Ad-hoc GroupsThe following ad-hoc groups were established:Title Chair No. MeetingAHG on MPEG-4 Audio Reference Software

H. Purnhagen,Co-chair B. Teichmann

3652 No

AHG on Audio part of MPEG-4 Conformance

R. Sperschneider 3653 Sunday before 55th meeting

67

AHG on MPEG-4 Audio 2000 Edition S-W. Kim,Co-chair B. Grill, T. Moriya

3654 No

AHG on Audio call for Evidence S. Quackenbush 3655 Sunday before 55th meeting

AHG on MPEG-7 Audio A. Lindsay Co-chair M. Casey, S. Quackenbush, B. Feiten, Y. Kim

3656 Sunday before 55th meeting

Approval of output documentsAll output documents, shown in Annex-IV, were presented in Audio plenary and were approved.

Future activities

Schedule of future meetingsAd Hoc group meetings that may be held immediately prior to the next MPEG meeting are shown in the table listing the Ad Hoc groups.

Agenda for next meetingThere was not time to review the agenda for the January MPEG meeting. It is shown in Annex V.

All other businessThere was none.

Closing of the meetingThe Chair thanked the participants at this MPEG meeting for their hard work. Every attendee was a contributor, and the output documents showed the extent of their accomplishments. Audio Plenary was adjourned at 13:00h Friday, with plenty of time for lunch!

68

Annex A-I: Participants

Name First Name Country Affiliation e-mail addressBurnett Ian AU Univ of

[email protected]

Carre Natthieu FR FR Telecom [email protected] Mike US M E R L [email protected] Wilson UK Canon [email protected] Bernhard DE T-Nova [email protected] Betrand FR FR Telecom R&D Betrand.foulonneau

@FRtelecom.frFunken Ralf F.M. NL Philips Consumer

[email protected]

Garner Philip UK Canon [email protected] Ron US Creative Labs [email protected] Bernhart DE FhG-IIS [email protected] Jürgen DE FhG-IIS [email protected] Sanae JP NTTDoCoMo [email protected] Jyri FI Nokia Res Center [email protected] Masahiro JP NEC [email protected] Sang-Wook KR Samsung [email protected] Youngmoo US MIT [email protected] Frank DE Fraunhofer [email protected] Clerc Francois FR Thomson

[email protected]

Lindsay Adam UK Lancaster Univ [email protected] Guyader Alain FR FR Telecom R&D [email protected] Takehiro SG NTT [email protected] Masayuki JP Sony [email protected] Sung-Hee KR Samsung [email protected] Pierrick FR FR Telecom R&D [email protected] Vincent FR IRCAM [email protected] Heiko DE Uni Hannover [email protected] Schuyler US AT&T [email protected] Jean-

BernardFR FR Telecom R&D [email protected]

Sperschneider Ralph DE FhG [email protected]äänänen Mauri FI Nokia Res. Center [email protected]

mailto:[email protected]


mailto:sheba@sait


mailto:Moriya.takehiro@lab










Annex A-II: Agenda for the La Baule Audio Meeting

Agenda Item Contributions1. Opening of the meeting2. Administrative matters Monday 3PM – 7PM

2.1. Approval of agenda2.2. Approval of Beijing meeting reports2.3. Allocation of contributions2.4. Communications from the Chair

2.4.1. Sunday Chair’s meeting2.4.2. Joint meetings

2.5. Review of AhG reports 6430(M) 6437 6463 6465 6489 6583(S) 6621

2.5.1. Audio Call for Evidence2.5.2. MP4 over IP

2.6. Review of task group mandates2.7. Review of ballot item deadlines

2.7.1. 14496-3/1999:DCORR1 ballot closes 2001-01-062.8. Received national body comments and liaison matters 6460

3. Task group activities3.1. MPEG-4 V2 conformance, 14496-4/Amd 1 (FDAM Jan

01)3.1.1. "Study on" text 6487 6488 6558 66043.1.2. Bitstream status

3.2. MPEG-4 Reference Software 14496-5/Amd 1 (FDAM Oct 00)

Thursday 9AM – 12N

3.2.1. Review rewrite status and workplan3.3. MPEG-4 Corrigenda and 2nd Edition

3.3.1. Proposals for DCORR1 ballot comments3.3.2. Workplan for 2nd Edition editing

3.4. MPEG-7 Audio 15938-3 (CD Oct 00)3.4.1. Produce CD text 6561(M)

3.5. MPEG-7 Audio core experiments and other business3.5.1. Review progress 6434 6436(S) 6472 6551

6626 6629 6654 66553.5.2. Harmonization and completeness of MPEG-7

Audio6435(M)

3.5.3. Conformance and Profiles3.6. Audio Call for Evidence

3.6.1. Access to encoded material3.7. MPEG Audio web page / FAQ / FTP site / press

statement4. Discussion of unallocated contributions5. Meeting deliverables

5.1. Press statement5.2. Dispositions of comments5.3. Responses to NB comments5.4. Liaison statements5.5. Recommendations for final plenary5.6. Establishment of new Ad-hoc groups5.7. Approval of output documents

6. Future activities6.1. Agenda for next meeting

7. A.O.B.8. Closing of the meeting

71

Annex A-III: Task Groups

1. MPEG-4 Reference Software 14496-5/Amd 1 (FDAM Oct 00)Chair Heiko PurnhagenMandates and Agenda1.2. Review rewrite status and workplan Thur 9:00 – 12:00

1.2.1. Will Audio part 5 corrigendum (SEED work) contain TTS and SA and Audio Composition?

1.3. Coordinate with 14496-3 DCORR1

2. MPEG-4 V2 conformance, 14496-4/Amd 1 (FDAM Jan 01)Chair Ralph SperschneiderMandates and Agenda2.1. Review text2.2. Review conformance data status2.3. Specify uniform naming and zip archive packing for all conformance data2.4. Review "Proposed corrections to MPEG-4 Version 1 and Version 2 Audio

Conformance," N34862.4.1. Start DCORR if appropriate2.4.2. Audio decoder conformance criterion

3. MPEG-4 2nd EditionChair Bernhard Grill, Sang-Wook KimMandates:1.1. Review DCORR (N3485)1.2. Create a “Study on 2nd Edition”

1.2.1. Merge V1 and V2 text plus N3485 (DCORR text)1.2.2. Prepare this text to issue this as MPEG-4 Audio Second Edition, 14496-3 at same

meeting that DCOR issues.1.3. Create workplan for progression of DCORR and 2nd Edition text1.4. Co-ordinate NB comments on DCORR1

4. MPEG-7 Audio 15938-3 (CD Oct 00)Chair Phil GarnerMandates:4.1. Prepare CD text

5. MPEG-7 Audio core experimentsChair Adam LindsayMandates and Agenda5.1. Review CE progress5.2. Select technology for inclusion in CD5.3. Revise "Status of MPEG-7 Audio Core Experiments," N34915.4. Review status of XM

5.4.1. Report on status of Audio software integration5.5. MDS Harmonization

5.5.1. talking to, etc.5.5.2. presentation of video editing examples

5.6. Consider MPEG-7 “examples” as a way to verify completeness of MPEG-75.6.1. Music Library Annotation

5.7. Modules, Profiles and Conformance points

6. Call for Evidence of Audio TechnologyChair Schuyler QuackenbushMandates:6.1. Review Audio Call procedures in light of registrants and proposed technology

6.1.1. Determine what companies and contact individuals will provide access to coded material

6.1.2. Specify procedure that will provide access to coded material6.2. Insure that these procedures are adequately publicized

73

Annex A-IV: Input and Output Documents

Contributed documentsThe following documents were contributed to the Audio Subgroup and were considered during this meeting:Number Group Source Title6434 MPEG-7 P N Garner, J P A Charlesworth SpokenContent Developments6437 All S. R. Quackenbush Report of the AHG on Audio Call for

Evidence6463 MPEG-4 Takehiro Moriya, Bernhard Grill Report of AHG on MPEG-4 Audio second

edition6465 MPEG-4 Heiko Purnhagen, Bodo Teichmann Report of AHG on MPEG-4 Audio

Reference Software6472 MPEG-7 Frank Klefenz, Juergen Herre,

Andras KataiContinuation of Check Site Test Report on MPEG-7 Core Experiment on Melody Similarity

6487 MPEG-4 Ralph Sperschneider, for the AHG Study on MPEG-4 Version 2 Audio Conformance FPDAM

6488 MPEG-4 Ralph Sperschneider, for the AHG Status and Workplan for V1 and V2 Audio Conformance

6489 MPEG-4 Ralph Sperschneider, for the AHG Report of the Ad-hoc Group on the Audio part of MPEG-4 Conformance

6551 MPEG-7 Bernhard Feiten, Silvia Pfeiffer Status of the CE Silence6558 MPEG-4 Sung-Hee Park, Sang-Wook Kim ER_BSAC related modifications in MPEG-

4 conformance FPDAM16604 MPEG-4 Jyri Huopaniemi, Riitta Vaananen Comment on Advanced AudioBIFS

conformance6621 MPEG-7 Adam Lindsay (on behalf of the

AhG)Report of the Ad-hoc Group on MPEG-7 Audio Core Experiments

6626 MPEG-7 Adam Lindsay Comments on the Melody CE6629 MPEG-7 Michael Casey Sound Effects Core Experiment Results6654 MPEG-7 Youngmoo Kim Status of Melody CE6655 MPEG-7 Youngmoo Kim Validation of Independent Components

Analysis DS

Here are additional documents that were not reviewed by the Audio subgroup, but that the Chair felt were important to call to the attention of the group:Number Section Source Title6431 MDS Y. Shibata Additional DDL Representation Guidelines

regarding Global Element Declaration6455 Requirements Neil Day Presentation Programme for First MPEG-7

Awareness Event6456 Requirements Neil Day, Witold Reichhart,

Caterina Saraceno, [email protected]

Report of MPEG-7 Applications and Promotions to Industry Adhoc

6491 MDS Eric Rehm Internet Streaming Media Metadata Interchange with MPEG-7 MDS

6492 MDS Eric Rehm Proposal for Additional MDS Media Format and Coding Elements for Internet Streaming Media

6507 MDS Sanghoon Sull, Hyeokman Kim Naming Convention for MDS6533 MDS Toby Walker Proposed Improvements for Controlled

Terms and Classification Schemes6561 MDS Philippe Salembier Proposal of Template for NB comment on

MPEG-7 MDS CD6574 Systems Michael Wollborn (Bosch), Sven

Bauer (Bosch), Andreas Engelsberg (Bosch), Jens Rainer Ohm (RWTH

BiM - A binary format for MPEG-7 data

Number Section Source TitleAachen)

6577 Systems AHG on binary and dynamic MPEG-7 data representation

Report of AHG on binary and dynamic MPEG-7 data representation

6613 Systems J. Heuer, A. Hutter (Siemens AG), U. Niedermeier (TU Muenchen), E. Wan (CISRA)

Results of CE on BiM: A generic context sensitive encoding scheme (CSE) for MPEG-7 descriptions and MPEG-7 description schemes

6645 Systems Hawley K. Rising III, Ali Tabatabai, Dave Singer

A Generic Framework for the Design of Textual and Binary MPEG-7 System.

Output DocumentsThe Audio Subgroup produced the following output documents. Those shown in Italics were approved for public release.Title No

Call for Evidence Justifying the Testing of Audio Coding Technology 3641Study on MPEG-4 Audio 2000 Edition 3642Study on MPEG-4 Audio Contribution to Conformance FPDAM 3643Proposed corrections to MPEG-4 Version 1 and Version 2 Audio Conformance 3644Status and Workplan for MPEG-4 Audio Conformance 3645Status and Workplan for MPEG-4 Audio Reference Software 3646Status of MPEG-7 Audio Core Experiments 3647Workplan for MPEG-7 Timbre Description 3648Workplan for MPEG-7 Sound Effects Classification 3649Workplan for MPEG-7 Melody Description 3650Workplan for MPEG-7 Silence Description 3651Text of ISO/IEC CD 15938-4 Information Technology - Multimedia Content Description Interface - Part 4 Audio

3704

75

Annex A-V: Agenda for the January MPEG Audio Meeting

Agenda Item Contributions1. Opening of the meeting2. Administrative matters

2.1. Approval of agenda2.2. Approval of La Baule meeting report2.3. Allocation of contributions2.4. Communications from the Chair2.5. Joint meetings2.6. Review of AhG reports

2.6.1. Audio Call for Evidence2.7. Review of task group mandates2.8. Received national body comments and liaison matters

3. Task group activities3.1. Audio Call for Evidence3.2. MPEG-4 V2 conformance, 14496-4/Amd 1 (FDIS Jan 01)

3.2.1. Define bitstreams for each profile and level demonstrate limits of decoder complexity

3.3. MPEG-4 V1 Corrigenda and Edition 20003.4. MPEG-7 Audio 15938-3 (FCD Mar 03)3.5. MPEG-7 Audio3.6. MPEG Audio web page / FAQ / FTP site / press statement

4. Discussion of unallocated contributions5. Meeting deliverables

5.1. Press statement5.2. Dispositions of comments5.3. Responses to NB comments5.4. Liaison statements5.5. Recommendations for final plenary5.6. Establishment of new Ad-hoc groups5.7. Approval of output documents

6. Future activities6.1. Agenda for next meeting

7. A.O.B.8. Closing of the meeting

76

22 Annex A-VI: Analysis of RTP packetization overhead for various payload definitions (IETF drafts) for various audio decoder objects

Assumptions1500MTU, maximum transfer unit

1sec, MEAD Maximum Encoded Audio Duration in RTP packetRTP payload as in Civanlar IETF draft Civanlar IETF draft: draft-ietf-avt-rtp-mpeg4-02

AbbreviationsAF audio frameEAF encoded audio frame

Coder Bit Rate AF Duration Bits/EAF EAF/RTP packet

Byte packing inefficiency, %

RTP and SL header overhead, %(1)

Total Bitrate

HVXC 2000 0.020 40 1 10.0 800 18000HVXC 4000 0.020 80 1 5.0 400 20000NBCELP 3850 0.040 154 1 2.6 208 11850NBCELP 6000 0.020 120 1 3.3 267 22000NBCELP 12000 0.010 120 1 3.3 267 44000WBCELP 16000 0.010 160 1 2.5 200 48000WBCELP 24000 0.015 360 1 1.1 89 45333AAC 32000 0.023 736 1 0.5 43 45913AAC 48000 0.023 1104 1 0.4 29 61913AAC 64000 0.023 1472 1 0.3 22 77913AAC 96000 0.023 2208 1 0.2 14 109913AAC 128000 0.023 2944 1 0.1 11 141913AAC 320000 0.023 7360 1 0.1 4 333913

2) Pack as many Audio AU (EAF) per RTP packet up to MTU limit

Coder Bit Rate AF Duration Bits/EAF EAF/RTP packet


RTP overhead, %(1)

Total Bitrate


78

2) Pack as many Audio AU (EAF) per RTP packet up to MTU limit, but not to exceed MEAD limit

Coder Bit Rate AF Duration Bits/EAFEAF/RTP packet


RTP overhead, %(1) Total Bitrate


LATM IETF draft

Pack up to 8 Audio AU (EAF) per RTP packet, but not to exceed MEAD limit40RTP header length, bytes8LATM maximum AU per superblock




Coded Audio Duration per RTP pkt

HVXC 2000 0.020 40 8 1.25 100.00 4000 0.160HVXC 4000 0.020 80 8 0.63 50.00 6000 0.160NBCELP 3850 0.040 154 8 0.32 25.97 4850 0.320NBCELP 6000 0.020 120 8 0.42 33.33 8000 0.160NBCELP 12000 0.010 120 8 0.42 33.33 16000 0.080WBCELP 16000 0.010 160 8 0.31 25.00 20000 0.080WBCELP 24000 0.015 360 8 0.14 11.11 26667 0.120AAC 32000 0.023 736 8 0.07 5.57 33739 0.184AAC 48000 0.023 1104 8 0.05 3.71 49739 0.184AAC 64000 0.023 1472 8 0.03 2.79 65739 0.184AAC 96000 0.023 2208 5 0.04 2.97 98783 0.115AAC 128000 0.023 2944 4 0.03 2.79 131478 0.092AAC 320000 0.023 7360 1 0.05 4.57 333913 0.023

79

FLEXMUXPack as many Audio AU (EAF) per RTP packet, but not to exceed FLEXmux or MEAD limit

40RTP header length, bytes256FLEXMUX maximum bytes per RTP packet




Coded Audio Duration per RTP pkt

HVXC 2000 0.020 40 50 0.20 16.40 2320 1.000HVXC 4000 0.020 80 25 0.20 16.40 4640 0.500NBCELP 3850 0.040 154 13 0.20 16.38 4465 0.520NBCELP 6000 0.020 120 17 0.20 16.08 6941 0.340NBCELP 12000 0.010 120 17 0.20 16.08 13882 0.170WBCELP 16000 0.010 160 12 0.21 17.08 18667 0.120WBCELP 24000 0.015 360 5 0.22 18.22 28267 0.075AAC 32000 0.023 736 2 0.27 22.83 38957 0.046AAC 48000 0.023 1104 1 0.36 30.43 61913 0.023AAC 64000 0.023 1472 1 0.27 22.83 77913 0.023AAC 96000 0.023 2208 0 #DIV/0! #DIV/0! #DIV/0! 0.000AAC 128000 0.023 2944 0 #DIV/0! #DIV/0! #DIV/0! 0.000AAC 320000 0.023 7360 0 #DIV/0! #DIV/0! #DIV/0! 0.000

80

Annex 9SNHC report

Author: Euee S. Jang, Chair of SNHC subgroup

SNHC Meeting SummarySNHC objectives were: to check the conformance status of Version 2 tools (i.e., FBA and 3DMC), to discuss the integration issue of 3DMC in Systems, to discuss and evaluate the CFP responses to the generic animation framework, to clarify if there is any overlap between MPEG-4 SNHC tools and MPEG-7 Video, and to review the FAQ of SNHC.

SNHC Objectives & Work ItemsAn outline of more detailed meeting objectives and work is given below:MPEG-4 Version 2A. 3D Model Coding

1. Integration issue in Systems2. Conformance

Reference S/W (with maintenance)B. Face and Body Animation

1. Integration to IM-12. Part 5 Reference Software

MPEG-4 Graphics ProfilesMPEG-4 Version 5A. Animation Framework eXtension

1.Review of pre-registrations2.Draft of study document on the animation framework

MPEG-71. Any link between SNHC and MPEG-7?

SNHC Contributions & Related Review

No. Group TitleSection Source

6397MPEG-4 Overview of responses to the generic animation framework CFP (N1714)SNHC Euee S. Jang

6509MPEG-4 Report of FBA Conformance adhoc reportSNHC Eric Petajan, Tolga Capin.

6510MPEG-4 Inclusion of 3DMC and FBA compression tools in Graphics ProfilesSNHC Eric Petajan, Mahnjin Han

6511MPEG-7 MPEG-7 Issues Regarding MPEG-4 Synthetic ObjectsSNHC Eric Petajan, Zon-Yin Shae, Ajay Divakaran, Tsuhan Chen

6563MPEG-4 Proposal for addition of 3DMC related issues in ISO/IEC 14496-1:2000/COR1

Systems/SNHCMahnjin Han, Sungjin Kim, Do Kyoon Kim, Sang O. Woo, Euee S. Jang6564MPEG-4 Addition of 3DMC to Version 3 Complete Graphics Profile

Requirements Mahnjin Han, Sungjin Kim, Do Kyoon Kim, Euee S. Jang6566MPEG-4 Report of the AHG on 3DMC Conformance

81

SNHC Mahnjin Han, Jean-Claude Dufourd6652MPEG-4 AHG report of the generic animation framework

SNHC Euee S. Jang, Michael Bourges-Sevenier6656MPEG-4 Liaison Statement from Web3D Consortium to WG 11 on Proposal for Core

Scene Graph Profile (SC 29 N 3879)Liaison Web3D Consortium

Output Document EditorsDocument EditorMinutes of the Meeting James KimV2 3DMC Conformance Mahnjin HanDraft of Study of the generic animation framework

Mikael Bourges-Sevenier

FAQ update Eric Petajan, Aaron E. Walsh, Michael SteliarosMPEG-4 AFX VM/WD editorial committee

Mikael Bourges-Sevenier, Aaron E. Walsh, Michael Steliaros, Ilse Ravyse, Mahnjin Han

MPEG-4 AFX Requirements Mikael Bourges-Sevenier, Mahnjin HanMPEG-4 AFX S/W implementation workplan

Aaron E. Walsh, Mikael Bourges-Sevenier, Michael Steliaros, James D. Kim, Chris Wendt

Text for “SuperComplete” graphics profile

Mahnjin Han, Aaron E. Walsh

SNHC & Joint MeetingsSNHC group had the following work schedule along with joint meetings with other groups:

Joint in Monday Tuesday Wednesday Thursday FridayWG11 9:00am-2:00pm

WG11 Plenary9-11:30am

WG11 Plenary

2-10:00pm WG11

PlenarySNHC 3-7pm SNHC

Plenary – Roll Call, Approval

of agenda, SNHC

deliverables, Workplan,

3DMC conformance

9am–5pm SNHC Plenary – MPEG-

4 Demo & Applications,

Version 5 AFX, FBA

Conformance, Graphics profiles, MPEG-7 SNHC

11:30 – 5pm SNHC Plenary – MPEG-7 SNHC, E-mail reflectors, Version 5 Issues

9-10:30am SNHC

Plenary – AFX

requirements1-3pm SNHC Breakout – AFX VM

editing3-5pm SNHC

Plenary – Status of

deliverables

9-12 SNHC- Plenary approval

Systems 7-8pm SNHC & Systems & Req –graphics profiles

+3DMC

8-9am SNHC & Systems & Req –graphics profiles3-4pm SNHC & Systems –3DMC

2:30-3pm SNHC &

Systems –IM-1

Requirements 10:30-11am SNHC & Req –AFX

requirements

82

Joint in Monday Tuesday Wednesday Thursday Friday2-2:30pm SNHC &

Req –Graphics profiles

MMDS 11-12am SNHC & MMDS & Video –MPEG-7 SNHC

Works & Results

Version 2 – FBA ConformanceAll the conformant bit streams are delivered and finalized. The integration of FBA tools to IM-1 is still found not to be complete: a slow decoding problem. The IM-1 implementation will continue till January with the new work plan (N3716)

Version 2 – 3DMC ConformanceThe implementation of 3DMC in Player3D of IM-1 continues till January 2001. Some problems in implementing 3DMC within BIFS are identified in the contribution of M6563. As an outcome of the discussion with Systems, both the informative and normative descriptions on the USge of 3DMC have been incorporated into Systems DCOR1 (N3714).

Version X – Graphics profiles with SNHC toolsThere were two contributions proposing Graphics profiles with SNHC tools (M6510, M6564). Several joint meetings with Systems and Requirements groups were held for further discussions on how to define Graphics profiles. The following items are identified through the discussion: For the Graphics-related profiles, the definition of level is very weak. There was an input

contribution from Web3D Consortium (M6656). Agreement reached to define the levels on Graphics profiles based on the Web3D contribution. Yet, further thoughts should be given for the finer definition of levels in the future.

Regarding the requests to design Graphics profiles (possibly) in Version 3 (M6510, M6564), a decision is taken not to pursue immediate definition of new profiles. It is to give more thoughts on the definition of new profiles as well as to draw more industrial attention before designing new profiles.

In MPEG-4, there are some Graphics tools specified both in Systems and in Visual specifications. For stand-alone tools, it has been considered mainly in Visual specification. But for the future standard development in MPEG-4, it was identified that it would be better to treat in Systems specification where Graphics profiles are designed. And the decision is reflected in the Requirements Group resolutions (N3615).

Version 5 – Animation Framework eXtension (AFX)Discussion on the animation framework continued in the meeting with 5 responses made by September 15, 2000. The evaluation meeting for the responses to CFP was held on October 22, 2000. Review of the evaluation meeting will be found in M6652.AFX Requirements: There was in-depth discussion on the AFX requirements during the week. The final version of the summarized requirements has been reflected to the Requirements document (N3746). Test data collection: the SNHC group felt that more test data will be necessary for the on-going development of the AFX standard. The participating companies agreed to cooperate to collect the common test materials.

83

AFX S/W implementation: There were some companies who tried to provide integrated S/W for the SNHC tools in MPEG-4. This notion is inherited to the development of AFX standards. We have identified some companies (blaxxun, Mantis Corp., iVast, Samsung, Superscape, Avipix) who will develop the S/W platform for AFX standard. An AHG was established to manage the S/W development (N3698).AFX development plan: It was planned to start with VM (N3699). The AFX standard will be developed with the following schedule:Item Schedule Meeting StatusCall for Proposals (N3341) October - COMPLETEPre-registration 1 July 2000 No COMPLETEJoint meeting with Web3D 28 July 2000 Yes (New Orleans, US) COMPLETEFinal Proposal 15 September 2000 No COMPLETEEvaluation meeting 22 October 2000 Yes (La Baule, FR) COMPLETEMPEG-4 AFX WD March 2001 SCHEDULEDMPEG-4 AFX Committee Draft

October 2001 SCHEDULED

MPEG-4 AFX Final CD March 2002 SCHEDULEDMPEG-4 AFX FDIS July 2002 SCHEDULEDCore experiments: The AFX standard will be developed based on the guidelines specified in N2200. The following core experiments will be designed and performed till January 2001:A1: Interpolator compression (Samsung)A2: Subdivision Surfaces (Superscape)A3: Animation path representation (iVast)A4: Multitexturing (iVast, Superscape)The group acknowledged a need of coordination between Web3D and MPEG. As a positive sign of collaboration between MPEG and Web3D, a joint meeting is planned during the period of Web3D Conference in 2001.

MPEG-7 SNHCThere was an input contribution about SNHC tools in MPEG-4 that are relevant to MPEG-7 Visual (M6511). A joint meeting with MMDS and Video groups was helpful to understand the nature of SNHC tools in MPEG-7. In order to have a better look at the issue, further contributions from the proponents are expected at January. Name scope collision was also identified as another issue between MPEG-4 and MPEG-7. This problem will be studied in the continuing AHG activity (N3638).

SNHC E-mail reflectorsThere was a short discussion on the e-mail reflector for on-going activities. Some reflectors seemed to have problems in subscribing new members. Everyone agreed that new e-mail reflectors can be established whenever needed. For the time being, the current reflectors will be in use unless they are troublesome to use.

SNHC FAQ updateFAQ of SNHC was reviewed by SNHC members and got fixed with 3 new Q&As. It was decided not to officially update the FAQ this time due to the marginal changes to the FAQ. Dr. Eric Petajan is currently in charge of maintaining the FAQ draft

Output Documents from La BauleRefer to Clause 7.

Ad Hoc Groups for JanuaryRefer to Clause 7.

84

La Baule ParticipantsMany thanks to the following individuals who participated in SNHC meetings in La Baule:

Name Company Country

E-mail

Aaron E. Walsh Mantis Corp. US [email protected] Cotarmanach FR Telecom FR [email protected] Wendt Avipix US [email protected] Mozelle Thomson Multimedia FR [email protected] Grahn blaxxun interactive DE [email protected] Ravyse Vrije Universiteit Brussel

(VUB)BE [email protected]

James D. Kim Samsung AIT KR [email protected] Petajan face2face animation US [email protected] S. Jang Samsung AIT KR [email protected] Moran Univ. Politecnica Madrid ES [email protected] Jin Han Samsung AIT KR [email protected] Preda INT FR [email protected] Steliaros Superscape (UK) Ltd. UK [email protected] Bourges-Sevenier

iVast Inc. US [email protected]

Olivier AubanPL FR Telecom FR olivier [email protected] Patrick Gioia FR Telecom FR p atrick [email protected] Philippe Robert Thomson Multimedia FR [email protected] W. Woo Samsung AIT KR [email protected] Ho K-JIST KR [email protected] Fisher Envivio US [email protected]

85














Annex 10Test group report

Source: Mark Buxton, Chair

SummaryObjectives for the 54th meeting of WG11, in La Baule, FR, were the definition of content, methodology, and issuance of two Calls for Proposal; one for new video coding technology for MPEG-4 and one for Digital Cinema. Initial work was to be done to define verification tests for MPEG-4 Version 4 (Studio Profile) and MPEG-4 Version 5 (FGS). These objectives were satsified but the Digital Cinema Call for Proposals (CfP) was postponed to continue definition of content and test methodology. Test issues related to the MPEG-4 Video CfP were discussed and the CfP was issued (from Video). Initial work commenced on the FGS and Studio Profile verification tests.

Agenda1. MPEG-4 Version 2

a. Video CfPi. Review of AHG work

ii. Review of NB / Liaison Contributioniii. Review of input documentsiv. Finalization of test contentv. Test methodology

a. Digital Cinema CfPi. Review of AHG Work

ii. Review of NB / Liaison Contributioniii. Review of input documentsiv. Test Contentv. Test methodology

2. MPEG-4 Version 4a. Verification test planning

3. MPEG-4 Version 5 (FGS)a. Verification test planning

Contribution ReviewContributions from the USNB concerning evaluation procedures for both DCinema and Video were considered and answered. Significantly, the decision was made to use short sequences for sequential evaluation, and longer sequences for side-by-side evaluation.

Detailed Work Items

MPEG-4 Version 2 Video CfPFacilities volunteered by Intel were accepted for the subjective testing scheduled Feb 26-28, 2001. Test content was selected to conduct meaningful tests based on anticipated registrations and test time available. The many levels from the preliminary call-for-proposals were reduced to two: Low Bitrate (QCIF) and Medium Bitrate (CIF).

The test process was refined and summarized in N3671. The process follows ITU-R BT500-10, which has been used in previous tests, with some major exceptions. First, due to the progressive

86

content selected for the trials, progressive monitors were selected for viewing. Second, a side-by-side technique for evaluation is considered in addition to or in replacement to the double-stimulus sequential technique. This approach may be refined based on additional input from test experts in the AHG. Third, viewing distances have been modified to include much closer viewing than traditional techniques. The test hardware configuration is likely to be similar to that used for informal FGS evaluation: a video server connected to a progressive monitor.

MPEG-4 Version 2 Digital Cinema CfPThe work of the AHG was reviewed. Several organizations signed the call for test material response, including Sony, Technicolor, and Paramount. The AHG previewed Sony test material on VHS (the Technicolor content was previewed on VHS in Beijing) but was unable to view other test material or view material at native resolution.

NTT volunteered future work to produce (shoot, digitize) content for use by MPEG. They would pay for the initial costs of production, and the original content would be available for rescanning. Some of the attributes of the content include:

10 clips, 10s – 60s each 35mm film stock 6500K white 4096x3112 resolution (10 bit linear)

The work has not been completed but NTT estimates a completion date of the end of March.

Extensive discussion isolated a few test content attributes of high importance for the first round of tests. These are summarized in N3661.

The test process was refined, specifically the length of most sequences was constrained to <10 s. The intent was to use using traditional sequential test methods, as these are felt superior to side-by-side or split-screen viewing for certain artifacts. Split screen viewing was considered but only for longer sequences (>30 seconds). The test and evaluation process is summarized in N3662.

Test facilities for the subjective tests were proposed at the University of Southern California (USC) Entertainment Technology Center (ETC) Hollywood Pacific theatre facilities. There is substantial uncertainty about the facilities, including screen type, ability to fit multiple projectors or accommodate scaffolding for correct projector placement, air-conditioning, etc. These issues will be resolved in a future AHG.

Projection systems discussed include a TI-based DLP projector and a Sony CRT-based projector. There is substantial uncertainty about the DLP projector’s suitability for the tests due to its low native resolution, uncertain (digital or analog) interface, and internal signal processing. The consensus is that multiple projection systems should be considered for the test, but again a future AHG must determine the specifications and configurability of the projection systems.

Due to lack of much technical information and general consensus that the content and submissions would not be ready in time to meet the February schedule, the subjective trials were pushed back to June.

MPEG-4 Version 4 Studio ProfileInitial work was begun to define the schedule for Studio verification tests. A preliminary template document was prepared for continuing work in the Studio AHG. A final schedule and verification plan will be available at the 55th meeting.

MPEG-4 Version 5 FGS87

Initial work was begun to define the schedule for Studio verification tests. A preliminary template document was prepared for continuing work in the Studio AHG. A final schedule and verification plan will be available at the 55th meeting.

List of output documentsTitle NumberPreliminary Digital Cinema Call for Proposals N3661Digital Cinema Evaluation Procedures N3662

Ad hoc groupsAd hoc group Chair(s) Number Mtg

AHG on Digital Cinema Don Mead (DECI), Frank Bossen (SONY) N3663 yes

88

Annex 11ISG report

Source: ISG ChairEditor: Marco Mattavelli (EPFL)

OverviewThe main topic of the Implementation Subgroup in La Baule is:

1. MPEG-7 XM development for video/audio descriptors and Descriptor Schemes and related promotional activities,

2. The answers to US NB comments about complexity of video tools in the simple profile

3. The promotion of a new activity: Reference hardware description for MPEG-4

Input contributions w.r.t. the above items are summarized according to the following table:

MPEG-7 XM developmentM6547 Report of AHG on XM Development. Stephan HerrmannM6587 “Report of Ad Hoc Group on identifying key

applications of MPEG-7 normative Ds and DSs to be included in the XM as non normative examples.

Marco Mattavelli

M6540 “Guidelines/Documentation for Fast Audio Moving Storyboard XM software (SequentialSummaryDS)”

Dulce Ponceleon, Jan Pieper, Gilad Cohen

M6541 “Guidelines for Textual Summaries (Sequential Summary XM software)”

Dulce Ponceleon, Jan Pieper, Savitha Srinivasan

Complexity of video tools

M6411 “USNB Contribution: Advanced Simple Profile Issues”

A. G. Tescher for USNB

Detailed Report

MPEG-7 XM developmentSeveral joint meetings have been taken place during the week between the ISG team involved in the XM development and the audio, video and MDS groups. Discussions have started with the MDS group with the review of the current status of the integration of the XM. The main outcomes of the discussions can be summarized as follows:

Joint Meeting ISG-MDS

It was agreed that comments on the DS normative software are necessary for the understanding of the normative part of DSs. Templates for providing all relevant information have been provided by a contribution, it was agreed that DS authors should prepare a comment according to an appropriate template.

89

Status of new DS submissions promotion from WD to CD and consequently to XM has been clarified. Some packages are not yet integrated for lack of time between submission and start of the meeting, some are not yet updated on on the CVS server. More involvement from the MDS group is required by ISG to help the work to prepare the XM for CD.Some common problems of submitted code have been explained to MDS group:1) The structure of the input database and annotated files must be generalized. ISG has provided a general solution2) Input format must be a common one Specified interfaces are not used!3) Several DS defines new classes besides the ones used by the XM and this should be avoided if possible.A new schedule is defined for 4 new submissions + one update.Next version for the final revision of authors will be released by two weeks after the meeting: Authors will be invited to revise their code according to the comments included by Stephan Herrmann in each respective code.

Documentation of DS software

Guidelines document is still incomplete (figures are missing, DS specific part are missing) and has been improved during the meeting, example code are now available.DS documentation for the XM Template for the comment to DS code.ISG will present a document describing how to document all submitted DS to be approved by MDS.A template table will be provided to guide people to fill information about DS software. A Perl script will be developed to build a HTML document that will contain all documentation information, a script need to be done to make an easy update of the documentation.Template table, and example ready for Friday, output document with two weeks editing time, then it will be submitted on the reflector to be filled by code submitter.

Joint Meeting ISG-Audio

Contribution M6434 describes the “spoken content” activity in the last 3-4 months. Spoken content code has been partitioned into normative and non-normative sections according to the XM structure. These modules are not yet integrated because of lack of time from the submission and the start of the meeting. The problem of how to integrate the complex code constituting the extraction component of the DS was discussed. Audio group does believe that a C/C++ conversion of current extraction methods would be too heavy. Therefore, the proposed solution is to provide to the XM pre-computed XML descriptions and generate new ones using XSL. Extraction tools will be available in MatLab format. A new schedule has been drafted for audio descriptors and DS, 7 new Ds and 6 DSs will be integrated in the XM.

Meeting outcomes about XM development

In conclusion main achievements of the meeting concerning the XM development are: The update of Work schedules for the XM integration (video tools, audio tools and DS) The update of the status of the XML parsers and their extensions The start of the activity aiming at providing a complete documentation of the XM

software, The generation of a template table for the documentation of all Ds and DS to be filled by

all proposers

90

The definition of the functionality of a Perl script that can generate automatically an HTML document well organized and containing hyperlinks and cross references for the XM.

The new version of the XM guidelines document for the integration with improvement and updates of the various APIs

Complexity of video tools

A short discussion was held about the complexity issues raised in the document M6411 “USNB Contribution: Advanced Simple Profile Issues” A. G. Tescher for USNB. The conclusion was that the concerns have already been discussed and results are already available in previous resolutions and contributions from Stockholm and Fribourg meetings.

Reference hardware description for MPEG-4

A proposition to provide a VHDL description of normative and non-normative parts of MPEG-4 has been presented to the ISG group. The comment of the group was unanimously favorable for the promotion and support of this new activity. The group agreed that a more formal proposition should be defined discussed and possibly approved during next meeting. A condition that seems necessary to the success of the activity is that VHDL should be standard portable VHDL. The benefits of this activity will help time to market considerations for companies trying to deploy MPEG-4 systems with some hardware components. The current and future complexity of real time applications of MPEG systems may require a hardware implementation to keep cost and power manageable. ISG expects there will be benefits especially in the multimedia mobile market. The ISG group invites universities, companies, and consortiums to contribute towards the effort. ISG will try to follow the same rules and guidelines as the MPEG-4 C reference software as far as availability and USge of the VHDL reference code is concerned as a minimum baseline, but it will try to enlarge the availability and possibility of use of such VHDL reference code.

ResolutionsThe above activities have led to the following resolutions.

To approve the following document:Schedule for the software integration of XM for visual, audio, MDS tools and DDL parsers.

N3657

XM integration guidelines document N3658Guidelines for documenting XM Ds and DSs software components N3659Text of ISO/IEC CD 15938-6 Information Technology -Multimedia Content Description Interface- Part 6: Reference Software (Version 1.0)

N3706

To make publicly available the following documents:Text of ISO/IEC CD 15938-6 Information Technology -Multimedia Content Description Interface- Part 6: Reference Software (Version 1.0)

N3706

To establish the following ad-hoc group:Title Chair(s) No. MtgAHG on MPEG-7 XM Development Stephan Herrmann,

Toby WalkerMichael Casey

N3660 N

91

To welcome the proposition of promoting and providing standard, portable synthesizable/simulatable VHDL descriptions of MPEG-4 tools, to consider this issue as work item for the future ISG activities and possibly promote the development of a new informative part called “MPEG-4 reference hardware description”.

92

Annex 12Liaison report

Source: Barry Haskell

The Liaison Group considered the following LaBaule input documents

MPEG # Replyneeded?

Title

1 m6394 yes Liaison statement from DVD Forum on MPEG-2 amendment for video supplemental information

2 M6633 yes Incoming Liaison from SMPTE – metadata on MPEG-2

3 M6438 yes Liaison Statement from ITU-R WP 6P on MPEG Studies of Digital Cinema (SC 29 N 3845)

4 M6439 yes Liaison Statement from 3GPP TSG-SA WG4 on MPEG-4 Conformance Points (SC 29 N 3846)

5 M6620 Liaison from ISO/IEC JTC1/SC24 to MPEG

6 M6656 yes Liaison Statement from Web3D Consortium to WG 11 on Proposal for Core Scene Graph Profile (SC 29 N 3879)

7 M6409 USNB Contribution: Suggested liaison with ITU-T SG16

8 M6650 yes Liaison Statement from ITU-T Advanced Video Coding Experts Group

9 M6501 Report of Liaison between MPEG-7 and XML Schema

10 M6502 Report of Liaison between MPEG and Dublin Core (DCMI)

10A

Input on TV-Anytime Matters

11 DCMI email

12 IFPI email requesting liaison

13 SCHEMAS email

14 XBRL email

15 M6470 Liaison Statement from ITU-R WP 6M to SC 29/WG 11 on Collaboration with WG 11 (SC 29 N 3857)

16 M6460 IEC CD 61883-6: Consumer audio/video equipment – Digital interface – Part 6: Audio and music data transmission protocol (SC 29 N 3856)

List of Organizations with which Liaisons Exist

Organization Responsible IndividualAES Karlheinz BrandenburgAGICOA Didier MaryATSC Regis CrinonCEN Francoise PreteuxCIDF Keith HillCISAC Dominique Yon

93

DCMI Jane HunterDIG Kats IshiiIEC TC100 Kate GrantIETFIFPI Paul JessopINTELSAT Surendra SatijaISO / TC 46 / SC 9 Albert Simmonds and Keith HillITU-T SG16 Q11 Yoshihiro KikuchiITU-T SG16 Q15 Gary SullivanITU-R WP10C Karlheinz BrandenburgSMPTE Mike Vetter and Stephen LongW3C Jane Hunter and Frank NackWeb3D (VRML) Julien Signès

94

INTERNATIONAL ORGANISATION FOR STANDARDISATION · Web viewm6439 3GPP TSG-SA WG4 - liaison on MPEG-4...

Documents

Transcript of INTERNATIONAL ORGANISATION FOR STANDARDISATION · Web viewm6439 3GPP TSG-SA WG4 - liaison on MPEG-4...