Presentation of Mediamap @Ebu Production Technology Seminar

© MediãMāp - All rights reserved

MediaMap

A Prototype System for Online Collaborative Production

MediaMap

A Prototype System for Online Collaborative Production

1

2010/02/03, Geneva - EBU Production Technology Seminar


2


?


© Memnon Archiving Services 2009

Side-Effects– Difficult to exchange, to manage and to access media

o Often stored as unstructured data or in proprietary systemso Different aspects of a single item are often managed by different systems

– Manual annotation is expensive and yet not scalable(!)– Content dispersion

o Excessive Numbers of Copies and File Transferso Various formats - Transcoding bottleneck

– Cumbersome supply chain integrationo Newsfeedso Field Production (EFP, Outside Broadcast,...)o Co-production

4


5

Mediamap is a Eureka Celtic project financed by the DGE (France) - IWT & IRSIB (Belgium)Q4 2008 – Q2 2011

Total effort: 59 man years

http://www.mediamapproject.org



Challenges – From re-use to real-time co-production Production applications - deliver content in stead of bare essence

– Production tools must preserve available metadata;– Value-added services inject high-level metadata;

Metadata - From plain text to machine-readable descriptions– Each format or genre requires a full-featured ontology (e.g. IPTC/NewsML-G2)

Workflow - From “disclosure by annotation” to “information integration”– trace the item throughout its lifecycle, i.e. the script, raw footage and edited clips;– Semantic technology (RDF, SPaRQL) - express, store and query the relationships

A virtual media asset management system implements a collaborative production environment and reduces content dispersion to a minimum.

6



7

Collaborative ModelDigital Silos Corporate Systems

Infrastructure

Application Platform

Access via Internet

Corporate Network

CentralMedia Asset Mgnt

Media Asset Management systems enable re-use and collaboration. Custom development is expensive and results in moderate stability.

A user-friendly online platform will enable real-time co-production.

Independant developers will create reusable apps, thus resulting in increased stability and lower cost

Digitisation has enabled increased functionality



8


The State of the Art...The State of the Art...


SMEF: Broadcast Metadata Exchange Format

www.prestospace.org

BBC - Standard Media Exchange Framework (SMEFTM)

http://www.prestospace.org/


Media Object

Product Engineering

Manufacturing Engineering

Classification

1*

1

1..*

1

*

1

*

1

*

1

*

*1

1

1..*

1

1**

1* *

1

*

1

*

*1

*1

1*

1*

1 1

*

1

*

1

*1*

1

*

1

is an instance ofrepresents

*

1 1

*

«Business Object»Edi torialObject

«Media Asset»MediaObject

Editorial Ontology«Classification»Inte llectualProperty

Camera

EditorialMasterSubObjects

MediaObjectGroup

Distribution

Edi torialObjectIns tance

MediaTypeContainerType CodingSchema

Application

EditorialObjectType

Episode «script»Scene

MediaObjectInstance

Series

ImplementedBy

ManufacturedMaster

«media asset»Composition

AudioTrackMicrophone

Setting

Cast

Contribution

StageProperty

propsAssociation

ManufacturingObjectSubobjec ts

ProductGroup Product

«media asset»Shot

«Media Asset»Master«media asset»

Newsfeed

«media asset»SemiFinished Component

«media asset»Finished Product

Trailer

VideoTrack

«Media Asset»Undefined

IngestMaterial Consignment

ManufacturingObjectType

ComposedBy

EditorialContribution

RoleType

Character

PerformerPerformerAssocia tion

StagePropertyType

«script»NewsReport

«media asset»Rushes

PhonogrammeAlbum

Author

Artist

«media asset»SoundRecording

Rev iew

InstrumentInstrumentAssociation

Production 1.1

- M a te ria lNum be r[1 ]

- M a te ria lDe s c rip tion[1 ]

- M a te ria lTy pe [1 ]

- M a te ria lTy pe De s c ription[1 ]

- Proc ure m e ntTy pe [1 ]

- Produc tionTy pe [1 ]

- Produc tionOrde r[1 ]

- Is rc [1 ]

- V-ISAN[1 ]

- Produc tDi v is ion [1 ]

- Produc tHi e ra rc h y [1 ]

- Produc tionSe rie s [1 ]

- Se qu e nc e Nu mb e r[1 ]

- Liv e Indic a to r[1 ]

- Prov e na nc e [1 ]

- Supp lie r[1 ]

- Produc tionDe pa rtm e nt[1 ]

- Produc tionM a na ge r[1 ]

- Produc e r[1 ]

- Di re c tor[1 ]

- As s is ta nt[1 ]

- Pre s e ntor[1 ]

- Ca pturin gLoc a ti on[1 ]

- Ca pture Da te [1 ]

- Chie fPro duc tion [1 ]

- Edi to r[1 ]

- As s e mb ly W ork Ce n tre [1 ]

- As s e mb ly Da te [1 ]

- Soun dEngine e r[1 ]

- Re le a s e dBy [1 ]

- Re le a s e Da te [1 ]

- c hi ld Pe rfI d*[1 ]

- pa re ntPe rfId*[1 ]

- As s o c ia ti onTy p e [1 ]

- Id [1 ]

- Code [1 ] : P/M ET A

- Na m e [1 ]

- De s c ription[1 ]

- Na m e [1 ]

- Sourc e [1 ]

- De s c ription[1 ] : Te x t

- Ty pe [1 ]

- Is rc [1 ]

- Loc a tion[1 ]

- Sta rtDa te [1 ]

- EndDa te [1 ]

- Digita lFla g[1 ]

- Liv e Fla g[1 ]

- Edi to ria lObje c tId*[1 ]

- Contribu ti on*[1 ]


- Contribu ti on*[1 ]

- Stre n gth [1 ]

- Fe a turin g[1 ]

- Loc a tion[1 ]

- Time [1 ]

- Sc ore [1 ]

- Tra ns s c ri pt[1 ]

- La ng ua ge [1 ] : ISO 6 3 9 -2

- Origina l La ng ua ge [1 ] : ISO 6 3

- Appe a ri ng[1 ]

- Ca pture Ti me s ta mp [1 ]

- In ge s tTime s ta m p[1 ]

- Re po rte r[1 ]

- Re po rte r[1 ]

- Loc a tion[1 ]

- Time [1 ]

- Abs tra c t[1 ] : Te x t

- Sc rip t[1 ]

- Appe a ri ng[1 ]

- Id [1 ]

- Na m e [1 ]


- c hi ld Pe rfI d*[1 ]

- pa re ntPe rfId*[1 ]

- As s o c ia ti onTy p e [1 ]

- Id [1 ]

- Na m e [1 ]


- Id [1 ]

- Na m e [1 ]


- Id [1 ]

- Code *[1 ] : P/M ETA 9 .1 .3 1

- Na m e [1 ]



- Contribu ti no*[1 ]


- M a nufa c turingObje c tI d*[1 ]

- Code *[1 ]


- Ty pe [1 ]

- Anno ta tion[1 ]

- Ty pe [1 ]

- Anno ta tion[1 ]

- Ty pe [1 ]

- Edi tDe c is ion Lis t[1 ]

- Anno ta tion[1 ]

- Ty pe [1 ]

- Anno ta tion[1 ] - Ty pe [1 ]

- Anno ta tion[1 ] - Ty pe [1 ]

- La ng ua ge [1 ] : ISO 6 3 9 -2

- Na m e [1 ]

- Ti tle [1 ] : Te x t


- La ng ua ge [1 ] : ISO 6 3 9 -2

- Na m e [1 ] : Nu mb e r

- Ti tle [1 ] : Te x t


- c hi ld Obje c tId*[1 ]

- pa re ntObj e c tId*[1 ]

- c hi ld Pro pId*[1 ]

- is Pa rtOfPropId*[1 ]

- id *[1 ]

- The s a urus [1 ]

- Ty pe [1 ]

- Na m e [1 ]



- Contribu ti on*[1 ] - id *[1 ]

- The s a urus [1 ]

- Role Ty p e [1 ]

- Cha ra c te r[1 ]

- Pe rfo rm e r[1 ]

- In s trum e nt[1 ]


- Sta ge Prope rty *[1 ]

- Ty pe [1 ]

- M ic M ov e me nt[1 ]

- M ic T y pe [1 ]

- Anno ta tion[1 ]

- Fina lPhra s e [1 ]

- Appe a ri ng[1 ]


- Fi rs tPhra s e [1 ]

- Re po rte r[1 ]

- Ty pe [1 ]


- Anno ta tion[1 ]

- Ty p e *[1 ]

- Gro u p Nu m b e r*[1 ]

- Nu m b e r*[1 ]

- Pa rtNu m b e r*[1 ]

- Co m p o n e n tNu m b e r*[1 ]

- Ve rs i o n *[1 ]

- Na m e [1 ]

- Su b j e c t Re fe re n c e [1 ]

- De s c ri p t io n [1 ]

- M a te ri a l Sta tu s [1 ]

- Ri g h ts Sta tu s [1 ]

- Du ra t io n [1 ]

- An n o ta t i o n [1 ]


- M a nufa c turingObje c tI d*[1 ]

- La ng ua ge [1 ] : ISO 6 3 9 -2

- Origina l La ng ua ge [1 ] : ISO 6 3 9 -2

- La ng ua ge [1 ] : ISO 6 3 9 -2

- Na m e [1 ] : Sh ort te x t

- Epis ode Count[1 ] : Num be r

- Ti tle [1 ] : Sho rt te x t

- Num be r[1 ] : Sho rt te x t

- Loc a tionTy p e [1 ] : Sho rt te x t

- Loc a tion[1 ] : Sh ort te x t

- PointInT im e [1 ] : Sh ort te x t

- Sy no ps is [1 ] : Te x t

- Sc rip t[*] : Te x t a rra y [2 ]

- Role s [1 ] : Te x t

- Code *[1 ]

- Na m e [1 ]


- Ontology Te m pla te [1 ]

- Dura tion Dim e ns ion [1 ]

- Pa re ntId *[1 ]

- Chi ld Id*[1 ]

- Id *[1 ]

- M e d i a Ob j e c t [1 ] : UM ID

- F i le F o rm a t [1 ]

- Co d i n g S c h e m a [ 1 ]

- Pro x y [1 ] : Bo o le a n

- Sc h e m a [1 ]

- Au th o rit y [ 1 ]

- Pa th [1 ]

- Qu e ry [1 ]

- Fra g m e n t [1 ]

- Id *[1 ]

- Um id [1 ]

- Na m e [1 ]


- It e m Id [1 ]

- M e d i a Ty p e [1 ]

- Co d i n g S ta n d a rd [1 ]

- Co n ta i n e rTy p e [1 ]

- Ta k e Nu m b e r[1 ]

- Go o d Sh o t In d ic a to r[1 ]

- Ri g h ts In d ic a to r[ 1 ]

- Cre a te d Da te [1 ]

- Cre a te d Ti m e [1 ]

- Pro v e n a n c e [1 ]

- Sta rtT i m e M a rk [1 ]

- En d T im e M a rk [1 ]

- Du ra t io n [1 ]

- Ed i tRa te [1 ]


- Id *[1 ]

- M e d i a Ob j e c tTy p e [1 ]

- M e d i a Ty p e [1 ]

- Um id [1 ] : UM ID

- Na m e [1 ]


- M e d i a Ob j e c tGro u p [1 ]

- Cre a t io n Da te Tim e [1 ]

- Cre a t io n L o c a t io n [1 ]

- Sta rtOf fs e t[1 ]

- En d Offs e t [1 ]

- Ed i tRa te [1 ]

- Id *[1 ]

- Ed i to ri a l M a s te rI d [1 ]

- M e d i a Ty p e [1 ]

- Co d i n g S ta n d a rd [1 ]

- Co n ta i n e rTy p e [1 ]

- Sc h e m a [1 ]

- Au th o rit y [ 1 ]

- Pa th [1 ]

- Qu e ry [1 ]

- Fra g m e n t [1 ]

- Ty p e *[1 ]

- Gro u p Nu m b e r*[1 ]

- Nu m b e r*[1 ]

- Pa rtNu m b e r*[1 ]

- Ve rs i o n *[1 ]

- Na m e [1 ]

- T i tl e [1 ]

- Al te rn a t i v e Ti tl e [ 1 ]

- Au th o r[1 ]

- Cre a t io n Da te [1 ]

- Cre a t io n Da te Ac c u ra c y [1 ]

- Su b j e c t [1 ]

- Ab s t ra c t [1 ]

- M a te ri a l Sta tu s [1 ]

- Ri g h ts In d ic a to r[ 1 ]


- Au d i e n c e In fo [1 ]

- Du ra t io n [1 ]

- Ty pe [1 ]

- Ca m e ra Ac tio n[1 ]

- Ca m e ra M ov e m e nt[1 ]

- Le ns [1 ]

- Anno ta tion[1 ]

- Na ture [1 ]

- Form a lOntology [1 ]

- Ta rge tAudie nc e Code [1 ]

- Ta rge tAudie nc e [1 ]

- Ca te gory Cod e [1 ]

- Ca te gory [1 ]

- Edi to ria lGe nre Code [1 ]

- Edi to ria lGe nre [1 ]

- Form a tCode [1 ]

- Form a t[1 ]

- In te n tionCod e [1 ]

- In te n tion[1 ]

- Tx Cy c le Code [1 ]

- Tx Cy c le [1 ]

- Copy rightOwne r[1 ]

- Rights Ty pe Code [1 ]

- Rights Ty pe [1 ]

- Rights De s c ription[1 ]

- Contra c t[1 ]

- Sta rtDa te [1 ]

- Sta rtTim e [1 ]

- EndDa te [1 ]

- Re s tric tions De s c riptio n[1 ]

- Dis tributionCha nne l[1 ]

- Cond itio nDe s c ri ption[1 ]

- EndT im e [1 ]

- Cond itio na lF la g [1 ]

- Te rri tory [1 ]

- Dis tributionCha nne lTy pe Co

- Re s tric tionTy pe [1 ]

- Re s tric tions Sta rtDa te [1 ]

- Re s tric tions Sta rtTim e [1 ]

- Re s tric tions End Da te [1 ]

- Re s tric tions End Tim e [1 ]

- Us a g e Re s tric tio nFla g[1 ]

- Ty pe [1 ]

- Subje c ts [1 ]

- GroupNu mbe r[1 ]

- Num be r[1 ]

- Pa rtNum be r[1 ]

- Ve rs ion[1 ]

- Author[1 ]

- M e dia Ty pe [1 ]

- CodingS ta nd a rd [1 ]

- Conta ine rTy pe [1 ]

- Uri[1 ]

- Progra m me Grou pTi tle [1 ]

- Origina l Progra m me Gro upTi tl e [1 ]

- Progra m me Grou pNa m e [1 ]

- Progra m me Grou pDe s c ription [1 ]

- La ng ua ge [1 ]

- Origina l La ng ua ge [1 ]

- Progra m me T itle [1 ]

- Origina l Progra m me Title [1 ]

- Progra m me Na m e [1 ]

- Epis ode Num be r[1 ]

- Progra m me De s c rip tion[1 ]

- Pa rtT itle [1 ]

- Pa rtDe s c ription[1 ]

- Pa rtL oc a tion Ty pe [1 ]

- Pa rtL oc a tion [1 ]

- Ca s t[1 ]

- Gue s ts [1 ]

- Dis tributionT y pe [1 ]

- Dis tributionCha nne l[1 ]

- Dis tributionS e rv ic e [1 ]

- Pla nne d Sta rtDa te [1 ]

- Pla nne d Sta rtTim e [1 ]

- Pla nne d Dura tion[1 ]

- Ac tua lSta rtDa te [1 ]

- Ac tua lSta rtTime [1 ]

- Ac tua lDura tion[1 ]

- Qua l i fic a tion Fla g[1 ]

- Qua l i fic a tion Code [1 ]

- Subti tle Fl a g[1 ]

- Subti tle Ty pe [1 ]

- Liv e Log oFla g[1 ]

- In te ra c tiv e Logo Fla g[1 ]

- As pe c tRa tio[1 ]

- Pic tu re De fini tion[1 ]

- AudioDe fi nition[1 ]

- Fi rs tSta rtDa te [1 ]

- Fi rs tSta rtTim e [1 ]

- Id [1 ]

- Code [1 ]

- Na m e *[1 ]


- Id *[1 ]

- Na m e [1 ]


- Id *[1 ]

- Pa re ntId [1 ]

- Na m e *[1 ]

- Spe c ific a tion[1 ]

- Bi tRa te [1 ]

- Va ria ble Bitra te [1 ] : Bool

- Conta ine rTy pe *[1 ]

- Conte ntTy pe *[1 ]

- CodingS ta nd a rd *[1 ]

- Na m e [1 ]

- Ex e c uta ble [1 ]

- De fa ul tP a th[1 ]


Clip

xxx.xml

/

Contents

yyy.xml

Video

xxx.mxf

yyy.mxf

Audio

xxx_0.mxf

xxx_1.mxf

Thumbnail

xxx.bmp

yyy.bmp

yyy_0.mxf

yyy_1.mxf

Voice

xxx_0.wav

Clip

xxx.xml

/

Contents

yyy.xml

Video

xxx.mxf

yyy.mxf

Audio

xxx_0.mxf

xxx_1.mxf

Thumbnail

xxx.bmp

yyy.bmp

yyy_0.mxf

yyy_1.mxf

Voice

xxx_0.wav

Clip xxx

Wrappers - MXF

A standard for the exchange of essences !!!


Production Process :

Acquisition & Indexation


Outstanding IssuesOutstanding Issues• Each broadcaster has a data model

– > There is no formal or de facto standard vocabulary• MXF is a wrapper for essence

– > There is no standardised syntax for metadata• Production Tools only produce essence

– > They don’t support the editorial context• MAM systems are designed to support archive processes

– > Production processes require a fundamentally different logic• Creative processes usually happen off-line

16



Mediamap – Beyond the State of the ArtMediamap – Beyond the State of the Art Research and Development

– The Unified Semantic Entity (USE) is a powerful wrapper of audiovisual content. It ensures preservation the semantic context;

– The Open Semantic Bus (OSB) extends of ISO/OAIS. It implements cross-system references to make information persistent.

Prototypes– Advanced Product Engineering methods;– Develop and integrate a smart camcorder;– Media Asset Mgnt services designed to support production processes.

Validation - Use Cases– “Birthday of the Expo 58 in Brussels”– Congo 60– Final Demo on Collaborative Production - TBD

17


18


19


Unified Semantic Entity (WIP)Unified Semantic Entity (WIP)

20

• Semantic overlay enables structuring and indexing of assets– Explicit, consistent and shared conceptual model– Non-intrusive asset annotation– Addresses interoperability issues through intrinsic mapping capabilities

• 100% Standards-based– RDF (Resource Description Framework)– OWL (Ontology Web Language)– SKOS (Simple Knowledge Organization System)


21

Open Semantic Bus (WIP)Open Semantic Bus (WIP)


Open Semantic Bus (WIP)Open Semantic Bus (WIP)

22

• Based on FP6 Memories ‘AXIS’– Acquisition, eXchange, Indexing and Search of Audiovisual Material– Based on ISO 14721:2003 (OAIS) reference model – RDF and OWL based definitions for data and semantics

• Mediamap extensions– NewsML-G2 translation– Integration with script editing, raw material acquisition and craft editing


Prototyping...Prototyping...

23


24

Script Supervisor

Production System

Script Editor

Story Editor

Director

Producer

Sy nopsis

Scene Descript ion

Y es Y es

Dialog Script

Sce

ne

De

scriptio

n

Sy nopsis

No

Dialog Script

No

Sce

ne

De

scriptio

n

Sce

ne

De

scriptio

n

Sce

ne

De

scriptio

n

StartProgramme

Development

Approve Synopsis

2.2.1 Check InSynopsis

2.2.2 Processsynopsis

ProductionDatabase

ApproveProgramme

Development

Approve Script

2.3.1 Check inScript

2.3.2 ProcessScript

2.2.0 SynopsisEditing

2.3.0 ScriptEditing

2.4.0Decoupage

2.5.0 StoryboardEditing

2.6.0 VirtualModelling


25


Prototype cameraPrototype camera

26


2727


• Semantic technology is a necessary condition to deal with distance – in space, in time or introduced by different systems and cultures.

• However, semantic awareness requires more than RDF and OWL. We still need a adequate vocabulary and a proper data model.

• The most important source of descriptive metadata is pre-production or script editing and we still need a standard vocabulary (an “ontology”) and a syntax (a “wrapper”) to support (non-news) editorial systems – A-S-A-P!

• In the advent of Web 3.0 (exchange of information), we need to think beyond interoperability. Production tools must understand and preserve the context in which the content is being created, so that it will be exploitable for other people (elsewhere, later, different).

28


29

http://medialab.vrt.be http://www.mediamapproject.org [email protected]

http://www.vrtmedialab.be/index.php/nederlands/project/project_c_mediamap/

http://www.mediamapproject.org/

mailto:[email protected]


Work in Process...Work in Process...

30

Presentation of Mediamap @Ebu Production Technology Seminar

Technology

Transcript of Presentation of Mediamap @Ebu Production Technology Seminar