MediaMosa 3.x Release & Transcripting Project - Community day - 8 december 2011

23
MediaMosa Community Day Utrecht, December 8, 2011 - SURFnet. We make innovation work ` Frans Ward Technical Product Manager SURFnet Advanced Services MediaMosa 3.x Release & Transcripting Project Tuesday, December 13, 11

description

MediaMosa 3.x Release
 & Transcripting Project Event: MediaMosa Community day Date: 8 december 2011 Presenter: Frans Ward - SURFnet

Transcript of MediaMosa 3.x Release & Transcripting Project - Community day - 8 december 2011

Page 1: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

`

Frans WardTechnical Product ManagerSURFnet Advanced Services

MediaMosa 3.x Release& Transcripting Project

Tuesday, December 13, 11

Page 2: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

OVERVIEW

• 15.00 - 15.10MediaMosa 3.0 release

• 15.10 - 15.25Transcripting Technology

• 15.25 - 15.30 Q&A

Tuesday, December 13, 11

Page 3: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

SURFnet. We make innovation work1

MediaMosa Status

• In production on the VP-Core platform as of november 16, 2011

• Release Notes / Changelog:http://www.mediamosa.org/trac/ticket/519

• Sourcecode:https://github.com/mediamosa/mediamosa

Latest stable release on Github

Release 3.0.7

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 4: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

SURFnet. We make innovation work1

MediaMosa 3.0

Focus on open interfaces, open standards and OpenSocial

MediaMosa OpenAPI interface:Own interface in MediaMosa for support for open REST calls and other related functions:• Search• oAuth• oEmbed• open upload

Open standards: • JSON, ATOM feed

OpenSocial: • a common API for social applications across multiple websites

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 5: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

SURFnet. We make innovation work1

New Feature: Open API• OpenAPI support

- Search - oAuth - oEmbed - Open upload

• MediaMosa OpenAPI interface Own interface in MediaMosa for support for open REST calls and other related functions

OpenAPI search with "alt" parameter:http://openapi.acceptatie.vpcore.snkn.nl/openapi/search?query=test&alt=rssAllowed values are 'xml', 'atom', 'rss', 'json'.

• http://openapi.acceptatie.vpcore.snkn.nl/openapi/search?query=test&alt=atom

• http://openapi.acceptatie.vpcore.snkn.nl/openapi/mediaItems/

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 6: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

SURFnet. We make innovation work1

New Feature: oAuth

• What is oAuth - An open protocol to allow secure API authorization

• How does it work? - Websites or software that supports oAuth - Websites or software that knows MediaMosa REST

• What are the use-cases; - External website/software that wants to copy media - External website/software that supports video editing

• For more information; - http://oauth.net/ - http://mediamosa.org/api- http://mediamosa.org/trac/ticket/10

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 7: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

SURFnet. We make innovation work1

New Feature: oEmbed

• What is oEmbed? - oEmbed is an open API format designed to allow embedding content from a website into another page. This content is of the types photo, video, link or rich. (converting a URL into an embed code)

• How does it work? - A external website does a call to a front-end website that supports oEmbed. - MediaMosa will provide the REST calls to return the embedded information

• What are the use-cases; - Websites that want to support embedding of their MediaMosa media in external websites

• For more information; - http://www.oembed.com - http://mediamosa.org/api- http://mediamosa.org/trac/ticket/413

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 8: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

SURFnet. We make innovation work1

New Features: Other• PDF Support

- PDFinfo: Integrated analyzer for meta data parsing - PDF2SWF: Converts PDF to SWF to enable to view PDF inside website (http://www.swftools.org/)

• Image Support - ImageMagic tool: Convert, Edit, and Compose Images http://www.imagemagick.org/- Exiv2: Manipulate the Exif metadata of images http://www.exiv2.org/

• Watermarking- Allows stills to be watermarked

• Users can now be in more than one (quota) group- No longer 1 on 1 relation between users and groups

• Status page improvements - More information - Real time and cached information

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 9: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

SURFnet. We make innovation work1

MEDIAMOSA TRANSCRIPTING TECHNOLOGY

• The number of AV-archives on the Internet increases rapidly

• Archiving is not enough: disclosure and reusing is required!

• The use of speech technology is needed (Reduce human effort).

Disclosure  of  audiovisual  archives

UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 10: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

SURFnet. We make innovation work1

MEDIAMOSA TRANSCRIPTING TECHNOLOGY

Disclosure  of  audiovisual  archives

UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 11: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

SURFnet. We make innovation work1

MEDIAMOSA TRANSCRIPTING TECHNOLOGY

• The number of AV-archives on the Internet increases rapidly.

Disclosure  of  audiovisual  archives

UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 12: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

SURFnet. We make innovation work1

MEDIAMOSA TRANSCRIPTING TECHNOLOGY

• The number of AV-archives on the Internet increases rapidly.

• Archiving is not enough: disclosure and reusing is required!

Disclosure  of  audiovisual  archives

UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 13: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

SURFnet. We make innovation work1

MEDIAMOSA TRANSCRIPTING TECHNOLOGY

• The number of AV-archives on the Internet increases rapidly.

• Archiving is not enough: disclosure and reusing is required!

• Adding Metadata is the key component here.

Disclosure  of  audiovisual  archives

UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 14: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

SURFnet. We make innovation work1

MEDIAMOSA TRANSCRIPTING TECHNOLOGY

• The number of AV-archives on the Internet increases rapidly.

• Archiving is not enough: disclosure and reusing is required!

• Adding Metadata is the key component here.

• The use of speech technology is needed (Reduce human effort).

Disclosure  of  audiovisual  archives

UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 15: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

SURFnet. We make innovation work1

Huge amount of workand no time-coded relations with video

Adding metadata, the traditional approach:Manual annotation

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 16: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

SURFnet. We make innovation work1

Adding metadata, the new approach:Using speech-to-text technology for metadata generation

Speech Recognition(Speech-to-Text)Time-coded Transcript

Indexing and Search:Search on fragment level

Audio Extraction

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 17: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

SURFnet. We make innovation work1

MEDIAMOSA TRANSCRIPTING TECHNOLOGYThe Technology Scout Project. The process is complex...

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 18: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

MEDIAMOSA TRANSCRIPTING TECHNOLOGY SCOUTING PROJECT

MediaMosaTranscription by Spraak /Cmu Sphinx

Multi-SourcePlayer

• Enhanced Search• Optional Subtitles• Mashup info

Lecture Recording

End User Application

• Recognize the Speech• Produce time-coded

Transcript

• Recording of Teacher• Recording of Slides• Reference material

• Transcode into audio• Store all into an asset

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 19: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

MEDIAMOSA TRANSCRIPTING PROJECT

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 20: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

MEDIAMOSA TRANSCRIPTING PROJECT

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 21: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

MEDIAMOSA TRANSCRIPTING PROJECTSubtitles:

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 22: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

SURFnet. We make innovation work1

MediaMosa 3.5 release

Focus on transcription technology (speech-2-text) and flexible workflows

• Development is started• beta release available: december 2011

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11

Page 23: MediaMosa 3.x Release & Transcripting Project  - Community day - 8 december 2011

SURFnet. We make innovation work1

MediaMosa Directions

Q&A

MediaMosa

MediaMosa

MediaMosa

Thanks

for yo

ur

attenti

on!

WWWhttp://mediamosa.org

Online Demohttp://demo.mediamosa.org

Forumhttp://mediamosa.org/forum

Issue Trackerhttp://mediamosa.org/trac

Source Codehttps://github.com/mediamosa

Slidesharehttp://www.slideshare.net/MediaMosa

Twitterhttp://twitter.com/mediamosa

MediaMosa Community DayUtrecht, December 8, 2011 - SURFnet. We make innovation work

Tuesday, December 13, 11