MediaMosa and Transcripting Technology to enhance usability of video in education

MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work

MediaMosa and Transcripting Technology to enhance usability of video in education

`

Frans WardSenior Technical Product ManagerSURFnet Advanced Services

Tuesday, June 28, 2011

OVERVIEW

• About SURFnetAnd our services. Briefly...

• MediaMosa IntroductionWhat is it?

• Searching in Spoken WordsDisclosure of recorded content

• Transcripting Technology ScoutWhat can this do for you?



About SURFnet

• The SURFnet network is the national computer network for higher education and research in the Netherlands (NREN)

• SURFnet is a subsidiary of the SURF organization

• Not for profit, 80 employees

• 180 connected institutions, serving 1 million users

NREN, National Research and Education Network



SURFnet ServicesSURFnet provides advanced services to the

Dutch research and education community

High performance networking. SURFnet plays a leading role in the development of national, European and world-wide networking.

Authentication and authorization services to provide secure access to the network and other resources.

Advanced multimedia collaboration tools, including high quality audio/video streaming and communication.


NREN, National Research and Education Network


CDN

VP-CorePowered by


SURFnet Video ServicesSURFmediaSURFnet’s online mediaportalhttp://www.surfmedia.nl/

✓ Video On Demand (VOD)✓ Live Streaming

Facts and Figures (June 2011)• 97.610 assets• 47.979 accounts• 11.450 logins per month• 43 institutions using federative logins • 4 content suppliers• 248.049 views per month


http://www.surfmedia.nl


CDN

VP-CorePowered by


SURFnet Video ServicesSURFmediaSURFnet’s online mediaportalhttp://www.surfmedia.nl/

✓ Video On Demand (VOD)✓ Live Streaming

Front-endsBack-ends

Facts and Figures (June 2011)• 97.610 assets• 47.979 accounts• 11.450 logins per month• 43 institutions using federative logins • 4 content suppliers• 248.049 views per month




SURFnet. We make innovation work1

MediaMosa Open Source

Software to build a Media Management andDistribution Platform

Main Entry: 1me·dia-mo-saPronunciation: \ˈmē-dē-ə-mō-ˈzā\Function: open source software to build a media management and distribution platformRelease Date: 8 april 2009

In use by SURFnet and Kennisnet on their

VP-Core platform since July 2008




MediaMosa is.....




MediaMosa is..... Open Source (GPLv2) Software

For building an online delivery and media management platform

For (streaming) video, audio and in factany content

Features flexible metadata sets, screening and transcoding services

MediaMosa is the basis for various successful video services that SURFnet provide to

the Dutch educational sector

Open as in Open Source, supporting Open Technology, Open Formats, Open Content,...



SURFnet. We make innovation work1UNINETT Lecture Recording Workshop - Trondheim, October 6, 2010

SURFnet. We make innovation work

189 REST serviceshttp://mediamosa.org/api


http://mediamosa.org/api

http://mediamosa.org/api

PROVEN TECHNOLOGYMediaMosa is in production since 2008 with SURFnet and Kennisnet. Also used by...



MediaMosa Community Website & Online DEMO environment

http://mediamosa.org

http://demo.mediamosa.org



























SURFnet. We make innovation work1 MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work

• Rich Media Systems Compared

• MediaMosa Building Block for Blackboard

• MediaMosa and support for other content

• Full text search engines

• Content in the Cloud

• MediaMosa and Open API

• Transcripting Technology

• Open Live Streaming

• MediaMosa RichMedia Application

• Content Supplier Application

• MediaMosa and Opencast Matterhorn

• HTML5 Video

TECHNOLOGY SCOUTING PROJECTS... PAST & PRESENT

MediaMosa Technology Scouts



MEDIAMOSA TRANSCRIPTING TECHNOLOGY

• The number of AV-archives on the Internet increases rapidly

• Archiving is not enough: disclosure and reusing is required!

• The use of speech technology is needed (Reduce human effort).

Disclosure of audiovisual archives

UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/


http://www.flickr.com/people/footage/






• The number of AV-archives on the internet increases rapidly.












• Adding Metadata is the key component here.












• Adding Metadata is the key component here.

• The use of speech technology is needed (Reduce human effort).









Huge amount of workand no time-coded relations with video

Adding metadata, the traditional approach:Manual annotation



Adding metadata, the new approach:Exploiting speech technology for metadata generation

Speech Recognition(Speech-to-Text)Time-coded Transcript

Indexing and Search:Search on fragment level

Audio Extraction




• Transcripting: conversion of speech into a written or electronic text document.

• Automatic Speech Recognition (ASR) seems to be the ideal technology for this.

• In combination with Optical Character Recognition (OCR) of slides.

• Goal: to provide additional metadata for searching in video / lecture recordings.




DEMO’s SPEECH RECOGNITION

http://hmi.ewi.utwente.nl/showcases/Broadcast-news-demohttp://hmi.ewi.utwente.nl/showcases/Radio%20Oranje%20demo


http://hmi.ewi.utwente.nl/showcases/Broadcast-news-demo



http://hmi.ewi.utwente.nl/showcases/Radio%20Oranje%20demo

http://hmi.ewi.utwente.nl/showcases/Radio%20Oranje%20demo


MEDIAMOSA TRANSCRIPTING TECHNOLOGYThe Technology Scout Project. The process is complex...


MEDIAMOSA TRANSCRIPTING TECHNOLOGY SCOUTING PROJECT

MediaMosaTranscription by ‘Spraak’

Multi-SourcePlayer

Partners:

• Enhanced Search• Optional Subtitles• Optional Reference links

Lecture Recording

End User Application

• Recognize the Speech• Produce time-coded

Transcript

• Recording of Teacher• Recording of Slides• Basic Metadata• Reference material

• Transcode into audio• Store all into an asset• Optional OCR of slides


http://www.spraak.org/


http://www.spraak.org

http://www.spraak.org


OPEN SOURCE MULTI-SOURCE HTML5 PLAYER



http://richmedia.previews.oneshoe.nl/presentation/mozcamp-utrecht

































MediaMosa Status & Roadmap

Continued Development: 2011: Two major releases based on new Drupal 7 framework.MediaMosa 3.0: focusses on Open InterfacesMediaMosa 3.5: focusses on Transcripting Technology (speech-2-text)

Other MediaMosa Projects 2011:• Weblecture Pilot MediaMosa - Matterhorn• Proof of Concepts Transcripting Technology• Proof of Concepts flexible workflows

(Enhanced support for other content than audio/video)

Available on mediamosa.org

Release 2.3.11



http://www.mediamosa.org










MediaMosa 3.0Focus on open interfaces, open standards and OpenSocial

MediaMosa OpenAPI interface:Own interface in MediaMosa for support for open REST calls and other related functions:• Search• oAuth• oEmbed• open upload

Open standards: • JSON, ATOM feed

OpenSocial: • a common API for social applications across multiple websites




MediaMosa Directions

Q&A

MediaMosa

MediaMosa

MediaMosa

Thanks

for yo

ur

attenti

on!

WWWhttp://mediamosa.org

Online Demohttp://demo.mediamosa.org

Forumhttp://mediamosa.org/forum

Issue Trackerhttp://mediamosa.org/trac

Source Codehttps://github.com/mediamosa

Slidesharehttp://www.slideshare.net/MediaMosa

Twitterhttp://twitter.com/mediamosa





http://mediamosa.org/forum

http://mediamosa.org/forum

http://www.mediamosa.org/trac/

http://www.mediamosa.org/trac/

http://www.slideshare.net/MediaMosa/

http://www.slideshare.net/MediaMosa/

MediaMosa and Transcripting Technology to enhance usability of video in education

Education

Transcript of MediaMosa and Transcripting Technology to enhance usability of video in education