Post on 14-Jan-2015
description
MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
MediaMosa and Transcripting Technology to enhance usability of video in education
`
Frans WardSenior Technical Product ManagerSURFnet Advanced Services
Tuesday, June 28, 2011
OVERVIEW
• About SURFnetAnd our services. Briefly...
• MediaMosa IntroductionWhat is it?
• Searching in Spoken WordsDisclosure of recorded content
• Transcripting Technology ScoutWhat can this do for you?
MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011
About SURFnet
• The SURFnet network is the national computer network for higher education and research in the Netherlands (NREN)
• SURFnet is a subsidiary of the SURF organization
• Not for profit, 80 employees
• 180 connected institutions, serving 1 million users
NREN, National Research and Education Network
MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011
SURFnet ServicesSURFnet provides advanced services to the
Dutch research and education community
High performance networking. SURFnet plays a leading role in the development of national, European and world-wide networking.
Authentication and authorization services to provide secure access to the network and other resources.
Advanced multimedia collaboration tools, including high quality audio/video streaming and communication.
MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
NREN, National Research and Education Network
Tuesday, June 28, 2011
CDN
VP-CorePowered by
MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
SURFnet Video ServicesSURFmediaSURFnet’s online mediaportalhttp://www.surfmedia.nl/
✓ Video On Demand (VOD)✓ Live Streaming
Facts and Figures (June 2011)• 97.610 assets• 47.979 accounts• 11.450 logins per month• 43 institutions using federative logins • 4 content suppliers• 248.049 views per month
Tuesday, June 28, 2011
CDN
VP-CorePowered by
MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
SURFnet Video ServicesSURFmediaSURFnet’s online mediaportalhttp://www.surfmedia.nl/
✓ Video On Demand (VOD)✓ Live Streaming
Front-endsBack-ends
Facts and Figures (June 2011)• 97.610 assets• 47.979 accounts• 11.450 logins per month• 43 institutions using federative logins • 4 content suppliers• 248.049 views per month
Tuesday, June 28, 2011
SURFnet. We make innovation work1
MediaMosa Open Source
Software to build a Media Management andDistribution Platform
Main Entry: 1me·dia-mo-saPronunciation: \ˈmē-dē-ə-mō-ˈzā\Function: open source software to build a media management and distribution platformRelease Date: 8 april 2009
In use by SURFnet and Kennisnet on their
VP-Core platform since July 2008
MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011
SURFnet. We make innovation work1
MediaMosa is.....
MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011
SURFnet. We make innovation work1
MediaMosa is..... Open Source (GPLv2) Software
For building an online delivery and media management platform
For (streaming) video, audio and in factany content
Features flexible metadata sets, screening and transcoding services
MediaMosa is the basis for various successful video services that SURFnet provide to
the Dutch educational sector
Open as in Open Source, supporting Open Technology, Open Formats, Open Content,...
MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011
SURFnet. We make innovation work1UNINETT Lecture Recording Workshop - Trondheim, October 6, 2010
SURFnet. We make innovation work
189 REST serviceshttp://mediamosa.org/api
Tuesday, June 28, 2011
PROVEN TECHNOLOGYMediaMosa is in production since 2008 with SURFnet and Kennisnet. Also used by...
Tuesday, June 28, 2011
SURFnet. We make innovation work1
MediaMosa Community Website & Online DEMO environment
http://mediamosa.org
http://demo.mediamosa.org
MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011
SURFnet. We make innovation work1 MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
• Rich Media Systems Compared
• MediaMosa Building Block for Blackboard
• MediaMosa and support for other content
• Full text search engines
• Content in the Cloud
• MediaMosa and Open API
• Transcripting Technology
• Open Live Streaming
• MediaMosa RichMedia Application
• Content Supplier Application
• MediaMosa and Opencast Matterhorn
• HTML5 Video
TECHNOLOGY SCOUTING PROJECTS... PAST & PRESENT
MediaMosa Technology Scouts
Tuesday, June 28, 2011
SURFnet. We make innovation work1 MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
• The number of AV-archives on the Internet increases rapidly
• Archiving is not enough: disclosure and reusing is required!
• The use of speech technology is needed (Reduce human effort).
Disclosure of audiovisual archives
UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/
Tuesday, June 28, 2011
SURFnet. We make innovation work1 MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
Disclosure of audiovisual archives
UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/
Tuesday, June 28, 2011
SURFnet. We make innovation work1 MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
• The number of AV-archives on the internet increases rapidly.
Disclosure of audiovisual archives
UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/
Tuesday, June 28, 2011
SURFnet. We make innovation work1 MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
• The number of AV-archives on the internet increases rapidly.
• Archiving is not enough: disclosure and reusing is required!
Disclosure of audiovisual archives
UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/
Tuesday, June 28, 2011
SURFnet. We make innovation work1 MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
• The number of AV-archives on the internet increases rapidly.
• Archiving is not enough: disclosure and reusing is required!
• Adding Metadata is the key component here.
Disclosure of audiovisual archives
UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/
Tuesday, June 28, 2011
SURFnet. We make innovation work1 MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
• The number of AV-archives on the internet increases rapidly.
• Archiving is not enough: disclosure and reusing is required!
• Adding Metadata is the key component here.
• The use of speech technology is needed (Reduce human effort).
Disclosure of audiovisual archives
UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/
Tuesday, June 28, 2011
SURFnet. We make innovation work1 MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Huge amount of workand no time-coded relations with video
Adding metadata, the traditional approach:Manual annotation
Tuesday, June 28, 2011
SURFnet. We make innovation work1 MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Adding metadata, the new approach:Exploiting speech technology for metadata generation
Speech Recognition(Speech-to-Text)Time-coded Transcript
Indexing and Search:Search on fragment level
Audio Extraction
Tuesday, June 28, 2011
SURFnet. We make innovation work1 MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
• Transcripting: conversion of speech into a written or electronic text document.
• Automatic Speech Recognition (ASR) seems to be the ideal technology for this.
• In combination with Optical Character Recognition (OCR) of slides.
• Goal: to provide additional metadata for searching in video / lecture recordings.
Tuesday, June 28, 2011
SURFnet. We make innovation work1 MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
DEMO’s SPEECH RECOGNITION
http://hmi.ewi.utwente.nl/showcases/Broadcast-news-demohttp://hmi.ewi.utwente.nl/showcases/Radio%20Oranje%20demo
Tuesday, June 28, 2011
SURFnet. We make innovation work1 MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
MEDIAMOSA TRANSCRIPTING TECHNOLOGYThe Technology Scout Project. The process is complex...
Tuesday, June 28, 2011
MEDIAMOSA TRANSCRIPTING TECHNOLOGY SCOUTING PROJECT
MediaMosaTranscription by ‘Spraak’
Multi-SourcePlayer
Partners:
• Enhanced Search• Optional Subtitles• Optional Reference links
Lecture Recording
End User Application
• Recognize the Speech• Produce time-coded
Transcript
• Recording of Teacher• Recording of Slides• Basic Metadata• Reference material
• Transcode into audio• Store all into an asset• Optional OCR of slides
MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
http://www.spraak.org/
Tuesday, June 28, 2011
SURFnet. We make innovation work1
OPEN SOURCE MULTI-SOURCE HTML5 PLAYER
MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011
SURFnet. We make innovation work1
MediaMosa Status & Roadmap
Continued Development: 2011: Two major releases based on new Drupal 7 framework.MediaMosa 3.0: focusses on Open InterfacesMediaMosa 3.5: focusses on Transcripting Technology (speech-2-text)
Other MediaMosa Projects 2011:• Weblecture Pilot MediaMosa - Matterhorn• Proof of Concepts Transcripting Technology• Proof of Concepts flexible workflows
(Enhanced support for other content than audio/video)
Available on mediamosa.org
Release 2.3.11
MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011
SURFnet. We make innovation work1
MediaMosa 3.0Focus on open interfaces, open standards and OpenSocial
MediaMosa OpenAPI interface:Own interface in MediaMosa for support for open REST calls and other related functions:• Search• oAuth• oEmbed• open upload
Open standards: • JSON, ATOM feed
OpenSocial: • a common API for social applications across multiple websites
MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011
SURFnet. We make innovation work1 MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011
SURFnet. We make innovation work1 MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011
SURFnet. We make innovation work1
MediaMosa Directions
Q&A
MediaMosa
MediaMosa
MediaMosa
Thanks
for yo
ur
attenti
on!
WWWhttp://mediamosa.org
Online Demohttp://demo.mediamosa.org
Forumhttp://mediamosa.org/forum
Issue Trackerhttp://mediamosa.org/trac
Source Codehttps://github.com/mediamosa
Slidesharehttp://www.slideshare.net/MediaMosa
Twitterhttp://twitter.com/mediamosa
MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011