An Extra TV Audio Track for Hard-Of-Hearing Viewers

26
TMT Nov.28, 2010 © IRT - Marti n Link, RBB - Bett ina Heidkamp-Tchegl off, Sven Glas er UAB - Pilar Orero, Marta Miquel Iriarte An Extra TV Audio Track for Hard-Of-Hearing Viewers Part of the EU – Project DTV4All Martin Link, Audio Production Systems, IRT In Cooperation with: Bettina Heidkamp (RBB), Sven Glaser (RBB), Pilar Orero (UAB), Marta Miquel Iriarte (UAB)   

Transcript of An Extra TV Audio Track for Hard-Of-Hearing Viewers

Page 1: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 1/26

TMT Nov.28, 2010

© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

UAB - Pilar Orero, Marta Miquel Iriarte

An Extra TV Audio Trackfor Hard-Of-Hearing Viewers

Part of the EU – Project DTV4All 

Martin Link, Audio Production Systems, IRT

In Cooperation with:

Bettina Heidkamp (RBB), Sven Glaser (RBB), Pilar Orero (UAB),

Marta Miquel Iriarte (UAB)  

Page 2: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 2/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 2© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

An Extra TV Audio Track for Hard-Of-Hearing Viewers

Background of the Research

Clean Audio

Reduced Playback Speed

Overview

Page 3: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 3/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 3© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

An Extra TV Audio Track for Hard-Of-Hearing Viewers

1.Background of the Research1.General Improvements for Disabled People as Audience

2.The Project "Digital Television For All" (DTV4All)  

2.Clean Audio

1.Available Techniques for Signal Processing2.Selection of Program Sequences for Evaluation

3.Votings by Concerned TV Viewers

4.Conclusions and Future Prospects

3.Reduced Playback Speed• Aspects for Telecasts

1.Evaluation of Intelligibility

2.Conclusions and Future Prospects

Overview

Page 4: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 4/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 4© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

An Extra TV Audio Track for Hard-Of-Hearing Viewers

1.Background of the Research1.General Improvements for Disabled People as Audience2.The Project "Digital Television For All" (DTV4All)  

2.Clean Audio

3.Reduced Playback Speed

Overview

Page 5: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 5/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 5© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

1. Background Of the Research1.1. General Improvements for Disabled People ...

Helpful for Hard-of-....

Hearing

Hearing

Hearing

HearingHearing

Hearing

... People

Seeing

Seeing

Seeing

Seeing

Additional Services

Action on Audio Services

Clean Audio

Audio Description

Reduced Playback Speed

Easy Web-support by HbbTV

Action on Video Services

Signer LanguageSubtitle Presentation

Reduced Playback Speed

Page 6: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 6/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 6© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

1. Background Of the Research1.2. The Project "Digital Television For All" (DTV4All)  

Project Partners

BROADCAST

INDUSTRIERESEARCH

Supported by European Commission of ICT PSPTime Schedule: July 1, 2008 – December 31, 2010)Subject "Barrier-Free Access to Digital TV"

Partners:

•Rundfunk Berlin-Brandenburg (rbb)•Danmarks Radio (DR)•Radiotelevisione Italiana (RAI)•Televisió de Catalunya (TVC)•Brunel University of London - Project Leader 

•Institut für Rundfunktechnik (IRT)•Universitat Autònoma de Barcelona (UAB)•Red Bee Media, London (Retired in 2009)

•(All in cooperation with EBU)

Page 7: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 7/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 7© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

1. Background Of the Research1.2. The Project "Digital Television For All" (DTV4All)  

Cooperation

Separate Tasks

CLEAN AUDIO

Preparing and compilation of test sequences IRT

Pre-Tests RBB, UABTest organization RBB

REDUCED PLAYBACK SPEED

Preparing and compilation of test sequences IRTTest organization and evaluation UAB

Page 8: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 8/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 8© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

An Extra TV Audio Track for Hard-Of-Hearing Viewers

1. Background Of the Research

2. Clean Audio1. Available Techniques for Signal Processing

2. Selection of Program Sequences for Evaluation

3. Votings by Concerned TV Viewers

4. Conclusions and Future Prospects3. Reduced Playback Speed

Overview

Page 9: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 9/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 9© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

E x i st i ng  Asse t  w i t h F o o t ag e 

 E x i s t i n g 

A s s e t  w i t h

 o u t  F o o t a

 g e

New  P r o duc t i o n

 L i f e  C o m m e n t,  N

 o i s y

L i  f  e  C o m m e n t  &  I  T  - c h a n n e l  

 O l d  M o

 v i eNe ws R

epor t On Si te

New s Show 

Clean AudioClean Audio

Normal Audio

Clean AudioClean Audio

Normal Audio

2. Clean Audio

2.1. Available Techniques for Signal Processing

Non-suitable and suitable program material

Source Material

Page 10: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 10/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 10© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

Providing Material

2. Clean Audio2.2. Selection of Program Sequences for Evaluation  

Genres of Source Material

Movies

Television plays

Entertainment shows

Reports

Sports transmissions

Talk shows

News shows

Educational stuff 

Sometimes with ambient noise Normally no ambient noise

Page 11: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 11/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 11© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

2. Clean Audio

2.2. Selection of Program Sequences for Evaluation

----2x Cedar, level

reduced in

 pauses

 Normal audiosome indoor ambience, silent

musicconversation9

----2x Cedar, level reduced

in pauses Normal audiomostly music

ladie's voice and a girl outdoor 

(film of a fairytale)  8

like "a", partially again

Cedar, noIzotope

like "a", with Izotope,

re-peatedlyCedar 

1x-2x Cedar (edits)   Normal audioenthusiastic crowd at a boxingmatchsports reporter (movie)  7

like "a", again Cedar,

no Izotope

like "a", with Izotope,

re-peatedly

Cedar 

1x-2x Cedar (edits)   Normal audioenthusiastic crowd at a boxing

matchsports reporter (movie)  6

--3x Cedar, level reduced

in pauses2x Cedar  Normal audio

rural ambience,

men fighting, barking dog

normal and loud talking

(movie)  5

--Cedar + IzotpeCedar only Normal audioclicks in a coroner's roomslightly echoing dialogue

(TV_movie)  4

----2x Cedar, new setting

for radio-voice Normal audio

moderate ambience of a boxing

arena from a radio set

two ladies in a living room,

radio speaker (movie)  3

----

2x Cedar, a lot with

Izotope on the

music

 Normal audioclicks by tableware, musicladie and girl in a dining room

(film of a fairytale)  2

----

rumbling, no atmo,1x

Cedar,Izotope

on piano ones

 Normal audioindoor ambience, piano tonesdialogue in an aisle of a

hospital (tv_movie)  1

4th segment "c"3rd segment "b"2nd segment "a"1st segment "N"audio to rejectaudio to keepItem

Content of the itemsSoundtrack 

Test Items

Page 12: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 12/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 12© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

2. Clean Audio

2.2. Selection of Program Sequences for Evaluation

Test Helpers Onscreen

Page 13: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 13/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 13© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

2. Clean Audio2.3. Votings by Concerned TV Viewers

2.31.94.24.04.04.54.43.74.053.13.13.72.22.73.33.82.52.6#1,#2,#4 out

2.72.54.34.14.14.34.43.94.34.73.63.63.62.62.93.44.22.72.5All subj.

Averages:

2132123255212212220#18

224555555533.5422.53332.5#17

2252254326444223022#16

4244244243424324203#15

112222.5321.545.54.53.522.52424#14

0033233324323233202#13

2.5155.55.55.5556655.55.533.53.55.51.51.5#12

3266666666222222622#11

2244554556234234443#10

1266666335522223522#9

3266666656333333623#8

2235554345255255443#7

3444554.54.54.5533.5433.54.5434#6

3243555356235234002#5

3.5466666666666566600#4 out

2243233323124124222#3

5655526662662552660#2 out

5632421362662423601#1 out

c ba Nc ba N ba N ba N

I9I8I7I6I5I4I3I2I1subj. nr 

All Scores

Page 14: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 14/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 14© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

2. Clean Audio2.3. Votings by Concerned TV Viewers

Ranking by Scores

+_____|++____|++____|++____|+_____| Noise in "Normal"

1414131214(Sum) 

00400 bad

51546average

913481Good to very good

AnswersAnswersAnswersAnswersAnswers

Item 9Item 8Item 3Item 2Item 1

Pair Comparison results

Page 15: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 15/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 15© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

2. Clean Audio2.3. Votings by Concerned TV Viewers

Ranking by Scores

+++++_|+++++_|++____|++____| Noise in

"Normal"

15151515151515151515(Sum) 

2002012102Worse than

normal

61094446645Same as normal

7569111078119Better than

normal

1213544342

2 or more

grades

 better 

AnswersAnswersAnswersAnswers

c bac ba ba ba

Item 7Item 6Item 5Item 4

Multiple Comparison results

Page 16: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 16/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 16© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

Example: User Interface

 █ █ █ █ █ █ █  _ _ _ _ _ _ _ FADER 

Slightly CLEANBACKGROUND LEVEL

Ambience when not spokenBACKGROUND LEVEL

Silence when not spokenAGC

NORMAL

SELECT ◄ ► INTENSITY ☻ EXIT     ►◄

2. Clean Audio2.4. Conclusions and Future Prospects

Page 17: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 17/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 17© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

2. Clean Audio2.4. Conclusions and Future Prospects

Application

To many hard-of hearing people the advantage of Clean Audio is proven.

Even when small quality impairments occur by post-processed 'cleaning'.

The acceptance could cause to start developments of automated systems,the first step is to simplify the workflow

Page 18: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 18/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 18© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

An Extra TV Audio Track for Hard-Of-Hearing Viewers

1. Background Of the Research

2. Clean Audio

3.Reduced Playback Speed1.Aspects for Telecasts

2.Evaluation of Intelligibility

3.Conclusions and Future Prospects

Overview

Page 19: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 19/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 19© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

3. Reduced Playback Speed3.1. Aspects for Telecasts

Test Setup

A test concerning acoustical and visual perceptance:

•Test in a laboratory environment

•1. part audio with video; 2. part video only

•8 items of about one minute durance in normal playing speed•Presented playing speeds 100%, 90%, 80%,70%

•Pair comparisons of different items at different speeds

•Content are different reports, talkshows with current themes

•Evaluation by eye-tracking system and questionaires

•Detailed questions about understanding the content

Page 20: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 20/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 20© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

3. Reduced Playback Speed3.2. Evaluation of Intelligibility

Comparison Test Scheme

Page 21: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 21/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 21© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

3. Reduced Playback Speed3.2. Evaluation of Intelligibility

Questionaire

Test material contains meanings and opinions on current affairs and

politics, which the subjects will understand more or less, related to

intelligibility

Test of intelligibility by questions on

details of the shown statements

Statements in the questionaire to answer with

"True/false"

Page 22: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 22/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 22© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

3. Reduced Playback Speed3.2. Evaluation of Intelligibility

Sample of evaluation chart

"correction" is related to the questions with [Y/N]

being right-or-wrong statements

Page 23: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 23/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 23© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

3. Reduced Playback Speed3.2. Evaluation of Intelligibility

When all answers were correct

3140

Results of video only

(Dumb Condition) 

5131Sum

ALL8

ALLALL7

ALL6

5

4

ALLALL3

ALLALL2

ALLALL1

70%80%90%100%# of Video

Page 24: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 24/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 24© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

3. Reduced Playback Speed3.3. Conclusions and Future Prospects

Application

In case of talk shows, news shows etc.

Permament flow of information = talking. Just play all at Reduced Playback Speed:

Nothing to be done by the broadcasters

The receiver plays slowly according to user setting

In case of movies, some entertainment shows etc.:

Only Short phrases for Reduced Playback Speed, mostly no information for understanding:

Broadcast a control signal during dialog partThe Settop box will stretch dialog parts only, and overlap a little bit before and after 

Over-all playing time is not prolonged

Page 25: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 25/26

TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte

S. 25© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

Clean Audio

And

Reduced Playback Speed

Might even be useful tools in combination….

Application

Page 26: An Extra TV Audio Track for Hard-Of-Hearing Viewers

8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers

http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 26/26

TMT Nov.28, 2010

© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser 

UAB - Pilar Orero, Marta Miquel Iriarte

Thank-You for Your Attention.

Institut für Rundfunktechnik

Floriansmühlstraße 60

80939 München

Tel. +49-(0)89 32399 458

Fax +49-(0)89 32399 351

E-Mail: [email protected] and documents are protected by copyright law. Any kind

of reproduction is not allowed without permission of the author.

This copyright notice may not be removed.

Martin Link

Audio Production Systems