An Extra TV Audio Track for Hard-Of-Hearing Viewers
-
Upload
marta-miquel-iriarte -
Category
Documents
-
view
219 -
download
0
Transcript of An Extra TV Audio Track for Hard-Of-Hearing Viewers
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 1/26
TMT Nov.28, 2010
© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
UAB - Pilar Orero, Marta Miquel Iriarte
An Extra TV Audio Trackfor Hard-Of-Hearing Viewers
Part of the EU – Project DTV4All
Martin Link, Audio Production Systems, IRT
In Cooperation with:
Bettina Heidkamp (RBB), Sven Glaser (RBB), Pilar Orero (UAB),
Marta Miquel Iriarte (UAB)
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 2/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 2© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
An Extra TV Audio Track for Hard-Of-Hearing Viewers
Background of the Research
Clean Audio
Reduced Playback Speed
Overview
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 3/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 3© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
An Extra TV Audio Track for Hard-Of-Hearing Viewers
1.Background of the Research1.General Improvements for Disabled People as Audience
2.The Project "Digital Television For All" (DTV4All)
2.Clean Audio
1.Available Techniques for Signal Processing2.Selection of Program Sequences for Evaluation
3.Votings by Concerned TV Viewers
4.Conclusions and Future Prospects
3.Reduced Playback Speed• Aspects for Telecasts
1.Evaluation of Intelligibility
2.Conclusions and Future Prospects
Overview
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 4/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 4© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
An Extra TV Audio Track for Hard-Of-Hearing Viewers
1.Background of the Research1.General Improvements for Disabled People as Audience2.The Project "Digital Television For All" (DTV4All)
2.Clean Audio
3.Reduced Playback Speed
Overview
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 5/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 5© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
1. Background Of the Research1.1. General Improvements for Disabled People ...
Helpful for Hard-of-....
Hearing
Hearing
Hearing
HearingHearing
Hearing
... People
Seeing
Seeing
Seeing
Seeing
Additional Services
Action on Audio Services
Clean Audio
Audio Description
Reduced Playback Speed
Easy Web-support by HbbTV
Action on Video Services
Signer LanguageSubtitle Presentation
Reduced Playback Speed
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 6/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 6© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
1. Background Of the Research1.2. The Project "Digital Television For All" (DTV4All)
Project Partners
BROADCAST
INDUSTRIERESEARCH
Supported by European Commission of ICT PSPTime Schedule: July 1, 2008 – December 31, 2010)Subject "Barrier-Free Access to Digital TV"
Partners:
•Rundfunk Berlin-Brandenburg (rbb)•Danmarks Radio (DR)•Radiotelevisione Italiana (RAI)•Televisió de Catalunya (TVC)•Brunel University of London - Project Leader
•Institut für Rundfunktechnik (IRT)•Universitat Autònoma de Barcelona (UAB)•Red Bee Media, London (Retired in 2009)
•(All in cooperation with EBU)
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 7/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 7© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
1. Background Of the Research1.2. The Project "Digital Television For All" (DTV4All)
Cooperation
Separate Tasks
CLEAN AUDIO
Preparing and compilation of test sequences IRT
Pre-Tests RBB, UABTest organization RBB
REDUCED PLAYBACK SPEED
Preparing and compilation of test sequences IRTTest organization and evaluation UAB
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 8/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 8© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
An Extra TV Audio Track for Hard-Of-Hearing Viewers
1. Background Of the Research
2. Clean Audio1. Available Techniques for Signal Processing
2. Selection of Program Sequences for Evaluation
3. Votings by Concerned TV Viewers
4. Conclusions and Future Prospects3. Reduced Playback Speed
Overview
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 9/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 9© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
E x i st i ng Asse t w i t h F o o t ag e
E x i s t i n g
A s s e t w i t h
o u t F o o t a
g e
New P r o duc t i o n
L i f e C o m m e n t, N
o i s y
L i f e C o m m e n t & I T - c h a n n e l
O l d M o
v i eNe ws R
epor t On Si te
New s Show
Clean AudioClean Audio
Normal Audio
Clean AudioClean Audio
Normal Audio
2. Clean Audio
2.1. Available Techniques for Signal Processing
Non-suitable and suitable program material
Source Material
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 10/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 10© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
Providing Material
2. Clean Audio2.2. Selection of Program Sequences for Evaluation
Genres of Source Material
Movies
Television plays
Entertainment shows
Reports
Sports transmissions
Talk shows
News shows
Educational stuff
Sometimes with ambient noise Normally no ambient noise
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 11/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 11© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
2. Clean Audio
2.2. Selection of Program Sequences for Evaluation
----2x Cedar, level
reduced in
pauses
Normal audiosome indoor ambience, silent
musicconversation9
----2x Cedar, level reduced
in pauses Normal audiomostly music
ladie's voice and a girl outdoor
(film of a fairytale) 8
like "a", partially again
Cedar, noIzotope
like "a", with Izotope,
re-peatedlyCedar
1x-2x Cedar (edits) Normal audioenthusiastic crowd at a boxingmatchsports reporter (movie) 7
like "a", again Cedar,
no Izotope
like "a", with Izotope,
re-peatedly
Cedar
1x-2x Cedar (edits) Normal audioenthusiastic crowd at a boxing
matchsports reporter (movie) 6
--3x Cedar, level reduced
in pauses2x Cedar Normal audio
rural ambience,
men fighting, barking dog
normal and loud talking
(movie) 5
--Cedar + IzotpeCedar only Normal audioclicks in a coroner's roomslightly echoing dialogue
(TV_movie) 4
----2x Cedar, new setting
for radio-voice Normal audio
moderate ambience of a boxing
arena from a radio set
two ladies in a living room,
radio speaker (movie) 3
----
2x Cedar, a lot with
Izotope on the
music
Normal audioclicks by tableware, musicladie and girl in a dining room
(film of a fairytale) 2
----
rumbling, no atmo,1x
Cedar,Izotope
on piano ones
Normal audioindoor ambience, piano tonesdialogue in an aisle of a
hospital (tv_movie) 1
4th segment "c"3rd segment "b"2nd segment "a"1st segment "N"audio to rejectaudio to keepItem
Content of the itemsSoundtrack
Test Items
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 12/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 12© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
2. Clean Audio
2.2. Selection of Program Sequences for Evaluation
Test Helpers Onscreen
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 13/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 13© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
2. Clean Audio2.3. Votings by Concerned TV Viewers
2.31.94.24.04.04.54.43.74.053.13.13.72.22.73.33.82.52.6#1,#2,#4 out
2.72.54.34.14.14.34.43.94.34.73.63.63.62.62.93.44.22.72.5All subj.
Averages:
2132123255212212220#18
224555555533.5422.53332.5#17
2252254326444223022#16
4244244243424324203#15
112222.5321.545.54.53.522.52424#14
0033233324323233202#13
2.5155.55.55.5556655.55.533.53.55.51.51.5#12
3266666666222222622#11
2244554556234234443#10
1266666335522223522#9
3266666656333333623#8
2235554345255255443#7
3444554.54.54.5533.5433.54.5434#6
3243555356235234002#5
3.5466666666666566600#4 out
2243233323124124222#3
5655526662662552660#2 out
5632421362662423601#1 out
c ba Nc ba N ba N ba N
I9I8I7I6I5I4I3I2I1subj. nr
All Scores
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 14/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 14© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
2. Clean Audio2.3. Votings by Concerned TV Viewers
Ranking by Scores
+_____|++____|++____|++____|+_____| Noise in "Normal"
1414131214(Sum)
00400 bad
51546average
913481Good to very good
AnswersAnswersAnswersAnswersAnswers
Item 9Item 8Item 3Item 2Item 1
Pair Comparison results
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 15/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 15© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
2. Clean Audio2.3. Votings by Concerned TV Viewers
Ranking by Scores
+++++_|+++++_|++____|++____| Noise in
"Normal"
15151515151515151515(Sum)
2002012102Worse than
normal
61094446645Same as normal
7569111078119Better than
normal
1213544342
2 or more
grades
better
AnswersAnswersAnswersAnswers
c bac ba ba ba
Item 7Item 6Item 5Item 4
Multiple Comparison results
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 16/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 16© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
Example: User Interface
█ █ █ █ █ █ █ _ _ _ _ _ _ _ FADER
Slightly CLEANBACKGROUND LEVEL
Ambience when not spokenBACKGROUND LEVEL
Silence when not spokenAGC
NORMAL
SELECT ◄ ► INTENSITY ☻ EXIT ►◄
2. Clean Audio2.4. Conclusions and Future Prospects
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 17/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 17© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
2. Clean Audio2.4. Conclusions and Future Prospects
Application
To many hard-of hearing people the advantage of Clean Audio is proven.
Even when small quality impairments occur by post-processed 'cleaning'.
The acceptance could cause to start developments of automated systems,the first step is to simplify the workflow
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 18/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 18© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
An Extra TV Audio Track for Hard-Of-Hearing Viewers
1. Background Of the Research
2. Clean Audio
3.Reduced Playback Speed1.Aspects for Telecasts
2.Evaluation of Intelligibility
3.Conclusions and Future Prospects
Overview
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 19/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 19© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
3. Reduced Playback Speed3.1. Aspects for Telecasts
Test Setup
A test concerning acoustical and visual perceptance:
•Test in a laboratory environment
•1. part audio with video; 2. part video only
•8 items of about one minute durance in normal playing speed•Presented playing speeds 100%, 90%, 80%,70%
•Pair comparisons of different items at different speeds
•Content are different reports, talkshows with current themes
•Evaluation by eye-tracking system and questionaires
•Detailed questions about understanding the content
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 20/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 20© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
3. Reduced Playback Speed3.2. Evaluation of Intelligibility
Comparison Test Scheme
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 21/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 21© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
3. Reduced Playback Speed3.2. Evaluation of Intelligibility
Questionaire
Test material contains meanings and opinions on current affairs and
politics, which the subjects will understand more or less, related to
intelligibility
Test of intelligibility by questions on
details of the shown statements
Statements in the questionaire to answer with
"True/false"
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 22/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 22© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
3. Reduced Playback Speed3.2. Evaluation of Intelligibility
Sample of evaluation chart
"correction" is related to the questions with [Y/N]
being right-or-wrong statements
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 23/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 23© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
3. Reduced Playback Speed3.2. Evaluation of Intelligibility
When all answers were correct
3140
Results of video only
(Dumb Condition)
5131Sum
ALL8
ALLALL7
ALL6
5
4
ALLALL3
ALLALL2
ALLALL1
70%80%90%100%# of Video
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 24/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 24© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
3. Reduced Playback Speed3.3. Conclusions and Future Prospects
Application
In case of talk shows, news shows etc.
Permament flow of information = talking. Just play all at Reduced Playback Speed:
Nothing to be done by the broadcasters
The receiver plays slowly according to user setting
In case of movies, some entertainment shows etc.:
Only Short phrases for Reduced Playback Speed, mostly no information for understanding:
Broadcast a control signal during dialog partThe Settop box will stretch dialog parts only, and overlap a little bit before and after
Over-all playing time is not prolonged
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 25/26
TMT Nov.28, 2010 UAB - Pilar Orero, Marta Miquel Iriarte
S. 25© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
Clean Audio
And
Reduced Playback Speed
Might even be useful tools in combination….
Application
8/7/2019 An Extra TV Audio Track for Hard-Of-Hearing Viewers
http://slidepdf.com/reader/full/an-extra-tv-audio-track-for-hard-of-hearing-viewers 26/26
TMT Nov.28, 2010
© IRT - Martin Link, RBB - Bettina Heidkamp-Tchegloff, Sven Glaser
UAB - Pilar Orero, Marta Miquel Iriarte
Thank-You for Your Attention.
Institut für Rundfunktechnik
Floriansmühlstraße 60
80939 München
Tel. +49-(0)89 32399 458
Fax +49-(0)89 32399 351
E-Mail: [email protected] and documents are protected by copyright law. Any kind
of reproduction is not allowed without permission of the author.
This copyright notice may not be removed.
Martin Link
Audio Production Systems