Subtitles are Enough and Other Stories - Research Report

61
What Russian players think makes a good localization: research report Anastasia Kosareva, Demid Tishin Barcelona 2015

Transcript of Subtitles are Enough and Other Stories - Research Report

Page 1: Subtitles are Enough and Other Stories - Research Report

What Russian players think makes a good localization: research reportAnastasia Kosareva, Demid TishinBarcelona 2015

Page 2: Subtitles are Enough and Other Stories - Research Report

Session outlinePresentation• Research background, goals and design• Overview of survey respondents • Summary of responses• Focus group: hypotheses and key findings• Summary• Lessons learned• Future steps

Discussion• Application scenarios

Page 3: Subtitles are Enough and Other Stories - Research Report

Why research?• Establish communication with end-users• Identify bottlenecks in localization production• Improve workflows on dev side and loc side• Improve image of localization vendors in

gaming community

Page 4: Subtitles are Enough and Other Stories - Research Report

Objectives

• Publish research summary for all stakeholders as widely as possible

• Involve publishers in discussion• Update own work instructions and loc

specification defaults

Page 5: Subtitles are Enough and Other Stories - Research Report

Design• Open survey on a major gaming portal– www.riotpixels.ru– 1800+ responses– 95% responses gathered over 1 week

• Representative focus-group– 100 respondents matching publicly available

player distribution reports (gender, age and platforms)

– Respondents with more detailed answers were preferred

– Inductive analysis– Hypotheses testing

Page 6: Subtitles are Enough and Other Stories - Research Report

The respondents

Page 7: Subtitles are Enough and Other Stories - Research Report
Page 8: Subtitles are Enough and Other Stories - Research Report
Page 9: Subtitles are Enough and Other Stories - Research Report

Do they care?

Page 10: Subtitles are Enough and Other Stories - Research Report
Page 11: Subtitles are Enough and Other Stories - Research Report
Page 12: Subtitles are Enough and Other Stories - Research Report
Page 13: Subtitles are Enough and Other Stories - Research Report
Page 14: Subtitles are Enough and Other Stories - Research Report
Page 15: Subtitles are Enough and Other Stories - Research Report

Localization depth

Page 16: Subtitles are Enough and Other Stories - Research Report
Page 17: Subtitles are Enough and Other Stories - Research Report
Page 18: Subtitles are Enough and Other Stories - Research Report
Page 19: Subtitles are Enough and Other Stories - Research Report

Voiceover

Page 20: Subtitles are Enough and Other Stories - Research Report
Page 21: Subtitles are Enough and Other Stories - Research Report
Page 22: Subtitles are Enough and Other Stories - Research Report
Page 23: Subtitles are Enough and Other Stories - Research Report

RU voiceovers they love

Page 24: Subtitles are Enough and Other Stories - Research Report

Best voiceovers, 100 respondents

Page 25: Subtitles are Enough and Other Stories - Research Report

RU voiceovers they hate

Page 26: Subtitles are Enough and Other Stories - Research Report

Worst voiceovers, 100 respondents

Page 27: Subtitles are Enough and Other Stories - Research Report

And the winners are…

Page 28: Subtitles are Enough and Other Stories - Research Report

Best voiceovers (net score) 100 respondents

Page 29: Subtitles are Enough and Other Stories - Research Report

Text localization – fluency

Page 30: Subtitles are Enough and Other Stories - Research Report
Page 31: Subtitles are Enough and Other Stories - Research Report
Page 32: Subtitles are Enough and Other Stories - Research Report
Page 33: Subtitles are Enough and Other Stories - Research Report
Page 34: Subtitles are Enough and Other Stories - Research Report
Page 35: Subtitles are Enough and Other Stories - Research Report
Page 36: Subtitles are Enough and Other Stories - Research Report

Text localization – accuracy

Page 37: Subtitles are Enough and Other Stories - Research Report
Page 38: Subtitles are Enough and Other Stories - Research Report
Page 39: Subtitles are Enough and Other Stories - Research Report
Page 40: Subtitles are Enough and Other Stories - Research Report
Page 41: Subtitles are Enough and Other Stories - Research Report
Page 42: Subtitles are Enough and Other Stories - Research Report
Page 43: Subtitles are Enough and Other Stories - Research Report

Text localization – design

Page 44: Subtitles are Enough and Other Stories - Research Report
Page 45: Subtitles are Enough and Other Stories - Research Report
Page 46: Subtitles are Enough and Other Stories - Research Report

Fan or official?

Page 47: Subtitles are Enough and Other Stories - Research Report
Page 48: Subtitles are Enough and Other Stories - Research Report

Focus group research

Page 49: Subtitles are Enough and Other Stories - Research Report
Page 50: Subtitles are Enough and Other Stories - Research Report

Pains

Page 51: Subtitles are Enough and Other Stories - Research Report

Mentions of localization issues, 100 respondents

Page 52: Subtitles are Enough and Other Stories - Research Report
Page 53: Subtitles are Enough and Other Stories - Research Report
Page 54: Subtitles are Enough and Other Stories - Research Report

Gains

Page 55: Subtitles are Enough and Other Stories - Research Report
Page 56: Subtitles are Enough and Other Stories - Research Report

Mentions of localization merits, 100 respondents

Page 57: Subtitles are Enough and Other Stories - Research Report

Some hypotheses we checked• Gamers with a higher proficiency in English prefer to play games in their

original language – confirmed• Women are more sensitive to gender-neutral address – not confirmed:

both men and women dislike it• Mobile gamers are more tolerant of errors than PC gamers –

controversial: close-type answers show that language fluency is equally important in the two groups, but mobile gamers were 4 times less active naming loc issues in open answers. Could be explained by less text in mobile games

• Hardcore gamers are more tolerant of gaming slang – confirmed • RPG gamers are less sensitive to abbreviations – not confirmed. Most

sensitive: simulation / tycoon players, least sensitive – arcade & puzzle players

• Hardcore gamers are less sensitive to memes – the opposite correlation shows. Could be explained by bigger immersion of hardcore gamers

Page 58: Subtitles are Enough and Other Stories - Research Report

Summary• Good localization is important for UX, but it’s not the decisive

factor in player's loyalty• Voiceover is appreciated – provided there’s a language switch,

and voices sound natural and match characters• Subtitles are crucial, and should match video• The majority of Russian players read all in-game text• Mistranslations are common and irritating • Bad fonts, truncations, abbreviations and gender-neutral

address all spoil UX• Russian players pay attention to text fluency, spelling and

grammar• Realisitic speech registers are crucial for UX• Swearings are generally appreciated, while gaming slang and

memes are a thumbs-down• Players lack means to give feedback on loc

[email protected]

Page 59: Subtitles are Enough and Other Stories - Research Report

Lessons learned• There’s little or no correlation between age /

gender / language proficiency and core responses

• Focus on correlations between platforms / genres / time spent on gaming and localization preferences instead

• Double-check questions for clarity• Use rubrics instead of open-type questions• Sampling – use multiple / general survey

platforms (Facebook?)

[email protected]

Page 60: Subtitles are Enough and Other Stories - Research Report

Future steps Involve publishers in discussion • Create a mailing list • Distribute research summary for all

stakeholders as widely as possible July 2015• Update own work instructions and loc

specification defaults • Initiate a wider-scale research• Project facilitation meeting:

Las Vegas QA & Loc Forum Dec 2015• Prepare and circulate a best practices paper

[email protected]

Page 61: Subtitles are Enough and Other Stories - Research Report

What can we change?• Give loc vendors more time • Give loc vendors more context (builds, please :)• Enable efficient communication between dev

and loc• Develop common requirements to localization

quality experts • Dev: go deep with loc engineering – language

switch, fonts, text resizing and grammatical tokens

• Loop back to loc vendor for overall check before release

[email protected]