The Course of Emotion in Three Centuries of German Text · Sven Buechel, Johannes Hellrich and Udo...

Digital Humanities 2017 August9,2017,Montreal,Canada

Sven Buechel, Johannes Hellrich and Udo Hahn TheCourseofEmotioninThreeCenturiesofGermanText 1

The Course of Emotion in Three Centuries of German Text

A Methodological Framework

Sven Buechel1, Johannes Hellrich1,2 and Udo Hahn1

2 Graduate School ’The Romantic Model’

http://www.modellromantik.uni-jena.de

Friedrich Schiller University Jena, Jena, Germany

1 Jena University Language & Information Engineering (JULIE) Lab

http://www.julielab.de



Motivation: Emotion in the Humanities

http://www.br.de/telekolleg/faecher/deutsch/literatur/goethe-weimarer-klassik-100.html

https://de.wikipedia.org/wiki/Laokoon-Gruppe

https://de.wikipedia.org/wiki/Der_Schrei



Resource Problem in Sentiment Analysis

Contemporary Resources Historical Resources

?



Methodological Framework

lexicon

lexiconadapt+expand applyforemotionanalysis

modern historicallyadapted

historicaltext



Methods



Representing Emotion: VAD

−1.0 −0.5 0.0 0.5 1.0−1.0

−0.5

0.0

0.5

1.0

−1.0

−0.5

0.0

0.5

1.0

●

●

●●

●

●

Anger

SurpriseDisgust

Fear

Sadness

Joy

Valence

(displeasure—pleasure)

Dominance

(incontrol—

beingcontrolled)



Emotion Lexicons

• Lexical resources

• Store emotion values of individual words

• Many lexicons available from psychology

Lemma Valence Arousal Dominance

sunshine 8.1 5.3 5.4

terrorism 1.6 7.4 2.7

calm 6.9 1.7 7.4

(Warriner etal.,2013)

(1-to-9scales)



Lexicon Expansion

mouse

filth rat computer keyboard

• Automatic expansion based on Seed

• Turney-Littman-Algorithm:



Measuring Similarity: Word Embeddings

• Dominant approach to similarity

• Dense, low-dimensional vectors as word representation

• Most common: word2vec (SGNS) (Mikolov et al., 2013)

• SVDPPMI supposedly better suited for humanities (Levy et al.,

2015, Hellrich & Hahn, 2016)

Ø Johannes’ talk for details!(Friday, 9am, LP-26)

read

listen

novel

poem

opera

song



Classical Expansion Methodology

contemp.corpus

contemp.embeddings expansion

contemp.expandedlexicon

contemp.lexicon



Modifications to Expansion Methodology

historicalembeddings expansion

expanded+adaptedLexicon

contemp.lexicon

historical.corpus



Intuition of Temporal Adaptation (Before)

mouse




Intuition of Temporal Adaptation (After)

mouse




Experiments I(Lexicon Induction)




lexicon



historicaltext



Resources

• Seed Lexicon:– ANGST (Schmidtke et al. (2014)

– A thousand German word-emotion pairs– Well established acquisition methodology

• Target corpus:– Deutsches Textarchiv (DTA) [“German Text Archive”]– Balanced and manually transcribed – Rich meta-data (e.g., genre and subgenre)



Target Corpus: DTAIm DTA verfügbare Werke

nach Genre und Dekade

Belletristik Gebrauchsliteratur Wissenschaft

1601ff.

1611ff.

1621ff.

1631ff.

1641ff.

1651ff.

1661ff.

1671ff.

1681ff.

1691ff.

1701ff.

1711ff.

1721ff.

1731ff.

1741ff.

1751ff.

1761ff.

1771ff.

1781ff.

1791ff.

1801ff.

1811ff.

1821ff.

1831ff.

1841ff.

1851ff.

1861ff.

1871ff.

1881ff.

1891ff.

1901ff.

0

50

100

150Werke

Documents

1600s 1700s 1800s 1900s

AcademiaFunctionalBelleslettres

• 1st third shows different genre distribution

• Individual decades comprise too little text

Ø Aggregate 30-years slices

Ø Select 1690-1899 (~ 1k documents, 7 slices)

http

://www.deutsches-te

xtarchiv.de/doku/textauswahl



Affective Course of Sünde [Sin]

• Strong increase in Valence since onset of Enlightenment

• Backing up our findings with corpus linguistics…

1705 1735 1765 1795 1825 1855 1885

−4

−2

0

2

4

Year

Stan

dard

Dev

iatio

ns

● ●● ●

●

●●

●●

● ●

●● ●

●●

●

● ●

●●

ValenceArousalDominance



Top 10 Collocations for Sünde [Sin]

RankLemmaandTranslation

1690s 1890s

1 todt- death(prefixuse) Lamm lamb

2 Erzürnung infuriation hinwegnehmen totakeaway

3 läßlich minor(clerical) Verzeihung forgiveness

4 beichten toconfess Ausschweifung excess

5 Nachlaß abatement Gotte god

6 Grobheit crudeness Schande shame

7 verschweigen toconceal Reue repentance

8 beweinen tobeweep Ärgernis nuisance

9 pichen topitch Laster vice

10 beichten toconfess aufrichtig sincere



Experiments II(Application to Historical Text)




lexicon



historicaltext



Sentence-Level Emotion Prediction: JEMAS

Available: https://github.com/JULIELab/JEmAS

(Buechel&Hahn,ECAI2016)

(sunshine,<8,3,5>)

(terrorism,<2,7,3>)

(calm,<7,2,7>)

fulltext

documentslinguistic

normalization

BOW

representation

wordemotion lexicon

VADscore

calculation



Distinction of DTA Main Classes

Belles LettresAcademic

−8 −4 0 2 4

−4−2

02

Valence

Arousal

−4 −2 0 2

−40

24

ArousalD

omin

ance

−8 −4 0 2 4

−40

24

Valence

Dom

inance



Distinction between Principal Literary Forms

−8 −4 0 2 4

−4−2

02

Valence

Arousal

LyricNarrativesDrama

−4 −2 0 2

−40

24

Arousal

Dom

inan

ce

−8 −4 0 2 4

−40

24

ValenceDom

inance



Distinction of Academic Subclasses

−8 −4 0 2 4

−4−2

02

Valence

Arousal

−8 −4 0 2 4

−40

24

Valence

Dom

inance

−4 −2 0 2

−40

24

ArousalD

omin

ance

LawPhilosophyMathematicsTechnologyPhysics



Development of Literary Forms (1690-1719)

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

●Lyric Narrative Drama

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2−3

−11

3

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1−3

−11

3Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal





−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal


−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2−3

−11

3

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1−3

−11

3

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal





−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal


−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2−3

−11

3

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1−3

−11

3

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal





−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal


−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2−3

−11

3

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1−3

−11

3

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal





−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal


−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2−3

−11

3

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1−3

−11

3

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal





−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal


−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2−3

−11

3

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1−3

−11

3

Dominance

Arousal




Development of Literary Genres (1870-1899)

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal


−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2

−3−1

13

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal

−4 0 2

−3−1

1

Valence

Arousal

−4 0 2−3

−11

3

Valence

Dom

inance

−3 −1 1

−3−1

13

Dominance

Arousal




Conclusion



Conclusion

• Methodological framework for quantifying emotion in non-contemporary text

• Combination of temporally-specific lexicon expansion and lexicon-based emotion analysis

• Application to German historical corpus as proof of concept

• Qualitative validation on word and text level

Ø Genres show distinct and dynamic emotional patterns!

Ø Resources available: https://github.com/JULIELab/HistEmo



The Course of Emotion in Three Centuries of German Text

A Methodological Framework

Sven Buechel1, Johannes Hellrich1,2 and Udo Hahn1

2 Graduate School ’The Romantic Model’

http://www.modellromantik.uni-jena.de

Friedrich Schiller University Jena, Jena, Germany

1 Jena University Language & Information Engineering (JULIE) Lab

http://www.julielab.de

The Course of Emotion in Three Centuries of German Text · Sven Buechel, Johannes Hellrich and Udo...

Documents

Transcript of The Course of Emotion in Three Centuries of German Text · Sven Buechel, Johannes Hellrich and Udo...