Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in...
Transcript of Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in...
![Page 1: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/1.jpg)
Predicting code-switching
in Udmurt/Russian blogsMasha Medvedeva
s3026817
Methodology & Statistics
ReMa Language and Communication Technologies
2015/2016
![Page 2: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/2.jpg)
Code-mixing
Zentella: I’ll tell you exactly when I have to leave, at ten o’clock. Y son las nueve y cuarto. ("And it’s nine fifteen.”)
Marta: Lolita, te voy a dejar con Ana. ("I’m going to leave you with Ana.") Thank you, Ana.
![Page 3: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/3.jpg)
Code-mixing
> 4 000 000 000 bilinguals, trilinguals, etc
'Linguistic rubbish' or an area of linguistic study?
![Page 4: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/4.jpg)
Types of code-mixing
- insertion
- alternation
- congruent lexicalization
4
![Page 5: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/5.jpg)
Insertion
5
![Page 6: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/6.jpg)
Alternation
Sometimes I’ll start a sentence in Spanish y termino en español.
‘Sometimes I’ll start a sentence in Spanish and finish in Spanish.’6
![Page 7: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/7.jpg)
Congruent lexicaliztation
7
wan heri gedeelte de ondro beheer fu gewapende machten one wholepart cop under control of armed force“One whole part is under control of the armed forces.”
Dutch–Sranan (Bolle 1994:75, cited in Muysken 2000:139)
![Page 8: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/8.jpg)
Free-Morpheme Constraint*EAT - iendo
That’s what Papschi mein -s to say.
‘That’s what Papschi means to say.’
…in meine Mutter -s car.
‘In my mother’s car.’
8
![Page 9: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/9.jpg)
Equivalence ConstraintEl MAN que CAME ayer WANTS JOHN comprar A CAR nuevo.
The man who came yesterday wants … John to buy a new car.
| | | | | | Х | | X
El hombre que vino ayer quire… que John compre un coche nuevo
Equivalence constraint has been verified as a tendency in many language pairs:
Spanish/English (Poplack 1980), Finnish/English (Poplack et al. 1987), French/Arabic (Naït M’Barek & Sankoff 1988),
English/Tamil (Sankoff et al. 1990), Wolof/French and Fongbe/French (Poplack & Meechen 1995), Ukranian/English
(Budzhak-Jones 1995), French/English (Turpin 1998) and possibly more.
9
![Page 10: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/10.jpg)
10
http://web-corpora.net/UdmurtRussianCorpus/search/
![Page 11: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/11.jpg)
11
![Page 12: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/12.jpg)
Data- Udmurt/Russian
- 7 blogs - 146,000 tokens - 18967 sentences - 5615 sentences contain code-mixing (30%)
- EANC platform - mystem (Russian), UniParser (Udmurt)
12
![Page 13: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/13.jpg)
Corpus Examples: InsertionПуко пиосмуртъёс юыса ужзы бере и ми отын ӟабыльтӥськом
удмурт сяин.
‘Men are sitting, drinking before work and meanwhile we are there
talking in Udmurt.
Атае третий десяток пошёл шуыса шоккетӥз.
‘~Father is in his thirties now, that’s what they say.’13
![Page 14: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/14.jpg)
Corpus Examples: Congruent LexicalizationОкно - со стекло прозрачное, адӟиськод, мар луэ со сьӧрын, а
чтобы лэсьтыны сое зеркало и чтобы адӟыны астэ гинэ и не
замечать, мар луэ вокруг стеклоез покрытьтоно сереброен.
A window has a transparent glass, you can see through it what's going on, and if you want to make a mirror out of it, to see just yourself, and not
notice what's around, the glass has to be covered with silver.
14
![Page 15: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/15.jpg)
Annotation
15
![Page 16: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/16.jpg)
Information Retrieval
16
![Page 17: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/17.jpg)
Additional annotation: congruent lexicalization
17
![Page 18: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/18.jpg)
Triggering: Chi-square
18
![Page 19: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/19.jpg)
Logistic Regression
- binary dependent variable - categorical independent variables - not normally distributed
19
![Page 20: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/20.jpg)
Logistic Regression
20
![Page 21: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/21.jpg)
Logistic Regression
21
![Page 22: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/22.jpg)
Logistic Regression
22
![Page 23: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/23.jpg)
Logistic Regression: Triggering vs POS
23
![Page 24: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/24.jpg)
Logistic Regression: POS vs Triggering + POS
24
![Page 25: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/25.jpg)
Logistic Regression: Triggering vs Triggering + POS
25
![Page 26: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/26.jpg)
Best Model
26
![Page 27: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/27.jpg)
Conclusion
- Trigger words facilitate code-switching
- Some parts of speech are more likely to be switched than others
27
![Page 28: Predicting code-switching in Udmurt/Russian · PDF filePredicting code-switching in Udmurt/Russian blogs Masha ... (Poplack & Meechen 1995), Ukranian/English (Budzhak-Jones ... to](https://reader035.fdocuments.net/reader035/viewer/2022062401/5a78bd157f8b9aa17b8bd3a2/html5/thumbnails/28.jpg)
photo by Maxim Medvedev
Questions?