Download - English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Transcript
Page 1: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

English Learner Dialogue Corpus and Applications

Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana SHIMOTORI,

Tomohito NAKANO, Maksim TIKHONENKO, Masaki MURAI, Yuna YAMAMOTO (Tokyo University of Foreign Studies)

1

Page 2: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Structure of the Presentation1. Project Outline

2. Case Study: The Situation at Joto High School

3. Platform Development

4. Academic Collaboration: Video Resources at TUFS

5. Data Processing

2

Page 3: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

1. Project OutlineLaurence NEWBERY-PAYTON

3

Page 4: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Challenges for English Education in Japan: How do Schools…

A) adapt to the incoming university entrance exam system?

B) improve studentsʼ productive language skills?

C) use ICT to augment English education programs?

4

Page 5: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Professional & Academic Collaboration• TUFS research group higher education

• High Schools (Nagano, Tokushima) secondary education

• Sankei Human Learning; industryLingua House Institute for Education

⇒ long-distance, interactive English education with support from higher education and business

A new model?

5

Page 6: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Teachers & Class Structure• Monthly lessons with teachers based in the Philippines

• High schools provided with webcams & headsets

• Lessons recorded as part of publicly-funded two year longitudinal research*

*KAKEN “Research on cross-referential learners' corpora of English, Chinese and Japanese though international educational collaboration at secondary and tertiary levels” (17H02357)

6

Page 7: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Individual Lessons with Teachers in the Philippines

7

Page 8: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Participants• First year high school students

• Nagano Prefectural Ueda Senior High School (18)• Tokushima Prefectural Joto Senior High School (32)

• Collect information on studentsʼ motivations, goals, study methods etc.

⇒do these variables affect studentsʼ subsequent progress?

8

Page 9: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Resources• Online resources developed at TUFS

• Textbook• Audio files (World Englishes)

• Focus on productive skills• Speaking• Writing

• Focus on interaction• Feedback from teachers• Feedback from TUFS• Feedback from students

9

Page 10: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Resources

10

0. Preparation: Students write a short essay and prepare answers to the class questions ⇒Maximize speaking time in class

1. Dialogue: Students listen to the dialogue online before class⇒Contact with World Englishes

3. Practice: Students are free to express themselves, thanks to their earlier preparation

4. Understanding Other Cultures: Provides cultural background and know-how⇒Spark studentsʼ interest in a range of topics

Page 11: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Sharing Resources in Real-Time

11

Page 12: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

2. Case Study: The Situation at Joto High SchoolTomohito NAKANO

12

Page 13: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Tokushima Prefectural Joto High School

Page 14: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

• Biggest challenge; Adopting to the incoming university entrance exam system

•How to enhance four skills? → issue; few times to speak English

e.g.) English class with ALT・1st grade student→once/wk. ・3rd grade student→none

Page 15: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

What teachers are trying • “One-minute talks” in the beginning of the class

• Preparing for the speaking test (Eiken test) with ALT

• English debate competition with other schools

• Interaction with students in Indonesia or France

Page 16: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Speaking education in Tokyo• Top high schools →one-to-one online English conversation class

• All the public high schools→English classes with ALT once a week in every grade

Huge education gap between Tokushima and Tokyo

Page 17: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Implementation of our project in Joto• First online lesson… Nov 12th 2018→ Seven times so far

• From feed back from students…・Students enjoy and feel more comfortable to speak English.・Their attitude towards lessons makes them motivated to study English.

Page 18: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

3. Development of an E-Learning Platform for Two-Way CommunicationZHANG Zheng

18

Page 19: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Sankei Human Learning Filipino tutors

High school students

TUFS GLEXA

ZOO

Mone-on-one English conversations

writing/speaking feedback, supplementary videos,student survey…

19

Page 20: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Unit Outline• Step 1: Preparation

A) Text and dialogueB) Mini essay

• Step 2: Online LessonSupport from TUFS and Sankei

• Step 3: FeedbackA) Speaking feedback (from teachers)B) Writing feedback (English native speakers at TUFS)

• Step 4: Student SurveyConducted online

• Step 5: Support from TUFS studentsSupplementary videos

E-Portfolio

20

Page 21: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Step 1: PreparationText and dialogue

21

Page 22: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Step 1: PreparationMini essay, Writing support

22

Page 23: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Step 2: Online Lesson

23

Page 24: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Step 3: FeedbackWriting feedback (English native speakers at TUFS)

24

Page 25: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Step 3: FeedbackSpeaking feedback (from teachers in the Philippines)

25

Page 26: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Step 4: Student Survey

26

Page 27: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Step 5: Support from TUFS students

27

Page 28: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

4. Academic Collaboration: Video Resources at TUFSYuri AMANO, Kaoru IMAI & Maksim TIKHONENKO

28

Page 29: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

The Role of University Students at TUFS As university students and exchange students…

We devised and recorded videos for the high school students

29

Page 30: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Purpose of the Videos

The best way to teach or give advice →one-on-one conversation

But due to limited resources…→ videos for students to watch remotely

30

Page 31: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Sharing Videos• Through the e-learning system → Glexa

31

Page 32: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Goals1. Have participants learn more about different cultures,

and see Japan from other perspectives

2. Give feedback about grammar and language usage

3. Give advice about studying English

32

Page 33: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Content of the Videos 11. Cultural differences between Japanese and other cultures

Ex.) food, extracurricular activities…

(Have them learn more about different cultures and see Japan from other perspectives)

33

Page 34: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

34

Page 35: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Content of the Videos 22. ・How to correct mistakes seen in the writing assignments

・Points to be careful about, related to studentsʼ comments and feedback

(Give feedback about grammar and language usage)

35

Page 36: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

36

Page 37: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Content of the Videos 33. Messages to the students about how they can enjoy studying English

→ important contributions from the collaboration between high school and university

(Give advice about studying English)

37

Page 38: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

38

Page 39: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Teaching English as a Non-Nativel Image of English teachers as native speakers

l But more likely to converse with non-native speakers

à Students need to get used to other accents

Page 40: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Teaching English as a Non-Nativel Japanese students often know little about non English-

speaking countries

àTeach students about cultural differences, which may be large

Page 41: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

41

Page 42: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Summaryl Main purposes of the videos

l teach about other cultures

l provide feedback

l give advice for studying English

l Future directions

l Create one video for each chapter

l Benefits for university students

Ø Make use of project data for undergraduate/graduate research

Page 43: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

5. Data ProcessingMasaki MURAI & Yuna YAMAMOTO

43

Page 44: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Transcription and Annotation• Follow NICT JLE Corpus guidelines:

• Filler, repetition, self correction etc.• Cut off, overlap etc.• Non-verbal sound, laughter etc.

• Source: https://alaginrc.nict.go.jp/nict_jle/index_E.html

• Additional Tags: • Facial expressions (confused, smiling, surprise…)

44

Page 45: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Preliminary Transcription

repetition

hesitation, filler

45

Page 46: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Going Forward• Annotate data with appropriate tags• Create database with:

A) TextB) AudioC) Video

46

Page 47: English Learner Dialogue Corpus and Applications...English Learner Dialogue Corpus and Applications Keiko MOCHIZUKI, Laurence NEWBERY-PAYTON, ZHANG Zheng, Kaoru IMAI, Yuri AMANO, Kana

Project members

47

Thank you for your attention! We hope to receive your comments and advice!