A Network-based End-to-End Trainable Task-oriented ...€¦ · Dialogue Systems Group A...

Dialogue Systems Group

A Network-based End-to-End Trainable Task-oriented Dialogue System

Deep Learning Summer school, 05 Aug 2016

Tsung-Hsien (Shawn) Wen

Outline

Intro

Neural Dialogue System

Wizard-of-Oz Data Collection

Experiments

Conclusion

2

Outline

Intro



Experiments

Conclusion

3

The two paradigms4

Goal-oriented Dialogue Systems

The two paradigms4


Help the user to accomplish domain tasks

The two paradigms4



Domain specific, hard to collect data

The two paradigms4




Current Systems

Modular, highly handcrafted, restricted ability

The two paradigms4




Current Systems


Can we train a dialogue system on a small dataset w/ a minimal amount of handcrafting?

The two paradigms4




Current Systems


Can we train a dialogue system on a small dataset w/ a minimal amount of handcrafting?

How can we collect data to train this model?

Outline

Intro



Experiments

Conclusion

5

Traditional Dialogue Systems6

Language Understanding

DialogueManager

DB

Ontology

Dialogue System

Language Generation

text

text

Neural Dialogue Systems7

DB

Ontology


text

text

Can I have <v.food>

Korean 0.7British 0.2French 0.1

…

Belief Tracker

0 0 0 … 0 1

MySQL query:“Select * where food=Korean”

Database Operator

Intent Network

Can I have <v.food>

Generation Network

<v.name> serves great <v.food> .

Policy NetworkCopy field

…

Database

Seven d

ays

Cu

rry Prin

ce

Nirala

Ro

yal Stand

ard

Little Seuo

l

DB pointerxt

zt

pt

qt

Intent Network

Can I have <v.food>

Generation Network


zt

Seq2Seq

Can I have <v.food>


…

Belief Tracker

Intent Network

Can I have <v.food>

Generation Network


zt

pt

Language Grounding

Can I have <v.food>


…

Belief Tracker

0 0 0 … 0 1


Database Operator

Intent Network

Can I have <v.food>

Generation Network


…

Database

Seven d

ays

Cu

rry Prin

ce

Nirala

Ro

yal Stand

ard

Little Seuo

l

DB pointerxt

zt

pt

qt

Database Accessing

Can I have <v.food>


…

Belief Tracker

0 0 0 … 0 1


Database Operator

Intent Network

Can I have <v.food>

Generation Network


Policy Network

…

Database

Seven d

ays

Cu

rry Prin

ce

Nirala

Ro

yal Stand

ard

Little Seuo

l

DB pointerxt

zt

pt

qt

Decision Making

Can I have <v.food>


…

Belief Tracker

0 0 0 … 0 1


Database Operator

Intent Network

Can I have <v.food>

Generation Network


Policy NetworkCopy field

…

Database

Seven d

ays

Cu

rry Prin

ce

Nirala

Ro

yal Stand

ard

Little Seuo

l

DB pointerxt

zt

pt

qt

Outline

Intro



Experiments

Conclusion

14

Wizard of Oz Data Collection15

Online parallel version of WOZ on MTurk



Randomly hire a worker to be user/wizard.




Task: Enter an appropriate response for ONE TURN.





Repeat the process until all dialogues are finished.






Advantage:






Advantage:

Avoid latency, parallelisable, cheap


1

Task: Find a restaurant, cheap, Korean, NorthAsk phone number


Hi, I want a cheap Korean restaurant.

1




1


1



1


1

What user wants?

Food Korean

Price Cheap

Area N/A



1


1

What user wants?

Food Korean

Price Cheap

Area N/A

Search Table

Little Seoul …

Best Korea …

…



What area are you looking for ?

1


1

What user wants?

Food Korean

Price Cheap

Area N/A

Search Table

Little Seoul …

Best Korea …

…




2





Somewhere in the north.

2


2





2


2

What user wants?

Food Korean

Price Cheap

Area North





2


2

What user wants?

Food Korean

Price Cheap

Area North

Search Table

Little Seoul …





Little Seoul is nice one in the north.2


2

What user wants?

Food Korean

Price Cheap

Area North

Search Table

Little Seoul …





Little Seoul is nice one in the north.

Its phone number is 01223456789.

What is the phone number?

Thank you very much, good bye.

Thank you for using the system.

4


4

What user wants?

Food Korean

Price Cheap

Area North

Search Table

Little Seoul

…





Little Seoul is nice one in the north.

Its phone number is 01223456789.

What is the phone number?

Thank you very much, good bye.

Thank you for using the system.

What user wants?

Food Korean

Price Cheap

Area North

Data Statistics20

Ontology:

Data Statistics20

Ontology:

Cambridge restaurant domain, 99 venues.

Data Statistics20

Ontology:


3 informable slots: area, price range, food type

3 requestable slots: address, phone, postcode

Data Statistics20

Ontology:




Dataset

Data Statistics20

Ontology:




Dataset

676 dialogues, ~2750 turns

Data Statistics20

Ontology:




Dataset


3000 HITS, takes 3 days, costs ~400 USD

Data Statistics20

Ontology:




Dataset


3000 HITS, takes 3 days, costs ~400 USD

Data cleaning takes 2-3 days for one person

Outline

Intro



Experiments

Conclusion

21

Experiments22

Experimental details

Train/valid/test: 3/1/1

SGD, l2 regularisation, early stopping, gradient clip=1

Hidden size = 50, Vocab size: ~500

Experiments22





Two stage training:

Training trackers with label cross entropy

Training other parts with response cross entropy

Experiments22





Two stage training:

Training trackers with label cross entropy

Training other parts with response cross entropy

Decoding

Beam search w/ beam width 10

Decode with average word likelihood

Human evaluation23

System Comparison

Example dialogues24

Visualising action embedding25

Outline

Intro



Experiments

Conclusion

26

Conclusion

An end-to-end trainable task-oriented dialogue system architecture is proposed.

27

Conclusion


A complementary WOZ data collection is also proposed (no latency, parallel, cheap).

27

Conclusion


A complementary WOZ data collection is also proposed (no latency, parallel, cheap).

Results show that it can learn from human-human conversations and help users to complete tasks.

27

The paper

Tsung-Hsien Wen, David Vandyke, Nikola Mrksic, Milica Gasic,Lina M.R. Barahona, Pei-Hao Su, Stefan Ultes, and SteveYoung. A Network-based End-to-End Trainable Task-orientedDialogue System. arXiv preprint: 1604.04562 2016.

28

Dialogue Systems Group

Thank you! Questions?

Tsung-Hsien Wen is supported by a studentship funded by Toshiba Research Europe Ltd, Cambridge Research Laboratory

Response Generation Task30

Model Match (%) Success (%) BLEU

Seq2Seq [Sutskever et al, 2014] - - 0.1718

HRED [Serban et al, 2015] - - 0.1861

Our model w/o req. trackers 89.70 30.60 0.1799

Our full model 86.34 75.16 0.2313

Our full model + attention 90.88 80.02 0.2388

Example dialogues31

Jordan RNN-CNN belief trackers

1st conv. 2nd conv. 3rd conv. max-pool avg-pool

User turn t System turn t-1

Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

Jordan RNN

<nil>

I

want

v.food

s.food

<nil>

sentence representation

32

<nil>

I

want

Korean

food

<nil>


Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

British French Korean … Chinese

33


Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

<nil>

I

want

v.food

s.food

<nil>


33


Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

<nil>

I

want

v.food

s.food

<nil>


33

Memorisethe delex. position


1st conv.

Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

<nil>

I

want

v.food

s.food

<nil>


33


1st conv.

Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

<nil>

I

want

v.food

s.food

<nil>


33

Pad zeros to have the

same length


1st conv. 2nd conv.

Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

<nil>

I

want

v.food

s.food

<nil>


33


1st conv. 2nd conv. 3rd conv.

Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

<nil>

I

want

v.food

s.food

<nil>


33


1st conv. 2nd conv. 3rd conv. max-pool

Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

<nil>

I

want

v.food

s.food

<nil>


33



Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

<nil>

I

want

v.food

s.food

<nil>



33



Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

<nil>

I

want

v.food

s.food

<nil>



1.3

33



Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

<nil>

I

want

v.food

s.food

<nil>



1.3

33

Slot-specific delex. ngram

feature



Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

<nil>

I

want

v.food

s.food

<nil>



1.3

33

Slot-specific delex. ngram

feature

Value-specific delex. ngramplaceholder



Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

<nil>

I

want

v.food

s.food

<nil>



1.3 2.3

33



Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

<nil>

I

want

v.food

s.food

<nil>



1.3 2.3 9.7

33



Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

<nil>

I

want

v.food

s.food

<nil>



1.3 2.3 9.7

33

Value-specific delex. ngram

feature



Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

<nil>

I

want

v.food

s.food

<nil>


…


1.3 2.3 9.7 1.2

33



Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

<nil>

I

want

v.food

s.food

<nil>


…

British French Korean … Chinese.01 .02 .85 .01

33



Turn tInput layer

Output layer

Hidden layer

Delexicalised CNN

<nil>

I

want

v.food

s.food

<nil>


…

British French Korean … Chinese.01 .02 .85 .01

33

[Henderson et al, 2014]

A Network-based End-to-End Trainable Task-oriented ...€¦ · Dialogue Systems Group A...

Documents

Transcript of A Network-based End-to-End Trainable Task-oriented ...€¦ · Dialogue Systems Group A...