Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE...
-
date post
21-Dec-2015 -
Category
Documents
-
view
221 -
download
2
Transcript of Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE...
![Page 1: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/1.jpg)
Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain
Dan Bohus, Alex Rudnicky
MITRE Workshop on Dialog Management,Boston, October 2003
![Page 2: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/2.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
Overall Architecture
ParsingPHOENIX/HELIOS
Dialog Manag.RAVENCLAW
Back-end(perl)
Language Gen.ROSETTA
RecognitionSPHINX
SynthesisFESTIVAL
![Page 3: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/3.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
Overall Architecture (internals)
ParsingPHOENIX/HELIOS
Dialog Manag.RAVENCLAW
Back-end(perl)
Language Gen.ROSETTA
HUB
FESTIVALSERVER
RecognitionSPHINX
SynthesisFESTIVAL
Galaxy
![Page 4: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/4.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
Overall Architecture
ParsingPHOENIX/HELIOS
Dialog Manag.RAVENCLAW
Back-end(perl)
Language Gen.ROSETTA
RecognitionSPHINX
SynthesisFESTIVAL
![Page 5: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/5.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
Overall Architecture
ParsingPHOENIX/HELIOS
Dialog Manag.RAVENCLAW
Back-end(perl)
Language Gen.ROSETTA
Text I/OTTYServer
RecognitionSPHINX
SynthesisFESTIVAL
![Page 6: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/6.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
Developed Resources
ParsingPHOENIX/HELIOS
Dialog Manag.RAVENCLAW
Back-end(perl)
Language Gen.ROSETTA
Text I/OTTYServer
Grammar
Templates
RavenClawDialogTask
Specification
Back-end(perl)
![Page 7: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/7.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
Development Time
ParsingPHOENIX/HELIOS
Dialog Manag.RAVENCLAW
Back-end(perl)
Language Gen.ROSETTA
Text I/OTTYServer
Grammar
Templates
RavenClawDialogTask
Specification
Back-end(perl)
RC Fixes 2h15, 11%
RavenClaw 4h, 19%
Design 4h, 18%
Setup 1h10, 5%
Grammar3h45, 18%
Backend3h20, 16%
Templates 2h45, 13%
Total: 21:15h
![Page 8: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/8.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
RavenClaw Architecture
Captures all domain-specific dialog (task) logic with a hierarchical description
The authoring effort is focused entirely here
Dialog Task (Specification)
Domain-independent Dialog Engine
Manages dialog by executing the dialog task specification
Provides domain-independent conversational strategies
![Page 9: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/9.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
RavenClaw Architecture
Dialog Stack
Madeleine
E:LoadSymptoms GeneralFeel
R:HowAreYou? I:Glad I:Sorry
Diagnose
Fever Travel
R:AskFever E:MeasureTemp I:InformFever
I:Welcome
Expectation Agenda
general_feeling
chart
have_fever
diagnostic
![Page 10: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/10.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
RavenClaw Architecture
Dialog Stack
Madeleine
Madeleine
E:LoadSymptoms GeneralFeel
R:HowAreYou? I:Glad I:Sorry
Diagnose
Fever Travel
R:AskFever E:MeasureTemp I:InformFever
I:Welcome
Expectation Agenda
general_feeling
chart
have_fever
diagnostic
![Page 11: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/11.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
RavenClaw Architecture
Dialog Stack
Madeleine
Welcome
Madeleine
E:LoadSymptoms GeneralFeel
R:HowAreYou? I:Glad I:Sorry
Diagnose
Fever Travel
R:AskFever E:MeasureTemp I:InformFever
I:Welcome
Expectation Agenda
general_feeling
chart
have_fever
diagnostic
![Page 12: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/12.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
RavenClaw Architecture
Dialog Stack
Madeleine
Hi, this is Madeleine, the automated…
Madeleine
E:LoadSymptoms GeneralFeel
R:HowAreYou? I:Glad I:Sorry
Diagnose
Fever Travel
R:AskFever E:MeasureTemp I:InformFever
I:Welcome
Expectation Agenda
general_feeling
chart
have_fever
diagnostic
![Page 13: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/13.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
RavenClaw Architecture
Dialog Stack
Madeleine
Hi, this is Madeleine, the automated…
Madeleine
E:LoadSymptoms GeneralFeel
R:HowAreYou? I:Glad I:Sorry
Diagnose
Fever Travel
R:AskFever E:MeasureTemp I:InformFever
I:Welcome
LoadSymptoms
R:Headache R: R: R:
Expectation Agenda
general_feeling
chart
have_fever
diagnostic
headache
![Page 14: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/14.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
RavenClaw Architecture
Dialog Stack
Madeleine
Hi, this is Madeleine, the automated…
Madeleine
E:LoadSymptoms GeneralFeel
R:HowAreYou? I:Glad I:Sorry
Diagnose
Fever Travel
R:AskFever E:MeasureTemp I:InformFever
I:Welcome
R:Headache R: R: R:
Expectation Agenda
general_feeling
chart
have_fever
diagnostic
headache
![Page 15: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/15.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
RavenClaw Architecture
Dialog Stack
Madeleine
Hi, this is Madeleine, the automated…
Madeleine
E:LoadSymptoms GeneralFeel
R:HowAreYou? I:Glad I:Sorry
Diagnose
Fever Travel
R:AskFever E:MeasureTemp I:InformFever
I:Welcome
R:Headache R: R: R:
GeneralFeel
Expectation Agenda
general_feeling
chart
have_fever
diagnostic
headache
![Page 16: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/16.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
RavenClaw Architecture
Dialog Stack
Madeleine
Hi, this is Madeleine, the automated…
Madeleine
E:LoadSymptoms GeneralFeel
R:HowAreYou? I:Glad I:Sorry
Diagnose
Fever Travel
R:AskFever E:MeasureTemp I:InformFever
I:Welcome
R:Headache R: R: R:
GeneralFeel
How are you feeling today?
general_feeling
chart
have_fever
diagnostic
HowAreYou
Expectation Agenda
general_feeling: [good], [bad], [soso]
general_feeling: [good], [bad], [soso] [good], [bad], [soso]
general_feeling: [good], [bad], [soso] [good], [bad], [soso]have_fever: [fever]. ![yes], ![no] ![yes], ![no]headache: [headache], ![yes], ![no] ![yes], ![no]cough: [cough], ![yes], ![no] ![yes], ![no]……
GeneralFeel
I:Glad I:Sorry
Not so good, I think I have a fever[soso](not so good)[fever](I think I have a fever)
headache
GeneralFeel
![Page 17: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/17.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
Illustrated Features
Dynamic generation of dialog task structure Symptoms loaded from backend, appropriate
structures to “talk about them” created on-the-fly New symptoms – no DM changes
Dynamic dialog control policy The order in which symptoms are addressed is
controlled by the backend
Conversational skills
![Page 18: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/18.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
Illustrated Features
Dynamic generation of dialog task structure Symptoms loaded from backend, appropriate
structures to “talk about them” created on-the-fly New symptoms – no DM changes
Dynamic dialog control policy The order in which symptoms are addressed is
controlled by the backend
Conversational skills
![Page 19: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/19.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
Dynamic Dialog Control …
Dialog Stack
Madeleine
Hi, this is Madeleine, the automated…How are you today?Not so good, I think I have a headacheSorry to hear you’re not feeling so good,Tell me more about your symptoms…Do you have abdominal pain?
Madeleine
E:LoadSymptoms GeneralFeel
R:HowAreYou? I:Glad I:Sorry
Diagnose
Fever Travel
R:AskFever E:MeasureTemp I:InformFever
I:Welcome
R:Headache R: R: R:
Diagnose
Expectation Agenda
general_feeling
chart
have_fever
diagnostic
headache
Backend Decision Tree
![Page 20: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/20.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
Illustrated Features
Dynamic generation of dialog task structure Symptoms loaded from backend, appropriate
structures to “talk about them” created on-the-fly New symptoms – no DM changes
Dynamic dialog control policy The order in which symptoms are addressed is
controlled by the backend
Conversational skills
![Page 21: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/21.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
Conversational Skills
Corresponding agencies added automatically to the dialog task tree Help What Can I Say? Repeat Suspend / Resume Start Over Timeout handling (not illustrated)
Still need all the language generation prompts and grammar, but some of those are develop-once, too
![Page 22: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/22.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
Conclusion
Highlights Set task posed no challenges to the framework
Easy to implement Dynamic dialog structure and control Automatic use of domain-independent
conversational skills
Lowlights? Toolkit perspective: how easy would it be for
someone else to build it? Asynchronous behaviors? (timing) Couple of bugs / fixes (or is that a highlight?) …
![Page 23: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/23.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
Demo
Run
![Page 24: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/24.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
RavenClaw Grounding
Madeleine
E:LoadSymptoms GeneralFeel
R:HowAreYou? I:Glad I:Sorry
Diagnose
Fever Travel
R:AskFever E:MeasureTemp I:InformFever
I:Welcome
R:Headache R: R: R:
general_feeling
chart
have_fever
diagnostic
headache
Grounding EngineStateIndicators
Strategies
![Page 25: Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003.](https://reader036.fdocuments.net/reader036/viewer/2022062421/56649d585503460f94a3812e/html5/thumbnails/25.jpg)
10-127-2003 Madeleine: a RavenClaw exercise in the medical diagnosis domain…
Other RavenClaw systems
LARRI – Language Assistant for Retrieval of Repair Information
RoomLine – Conference room reservation within SCS
Let’s Go! (BusLine) – Bus schedule information in Pittsburgh
TeamTalk – Command and control for a team of robots
Eureka – Dialog interface to a clustered web search engine (Vivisimo)