Creating a corpus of commands in a domotic environment (semi-automatically)?

IBIS route directions• Start from IBIS transcript corpus http://www.ltg.ed.ac.uk/ibl/ibl-

transcription.txt• u10_GA_MC_1.wav okay if you erm if you get to the university and

then take the third first exit just past the university and then turn right • u10_GA_MC_2.wav erm boots is on your left • u10_GA_MD_1.wav okay head towards the grand hotel but just before

you get there the safeway is on your right hand side • u10_GA_ME_1.wav okay turn left at the post office • u10_GA_ME_2.wav go straight down that road and to the next

junction the grand hotel is on your left • u10_GA_MW_1.wav okay go straight ahead • NEED TO CLEAN (wav, okay, erm)

Take part of the corpus and annotate

• Object names with OBJECT• Location names with LOCATION• Select a few relevant framenet FRAMES, and

change verbs with name of FRAME

Examples

• head towards the grand hotel but just before you get there the safeway is on your right hand side

• MOVE towards LOCATION but just before you get there the LOCATION is on your right hand side

For the “smarters”

• Annotate a portion of the corpus, try to automatically annotate the rest

• How? (I’ll give advise)

Parse annotated sentences with Stanford parser

Variety of things can be done with that

• Cluster sentence schemas (either using only POS and CATEGORY sequences, e.g.:

or the typed dependencies

• Or?

VB DT JJ NN IN PRP VBP TO DT LOCATION/NNP CC RB MOVE/VB up/RP DT LOCATION/NN

Variety of things can be done with that

• Generate a new corpus in a different environment (DOMOTICS) by replacing LOCATIOn names with locations and objects in the domain

• MOVE towards the dining room but just before you get there the chair is on your right hand side