demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0....

63

Transcript of demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0....

Page 1: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 2: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

Page 3: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 4: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

▪▪▪▪▪▪▪▪

Page 5: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 6: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 7: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 8: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

Page 9: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 10: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 11: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 12: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

▪”

▪▪

Page 13: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

▪▪▪

American British

all

old

Page 14: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

▪▪

▪▪

Page 15: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

25 ms

10ms

a1 a2 a3

Page 16: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

▪▪▪▪▪▪▪

Page 17: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 18: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 19: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 20: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 21: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

▪▪

▪▪

Page 22: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 23: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

the future is independent of the past given the present

Page 24: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 25: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

o1 o2 on

...

Page 26: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

Page 27: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

▪▪

▪▪

Page 28: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 29: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 30: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 31: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

Page 32: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 33: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 34: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 35: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 36: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 37: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 38: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 39: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 40: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 41: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 42: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

▪▪▪

Page 43: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 44: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 45: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 46: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 47: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 48: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 49: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

ssssssssppppeeeeeeetshshshshllllaeaeaebbbbb

“speech lab”

Page 50: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 51: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 52: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

▪▪

▪▪

Page 53: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 54: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

P(x)

x

P(x) is highest here at mean

P(x) is low here, far from mean

A Gaussian is parameterized by a mean and a variance:

Page 55: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

▪ σ

▪ Σ

▪▪

Page 56: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

Σ▪▪ Σ Σ Σ▪ Σ Σ

Page 57: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

Σ▪

Page 58: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

From openlearn.open.ac.uk

Page 59: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

Page 60: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 61: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)
Page 62: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)

▪▪▪▪▪

▪▪▪

Page 63: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · exp ( — 1 0 0 1 0. 0.5 5 0.8 0.8 - - u)) exp ( exp 3500 3000 2500 2000 1000 500 ... xP(31hot) x P(l lhot)