A Bayesian approach to informing decision makers ...€¦ · A Bayesian approach to informing...

15
A Bayesian approach to informing decision makers: Comparisons to minimizing relative entropy The Ninth Workshop on Information Theoretic Methods in Science and Engineering 19 September 2016 David Bickel University of Ottawa

Transcript of A Bayesian approach to informing decision makers ...€¦ · A Bayesian approach to informing...

Page 1: A Bayesian approach to informing decision makers ...€¦ · A Bayesian approach to informing decision makers: Comparisons to minimizing relative entropy The Ninth Workshop on Information

A Bayesian approach to informing decision makers: Comparisons to minimizing relative entropy

The Ninth Workshop on Information Theoretic Methods in Science and Engineering

19 September 2016

David Bickel University of Ottawa

Page 2: A Bayesian approach to informing decision makers ...€¦ · A Bayesian approach to informing decision makers: Comparisons to minimizing relative entropy The Ninth Workshop on Information

Bayes’s theorem

• posterior odds = Bayes factor ⨉ prior odds

• Bayes factor = strength of evidence

Page 3: A Bayesian approach to informing decision makers ...€¦ · A Bayesian approach to informing decision makers: Comparisons to minimizing relative entropy The Ninth Workshop on Information

Decision-maker’s loss function

Page 4: A Bayesian approach to informing decision makers ...€¦ · A Bayesian approach to informing decision makers: Comparisons to minimizing relative entropy The Ninth Workshop on Information

Bayes action

Page 5: A Bayesian approach to informing decision makers ...€¦ · A Bayesian approach to informing decision makers: Comparisons to minimizing relative entropy The Ninth Workshop on Information

Scientist’s regret function

Page 6: A Bayesian approach to informing decision makers ...€¦ · A Bayesian approach to informing decision makers: Comparisons to minimizing relative entropy The Ninth Workshop on Information

Scientist’s odds to report

Page 7: A Bayesian approach to informing decision makers ...€¦ · A Bayesian approach to informing decision makers: Comparisons to minimizing relative entropy The Ninth Workshop on Information

Known cost ratio

Page 8: A Bayesian approach to informing decision makers ...€¦ · A Bayesian approach to informing decision makers: Comparisons to minimizing relative entropy The Ninth Workshop on Information

Unknown cost ratio

• Scale & reciprocal invariance ⇒ Benford’s law

Page 9: A Bayesian approach to informing decision makers ...€¦ · A Bayesian approach to informing decision makers: Comparisons to minimizing relative entropy The Ninth Workshop on Information

Why log odds?

Page 10: A Bayesian approach to informing decision makers ...€¦ · A Bayesian approach to informing decision makers: Comparisons to minimizing relative entropy The Ninth Workshop on Information

Geometric mean odds

Page 11: A Bayesian approach to informing decision makers ...€¦ · A Bayesian approach to informing decision makers: Comparisons to minimizing relative entropy The Ninth Workshop on Information

Geometric mean Bayes factor

Page 12: A Bayesian approach to informing decision makers ...€¦ · A Bayesian approach to informing decision makers: Comparisons to minimizing relative entropy The Ninth Workshop on Information

Evidential distance

Page 13: A Bayesian approach to informing decision makers ...€¦ · A Bayesian approach to informing decision makers: Comparisons to minimizing relative entropy The Ninth Workshop on Information

Minimax evidential distance or minimax redundancy?

Page 14: A Bayesian approach to informing decision makers ...€¦ · A Bayesian approach to informing decision makers: Comparisons to minimizing relative entropy The Ninth Workshop on Information

Minimum evidential distance or maximum entropy?

Page 15: A Bayesian approach to informing decision makers ...€¦ · A Bayesian approach to informing decision makers: Comparisons to minimizing relative entropy The Ninth Workshop on Information

Finally

Funded by the Natural Sciences and Engineering Research Council of Canada

Preprint coming soon … davidbickel.com "Reporting Bayes factors or probabilities to decision makers of unknown loss functions"