Learning from DES: Exploring the high involvement hypothesis Tom Monks, Stewart Robinson & Kathy...
-
Upload
arnold-merriam -
Category
Documents
-
view
214 -
download
0
Transcript of Learning from DES: Exploring the high involvement hypothesis Tom Monks, Stewart Robinson & Kathy...
![Page 1: Learning from DES: Exploring the high involvement hypothesis Tom Monks, Stewart Robinson & Kathy Kotiadis IFORS 2014.](https://reader036.fdocuments.net/reader036/viewer/2022062712/56649c855503460f9493b112/html5/thumbnails/1.jpg)
Learning from DES: Exploring the high involvement hypothesis
Tom Monks, Stewart Robinson & Kathy KotiadisIFORS 2014
![Page 2: Learning from DES: Exploring the high involvement hypothesis Tom Monks, Stewart Robinson & Kathy Kotiadis IFORS 2014.](https://reader036.fdocuments.net/reader036/viewer/2022062712/56649c855503460f9493b112/html5/thumbnails/2.jpg)
Behavioural Operational Research
2
1. Eliciting behavioural parameters
2. Detailed behavioural modelling
3. Study of modelling and model use
Psychological/social aspects of model use in problem solving (Hamallainen et al.
2013)
![Page 3: Learning from DES: Exploring the high involvement hypothesis Tom Monks, Stewart Robinson & Kathy Kotiadis IFORS 2014.](https://reader036.fdocuments.net/reader036/viewer/2022062712/56649c855503460f9493b112/html5/thumbnails/3.jpg)
The high involvement hypothesis (HIH)
3
Involving clients in modelling aids learning
Empirical evidence?
50% of the benefit of modelling is gained just from building the model (Robinson, 1994)
Implicit mental models of the system converted into explicit mental models (Anderson, 1997)
80%
![Page 4: Learning from DES: Exploring the high involvement hypothesis Tom Monks, Stewart Robinson & Kathy Kotiadis IFORS 2014.](https://reader036.fdocuments.net/reader036/viewer/2022062712/56649c855503460f9493b112/html5/thumbnails/4.jpg)
Single and Double-Loop learning
4
Governing
VariablesConsequencesActions
~Attitudes
~Transfer / repeated use / creativity
Important: also applies to the way we learn
![Page 5: Learning from DES: Exploring the high involvement hypothesis Tom Monks, Stewart Robinson & Kathy Kotiadis IFORS 2014.](https://reader036.fdocuments.net/reader036/viewer/2022062712/56649c855503460f9493b112/html5/thumbnails/5.jpg)
Theory versus efficiency
Problem: fixed budget of time
5
Simulation Project
Building Using
Building Using
Reusing
![Page 6: Learning from DES: Exploring the high involvement hypothesis Tom Monks, Stewart Robinson & Kathy Kotiadis IFORS 2014.](https://reader036.fdocuments.net/reader036/viewer/2022062712/56649c855503460f9493b112/html5/thumbnails/6.jpg)
Research Questions
1. Can the HIH be demonstrated empirically?
2. What mechanisms aid client learning from involvement in building and reuse?
3. Is there any evidence that single-loop learning systems inhibit learning from DES models?
6
![Page 7: Learning from DES: Exploring the high involvement hypothesis Tom Monks, Stewart Robinson & Kathy Kotiadis IFORS 2014.](https://reader036.fdocuments.net/reader036/viewer/2022062712/56649c855503460f9493b112/html5/thumbnails/7.jpg)
Methods and design
7
Reusing
Building Using
Building Using
64 students
A&E case study
MR
MBL
MB
Time
Vs.
![Page 8: Learning from DES: Exploring the high involvement hypothesis Tom Monks, Stewart Robinson & Kathy Kotiadis IFORS 2014.](https://reader036.fdocuments.net/reader036/viewer/2022062712/56649c855503460f9493b112/html5/thumbnails/8.jpg)
Dependent Variables
8
Measures Operationalised by Hypotheses
∆MaxUtil Theory of planned behaviour MB = MBL > MR
∆TradeUtil Theory of planned behaviour MB = MBL > MR
Creativity Use of ‘new’ variables MB > MR
Introduction to Simulation
Watch building of a simple model of
case study
Act as domain expert during
model building
Act as domain expert during
experimentation
Introduction to Simulation
Overview of model to be reused
Act as domain expert during
experimentation
Pre-test questionnaire
Post-test questionairre
MR
MB & MBL
![Page 9: Learning from DES: Exploring the high involvement hypothesis Tom Monks, Stewart Robinson & Kathy Kotiadis IFORS 2014.](https://reader036.fdocuments.net/reader036/viewer/2022062712/56649c855503460f9493b112/html5/thumbnails/9.jpg)
Results Summary
Creativity (MB versus MR)– MB explored a greater variety of variables– MB simulated more ‘validation’ scenarios
Attitude Change– MB by far the least likely to maximise util– MB and MR more likely than MBL to trade
some utilisation in order to reduce queuing
– MB could still make the wrong decisions! 9
![Page 10: Learning from DES: Exploring the high involvement hypothesis Tom Monks, Stewart Robinson & Kathy Kotiadis IFORS 2014.](https://reader036.fdocuments.net/reader036/viewer/2022062712/56649c855503460f9493b112/html5/thumbnails/10.jpg)
Conclusions: Evidence of HIH
Clearest support in creativity difference– Evidence of double-loop learning
Attitude results were mixed
Not as straight forward as often portrayed!
10
![Page 11: Learning from DES: Exploring the high involvement hypothesis Tom Monks, Stewart Robinson & Kathy Kotiadis IFORS 2014.](https://reader036.fdocuments.net/reader036/viewer/2022062712/56649c855503460f9493b112/html5/thumbnails/11.jpg)
Conclusions: Learning mechanisms
11
Incremental
Validation
Attitude strength
and complexity
Classic learning
cycle
Treat these as hypotheses for future research
![Page 12: Learning from DES: Exploring the high involvement hypothesis Tom Monks, Stewart Robinson & Kathy Kotiadis IFORS 2014.](https://reader036.fdocuments.net/reader036/viewer/2022062712/56649c855503460f9493b112/html5/thumbnails/12.jpg)
Conclusions: SL learning systems
Yes it is was a problem for a minority ~30%
Maximise winning and minimise losing
No follow up on negative results– Dismissed due to “randomness”– Often followed by an obvious positive
scenario (confirmation bias)– May be concerns about looking foolish
12
![Page 13: Learning from DES: Exploring the high involvement hypothesis Tom Monks, Stewart Robinson & Kathy Kotiadis IFORS 2014.](https://reader036.fdocuments.net/reader036/viewer/2022062712/56649c855503460f9493b112/html5/thumbnails/13.jpg)
Thanks for listening
13
T: @tommonks1
P +44 (just phone England and ask for me)
For full details please see:
Monks, T., Robinson, S., Kotiadis, K. Learning from discrete-event simulation: Exploring the high involvement hypothesis. European Journal of Operational Research. 2014; 235(1): 195-205