Catholijn M. Jonker

36
Development and Application of Rich Cognitive Models and the Role of Agent-Based Simulation for Policy Making Catholijn M. Jonker

description

Development and Application of Rich Cognitive Models and the Role of Agent-Based Simulation for Policy Making. Catholijn M. Jonker. BRIDGE : Development and Application of Rich Cognitive Models for Policy Making. Frank Dignum , Virginia Dignum , Catholijn M. Jonker. Policy. - PowerPoint PPT Presentation

Transcript of Catholijn M. Jonker

Page 1: Catholijn M. Jonker

Development and Application of Rich Cognitive Models and the Role of Agent-

Based Simulation for Policy Making

Catholijn M. Jonker

Page 2: Catholijn M. Jonker

BRIDGE: Development and Application of Rich Cognitive

Models for Policy Making

Frank Dignum, Virginia Dignum, Catholijn M. Jonker

Page 3: Catholijn M. Jonker

Policy

• Policy introduction– Goal: noticeable change on the global level– Assumption: incentive for individuals to

change behaviour to intended new behaviour• Influencers of individual’s behaviour

– Dynamics of environment– Social circles (family, friends, work, culture …)– Personal circumstances

Page 4: Catholijn M. Jonker

Example Policies• Anti-smoking ban:

– Aim: Healthy (work) environment– Result? Less bar revenues, civil disobedience

• VAT increases– Aim: More state revenues– Result? more black market, less revenues

• Higher demands on hospital hygiene– Aim: Better health– Result? superbugs

Page 5: Catholijn M. Jonker
Page 6: Catholijn M. Jonker

Levels of simulation / models• Macro-level to measure policy effect

– Model at macro level: • Averages over behaviour of individuals• Misses out on holistic effects

• Micro-level to allow variation in behaviours– Requires rich cognitive models

• Personality• Cultural differences

– Local variation• Personal circumstances• Social circles

Page 7: Catholijn M. Jonker

Micro-macro simulation: zoom-in/zoom-out approach

Page 8: Catholijn M. Jonker
Page 9: Catholijn M. Jonker

The BRIDGE architecture

B

E

D

G

I

Inference method

personal orderingPreference

Cultural beliefs

Normative beliefs

Growth needs

deficiency needs

sense

act

generate

select plan

update

inte

rpre

t filter

plan select

direct

R

urges, stress

select

direct

over

rule

stimuli

explicit

implicit

BeliefsResponseIntentionsDesiresGoalsEgo

Page 10: Catholijn M. Jonker

Support for Policy Makers

Old viewPolicy maker directly puts

policy at work in the society.

Agent-based simulation viewPolicy maker first tries out

the policy in the simulation

Page 11: Catholijn M. Jonker

When would ABM help?• Agent should show

realistic human behaviour, with culture, social circles etc.

• If we can build agents that react realistically to any policy, then we solved the strong AI problem!

Agent-based simulation viewPolicy maker first tries out the

policy in the simulation

Page 12: Catholijn M. Jonker

Policy – Effect examples• Goal: reduce garbage heaps• Policy: garbage bags are taxed• Effect: people dump garbage in nature

• Goal: Reduce “fat” from Ministry of Defense• Policy: Reduce budget• Effect: Minister announces Trade Fleet cannot

be protected from pirates

• Goal: Reduce risk of terrorist attacks• Policy: Forbid face covering clothing• Effect: Police officers refuse to enforce it

Page 13: Catholijn M. Jonker

Our proposal• Identify stakeholders• Qualitative interviews with representatives of:

– target population– implementers of policy

Þ Possible implementations, possible reactions of targets, possible side effects

• Interview experts in psychology and national cultures to create XML file to link possible reactions to personality, culture, and circumstances

• Run simulations using XML file

Page 14: Catholijn M. Jonker

Required Adaptations of Models• Additional info from

interviewed people – new actions and

decision rules– Adapt existing

decision rules when influenced by new actions

• Run simulation

policypossible reactions

possible side effects

Page 15: Catholijn M. Jonker
Page 16: Catholijn M. Jonker

Caveats

• Sensitivity analysis required of the – Basic agent model – Overall simulation model

• Validation!• Cannot predict, only explore possibilities

Page 17: Catholijn M. Jonker

Theorizing

Theory,hypotheses

Gamesessions

Data,conclusions

Test design

Experimentalsetup

Gamingsimulation

Agentmodeling

Agent-BasedModel

Modelvalidation

Modelruns

Validationresults

Game design

Real world observations

Page 18: Catholijn M. Jonker

Gaming simulation

Computer simulation

Theory

tests predictions based on

implements design of

implements mechanisms according to

validates mechanisms described by

tests predictions based on

Page 19: Catholijn M. Jonker

Sensitivity Analysis of anAgent-Based Model of

Culture’s Consequences for Trade

Saskia Burgers, Gert Jan Hofstede, Catholijn Jonker, Tim Verwaart

September 9-10, 2010 - Treviso (Italy)

Page 20: Catholijn M. Jonker

Sensitivity analysis

• Generally considered “good modeling practice”

• Actual parameter values are uncertain• A powerful tool in the process of model

verification and validation• Specific problems arise when performing

sensitivity analysis for agent-based models

Page 21: Catholijn M. Jonker

Sensitivity analysis for ABM• Agent-based models may be very

sensitive to parameter changes in particular parts of parameter space:– Nothing may happen in large areas in the joint

parameter space– Areas may exist where the system responds

dramatically to slight changes• Parameters may significantly interact• Sensitivity may be studied for aggregated

individual level outputs

Page 22: Catholijn M. Jonker

Influence of culture

• Culture modifies parameter values in the decision functions

• Describe culture based on Hofstede’s five dimensions of national cultures

• Relational attributes have different significance in different cultures:– Group distance– Status difference– Interpersonal trust

Page 23: Catholijn M. Jonker

The role of parameters• Which areas in parameter space result in

realistic behavior?• In which areas of parameter space can

tipping points occur?• Which parameters have significant effects

for which outputs?• Which interactions between culture and

other parameters are important?• Are the answers different between

aggregate and individual level?

Page 24: Catholijn M. Jonker

Results of sensitivity analysis (1/2)

• For many of the parameter sets drawn at random, no transactions occur

• No obvious regions in parameter space where transactions occur / no transactions occur

• Logistic regression: discover the parts of parameter space where transactions occur

• Zoom in on the regions in parameter space where interesting behaviour occurs

Page 25: Catholijn M. Jonker

Results of sensitivity analysis (2/2)• Parameters that have significant effects can be

identified through meta-modeling, even for complex systems. However, the analysis is not straightforward.

• When keeping culture constant, straightforward methods for sensitivity analysis can be applied. Results differ considerably across cultures.

• Sensitivity of individual agents can differ considerably from aggregate level sensitivity.

Page 26: Catholijn M. Jonker

Cross-validation of Multi-Agent Simulation withCultural Differentiation

Gert Jan Hofstede, Catholijn M. Jonker, Tim Verwaart

September 9-10, 2010 - Treviso (Italy)

Page 27: Catholijn M. Jonker

Validation

• Why: to combat under-determinism• model M explains the behaviour of a

system S– Is M the only model to do so?

Page 28: Catholijn M. Jonker

Cross-validation (Moss & Edmonds, 2005)

• Compare statistics of – Agent-based simulation– Simulated system at aggregate level

• Compare– Behaviour at individual level– Data from qualitative research

Page 29: Catholijn M. Jonker

Human-like Agent behaviour

• Complexity requires compositionality• Process model composed of sub-process

models• Sub-models implement theories of

different aspects of behaviour:– Negotiation, trust, deceit …– Moods, emotions, affect, …

Page 30: Catholijn M. Jonker

Culture complicates matters

• Social situations are culture-sensitive• Policies affect social situations• Policy making requires culture-sensitive

modelling

Page 31: Catholijn M. Jonker

Our proposal to approach validation

• Complexity: Use compositionality– Validate sub-processes at lower compositional

levels• Qualitative Data: Use gaming simulations

– Played by humans for these sub-processes to gather data

Page 32: Catholijn M. Jonker

Overall multi-agent

simulation

partialmulti-agent simulation

partialmicro

simulations

Compositional Cross-Validation

Page 33: Catholijn M. Jonker

Example in Trade

• Trust & Tracing game to simulate trade chains

Producers Middlemen ConsumersRetailersProducers Middlemen ConsumersRetailers

Page 34: Catholijn M. Jonker
Page 35: Catholijn M. Jonker

Decision model within agent

determinetrade goal

selecttrade partner

negotiate

deliver

monitor and enforce

update beliefs

determinetrade goal

selecttrade partner

negotiate

deliver

monitor and enforce

update beliefs

Page 36: Catholijn M. Jonker

Conclusion• BRIDGE: rich cognitive agents & support for

policy makers• Involve stakeholders to avoid strong AI problem• Sensitivity analysis• Game-based Compositional cross-validation

Acknowledgements:• Frank Dignum, Virginia Dignum, Gert-Jan

Hofstede, Tim Verwaart, Saskia Burgers