Goal-Based Decision Making
of 56
Transcript of Goal-Based Decision Making
-
8/6/2019 Goal-Based Decision Making
1/56
Decision Making
Goal-Oriented Behavior
Raoul Felix
-
8/6/2019 Goal-Based Decision Making
2/56
-
8/6/2019 Goal-Based Decision Making
3/56
-
8/6/2019 Goal-Based Decision Making
4/56
-
8/6/2019 Goal-Based Decision Making
5/56
-
8/6/2019 Goal-Based Decision Making
6/56
Goal-Oriented Behavior
-
8/6/2019 Goal-Based Decision Making
7/56
Goals
Eat
Regenerate Health
Kill Enemy
3
1
5
-
8/6/2019 Goal-Based Decision Making
8/56
Actions
-
8/6/2019 Goal-Based Decision Making
9/56
Simple
Selection
-
8/6/2019 Goal-Based Decision Making
10/56
Eat = 4Sleep = 3
-
8/6/2019 Goal-Based Decision Making
11/56
Action Effect on Goals
Get-Raw-Food Eat - 3
Get-Snack Eat - 2
Sleep-in-Bed Sleep - 4
Sleep-on-Sofa Sleep - 2
Eat = 4
Sleep = 3
-
8/6/2019 Goal-Based Decision Making
12/56
Action Effect on Goals
Get-Raw-Food Eat - 3
Get-Snack Eat - 2
Sleep-in-Bed Sleep - 4
Sleep-on-Sofa Sleep - 2
Eat = 1
Sleep = 3
-
8/6/2019 Goal-Based Decision Making
13/56
Performance
O(n+m):
: O(1)
- Goals
- Actions
n
m
-
8/6/2019 Goal-Based Decision Making
14/56
Pros & Cons
Simple
Fast
Sensible Results
No Side-effects
No Timing Information
No Action Planning
-
8/6/2019 Goal-Based Decision Making
15/56
Eat = 4Bathroom = 3
-
8/6/2019 Goal-Based Decision Making
16/56
Action Effect on Goals
Drink-SodaEat - 2
Bathroom + 2
Go-to-Bathroom Bathroom - 4
Eat = 4
Bathroom = 3
-
8/6/2019 Goal-Based Decision Making
17/56
Overall Utility
-
8/6/2019 Goal-Based Decision Making
18/56
Eat = 4
Bathroom = 3
Action Effect on Goals Discontentment
Drink-SodaEat - 2
Bathroom + 2
Go-to-
BathroomBathroom - 4
-
8/6/2019 Goal-Based Decision Making
19/56
Action Effect on Goals Discontentment
Drink-SodaEat - 2
Bathroom + 229
Go-to-
BathroomBathroom - 4
Eat = 2
Bathroom = 5
-
8/6/2019 Goal-Based Decision Making
20/56
Action Effect on Goals Discontentment
Drink-SodaEat - 2
Bathroom + 229
Go-to-
BathroomBathroom - 4 16
Eat = 4
Bathroom = 0
-
8/6/2019 Goal-Based Decision Making
21/56
Performance
O(nm):
: O(1)
- Goals
- Actions
n
m
-
8/6/2019 Goal-Based Decision Making
22/56
Pros & Cons
Side Effects
+/- Fast
Optimizable (SIMD)
No Timing Information
No Action Planning
-
8/6/2019 Goal-Based Decision Making
23/56
Timing
-
8/6/2019 Goal-Based Decision Making
24/56
or ?
Timing
-
8/6/2019 Goal-Based Decision Making
25/56
++ =
Timing
-
8/6/2019 Goal-Based Decision Making
26/56
Timing
-
8/6/2019 Goal-Based Decision Making
27/56
Utility Involving
Timing
-
8/6/2019 Goal-Based Decision Making
28/56
Eat = 4 +4 per hourBathroom = 3 +2 per hour
-
8/6/2019 Goal-Based Decision Making
29/56
Eat = 4 +4 per hour
Bathroom = 3 +2 per hour
Action Effect on Goals Time Discontentment
Go-to-
BathroomBathroom - 4 15m
Eat-Main-
Meal Eat - 4 1h
Eat-Snack Eat - 2 15m
-
8/6/2019 Goal-Based Decision Making
30/56
Eat = 5 +4 per hour
Bathroom = 0 +2 per hour
Action Effect on Goals Time Discontentment
Go-to-
BathroomBathroom - 4 15m 25
Eat-Main-
Meal Eat - 4 1h
Eat-Snack Eat - 2 15m
-
8/6/2019 Goal-Based Decision Making
31/56
Eat = 0 +4 per hour
Bathroom = 5 +2 per hour
Action Effect on Goals Time Discontentment
Go-to-
BathroomBathroom - 4 15m 25
Eat-Main-
Meal Eat - 4 1h 25
Eat-Snack Eat - 2 15m
-
8/6/2019 Goal-Based Decision Making
32/56
Eat = 2 +4 per hour
Bathroom = 3.5 +2 per hour
Action Effect on Goals Time Discontentment
Go-to-
BathroomBathroom - 4 15m 25
Eat-Main-
Meal Eat - 4 1h 25
Eat-Snack Eat - 2 15m 16.25
-
8/6/2019 Goal-Based Decision Making
33/56
Calculating Goal Change over Time
basicRate = 0.95 * basicRate +
0.05 * rateSinceLastTime
rateSinceLastTime =
changeSinceLastTime
timeSinceLast
-
8/6/2019 Goal-Based Decision Making
34/56
Performance
O(nm):
: O(1)
- Goals
- Actions
n
m
-
8/6/2019 Goal-Based Decision Making
35/56
Pros & Cons
Timing Information
Side Effects
+/- Fast
Optimizable (SIMD)
No Action Planning
-
8/6/2019 Goal-Based Decision Making
36/56
Need for Planning
vs
HP
Mana
4
3
2
Heal = 4 Kill-Ogre = 3Goals
Heal = 0Heal = 2 Kill-Ogre = 0
-
8/6/2019 Goal-Based Decision Making
37/56
Overall Utility
GOAP
-
8/6/2019 Goal-Based Decision Making
38/56
-
8/6/2019 Goal-Based Decision Making
39/56
-
8/6/2019 Goal-Based Decision Making
40/56
-
8/6/2019 Goal-Based Decision Making
41/56
-
8/6/2019 Goal-Based Decision Making
42/56
Goals
Mana Slots
Actions
Heal: 4
Kill-Ogre: 3
5
GH, LH, F
0
1
2
Goals
Mana Slots
Actions
Heal: 0
Kill-Ogre: 31
-
GH
Goals
Mana Slots
Actions
Heal: 2
Kill-Ogre: 33
LH, F
LH
F
Goals
Mana Slots
Actions
Heal: 2
Kill-Ogre: 0
0
-
Goals
Mana Slots
Actions
Heal: 4
Kill-Ogre: 02
LH
F
LH
Goals
Mana Slots
Actions
Heal: 2
Kill-Ogre: 0
0
-
Discomfort: 4
Action: LH
LH
Goals
Mana Slots
Actions
Heal: 0
Kill-Ogre: 3
1
-
Discomfort: 9
Action: LH
-
8/6/2019 Goal-Based Decision Making
43/56
Performance
O(nmk):
: O(k)
- Goals
- Actions
- Depth
n
m
k
-
8/6/2019 Goal-Based Decision Making
44/56
Pros & Cons
Action Planning
Simple to Implement
Side Effects
Brute Force Approach
Naive
Slow
-
8/6/2019 Goal-Based Decision Making
45/56
Best of All Possible ActionsChoose Goal based on Insistence
-
8/6/2019 Goal-Based Decision Making
46/56
GOAP with
IDA*
-
8/6/2019 Goal-Based Decision Making
47/56
-
8/6/2019 Goal-Based Decision Making
48/56
+ =
IDA*
>
-
8/6/2019 Goal-Based Decision Making
49/56
Transposition Table
Number
of Actions+
Number
of Actions+
-
8/6/2019 Goal-Based Decision Making
50/56
Transposition Table
A A
B B
-
8/6/2019 Goal-Based Decision Making
51/56
Performance
O(nd):
: O(t)
- Goals
- Depth
- Transposition
Entries
n
d
t
-
8/6/2019 Goal-Based Decision Making
52/56
Smelly GOB
-
8/6/2019 Goal-Based Decision Making
53/56
-
8/6/2019 Goal-Based Decision Making
54/56
Compound Actions
-
8/6/2019 Goal-Based Decision Making
55/56
Action-based Signals
I can be cooked I can be
eaten now
I can cook
raw food
-
8/6/2019 Goal-Based Decision Making
56/56
Character-based Signals
