PGに簡単なゲームのやり方を学習させる Vol.1 - まずはQ学習を理解する
41
PG - Q @shohu33
-
Upload
- -
Category
Engineering
-
view
890 -
download
2
Transcript of PGに簡単なゲームのやり方を学習させる Vol.1 - まずはQ学習を理解する
1. (Gamma)
2. Q 0
3. :
3.1
3.2 5 :
3.2.1
3.2.2
3.2.3 Q
Q(state, action) = R(state, action) + Gamma * Max[Q(next state, all actions)]* Q
3.2.4
3.2.5 5
3.3
31
Q(state, action) = R(state, action) + Gamma * Max[Q(next state, all actions)]
Q(3, 1) = R(3, 1) + 0.8 * Max[Q(1, 3), Q(1, 5)] = 0 + 0.8 * Max(0, 100) = 80
1
1 55
5 Q(state, action) = R(state, action) + Gamma * Max[Q(next state, all actions)]
Q(1, 5) = R(1, 5) + 0.8 * Max[Q(5, 1), Q(5, 4), Q(5, 5)] = 100 + 0.8 * Max(0, 0, 0) = 100
Q