RL in Scala Gridworld
Pole balancing
Try it yourself
Watch it learn
Pacman
Slides Source code

Pole balancing - watch it learn

Controls

Q(s, a)

Tab names indicate cart position.
Left Middle Right
Cart velocity Fast left Slow Fast right
Pole velocity Fast left Slow Fast right Fast left Slow Fast right Fast left Slow Fast right
Pole angle Very left
Quite left
Slightly left
Slightly right
Quite right
Very right
Cart velocity Fast left Slow Fast right
Pole velocity Fast left Slow Fast right Fast left Slow Fast right Fast left Slow Fast right
Pole angle Very left
Quite left
Slightly left
Slightly right
Quite right
Very right
Cart velocity Fast left Slow Fast right
Pole velocity Fast left Slow Fast right Fast left Slow Fast right Fast left Slow Fast right
Pole angle Very left
Quite left
Slightly left
Slightly right
Quite right
Very right