Pole balancing - watch it learn

Controls

Q(s, a)

Tab names indicate cart position.
Cart velocity Fast left Slow Fast right
Pole velocity Fast left Slow Fast right Fast left Slow Fast right Fast left Slow Fast right
Pole angle Very left
Quite left
Slightly left
Slightly right
Quite right
Very right
Cart velocity Fast left Slow Fast right
Pole velocity Fast left Slow Fast right Fast left Slow Fast right Fast left Slow Fast right
Pole angle Very left
Quite left
Slightly left
Slightly right
Quite right
Very right
Cart velocity Fast left Slow Fast right
Pole velocity Fast left Slow Fast right Fast left Slow Fast right Fast left Slow Fast right
Pole angle Very left
Quite left
Slightly left
Slightly right
Quite right
Very right