Practical work Discovery of Reinforcement Learning (advanced)

ARTIFICIAL INTELLIGENCE EDUCATION

REINFORCEMENT LEARNING

PREREQUISITE

THE ALPHAI ROBOT

• • • •

Camera Ultra-sons Infra-red

REINFORCEMENT LEARNING

P.2

ALPHAI SOFTWARE

REINFORCEMENT LEARNING

P.3

INTRODUCTION

Sensors

"Brain"

Action

Learning

Reward

REINFORCEMENT LEARNING

P.4

MANUAL NETWORK EDITING

→

→ → → →

→

Introduction to AI P.5

Introduction to AI P.6

Introduction to AI P.7

MACHINE LEARNING: BLOCKED / MOTION

→

Introduction to AI P.8

Introduction to AI P.9

Introduction to AI P.10

𝛾

𝑎𝑡 𝑠𝑡 𝑄(𝑠𝑡 , 𝑎𝑡 )𝑟𝑡+1 𝑎𝑡 𝑠𝑡

Introduction to AI P.11

𝛾

𝑄(𝑠𝑡 , 𝑎𝑡 ) = 𝑟𝑡+1

𝛼

𝑄(𝑠𝑡 , 𝑎𝑡 ) ← 𝑄(𝑠𝑡 , 𝑎𝑡 ) + 𝛼(𝑟𝑡+1 − 𝑄 (𝑠𝑡 , 𝑎𝑡 ) )

𝑄 (𝑠𝑡 , 𝑎𝑡 ) ← (1 − 𝛼)𝑄 (𝑠𝑡 , 𝑎𝑡 ) + 𝛼. 𝑟𝑡+1

Introduction to AI P.12

𝑄(𝑠𝑡 , 𝑎𝑡 ) ← 𝑄(𝑠𝑡 , 𝑎𝑡 ) + 𝛼 (((1 − 𝛾)𝑟𝑡+1 + 𝛾𝑄(𝑠𝑡+1 , 𝑎∗ )) − 𝑄(𝑠𝑡 , 𝑎𝑡 ) )

𝑄 (𝑠𝑡 , 𝑎𝑡 ) ← (1 − 𝛼)𝑄 (𝑠𝑡 , 𝑎𝑡 ) + 𝛼((1 − 𝛾)𝑟𝑡+1 + 𝛾𝑄(𝑠𝑡+1 , 𝑎∗ ))

𝑠𝑡+1 .

Introduction to AI P.13

LEARNING - OBSTACLE AVOIDANCE WITH CAMERA

→

Introduction to AI P.14

Introduction to AI P.15

Introduction to AI P.16

LEARNING FOOTBALL

→

Introduction to AI P.17

CONCLUSION

Introduction to AI P.18