LiU Electronic Press
Download:
File size:
401 kb
Format:
application/pdf
Author:
Kleiner, Alexander (Staffordshire University)
Sharp, Bernadette (Staffordshire University)
Bittel, Oliver (University of Applied Sciences, Konstanz)
Title:
Self Organising Maps for Value Estimation to Solve Reinforcement Learning Tasks
Publication type:
Conference paper (Refereed)
Language:
English
In:
Proc. of the 2nd International Conference on Enterprise Information Systems (ICEIS 2000)
Pages:
74-83
Year of publ.:
2000
URI:
urn:nbn:se:liu:diva-72563
Permanent link:
http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-72563
Subject category:
Computer Systems
Abstract(en) :

Reinforcement learning has been applied recently more and more for the optimisation of agent behaviours. This approach became popular due to its adaptive and unsupervised learning process. One of the key ideas of this approach is to estimate the value of agent states. For huge state spaces however, it is difficult to implement this approach. As a result, various models were proposed which make use of function approximators, such as neural networks, to solve this problem. This paper focuses on an implementation of value estimation with a particular class of neural networks, known as self organizing maps. Experiments with an agent moving in a gridworld and the autonomous robot Khepera have been carried out to show the benefit of our approach. The results clearly show that the conventional approach, done by an implementation of a look-up table to represent the value function, can be out performed in terms of memory usage and convergence speed.

Available from:
2011-11-28
Created:
2011-11-28
Last updated:
2011-12-06
Statistics:
14 hits
FILE INFORMATION
File size:
401 kb
Mimetype:
application/pdf
Type:
fulltext
Statistics:
47 hits
Version:
Authorʼs version