Cost minimisation and Reward maximisation. A neuromodulating minimal disturbance system using anti-hebbian spike timing-dependent plasticity

Citation

Parussel K & Smith L (2005) Cost minimisation and Reward maximisation. A neuromodulating minimal disturbance system using anti-hebbian spike timing-dependent plasticity. In: Proceedings of the Symposium on Agents that Want and Like: Motivational and Emotional Roots of Cognition and Action. AISB 2005: Social Intelligence and Interaction in Animals, Robots and Agents - Symposium on Agents that Want and Like, Motivational and Emotional Roots of Cognition and Action, Hertfordshire, 12.04.2005-15.04.2005. Hertfordshire: AISB, pp. 98-101. http://www.aisb.org.uk/publications/proceedings/aisb2005/2_Agents_Final.pdf

Abstract
In the brain, different levels of neuro-active substances modulate the behaviour of neurons that have receptors for them, such as sensitivity-to-input, Koch (1999). An articial neural network is described that learns which actions have the immediate effect of minimising cost and maximising reward for an agent. Two versions of the network are compared, one that uses neuromodulation and one that does not. It is shown that although neuromodulation can decrease performance it agitates the agent and stops it from over-tting the environment.

People

Professor Leslie Smith

Emeritus Professor, Computing Science