25
January
2012

Neuroscience Lecture by Peter Dayan (University College London, UK)

Title: "Interactions between Model-free and Model-based Reinforcement Learning"

Time and venue: 11.00 a.m. at the Lecture Hall (room 0.10 of the Max Planck Institute of Biophysics, Max-von-Laue-Str. 3, 60438 Frankfurt am Main, Campus Riedberg)

Abstract
Substantial recent work has explored multiple mechanisms of decision-making in humans and other animals. Functionally and anatomically distinct modules have been identified, and their individual properties have been examined using intricate behavioural and neural tools. I will discuss the background of these studies, and show fMRI results that suggest closer and more complex interactions between the mechanisms than originally conceived. In some circumstances, model-free methods seize control after much less experience than would seem normative; in others, temporal difference prediction errors, which are epiphenomenal for the model-based system, are nevertheless present and apparently effective. Finally, I will show that model-free and model-based methods on occasion both cower in the face of Pavlovian influences, and will try and reconcile this as a form of robust control.

Interactive

ShareThis
ShareThis

Public Relations

Dr. Arjan Vink
T: +49 69 850033-2900
M: +49 175 2647988
pr(at)brain.mpg.de