Neuroscience Lecture by Peter Dayan (University College London, UK)
Title: "Interactions between Model-free and Model-based Reinforcement Learning"
Time and venue: 11.00 a.m. at the Lecture Hall (room 0.10 of the Max Planck Institute of Biophysics, Max-von-Laue-Str. 3, 60438 Frankfurt am Main, Campus Riedberg)
Substantial recent work has explored multiple mechanisms of decision-making in humans and other animals. Functionally and anatomically distinct modules have been identified, and their individual properties have been examined using intricate behavioural and neural tools. I will discuss the background of these studies, and show fMRI results that suggest closer and more complex interactions between the mechanisms than originally conceived. In some circumstances, model-free methods seize control after much less experience than would seem normative; in others, temporal difference prediction errors, which are epiphenomenal for the model-based system, are nevertheless present and apparently effective. Finally, I will show that model-free and model-based methods on occasion both cower in the face of Pavlovian influences, and will try and reconcile this as a form of robust control.
Dr. Arjan Vink
T: +49 69 850033-2900
M: +49 175 2647988