 |
| Research article summary (published Jun 2009): |
Lateral intraparietal cortex and reinforcement learning during a mixed-strategy game.
Full Abstract
Activity of the neurons in the lateral intraparietal cortex (LIP) displays a mixture of sensory, motor, and memory signals. Moreover, they often encode signals reflecting the accumulation of sensory evidence that certain eye movements might lead to a desirable outcome. However, when the environment changes dynamically, animals are also required to combine the information about its previously chosen actions and their outcomes appropriately to update continually the desirabilities of alternative actions. Here, we investigated whether LIP neurons encoded signals necessary to update an animal's decision-making strategies adaptively during a computer-simulated matching-pennies game. Using a reinforcement learning algorithm, we estimated the value functions that best predicted the animal's choices on a trial-by-trial basis. We found that, immediately before the animal revealed its choice, approximately 18% of LIP neurons changed their activity according to the difference in the value functions for the two targets. In addition, a somewhat higher fraction of LIP neurons displayed signals related to the sum of the value functions, which might correspond to the state value function or an average rate of reward used as a reference point. Similar to the neurons in the prefrontal cortex, many LIP neurons also encoded the signals related to the animal's previous choices. Thus, the posterior parietal cortex might be a part of the network that provides the substrate for forming appropriate associations between actions and outcomes.
Author information
Author/s: Seo, Hyojung (H); Barraclough, Dominic J (DJ); Lee, Daeyeol (D);
Affiliation: Department of Neurobiology, Yale University School of Medicine, New Haven, Connecticut 06510, USA.
Grants: MH073246 (Agency:NIMH NIH HHS)
Journal and publication information
Publication Type: Journal Article; Research Support, N.I.H., Extramural
Journal: The Journal of neuroscience : the official journal of the Society for Neuroscience (J Neurosci), published in United States. (Language: eng)
Reference: 2009-Jun; vol 29 (issue 22) : pp 7278-89
Dates: Created 2009/06/04; Completed 2009/06/22; Revised 2009/09/15;
PMID: 19494150, status: MEDLINE (last retrieval date: 9/16/2009, IMS Date: )
Sourced from the National Library of Medicine. Abstract text and other information may be subject to copyright.
External Links for this article
(including full text providers, if available):
Click Electronic Full-text Provider Links to see options for finding the electronic full text links to this article. Note there may be a subscription or fee required for access to the full text. See our FAQ for information on finding FREE full text articles.
This article may also be located in paper journal collections available in many libraries. Use the Journal and Publication Information above to find the full article.
MeSH headings (categories)
This article was linked to the MESH Headings shown below.
Related articles
This article has not been indexed for related articles as yet, however you can still use the live related article search links below.
See a large map of 100+ related articles.