• Info
  • Home
  • About
  • Editorial Board
  • Archive
  • Research Topics
  • View Some Authors
  • Review Guidelines
  • Subscribe to Alerts
  • Search
  • Article Type

    Publication Date

  • Author Info
  • Why Submit?
  • Fees
  • Article Types
  • Author Guidelines
  • Submission Checklist
  • Contact Editorial Office
  • Submit Manuscript
Start date should be earlier than end date. OK Please enter valid date format.

Original Research ARTICLE

Analyses of Markov decision process structure regarding the possible strategic use of interacting memory systems

Center for Memory and Brain, Boston University, Boston, MA, USA
Behavioral tasks are often used to study the different memory systems present in humans and animals. Such tasks are usually designed to isolate and measure some aspect of a single memory system. However, it is not necessarily clear that any given task actually does isolate a system or that the strategy used by a subject in the experiment is the one desired by the experimenter. We have previously shown that when tasks are written mathematically as a form of partially observable Markov decision processes, the structure of the tasks provide information regarding the possible utility of certain memory systems. These previous analyses dealt with the disambiguation problem: given a specific ambiguous observation of the environment, is there information provided by a given memory strategy that can disambiguate that observation to allow a correct decision? Here we extend this approach to cases where multiple memory systems can be strategically combined in different ways. Specifically, we analyze the disambiguation arising from three ways by which episodic-like memory retrieval might be cued (by another episodic-like memory, by a semantic association, or by working memory for some earlier observation). We also consider the disambiguation arising from holding earlier working memories, episodic-like memories or semantic associations in working memory. From these analyses we can begin to develop a quantitative hierarchy among memory systems in which stimulus-response memories and semantic associations provide no disambiguation while the episodic memory system provides the most flexible disambiguation, with working memory at an intermediate level.
Keywords:
content-addressable sequential retrieval, gated active maintenance, multiple memory systems, partially observable Markov decision process, reinforcement learning
Citation:
Zilli EA and Hasselmo ME (2008). Analyses of Markov decision process structure regarding the possible strategic use of interacting memory systems. Front. Comput. Neurosci. 2:6. doi: 10.3389/neuro.10.006.2008
Received:
28 May 2008;
 Paper pending published:
25 June 2008;
Accepted:
01 December 2008;
 Published online:
24 December 2008.

Edited by:

Peter Dayan, University College London, UK

Reviewed by:

Yael Niv, Princeton University, USA
Marc Howard, Syracuse University, USA
Michael Todd, Princeton University, USA
Copyright:
© 2008 Zilli and Hasselmo. This is an open-access article subject to an exclusive license agreement between the authors and the Frontiers Research Foundation, which permits unrestricted use, distribution, and reproduction in any medium, provided the original authors and source are credited.
*Correspondence:
Eric A. Zilli, Center for Memory and Brain, Boston University, 2 Cummington Street, Boston, MA 02215, USA. e-mail: zilli@bu.edu

© 2007 - 2012 Frontiers Media S.A. All Rights Reserved