The functional role of episodic memory in spatial learning

A bstract Episodic memory has been studied extensively in the past few decades, but so far little is understood about how it drives behavior. Here we propose that episodic memory can facilitate learning in two fundamentally different modes: retrieval and replay. We study their properties by comparing three learning paradigms using computational modeling based on visually-driven reinforcement learning. Firstly, episodic memory is retrieved to learn from single experiences (one-shot learning); secondly, episodic memory is replayed to facilitate learning of statistical regularities (replay learning); and, thirdly, learning occurs online as experiences arise with no access to past experiences (online learning). We found that episodic memory benefits spatial learning in a broad range of conditions, but the performance difference is meaningful only when the task is sufficiently complex and the number of learning trials is limited. Furthermore, the two modes of accessing episodic memory affect spatial learning distinctly. One-shot learning is initially faster than replay learning, but the latter reaches a better asymptotic performance. Our model accounts for experimental results where replay is inhibited, but the hippocampus, and hence episodic memory, is intact during learning. Understanding how episodic memory drives behavior will be an important step towards elucidating the nature of episodic memory.