Regular Article
Carving the Cognitive Niche: Optimal Learning Strategies in Homogeneous and Heterogeneous Environments

https://doi.org/10.1006/jtbi.2003.3146Get rights and content

Abstract

A model learning system is constructed, in which an organism samples behaviors from a behavioral repertoire in response to a stimulus and selects the behavior with the highest payoff. The stimulus and most rewarding behavior may be kept in the organism's long-term memory and reused if the stimulus is encountered again. The value of the memory depends on the reliability of the stimulus, that is, how the corresponding payoffs of behaviors change over time. We describe how the inclusion of memory can increase the optimal sampling size in environments with some stimulus reliability. In addition to using memory to guide behavior, our organism may use information in its memory to choose the stimulus to which it reacts. This choice is influenced by both the organism's memory state and how many stimuli the organism can observe (its sensory capability). The number of sampled behaviors, memory length, and sensory capability are the variables that define the learning strategy. When all stimuli have the same reliability, there appears to be only a single optimal learning strategy. However, when there is heterogeneity in stimulus reliability, multiple locally optimal strategies may exist.

References (34)

  • R.R. BUSH et al.

    Stochastic Models for Learning

    (1955)
  • D. COHEN

    The equilibrium distribution of optimal search and sampling effort of foraging animals in patchy environments

  • R. Dukas

    Evolutionary ecology of learning

  • R. DUKAS

    Constraints on information processing and their effects on behavior

  • M.W. FELDMAN et al.

    Individual versus social learning: Evolutionary analysis in a fluctuating environment

    Anthropol. Sci.

    (1996)
  • P. GODFREY-SMITH

    Complexity and the Function of Mind in Nature

    (1998)
  • Cited by (0)

    1

    Corresponding author. Present address: Department of Ecology, Evolution and Behavior, University of Minnesota, 100 Ecology, 1987 Buford Circle, St. Paul, MN 55108, U.S.A. Tel.: +1-612-624-3769.

    E-mail address: [email protected] (B. Kerr).

    View full text