Original contribution
Higher order associative memories and their optical implementations

https://doi.org/10.1016/0893-6080(88)90017-2Get rights and content

Abstract

The properties of higher order memories are described. The non-redundant, up to Nth order polynomial expansion of N-dimensional binary vectors is shown to yield orthogonal feature vectors. The properties of expansions that contain only a single order are investigated in detail and the use of the sum of outer product algorithm for training higher order memories is analyzed. Optical implementations of quadratic associative memories are described using volume holograms for the general case and planar holograms for shift invariant memories.

References (31)

  • C. Warde et al.

    Spatial light modulators: Applications and functional capabilities

  • Y. Abu-Mostafa et al.

    Computation power of parallelism in optical architectures

  • J.A. Anderson

    Cognitive and psychological computation with neural models

    IEEE Transactions on Systems, Man, and Cybernetics

    (1983)
  • R.A. Athale et al.

    Optical implementation of associative memory with controlled nonlinearity in the correlation domain

    Optics Letters

    (1986)
  • P. Baldi et al.

    Number of stable points for spin-glasses and neural networks of higher orders

    Physics Review Letters

    (1987)
  • H.H. Chen et al.

    High order correlation model for associative memory

  • M. Cohen et al.

    Absolute stability of global pattern formation and parallel memory storage by competitive neural networks

    IEEE Transactions on Systems, Man, and Cybernetics

    (1983)
  • R.J. Collier et al.

    Optical holography

    (1971)
  • T.M. Cover

    Geometrical and statistical properties of systems of linear inequalities with applications in pattern recognition

    IEEE Transactions on Electronic Computers

    (1965)
  • R. Duda et al.

    Pattern classification and scene analysis

    (1973)
  • C.L. Giles et al.

    Learning and generalization in higher order networks

    Applied Optics

    (1987)
  • J.W. Goodman et al.

    Fully parallel high speed incoherent optical method for performing discrete Fourier transforms

    Optics Letters

    (1978)
  • J. Hopfield

    Neural networks and physical systems with emergent collective computational abilities

  • H. Kogelnik

    Coupled theory for thick hologram gratings

    Bell Systems Technical Journal

    (1969)
  • T. Kohonen

    Self-organization and associative memory

    (1984)
  • Cited by (0)

    Funded by the Air Force Office of Scientific Research, the Army Research Office and the Defense Advanced Research Projects Agency.

    Dr. Hong is now with the Rockwell Science Center, Thousand Oaks, CA 91360.

    View full text