Abstract
The construct of conditioned reinforcement has been challenged over the past two decades, both as an adequate explanation of behavior in various situations (e.g., behavioral chains) in which it was previously regarded as crucial and in terms of the validity of the concept of conditioned value on which it is based. Recent research is reviewed that answers these criticisms and vindicates the importance of the construct. Also discussed are unanswered empirical issues regarding the concept and its implications for behavioral phenomena of major importance for general-process learning theory, such as autoshaping and imprinting.
Article PDF
Similar content being viewed by others
References
Baeyens, F., Eelen, P., Crombez, G., &van den Bergh, O. (1992). Human evaluative conditioning: Acquisition trials, presentation schedule, evaluative style and contingency awareness.Behavior Research & Therapy,30, 133–142.
Baeyens, F., Eelen, P., &van den Bergh, O. (1990). Contingency awareness in evaluative conditioning: A case for unaware affective evaluative learning.Cognition & Emotion,4, 3–18.
Baum, W. M. (1973). The correlation-based law of effect.Journal of the Experimental Analysis of Behavior,20, 137–153.
Bolhuis, J. J., de Vos, G. J., &Kruijt, J. P. (1990). Filial imprinting and associative learning.Quarterly Journal of Experimental Psychology,42B, 313–329.
Bolles, R. C. (1967).Theory of motivation. New York: Harper & Row.
Branch, M. N. (1977). Signalled and unsignalled percentage reinforcement of performance under a chained schedule.Journal of the Experimental Analysis of Behavior,25, 71–83.
Brewer, W. F. (1974). There is no convincing evidence for operant or classical conditioning in adult humans. In W. B. Weimer & D. S. Palermo (Eds.),Cognition and symbolic processes. Hillsdale, NJ: Erlbaum.
Brown, P. L., &Jenkins, H. M. (1968). Auto-shaping of the pigeon’s keypeck.Journal of the Experimental Analysis of Behavior,11, 1–8.
Bullock, D., &Neuringer, A. (1977). Social learning by following: An analysis.Journal of the Experimental Analysis of Behavior,25, 127–135.
Catania, A. C., &Keller, K. J. (1981). Contingency, contiguity, correlation, and the concept of causation. In P. Harzem & M. D. Zeiler (Eds.),Advances in the analysis of behaviour: Vol. 2. Predictability, correlation, and contiguity (pp. 125–167). Chichester, U.K.: Wiley.
Chance, P. (1994).Learning & behavior (3rd ed.). Pacific Grove, CA: Brooks/Cole.
Cronin, P. B. (1980). Reinstatement of postresponse stimuli prior to reward in delayed-reward discrimination learning by pigeons.Animal Learning & Behavior,8, 352–358.
Daly, H. B. (1969). Learning of a hurdle-jump response to escape cues paired with reduced reward or frustrative nonreward.Journal of Experimental Psychology,79, 146–157.
Deutsch, J. A. (1960). The structural basis of behavior. Cambridge: Cambridge University Press.
Dollard, J., &Miller, N. E. (1950).Personality and psychotherapy: An analysis in terms of learning, thinking and culture. New York: McGraw-Hill.
Domjan, M., &Burkhard, B. (1986).The principles of learning and behavior (2nd ed.). Pacific Grove, CA: Brooks/Cole.
Dunn, R., Williams, B., &Royalty, P. (1987). Devaluation of stimuli contingent on choice: Evidence for conditioned reinforcement.Journal of the Experimental Analysis of Behavior,48, 117–131.
Durlach, P. J. (1989). Learning and performance in Pavlovian conditioning: Are failures of contiguity failures of learning or performance? In S. B. Klein & R. R. Mowrer (Eds.),Contemporary learning theories: Pavlovian conditioning and the status of traditional learning theory (pp. 19–59). Hillsdale, NJ: Erlbaum.
Fantino, E. (1969). Choice and rate of reinforcement.Journal of the Experimental Analysis of Behavior,12, 723–730.
Fantino, E. (1977). Conditioned reinforcement: Choice and information. In W. K. Honig & J. E. R. Staddon (Eds.),Handbook of operant behavior (pp. 313–339). Englewood Cliffs, NJ: Prentice-Hall.
Gallistel, C. R. (1990).The organization of learning. Cambridge, MA: MIT Press.
Gibbon, J., &Balsam, P. (1981). Spreading association in time. In C. M. Locurto, H. S. Terrace, & J. Gibbon (Eds.),Autoshaping and conditioning theory (pp. 219–253). New York: Academic Press.
Gollub, L. R. (1970). Information on conditioned reinforcement: A review ofConditioned reinforcement edited by D. Hendry.Journal of the Experimental Analysis of Behavior,14, 361–372.
Gormezano, I., &Kehoe, E. J. (1982). Associative transfer in classical conditioning to serial compounds. In M. L. Commons, R. J. Herrnstein, & A. R. Wagner (Eds.),Quantitative analyses of behavior: Acquisition (Vol. 3, pp. 297–322). Cambridge, MA: Ballinger Press.
Hearst, E. (1975). Pavlovian conditioning and directed movements. In G. Bower (Ed.),The psychology of learning and motivation (Vol. 9, pp. 215–262). New York: Academic Press.
Hearst, E., &Jenkins, H. M. (1974).Sign tracking: The stimulusreinforcer relation and directed action. Austin, TX: The Psychonomic Society.
Herrnstein, R. J. (1977). The evolution of behaviorism.American Psychologist,32, 593–603.
Herrnstein, R. J., &Loveland, D. H. (1972). Food-avoidance in hungry pigeons and other perplexities.Journal of the Experimental Analysis of Behavior,18, 369–383.
Hoffman, H. S., &Ratner, A. M. (1973). A reinforcement model of imprinting: Implications for socialization in monkeys and man.Psychological Review,80, 527–546.
Holland, P. C. (1982). Interelement associations in serial compound conditioning. In M. Commons, R. J. Herrnstein, & A. Wagner (Eds.),Quantitative analyses of behavior: Acquisition (Vol. 3, pp. 323–345). Cambridge, MA: Ballinger Press.
Holland, P. C., &Rescorla, R. A. (1975). The effect of two ways of devaluing the unconditioned stimulus after first- and second-order appetitive conditioning.Journal of Experimental Psychology: Animal Behavior Processes,1, 355–363.
Holyoak, K. J., Koh, K., &Nisbett, R. E. (1989). A theory of conditioning: Inductive learning within rule-based default hierarchies.Psychological Review,96, 315–340.
Jenkins, H. M., &Moore, B. R. (1973). The form of the autoshaped response with food or water reinforcers.Journal of the Experimental Analysis of Behavior,20, 163–181.
Kelleher, R. T. (1966). Conditioned reinforcement in second-order schedules.Journal of the Experimental Analysis of Behavior,9, 475–485.
Keller, F. S., &Schoenfeld, W. N. (1950).Principles of psychology. New York: Appleton-Century-Crofts.
Killeen, P. (1968). On the measure of reinforcement frequency in the study of preference.Journal of the Experimental Analysis of Behavior,11, 263–269.
Kimble, G. A. (1961).Hilgard and Marquis’ conditioning and learning. Englewood Cliffs, NJ: Prentice-Hall.
Kish, G. B. (1966). Studies of sensory reinforcement. In W. K. Honig (Ed.),Operant behavior: Areas of research and application (pp. 109–159). New York: Appleton-Century-Crofts.
Lattal, K. A., &Gleeson, S. (1990). Response acquisition with delayed reinforcement.Journal of Experimental Psychology: Animal Behavior Processes,16, 27–39.
Leung, J.-P., &Winton, A. S. W. (1988). Preference for simple interval schedules of reinforcement in concurrent chains: Effects of segmentation ratio.Journal of the Experimental Analysis of Behavior,49, 9–20.
Lieberman, D. A., Davidson, F. H., &Thomas, G. V. (1985). Marking in pigeons: The role of memory in delayed reinforcement.Journal of Experimental Psychology: Animal Behavior Processes,11, 611–624.
Lieberman, D. A., McIntosh, D. C., &Thomas, G. V. (1979). Learning when reward is delayed: A marking hypothesis.Journal of Experimental Psychology: Animal Behavior Processes,5, 224–242.
Mackintosh, N. J. (1974).The psychology of animal learning. New York: Academic Press.
Mackintosh, N. J. (1983).Conditioning and associative learning. New York: Oxford University Press.
Mazur, J. E. (1986). Choice between single and multiple delayed reinforcers.Journal of the Experimental Analysis of Behavior,46, 67–77.
Mazur, J. E. (1991). Choice with probabilistic reinforcement: Effect of delay and conditioned reinforcers.Journal of the Experimental Analysis of Behavior,55, 63–77.
Mazur, J. E. (1993). Predicting the strength of a conditioned reinforcer: Effects of delay and uncertainty.Current Directions in Psychological Science,2, 70–74.
Miller, N. (1951). Learnable drives and rewards. In S. S. Stevens (Ed.),Handbook of experimental psychology (pp. 435–472). New York: Wiley.
Miller, N. E., &Dollard, J. (1941).Social learning and imitation. New Haven: Yale University Press.
Morgan, M. J. (1974). Resistance to satiation.Animal Behavior,22, 449–466.
Mowrer, O. H. (1950).Learning theory and personality dynamics. New York: The Ronald Press.
Nairne, J. S., &Rescorla, R. A. (1981). Second-order conditioning with diffuse auditory reinforcers in the pigeon.Learning & Motivation,12, 65–91.
Neuringer, A., &Neuringer, M. (1974). Learning by following a food source.Science,184, 1005–1008.
Pearce, J. M., &Collins, L. (1987). An evaluation of the associative strength of a partially reinforced serial CS.Quarterly Journal of Experimental Psychology,39B, 273–293.
Peden, B. F., Browne, M. P., &Hearst, E. (1977). Persistent approaches to a signal for food despite food omission for approaching.Journal of Experimental Psychology: Animal Behavior Processes,3, 377–399.
Preston, R. A., &Fantino, E. (1991). Conditioned reinforcement value and choice.Journal of the Experimental Analysis of Behavior,55, 155–175.
Rachlin, H. (1976).Behavior and learning. San Francisco: W. H. Freeman.
Rachlin, H., Logue, A. W., Gibbon, J., &Frankel, M. (1986). Cognition and behavior in studies of choice.Psychological Review,93, 33–45.
Rescorla, R. A. (1977). Pavlovian second-order conditioning: Some implications for instrumental behavior. In H. Davis & H. M. B. Hurwitz (Eds.),Operant-Pavlovian interactions (pp. 133–164). Hillsdale, NJ: Erlbaum.
Rescorla, R. A. (1980).Pavlovian second-order conditioning: Studies in associative learning. Hillsdale, NJ: Erlbaum.
Rescorla, R. A. (1982). Effect of a stimulus intervening between CS and US in autoshaping.Journal of Experimental Psychology: Animal Behavior Processes,8, 131–141.
Rose, J. E., &Levin, E. (1991). Inter-relationships between conditioned and primary reinforcement in the maintenance of cigarette smoking.British Journal of Addiction,86, 605–609.
Royalty, P., Williams, B. A., &Fantino, E. (1987). Effects of delayed conditioned reinforcement in chain schedules.Journal of the Experimental Analysis of Behavior,47, 41–56.
Schaal, D. W., &Branch, M. N. (1988). Responding of pigeons under variable-interval schedules of unsignaled, briefly signaled, and completely signaled delays to reinforcement.Journal of the Experimental Analysis of Behavior,50, 33–54.
Schaal, D. W., &Branch, M. N. (1990). Responding of pigeons under variable-interval schedules of signaled-delayed reinforcement: Effects of delay-signal duration.Journal of the Experimental Analysis of Behavior,53, 103–121.
Schuster, R. H. (1969). A functional analysis of conditioned reinforcement. In D. Hendry (Ed.),Conditioned reinforcement (pp. 192–234). Homewood, IL: Dorsey Press.
Shull, R. L., Mellon, R. C., &Sharp, J. A. (1990). Delay and number of food reinforcers: Effect on choice and latencies.Journal of the Experimental Analysis of Behavior,53, 235–246.
Shull, R. L., Spear, D. J., &Bryson, A. E. (1981). Delay or rate of food delivery as a determiner of response rate.Journal of the Experimental Analysis of Behavior,35, 129–143.
Sizemore, O. J., &Lattal, K. A. (1978). Unsignalled delay of reinforcement in variable-interval schedules.Journal of the Experimental Analysis of Behavior,30, 169–175.
Skinner, B. F. (1938).The behavior of organisms. New York: Appleton-Century-Crofts.
Skinner, B. F. (1953).Science and human behavior. New York: Free Press.
Staddon, J. E. R. (1983).Adaptive learning and behavior. Cambridge: Cambridge University Press.
Stuart, E. W., Shimp, T. A., &Engle, R. W. (1987). Classical conditioning of consumer attitudes: Four experiments in an advertising context.Journal of Consumer Research,14, 334–349.
Wessells, M. G. (1974). The effects of reinforcement upon the prepecking behaviors of pigeons in the auto-shaping experiment.Journal of the Experimental Analysis of Behavior,21, 125–144.
Wike, E. L. (1966).Secondary reinforcement: Selected experiments. New York: Harper & Row.
Williams, B. A. (1971). The effects of intertrial interval on discrimi nation reversal learning in the pigeon.Psychonomic Science,23, 241–243.
Williams, B. A. (1976a). The effects of unsignalled delayed reinforcement.Journal of the Experimental Analysis of Behavior,26, 441–449.
Williams, B. A. (1976b). Short-term retention of response outcome as a determinant of serial reversal learning.Learning & Motivation,7, 418–430.
Williams, B. A. (1981). Invariance in reinforcements to acquisition, with implications for the theory of inhibition.Behaviour Analysis Letters,1, 73–80.
Williams, B. A. (1988). Reinforcement, choice, and response strength. In R. C. Atkinson, R. J. Herrnstein, G. Lindzey, & R. D. Luce (Eds.),Stevens’ handbook of experimental psychology (2nd ed., pp. 167–244). New York: Wiley.
Williams, B. A. (1991a). Behavioral contrast and reinforcement value.Animal Learning & Behavior,19, 337–344.
Williams, B. A. (1991b). Marking and bridging versus conditioned reinforcement.Animal Learning & Behavior,19, 264–269.
Williams, B. A., &Dunn, R. (1991a). Preference for conditioned reinforcement.Journal of the Experimental Analysis of Behavior,55, 37–46.
Williams, B. A., &Dunn, R. (1991b). Substitutability between conditioned and primary reinforcers in discrimination acquisition.Journal of the Experimental Analysis of Behavior,55, 21–35.
Williams, D. R., &Williams, H. (1969). Automaintenance in the pigeon: Sustained pecking despite contingent non-reinforcement.Journal of the Experimental Analysis of Behavior,12, 511–520.
Zimmerman, J., Hanford, P. V., &Brown, W. (1967). Effects of conditioned reinforcement frequency in an intermittent free-feeding situation.Journal of the Experimental Analysis of Behavior,10, 331–340.
Author information
Authors and Affiliations
Corresponding author
Additional information
Preparation of this paper, as well as much of the research, was supported by NSF grants to the author, who thanks Seth Roberts, Linda Hayes, and Edmund Fantino for their comments on earlier drafts.
Rights and permissions
About this article
Cite this article
Williams, B.A. Conditioned reinforcement: Neglected or outmoded explanatory construct?. Psychon Bull Rev 1, 457–475 (1994). https://doi.org/10.3758/BF03210950
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03210950