Abstract
To improve forecasting accuracy, combine forecasts derived from methods that differ substantially and draw from different sources of information. When feasible, use five or more methods. Use formal procedures to combine forecasts: An equal-weights rule offers a reasonable starting point, and a trimmed mean is desirable if you combine forecasts resulting from five or more methods. Use different weights if you have good domain knowledge or information on which method should be most accurate. Combining forecasts is especially useful when you are uncertain about the situation, uncertain about which method is most accurate, and when you want to avoid large errors. Compared with errors of the typical individual forecast, combining reduces errors. In 30 empirical comparisons, the reduction in ex ante errors for equally weighted combined forecasts averaged about 12.5% and ranged from 3 to 24%. Under ideal conditions, combined forecasts were sometimes more accurate than their most accurate components.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Agnew, C. (1985), “Bayesian consensus forecasts of macroeconomic variables,” Journal of Forecasting, 4, 363–376.
Armstrong, J. S. (1983), “Relative accuracy of judgmental and extrapolative methods in forecasting annual earnings,” Journal of Forecasting, 2, 437–447. Full text at hops.wharton.upenn.edu/forecast.
Armstrong, J. S. (1985), Long-Range Forecasting: From Crystal Ball to Computer (2nd ed.). New York: John Wiley. Full text at hops.wharton.upenn.edu./forecast
Armstrong, J. S., M. Adya and F. Collopy (2001), “Rule-based forecasting: Using judgment in time-series extrapolation,” in J. S. Armstrong (ed.), Principles of Forecasting. Norwell, MA: Kluwer Academic Publishers.
Armstrong, J. S., V. G. Morwitz and V. Kumar (2000), “Sales forecasts for existing consumer products and services: Do purchase intentions contribute to accuracy?” International Journal of Forecasting, 16, 383–397. Full text at hops.wharton.upenn.edu./forecast
Ashton, A. H. and R. H. Ashton (1985), “Aggregating subjective forecasts: Some empirical results,” Management Science, 31, 1499–1508.
Baker, E. J., S. G. West, D. J. Moss and J. M. Weyant (1980), “Impact of offshore nuclear power plants: Forecasting visits to nearby beaches,” Environment and Behavior, 12, 367–407.
Batchelor, R. and P. Dua (1990), “All forecasters are equal,” Journal of Business and Economic Statistics, 8, 143–144.
Batchelor, R. and P. Dua (1992), “Conservatism and consensus-seeking among economic forecasters,” Journal of Forecasting, 11, 169–181.
Batchelor, R. and P. Dua (1995), “Forecaster diversity and the benefits of combining forecasts,” Management Science, 41, 68–75.
Bates, J. M. and C. W. J. Granger (1969), “The combination of forecasts,” Operational Research Quarterly, 20, 451–468.
Bessler, D. A. and J. A. Brandt (1981), “Forecasting livestock prices with individual and composite methods,” Applied Economics, 13, 513–522.
Blattberg, R. C. and S. J. Hoch (1990), “Database models and managerial intuition: 50% model and 50% manager,” Management Science, 36, 887–899.
Brandt, J. A. and D. A. Bessler (1983), “Price forecasting and evaluation: An application in agriculture,” Journal of Forecasting, 2, 237–248.
Bretschneider, S., W. P. Gorr, G. Grizzle and E. Klay (1989), “Political and organizational influences on the accuracy of forecasting state government revenues,” International Journal of Forecasting, 5, 307–319.
Chan, C. K., B. G. Kingsman and H. Wong (1999), “The value of combining forecasts in inventory management a case study in banking,” European Journal of Operational Research, 117, 199–210.
Clemen, R. T. (1989), “Combining forecasts: A review and annotated bibliography,” International Journal of Forecasting, 5, 559–583.
Clemen, R. T. and R. L. Winkler (1986), “Combining economic forecasts,” Journal ofBusiness and Economic Statistics, 4, 39–46.
Cronbach, L. J. and P. E. Meehl (1955), “Construct validity in psychological tests,” Psychological Bulletin, 52, 281–302.
Dalrymple, D. J. (1987), “Sales forecasting practices: Results from a United States survey,” International Journal of Forecasting, 3, 379–391.
Fildes, R. (1991), “Efficient use of information in the formation of subjective industry forecasts,” Journal of Forecasting, 10, 597–617.
Fischer, I. and N. Harvey (1999), “Combining forecasts: What information do judges need to outperform the simple average?” International Journal of Forecasting, 15, 227–246.
Fischhoff, B. (1976), “The effect of temporal setting on likelihood estimates,” Organizational Behavior and Human Performance, 15, 180–184.
Galton, F. (1878), “Composite portraits,” Journal of the Anthropological Institute of Great Britain and Ireland, 8, 132–142.
Gartner, W. B. and R. J. Thomas (1993), “Factors affecting new product forecasting accuracy in new firms,” Journal of Product Innovation Management, 10, 35–52.
Gordon, K. (1924), “Group judgments in the field of lifted weights,” Journal ofExperimental Psychology, 7, 398–400.
Hogarth, R. (1978), “A note on aggregating opinions,” Organizational Behavior and Human Performance21,40–46.
Huffcutt, A. I. and D. J. Woehr (1999), “Further analysis of employment interview validity: A quantitative evaluation of interview-related structuring methods,” Journal of Organizational Behavior, 20, 549–560.
Kaplan, A., A. L. Skogstad and M. A. Girshick (1950), “The prediction of social and technological events,” Public Opinion Quarterly, 14 (Spring), 93–110.
Klugman, S. F. (1945), “Group judgments for familiar and unfamiliar materials,” Journal of General Psychology, 32, 103–110.
Krishnamurti, T. N. et al. (1999), “Improved multimodal weather and seasonal climate forecasts from multimodel `superensemble,”’ Science, 285 (Sept. 3), 1548–1550.
Landefeld, J. S. and E. P. Seskin (1986), “A comparison of anticipatory surveys and econometric models in forecasting U.S. business investment,” Journal of Economic and Social Measurement, 14, 77–85.
Langlois, J. H. and L. A. Roggman (1990), “Attractive faces are only average,” Psychological Science, 1 (March), 115–121.
Larreche, J. C. and R. Moinpour (1983), “Managerial judgment in marketing: The concept of expertise,” Journal of Marketing Research, 20, 110–121.
Lawrence, M. J., R. H. Edmundson and M. J. O’Connor (1986), “The accuracy of combin- ing judgmental and statistical forecasts,” Management Science, 32, 1521–1532.
Levine, R. A. (1960), “Capital expenditures forecasts by individual firms,” in National Bureau of Economic Research, The Quality and Significance of Anticipations Data. Princeton, N.J. pp. 351–366.
Levins, R. (1966), “The strategy of model building in population biology,” American Scientist, 54, 421–431.
Libby, R. and R. K. Blashfield (1978), “Performance of a composite as a function of the number of judges,” Organizational Behavior and Human Performance, 21, 121–129.
Lobo, G. J. (1991), “Alternative methods of combining security analysts’ and statistical forecasts of annual corporate earnings,” International Journal of Forecasting, 7, 57–63.
Lobo, G. J. (1992), “Analysis and comparison of financial analysts’, times series, and combined forecasts of annual earnings,” Journal of Business Research, 24, 269–280.
Lobo, G. J. and R. D. Nair (1990), “Combining judgmental and statistical forecasts: An application to earnings forecasts,” Decision Sciences, 21, 446–460.
Lott, J. (1998), More Guns, Less Crime. Chicago: U. of Chicago Press.
MacLaughlin, R. L. (1973), “The forecasters’ batting averages,” Business Economics, 3 (May), 58–59.
Makridakis, S. (1990), “Sliding simulation: A new approach to time series forecasting,” Management Science, 36, 505–512.
Makridakis, S., C. Chatfield, M. Hibon, M. Lawrence, T. Mills, K. Ord and L. F. Simons (1993), “The M2-Competition: A real-time judgmentally based forecasting study,” International Journal of Forecasting, 9, 5–22.
Makridakis, S. and R. Winkler (1983), “Averages of forecasts: Some empirical results,” Management Science, 29, 987–996.
McNees, S. K. (1992), “The uses and abuses of consensus’ forecasts,” Journal of Forecasting, 11, 703–710
Meade, N. and T. Islam (1998), “Technological forecasting—model selection, model stability, and combining models,” Management Science, 44, 1115–1130.
National Industrial Conference Board (1963), Forecasting Sales. Studies in Business Policy, No. 106. New York.
Newbold, P. and C. W. J. Granger (1974), “Experience with forecasting univariate time series and the combination of forecasts,” Journal of the Royal Statistical Society, Series A, Part 2, 131–165.
Okun, A. E. (1960), “The value of anticipations data in forecasting national product,” in National Bureau of Economic Research, The Quality and Economic Significance of Anticipations Data. Princeton, N.J.
Pencavel, J. H. (1971), “A note on the predictive performance of wage inflation models of the British economy,” Economic Journal, 81, 113–119.
Plous, S. (1995), “A comparison of strategies for reducing interval overconfidence in group judgments,” Journal of Applied Psychology, 80, 443–454.
PoKempner, S. J. and E. Bailey (1970), Sales Forecasting Practices. New York: The Conference Board.
Richards, R. M. and D. R. Fraser (1977), “Further evidence on the accuracy of analysts’ earnings forecasts: A comparison among analysts,” Journal of Economics and Business, 29 (3), 193–197.
Rowse, G. L., D. H. Gustafson and R. L. Ludke (1974), “Comparison of rules for aggregating subjective likelihood ratios,” Organizational Behavior and Human Performance, 12, 274–285.
Sanders, N. R. and K. B. Manrodt (1994), “Forecasting practices in U.S. corporations: Survey results,” Interfaces 24 (March–April), 92–100.
Sanders, N. R. and L. P. Ritzman (1989), “Some empirical findings on short-term forecasting: Technique complexity and combinations,” Decision Sciences, 20, 635–640.
Sanders, N. R. and L. P. Ritzman (1992), “The need for contextual and technical knowledge in judgmental forecasting,” Journal of Behavioral Decision Making, 5, 39–52.
Schnaars, S. (1986), “A comparison of extrapolation models on yearly sales forecasts,” International Journal of Forecasting, 2, 71–85.
Shamseldin, A. Y., K. M. O’Connor and G. C. Liang (1997), “Methods for combining the outputs of different rainfall-runoff models,” Journal of Hydrology, 197, 203–229.
Stroop, J. R. (1932), “Is the judgment of the group better than the average member of the group,” Journal of Experimental Psychology, 15, 550–560.
Thorndike, R. L. (1938), “The effect of discussion upon the correctness of group decisions when the factor of a majority influence is allowed for,” Journal of Social Psychology, 9, 343–362.
Vandome, P. (1963), “Econometric forecasting for the United Kingdom,” Bulletin of the Oxford University Institute of Economics and Statistics, 25, 239–281.
Walker, H. E. (1970), “The value of human judgment,” Industrial Marketing Research Association Journal, 6 (May), 71–74.
Weinberg, C. B. (1986), “Arts plan: Implementation, evolution, and usage,” Marketing Science, 5, 143–158.
Winkler, R. L. (1967), “Probabilistic prediction: Some experimental results,” Journal of the American Statistical Association, 66, 675–685.
Winkler, R. L. and R. M. Poses (1993), “Evaluating and combining physicians’ probabilities of survival in an intensive care unit,” Management Science, 39, 1526–1543.
Wolfe, H. D. (1966), Business Forecasting Methods. New York: Holt, Rinehart and Winston.
Zarnowitz, V. (1984), “The accuracy of individual and group forecasts from business outlook surveys,” Journal of Forecasting, 3, 11–26.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer Science+Business Media New York
About this chapter
Cite this chapter
Armstrong, J.S. (2001). Combining Forecasts. In: Armstrong, J.S. (eds) Principles of Forecasting. International Series in Operations Research & Management Science, vol 30. Springer, Boston, MA. https://doi.org/10.1007/978-0-306-47630-3_19
Download citation
DOI: https://doi.org/10.1007/978-0-306-47630-3_19
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-7923-7401-5
Online ISBN: 978-0-306-47630-3
eBook Packages: Springer Book Archive