Skip to main content
Springer Nature Link
Log in

Effective communication of uncertainty in the IPCC reports

  • Published:
Climatic Change Aims and scope Submit manuscript

Abstract

The Intergovernmental Panel on Climate Change (IPCC) publishes periodical assessment reports informing policymakers and the public on issues relevant to the understanding of human induced climate change. The IPCC uses a set of 7 verbal descriptions of uncertainty, such as unlikely and very likely to convey the underlying imprecision of its forecasts and conclusions. We report results of an experiment comparing the effectiveness of communication using these words and their numerical counterparts. We show that the public consistently misinterprets the probabilistic statements in the IPCC report in a regressive fashion, and that there are large individual differences in the interpretation of these statements, which are associated with the respondents’ ideology and their views and beliefs about climate change issues. Most importantly our results suggest that using a dual (verbal—numerical) scale would be superior to the current mode of communication as it (a) increases the level of differentiation between the various terms, (b) increases the consistency of interpretation of these terms, and (c) increases the level of consistency with the IPCC guidelines. Most importantly, these positive effects are independent of the respondents’ ideological and environmental views.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. Budescu et al. (2009) also asked respondents to indicate a range of values that best describes the word. Our sample size was inversely proportional to the length of the questionnaire, so we decided to focus only on the mean values (as a proxy for the ranges), in an effort to maximize sample size.

  2. The two numbers are different because there were two items associated with each word.

  3. We re-ran the same analysis with the complete data (including all the extreme responses), and found significant differences between words, presentation formats and an interaction between words and presentation formats. Similarly, the differences between words is most (least) pronounced in the VN (Control) group. This analysis confirms the robustness of our results. The detailed results are described in Section 6 of the Online Resource.

  4. Ten respondents were not included in this analysis because they used extreme values (either 0 or 100) for all items and these were coded as missing values.

  5. Relatively fewer respondents scored 3 or more on the numeracy scale and this contributed to higher standard errors observed for these scores

  6. We replicated most of the key ANCOVA results using the complete data. We found significant differences between words, but not between formats. Most importantly, the interaction between words and formats is significant with the VN group showing the best differentiation between terms (see Section 6 in the Online Resource for the detailed results).

  7. Extracted from IPCC AR4 Working Group I Report “The Physical Science Basis”, Chapter 10.

  8. The translation table is ambiguous as it does not specify whether the various ranges are mutually exclusive or overlapping (for example, it is unclear whether likely applies to all probabilities above 66%, or only to values between 67% and 90%). The recently published guidelines for the 5th assessment (Mastrandea, et al. 2010) explicitly state that they are not exhaustive, i.e. likely can be used for any probability between 66% and 100% (not only for the 67–90% range). Although we have no data on this point we suspect that most people will find this solution counterintuitive and confusing.

References

  • Bastardi A, Uhlmann EL, Ross L (2011) Wishful thinking: belief, desire, and the motivated evaluation of scientific evidence. Psychol Sci 22:731–732

    Article  Google Scholar 

  • Begley S (2007) The truth about denial. Newsweek 150:20–29

    Google Scholar 

  • Beyth-Marom R (1982) How probable is probable? A numerical translation of verbal probability expressions. J Forecast 1:257–269

    Article  Google Scholar 

  • Broomell S, Budescu DV, Por H (2009) Beliefs and actions: an analysis of the public’s attitudes toward global climate change. Paper presented at the Annual Meeting of the Society of Judgment and Decision Making, Boston

  • Brun W, Teigen KH (1988) Verbal probabilities: ambiguous, context-dependent, or both? Organ Behav Hum Decis Process 41:390–414

    Article  Google Scholar 

  • Bryant G, Norman G (1980) Expressions of probability: words and numbers. N Engl J Med 302:411

    Google Scholar 

  • Budescu DV, Broomell SB, Por HH (2009) Improving communication of uncertainty in the reports of the Intergovernmental Panel on Climate Change. Psychol Sci 20:299–308

    Article  Google Scholar 

  • Budescu DV, Wallsten TS (1990) Dyadic decisions with numerical and verbal probabilities. Organ Behav Hum Decis Process 46:240–263

    Article  Google Scholar 

  • Budescu DV, Wallsten TS (1985) Consistency in interpretation of probabilistic phrases. Organ Behav Hum Decis Process 36:391–405

    Article  Google Scholar 

  • Budescu DV, Wallsten TS (1987) Subjective estimation of precise and vague uncertainties. In: Wright G, Ayton P (eds) Judgmental forecasting. Wiley, New York, pp 63–82

    Google Scholar 

  • Budescu DV, Weinberg S, Wallsten TS (1988) Decisions based on numerically and verbally expressed uncertainties. J Exp Psychol Hum Percept Perform 14:281–294

    Article  Google Scholar 

  • Budescu DV, Karelitz TM, Wallsten TS (2003) Predicting the directionality of probability words from their membership functions. J Behav Decis Mak 16:159–180

    Article  Google Scholar 

  • Chesley GR (1985) Interpretation of uncertainty expressions. Contemp Account Res 2:179–199

    Article  Google Scholar 

  • Clarke VA, Ruffin CL, Hill DJ, Beamen AL (1992) Ratings of orally presented verbal expressions of probability by a heterogeneous sample. J Appl Soc Psychol 22:638–656

    Article  Google Scholar 

  • Dhami MK, Wallsten TS (2005) Interpersonal comparison of subjective probabilities: toward translating linguistic probabilities. Mem Cognit 33:1057–1068

    Article  Google Scholar 

  • Erev I, Cohen BL (1990) Verbal versus numerical probabilities: Efficiency, biases, and the preference paradox. Organ Behav Hum Decis Process 45:1–18

    Article  Google Scholar 

  • Erev I, Wallsten TS, Neal M (1991) Vagueness, ambiguity, and the cost of mutual understanding. Psychol Sci 2:231–324

    Article  Google Scholar 

  • illenbaum S, Wallsten TS, Cohen BL, Cox JA (1991) Some effects of vocabulary and communication task on the understanding and use of vague probability expressions. Am J Psychol 104:35–60

    Article  Google Scholar 

  • Fischer K, Jungermann H (1996) Rarely occurring headaches and rarely occurring blindness: is rarely = rarely? The meaning of verbal frequentistic labels in specific medical contexts. J Behav Decis Mak 9:153–172

    Article  Google Scholar 

  • Fischhoff B (1994) What forecasts (seem to) mean. Int J Forecast 10:387–403

    Article  Google Scholar 

  • Frederick S (2005) Cognitive reflection and decision making. J Econ Perspect 19(4):25–42

    Article  Google Scholar 

  • Fox CR, Irwin JR (1998) The role of context in the communication of uncertain beliefs. Basic Appl Soc Psychol 20:57–70

    Article  Google Scholar 

  • Hamm RM (1991) Selection of verbal probabilities: a solution for some problems of verbal probability expression. Organ Behav Hum Decis Process 48:193–223

    Article  Google Scholar 

  • Heath Y, Gifford R (2006) Free-market ideology and environmental degradation: the case of belief in global climate change. Environ Behav 38:48–71

    Article  Google Scholar 

  • Ha-Duong M, Swart R, Bernstein L, Petersen R (2007) Uncertainty management in the IPCC: agreeing to disagree. Glob Environ Chang 17:8–11

    Article  Google Scholar 

  • Intergovernmental Panel on Climate Change (2001) Summary for policymakers: contribution of working group I to the third assessment report of the intergovernmental panel on climate change. Retrieved July 2009 from http://www.grida.no/climate/ipcc_tar/wg1/pdf/WG1_TAR-FRONT.pdf

  • Intergovernmental Panel on Climate Change (2005) Guidance notes for lead authors of the IPCC fourth assessment report on addressing uncertainties. Retrieved February 2011 from http://www.ipcc.ch/meetings/ar4-workshops-express-meetings/uncertainty-guidance-note.pdf

  • Intergovernmental Panel on Climate Change (2007) Summary for policymakers: contribution of working group I to the fourth assessment report of the intergovernmental panel on climate change. Retrieved February 2007 from http://www.ipcc.ch/pdf/assessment-report/ar4/wg1/ar4-wg1-spm.pdf

  • Johnson EM (1973) Numerical encoding of qualitative expressions of uncertainty (Technical paper No. 250). US Army Research Institute for the Behavioral & Social Sciences

  • Karelitz TM, Budescu DV (2004) You say “Probable” and I say “Likely”: improving interpersonal communication with verbal probability phrases. J Exp Psychol Appl 10:25–41

    Article  Google Scholar 

  • Klayman J, Ha Y (1987) Confirmation, disconfirmation and information in hypothesis testing. Psychol Rev 94:211–228

    Article  Google Scholar 

  • Kong A, Barnett GO, Mosteller F, Youtz C (1986) How medical professionals evaluate expressions of probability. N Engl J Med 315:740–744

    Article  Google Scholar 

  • Kunda Z (1990) The case for motivated reasoning. Psychol Bull 180:480–498

    Article  Google Scholar 

  • Leiserowitz A, Maibach E, Roser-Renouf C, Hmielowski JD (2011) Politics & global warming: democrats, republicans, independents, and the tea party. Yale University and George Mason University. New Haven, CT: Yale Project on Climate Change Communication. Retrieved from http://environment.yale.edu/climate/files/PoliticsGlobalWarming2011.pdf

  • Leiserowitz A, Smith N (2010) Knowledge of climate change across global warming’s six Americas. Yale University. New Haven, CT: Yale Project on Climate Change Communication

  • Leiserowitz A, Smith N, Marlon JR (2010) Americans’ knowledge of climate change. Yale University. New Haven, CT: Yale Project on Climate Change Communication. Retrieved from http://environment.yale.edu/climate/files/ClimateChangeKnowledge2010.pdf

  • Lipkus IM (2007) Communicating the uncertainty of harms and benefits of medical interventions. Med Decis Making 27:681–695

    Article  Google Scholar 

  • Mapes REA (1979) Verbal and numerical estimates of probability terms. J Gen Intern Med 6:237

    Google Scholar 

  • Mastrandea MD, Field CB, Stocker TF, Edenhofer O, Rbi KL, Frame DJ, Held H, Kreogler E, Mach KJ, Matschoss PR, Plattner GK, Yohee GW, Zwiers FW (2010) Guidance note for lead authors of the IPCC fifth assessment report on consistent treatment of uncertainties. Intergovermental Panel on Climate Change (IPCC). (Available at http://www.ipcc.ch)

  • Merz JF, Druzdzel MJ, Mazur DJ (1991) Verbal expressions of probability in informed consent litigation. J Med Decis Making 11:273–281

    Article  Google Scholar 

  • Mosteller F, Youtz C (1990) Quantifying probabilistic expressions. Stat Sci 5:2–16

    Google Scholar 

  • Mullet E, Rivet I (1991) Comprehension of verbal probability expressions in children and adolescents. Lang Comm 11:217–225

    Article  Google Scholar 

  • Nakao M, Axelrod S (1983) Numbers are better than words: verbal specifications of frequency have no place in medicine. Am J Med 74:1061

    Article  Google Scholar 

  • Nickerson RS (1998) Confirmation bias: a ubiquitous phenomenon in many guises. Rev Gen Psychol 2:175–220

    Article  Google Scholar 

  • Nobelprize.org (2008) The Nobel peace prize 2007. Retrieved November 2007 from http://nobelprize.org/nobel_prizes/peace/laureates/2007/press.html

  • Olson MJ, Budescu DV (1997) Patterns of preference for numerical and verbal probabilities. J Behav Decis Mak 10:117–131

    Article  Google Scholar 

  • Patt AG, Schrag DP (2003) Using specific language to describe risk and probability. Clim Chang 61:17–30. doi:10.1023/A:1026314523443

    Article  Google Scholar 

  • Pepper S, Prytulak LS (1974) Sometimes frequently means seldom: context effects in the interpretation of quantitative expressions. J Res Personal 8:95–101

    Article  Google Scholar 

  • Peters E, Västfjäll D, Slovic P, Mertz CK, Mazzocco K, Dickert S (2006) Numeracy and decision making. Psychol Sci 17:407–413

    Article  Google Scholar 

  • Pew Research Center for for the People and the Press (2009) Scientific achievements less prominent than a decade ago: public praise science; Scientists fault public, media. Retrieved Novermber 2009 from http://people-press.org/reports/pdf/528.pdf

  • Piercey MD (2009) Motivated reasoning and verbal vs. numerical probability assessment: evidence from an accounting context. Organ Behav Hum Decis Process 108:330–341

    Article  Google Scholar 

  • Pyszcynski T, Greenberg J (1987) Toward an integration of cognitive and motivational perspectives on social inferences: a biased hypothesis testing model. In: Berkowitz L (ed) Advances in experimental social psychology. Academic Press, New York, pp 297–340

  • Reagan R, Mosteller F, Youtz C (1989) Quantitative meanings of verbal probability expressions. J Appl Psychol 74:433–442

    Article  Google Scholar 

  • Reyna VF, Brainerd CJ (2007) The importance of mathematics in health and human judgment: numeracy, risk communication, and medical decision making. Learn Individ Differ 17:147–159

    Article  Google Scholar 

  • Smithson M, Budescu DV, Broomell SB, Por H (2011) Never say “Not:” impact of negative wording in probability phrases on imprecise probability judgments. Presented at 7th International Symposium on Imprecise Probability: Theories and Applications, Innsbruck, Austria

  • Sterman JD (2011) Communicating climate change risks in a skeptical world. Climatic Change. In press

  • Sutherland HJ, Lockwood GA, Tritchler DL, Sem F (1991) Communicating probabilistic information to cancer patients: is there “noise” on the line? Soc Sci Med 32:725–731

    Article  Google Scholar 

  • Teigen KH, Brun W (1999) The directionality of verbal probability expressions: effects on decisions, predictions and probabilistic reasoning. Organ Behav Hum Decis Process 80:155–190

    Article  Google Scholar 

  • Wallsten TS, Budescu DV (1995) A review of human linguistic probability processing: general principles and empirical evidence. Knowl Eng Rev 10:43–62

    Article  Google Scholar 

  • Wallsten TS, Budescu DV, Zwick R, Kemp SM (1993) Preferences and reasons for communicating probabilistic information in numerical or verbal terms. Bull Psychon Soc 31:135–138

    Google Scholar 

  • Wallsten TS, Fillenbaum S, Cox JA (1986) Base rate effects on the interpretations of probability and frequency expressions. J Mem Lang 25:571–587

    Article  Google Scholar 

  • Weber EU, Hilton DJ (1990) Contextual effects in the interpretations of probability words: perceived base rate and severity of events. J Exp Psychol Hum Percept Perform 16:781–789

    Article  Google Scholar 

  • Witteman C, Renooij S (2003) Evaluation of a verbal–numerical probability scale. Int J Approx Reason 33:117–131

    Article  Google Scholar 

  • Witteman C, Renooij S, Koele PM (2007) Medicine in words and numbers: a cross-sectional survey comparing probability assessment scales. BMC Med Informat Decis Making 7

  • Zwick R, Wallsten TS (1989) Combining stochastic uncertainty and linguistic inexactness: theory and experimental evaluation of four fuzzy probability models. Int J Man Mach Stud 30:69–111

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Science Foundation under Grant No. 0345925, and the data were collected by Time-sharing Experiments for the Social Sciences, NSF Grant 0818839 (Jeremy Freese and Penny Visser, Principal Investigators). The third author was supported by the National Geospatial-Intelligence Agency (under Grant No. HM1582-09-1-0020). The opinions, findings and conclusions or recommendations expressed in this paper are those of the authors and do not necessarily reflect the views of the funding entity.

Many thanks to Profs. Klaus Keller and Thomas Wallsten and three reviewers for useful comments and suggestions on an earlier version.

Author information

Authors and Affiliations

  1. Department of Psychology, Fordham University, 441 East Fordham Road, Bronx, NY, 10458, USA

    David V. Budescu & Han-Hui Por

  2. Department of Social and Decision Sciences, Carnegie Mellon University, Pittsburgh, PA, 15213, USA

    Stephen B. Broomell

  3. College of Information Sciences and Technology, Pennsylvania State University, University Park, PA, 16802, USA

    Stephen B. Broomell

Authors
  1. David V. Budescu
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Han-Hui Por
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Stephen B. Broomell
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to David V. Budescu.

Electronic supplementary materials

Below is the link to the electronic supplementary material.

Online Resource

(DOCX 663 kb)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Budescu, D.V., Por, HH. & Broomell, S.B. Effective communication of uncertainty in the IPCC reports. Climatic Change 113, 181–200 (2012). https://doi.org/10.1007/s10584-011-0330-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10584-011-0330-3

Keywords