Skip to main content
Log in

Navigating Time and Uncertainty in Health Technology Appraisal: Would a Map Help?

  • Leading Article
  • Published:
PharmacoEconomics Aims and scope Submit manuscript

Abstract

Healthcare systems are increasingly under pressure to provide funding for innovative technologies. These technologies tend to be characterized by their potential to make valued contributions to patient health in areas of relative unmet need, and have high acquisition costs and uncertainty within the evidence base on their actual impact on health. Decision makers are increasingly interested in linking reimbursement strategies to the degree of uncertainty in the evidence base and, as a result, reimbursement for innovative technologies is frequently linked to some form of patient access or risk-sharing scheme. As the dominant methods of economic evaluation report final outcomes only at the time horizon of the analysis, they present only aggregated information. This omits much of the information available on how net benefit is distributed within the time horizon. In this article, we introduce the Net Benefit Probability Map (NBPM), which maps net health benefit versus time to identify how certain decision makers can be about the benefit of technologies at multiple time points. Using an illustrative example, we show how the NBPM can inform decision makers about how long it will take for innovative technologies to ‘pay off’, how methodological choices on discount rates affect results and how alternative payment mechanisms can reduce the risk for decision makers facing innovative technologies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Van Hout B, Al J, Gordon G, Rutten F. Costs, effects and C/E ratios alongside a clinical trial. Health Econ. 1994;3(5):309–19.

    Article  PubMed  Google Scholar 

  2. Drummond M, Sculpher M, Torrance G, O’Brien B, Stoddart G. Methods for the economic evaluation of health care programmes. 3rd ed. Oxford: Oxford University Press; 2005.

    Google Scholar 

  3. Fenwick E, Claxton K, Sculpher M. Representing uncertainty: the role of cost-effectiveness acceptability curves. Health Econ. 2001;10:779–87.

    Article  PubMed  CAS  Google Scholar 

  4. Eckermann S, Willan A. Presenting evidence and summary measures to best inform societal decisions when comparing multiple strategies. Pharmacoeconomics. 2011;29(7):563–77.

    PubMed  Google Scholar 

  5. NICE. Appraising treatments which may extend life, at the end of life. National Institute of Health and Clinical Excellence. 2011. http://www.nice.org.uk/aboutnice/howwework/devnicetech/endoflifetreatments.jsp. Accessed 15th November 2012.

  6. Claxton K, Palmer S, Longworth L, Bojke L, Griffin S, McKenna C, et al. Uncertainty, evidence and irrecoverable costs: informing approval, pricing and research decisions for health. Centre for Health Economics Research Paper 69. York: University of York; 2011.

  7. Stafinski T, McCabe C, Menon D. Funding the unfundable: mechanisms for managing uncertainty in decisions on the introduction of new and innovative technologies into health care systems. Pharmacoeconomics. 2010;28(2):113–42.

    Article  PubMed  Google Scholar 

  8. NICE. NICE Patient Access Schemes Liaison Unit. 2011. http://www.nice.org.uk/aboutnice/howwework/paslu/patientaccessschemesliaisonunit.jsp. Accessed September 2012.

  9. Claxton K, Ginnelly L, Sculpher M, Philips Z, Palmer S. A pilot study of the use of decision theory and value of information analysis as part of the NHS Health Technology Assessment Programme. Health Technol Assess. 2004;8(31):1–103.

    Google Scholar 

  10. Hall P, Edlin R, Kharroubi S, Gregory W, McCabe C. Expected net present value of information: from burden to investment. Med Decis Mak. 2012;32(3):E11–21.

    Article  Google Scholar 

  11. Hall P, Hulme C, McCabe C, Oluboyede Y, Round J, Cameron D. Updated cost-effectiveness analysis of trastuzumab for early breast cancer: a UK perspective considering long-term toxicity and patterns of recurrence. Pharmacoeconomics. 2011;29(5):415–32.

    Article  PubMed  Google Scholar 

  12. Stinnett A, Mullahy J. Net health benefits: a new framework for the analysis of uncertainty in cost effectiveness analysis. Med Decis Mak. 1998;18(2):S68–90.

    Article  CAS  Google Scholar 

  13. Claxton K, Paulden M, Gravelle H, Brouwer W, Culyer A. Discounting and decision making in the economic evaluation of health-care technologies. Health Econ. 2010;20:2–15.

    Google Scholar 

  14. Walker S, Sculpher M, Claxton K, Palmer S. Coverage with evidence development, only in research, risk sharing or patient access scheme? A framework for coverage decisions. Value Health. 2012;15(3):570–9.

    Article  PubMed  Google Scholar 

  15. McCabe C, Edlin R, Stafinski T, Menon D. Access with evidence development schemes: a framework for design and evaluation. Pharmacoeconomics. 2010;28(2):143–52.

    Article  PubMed  Google Scholar 

  16. Brouwer W, Niessen L, Postma M, Rutten F. Need for differential discounting of costs and health effects in cost effectiveness analyses. Br Med J. 2005;331:446–8.

    Article  Google Scholar 

  17. Claxton K, Sculpher M, Culyer A, McCabe C, Briggs A, Akehurst R, et al. Discounting and cost-effectiveness in NICE: stepping back to sort out a confusion. Health Econ. 2006;15(1):1–4.

    Article  PubMed  Google Scholar 

  18. Jonsson P, Roberts J. Briefing paper for the methods review group working party on discounting. London: National Institute for Health and Clinical Excellence; 2011.

    Google Scholar 

  19. NICE Citizens Council. How should NICE assess future costs and benefits? http://www.nice.org.uk/media/06B/B8/Citizens_Council_report_on_Discounting.pdf (2011). Accessed 15th November 2012.

  20. Claxton K, Briggs A, Buxton M, Culyer A, McCabe C, Walker S, et al. Value based pricing for NHS drugs: an opportunity not to be missed? Br Med J. 2008;336(7638):251–4.

    Article  Google Scholar 

  21. O’Brien B, Briggs A. Analysis of uncertainty in health care cost-effectiveness studies: an introduction to statistical issues and methods. Stat Methods Med Res. 2002;11(6):455–68.

    Article  PubMed  Google Scholar 

  22. NICE. Guide to the methods of health technology. London: National Institute for Health and Clinical Excellence; 2008.

  23. Huseraeu DF, Augustovski F, Briggs AH, Carswell C, Drummond M, et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS): exploration and elaboration. An ISPOR Task Force Report [draft]. http://www.ispor.org/taskforces/documents/ISPOR-Health-Econ-Eval-Pub-Guidelines-CHEERS-draft-for-review.pdf. Accessed 24th June 2013.

  24. NICE Patient Access Scheme Liaison Unit. http://www.nice.org.uk/aboutnice/howwework/paslu/patientaccessschemesliaisonunit.jsp. Accessed 24th June 2013.

Download references

Acknowledgements

The research reported in this article was unfunded. All individuals who made substantive contributions to the ideas presented in this article are included as authors. The initial concepts for this article were proposed by Christopher McCabe. Richard Edlin was responsible for the first realisations of the NBPM. Peter Hall undertook the modelling work to provide the examples. All authors contributed towards the arguments towards the application of the probability map. We would also like to acknowledge the constructive contribution of several anonymous referees to improving this article.

Conflicts of interest

The research reported in this article is unfunded research. The focus of the article is methodological and we do not believe it has implications for any specific technology.

Christopher McCabe has no conflicts of interest.

Richard Edlin has no conflicts of interest.

Peter Hall has no conflicts of interest.

Statement on Research Ethics

The research reported in this article is methodological and has not required the use of individual data, either identifiable or anonymous. It has not required approval by a research ethics committee.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Christopher McCabe.

Rights and permissions

Reprints and permissions

About this article

Cite this article

McCabe, C., Edlin, R. & Hall, P. Navigating Time and Uncertainty in Health Technology Appraisal: Would a Map Help?. PharmacoEconomics 31, 731–737 (2013). https://doi.org/10.1007/s40273-013-0077-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40273-013-0077-y

Keywords

Navigation