Original Article
External adjustment for unmeasured confounders improved drug–outcome association estimates based on health care utilization data

https://doi.org/10.1016/j.jclinepi.2012.03.014Get rights and content

Abstract

Objectives

Health care utilization (HCU) databases are widespread sources of data for pharmacoepidemiologic investigations. Possible confounders are typically not measured in such databases. We show how to assess the impact of confounders in a study aimed at comparing cardiovascular (CV) risk according to drug regimen prescribed at starting antihypertensive therapy, nominally one agent (monotherapy) or a combination of agents in a unique tablet (fixed-dose combination) or in at least two distinct tablets (extemporaneous combination).

Study Design and Settings

A nested case–control study was carried out by including the 209,650 patients from Lombardy (Italy) newly treated between 2000 and 2001. Cases were the 10,688 patients who were hospitalized for CV disease until 2007. Three controls were selected for each case. Logistic regression was used to model the CV risk associated with initial therapeutic regimen. A Monte Carlo sensitivity analysis was performed for accounting unmeasured confounders (hypertension severity and chronic disease score) by means of external adjustment with medical record (MR) data.

Results

Compared with patients on fixed-dose combination, those on extemporaneous combination or monotherapy, respectively, had CV risk increased to 15% (95% confidence interval [CI]: 3%, 29%) or 17% (95% CI: 8%, 26%). External adjustment did not modify the risk associated with monotherapy. In contrast, the excess of risk associated with extemporaneous combination was annulled when external adjustment was applied.

Conclusion

MR data can be used to assess confounding bias unmeasured from HCU database. Starting antihypertensive therapy with a combination of agents probably reduces the CV risk with respect to monotherapy, even in the setting of primary prevention.

Introduction

What is new?

Key findings

  1. We compared the risk of cardiovascular (CV) events in patients starting blood pressure (BP)–lowering therapy with various therapeutic regimens using the health care utilization (HCU) database of the Italian region of Lombardy.

  2. We found that patients starting on extemporaneous combination or on monotherapy had a CV risk significantly higher than patients initiating on fixed-dose combination.

  3. Confounding bias is of particular concern in interpreting such findings because combinations therapy might be more likely prescribed to patients with worse clinical characteristics. By omitting sources of selective prescribing, biased estimates of the drug–outcome association are systematically generated.

  4. We propose of addressing the possible extent of unmeasured confounders by means of an approach based on an easy-to-apply Monte Carlo sensitivity analysis (MCSA) that accounts for external adjustment with data informative of the prescribing behavior of primary care physicians.

  5. We found that the excess of CV risk among patients starting on extemporaneous combination, with respect to those on fixed-dose combination, was likely explained by differences in clinical profile of patients receiving these treatments.

  6. Conversely, we found that starting therapy with a combination of drugs significantly reduced the CV risk with respect to initiating with a single antihypertensive agent, even after external adjustment.

What this adds to what was known?
  1. Although the absence of information on potential confounders is a common criticism of observational studies based on HCU data, our analysis shows that medical records database can be used to quantitatively assess confounding bias.

  2. The main suggestion from this study is that starting therapy with a combination of BP-lowering agents likely reduces the CV risk with respect to treatment with one drug alone, even in the setting of primary CV prevention.

What is the implication and what should change now?
  1. There are many situations where unmeasured clinical features may act as confounders of the drug–outcome association, in particular when HCU databases represent the main data source. However, whenever data informative of the physicians' prescribing behavior are available from external data sources, the estimates validity may be easily improved by means of MCSAs. The availability of the provided SAS macro could lead to a widespread diffusion of this easily applied approach in the framework of pharmacoepidemiologic research.

Existing health databases are widespread sources of data for pharmacoepidemiologic investigations [1]. Databases collecting health information can be classified into two broad categories: those that collect information for administrative purposes, such as filling claims for payment (i.e., health care utilization [HCU] databases), and those that serve as the patient's medical record (MR) and are therefore a primary mean by which physicians track health information on their patients (i.e., MR databases). A major advantage of HCU data is that they reflect real-world clinical practice for large and unselected populations [2]. Nevertheless, studies based on HCU data have been criticized for the incompleteness of information on potential confounders such as markers of clinical disease severity, lifestyle habits, socioeconomic status, among others. In contrast, although MR data are richer of clinical and lifestyle information, they often suffer of the fact that any given practitioner provides only a piece of the care a patient receives, and specialist and hospital cares are unlikely to be recorded in a common MR database [1].

These considerations suggest that, where feasible, multiple sources should be considered. Overall, the rationale of the approach used in this article is that although the strength of drug–outcome association estimated by HCU database may be biased by unmeasured confounders, external adjustment can be attempted if additional information is available from MR database covering a similar population as that of the considered HCU database.

As a motivating example, this article compares the risk of cardiovascular (CV) outcomes among patients submitted to different blood pressure (BP)–lowering drug regimens, nominally monotherapy, fixed-dose, or extemporaneous combination of two agents.

International guidelines have recommended initiating antihypertensive therapy with a single agent in patients with mild hypertension [3], [4]. However, based in part on data from the Antihypertensive and Lipid-Lowering Treatment to Prevent Heart Attack Trial, almost 75% of patients with hypertension will require antihypertensive therapy with more than one agent to achieve recommended BP goals [5]. Furthermore, based on analyses of large numbers of published clinical trials, it has been estimated that the BP-lowering capacities of low doses of two agents used in combination are additive [6]. Consequently, initiating therapy with more than one agent may be more efficient and efficacious than sequential monotherapy. A potential additional advantage of combination therapy is the reduction of drug adverse effects by allowing lower doses of the agents used in combination. Based on a meta-analysis of a large number of trials, it has been estimated that the extra BP reduction from combining drugs is about five times greater than doubling the dose of one drug [7]. Combinations between two drugs in a single tablet (fixed-dose combination) are regarded as to offer some advantages over vis-à-vis use of liberal combinations of two or more drugs (extemporaneous combinations) because simplification of treatment is associated with an improvement of patients' compliance [8], [9], [10], [11]. However, limited evidence has still available on the impact that use of fixed-dose combinations on the rate of CV events with respect to extemporaneous combinations or monotherapy in the clinical practice.

Confounding bias is of particular concern in investigating such a problem. In fact, combinations of BP-lowering drugs might be more likely prescribed to patients with poor prognosis, such as those with certain clinical characteristics (e.g., severe hypertension and poor clinical profile). By omitting sources of selective prescribing (e.g., because these data are not available from the HCU database used for investigating this issue), biased estimates of the drug–outcome association are systematically generated. This problem can be investigated by sensitivity analysis [12]. The basic concept of sensitivity analyses is to make informed assumptions about potential confounders and quantify their effects on the observed drug–outcome association. If additional data sources can be identified (e.g., from MR database), these assumptions can be substituted by empirical estimates and then they may be used for external adjustment of the drug–outcome association [13].

We conducted a large observational study using the HCU database of the Italian region of Lombardy aimed at assessing the risk of CV nonfatal events in patients starting BP-lowering therapy on fixed-dose combination in comparison to those on extemporaneous combination or monotherapy. For the analysis presented here, we used data obtained from 700 Italian primary care physicians providing information to the Health Search Cegedim Strategic Database [HSD]. We assessed the impact of confounding bias by clinical factors unmeasured in HCU data, including severity of hypertension and chronic disease score (CDS). Although our example is from pharmacoepidemiology, the techniques we discuss can be applied to any study in which one has some external data source that may improve validity of main study estimates [14]. For this reason, we developed and supplied an SAS code useful for any application of the Monte Carlo sensitivity analysis (MCSA).

Section snippets

Setting

The primary sources of data were the HCU databases of Lombardy, a region of Italy that accounts for about 16% (9 million) of its population. In Italy, the population is covered by the National Health Service (NHS), and in Lombardy, this has been associated since 1997 with an automated system of databases to collect a variety of information, including (1) an archive of residents who receive NHS assistance (practically the whole resident population), reporting demographic and administrative data;

Main study

The distribution of the exclusion criteria is shown in Fig. 2. The 209,650 patients included in the cohort accumulated 1,244,870 person-years of observation (on average almost 6 years per patient) and generated 10,688 hospital admissions either for coronary (n = 6,077) or for cerebrovascular (n = 4,611) events. These 10,688 case patients were matched to 32,064 controls. At the date of the index prescription, mean age of cases and controls was about 64 years, and in both groups, almost 36% of the

Discussion

Pharmacoepidemiologic investigations using HCU data are frequently conducted without individual data on potentially confounding factors, which may result in biased estimates of the drug–outcome association [24]. Quantitative assessment of likely sources of bias can provide more realistic estimates of the systematic uncertainty, especially if the investigator has some idea of the likely effects of bias from these sources [14]. With the aim to address the possible extent of such biases, an

Acknowledgments

This study was funded by grants from the Italian Ministry for University and Research (“Fondo d'Ateneo per la Ricerca” portion, year 2010).

References (37)

  • A.V. Chobanian et al.

    The Seventh Report of the Joint National Committee on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure: the JNC 7 report

    JAMA

    (2003)
  • Major outcomes in high-risk hypertensive patients randomized to angiotensin-converting enzyme inhibitor or calcium channel blocker vs diuretic: The Antihypertensive and Lipid-Lowering Treatment to Prevent Heart Attack Trial (ALLHAT)

    JAMA

    (2002)
  • M.R. Law et al.

    Value of low dose combination treatment with blood pressure lowering drugs: analysis of 354 randomised trials

    BMJ

    (2003)
  • A.K. Gupta et al.

    Compliance, safety, and effectiveness of fixed-dose combinations of antihypertensive agents: a meta-analysis

    Hypertension

    (2010)
  • S. Greenland

    Basic methods for sensitivity analyses of biases

    Int J Epidemiol

    (1996)
  • D. Kriebel et al.

    Quantitative evaluation of the effects of uncontrolled confounding by alcohol and tobacco in occupational cancer studies

    Int J Epidemiol

    (2004)
  • K. Steenland et al.

    Monte Carlo sensitivity analysis and Bayesian analysis of smoking as an unmeasured confounder in a study of silica and lung cancer

    Am J Epidemiol

    (2004)
  • G. Corrao et al.

    Pharmacoepidemiological research and the linking of electronic healthcare databases available in the Italian region of Lombardy

    BioMed Stat Clin Epidemiol

    (2008)
  • Cited by (18)

    • Good adherence to therapy with statins reduces the risk of adverse clinical outcomes even among very elderly. Evidence from an Italian real-life investigation

      2018, European Journal of Internal Medicine
      Citation Excerpt :

      The Monte-Carlo sensitivity analysis allowed to correct the observed ORs for the bias factor calculated from the above-mentioned data, taking into account random uncertainty for adjusting estimates. Full details on the Monte-Carlo sampling procedure and computing method are reported elsewhere [34]. For all hypotheses tested, two-tailed p-values less than 0.05 were considered significant.

    • Are generic and brand-name statins clinically equivalent? Evidence from a real data-base

      2014, European Journal of Internal Medicine
      Citation Excerpt :

      The Monte-Carlo sensitivity analysis consists of correcting the observed HRs for the bias factor calculated from the above mentioned data and by taking into account random uncertainty for adjusting estimates. Full details on the Monte-Carlo sampling procedure and computing method are reported elsewhere [27]. For all tested hypotheses, two-tailed p-values less than 0.05 were considered statistically significant.

    • Risk of hyponatremia with diuretics: Chlorthalidone versus hydrochlorothiazide

      2014, American Journal of Medicine
      Citation Excerpt :

      We consider confounding by indication unlikely as the indication is similar. Although unmeasured confounding48 cannot be excluded, actual differences might also underlie. ARBs suppress aldosterone more effectively49 and selectively block the angiotensin II subtype 1 receptor that increases sodium reabsorption,50 but not the angiotensin II subtype 2 receptor that promotes sodium excretion.51-56

    • Long-term use of statins reduces the risk of hospitalization fordementia

      2013, Atherosclerosis
      Citation Excerpt :

      In addition, we assumed that, compared to patients with mild or moderate hypercholesterolemia (<200 mg/dl), those with severe hypercholesterolemia had: (i) a risk of dementia 1.5 fold greater; and (ii) an odds of experiencing the longest duration of statin therapy 1.5-, 2-, 2.5-, and 5-fold higher [20]. The Monte Carlo sensitivity analysis consists of correcting the observed ORs for the bias factor calculated from the above reported data and by taking into account random uncertainty of adjusted estimates through a Monte-Carlo sampling procedure [21]. We also addressed the possibility that unmeasured confounders might overinflate the possible protective effect of duration of statin therapy.

    View all citing articles on Scopus
    View full text