Skip to main content

Observed versus predicted cardiovascular events and all-cause death in HIV infection: a longitudinal cohort study

Abstract

Background

The aim of the study was to assess the applicability of an algorithm predicting 10-year cardiovascular disease (CVD) generated in the setting of the Framingham Heart Study to a real-life, contemporary Italian cohort of HIV-positive subjects.

Methods

The study was an observational longitudinal cohort study. The probability for 10-year CVD events according to the Framingham algorithm was assessed in 369 consecutive HIV-positive participants free from overt CVD enrolled in 2004, who were followed for a median of 10.0 years (interquartile range, 9.1-10.1). Cardiovascular events included myocardial infarction, hospitalized heart failure, revascularized angina, sudden cardiac death, stroke, peripheral arterial disease.

Results

Over 3097 person-years of observation, we observed a total of 34 CVD events, whereas Framingham algorithm predicted the occurrence of 34.3 CVD events. CVD event rate was 11.0/1000 person-years of follow-up. In a receiver operating characteristics curve analysis, Framingham risk equation showed an excellent predictive value for incident CVD events (c-statistics, 0.83; 95% confidence interval, 0.76-0.90). In a multivariable Cox analysis, age, smoking and diabetes were independent predictors of CVD events. All-cause death rate was 20.0/1000 person-years of follow-up (n = 62 deaths). Causes of death included liver diseases (18), malignancies (14), AIDS-related (11); cardiovascular (9) and others (10). In a Cox analysis, age, AIDS diagnosis and chronic hepatitis were independent predictors of death.

Conclusions

Observed CVD events in HIV-infected patients were well predicted by Framingham algorithm. Established major CVD risk factors are the strongest determinants of CVD morbidity in an Italian contemporary cohort of HIV-positive subjects. Interventions to modify traditional risk factors are urgently needed in HIV people.

Peer Review reports

Background

Atherosclerotic cardiovascular disease (CVD), a leading cause of morbidity and mortality in the general population, is also an increasing concern for the progressively aging HIV-infected population. Patients on antiretroviral therapy (ART) have a long life expectancy and, as a result, are at risk of developing chronic non-communicable diseases. The increased burden of CVD among HIV-infected patients is likely a consequence of both traditional and non-traditional risk factors, such as immune activation and inflammation that may contribute to an accelerated aging process characterized by higher-than-anticipated rates of noninfectious comorbidities [1, 2].

Risk prediction is a cornerstone of strategies for prevention of CVD. The absolute cardiovascular (CV) risk in a single individual is determined by a complex interplay of risk factors including age, family history of CVD, smoking, hypertension, elevated blood lipids, diabetes, and other determinants [3]. Identifying in clinical practice HIV subjects at high CV risk for primary prevention is a relevant issue, but the optimal measure for predicting the CV risk remains controversial. The Framingham risk equation is a calculated measure of CVD risk, which has been validated in the general population [4], and is internationally considered a valuable tool for patient evaluation and management of primary CV prevention. To date, prospective data regarding CVD events from HIV people are lacking, and the ability of available risk charts to predict CVD events in HIV people are still debated. A first report from the D:A:D: study with 5 years of follow-up indicates that the Framingham equation slightly underestimates the risk of MI in subjects receiving ART [5]. An update from D:A:D: study concluded that Framingham model performed well compared to DAD equation for global CVD risk [6]. In contrast a study from Spain showed that Framingham risk equation significantly overestimated ischemic heart events in South-European HIV-infected patients [7]. We assessed the agreement between predicted global CVD risk according to the Framingham equation [4] and observed CVD morbidity in a consecutive series of HIV-positive subjects who were followed up until 10 years. We also evaluated the main predictors of CV events and all-cause death rate over the same time period.

Methods

As reported in a previous study [8], consecutive adult subjects with documented HIV infection were recruited at the outpatient clinic of the Unit of Infectious Diseases, University of Perugia, Italy, from January to December 2004. All subjects provided informed consent to participate in the study and they were included irrespective of whether they had been receiving antiretroviral therapy. The consecutive adult patients aged between 30 and 74 years, were examined during baseline clinical evaluation for HIV infection. Individuals with a history of coronary or cerebrovascular disease were excluded from the study. For each patient a complete medical history, physical examination, and laboratory evaluation was completed. Blood was drawn after an 8 to 12 h fast to determine serum total cholesterol values, high-density lipoprotein (HDL) cholesterol, triglycerides, blood glucose, CD4 + T-lymphocyte count, and HIV-RNA. Blood pressure was measured by the physicians in the medical center with a mercury sphygmomanometer after patients sat for 10 min or longer at room temperature. Smokers were considered to be those who smoked one or more cigarettes a day. Patients were followed prospectively at the HIV outpatient clinic for a median of 10 years as part of regular medical care. For each patient we estimated baseline CVD risk according to the global Framingham risk equation [4]. We also estimated the expected numbers of major coronary heart disease (CHD) events over the following 10 years based on the risk equations developed by the “Progetto CUORE”, which has been developed specifically for an Italian population [9, 10]. The 10-year risk for cardiovascular mortality was estimated on the ground of the European SCORE (Systematic COronary Risk Evaluation) algorithm [11]. Clinical data were obtained from electronic or paper medical records. Patients were excluded if they did not complete a minimum of 1 year of follow-up. Collected data were analyzed anonymously. The study was approved by the institutional ethics committee (Ethics Committee of the Umbria Region).

Study outcomes

We defined CVD events, according Framingham study [4], as a composite of myocardial infarction, hospitalized heart failure, revascularized angina, sudden cardiac death, stroke, transient cerebral ischemia, peripheral arterial disease (intermittent claudication). For the subjects who developed a CV event during follow-up, hospital record forms and other available original source documents were reviewed in conference by the investigators, who were unaware of the baseline clinical data of the subjects examined. Source documents were coded by International Classification of Disease, Ninth Revision, Clinical Modification (ICD-9-CM), codes 410-415, 428, 430-441. We made any effort to carefully identify CV outcome events to avoid potential sources of bias. We also recorded all-cause deaths categorized as liver-related, cancer, defined as non-AIDS-defining malignancies, AIDS-related, including all AIDS-defining malignancy, CV, others.

Statistical analysis

SPSS statistical package, release 22.0 (SPSS Inc., Chicago, Ill) was used for all statistical analyses. Standard descriptive and comparative analyses were undertaken. Statistical testing was performed at the two-tailed a-level of 0.05. Continuous variables were tested to detect substantial deviations from normality by computing the Kolmogorov-Smirnov Z test. The assumption of satisfactory normal distribution was met for all of the examined variables. Differences between the groups with vs without incident CV events were evaluated by Pearson’s χ2 test. The Student t test and the Mann-Whitney U test were used to assess differences in normally and non-normally continuous variables respectively.

The rates of CV events are presented as the number of events per 100 patient-years. For those subjects who experienced multiple events, survival analysis was restricted to the first event. The effect of prognostic factors on survival was evaluated with the use of the stepwise Cox semiparametric regression model. The assumption of linearity for the Cox model was tested through visual inspection and no violation of proportional hazards was found. For patients without events, the date of censor was that of the last contact with the patient.

We used the χ2 goodness-of-fit test to assess agreement between observed and expected. Individual predictive performances for global Framingham risk equation [4] (CVD events), “Progetto CUORE” equation [9, 10] (major coronary heart disease events) and European SCORE algorithm [11] (CV mortality) were evaluated by receiver operating characteristic (ROC) curve analysis, describing areas under curves with their 95% confidence intervals (CI) and comparing them to the null hypothesis (area = 0.5) [12]. An area under the ROC curve of 1.0 indicates perfect classification of cases (future event) and non-cases (future censoring), whereas 0.5 means that the classification is not better than chance.

Results

A total of 403 consecutive HIV outpatients were enrolled. After the exclusion of 34 patients who had no follow-up visits after 1 year, 369 patients were included in the present study. Over a median of ten follow-up years (range, 1-10 years), we observed a total of 34 CV events over 3097 person-years (11.0 CV events/1000 follow-up years). The study flow-chart is reported in Fig. 1.

Fig. 1
figure 1

Flow-chart of the study

The main clinical characteristics of the study participants with or without incident events are shown in Tables 1 (CV) and 2 (death). Patients with incident CV events were older (mean age 53.8 ± 12 vs 41.9 ± 8), predominantly male (88.2% vs 60.3), more likely to be smokers (70.6% vs 52.2%), hypertensive on therapy (26.5% vs 7.5%), and diabetic (35.5% vs 4.5%). HIV-related factors such as baseline CDC stage, CD4 cell count, CD4 cell nadir and zenith of HIV-RNA, were not significantly related to incident CV events. As expected, major traditional CV risk factors and CV risk equations were strongly associated with CV events.

Table 1 Clinical characteristics at baseline of the study participants with or without incident CV events
Table 2 Baseline clinical characteristics of the participants, dead vs alive in the follow-up

The numbers of events predicted by Framingham global risk score [4] and observed in the various categories of CV risk are reported in Fig. 2. CV event rate progressively increased with increasing Framingham Risk Score. As shown, the number of observed CV events (n = 34) was well predicted by the Framingham algorithm (n = 34.3 events, observed vs predicted p = 0.96). Italian “progetto Cuore” estimated a total of 14.3 major CHD events vs 21 observed (6.8 CHD events/1000 follow-up years, observed vs predicted p = 0.07), and European SCORE estimated 4.8 fatal CV events vs 9 observed (2.9 fatal CV events/1000 follow-up years, observed vs predicted p = 0.053).

Fig. 2
figure 2

Predicted and observed 10-year cardiovascular event rate by different cardiovascular risk strata (Framingham Risk Score) and in the whole population

As depicted in Fig. 3, the area under the ROC curve analysis showed that Framingham risk equation was an excellent predictor of CVD events (area under the curve 0.83; 95% confidence interval [CI]: 0.76-0.90). “Progetto Cuore” significantly predicted major coronary events (area under the curve 0.81; 95% CI: 0.72-0.90) and European SCORE predicted cardiovascular death (area under the curve 0.77; 95% CI: 0.67-0.88), although with area values nominally lower than that of Framingham risk equation.

Fig. 3
figure 3

ROC curve analysis receiver operating characteristic (ROC) curve analysis, describing areas under curves with their 95% confidence intervals (CI) and comparing them to the null hypothesis (area = 0.5). An area under the ROC curve of 1.0 indicates perfect classification of cases (future event) and non-cases (future censoring), whereas 0.5 means that the classification is not better than chance

Multivariable analysis using Cox regression (Table 3) showed as significant predictors of incident CV events age, smoking and diabetes. CDC stage and CD4 cells count at baseline had no significantly impact.

Table 3 Predictors of incident cardiovascular events

As regarding all-cause mortality in study population, crude all-cause death rate was 20.0/1000 person-years of follow-up (n = 62 deaths). The leading causes of death were respectively liver diseases (18), as non-AIDS-defining malignancies (14), AIDS-related causes (11); cardiovascular (9) and others (10) (Fig. 1). Univariate analysis (Table 2) showed that global mortality was associated whit older age (mean age 46.4 ± 8 vs 42.3 ± 9, p < 0.001), CDC stage C (51.6% vs 23.8%, p < 0.001), low CD4 cell count (393 ± 331 vs 523 ± 300, p = 0.005), HCV co-infection (46.8% vs 26.8%, p = 0.002) and injecting drug user (IDU) risk factor for HIV infection (48.4% vs 23.1%, p < 0.001). Multivariable analysis using Cox regression (Table 4) showed as significant predictors of 10-year death age, CDC C stage, and chronic hepatitis diagnosis.

Table 4 Predictors all-cause deaths

Discussion

In the present study we examined cardiovascular risk in an outpatient population of HIV-infected patients followed in routine clinical care. Over 3097 person-years, we observed a total of 34 incident cardiovascular events. Event rate was 11.0/1000 person-years of follow-up. By applying global Framingham algorithm for cardiovascular risk estimation, which takes into account the role of conventional risk factors only, we found that HIV-infected individuals had very similar rates of observed clinical CV events compared to the expected ones.

The main findings of the present study may be summarized as follows. First, Framingham model showed good discrimination for 10-year CV events prediction in a contemporary Italian HIV outpatient cohort, with an area under the ROC curve of 0.83 (Fig. 3). Therefore, we validated the Framingham CV risk model in an Italian HIV-infected cohort. The model has been so far validated in several populations, and it has been proved to overestimate CVD risks in countries with a low absolute incidence of coronary events, such as Italy [13]. The present study suggests that this could not be true for Italian HIV-infected patients, who appear more similar to the general population of higher-risk countries than to Italian HIV uninfected subjects. The “real life” setting of the present study suggests that the Framingham model may be appropriate and useful in the daily clinical practice. We also evaluated other widely used risk prediction tools. In our hands, Italian “Progetto Cuore” and European SCORE provide numerically lower estimation rates of incident CV events in Italian HIV patients, although the low number of events is a limitation of this study. Other groups very recently investigated the predictive value of Framingham risk score in longitudinal cohorts and reported moderate discrimination ability. Raggi et al. [14] from Modena HIV Metabolic Clinic showed a moderate sensitivity (69%) and specificity (72%) of Framingham model and a better prediction of atherosclerotic cardiovascular disease (ASCVD) by pooled cohort equation (PCE) algorithm proposed by American Heart Association [15]. However, the CV event rate in Modena cohort (4/1000 patient-years) was lower compared with our data and could be hypothetically related to a more accurate adherence to preventive CV measure in this HIV Metabolic Clinic. Thompson-Paul et al. [16] from HOPS American cohort found moderate discrimination of Framingham risk score (C-statistic: 0.66). The performance of ASCVD PCE algorithm was evaluated very recently in a multicenter clinical cohort from USA, it showed adequately discrimination of myocardial infarction risk (C-statistic: 0.75) [17]. The reasons for difference in prediction ability are not completely clear, but may be due to population differences in cohorts and differences in preventive measure adopted in specific clinical setting.

The second main finding is that this study provides evidence that traditional CV risk factors, directly or hypothetically mediated by HIV/ART, place a major detrimental role in the CV events in HIV-infected patients observed in real life, thus they are essential for risk estimation. Smoking habits, largely present in HIV people, remains the leading cause of preventable illness, thus there is the need of new approaches in stopping smoking in the general population [18] and even more in HIV infected people [19]. We did not document any association between HIV-related factors such as baseline CDC stage and CD4 cells counts, likely to small sample size and probably to secondary role played through non traditional risk factors. In our population, the effective increased risk of CVD through HIV/ART factors appeared modest. Although HIV patients are considered at high CV risk, surprisingly they still tend to be undertreated in terms of drugs for CV prevention [20, 21]. The unquestionable role of conventional risk factors in the actually observed CV events should persuade clinicians to accurately monitor the corrigible CV risk factors in HIV people, such as dyslipidemia, diabetes and hypertension. Understanding and optimizing preventive care in HIV patients is essential in maintaining the substantial advances in prognosis for those subjects [22].

A third relevant finding from this paper is that the 10-year global mortality was largely influenced by HIV infection and/or chronic hepatitis, therefore the optimal treatment of HIV, and virus hepatitis is evidently mandatory. The liver disease was clearly the first cause of mortality in the years investigated. The relatively small sample size and the limited number of events precluded an extensive multivariate analysis and discussion of mortality, although assessment of mortality was not a primary objective of the study.

Strengths of the present study include the well characterized population and quite long time of follow-up. There are several limitations to our analysis; first the lack of an HIV negative control group did not allow us to study the association of HIV infection per se with CV events. The limited sample size may have reduced the power of the study to identify clinically relevant predictors. We conduct our study in a single center, thus data may not be generalizable to HIV people. Figure 2 actually shows a difference between expected and observed in moderate risk patients (5-10% Framingham risk score) with the risk score underestimating the event rate suggesting that possibly with a larger sample size this would be of interest. The limited sample size of the study cohort precludes the evaluation of other relevant CV algorithms such as the D:A:D:, predictive in the next 5 tears and ASCVD PCE algorithms predictive of hard CV events only.

Conclusion

Observed CVD events in HIV-infected patients were well predicted by Framingham algorithm. In risk assessment for cardiovascular disease Framingham algorithm may still be useful in Italian HIV patients. Established major CV risk factors (age, diabetes, and smoking) are the strongest determinants of CV morbidity in an Italian cotemporary cohort of HIV-positive subjects observed in the real life.

The approach to cardiovascular risk reduction is necessarily multifactorial given the multiplicity of risk factors involved. The data emphasizes the importance of clinical interventions aiming at prevention of modifiable traditional CV risk factors.

Abbreviations

ART:

Antiretroviral therapy

ASCVD:

Atherosclerotic cardiovascular disease

CHD:

Coronary heart disease

CI:

Confidence intervals

CV:

Cardiovascular

CVD:

Cardiovascular disease

IDU:

Injecting drug user

PCE:

Pooled cohort equation

ROC:

Receiver operating characteristic

SCORE:

Systematic COronary Risk Evaluation

References

  1. Guaraldi G, Cossarizza A, Franceschi C, Roverato A, Vaccher E, Tambussi G, et al. Life expectancy in the immune recovery era:the evolving scenario of the HIV epidemic in northern Italy. J Acquir Immune Defic Syndr. 2014;65:175–81.

    Article  PubMed  Google Scholar 

  2. De Socio GV, Ricci E, Parruti G, Maggi P, Madeddu G, Quirino T, et al. Chronological and biological age in HIV infection. J Inf Secur. 2010;61:428–30.

    Google Scholar 

  3. Grundy SM, Cleeman JI, Merz CN, Brewer HB Jr, Clark LT, Hunninghake DB, et al., National Heart, Lung, and Blood Institute, American College of Cardiology Foundation, American Heart Association. Implications of recent clinical trials for the National Cholesterol Education Program Adult Treatment Panel III guidelines. Circulation. 2004;110:227–39.

    Article  PubMed  Google Scholar 

  4. D'Agostino RB Sr, Vasan RS, Pencina MJ, Wolf PA, Cobain M, Massaro JM, et al. General cardiovascular risk profile for use in primary care: the Framingham heart study. Circulation. 2008;117:743–53.

  5. Law MG, Friis-Møller N, El-Sadr WM, Weber R, Reiss P, D’Arminio Monforte A, et al., D:A:D Study Group. The use of the Framingham equation to predict myocardial infarctions in HIV-infected patients: comparison with observed events in the D:a:D study. HIV Med. 2006;7:218–30.

    Article  CAS  PubMed  Google Scholar 

  6. Friis-Møller N, Ryom L, Smith C, Weber R, Reiss P, Dabis F, et al., D:A:D study group. An updated prediction model of the global risk of cardiovascular disease in HIV-positive persons: the data-collection on adverse effects of anti-HIV drugs (D:a:D) study. Eur J Prev Cardiol. 2016;23:214–23.

    Article  PubMed  Google Scholar 

  7. Herrera S, Guelar A, Sorlì L, Vila J, Molas E, Grau M, et al. The Framingham function overestimates the risk of ischemic heart disease in HIV infected patients from Barcelona. HIV Clinical Trials. 2016;17:131–9.

    Article  PubMed  Google Scholar 

  8. De Socio GV, Martinelli L, Morosi S, Fiorio M, Roscini AR, Stagni G, et al. Is estimated cardiovascular risk higher in HIV-infected patients than in the general population? Scand J Infect Dis. 2007;39:805–12.

  9. Gruppo di Ricerca del Progetto CUORE. The Italian heart project- longitudinal studies. Ital Heart J. 2004;5:94S–101S.

    Google Scholar 

  10. Ferrario M, Chiodini P, Chambless LE, Cesana G, Vanuzzo D, Panico S, et al., CUORE Project Research Group. Prediction of coronary events in a low incidence population. Assessing accuracy of the CUORE cohort study prediction equation. Int J Epidemiol. 2005;34:413–21.

    Article  PubMed  Google Scholar 

  11. Conroy RM, Pyorala K, Fitzgerald AP, Sans S, Menotti A, De Backer G, et al., SCORE project group. Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project. Eur Heart J. 2003;24:987–1003.

    Article  CAS  PubMed  Google Scholar 

  12. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36.

    Article  CAS  PubMed  Google Scholar 

  13. Menotti A, Puddu PE, Lanti M. Comparison of the Framingham risk function-based coronary chart with risk function from an Italian population study. Eur Heart J. 2000;21:365e70.

    Article  Google Scholar 

  14. Raggi P, De Francesco D, Manicardi M, Zona S, Bellasi A, Stentarelli C, et al. Prediction of hard cardiovascular events in HIV patients. J Antimicrob Chemother. 2016;71:3515–8.

    Article  PubMed  Google Scholar 

  15. American College of Cardiology/American Heart Association. 2013 Prevention guidelines tools: CV risk calculator. Available at: http://professional.heart.org/professional/GuidelinesStatements/PreventionGuidelines/UCM_457698_Prevention-Guidelines.jsp. Accessed 21 Dec 2016.

    Google Scholar 

  16. Thompson-Paul AM, Lichtenstein KA, Armon C, Palella FJ Jr, Skarbinski J, Chmiel JS, et al. Cardiovascular disease risk prediction in the HIV outpatient study. Clin Infect Dis. 2016;63:1508–16.

    Article  PubMed  Google Scholar 

  17. Feinstein MJ, Nance RM, Drozd DR, Ning H, Delaney JA, Heckbert SR, et al. Assessing and refining myocardial infarction risk estimation among patients with human immunodeficiency virus: a study by the centers for AIDS research network of integrated clinical systems. JAMA Cardiol. 2017;2:155–62.

    Article  PubMed  Google Scholar 

  18. Halpern SD, French B, Small DS, Saulsgiver K, Harhay MO, Audrain-McGovern J, et al. Randomized trial of four financial-incentive programs for smoking cessation. N Engl J Med. 2015;372:2108–17.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Moadel AB, Bernstein SL, Mermelstein RJ, Arnsten JH, Dolce EH, Shuter J. Randomized controlled trial of a tailored group smoking cessation intervention for HIV-infected smokers. J Acquir Immune Defic Syndr. 2012;61:208–15.

    Article  PubMed  PubMed Central  Google Scholar 

  20. De Socio GV, Ricci E, Maggi P, Parruti G, Celesia M, Orofino A, et al., CISAI Study Group. Time trend in hypertension prevalence, awareness, treatment, and control in a contemporary cohort of HIV-infected patients: the HIV and hypertension study. J Hypertens. 2017;35:409–16.

    Article  PubMed  Google Scholar 

  21. De Socio GV, Ricci E, Parruti G, Calza L, Maggi P, Celesia BM, et al. Statins and aspirin use in HIV-infected people: gap between European AIDS clinical society guidelines and clinical practice: the results from HIV-HY study. Infection. 2016;44:589–97.

    Article  PubMed  Google Scholar 

  22. Maggi P, De Socio GV, Cicalini S, D'Abbraccio M, Dettorre G, Di Biagio A, et al. Use of statins and aspirin to prevent cardiovascular disease among HIV-positive patients. A survey among Italian HIV physicians. New Microbiol. 2017;40:139–42.

    PubMed  Google Scholar 

Download references

Acknowledgment

We would like to express our deep gratitude to Professor Giuseppe Schillaci research supervisor, for his patient guidance, enthusiastic encouragement and useful critiques of this research work. He prematurely died before this submission.

Funding

No has been provided by any private or public actor beyond current clinical practice (National Health Service).

Authors’ contributions

Study concept and design: GVDS. Statistical expertise: GVDG, GS. Drafting of the manuscript: GVDS, GS. Analysis, interpretation, discussion of data and critical revision of the manuscript for important intellectual content: GVDS, GP, FB, GS. The authors had full access to the data and take responsibility for their integrity. All authors have read and agreed to the final manuscript as written.

Competing interests

The authors declared no conflict of interest.

Consent for publication

Not applicable.

Ethics approval and consent to participate

The study have been performed in accordance with the Declaration of Helsinki. All subjects provided informed consent to participate in the study, which was approved by the institutional ethics committee (Ethics Committee of the Umbria Region, no. 2875/2016).

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Giuseppe Vittorio De Socio.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

De Socio, G.V., Pucci, G., Baldelli, F. et al. Observed versus predicted cardiovascular events and all-cause death in HIV infection: a longitudinal cohort study. BMC Infect Dis 17, 414 (2017). https://doi.org/10.1186/s12879-017-2510-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12879-017-2510-x

Keywords