Development of a Novel Scoring System for Comprehensive COVID-19 Patient Evaluation: An Evidence-based Systematic Review

authors:

avatar Abdollah Karimi ORCID 1 , avatar Roxana Mansour Ghanaie ORCID 1 , avatar Mohammad Reza Masjedi ORCID 2 , avatar Seyed Alireza Fahimzad 1 , avatar Sedigheh Rafiei Tabatabaei ORCID 1 , avatar Shahnaz Armin 1 , avatar Fatemeh Fallah 1 , avatar Katayoun Tayeri 3 , avatar Mahboobeh Haji Abdolbaghi 4 , avatar Armin Shirvani ORCID 5 , avatar Ali Bidari ORCID 6 , avatar Majid Mokhtari 7 , avatar Mojgan Sarmadi 8 , avatar Maryam Rajabnejad ORCID 1 , *

Pediatric Infections Research Center, Research Institude for Children's Health, Shahid Beheshti University of Medical Sciences, Tehran, Iran
Iranian Anti-Tobacco Association, Tobacco Control Research Center, Tobacco Control Research Center, Shahid Beheshti University of Medical Sciences, Tehran, Iran
Iranian Research Center of HIV and AIDS, Tehran University of Medical Sciences, Tehran, Iran
Infectious Disease Department, Imam Khomeini Hospital, Tehran University of Medical Sciences, Tehran, Iran
Virtual School of Medical Education and Management, Shahid Beheshti University of Medical Sciences, Tehran, Iran
Department of Rheumatology, Iran University of Medical Sciences, Tehran, Iran
Loghman Hakim Hospital, Shahid Beheshti University of Medical Sciences, Tehran, Iran
Oral Immunity and Infection Unit, National Institute of Dental and Craniofacial Research, Oral and Pharyngeal Cancer Branch, National Institutes of Health, Bethesda, USA

how to cite: Karimi A , Mansour Ghanaie R, Masjedi M R , Fahimzad S A, Rafiei Tabatabaei S, et al. Development of a Novel Scoring System for Comprehensive COVID-19 Patient Evaluation: An Evidence-based Systematic Review. Arch Pediatr Infect Dis. 2021;9(1):e110201. https://doi.org/10.5812/pedinfect.110201.

Abstract

Context:

In the era of the SARS-CoV-2 virus pandemic, new scoring systems need to be developed to estimate the risk of COVID-19 complications aiding in the accurate prognosis. Improved scoring systems by combining multiple variables allow clinicians to optimize the allocation of limited medical resources for the best clinical outcomes.

Methods:

Published articles were selected that assessed the relationship between clinical, para-clinical, demographics, co-morbidities, and outcomes of COVID-19 patients in a systematic review to develop a novel scoring system.

Results:

In this study, by summarizing the results of 97 studies and the experiences of experts, prognostic factors were determined and divided into four groups: Age, clinical symptoms, co-morbidities, and tests. Twenty-three published articles met the selection criteria and were included in this study. Accordingly, by the opinion of experts, prognostic factors were categorized into four main groups: Age, clinical symptoms, co-morbidities, and specific test results.

Conclusions:

This novel scoring model helps physicians to early identify critical COVID-19 patients and optimize patient management based on recent comprehensive data of the most significant predictive factors.

1. Context

The SARS-CoV-2 virus has spread worldwide since its outbreak in early December 2019 in a Chinese province and is now an emergent threat to global health. The number of confirmed patients in more than 210 countries has exceeded 38 million, and more than 1,000,000 people have died from COVID-19-related causes (up to 15 Oct 2020) (1). The COVID-19 pandemic is known as the biggest global health crisis of the past century, affecting all aspects of human life.

Due to the very recent emergence of SARS-CoV-2, physicians and researchers often have very little information about the accurate diagnosis and best regimens in the treatment of COVID-19. In many cases, trial and error methods are used to manage patients. In this situation, one of the most important practical tools to help clinicians to take the best step at the best time is to use valid scoring systems to optimize patient management based on the risk of disease progression to critical stage and death.

The prompt and accurate diagnosis of disease and modulating prediction rules are essential to reduce the burden of disease not only in any population but also in healthcare systems. By combining several variables to estimate the risk and prognosis, such forecasting models help physicians in proper triage and early identification of critical patients, and allow them to allocate restricted resources rationally. This proper allocation of resources is especially important for intensive care units and ventilators (2). The high impact of accurate predictive models on reducing mortality during a pandemic is due to its influence on timely adjusting the best clinical management plan (3).

So far, several scoring systems, such as SOFA and CALL, have been developed for COVID-19. In each of them, a limited number of variables have been used to score and classify patients in high, moderate, and low-risk groups (4-6). Thus, identifying the prognostic factors by multivariate analysis and preparing a prediction rule is more than useful.

2. Methods

To develop a scoring system for the prediction of COVID-19 severity, three databases of PubMed, Scopus, and Google Scholar were searched. To make these searches extensive and sensitive, the following keywords were used [(COVID-19) OR (SARS-CoV-2)] AND [(scor*) OR (predict*)] OR (severity). To obtain more results, the following keywords were added and searched in parallel in Google Scholar: [COVID-19] AND [scor*] AND [severity] AND [predicting factor] AND [co-morbidities] AND [lab tests] AND [%]. All searches were limited to studies from 2019 to September 7, 2020.

2.1. Study Selection and Appraisal

In this review, all articles that assessed the clinical or para-clinical findings, individual characteristics, and co-morbidities in the form of quantitative indicators to predict the disease severity were included in the study. To be included in this review, the articles were needed to divide the patients into severe and mild groups based on clear and valid criteria. As the only important outcome was the patient’s final condition as a severe or mild illness, studies that examined this association in the form of hazard ratio (HR) were excluded. No evaluation of bias was performed.

2.2. Data Extraction

From the reported indices, cases with the highest statistical accuracy (lowest confidence interval) were selected. Risk factors were ranked based on the magnitude of OR, and according to experts, a threshold was selected to divide them into major and minor criteria.

3. Results

3.1. Included Studies

Based on the inclusion and exclusion criteria, a total number of 97 articles were identified. After excluding duplicate studies and those with insufficient data, 23 studies were selected (Appendix table in Supplementary File), and the data from these studies were extracted in an Excel spreadsheet.

3.2. Host Factors

3.2.1. Age

In all articles included in this analysis, age was an important factor influencing the severity of COVID-19 disease with significant p values (< 0.001) (7). Most of these articles targeted adults. The ages above 65, 75, and 80 years, with odds ratios of 8.55, 6.06, and 3.43, respectively, were the most important factors to predict the severity of the disease. In only one article, it was reported that among the 4 age groups (0-14-, 15-44-, 45-64-, and 65-74-year-old), disease severity and disease related admission was highest in the 45-64-year-old age group (36%). There were very fewer articles in the pediatric population than in adults. In pediatrics, age groups were only noted; but, the relationship with the severity of the disease was not reported.

3.2.2. Gender

In many studies, the prevalence was higher in males than in females, but the p value for the correlation of the severity of disease with sex was insignificant (8-11).

3.2.3. Clinical Findings

In most studies, multiple variables (such as cough, dyspnea, gastrointestinal signs and symptoms, and vital signs) were noted concerning the severity of the disease. However, a vital sign was the only variable with significantly different frequencies between mild and severe disease groups (5, 8).

3.3. Comorbidities

In all studies, the presence of underlying disease was significantly higher in severe disease than in mild-to-moderate disease (P-value < 0.001; Table 1) (9, 11).

Table 1.

Odds Ratio and Confidence Interval of Predictive Factors

Predictive FactorResultORCI
Sickle cell disease20% ICU admission
LDH> 50017.334.3 - 42.9
CRP, mg/L> 41.810.531.92 - 10.03
Age 6.063.98 - 9.22
Serious cardiovascular disease5.193.25 - 8.29
Elevated liver enzyme (AST), U/L> 404.002.46 - 6.52
Cerebrovascular disease 3.89
Obesity (body mass index ≥30)3.681.54 - 8.83
Type 2 diabetes mellitus3.682.68 - 5.03
Chronic liver disease3.551.23 ‐ 10.24
Chronic obstructive pulmonary disease3.37
LDH245 - 5003.342.1 - 8.5
Lymphopenia3.140.22 - 0.36
Chronic kidney disease3.031.09 - 8.47
CRP, mg/L> 8.26.171.22 - 34.70
Hypertension2.721.60 - 4.64
Smoking2.511.39 - 3.32
Pulmonary fibrosis 0.660.06 - 7.65
Cancer0.150.01 - 1.78
Asthma (moderate to severe)Not significant

3.4. Laboratory Tests

In several articles, the results of different lab tests were compared between severe-to-critical disease and mild-to-moderate disease. Among them, the higher odds ratio was related to lymphopenia, LDH, CRP, and AST (Table 1) (5, 7-10, 12, 13). They also evaluated hemoglobin, albumin, BUN, prothrombin time, interleukin-6, procalcitonin, total bilirubin, platelet count, D-dimer, glucose, fibrinogen, ferritin, and CPK. In some studies, these test values were significantly higher among patients with mild-to-moderate symptoms than in patients with severe or critical status (5, 13).

3.5. Development of a Novel Scoring System

From the ORs reported in the selected articles, the ones with the highest accuracy were considered (Table 1). Then, a cutoff was determined based on experts’ opinions according to OR = 3.14 to determine the risk (Table 2).

Table 2.

Predictive Scoring Measures

PredictorsPredictive FactorCutoffScore
Early Evaluation
Host factorsAge> 601
> 702
Clinical manifestationsPulse rate100 - 120/min1
> 120/min2
Respiratory rate24 - 30/min1
> 30/min2
O2 Sat.90% - 93%2
< 90%3
Temperature> 38.51
> 38.5 for > 5 days2
Co-morbiditiesObesitybody mass index ≥ 402
body mass index = 30 - 401
Diabetes mellitusUncontrolled2
Controlled1
Cardiovascular disease2
Cerebrovascular disease1
Chronic liver disease1
HypertensionUncontrolled2
Controlled1
Chronic lung diseaseChronic obstructive pulmonary disease2
Other (uncontrolled asthma, pulmonary fibrosis)1
Immune deficiencyBone marrow or solid organ transplant2
Other immunodeficiencies (HIV (CD4 < 200 OR 15%), use of corticosteroids or other immunosuppressing agents)1
CancerUnder chemotherapy2
In remission1
HemoglobinopathySickle cell disease2
Other hemoglobinopathies1
Smoking1
Chronic kidney disease1
Secondary evaluation
Laboratory testsLymphopenia< 5002
< 11001
LDH Or CRP> 5002
245 - 5001
> 70 mg/L2
40 - 70 mg/L1

3.6. Expert Consensus

The risk factors were divided into four groups (Table 2), and different combinations were provided to the experts to judge the participation of each of the major and minor risk factors in creating the final situation. Based on this judgment, each of the risk factors was scored, and finally, a threshold was set according to which patients were divided into two groups (high-risk and low-risk). Accordingly, a score of 2 was considered for the factors whose ORs were above the given threshold, and those who had ORs below the threshold were given a score of 1.

3.7. Evaluating Different Combinations

Based on the experts’ opinions, in patients with the sudden onset of fever and cough or at least three or more symptoms such as fever, headache, cough, fatigue, muscle aches, sore throat, rhinorrhea, shortness of breath, anorexia, nausea, vomiting, and diarrhea, the diagnosis of COVID-19 was relevant. Therefore, a score was given based on Table 2. If the patient presents with a combination of the above symptoms or has warning signs such as a decreased level of consciousness, hemodynamic instability, distress or resting shortness of breath, inability to eat or drink, abnormally large abdomen, refractory frequent vomiting, dysentery, acute abdomen, hematuria, swelling under the eyes, edema, lack of communication when awake, sudden movement disorder, seizures, weakness, and severe lethargy or bleeding in various parts of the body, it is necessary to refer directly to the hospital. Accordingly, scoring for the predicting factors was done, as follows (Table 3):

Table 3.

Management of Patients According to Scores

Total ScoreSuggested Management
≤ 5Outpatient supportive medication; announcing warning signs and symptoms
6 - 8Outpatient supportive medication like naproxen; optional prescription like hydroxychloroquine sulfatea or azithromycina; announcing warning signs and symptoms
≥ 9Hospitalization for immediate supportive care like oxygen and correction of electrolytes; precise evaluation of disease progression; Low-dose corticosteroidsa, interferon beta-1ba and 1aa, and antiviral drugsa; anti-coagulant drugs like enoxaparin

1) If the total score of the patient in the early evaluation (host factors, clinical manifestations, and comorbidities) is equal to or less than 5, home care is recommended by prescribing supportive medication, besides teaching the patient about warning signs and follow-up based on patient condition.

2) If the total score of the patient in the early evaluation (host factors, clinical manifestations, and comorbidities) is between 6 and 8, the initial tests such as CBC, LDH, or CRP should be ordered. The patient should receive outpatient treatment according to national guidelines and at the discretion of the treating physician.

3) If the total score in the early evaluation (host factors, clinical manifestations, and comorbidities) or the total score in Table 2 (early and secondary evaluation) is equal to or greater than 9, the patient should be referred to the hospital.

4) The score limit that can be assigned to the total clinical findings and the total age and underlying disease is 5 points and to laboratory tests, 3 points.

4. Discussion

Articles published so far (September 15, 2020) on the scoring of patients with COVID-19 have considered a few prognostic factors, such as laboratory test results (CBC, CRP, GFR, and myoglobin), age, and several comorbidities (such as respiratory diseases, cardiac diseases, hypertension, hyperlipidemia, diabetes, kidney diseases, liver diseases, History of previous surgery). In this study, by summarizing the results of studies in this area and the experience of experts, more prognostic factors were determined and divided into four groups: Age, clinical symptoms, comorbidities, and tests.

In this review, by summarizing the results of other studies in this area and using the experience of experts, more prognostic factors were incorporated into a new, more comprehensive, and uniform clinical scoring system for COVID-19 treatment planning, encompassing four major groups of variables: Age, clinical symptoms, comorbidities, and laboratory tests. Finally, patient management guideline was developed based on predictive factors.

4.1. Limitation of Study

As COVID-19 is an emergent disease, prospective studies are needed to determine a scoring system with acceptable validity. However, these studies are time-consuming. Thus, we have an urgent need to develop a scoring system that helps physicians in decision-making and managing the patients (whether to start treatment or hospitalization). The only way to prepare a scoring system is to use the results of studies and expert opinions. On the other hand, most studies only reported the frequency of observed risk factors in patients with mild, moderate, severe, and critical symptoms for disease progression, and there were no studies that showed the presence of risk factors separately with any severity of the disease, including age, sex, underlying diseases, clinical symptoms, and test results. This led us to use the reported odds ratios for risk factors in the studies, as well as the opinions of experts in the field, to develop an initial scoring system that can help physicians in the proper management of patients. Indeed, it is noteworthy that to assess the external and internal validity of this scoring system, we have started a comprehensive study nationwide to examine the impact of various risk factors on the severity of the disease in different people, which has not been completed yet.

References

  • 1.

    WHO. Coronavirus Disease (COVID-19) Dashboard. CEST; 2020.

  • 2.

    Wynants L, Van Calster B, Bonten MM, Collins GS, Debray TP, De Vos M, et al. Prediction models for diagnosis and prognosis of covid-19 infection: systematic review and critical appraisal. BMJ. 2020;1328. https://doi.org/10.1101/2020.03.24.20041020.

  • 3.

    Zheng Z, Peng F, Xu B, Zhao J, Liu H, Peng J, et al. Risk factors of critical & mortal COVID-19 cases: A systematic literature review and meta-analysis. J Infect. 2020;81(2):e16-25. [PubMed ID: 32335169]. [PubMed Central ID: PMC7177098]. https://doi.org/10.1016/j.jinf.2020.04.021.

  • 4.

    Li X, Xu S, Yu M, Wang K, Tao Y, Zhou Y, et al. Risk factors for severity and mortality in adult COVID-19 inpatients in Wuhan. J Allergy Clin Immunol. 2020;146(1):110-8. [PubMed ID: 32294485]. [PubMed Central ID: PMC7152876]. https://doi.org/10.1016/j.jaci.2020.04.006.

  • 5.

    Huang D, Wang T, Chen Z, Yang H, Yao R, Liang Z. A novel risk score to predict diagnosis with coronavirus disease 2019 (COVID-19) in suspected patients: A retrospective, multicenter, and observational study. J Med Virol. 2020;92(11):2709-17. [PubMed ID: 32510164]. [PubMed Central ID: PMC7300577]. https://doi.org/10.1002/jmv.26143.

  • 6.

    Lu L, Zhong W, Bian Z, Li Z, Zhang K, Liang B, et al. A comparison of mortality-related risk factors of COVID-19, SARS, and MERS: A systematic review and meta-analysis. J Infect. 2020;81(4):e18-25. [PubMed ID: 32634459]. [PubMed Central ID: PMC7334925]. https://doi.org/10.1016/j.jinf.2020.07.002.

  • 7.

    Shekerdemian LS, Mahmood NR, Wolfe KK, Riggs BJ, Ross CE, McKiernan CA, et al. Characteristics and Outcomes of Children With Coronavirus Disease 2019 (COVID-19) Infection Admitted to US and Canadian Pediatric Intensive Care Units. JAMA Pediatr. 2020;174(9):868-73. [PubMed ID: 32392288]. [PubMed Central ID: PMC7489842]. https://doi.org/10.1001/jamapediatrics.2020.1948.

  • 8.

    Xie J, Hungerford D, Chen H, Abrams ST, Li S, Wang G, et al. Development and external validation of a prognostic multivariable model on admission for hospitalized patients with COVID-19. medRxiv. 2020. https://doi.org/10.1101/2020.03.28.20045997.

  • 9.

    Ji D, Zhang D, Xu J, Chen Z, Yang T, Zhao P, et al. Prediction for Progression Risk in Patients With COVID-19 Pneumonia: The CALL Score. Clin Infect Dis. 2020;71(6):1393-9. [PubMed ID: 32271369]. [PubMed Central ID: PMC7184473]. https://doi.org/10.1093/cid/ciaa414.

  • 10.

    Qian Y, Li Z, Du Z, Zhu Y, Miao H. Prognostic Value of Charlton's Weighted Index of Capabilities Combined with Chronic Health Evaluation II Score in COVID-19: a retrospective cohort study. Preprint. 2020. https://doi.org/10.21203/rs.3.rs-22479/v1.

  • 11.

    Zhou F, Yu T, Du R, Fan G, Liu Y, Liu Z, et al. Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study. Lancet. 2020;395(10229):1054-62. [PubMed ID: 32171076]. [PubMed Central ID: PMC7270627]. https://doi.org/10.1016/S0140-6736(20)30566-3.

  • 12.

    Zappala DC. Predicting a worse COVID-19 outcome Federal AMA Vice President. 2020, [cited 2020 May 8]. Available from: https://ama.com.au/article/latest-information-covid-19#FACTFILES.

  • 13.

    Zhao Z, Chen A, Hou W, Graham JM, Li H, Richman PS, et al. Prediction model and risk scores of ICU admission and mortality in COVID-19. PLoS One. 2020;15(7). e0236618. [PubMed ID: 32730358]. [PubMed Central ID: PMC7392248]. https://doi.org/10.1371/journal.pone.0236618.