Skip to content
Publicly Available Published by De Gruyter April 25, 2022

Discriminant properties of the Behavioral Pain Scale for assessment of procedural pain-related distress in ventilated children

  • Maximilian David Mauritz EMAIL logo , Felix Uhlenberg , Larissa Alice Dreier , Vito Giordano and Philipp Deindl

Abstract

Objectives

Children hospitalized in a pediatric intensive care unit (PICU) are frequently exposed to distressing and painful medical procedures and interventions. There is a lack of clinical scales to measure procedural pain-related distress in ventilated children. The Behavioral Pain Scale (BPS) was initially developed to detect procedural pain in critically ill adults. This study aims to assess the BPS’s discriminant properties for measuring procedural pain-related distress in ventilated pediatric patients incorporating two instruments validated for pediatric patients.

Methods

This prospective exploratory study was performed with ventilated children admitted to the interdisciplinary 14-bed PICU of the University Children’s Hospital, University Medical Center Hamburg-Eppendorf, Germany. The nurse in charge and an independent observer simultaneously assessed the patients using German versions of the BPS, the COMFORT-B scale (CBS), and the modified Face, Legs, Activity, Cry, Consolability (mFLACC) scale immediately before and during endotracheal suctioning.

Results

We analyzed 170 parallel assessments in n=34 ventilated children. Patients were (mean ± SD) 9.5 ± 4.8 years old. Internal consistency for the BPS was excellent (α=0.93). We found a high rater agreement for all clinical scales (BPS: k=0.73, CBS: k=0.80, mFLACC: k=0.71). Strong correlations were identified between BPS and CBS (r=0.89) and BPS and mFLACC (r=0.79). The BPS cutoff values showed likewise excellent results (area under the curve CBS >16: 0.97; mFLACC >2: 0.91).

Conclusions

In our population of ventilated children, the BPS was well suited to detect procedural pain-related distress compared with two validated pain scales. Further extensive validation studies should follow to support our findings.

Introduction

International guidelines for children’s intensive care treatment recommend adequate analgesia and sedation [1], [2], [3], [4], [5]. Considering that mechanically ventilated children in pediatric intensive care units (PICUs) undergo more than twice as many distressing and painful procedures (e.g., suctioning, vascular cannula placement, lumbar puncture, and blood sampling) as non-ventilated patients, this is particularly relevant [6, 7]. Acute procedural pain may have immediate effects on the current medical condition of the patient, including hemodynamic stability, intracranial pressure, and metabolism. Pain-related experiences also correlate with the development of chronic pain syndromes, posttraumatic stress disorder, and low health-related quality of life [8]. Therefore, avoiding unnecessary painful procedures and providing adequate pharmacological and non-pharmacological measures for necessary painful procedures should always constitute health care professionals’ primary objective. Ideally, predicting the response to painful stimuli should be possible, e.g., by objective pain and sedation monitoring to titrate analgesic and sedative therapy accordingly before the noxious intervention as needed [9, 10]. Pending extensive evaluation of these predictive methods, it is essential to assess current procedural pain-related distress adequately by clinical scales that have shown to produce valid scores to provide adequate analgesia then.

Self-report is considered an ideal source for the assessment of pain intensity [11]. However, in most cases, self-reporting is not possible in endotracheally intubated and ventilated children. In this respect, clinical pain scales provide an objective method of pain assessment. A recent systematic review found 65 pain scales developed for pediatric patients; however, only 28 were considered suitable based on the availability of construct validity, internal consistency, and interrater reliability [12]. Despite this large number of scales, pain scores of only six scales, including the COMFORT-scale [13] and the Face, Legs, Activity, Cry and Consolability (FLACC) scale [14], have been validated in ventilated term infants, toddlers, and children [15]. Here, these scales were evaluated in the context of acute, postoperative pain. Many international guidelines recommend the COMFORT scale, the COMFORT- B Scale (CBS), or the FLACC scale for preverbal infants and children in the PICU unable to self-report [13], [4], [5]. Both scales produced valid scores when assessing acute and postoperative pain in critically ill children [15]. Today, the (modified) FLACC and the CBS are the most commonly used scales in PICUs [18]. The FLACC scale [14] represents the most commonly used behavioral observational scale for pain in pediatric patients in general [16]. It was initially developed for the detection of postoperative pain. Recently, good reliability and sensitivity for detecting procedural pain were shown in pediatric patients undergoing painful interventions in the emergency department [17]. Since the rating of the item “cry” is a challenge in intubated patients [18], the item was changed to “cry (ventilated children)” in the modified FLACC (mFLACC) [19]. The COMFORT scale was initially developed to assess distress in pediatric intensive care patients 0–18 years of age [13]. Because of the physiological measures’ poor reliability and validity [20], a modified version of the COMFORT scale is now available, including only the behavioral measures, referred to as the CBS [21]. Subsequent studies also showed that the CBS provided valid pain scores compared to the Visual Analog Scale, the Numerical Rating Scale [22, 23], or the FLACC scale [24, 25] in postoperative patients. Nevertheless, none of the above scales’ pain scores have been validated to assess procedural pain or distress in critically ill infants and children on mechanical ventilation. However, their use for this purpose is widespread in daily clinical practice [26].

Outside the context of the PICU, two pain scales have been specifically developed to assess acute and procedural pain in infants and children: The Modified Behavioral Pain Scale (MBPS) [27], an adaptation of the Children’s Hospital of Eastern Ontario Pain Scale [28], and the EVENDOL scale [29]. However, the MBPS was developed to assess pain during immunization of infants, and the EVENDOL was developed for acute and procedural pain of infants and children in the emergency department. None of these scales were evaluated in ventilated pediatric patients.

Observational studies indicate that, contrary to current recommendations, pediatric patients unable to self-report may not always receive regular pain assessment [30, 31]. Reasons for this might include lack of satisfaction with the previous scales [31], for example, because they are considered too complex for routine use [32], [33], [34]. If the time required for the use of clinical pain scales and documentation of results is high, the likelihood of adoption and regular use is low [35]. Subsequently, inadequate pain assessment in children may result in underestimation and under-treatment of pain [36].

The Behavioral Pain Scale (BPS) was developed in 2001 by Payen et al. as an easy-to-use pain assessment scale to explicitly detect procedural pain in sedated, mechanically ventilated adults [37]. The BPS proved excellent validity and reliability for detecting procedural pain in several studies in adult patients on mechanical ventilation [38], [39], [40]. International guidelines recommend the BPS for monitoring pain in adult intensive care patients who cannot self-report [8]. The scale has only been used in two studies to assess pain in pediatric patients [31, 41]. Nevertheless, these studies do not provide enough evidence to confirm the validity of the scores to measure pain and pain-related distress in children. However, the BPS is already being used in children [30].

Pain is defined as both a sensory and emotional experience [42]. The response to a noxious stimulus, assessed with clinical observational scales, thus includes both pain intensity and behavioral distress [43]. Distress can be summarized as all negative experiences associated with pain, anxiety, and fear [13, 44]. Some studies suggest that available scales may have difficulty distinguishing pain-related behaviors from other distress-related behaviors [45, 46]. The distinction between pain vs. distress is not a clear-cut matter, and there are good reasons not to disentangle these often-coexisting concepts entirely [44]. Similarly, common pain scales are assumed to be most likely a measure of pain-related distress, a composite of pain and non-pain factors, rather than a measure exclusively of pain [47].

The aim of the present study was to evaluate the established, short, and straightforward BPS used to measure procedural pain in adult intensive care patients for the assessment of procedural pain-related distress in ventilated pediatric patients.

Methods

Patients

With the approval of the local ethics committee (approval code: PV5210; Ethics Committee of the Medical Association of Hamburg, Germany), this prospective observational study was conducted in the 14-bed PICU of the University Children’s Hospital, University Medical Center Hamburg-Eppendorf, Germany, between March 2017 and September 2018. Written informed consent was obtained from both parents of patients involved in the study. Patients were mechanically ventilated and received continuous analgesic and sedative therapy. A neuromuscular block, neuromuscular disease, or traumas to the peripheral or central nervous system were defined as exclusion criteria.

Clinical scales

The BPS consists of three behavioral items: facial expression, upper limb movement, and compliance with mechanical ventilation (Table 1). Each item is scored from 1 to 4 so that the overall BPS ranges from 3 (no pain) to 12 (maximum pain) [40]. A BPS score >5 indicates pain in adult patients [48]. The CBS assesses the behavioral characteristics of alertness, calmness/agitation, respiratory response, physical movement, muscle tone, and facial tension, with scores ranging from 1 to 5 for each item, resulting in a minimum score of 8 and a maximum score of 30. A CBS score of >16 indicates pain [21]. According to the acronym, the FLACC considers five behavioral characteristics: face, legs, activity, cry, and consolability. Each item is rated from 0 to 2. Thus, the scale ranges from 0 (no pain) to 10 (worst pain) [49]. An FLACC of >2 indicates that the patient is experiencing pain [24]. The FLACC was modified to the mFLACC by changing the criterion “crying” to “cry (ventilated children)” for the use in ventilated pediatric patients.

Table 1:

Behavioral pain scale.

Item Description Score
Facial expression Relaxed 1
Partially tightened (e.g., brow lowering) 2
Fully tightened (e.g., eyelid closing) 3
Grimacing 4
Upper limb movements No movement 1
Partially bent 2
Fully bent with finger flexion 3
Permanently retracted 4
Compliance with mechanical ventilation Tolerating movement 1
Coughing but tolerating ventilation for most of the time 2
Fighting ventilator 3
Unable to control ventilation 4

We used German language versions of the BPS [50], CBS [51], and FLACC scale [52] for this study. The German versions of the scales were translated backward by the authors to ensure the equivalent description of the individual items. In the case of the mFLACC scale, we added the translations of “ventilated child” and “facial expression” to the German version of the FLACC scale accordingly (Appendix S2). Prior to the study, the nursing staff was trained in using the BPS and mFLACC scale. The CBS was already part of the local standard of care; hence its use was familiar for the PICU staff.

Study protocol

Patients received treatment according to the hospital’s standards, which included sedative and analgesic therapy according to the PICU’s standard protocol (Appendix S1). For the study purpose, we selected regular endotracheal suctioning as a noxious stimulus. Patients were assessed after a rest period without intervention or disturbance within the preceding 30 min, immediately before (t0, pre-stimulation), and during stimulation by endotracheal suctioning (t1, stimulation). Depending on the length of stay in the PICU, multiple endotracheal suctioning events were evaluated. Endotracheal suctioning was performed using a closed system according to local treatment standards.

The nurse in charge and an independent observer (MM or FU; 4th-year medical students) assessed each patient using German versions of the BPS, the CBS, and the mFLACC scale. The scales were randomly applied using a randomization list before each suctioning and assessed independently by both observers, one after the other.

Statistical analysis

The BPS’s internal consistency was calculated using Cronbach’s alpha, the interrater reliability was assessed using Cohen’s weighted kappa. Finally, we determined repeated measures correlations [53] between individual scores to account for the repeated assessments in patients. The Wilcoxon signed-rank test and linear mixed-effect models (considering multiple measurements) [54] were calculated to analyze the changes in BPS scores across the different time points (t0, t1). Cutoff values discriminating between pain and no pain (based on CBS >16 or mFLACC >2) were determined by calculating receiver operating characteristic (ROC) curves. p-Values less than 0.05 were considered significant. Statistical analyses were performed using R 4.1.1 (R Core Team, Vienna, Austria) and IBM SPSS Statistics (Version 27.0. Armonk, NY, USA).

Results

Patient characteristics

This study initially included n=38 patients admitted to the PICU for various reasons (Table 2). Patients were (mean ± SD) 9.5 ± 4.8 years old, were on mechanical ventilation for 14.2 ± 15.8 days, and stayed for 19.0 ± 18.8 in the PICU. Table 2 shows detailed patient characteristics. Three patients were excluded secondarily: In two patients, no assessment was possible before extubation or transfer to another unit; we excluded the third patient because of previously unknown neuromuscular disease.

Table 2:

Clinical characteristics of the included patients (n=34).

Sex
Female 16 (47.1)
Male 18 (52.9)
Age, years 9.5 ± 4.8
Bodyweight, kg 31.1 ± 17.0
Time on mechanical ventilation, days 14.2 ± 15.8
Length of PICU stay, days 19.0 ± 18.8
Mode of mechanical ventilation
SIMV 32 (94.1)
BIPAP 2 (5.9)
Diagnostic group
Postoperative (non-cardiac) 12 (35.3)
Miscellaneous (including injury) 11 (32.3)
Respiratory 6 (17.6)
Gastrointestinal or renal 2 (5.9)
Cardiac postoperative 1 (2.9)
Survival
Yes 32 (94.1)
  1. BIPAP, bilevel positive airway pressure; PICU, pediatric intensive care unit; SIMV, synchronized intermittent mandatory ventilation. Continuous variables are shown as mean ± SD, and counts as n (% of all included patients).

Out of a total of 194 suctioning events, 24 events were excluded because of no or only partial assessment of scales or protocol violation (e.g., manipulation during the rest period). After exclusion, a median (interquartile range, IQR) of 2 (1–3) assessments in n=34 patients resulted in a total of 170 assessments that were included in the analysis (Figure 1). Eighty-four assessments were made pre-stimulation (t0) and 86 assessments during stimulation by endotracheal suctioning (t1). The median (IQR) scores of the respective scales assessed at t0 were BPS: 3 (3–4), CBS: 6 (6–9), and mFLACC: 0 (0–1). At t1, median scores were: BPS: 4 (3–6), CBS: 9 (6–12), and mFLACC: 1 (0–3). Before stimulation (t0), 6% of patients had a BPS >5, 3.6% had a CBS >16, and 10.7% had an mFLACC >2. At t1, 27.8% of patients had a BPS >5, 14% had a CBS >16, and 25.6% had an mFLACC >2.

Figure 1: 
            Consort flow chart of included assessments.
Figure 1:

Consort flow chart of included assessments.

Consistency and reliability

The internal consistency for the BPS was α=0.937. The interrater reliability of the BPS (k=0.73), the CBS (k=0.80), and the mFLACC scale (k=0.71) was high.

Correlations and discriminant validity

Strong correlations between the BPS and both the CBS (t0: r=0.72, confidence interval [CI]95%: 0.55–0.83; t1: r=0.92, CI95%: 0.87–0.96; p<0.01) and the mFLACC (t0: r=0.73, CI95%: 0.56–0.84; t1: r=0.86, CI95%: 0.74–0.91; p<0.01) were identified (Table 3). There was a significant difference between patients’ BPS scores at rest (t0) and during the intervention (t1; Wilcoxon signed-rank test, z=−5.3, p<0.01, n=84, effect size r=0.58). We also found a significant difference for the change in BPS scores between t0 and t1. We calculated linear mixed-effects models to consider the multiple measurements in individual patients with the patient ID as a random effect (Table 4).

Sensitivity and specificity

Applying the CBS pain criterion (CBS >16), a BPS cutoff score between 5 and 6 to detect pain with a sensitivity of 1 and a specificity of 0.88 was determined. Applying the mFLACC pain criterion (mFLACC >2), we calculated a BPS cutoff score between 3 and 4 to detect pain with a sensitivity of 1 and a specificity of 0.63. The ROC area under the curve (AUC) was 0.97 (CI95%: 0.94–1.0) for detecting pain by the CBS (Figure 2) and 0.91 (CI95%: 0.87–0.96) by the mFLACC scale (Figure 3).

Figure 2: 
            Receiver operating characteristic curve of Behavioral Pain Scale with CBS >16 as the state variable.
Figure 2:

Receiver operating characteristic curve of Behavioral Pain Scale with CBS >16 as the state variable.

Figure 3: 
            Receiver operating characteristic curve of Behavioral Pain Scale with modified Face, Legs, Activity, Cry, Consolability score >2 as the state variable.
Figure 3:

Receiver operating characteristic curve of Behavioral Pain Scale with modified Face, Legs, Activity, Cry, Consolability score >2 as the state variable.

Table 3:

Reliability and correlations of the BPS.

Interrater reliability
Clinical scale BPS CBS mFLACC
Cohen’s weighted kappa, k 0.73 0.80 0.71
Repeated measures correlations
CBSt0 CBSt1 mFLACCt0 mFLACCt1
BPSt0 r rm (CI95%) 0.72 (0.55–0.83) 0.73 (0.56–0.84)
p-Value <0.001 <0.001
BPSt1 r rm (CI95%) 0.92 (0.87–0.96) 0.86 (0.74–0.91)
p-Value <0.001 <0.001
  1. BPS, Behavioral Pain Scale; CBS, COMFORT-B scale; CI95%, 95% confidence interval; mFLACC, modified Face, Legs, Activity, Cry, Consolability scale; rrm, repeated measures correlation.

Table 4:

Linear mixed-effects models for the change in BPS between t0 and t1.

Predictors Estimates CI p-Value
(Intercept) 3.67 3.25–4.09 <0.001
t1
1.18
0.75–1.61
<0.001
Random effects

σ 2 2.04
τ 00 PID 0.62
ICC 0.23
N PID 34
Observations 170
Marginal R2/Conditional R2 0.116/0.322
  1. BPS, Behavioral Pain Scale; CI, confidence interval; ICC, intraclass correlation; PID, patient ID.

Discussion

This study aimed to determine the discriminant properties of the BPS for measuring procedural pain-related distress in ventilated pediatric patients during endotracheal suction. The BPS showed excellent performance for assessing procedural pain-related distress compared with two pain scales validated for assessing acute and postoperative pain in ventilated pediatric patients, with excellent internal consistency and high interrater reliability. Furthermore, the high correlation between the BPS scores and the CBS and mFLACC scores proved good construct and concurrent validity. With high sensitivity and specificity, the BPS showed different cutoff values for the pain criterion of CBS and mFLACC. In our study, a cutoff value for the detection of pain-related distress of >5 was shown for the BPS based on the pain criterion of CBS >16. This finding corresponds to the cutoff of the BPS for unacceptable pain found in conscious sedated adult patients [48]. The BPS’s AUC for discriminating pain-related distress compared to the two other applied scales was excellent.

The BPS has only been used in two studies in children [31, 41]. The study by Akinci et al. was an efficacy study investigating remifentanil vs. fentanyl infusions for postoperative analgesia in 22 children and used the BPS to measure pain on an assumption of validity [41]. A defined BPS target score of 3 was used to titrate the analgesic therapy. The authors concluded that remifentanil infusion provides comparable analgesia to fentanyl infusion in mechanically ventilated postoperative pediatric patients. However, the study did not address the BPS’ discriminant properties, and no other pain scale was used to test for criterion validity. The study by Sulla et al. investigated the applicability of the Italian version of the BPS in n=9 mechanically ventilated infants less than one year of age by comparing the BPS with the CBS [31]. Both scales were assessed before, during, and after painful (mobilization and tracheobronchial aspiration) and non-painful interventions. In total, the study showed a good correlation between the BPS and the CBS and good discriminant properties of the BPS. The authors also applied a questionnaire for physicians and nursing staff on pain measurement in their PICU. In this survey, 60% of the respondents expressed dissatisfaction with current pain scales (mainly CBS and Numerical Rating Scale). Nevertheless, the overall perception of the BPS was positive.

In particular, for the assessment of procedural pain-related distress in the context of pediatric intensive care, a short and easy-to-record scale is needed. Thus, the advantage of the BPS is its simplicity [31, 55]. It includes only three assessment criteria compared to the six and five criteria of the CBS and mFLACC. This simplicity may improve the frequency of pain-related distress assessments in critically ill pediatric patients on mechanical ventilation. Nonetheless, sufficient observation time must be maintained even if the BPS is shorter and easier to evaluate. If the observation period is too short, there is a considerable risk of underestimating the patient’s pain [56]. However, a clinical scale that is easy to assess and interpret could improve regular assessment of pain and distress in ventilated children in the PICU [34], especially for procedural pain-related distress.

Children treated in PICUs experience a variety of distressing or painful procedures in addition to the already stressful environment [6, 7]. Assessment of pain and determining the appropriate analgesia/pain balance remains a particular challenge in ventilated children. The clinical evaluation depends on the assessor’s experience, so clinical pain scales can help to objectify the assessment. Evaluation of the psychometric properties of existing pediatric behavior-based pain scales for assessing procedural pain is the subject of ongoing research [17, 57]. These studies provide support for the use of procedural pain assessment in pediatric patients through verification of reliability and construct validity. However, there is still a lack of respective studies for the unreserved use of the corresponding scales in ventilated critically ill children.

The procedure of endotracheal suctioning is considered one of the most painful procedures in a PICU in the literature, aside from punctures and intubations [58], [59], [60], [61]. Then again, this assumption is based on scores derived from clinical pain scales. As stated in the introduction, these scales likely also measure other distress-related behaviors in addition to pain-related behaviors. A significant proportion of our group of pediatric patients also responded to endotracheal suction with pain according to the used scales. Through this observation alone, this intervention cannot be reliably characterized as explicitly painful. Although fear and anxiety are, in fact, rather unlikely under the sedative therapy in our study, indicated by the low CBS before intervention (t0), they cannot be completely ruled out as a factor in the reaction to the suction maneuvers. Likely, the distinction between pain and distress cannot be fully achieved through observable behaviors [17]. Therefore, future studies should focus on the capacity of observational scales to differentiate pain and distress in ventilated pediatric children. Distinguishing these entities could improve the therapeutic approach by adjusting care and targeting titration of either analgesic or sedative therapy, depending on whether pain or distress is the primary concern.

To this point, no instrument was developed to measure procedural-related distress in critically ill infants and children on mechanical ventilation, and the use of existing pain scales is pending validation studies. However, scales explicitly developed and validated for those patients are urgently needed. The promising results of our study bring the BPS into play as a straightforward procedural-related distress scale in ventilated pediatric patients. More extensive studies to validate the psychometric properties of the BPS in ventilated pediatric patients are needed to confirm our results.

Limitations

The sample of patients recruited was very heterogenous in terms of age, underlying disease, and medication. However, our patient selection reflects the broad spectrum of patients treated in a PICU. We performed multiple measurements in patients. These were considered in the statistical analysis using repeated measures correlations and mixed-effects models. We sought to select a challenging part of routine care with sufficient intensity to provoke patient reactions but to avoid additional discomfort in these vulnerable patients. Regardless, endotracheal suctioning in pediatric patients may not be an optimal stimulus to differentiate between pain and distress. Future studies should test construct validity by comparing painful and non-painful interventions and examining responsiveness to analgesia. These studies should also investigate the discriminatory power of the BPS to distinguish between distress and pain. Nurses ought to be interviewed about the usability of the BPS, and the time taken to assess the scales should be compared. Future studies should also validate the German-language adaptations of the BPS, CBS, and mFLACC used in clinical practice for accurate translation and cultural adaptation.


Corresponding author: Dr. med. Maximilian David Mauritz, MD, German Paediatric Pain Centre, Children’s and Adolescents’ Hospital, Witten/Herdecke University, Dr.-Friedrich-Steiner-Str. 5, 45711, Datteln, Germany, Phone: +49 (0) 2363 9758082, Fax: +49 (0) 2363 64211, E-mail:

Acknowledgments

The authors would like to thank the “Hamburg macht Kinder gesund e.V.” foundation for supporting this study. We would also like to thank Dr. Benedikt Claus of the PedScience Research Institute for providing statistical consultation.

  1. Research funding: The study was supported by the foundation “Hamburg macht Kinder gesund e.V.”. The foundation had no role in the design and conduct of the study.

  2. Author contribution: Maximilian D. Mauritz and Felix Uhlenberg conceptualized and designed the study, collected data, conducted initial analyses, and reviewed and revised the article. Vito Giordano helped to merge the data and reviewed and revised the article. Larissa A. Dreier helped conceptualize and design the study, conduct statistical analyses, and review and revise the article. Dr. Deindl conceptualized and designed the study, designed the data collection instruments, coordinated and supervised data collection, and provided critical reviews of the article for important intellectual content. All authors approved the final article as submitted and agree to be accountable for all aspects of the work.

  3. Competing interests: Authors state no conflict of interest.

  4. Informed consent: Informed consent has been obtained from all parents of patients included in this study.

  5. Ethical approval: Research involving human subjects complied with all relevant national regulations, institutional policies and is in accordance with the tenets of the Helsinki Declaration (as amended in 2013), and has been approved by the Ethics Committee of the Medical Association of Hamburg, Germany (approval code: PV5210).

References

1. Harris, J, Ramelet, A-S, van Dijk, M, Pokorna, P, Wielenga, J, Tume, L, et al.. Clinical recommendations for pain, sedation, withdrawal and delirium assessment in critically ill infants and children: an ESPNIC position statement for healthcare professionals. Intensive Care Med 2016;42:972–86. https://doi.org/10.1007/s00134-016-4344-1.Search in Google Scholar PubMed PubMed Central

2. Playfor, S, Jenkins, I, Boyles, C, Choonara, I, Davies, G, Haywood, T, et al.. Consensus guidelines on sedation and analgesia in critically ill children. Intensive Care Med 2006;32:1125–36. https://doi.org/10.1007/s00134-006-0190-x.Search in Google Scholar PubMed

3. DAS-Taskforce 2015, Baron, R, Binder, A, Biniek, R, Braune, S, Buerkle, H, et al.. Evidence and consensus based guideline for the management of delirium, analgesia, and sedation in intensive care medicine. Revision 2015 (DAS-Guideline 2015) – short version. Ger Medical Sci 2015;13:Doc19. https://doi.org/10.3205/000223.Search in Google Scholar PubMed PubMed Central

4. Mattia, C, Savoia, G, Paoletti, F, Piazza, O, Albanese, D, Amantea, B, et al.. SIAARTI recommendations for analgo-sedation in intensive care unit. Minerva Anestesiol 2006;72:769–805.Search in Google Scholar

5. Sauder, P, Andreoletti, M, Cambonie, G, Capellier, G, Feissel, M, Gall, O, et al.. Sédation-analgésie en réanimation (nouveau-né exclu). Ann Fr. Anesth Réanimation 2008;27:541–51. https://doi.org/10.1016/j.annfar.2008.04.021.Search in Google Scholar PubMed

6. Baarslag, MA, Jhingoer, S, Ista, E, Allegaert, K, Tibboel, D, van Dijk, M. How often do we perform painful and stressful procedures in the paediatric intensive care unit? A prospective observational study. Aust Crit Care 2018;32:4–10. https://doi.org/10.1016/j.aucc.2018.04.003.Search in Google Scholar PubMed

7. Stevens, BJ, Abbott, LK, Yamada, J, Harrison, D, Stinson, J, Taddio, A, et al.. Epidemiology and management of painful procedures in children in Canadian hospitals. Can Med Assoc J 2011;183:E403–10. https://doi.org/10.1503/cmaj.101341.Search in Google Scholar PubMed PubMed Central

8. Devlin, JW, Skrobik, Y, Gélinas, C, Needham, DM, Slooter, AJC, Pandharipande, PP, et al.. Clinical practice guidelines for the prevention and management of pain, agitation/sedation, delirium, immobility, and sleep disruption in adult patients in the ICU. Crit Care Med 2018;46:e825–73. https://doi.org/10.1097/ccm.0000000000003299.Search in Google Scholar

9. Mauritz, MD, Uhlenberg, F, Bashir-Elahi, D, Werther, T, Gottschalk, U, Ebenebe, CU, et al.. Prediction of nociception in children using the nociceptive flexion reflex threshold and the bispectral index—a prospective exploratory observational study. Pediatr Crit Care Med 2021;22:e461–70. https://doi.org/10.1097/pcc.0000000000002701.Search in Google Scholar

10. Geuter, S, Gamer, M, Onat, S, Büchel, C. Parametric trial-by-trial prediction of pain by easily available physiological measures. Pain 2014;155:994–1001. https://doi.org/10.1016/j.pain.2014.02.005.Search in Google Scholar PubMed

11. Twycross, A, Voepel-Lewis, T, Vincent, C, Franck, LS, von Baeyer, CL. A debate on the proposition that self-report is the gold standard in assessment of pediatric pain intensity. Clin J Pain 2015;31:707–12. https://doi.org/10.1097/ajp.0000000000000165.Search in Google Scholar

12. Giordano, V, Edobor, J, Deindl, P, Wildner, B, Goeral, K, Steinbauer, P, et al.. Pain and sedation scales for neonatal and pediatric patients in a preverbal stage of development. JAMA Pediatr 2019;173:1186–97. https://doi.org/10.1001/jamapediatrics.2019.3351.Search in Google Scholar PubMed

13. Ambuel, B, Hamlett, KW, Marx, CM, Blumer, JL. Assessing distress in pediatric intensive care environments: the COMFORT scale. J Pediatr Psychol 1992;17:95–109.10.1093/jpepsy/17.1.95Search in Google Scholar PubMed

14. Merkel, SI, Voepel-Lewis, T, Shayevitz, JR, Malviya, S. The FLACC: a behavioral scale for scoring postoperative pain in young children. Pediatr Nurs 1997;23:293–7.Search in Google Scholar

15. Dorfman, TL, Schellenberg, ES, Rempel, GR, Scott, SD, Hartling, L. An evaluation of instruments for scoring physiological and behavioral cues of pain, non-pain related distress, and adequacy of analgesia and sedation in pediatric mechanically ventilated patients: a systematic review. Int J Nurs Stud 2014;51:654–76. https://doi.org/10.1016/j.ijnurstu.2013.07.009.Search in Google Scholar PubMed

16. Crellin, DJ, Harrison, D, Santamaria, N, Babl, FE. Systematic review of the Face, Legs, Activity, Cry and Consolability scale for assessing pain in infants and children. Pain 2015;156:2132–51. https://doi.org/10.1097/j.pain.0000000000000305.Search in Google Scholar PubMed

17. Crellin, DJ, Harrison, D, Santamaria, N, Huque, H, Babl, FE. The psychometric properties of the FLACC scale used to assess procedural pain. J Pain 2018;19:862–72. https://doi.org/10.1016/j.jpain.2018.02.013.Search in Google Scholar PubMed

18. Lempinen, H, Pölkki, T, Kyngäs, H, Kaakinen, P. Feasibility and clinical utility of the Finnish version of the FLACC pain scale in PICU. J Pediatr Nurs 2020;55:211–6. https://doi.org/10.1016/j.pedn.2020.07.011.Search in Google Scholar PubMed

19. Johansson, M, Kokinsky, E. The COMFORT behavioural scale and the modified FLACC scale in paediatric intensive care. Nurs Crit Care 2009;14:122–30. https://doi.org/10.1111/j.1478-5153.2009.00323.x.Search in Google Scholar PubMed

20. Carnevale, FA, Razack, S. An item analysis of the COMFORT scale in a pediatric intensive care unit. Pediatr Crit Care Med 2002;3:177–80. https://doi.org/10.1097/00130478-200204000-00016.Search in Google Scholar PubMed

21. van Dijk, M, Peters, JWB, van Deventer, P, Tibboel, D. The COMFORT Behavior Scale: a tool for assessing pain and sedation in infants. Am J Nurs 2005;105:33–6. https://doi.org/10.1097/00000446-200501000-00019.Search in Google Scholar PubMed

22. Valkenburg, AJ, Boerlage, AA, Ista, E, Duivenvoorden, HJ, Tibboel, D, van Dijk, M. The COMFORT-Behavior scale is useful to assess pain and distress in 0- to 3-year-old children with Down syndrome. Pain 2011;152:2059–64. https://doi.org/10.1016/j.pain.2011.05.001.Search in Google Scholar PubMed

23. van Dijk, M, de Boer, JB, Koot, HM, Tibboel, D, Passchier, J, Duivenvoorden, HJ. The reliability and validity of the COMFORT scale as a postoperative pain instrument in 0 to 3-year-old infants. Pain 2000;84:367–77. https://doi.org/10.1016/s0304-3959(99)00239-0.Search in Google Scholar PubMed

24. Bai, J, Hsu, L, Tang, Y, van Dijk, M. Validation of the COMFORT behavior scale and the FLACC scale for pain assessment in Chinese children after cardiac surgery. Pain Manag Nurs 2012;13:18–26. https://doi.org/10.1016/j.pmn.2010.07.002.Search in Google Scholar PubMed

25. Elella, RA, Adalaty, H, Koay, YN, Mokrusova, P, Theresa, M, Male, B, et al.. The efficacy of the COMFORT score and pain management protocol in ventilated pediatric patients following cardiac surgery. Int J Pediatr Adolesc Med 2015;2:123–7. https://doi.org/10.1016/j.ijpam.2015.11.001.Search in Google Scholar PubMed PubMed Central

26. Crellin, D, Sullivan, TP, Babl, FE, O’Sullivan, R, Hutchinson, A. Analysis of the validation of existing behavioral pain and distress scales for use in the procedural setting. Pediatr Anesth 2007;17:720–33. https://doi.org/10.1111/j.1460-9592.2007.02218.x.Search in Google Scholar PubMed

27. Taddio, A, Nulman, I, Koren, BS, Stevens, B, Koren, G. A revised measure of acute pain in infants. J Pain Manag 1995;10:456–63. https://doi.org/10.1016/0885-3924(95)00058-7.Search in Google Scholar PubMed

28. McGrath, PJ, Johnson, G, Goodman, JT, Dunn, J, Chapman, J. CHEOPS: a behavioral scale rating postoperative pain in children. New York, NY, USA: Raven Press; 1985.Search in Google Scholar

29. Fournier-Charrière, E, Tourniaire, B, Carbajal, R, Cimerman, P, Lassauge, F, Ricard, C, et al.. EVENDOL, a new behavioral pain scale for children ages 0 to 7 years in the emergency department: design and validation. Pain 2012;153:1573–82. https://doi.org/10.1016/j.pain.2012.02.024.Search in Google Scholar PubMed

30. Laures, E, LaFond, C, Hanrahan, K, Pierce, N, Min, H, McCarthy, AM. Pain assessment practices in the pediatric intensive care unit. J Pediatr Nurs 2019;48:55–62. https://doi.org/10.1016/j.pedn.2019.07.005.Search in Google Scholar PubMed

31. Sulla, F, Lachimia, M, Barbieri, L, Gigantiello, A, Iraci, C, Virgili, G, et al.. A first contribution to the validation of the Italian version of the Behavioral Pain Scale in sedated, intubated, and mechanically ventilated paediatric patients. Acta Biomed 2018;89:19–24. https://doi.org/10.23750/abm.v89i7-s.7945.Search in Google Scholar

32. Taddio, A, Hogan, M-E, Moyer, P, Girgis, A, Gerges, S, Wang, L, et al.. Evaluation of the reliability, validity and practicality of 3 measures of acute pain in infants undergoing immunization injections. Vaccine 2011;29:1390–4. https://doi.org/10.1016/j.vaccine.2010.12.051.Search in Google Scholar PubMed

33. Birkedal, HC, Larsen, MH, Steindal, SA, Solberg, MT. Comparison of two behavioural pain scales for the assessment of procedural pain: a systematic review. Nurs Open 2021;8:2050–60. https://doi.org/10.1002/nop2.714.Search in Google Scholar PubMed PubMed Central

34. de Carvalho, WB, da Silva, PSL, Paulo, CS, Fonseca, MM, Belli, LA. Comparison between the Comfort and Hartwig sedation scales in pediatric patients undergoing mechanical lung ventilation. Sao Paulo Med J 1999;117:192–6.10.1590/S1516-31801999000500003Search in Google Scholar PubMed

35. Hester, N, Foster, R, Jordan-Marsh, M. Putting pain measurement into clinical practice. In: Finley, G, McGrath, P, editors. Measurement of pain in infants and children, progress in pain research and management. IASP Press; 1998:179 p, vol 10.Search in Google Scholar

36. Merkel, S, Malviya, S. Pediatric pain, tools and assessment. J Perianesth Nurs 2000;15:408–14. https://doi.org/10.1053/jpan.2000.19504.Search in Google Scholar PubMed

37. Payen, JF, Bru, O, Bosson, JL, Lagrasta, A, Novel, E, Deschaux, I, et al.. Assessing pain in critically ill sedated patients by using a behavioral pain scale. Crit Care Med 2001;29:2258–63.10.1097/00003246-200112000-00004Search in Google Scholar PubMed

38. Young, J, Siffleet, J, Nikoletti, S, Shaw, T. Use of a Behavioural Pain Scale to assess pain in ventilated, unconscious and/or sedated patients. Intensive Crit Care Nurs 2006;22:32–9. https://doi.org/10.1016/j.iccn.2005.04.004.Search in Google Scholar PubMed

39. Rijkenberg, S, Stilma, W, Endeman, H, Bosman, RJ, Straaten, HMO. Pain measurement in mechanically ventilated critically ill patients: behavioral pain scale versus critical-care pain observation tool. J Crit Care 2015;30:167–72. https://doi.org/10.1016/j.jcrc.2014.09.007.Search in Google Scholar PubMed

40. Aïssaoui, Y, Zeggwagh, AA, Zekraoui, A, Abidi, K, Abouqal, R. Validation of a behavioral pain scale in critically ill, sedated, and mechanically ventilated patients. Anesth Analg 2005;101:1470–6. https://doi.org/10.1213/01.ane.0000182331.68722.ff.Search in Google Scholar PubMed

41. Akinci, SB, Kanabak, M, Guler, A, Aypar, U. Remifentanil versus fentanyl for short‐term analgesia‐based sedation in mechanically ventilated postoperative children. Pediatr Anesth 2005;15:870–8. https://doi.org/10.1111/j.1460-9592.2005.01574.x.Search in Google Scholar PubMed

42. Raja, SN, Carr, DB, Cohen, M, Finnerup, NB, Flor, H, Gibson, S, et al.. The revised International Association for the Study of Pain definition of pain: concepts, challenges, and compromises. Pain 2020;161:1976–82. https://doi.org/10.1097/j.pain.0000000000001939.Search in Google Scholar PubMed PubMed Central

43. Wells, N, Ridner, SH. Examining pain‐related distress in relation to pain intensity and psychological distress. Res Nurs Health 2008;31:52–62. https://doi.org/10.1002/nur.20262.Search in Google Scholar PubMed

44. Blount, RL. Commentary: acute pediatric procedural pain, distress, and coping. J Pediatr Psychol 2019;44:798–802. https://doi.org/10.1093/jpepsy/jsz041.Search in Google Scholar PubMed

45. Ranger, M, Johnston, CC, Rennick, JE, Limperopoulos, C, Heldt, T, du Plessis, AJ. A multidimensional approach to pain assessment in critically ill infants during a painful procedure. Clin J Pain 2013;29:613–20. https://doi.org/10.1097/ajp.0b013e31826dfb13.Search in Google Scholar PubMed PubMed Central

46. Kohut, SA, Riddell, RP. Does the neonatal facial coding system differentiate between infants experiencing pain-related and non-pain-related distress? J Pain 2009;10:214–20. https://doi.org/10.1016/j.jpain.2008.08.010.Search in Google Scholar PubMed

47. Blount, RL, Loiselle, KA. Behavioural assessment of pediatric pain. Pain Res Manag 2009;14:47–52. https://doi.org/10.1155/2009/348184.Search in Google Scholar PubMed PubMed Central

48. Ahlers, SJGM, van der Veen, AM, van Dijk, M, Tibboel, D, Knibbe, CAJ. The use of the behavioral pain scale to assess pain in conscious sedated patients. Anesth Analg 2010;110:127–33. https://doi.org/10.1213/ane.0b013e3181c3119e.Search in Google Scholar

49. Voepel-Lewis, T, Zanotti, J, Dammeyer, JA, Merkel, S. Reliability and validity of the face, legs, activity, cry, consolability behavioral tool in assessing acute pain in critically ill patients. Am J Crit Care 2010;19:55–61. https://doi.org/10.4037/ajcc2010624.Search in Google Scholar PubMed

50. Trojan, S, Wappler, F. Schmerztherapie in der Intensivmedizin. Deutsche Akademie für Anästhesiologische Fortbildung: refresher course. Ebelsbach, Germany: Aktiv Druck & Verlag; 2011:255 p.Search in Google Scholar

51. van Dijk, M, Ista, E. COMFORT behavior scale (German version); 2016. Available from: https://www.comfortassessment.nl/web/files/3514/7972/1778/COMFORT_Behavior_Skala_-_Deutsch_-_Final_version_2015_10_27.pdf [accessed 1 Nov 2021].Search in Google Scholar

52. Messerer, B, Meschik, J, Gutmann, A, Vittinghoff, M, Sandner-Kiesling, A. Postoperative Schmerzmessung bei speziellen Patientengruppen. Schmerz 2011;25:256–65. https://doi.org/10.1007/s00482-011-1061-0.Search in Google Scholar PubMed

53. Bakdash, JZ, Marusich, LR. Repeated measures correlation. Front Psychol 2017;8:456. https://doi.org/10.3389/fpsyg.2017.00456.Search in Google Scholar PubMed PubMed Central

54. Baayen, RH, Davidson, DJ, Bates, DM. Mixed-effects modeling with crossed random effects for subjects and items. J Mem Lang 2008;59:390–412. https://doi.org/10.1016/j.jml.2007.12.005.Search in Google Scholar

55. Chanques, G, Pohlman, A, Kress, JP, Molinari, N, de Jong, A, Jaber, S, et al.. Psychometric comparison of three behavioural scales for the assessment of pain in critically ill patients unable to self-report. Crit Care 2014;18:R160. https://doi.org/10.1186/cc14000.Search in Google Scholar PubMed PubMed Central

56. Boerlage, AA, Ista, E, de Jong, M, Tibboel, D, van Dijk, M. The COMFORT behavior scale: is a shorter observation period feasible? Pediatr Crit Care Med 2012;13:e124–5. https://doi.org/10.1097/pcc.0b013e3182192d92.Search in Google Scholar

57. Crellin, DJ, Babl, FE, Santamaria, N, Harrison, D. The psychometric properties of the MBPS scale used to assess procedural pain. J Pain 2018;19:660–9. https://doi.org/10.1016/j.jpain.2018.01.012.Search in Google Scholar PubMed

58. Laudiano-Dray, MP, Riddell, RP, Jones, L, Iyer, R, Whitehead, K, Fitzgerald, M, et al.. Quantification of neonatal procedural pain severity: a platform for estimating total pain burden in individual infants. Pain 2020;161:1270–7. https://doi.org/10.1097/j.pain.0000000000001814.Search in Google Scholar PubMed

59. Carbajal, R, Rousset, A, Danan, C, Coquery, S, Nolent, P, Ducrocq, S, et al.. Epidemiology and treatment of painful procedures in neonates in intensive care units. JAMA 2008;300:60–70. https://doi.org/10.1001/jama.300.1.60.Search in Google Scholar PubMed

60. Roofthooft, DWE, Simons, SHP, Anand, KJS, Tibboel, D, van Dijk, M. Eight years later, are we still hurting newborn infants? Neonatology 2014;105:218–26. https://doi.org/10.1159/000357207.Search in Google Scholar PubMed

61. Düzkaya, DS, Kuğuoğlu, S. Assessment of pain during endotracheal suction in the pediatric intensive care unit. Pain Manag Nurs 2015;16:11–9. https://doi.org/10.1016/j.pmn.2014.02.003.Search in Google Scholar PubMed


Supplementary Material

The online version of this article offers supplementary material (https://doi.org/10.1515/sjpain-2021-0193).


Received: 2021-10-21
Accepted: 2022-04-01
Published Online: 2022-04-25
Published in Print: 2022-07-26

© 2022 Walter de Gruyter GmbH, Berlin/Boston

Downloaded on 23.4.2024 from https://www.degruyter.com/document/doi/10.1515/sjpain-2021-0193/html
Scroll to top button