Next Article in Journal
The Influence of COVID-19 on University Students’ Well-Being, Physical Activity, Body Composition, and Strength Endurance
Next Article in Special Issue
Profile of Drug Utilization in Patients with Rare Diseases in Tuscany, Italy: A Population-Based Study
Previous Article in Journal
Effects of Physical Exercise on Mobile Phone Addiction in College Students: The Chain Mediation Effect of Psychological Resilience and Perceived Stress
Previous Article in Special Issue
Establishing Occupational Therapy Needs: A Semi-Structured Interview with Hereditary Transthyretin Amyloidosis Patients
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 19
Issue 23
10.3390/ijerph192315675
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Association between the Respiratory System and Upper Limb Strength in Males with Duchenne Muscular Dystrophy: A New Field for Intervention?

by
Agnieszka Sobierajska-Rek
1,†,
Eliza Wasilewska
2,*,†,
Karolina Śledzińska
3,
Joanna Jabłońska-Brudło
1,
Sylwia Małgorzewicz
4,
Andrzej Wasilewski
5 and
Dominika Szalewska
1
1
Department of Rehabilitation Medicine, Faculty of Health Sciences with the Institute of Maritime and Tropical Medicine, Medical University of Gdansk, 80-219 Gdańsk, Poland
2
Department of Pulmonology and Allergology, Faculty of Medicine, Medical University of Gdansk, 80-211 Gdańsk, Poland
3
Department of Internal and Pediatric Nursing, Faculty of Health Sciences with the Institute of Maritime and Tropical Medicine, Medical University of Gdansk, 80-211 Gdańsk, Poland
4
Department of Clinical Nutrition, Faculty of Health Sciences with the Institute of Maritime and Tropical Medicine, Medical University of Gdansk, 80-416 Gdańsk, Poland
5
Student Scientific Association at Department of Physical Education and Sport, Wroclaw Medical University, 51-601 Wroclaw, Poland
*
Author to whom correspondence should be addressed.
†
These authors contributed equally to this work.
Int. J. Environ. Res. Public Health 2022, 19(23), 15675; https://doi.org/10.3390/ijerph192315675
Submission received: 18 October 2022 / Revised: 21 November 2022 / Accepted: 22 November 2022 / Published: 25 November 2022
(This article belongs to the Special Issue Second Edition of the Current Situation and Distribution of Rare Diseases: Challenges, Prevention, Healthcare, and Effects)
Browse Figure
Review Reports Versions Notes

Abstract

:
Progressive, irreversible muscle weakness is the leading symptom of Duchenne muscular dystrophy (DMD), often resulting in death from respiratory muscle failure. Little is known about the relationship between the functioning of the respiratory system and the hand grip—a function which remains long preserved. This study aimed to investigate the interdependence between muscle strength and the function of both hand grip and the respiratory system in patients with DMD. Materials and Method: The study included cohort patients, aged 6–17, with DMD, recruited from the Rare Disease Centre, Gdansk, Poland. Clinical status (Vignos scale, Brook scale), pulmonary function (respiratory muscle strength—MIP, MEP); spirometry (FEV1; FVC), as well as upper limb function (performance of the upper limb—PUL 2.0) and hand grip strength (HGS) (hand-held dynamometer) were evaluated in all participants. Results: Finally, 53 boys (mean age 11.41 ± 3.70 years, 25 non-ambulant) were included. Each of the participants presented a lower %pv of MIP (48.11 ± 27), MEP (38.11 ± 22), PUL (75.64 ± 27), and HGS (33.28 ± 18). There were differences between the ambulatory and non-ambulatory groups in values of MIP, MEP, FVC, PUL, HGS (p < 0.001 for all), and FEV1 (p < 0.013). There were correlations between PUL, HGS, and MIP (R = 0.56; R = 0.61, p < 0.001 both), MEP (R = 0.59; R = 0.62, p < 0.001), FVC (R = 0.77; R = 0.77, p < 0.001), and FEV1 (R = 0.77; R = 0.79; p < 0.001). These correlations were found for all participants, but non-ambulatory patients presented stronger relationships. Conclusions: 1. The pulmonary and upper limb functions were within the normal range in ambulatory and low in non-ambulatory patients with DMD, but the muscle strength of both systems was low, regardless of the stage of the disease. 2. There seems to be an interdependence between the respiratory system and upper limb strength in terms of muscle strength and function in DMD patients, which is stronger in non-ambulatory patients. This may be the basis for the creation of a new personalized plan in rehabilitation—the simultaneous rehabilitation of the respiratory and upper limb muscles. Further studies on this theory should be conducted.

1. Introduction

In progressive irreversible neuromuscular disorders(DMD; OMIM Online Mendelian Inheritance in Man 310200), mutations in the dystrophin gene lead to the impaired production of dysfunctional dystrophin protein, which impacts appropriate muscle activity [1]. Usually, the first DMD symptoms occur in early childhood, at 2 to 3 years old, when boys do not run as quickly as their peers, start to fall more often, and have difficulties climbing stairs. This is due to the progressive muscular weakness of the proximal muscles of lower limbs and pelvic girdle, with consecutive loss of ambulation, mostly in the teenage years.
Steady disease progression deteriorates respiratory muscle function, resulting in restrictive ventilator defect [2,3]. Due to respiratory muscle exhaustion, the lungs cannot expand fully, which causes decreased lung volume, inadequate ventilation, and insufficient oxygenation [4]. Consequently, the risk of developing hypoventilation, and the subsequent dependence on ventilatory support increases with age, usually after the loss of ambulation. Pulmonary function reflects the skeletal muscle condition in DMD patients. The force of respiratory muscles generates pressure fluctuations, and the reduction in maximal pressures indicates respiratory muscle fatigue. The pulmonary function test (spirometry) measures lung volumes (FVC, FEV1), while maximal respiratory pressure reflects respiratory muscle strength (maximal inspiratory pressure—MIP; maximal expiratory pressure—MEP). The restriction of diaphragm movements has been revealed during maximal inspiration in DMD patients with an MIP of less than 60% of the predicted value [5]. Another study showed that patients with an MEP less than 60 cmH2O are at risk of losing the ability to cough effectively [6]. Consequently, these changes lead to the insufficiency of the respiratory system, which is one of the leading cause of death in DMD patients, alongside cardiomyopathy [3,4,5,6,7].
Unlike the respiratory system, the upper limbs retain their strength and function longer than any other muscular system in patients with DMD. Particularly, the function of the distal muscles of the upper limb is usually retained longer, even at the advanced stage of the disease. It was found that hand strength within the first decade of life increases, and in the following years, significantly correlates with the degree of physical disability [7]. The milestone in disease progression for the upper extremities is the loss of ability to reach over the head, loss of ability to self-feed, loss of ability to place hands on a tabletop, and to use a computer (distal hand function) [8,9]. Such activity is particularly important for DMD patients, as it allows them to remain independent, at least to some extent, and helps to provide a satisfactory and meaningful life.
The close anatomical relationship between the muscles of the upper limbs and the respiratory muscles (for example, the muscles of the upper extremities and the fascia surrounding most dorsal muscles of the trunk) makes it possible for them to influence each other [10].
Although this interconnectedness is an important issue, there is little data regarding the comparison of upper limb capacity and respiratory system function in these patients, and the results are inconclusive [11,12]. Moreover, the data from our previous study showed that pulmonary dysfunction in children with DMD may appear earlier than thought [2], and some ambulatory patients may not be aware of the gradual lung volume decrease, because they do not experience symptoms of nocturnal hypoventilation [13]. The mutual influence of the respiratory system and the upper limbs in patients with DMD is still little described and understood.
Therefore, the aim of the study was to investigate the interdependence between muscle strength and function of both the respiratory system and the upper limbs in patients with DMD.

2. Materials and Methods

2.1. Study Design

This cross-sectional single-center study was conducted as a part of the Multidisciplinary Care Program for Patients with Duchenne Muscular Dystrophy at the Rare Disease Center (RDC), University Clinical Center, Medical University of Gdansk, Poland, within the years 2017–2021. The University Clinical Center is a member of the TREAT NMD Alliance Neuromuscular Network.
All patients and/or their legal guardians provided written informed consent prior to participation in the study. Approval for the study was obtained from The Committee of Ethics, no: NKBBN/611/2017/2018, NKBBN/260/2021, conforming to the principles embodied in the Declaration of Helsinki.

2.2. Patients and Methods

Participants

The study included cohort DMD patients, aged between 5–17 years, diagnosed based on the presence of clinical symptoms, genetic testing, and/or muscle biopsy result [1]; patients had the ability to maintain a sitting position in a wheelchair and to perform pulmonary function tests.
The exclusion criteria were: lack of written consent, continuous dependence on assisted ventilation, presence of respiratory tract infection, and severe behavioral or attention deficit disorders that prevented adequate cooperation during evaluation.
Clinical status was assessed using the Vignos (VS) [14] and the Brooke (BS) [15] scale. The anthropometric data—weight and height—with an accuracy of 0.1 kg and 0.5 cm respectively, were obtained; body mass index (BMI) was calculated as the weight divided by height squared (kg/m2). BMI Polish references were used to calculate z-scores [16]. The height of non-ambulant participants was calculated from the ulnar length [17]. Patients were qualified as non-ambulant when they were unable to walk more than ten meters without human assistance.
The evaluation of pulmonary status consisted of spirometry and maximal respiratory pressure assessments, conducted by the same pulmonologist experienced in patients with DMD. The function and strength of the upper limbs were assessed using the performance of the upper limb (PUL) test and the maximal grip strength hand-held dynamometer by the same trained physical therapist and specialist in rehabilitation medicine.

2.3. Pulmonary Status

2.3.1. Respiratory Muscle Strength

Maximal respiratory pressure was evaluated using a calibrated portable hand-held mouth pressure meter (MicroRPM; Micro Medical Ltd., Rochester, England) in a sitting position. To measure maximal expiratory pressure (MEP cmH2O), participants were asked to exhale with a maximum expiratory effort for at least one second, done after maximum inspiration. On the contrary, maximal inspiratory pressure (MIP cmH2O) was measured as a maximum inspiratory effort for at least one second, done after maximum expiration. The highest positive MEP value and the lowest negative MIP value were chosen from three or more attempts (five attempts maximum). The percentage predicted value of MEP (MEP%) and MIP (MIP%) values were calculated according to the formulas presented in Appendix A.

2.3.2. Spirometry

Spirometry was performed using the calibrated, computerized spirometer Pneumo Screen (Jaeger, Germany), according to the European Respiratory Society and American Thoracic Society recommendations [18,19]. A minimum of three, and up to five, maneuvers with maximum effort were attempted by each subject. The highest value of forced vital capacity (FVC), forced expiratory volume in one second (FEV1), expressed as liters (L), and the percentage of predicted value (%pv) were evaluated from the correct acceptable attempts.

2.4. Upper Limb

2.4.1. Performance of the Upper Limb (PUL)

PUL is a functional scale designed specifically to assess upper limb function in DMD patients. It is used to assess the functioning of the upper limbs and is subdivided into three parts (shoulder level, mid-level, and distal level), related to the activities of daily life that both patients and clinicians identify as relevant. Participants were asked to lift the weight of 500 g and 1 kg by shoulder flexion, bring a 200 g cup to the mouth, bring two hands onto a table, and move weights of 100 g, 500 g, and 1 kg on the table to the level of the waist, move a heavy can diagonally on a table, stack 5 heavy cans, one on top of the other, remove the lid from a container, tear a piece of paper, trace a path with a pencil, push on a light, collect coins with a dominant hand from a table, and pick up 10 g with a finger pinch. All activities can be scored with 1 or 2 points. One point is given if the task is performed, with compensations. A total score of 42 points can be achieved by adding the results of the three levels, with a higher score denoting better function [20]. Percentage values were calculated based on the assumption that every healthy child in the age commensurate to that in study group would achieve 42 points (100%).

2.4.2. Maximal Hand Grip Strength (HGS)

Maximal HGS was evaluated with a dynamometer FT-5988—N1 (Spais, Gdansk, Poland)—a high-precision electronic device developed to measure grip strength in both patients with neuromuscular disorders and healthy individuals. During the test, patients were seated on a chair or wheelchair, in front of a table, with the dominant forearm placed on the table at waist level. All patients were strongly encouraged by evaluators to provide maximal voluntary isometric contractions for 3 s, followed by a rest period of about 30 s. Patients were asked to perform three attempts; the mean value was then calculated. Percentage predicted values were calculated according to the predictive equation formula presented in Appendix A [18].

2.5. Statistical Analysis

The results of the statistical analysis were expressed as mean and standard deviation (SD) or median and interquartile range (IQR). Correlations between numerical parameters were analyzed using the Spearman correlation test. The Mann–Whitney U test for non-parametric conditions was performed to analyze the differences between the groups. Linear regression analysis was used for the multivariate analysis of numerical parameters; p values less than 0.05 were accepted as significant. The statistical analysis was carried out with Statistica 13.3 (StatSoft, Kraków, Poland).

3. Results

3.1. Participant Characteristics

Finally, the study cohort consisted of 53 boys and adolescents with DMD. The mean age was 11.41 ± 3.70 years; 25 patients were non-ambulant. The mean age at loss of ambulation was 10.41 ± 2.06 years. Ambulatory patients were younger than non-ambulatory patients (9.17 ± 2.85 vs. 13.92 ± 2.87; p < 0.001).
Ambulatory status assessed with VS varied from 1 to 9 points (median 3; IQR 8), and the general condition of the upper limbs with BS varied from 1 to 5 (median 2; IQR 2). There was relationship between age and ambulatory status (R = 0.65; p < 0.000). Detailed characteristics of the participants are presented in Table 1.

3.2. Respiratory System

The results of respiratory muscle strength and spirometry are shown in Table 2. The MIP ranged from 5 to 83 cmH2O and the MEP from 8 to 77 cmH2O. The participants presented lower values of MIP (mean 48.11 %pv) and MEP (mean 38.11 %pv) than normal for a healthy population [19]. There were differences between the ambulatory and non-ambulatory groups in MIP %pv and MEP %pv (p < 0.001 for both), and in spirometry parameters FVC %pv and FEV1 %pv (p < 0.001 and p < 0013, respectively) (see Figure 1).

3.3. The Upper Limb

The PUL scores for the assessed population ranged from 2 to 42 points, while the HGS ranged from 0.3 to 17.17 kg. There were differences between the ambulatory and non-ambulatory groups regarding PUL and HGS (92.85 %pv vs 54.38 %pv, and 43.35 %pv vs. 21.52 %pv, p < 0.001 for both); see Figure 1. None of the study groups achieved the results achieved by a healthy population of children and adolescents. Healthy young individuals always presented 100 %pv (after converting the nominal values according to age). Details of the upper limb assessment are presented in Table 3.

3.4. Associations between the Respiratory System and Muscle Function of the Upper Limb

Detailed data on associations between the respiratory and upper limb parameters are shown in Table 4. For the whole study population, there were correlations between PUL and respiratory muscle MIP, MEP (R = 0.44, p < 0.001; R = 0.54, p < 0.001, respectively), and spirometry parameters FVC, and FEV1 (R = 0.28, p = 0.04 and R = 0.35, p = 0.01, respectively). Moreover, there were correlations between hand grip strength and MIP and MEP (R = 0.38, p = 0.004, R = 0.45, p < 0.001, respectively), as well as FVC and FEV1 (R = 0.71, p < 0.001; R = 0.73, p < 0.001, respectively).
The univariable regression analysis showed that hand grip strength was related to PUL, FVC values, and age (see Table 5).

4. Discussion

In the present study, the relationship between the respiratory system and the upper limbs was evaluated in the cohort of 53 ambulant and non-ambulant Caucasian patients with DMD, aged 6–17 years.
The most important results of our study were (1) a strong correlation between the respiratory system (expressed as respiratory muscle strength and lung volume) with upper limb function and hand grip strength in patients with DMD, (2) the strongest correlation between the systems was observed in the non-ambulatory patients, (3) low values of muscle strength (MIP, MEP, HGS) were recorded in all participants, as opposed to low function (FEV1, FVC, PUL) recorded only in non-ambulatory patients, and (4) a high standard deviations for all measured parameters. These findings may indicate the relationship in terms of function and muscle strength between the respiratory system and strength of the upper limbs.
Studies by other authors showed comparable results [21,22]. Lee et al. evaluated 43 non-ambulatory Duchenne males, aged 10–30 years, and confirmed that their PUL scores correlate with their pulmonary function [23]. Additionally, in a cohort of 89 DMD boys, aged up to 18 years, the study of Ricotti et al. showed an association between respiratory and hand grip strength; moreover, the authors point to the possibility of the novel concept of a composite endpoint in clinical trials by combining respiratory function, upper limb strength, and force domains [11].
The nature of the association between hand grip strength and lung function remains unclear, although studies also confirm this relationship in patients with other diseases [24,25] and even in healthy persons [26,27]. For example, research on neuromuscular diseases, such as spinal muscular atrophy (SMA), showed that FVC% correlate positively with the upper limb function measured with the revised upper limb module (RULM) [28]. Moreover, research on sufferers from pulmonary diseases reported significantly decreased hand grip strength in children with asthma in comparison to healthy subjects [25]. Moreover, adults with chronic obstructive pulmonary disease and sarcopenia presented low hand grip strength associated with worse pulmonary function [24,29].
Interestingly, studies conducted on a healthy population of young [30] middle-aged adults [27] and healthy elderly [12,31] also indicate the relationship between hand grip strength and FEV1 and FVC. Even if the study examined only the muscle mass (evaluated by bioelectrical impedance) without hand grip strength, it also confirmed associations between pulmonary and upper limb function [26].
The next interesting result of our study showed that MIP, MEP, HGS, and PUL values were characterized by a high standard deviation. Meier et al. reported high coefficients of variability for MIP (18%) and MEP (15%), irrespective of age, in a group of 64 DMD patients, aged 10–18 years [32]. The cited study concluded that patients have difficulty regarding the reproducibility of the measurements.
In our center (CRD), studied children underwent training before pulmonary measurements were obtained. Despite this, we found a large dispersion in the results of the study group. According to Hogrel et al. significant variability of HGS in these patients may be caused by confounding factors, such as mutation, chronological and biological age, cognitive status, motivation, and behavior [8]. The same observation may apply to respiratory muscle strength [33]. It may also be due to the diversity of DMD phenotypes, which Humbertclaude et al. showed in the French population; for example, the most severe group lost ambulation at a mean age of 7.10 years, as opposed to the mildest group, losing ambulation at 12.01 years old [34].
Perhaps the small size of our group size did not allow us to determine a relationship between MIP, MEP, HGS values, and genetic changes, or other confounding factors. However, taking into account our previous study, “E-monitoring of PULMonary function in patients with Duchenne Muscular Dystrophy at home,” (E-PULMoDMD; ClinicalTrials.gov Identifier: NCT05516745), was determined that daily regular spirometry measurements at home increase the quality and repeatability of the results obtained in the clinic and improve respiratory comfort, in some patients [35]. To improve the quality of the results obtained and to achieve greater repeatability, perhaps it should be recommended to perform more frequent measurements than those currently recommended (every 6–12 months) [36], especially since there are portable devices which can be used in homes [37,38].
Another interesting finding in our study was that all the individuals with DMD, regardless of the stage of the disease, presented low MIP, MEP, and HGS. Unlike this fact, most of the ambulatory patients were able to achieve maximum values, in the range of the results for healthy children, for FVC, FEV1, and PUL. From the results of the literature and our own research, it is known that the values of spirometry increase, reaching an individual maximum result before the loss of ambulation, while during the non-ambulatory period, these parameters are significantly decreased annually, regardless of the treatment with glucocorticosteroid [2,4,11,39,40]. PUL behaves similarly, and the study by Ricotti et al. showed that upper limb function (assessed with PUL) was stable in the ambulant population, while in the non-ambulant patients, an annual total loss of 4.13 points of PUL was observed [11].
However, in our study, we were surprised by the low values for muscle strength already obtained in the youngest children, with the function of gait still preserved. Finder et al. reported similar observations on MIP and MEP, based on the analysis of several studies [41].
Additionally, others point to the fact that MIP and MEP usually decrease faster than the values of spirometry, e.g., FVC and FEV1 in the natural history of the disease, which was already visible in children 6–7 years of age [40,42].
Our study showed that function indicators remained within the reference range for a healthy population, despite the already weakening strength of the respiratory muscles and the hand in ambulatory patients. While in the non-ambulatory group, there was a decrease in indicators of both the strength and function of the muscles of the evaluated organs. These results also partly explain the stronger correlation between upper limb condition and respiratory function for non-ambulant patients. This indicates the need for developing a specific care strategy that consists of respiratory function support and training, as well as taking care of the condition of the upper limbs.
In previous studies, other authors have evaluated indicators of strength and function regarding the hand and respiratory system to assess the course of the natural history of the disease, or to determine points in clinical trials. In our study, we draw attention to the possibility of using these dependencies in rehabilitation, thus improving the quality of life of patients with DMD.
In the current literature, there is a lack of guidelines according to upper limb physical therapy for DMD. The findings of this study highlight the meaning of upper limb rehabilitation in this population. The close anatomical relationship between the muscles of the upper limb and the respiratory muscles may cause that upper limb training can be considered as a respiratory muscle function-dependent activity [10]. Strengthening exercises of the upper limbs to support lung function might be considered potentially reasonable in a rehabilitation program for DMD patients. This strategy is successfully provided to patients with chronic obstructive pulmonary disease (COPD) or other lung diseases. In patients with COPD who additionally trained their upper body with resistance for four weeks, higher improvement in FEV1 and FVC was observed in comparison to the control group, which trained only with breathing exercises [43]. Moreover, other research shows that upper extremity muscle training increases inspiratory muscle strength in COPD patients [44].
Our previous study showed that it is possible to implement the telerehabilitation of respiratory muscles in patients with DMD [37,38]. After the results of the current research, we now consider the concept of the combined rehabilitation of both the respiratory system and the upper limbs.
The limitation of this study was that we did not explore the influence of skeletal disorders (scoliosis) on respiratory system function. The study was cross-sectional and lacked the evaluation of changes in the abovementioned parameters over time. As the number of participants was relatively low, our findings should be treated with caution. However, these observations justify addressing the question of whether upper limb exercises may contribute to the improvement of the pulmonary function in DMD patients, and may be indicators for further studies to determine the optimal strategy for preserving both parameters: upper limb strength and respiratory function. Future long-term studies may help to better understand the progression of upper limb weakness and respiratory muscle involvement.

5. Conclusions

  • The pulmonary and upper limb functions were within the normal range in ambulatory and lowered in non-ambulatory patients with DMD, but the muscle strength of both systems was low, regardless of the stage of the disease.
  • There seems to be an interdependence between the respiratory system and the upper limbs in terms of muscle strength and function in DMD patients, which is stronger in non-ambulatory patients. This may be the basis for the creation of a new personalized plan in rehabilitation—the simultaneous rehabilitation of the respiratory and upper limb muscles. Further studies on this topic should be conducted.

6. Clinical Implications

The rehabilitation of patients with DMD should focus on both the respiratory system and the upper limbs, preferably at the same time.

Author Contributions

Conceptualization: E.W., A.S.-R. and J.J.-B.; methodology: A.S.-R., J.J.-B. and E.W.; formal analysis: E.W. and D.S.; investigation: A.S.-R., E.W. and J.J.-B.; resources: A.S.-R., E.W. and K.Ś.; data curation: A.S.-R. and E.W.; writing—original draft preparation: A.S.-R. and E.W.; writing—review and editing: E.W., K.Ś. and S.M.; visualization A.S.-R. and A.W.; supervision: E.W. and D.S.; project administration: A.S.-R.; funding acquisition, D.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki. Approval for the study was obtained from The Committee of Ethics, no: NKBBN/611/2017/2018, NKBBN/260/2021.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. Full data are not publicly available due to privacy restrictions.

Acknowledgments

We would like to thank Katarzyna Witkowska and Łukasz Mański from the University Clinical Center, Medical University of Gdansk, Poland, for their support in data collection.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Formulas used to calculate the percentage of predicted values of pulmonary function parameters [19].
MEP% = MEP × 100/(7619 + (7806 × age) + (0.004 × height × weight)
MIP% = −MIP × 100/(−27,020 − (4132 × age) − (0.003 × height × weight)

References

  1. Birnkrant, D.J.; Bushby, K.; Bann, C.M.; Apkon, S.D.; Blackwell, A.; Brumbaugh, D.; Case, L.E.; Clemens, P.R.; Hadjiyannakis, S.; Pandya, S.; et al. Diagnosis and management of Duchenne muscular dystrophy, part 1: Diagnosis, and neuromuscular, rehabilitation, endocrine, and gastrointestinal and nutritional management. Lancet Neurol. 2018, 17, 251–267. [Google Scholar] [CrossRef] [Green Version]
  2. Wasilewska, E.; Małgorzewicz, S.; Meyer-Szary, J.; Sledzinska, K.; Niedoszytko, M.B.; Jassem, E.; Wierzba, J. Pulmonary dysfunction in children with Duchenne muscular dystrophy may appear earlier than we thought—Analysis using novel methodology based on z-scores. Arch. Med. Sci. 2021. [Google Scholar] [CrossRef]
  3. Nunes, M.F.; Hukuda, M.E.; Favero, F.M.; Oliveira, A.B.; Voos, M.C.; Caromano, F. Relationship between muscle strength and motor function in Duchenne muscular dystrophy. Arq. Neuro Psiquiatr. 2016, 74, 530–535. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Kang, S.-W.; Kang, Y.-S.; Sohn, H.-S.; Park, J.-H.; Moon, J.-H. Respiratory Muscle Strength and Cough Capacity in Patients with Duchenne Muscular Dystrophy. Yonsei Med. J. 2006, 47, 184–190. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Barnard, A.M.; Lott, D.J.; Batra, A.; Triplett, W.T.; Forbes, S.C.; Riehl, S.L.; Willcocks, R.J.; Smith, B.K.; Vandenborne, K.; Walter, G.A. Imaging respiratory muscle quality and function in Duchenne muscular dystrophy. J. Neurol. 2019, 266, 2752–2763. [Google Scholar] [CrossRef]
  6. Szeinberg, A.; Tabachnik, E.; Rashed, N.; McLaughlin, F.J.; England, S.; Bryan, C.A.; Levison, H. Cough Capacity in Patients with Muscular Dystrophy. Chest 1988, 94, 1232–1235. [Google Scholar] [CrossRef]
  7. Mayer, O.H.; Aliverti, A.; Meier, T. Breathe Duchenne: What natural history studies tell us about the progression of pulmonary morbidity in Duchenne muscular dystrophy. Neuromuscul. Disord. 2018, 28, 910–913. [Google Scholar] [CrossRef]
  8. Mattar, F.L.; Sobreira, C. Hand weakness in Duchenne muscular dystrophy and its relation to physical disability. Neuromuscul. Disord. 2008, 18, 193–198. [Google Scholar] [CrossRef]
  9. Hogrel, J.-Y.; Decostre, V.; Ledoux, I.; de Antonio, M.; Niks, E.H.; de Groot, I.; Straub, V.; Muntoni, F.; Ricotti, V.; Voit, T.; et al. Normalized grip strength is a sensitive outcome measure through all stages of Duchenne muscular dystrophy. J. Neurol. 2020, 267, 2022–2028. [Google Scholar] [CrossRef]
  10. Wasilewska, E.; Małgorzewicz, S.; Sobierajska-rek, A.; Jabło, J. Transition from Childhood to Adulthood in Pa-tients with Duchenne Muscular Dystrophy. Medicina 2020, 56, 426. [Google Scholar] [CrossRef]
  11. Han, J.W.; Kim, Y.M. Effect of breathing exercises combined with dynamic upper extremity exercises on the pulmonary function of young adults. J. Back Musculoskelet. Rehabil. 2018, 31, 405–409. [Google Scholar] [CrossRef] [PubMed]
  12. Ricotti, V.; Selby, V.; Ridout, D.; Domingos, J.; Decostre, V.; Mayhew, A.; Eagle, M.; Butler, J.; Guglieri, M.; Van der Holst, M.; et al. Respiratory and upper limb function as outcome measures in ambulant and non-ambulant subjects with Duchenne muscular dystrophy: A prospective multicentre study. Neuromuscul. Disord. 2019, 29, 261–268. [Google Scholar] [CrossRef] [PubMed]
  13. Bahat, G.; Tufan, A.; Ozkaya, H.; Tufan, F.; Akpinar, T.S.; Akin, S.; Bahat, Z.; Kaya, Z.; Kiyan, E.; Erten, N.; et al. Relation between hand grip strength, respiratory muscle strength and spirometric measures in male nursing home residents. Aging Male 2014, 17, 136–140. [Google Scholar] [CrossRef] [PubMed]
  14. Bulut, N.; Aydın, G.; Alemdaroğlu-Gürbüz, I.; Karaduman, A.; Yılmaz, Ö.; Pulmonary and upper limbs function in children with early stage Duchenne muscular dystrophy compared to their healthy peers. Braz. J. Phys. Ther. 2020, 25, 251–255. [Google Scholar] [CrossRef] [PubMed]
  15. Brooke, M.H.; Griggs, R.; Mendell, J.R.; Fenichel, G.M.; Shumate, J.B.; Pellegrino, R.J. Clinical trial in duchenne dystrophy. I. The design of the protocol. Muscle Nerve 1981, 4, 186–197. [Google Scholar] [CrossRef]
  16. Vignos, P.J.; Spencer, G.E.; Archibald, K.C. Management of Progressive Muscular Dystrophy of Childhood. JAMA 1963, 184, 89–96. [Google Scholar] [CrossRef]
  17. Kulaga, Z.; Litwin, M.; Tkaczyk, M.; Różdżyńska, A.; Barwicka, K.; Grajda, A.; Świąder, A.; Gurzkowska, B.; Napieralska, E.; Pan, H. The height-, weight-, and BMI-for-age of Polish school-aged children and adolescents relative to international and local growth references. BMC Public Health 2010, 10, 109. [Google Scholar] [CrossRef] [Green Version]
  18. Finder, J.D.; Birnkrant, D.; Carl, J.; Farber, H.J.; Gozal, D.; Iannaccone, S.T.; Kovesi, T.; Kravitz, R.M.; Panitch, H.; Schramm, C.; et al. Respiratory Care of the Patient with Duchenne Muscular Dystrophy: ATS consensus statement. Am. J. Respir. Crit. Care Med. 2004, 170, 456–465. [Google Scholar] [CrossRef]
  19. Miller, M.R.; Crapo, R.; Hankinson, J.; Brusasco, V.; Burgos, F.; Casaburi, R.; Coates, A.; Enright, P.; van der Grinten, C.P.M.; Gustafsson, P.; et al. General considerations for lung function testing. Eur. Respir. J. 2005, 26, 153–161. [Google Scholar] [CrossRef] [Green Version]
  20. Gauld, L.M.; Kappers, J.; Carlin, J.B.; Robertson, C.F. Prediction of Childhood Pulmonary Function Using Ulna Length. Am. J. Respir. Crit. Care Med. 2003, 168, 804–809. [Google Scholar] [CrossRef]
  21. Mayhew, A.G.; Coratti, G.; Mazzone, E.S.; Klingels, K.; James, M.; Pane, M.; Straub, V.; Goemans, N.; Mercuri, E.; Ricotti, V.; et al. Performance of Upper Limb module for Duchenne muscular dystrophy. Dev. Med. Child Neurol. 2019, 62, 633–639. [Google Scholar] [CrossRef] [PubMed]
  22. Ploegmakers, J.J.; Hepping, A.M.; Geertzen, J.H.; Bulstra, S.K.; Stevens, M. Grip strength is strongly associated with height, weight and gender in childhood: A cross sectional study of 2241 children and adolescents providing reference values. J. Physiother. 2013, 59, 255–261. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Domènech-Clar, R.; López-Andreu, J.; Compte-Torrero, L.; De Diego-Damiá, A.; Macián-Gisbert, V.; Perpiñá-Tordera, M.; Roqués-Serradilla, J. Maximal static respiratory pressures in children and adolescents. Pediatr. Pulmonol. 2003, 35, 126–132. [Google Scholar] [CrossRef] [PubMed]
  24. Park, J.H.; Kang, S.-W.; Lee, S.C.; Choi, W.A.; Kim, D.H. How Respiratory Muscle Strength Correlates with Cough Capacity in Patients with Respiratory Muscle Weakness. Yonsei Med. J. 2010, 51, 392–397. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Lee, H.N.; Sawnani, H.; Horn, P.S.; Rybalsky, I.; Relucio, L.; Wong, B.L. The Performance of the Upper Limb scores correlate with pulmonary function test measures and Egen Klassifikation scores in Duchenne muscular dystrophy. Neuromuscul. Disord. 2016, 26, 264–271. [Google Scholar] [CrossRef] [PubMed]
  26. Martínez-Luna, N.; Orea-Tejeda, A.; González-Islas, D.; Flores-Cisneros, L.; Keirns-Davis, C.; Sánchez-Santillán, R.; Pérez-García, I.; Gastelum-Ayala, Y.; Martínez-Vázquez, V.; Martínez-Reyna, Q. Association between body composition, sarcopenia and pulmonary function in chronic obstructive pulmonary disease. BMC Pulm. Med. 2022, 22, 106. [Google Scholar] [CrossRef]
  27. Strandkvist, V.J.; Backman, H.; Roding, J.; Stridsman, C.; Lindberg, A. Hand grip strength is associated with forced expiratory volume in 1 second among subjects with COPD: Report from a population-based cohort study. Int. J. Chronic Obstr. Pulm. Dis. 2016, 11, 2527–2534. [Google Scholar] [CrossRef] [Green Version]
  28. Latorre-Román, P.; Navarro-Martínez, A.V.; Mañas-Bastidas, A.; García-Pinillos, F. Handgrip strength test as a complementary tool in monitoring asthma in daily clinical practice in children. Iran. J. Allergy Asthma Immunol. 2014, 13, 394–403. [Google Scholar]
  29. Park, C.-H.; Yi, Y.; Do, J.G.; Lee, Y.-T.; Yoon, K.J. Relationship between skeletal muscle mass and lung function in Korean adults without clinically apparent lung disease. Medicine 2018, 97, e12281. [Google Scholar] [CrossRef]
  30. Mgbemena, N.C.; Aweto, H.A.; Tella, B.A.; Emeto, T.I.; Malau-Aduli, B.S. Prediction of lung function using handgrip strength in healthy young adults. Physiol. Rep. 2019, 7, e13960. [Google Scholar] [CrossRef] [Green Version]
  31. Han, C.H.; Chung, J.H. Association between hand grip strength and spirometric parameters: Korean National health and Nutrition Examination Survey (KNHANES). J. Thorac. Dis. 2018, 10, 6002–6009. [Google Scholar] [CrossRef] [PubMed]
  32. Wolfe, A.; Scoto, M.; Milev, E.; Lofra, R.M.; Abbott, L.; Wake, R.; Rohwer, A.; Main, M.; Baranello, G.; Mayhew, A.; et al. Longitudinal changes in respiratory and upper limb function in a pediatric type III spinal muscular atrophy cohort after loss of ambulation. Muscle Nerve 2021, 64, 545–551. [Google Scholar] [CrossRef]
  33. Shin, H.I.; Kim, D.-K.; Seo, K.M.; Kang, S.H.; Lee, S.Y.; Son, S. Relation Between Respiratory Muscle Strength and Skeletal Muscle Mass and Hand Grip Strength in the Healthy Elderly. Ann. Rehabil. Med. 2017, 41, 686–692. [Google Scholar] [CrossRef] [PubMed]
  34. Meier, T.; Rummey, C.; Leinonen, M.; Spagnolo, P.; Mayer, O.H.; Buyse, G.M.; Bernert, G.; Knipp, F.; Goemans, N.; Hauwe, M.V.D.; et al. Characterization of pulmonary function in 10–18 year old patients with Duchenne muscular dystrophy. Neuromuscul. Disord. 2017, 27, 307–314. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Nicot, F.; Hart, N.; Forin, V.; Boulé, M.; Clément, A.; Polkey, M.I.; Lofaso, F.; Fauroux, B. Respiratory Muscle Testing: A valuable tool for children with neuromuscular disorders. Am. J. Respir. Crit. Care Med. 2006, 174, 67–74. [Google Scholar] [CrossRef] [PubMed]
  36. Humbertclaude, V.; Hamroun, D.; Bezzou, K.; Bérard, C.; Boespflug-Tanguy, O.; Bommelaer, C.; Campana-Salort, E.; Cances, C.; Chabrol, B.; Commare, M.-C.; et al. Motor and respiratory heterogeneity in Duchenne patients: Implication for clinical trials. Eur. J. Paediatr. Neurol. 2012, 16, 149–160. [Google Scholar] [CrossRef] [PubMed]
  37. Wasilewska, E.; Sobierajska-Rek, A.; Małgorzewicz, S.; Soliński, M.; Jassem, E. Benefits of Telemonitoring of Pulmonary Function—3-Month Follow-Up of Home Electronic Spirometry in Patients with Duchenne Muscular Dystrophy. J. Clin. Med. 2022, 11, 856. [Google Scholar] [CrossRef]
  38. Wasilewska, E.; Sobierajska-Rek, A.; Małgorzewicz, S.; Soliński, M.; Szalewska, D.; Jassem, E. Is It Possible to Have Home E-Monitoring of Pulmonary Function in Our Patients with Duchenne Muscular Dystrophy in the COVID-19 Pandemic?—A One Center Pilot Study. Int. J. Environ. Res. Public Health 2021, 18, 8967. [Google Scholar] [CrossRef]
  39. Sobierajska-Rek, A.; Mański, Ł.; Jabłońska-Brudło, J.; Śledzińska, K.; Wasilewska, E.; Szalewska, D. Respiratory Telerehabilitation of Boys and Young Men with Duchenne Muscular Dystrophy in the COVID-19 Pandemic. Int. J. Environ. Res. Public Health 2021, 18, 6179. [Google Scholar] [CrossRef]
  40. McDonald, C.M.; Gordish-Dressman, H.; Henricson, E.K.; Duong, T.; Joyce, N.C.; Jhawar, S.; Leinonen, M.; Hsu, F.; Connolly, A.M.; Cnaan, A.; et al. Longitudinal pulmonary function testing outcome measures in Duchenne muscular dystrophy: Long-term natural history with and without glucocorticoids. Neuromuscul. Disord. 2018, 28, 897–909. [Google Scholar] [CrossRef] [Green Version]
  41. Finder, J.; Mayer, O.H.; Sheehan, D.; Sawnani, H.; Abresch, R.T.; Benditt, J.; Birnkrant, D.; Duong, T.; Henricson, E.; Kinnett, K.; et al. Pulmonary Endpoints in Duchenne Muscular Dystrophy. A Workshop Summary. Am. J. Respir. Crit. Care Med. 2017, 196, 512–519. [Google Scholar] [CrossRef] [PubMed]
  42. Khirani, S.; Ramirez, A.; Aubertin, G.; Boulé, M.; Chemouny, C.; Forin, V.; Fauroux, B. Respiratory muscle decline in duchenne muscular dystrophy. Pediatr. Pulmonol. 2013, 49, 473–481. [Google Scholar] [CrossRef] [PubMed]
  43. Singh, V.; Jani, H.; John, V.; Singh, P.; Joseley, T. Effects of upper body resistance training on pulmonary functions in sedentary male smokers. Lung India 2011, 28, 169–173. [Google Scholar] [CrossRef] [PubMed]
  44. Arikan, H.; Calik-Kutukcu, E.; Vardar-Yagli, N.; Saglam, M.; Oksuz, C.; Inal-Ince, D.; Duger, T.; Savci, S.; Kayihan, H.; Coplu, L. Effect of upper extremity training on respiratory muscle strength, activities of daily living and fatigue perception in patients with chronic obstructive pulmonary disease. Eur. Respir. J. 2014, 44 (Suppl. 58), P1290. Available online: https://erj.ersjournals.com/content/44/Suppl_58/P1290 (accessed on 1 September 2022).
Ijerph 19 15675 g001 550
Figure 1. Differences in muscle strength and function of the respiratory system (left) and upper limbs (right) between ambulatory vs. non-ambulatory participants. Muscle strength (MIP, MEP, HGS) decreased in both ambulatory and non-ambulatory patients, while function indicators (FVC, FEV1, PUL) decreased only in non-ambulatory patients. %pv—%predicted value; FEV1—forced expiratory volume in 1 s; FVC—forced vital capacity; MIP—maximal inspiratory pressure; MEP—maximal expiratory pressure; PUL—performance of upper limb; HGS—hand grip strength.
Figure 1. Differences in muscle strength and function of the respiratory system (left) and upper limbs (right) between ambulatory vs. non-ambulatory participants. Muscle strength (MIP, MEP, HGS) decreased in both ambulatory and non-ambulatory patients, while function indicators (FVC, FEV1, PUL) decreased only in non-ambulatory patients. %pv—%predicted value; FEV1—forced expiratory volume in 1 s; FVC—forced vital capacity; MIP—maximal inspiratory pressure; MEP—maximal expiratory pressure; PUL—performance of upper limb; HGS—hand grip strength.
Ijerph 19 15675 g001
Table
Table 1. Patient characteristics and anthropometric data.
Table 1. Patient characteristics and anthropometric data.
All
n = 53		Ambulant
n = 28		Non-Ambulant
n = 25
Mean; SD/Median; IQR
Age (years)11.41; SD 3.709.17; SD 2.8513.92; SD 2.87
Height (cm)141.55; SD 19.09130.16; SD 12.81154.32; SD 13.86
Body weight (kg)44.25; SD 19.2434.44; SD 12.8155.24; SD 19.48
BMI21.17; SD 5.4019.68; SD 4.1522.84; SD 6.19
BMI z-score0.55; SD 1.820.71; SD 1.070.38; SD 2.41
Age at the loss of ambulation (years)10.41; 2.06-10.41; 2.06
Mutation
Deletion34 (64.2)15 (53.6)19 (76.0)
Duplication8 (15.1)5 (17.8)3 (12.0)
Point mutation5 (9.4)4 (14.3)1 (4.0)
Nonsense mutation4 (7.5)3 (10.7)1(4.0)
No detected mutation2 (3.8)1 (3.6)1 (4.0)
Steroid therapy (ST)39 (%)23 (%)16 (%)
Encorton (prednisone) nb(%)
Age at ST onset (year)
Daily dose (mg)
Calcort (deflazacort) nb(%)
Age at ST onset (year)
Daily dose (mg)		16 (41.0)
5.12, SD 1.08
24.37, SD 7.50
23 (58.9)
6.13, SD 2.37
15.80, SD 2.88		10 (43.4)
5.10; SD 1.28
11.2; SD 3.64
13 (56.6)
5.15; SD 2.44
14.07; SD 2.25		6 (37.5)
5.2; SD 1.48
12.42; SD4.79
10 (62.5)
7.4; SD 1.64
13.50; SD 6.04
BMI—body mass index.
Table
Table 2. The values of respiratory muscle strength and spirometry.
Table 2. The values of respiratory muscle strength and spirometry.
Pulmonary Function Tests
All
n = 53
Mean ± SD		Ambulant
n = 28
Mean ± SD		Non-Ambulant
n = 25
Mean ± SD		p-Value
Ambulant vs. Non-Ambulant
Respiratory muscle strength (cm H2O)
MIP
%pv		41.05 ±19.51
48.11 ± 27.38		45.57 ± 16.16
60.23 ± 24.10		36.00 ± 21.91
34.55 ± 24.65		0.127
<0.001 *
MEP
%pv		40.05 ± 15.99
38.11 ± 22.77		44.67 ± 14.11
49.84 ± 22.23		34.88 ± 16.65
24.97 ± 15.06		0.024 *
<0.001 *
Spirometry (Liters)
FVC
%pv		1.62 ± 0.54
77.32 ± 25.74		1.78 ±0.59
91.46 ± 14.01		1.61 ± 0.61
61.48 ± 26.84		0.209
0.001 *
FEV1
%pv		1.81 ± 0.67
83.54 ± 28.39		1.83 ± 0.76
100.20 ± 16.60		1.63 ± 0.47
64.88 ± 27.38		0.204
0.013 *
FEV1—forced expiratory volume in 1 s; FVC—forced vital capacity; MIP—maximal inspiratory pressure; MEP—maximal expiratory pressure; * p < 0.05.
Table
Table 3. The values of upper limb assessment.
Table 3. The values of upper limb assessment.
Upper Limb
All
n = 53
Mean ± SD		Ambulant
n = 28
Mean ± SD		Non-Ambulant
n = 25
Mean ± SD		p-Value
Ambulant
vs. Non-Ambulant
PUL %pv
[score]		75.64 ± 27.86
31.37 ± 11.93		92.85 ± 9.76
39.00 ± 4.10		54.38 ± 28.77
22.84 1 ± 2.08		<0.001
<0.001
HGS %pv
[kg]		33.28 ± 18.72
5.78 ± 3.31		43.35 ± 14.20
6.22 ± 2.53		21.52 ± 16.5
5.27 ± 4.04		<0.001
0.30
PUL—performance of upper limb; HGS—hand grip strength; kg—kilogram; pv—predicted value.
Table
Table 4. Correlations between upper limb muscle function and respiratory parameters (%pv) (Spearman correlation test).
Table 4. Correlations between upper limb muscle function and respiratory parameters (%pv) (Spearman correlation test).
All
n = 53
R		p-ValueAmbulant
n = 28
R		p-ValueNon-Ambulant
n = 25
R		p-Value
Respiratory (%pv)Upper Limb (%pv)
Hand grip strength
MIP0.61<0.001 *0.510.004 *0.420.039 *
MEP0.72<0.001 *0.520.004 *0.74<0.001 *
FVC0.77<0.001 *0.470.001 *0.81<0.001 *
FEV10.79<0.001 *0.530.003 *0.82<0.001 *
Performance of Upper Limb
MIP0.56<0.001 *0.290.1330.430.028 *
MEP0.69<0.001 *0.270.1550.67<0.001*
FVC0.77<0.001 *0.410.028 *0.84<0.001 *
FEV10.77<0.001 *0.430.021 *0.83<0.001 *
FEV1—forced expiratory volume in 1 s; FVC—forced vital capacity, MIP—maximal inspiratory pressure; MEP—maximal expiratory pressure; PUL—performance of upper limb; pv—predicted value; * p < 0.05.
Table
Table 5. Potential variables associated with hand grip strength (the univariable regression analysis).
Table 5. Potential variables associated with hand grip strength (the univariable regression analysis).
R2 = 0.739
b *p-Value
PUL1.1400.000 *
FVC0.64100.000 *
Age0.4480.005 *
Ambulation−0.2020.076
Height0.2330.197
Weight−0.0020.986
BMI z-score0.1770.281
PUL—performance of upper limb; FVC—forced expiratory volume; BMI—body mass index; * p < 0.05.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Sobierajska-Rek, A.; Wasilewska, E.; Śledzińska, K.; Jabłońska-Brudło, J.; Małgorzewicz, S.; Wasilewski, A.; Szalewska, D. The Association between the Respiratory System and Upper Limb Strength in Males with Duchenne Muscular Dystrophy: A New Field for Intervention? Int. J. Environ. Res. Public Health 2022, 19, 15675. https://doi.org/10.3390/ijerph192315675

AMA Style

Sobierajska-Rek A, Wasilewska E, Śledzińska K, Jabłońska-Brudło J, Małgorzewicz S, Wasilewski A, Szalewska D. The Association between the Respiratory System and Upper Limb Strength in Males with Duchenne Muscular Dystrophy: A New Field for Intervention? International Journal of Environmental Research and Public Health. 2022; 19(23):15675. https://doi.org/10.3390/ijerph192315675

Chicago/Turabian Style

Sobierajska-Rek, Agnieszka, Eliza Wasilewska, Karolina Śledzińska, Joanna Jabłońska-Brudło, Sylwia Małgorzewicz, Andrzej Wasilewski, and Dominika Szalewska. 2022. "The Association between the Respiratory System and Upper Limb Strength in Males with Duchenne Muscular Dystrophy: A New Field for Intervention?" International Journal of Environmental Research and Public Health 19, no. 23: 15675. https://doi.org/10.3390/ijerph192315675

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop