Metabolites of the Nitric Oxide (NO) Pathway Are Altered and Indicative of Reduced NO and Arginine Bioavailability in Patients with Cardiometabolic Diseases Complicated with Chronic Wounds of Lower Extremities: Targeted Metabolomics Approach (LC-MS/MS)

Krzystek-Korpacka, Małgorzata; Wiśniewski, Jerzy; Fleszar, Mariusz G.; Bednarz-Misa, Iwona; Bronowicka-Szydełko, Agnieszka; Gacka, Małgorzata; Masłowski, Leszek; Kędzior, Krzysztof; Witkiewicz, Wojciech; Gamian, Andrzej

doi:https://doi.org/10.1155/2019/5965721

Oxidative Medicine and Cellular Longevity

On this page

Abstract Introduction Materials and Methods Results Discussion Conclusions Data Availability Conflicts of Interest Authors’ Contributions Acknowledgments Supplementary Materials References Copyright Related Articles

Special Issue

Novel Approaches for Diagnosing and Management of Cardiovascular Disorders Mediated by Oxidative Stress

View this Special Issue

Research Article | Open Access

Volume 2019 | Article ID 5965721 | https://doi.org/10.1155/2019/5965721

Metabolites of the Nitric Oxide (NO) Pathway Are Altered and Indicative of Reduced NO and Arginine Bioavailability in Patients with Cardiometabolic Diseases Complicated with Chronic Wounds of Lower Extremities: Targeted Metabolomics Approach (LC-MS/MS)

Małgorzata Krzystek-Korpacka,¹Jerzy Wiśniewski,¹Mariusz G. Fleszar,^1,2Iwona Bednarz-Misa,¹Agnieszka Bronowicka-Szydełko,¹Małgorzata Gacka,³Leszek Masłowski,⁴Krzysztof Kędzior,¹Wojciech Witkiewicz,^5,6and Andrzej Gamian¹

Guest Editor: Aneta Radziwon-Balicka

Received03 May 2019

Accepted26 Jun 2019

Published14 Jul 2019

Abstract

Objective. The status of metabolites of the nitric oxide (NO) pathway in patients with chronic wounds in the course of cardiometabolic diseases is largely unknown. Yet arginine supplementation and citrulline supplementation as novel therapeutic modalities aimed at increasing NO are tested. Material and Methods. Targeted metabolomics approach (LC-MS/MS) was applied to determine the concentrations of L-arginine, L-citrulline, asymmetric and symmetric dimethylarginines (ADMA and SDMA), and arginine/ADMA and arginine/SDMA ratios as surrogate markers of NO and arginine availability in ulnar and femoral veins, representing systemic and local levels of metabolites, in patients with chronic wounds in the course of cardiometabolic diseases () as compared to patients without chronic wounds but with similar cardiometabolic burden () and healthy individuals (). Results. Patients with chronic wounds had significantly lower systemic L-citrulline and higher ADMA and SDMA concentrations and lower L-arginine/ADMA and L-arginine/SDMA as compared to healthy controls. The presence of chronic wounds in patients with cardiometabolic diseases was associated with decreased L-arginine but with increased L-citrulline, ADMA, and SDMA concentrations and decreased L-arginine/ADMA and L-arginine/SDMA. Serum obtained from the ulnar and femoral veins of patients with chronic wounds differed by L-arginine concentrations and L-arginine/SDMA ratio, both lower in the femoral vein. Wound etiology affected L-citrulline and SDMA concentrations, lower and higher, respectively, in patients with venous stasis, and the L-arginine/SDMA ratio—lower in venous stasis. The wound type affected L-arginine/ADMA and citrulline—lower in patients with ulcerations or gangrene. IL-6 was an independent predictor of L-arginine/ADMA, VEGF-A of ADMA, G-CSF of L-arginine/SDMA, and GM-CSF of L-citrulline and SDMA. Conclusion. Chronic wounds in the course of cardiometabolic diseases are associated with reduced NO and arginine availability due to ADMA and SDMA accumulation rather than arginine deficiency, not supporting its supplementation. Wound character seems to affect NO bioavailability and wound etiology—arginine bioavailability. Arginine concentration and its availability are more markedly reduced at the local level than the systemic level.

1. Introduction

Sufficient synthesis and bioavailability of nitric oxide (NO)—a free radical and a key vasodilator—are crucial for proper functioning of the vascular endothelium. Consequently, NO deficiency is a prerequisite for and a hallmark of endothelial dysfunction, a pathology preceding the development of cardiovascular diseases (CVD) [1]. CVD and their main risk factors, such as obesity, hypertension, and type 2 diabetes mellitus (T2DM), are, in turn, among key factors negatively affecting proper wound healing [2]. Nonhealing wounds constitute a serious problem for affected people and a growing burden for public health care [3]. Currently, they affect 4.5 million people in the United States alone [4] but the incidence of chronic wounds is likely to increase along with estimated rise in the incidence of CVD, obesity, and T2DM [5–8]. The overall prevalence of peripheral artery disease (PAD) in Europe is estimated to be 5.3% but differs by country [9]. The disturbed blood flow and blood vessel damage accompanying CVD and specifically PAD may result in ulcerations or gangrene located in the lower extremities [9–11]. NO-releasing wound dressings as well as diet supplementation with L-arginine, a NO substrate, are currently being evaluated as novel modalities in the treatment of chronic wounds [12, 13].

Successful healing requires spacial and temporal cooperation of a myriad of players, mediating three key phases of the process: inflammatory, proliferative, and remodelling [5]. Nonhealing wounds are believed to be locked in the inflammatory phase [14]. While most mediators are proteins, other molecules, such as NO, are recently gaining attention as potentially relevant for all phases of the healing [15–19]. The importance of NO has been demonstrated by the delayed healing of animals with genetically impaired NO synthesis [20, 21]. Moreover, it has been shown that NO therapy is effective in healing ischemic [22] and diabetic ulcers [23] in experimental animals by inducing reepithelization, angiogenesis, and collagen synthesis.

NO is synthesized by nitric oxide synthases (NOS) from L-arginine, and L-citrulline is the other reaction product. There are three isoforms of the enzyme: constitutively expressed endothelial (eNOS; NOS1) and neuronal (nNOS; NOS3) isoforms and the inducible isoform (iNOS; NOS2) [24]. The activity of NOS enzymes is regulated by methylated derivatives of arginine, of which asymmetric dimethylarginine (ADMA) is believed to be a strong and symmetric dimethylarginine (SDMA) a weak enzyme inhibitor. Both ADMA and SDMA compete with L-arginine for its transporters, and therefore, their accumulation decreases NO production by diminishing L-arginine availability for the NOS enzymes. The ADMA and SDMA pool is regulated at the level of their synthesis, conducted by the protein arginine methyltransferases (PRMTs), and degradation. While ADMA is mostly catabolized to L-citrulline and dimethylamine (DMA), by dimethylarginine dimethylaminohydrolases (DDAHs), SDMA is preferentially excreted with urine. L-Citrulline may be used in the arginine-citrulline cycle to satisfy the body demand for L-arginine [24].

The gaseous nature, high diffusion capacity, and short half-life make NO the ideal signalling molecule but cause its quantification to be a challenge. Therefore, relatively more stable products of NO oxidation, nitrites and nitrates, are measured instead of NO. Nitrate has even been proposed as a “wound healing biomarker and surrogate end point” for treatment of diabetic foot ulcers [18]. Another approach for the assessment of NO and its bioavailability is the evaluation of intermediates in the NO synthesis pathway and inhibitors of NOS enzymes. Of those, the measurement of L-arginine and/or ADMA is the most popular.

Despite the relevance of NO for wound healing, the status of its pathway metabolites and surrogate markers is largely unknown. Recently, an elevation in serum ADMA [25] has been reported in patients with chronic wounds while our own preliminary research showed a decrease in serum L-arginine [26]. However, there seem to be a paucity of data on SDMA and citrulline or regarding the possible association between NO metabolites and wound etiology and the type or their interplay with inflammatory and immune mediators. Therefore, this study was designed to simultaneously evaluate a wider panel of L-arginine/NO pathway metabolites using targeted metabolomics approach and a novel assay recently developed by our group [27]. We measured L-arginine, L-citrulline (referred to hereafter simply as arginine and citrulline), ADMA, and SDMA to determine their status and clinical relevance in patients with chronic wounds of various etiologies and types, at systemic and local levels.

2. Materials and Methods

2.1. Ethical Approval

The study protocol was approved by the Medical Ethics Committees of Wroclaw Medical University (#KB-384/2012) from April 12, 2012, and the study was conducted in accordance with the Helsinki Declaration of 1975, as revised in 1983, and an informed consent has been obtained from all patients.

2.2. Patients

The study population consisted of 202 individuals: 114 patients with cardiovascular diseases and/or diabetes, of whom 59 had chronic wounds of lower extremities, and 88 healthy individuals. Patients were recruited from among patients of the Dept. of Angiology of the Regional Specialist Hospital and the Dept. of Angiology, Hypertension and Diabetes of the Wroclaw Medical University. Concerning patients with nonhealing wounds, only those with wounds in the course of vascular disease and diabetes were included while others, with wounds due to autoimmune diseases, malignancy, infections, or drugs, were not enrolled. Wound etiology was determined by the evaluation of wound characteristics (location and an appearance of the wound, its borders and those of the surrounding skin, pain, and the presence of bleeding on manipulation) in addition to the patient’s history and clinical assessment, which was based on the ankle-brachial pressure index, ultrasound, angiography, and computer tomography. The wound etiology was as follows: venous stasis (), ischemic (arterial) (), and neurotrophic (). Patients’ wounds were mechanically cleaned of necrotic tissue and excess wound exudate, photographs were taken, and wound material was collected for bacteriological examination. Subsequently, wounds were washed with antiseptic octenidine dihydrochloride and dressed using a sterile gauze. None of the patients used arginine supplements.

The control group consisted of healthy volunteers recruited from hospital staff and blood donors from Lower Silesian Center of Blood Donation and Therapy, Wroclaw, Poland (recruited on the basis of standard eligibility criteria for blood donation with an and an insignificant medical history as additional inclusion criteria for the current study). Table 1 presents detailed characteristics of the study population, and the categorization into examined groups is depicted in Figure 1.

In a subgroup of patients (), blood was sampled from the ulnar and femoral veins in order to compare systemic metabolite concentrations with those more local and closer to the wound.

2.3. Analytical Methods

Blood (7.5 mL), after an overnight fasting, was drawn into serum separator tubes from ulnar veins and, additionally, from femoral veins. Blood was clotted for 30 min and subsequently centrifuged (15 min, 10°C, 720×g). Collected serum was aliquoted and kept frozen at -80° until examination.

2.3.1. Materials

LC-MS-grade acetonitrile, water, and methanol were purchased from Merck Millipore (Warsaw, Poland). L-Arginine, SDMA, ADMA, L-citrulline, sodium tetraborate, benzoyl chloride (BCl), and HPLC-grade formic acid (FA) were obtained from Sigma-Aldrich (Poznan, Poland). Isotope-labeled asymmetric dimethylarginine (2,3,3,4,4,5,5-D7-ADMA, 98%) and L-arginine:HCl (D7-arginine, 98%) were acquired from Cambridge Isotope Laboratories (MA, USA). Leucine-enkephalin was purchased from Waters (Warsaw, Poland).

2.3.2. Quantitative Analysis of Metabolites Involved in NO Synthesis

Serum concentrations of metabolites involved in NO synthesis were measured by stable isotope dilution liquid chromatography tandem mass spectrometry using a Xevo G2 quadrupole-TOF instrument (Waters, Milford, MA, USA) as described in detail by Fleszar et al. [27]. Briefly, aliquots of 100 μL of sera or the calibration sample, 10 μL of internal standard solution in water (100 μM D7-arginine and 20 μM D7-ADMA), and 50 μL of borate buffer (0.025 M Na₂B₄O₇·10H₂O, 1.77 mM NaOH, ) were transferred into polypropylene microtubes and vortexed (1 min, 1100 rpm, 25°C). Then, 400 μL of acetonitrile and 10 μL of 10% BCl in acetonitrile were added and vortexed (5 min, 1100 rpm, 25°C). After derivatization, samples were centrifuged (7 min, 4°C, ) and 100 μL of supernatants was transferred into a chromatographic glass vial with 300 μL of water for LC-MS analysis.

2.3.3. LC-ESI-MS Analysis

The LC analysis was carried out on a nanoACQUITY UPLC System equipped with an ACQUITY HSS T3 column (, 1.75 μm) with a 0.22 μm membrane inline filter (Waters). The total run time of the method was 10 min with a flow rate of 80 μL/min. Mobile phase A consisted of 0.1% FA in water, while mobile phase B consisted of 0.1% FA in methanol. For ADMA and SDMA isomer separation, the following gradient was applied: 11% B for 0–1 min, 11%–13% B for 1–2 min, 13%–60% B for 2–5 min, 60%–90% B for 5–5.5 min, 90% B for 5.5–6 min, and 90%–11% B for 6–6.05 min. The sample injection volume was 2 μL.

Mass spectra for the compounds were acquired in a Xevo G2 Q-TOF mass spectrometer (Waters) in positive ion mode electrospray ionization (ESI). The MS operating conditions were as follows: capillary voltage, 3000 V; cone voltage, 40 V; source temperature, 120°C; cone gas flow, 85 L/hour; desolvation temperature, 350°C; and desolvation gas flow, 800 L/hour. Data acquisition was carried on MassLynx Software (Waters) using the following ions: 279.1457 , 286.1897 , 307.1770 , 314.2076 , and 280.1136 for L-arginine, D7-arginine, ADMA and SDMA, D7-ADMA, and L-citrulline, respectively.

As previously described [27], the method is characterized by intra- and interassay coefficients of variation of 1.6% and 3.3% for arginine, 3.2% and 3.1% for citrulline, 7.5% and 9.4% for ADMA, and 6.4% and 7.1% for SDMA determination.

2.4. Statistical Analysis

Data were tested for normality of distribution using the Kolmogorov-Smirnoff test and for homogeneity of variances using Levene’s test and presented as means or medians with 95% confidence interval (CI) around them. Between-group differences in means or medians were tested using a -test for independent samples with Welch correction if appropriate or with the Mann-Whitney test (two-group comparisons) and with a one-way ANOVA with the Tukey-Kramer post hoc test or with the Kruskal-Wallis test with the Conover post hoc test (multigroup comparisons). Log-transformation was used if necessary to obtain normality of distribution and/or homogeneity of variances. Additionally, a -test for paired samples was used to analyze differences in metabolite concentrations between femoral and ulnar veins. Frequency analysis was conducted using the chi-squared test. Univariate correlations were examined using Pearson tests. Multivariate linear regression was conducted to discern the independent predictor of NO-associated metabolites. Regression models were built with a stepwise method using the following criteria: enter variable if and remove variable if . All calculated probabilities were two-tailed, and values ≤ 0.05 were considered statistically significant. The analyses were performed using MedCalc Statistical Software version 18.11.6 (MedCalc Software bvba, Ostend, Belgium; https://www.medcalc.org; 2019).

3. Results

Both patients’ cohorts were well matched with respect to sex distribution, age, and concentrations of biochemical indices, indicative of similar disease burden. There were, however, significant differences in HDL cholesterol and CRP lower and higher, respectively, in patients with chronic wounds (Table 1). There were no sex-related differences in any intermediate in the arginine/NO pathway among patients with chronic wounds or healthy controls. However, in a group of patients with cardiometabolic diseases without wounds, males had higher citrulline, ADMA, and SDMA concentrations and lower Arg/ADMA and Arg/SDMA ratios (for details, see Suppl. Tab. 1).

3.1. Intermediates in the Arginine/NO Pathway in Patients with Cardiometabolic Diseases with and without Chronic Wounds

As compared to healthy individuals, patients with cardiometabolic diseases without chronic wounds had significantly higher arginine (Figure 2(a)) but lower citrulline (Figure 2(b)) concentrations and comparable ADMA and SDMA concentrations (Figures 2(c) and 2(d)) and Arg/ADMA and Arg/SDMA ratios (Figures 2(e) and 2(f)). As compared to healthy individuals, patients with cardiometabolic diseases with chronic wounds had significantly lower citrulline (Figure 2(b)) and higher ADMA and SDMA concentrations (Figures 2(c) and 2(d)) and lower Arg/ADMA and Arg/SDMA ratios (Figures 2(e) and 2(f)). The presence of chronic wounds in patients with cardiometabolic diseases was associated with decreased arginine (Figure 2(a)) but with increased citrulline (Figure 2(b)), ADMA, and SDMA concentrations (Figures 2(c) and 2(d)) and decreased Arg/ADMA and Arg/SDMA ratios (Figures 2(e) and 2(f)).

(a)

(b)

(c)

(d)

(e)

(f)

Figure 2

Intermediates in the arginine/NO pathway in chronic wounds: (a) arginine, (b) citrulline, (c) ADMA, (d) SDMA, (e) arginine-to-ADMA ratio (Arg/ADMA), and (f) arginine-to-SDMA ratio (Arg/SDMA). Data are presented as medians with 95% confidence intervals and analyzed using the Kruskal-Wallis test. CM+W: patients with cardiometabolic diseases and chronic wounds; CM: patients with cardiometabolic diseases without chronic wounds; HC: healthy controls. Numbers below the dot plots represent the mean value within a group. Letters above the dot plots indicate groups from which a given group mean differs significantly: A: significantly different from CM+V; B: significantly different from CM; C: significantly different from HC.

3.2. Impact of Wound Etiology on Intermediates in the Arginine/NO Pathway

Arginine (Figure 3(a)) and ADMA (Figure 3(c)) did not differ with respect to wound etiology, but citrulline concentrations (Figure 2(b)) were significantly higher in patients with venous stasis wounds than in those with neurotrophic wounds. SDMA concentrations (Figure 3(d)) were significantly higher in patients with venous stasis wounds as compared to both neurotrophic and ischemic wounds. The Arg/SDMA ratio (Figure 2(e)) was significantly lower in patients with venous stasis wounds as compared to neurotrophic wounds, and the Arg/ADMA ratio displayed a similar tendency (Figure 3(f)).

(a)

(b)

(c)

(d)

(e)

(f)

Figure 3

Wound etiology and intermediates in the arginine/NO pathway: (a) arginine, (b) citrulline, (c) ADMA, (d) SDMA, (e) arginine-to-ADMA ratio (Arg/ADMA), and (f) arginine-to-SDMA ratio (Arg/SDMA). Data are presented as means with 95% confidence intervals and analyzed using one-way ANOVA. ISCH: ischemic etiology; NEURO: neurotrophic etiology; VEN: venous stasis etiology. Numbers below the dot plots represent the mean value within a group. Letters above/below the dot plots indicate groups from which a given group mean differs significantly: A: significantly different from ISCH; B: significantly different from NEURO; C: significantly different from VEN.

3.3. Intermediates in the Arginine/NO Pathway and Wound Characteristics

The concentrations of intermediates of the arginine/NO pathway were compared between patients with and without gangrene and between two of its types (dry and wet) as well as between patients with and without phlegmon or with and without ulceration.

Concerning gangrene, only citrulline concentrations differed significantly and were lower in patients with gangrene (Figure 4(a)). There were no differences in other intermediates in the arginine/NO pathway with respect to the presence or absence of gangrene ( for arginine, for ADMA, for SDMA, for Arg/ADMA, and for Arg/SDMA) (for details, see Suppl. Fig. 1). Also, the intermediates did not differ with respect to the gangrene type ( for arginine, for citrulline, for ADMA, for SDMA, for Arg/ADMA, and for Arg/SDMA) (for details, see Suppl. Fig. 2).

(a)

(b)

(c)

(d)

Concerning phlegmon, there were no differences as well ( for arginine, for citrulline, for SDMA, for Arg/ADMA, and for Arg/SDMA) (for details, see Suppl. Fig. 3), although ADMA tended to be lower in patients with phlegmon (Figure 4(b)).

Concerning ulceration, ADMA () only tended to be higher in patients with ulcers and arginine () tended to be lower (for details, see Suppl. Fig. 4) but their ratio (Arg/ADMA) was significantly lower in patients with ulceration as compared to those without (Figure 4(c)). Citrulline tended to be elevated in patients with ulceration (Figure 4(d); 41.9 μM (35.9-47.9) vs. 27.4 μM (18.8-35.9), ), and SDMA () and Arg/SDMA () did not show significant differences (for details, see Suppl. Fig. 4).

3.4. Intermediates in the Arginine/NO Pathway and Blood Source

For a subgroup of seven patients, blood was sampled from both the ulnar and femoral veins. The comparison of metabolite concentrations with respect to blood source did not show statistically significant differences for ADMA (), SDMA (), Arg/ADMA (), and citrulline () (for details, see Suppl. Fig. 5). However, concentrations of arginine (Figure 5(a)) as well as Arg/SDMA (Figure 5(b)) were significantly lower in blood sampled from the femoral vein than the ulnar vein.

(a)

(b)

3.5. Correlation Pattern between Intermediates in the Arginine/NO Pathway and Cytokines, Chemokines, and Growth Factors

The correlation patterns between intermediates in the arginine/NO pathway and key cytokines, chemokines, and growth factors implicated in the pathogenesis of wound healing have been examined (Table 2). There was no significant correlation between arginine and any of evaluated mediators. Citrulline correlated negatively with G-CSF, GM-CSF, IL-4, and IL-8. Of these, GM-CSF was an independent predictor of citrulline concentrations, explaining 15% in its variability (, ; ). ADMA correlated negatively with GM-CSF, TNFα, and VEGF-A. Of these, VEGF-A was an independent predictor of ADMA concentrations, explaining 13% in its variability (, ; ). SDMA correlated negatively with G-CSF, GM-CSF, IL-1β, IL-4, IL-8, and TNFα. Of these, GM-CSF was an independent predictor of SDMA concentrations, explaining 17% in its variability (, ; ). Arg/ADMA correlated with G-CSF, GM-CSF, IL-1β, IL-4, IL-6, VEGF-A, and TNFα, of which IL-6 was an independent predictor, explaining 28% of variability in its value (, ; ). Arg/SDMA correlated with G-CSF, GM-CSF, IL-1β, IL-4, and TNFα, of which G-CSF was an independent predictor of the Arg/SDMA ratio, explaining 17% in its variability (, ; ).

3.6. Interplay between Intermediates in the Arginine/NO Pathway

The pattern of interrelationships of intermediates in the arginine/NO pathway in patients with cardiometabolic diseases with and without chronic wounds has been examined. Arginine did not correlate with any other metabolite in patients with cardiometabolic diseases without chronic wounds but became directly correlated with the ADMA and SDMA levels in patients with chronic wounds. Citrulline was positively correlated with ADMA and SDMA in both patient groups, but the associations were weaker in patients with chronic wounds. ADMA correlated positively with SDMA, and the association was weaker in patients with chronic wounds (Table 3).

4. Discussion

Detrimental effects of diminished NO bioavailability on cardiovascular health and wound healing are well documented and have led to an outburst of novel treatment strategies aiming at its increase. Intuitively, an elevation in arginine, a direct substrate for NOS enzymes, ought to increase NO availability. Indeed, in addition to wound dressings containing NO precursors [12], the effect of arginine supplementation on a diet has been found beneficial for facilitating the healing of pressure ulcers [13]. However, our results do not confirm that systemic arginine is diminished in patients with chronic wounds to warrant its supplementation. Rather unexpectedly, they were increased in patients with cardiometabolic burden but without chronic wounds. This observation, however, agrees well with previously reported increased risk for CVD in patients with elevated arginine, independent from traditional risk factors [28]. Still, we also demonstrated that arginine concentrations in the blood from the femoral vein, draining the wounded leg, are significantly lower implying that arginine might indeed be depleted locally. Moreover, also the Arg/SDMA ratio was markedly reduced in the femoral vein than in the ulnar vein, indicative of more severe local arginine depletion.

Nonetheless, it has been suggested that an elevation in systemic or local arginine may not directly translate into increased NO concentrations, a phenomenon explained by impaired arginine availability for NO synthesis by NOS enzymes. At least several mechanisms are in operation, that is, concomitant upregulation of NOS inhibitors, NOS uncoupling due to oxidative stress and tetrahydrobiopterin deficiency, and arginine utilization by an upregulated arginase [29]. Indeed, corroborating the first mechanism, we showed that patients with chronic wounds had increased both ADMA and SDMA concentrations as compared to healthy individuals and patients with cardiometabolic diseases without chronic wounds. Elevated ADMA increases cardiovascular risk [30] and is associated with every disease within the CVD spectrum as well as with CVD risk factors [31]. Mechanistically, ADMA interferes with NO synthesis by inhibiting NOS enzymes and by reducing arginine availability by competing for its membrane transporters. Additionally, it impairs NO signalling by inhibiting eNOS phosphorylation [32]. Also, El-Mesallamy et al. [25] demonstrated that ADMA was elevated in patients with leg ulcers significantly more so than in T2DM patients without neuropathy. SDMA negatively affects arginine availability by inhibiting its membrane transport as well but has not gained as much attention as ADMA as it is only a weak NOS inhibitor. There seems to be a paucity of information on SDMA in chronic wounds in the course of cardiometabolic diseases. In turn, data linking SDMA with a risk of CVD and CVD-caused mortality derived from meta-analyses are contradictory [30, 33]. However, individual studies indicate SDMA elevation to be an independent predictor of CVD-related mortality [34, 35] and to predict renal and cardiovascular outcomes in patients with chronic kidney disease [36]. Furthermore, functional studies have shown SDMA to abolish anti-inflammatory and antiatherogenic properties of HDL. Consequently, SDMA has been claimed to be a marker of HDL dysfunction [34].

We also observed that due to ADMA and SDMA accumulation, both Arg/ADMA and Arg/SDMA ratios were significantly decreased in patients with chronic wounds, indicating reduced availability of NO and arginine, respectively. Wound character seemed to have an impact on NO bioavailability since the Arg/ADMA ratio was markedly reduced in patients with ulcerations. In turn, wound etiology affected arginine bioavailability as patients with venous stasis had markedly elevated SDMA and decreased Arg/SDMA. The ADMA and SDMA pool is regulated mainly by the rates of their synthesis by type I (ADMA) and type II (SDMA) PRMTs and the rate of their degradation by DDAH enzymes (ADMA) and renal excretion [24]. Impaired renal secretion does not seem to explain the phenomenon of their accumulation in full as cardiometabolic burden, including chronic kidney disease, was similar in patients with and without chronic wounds. There is a paucity of data regarding PRMT and DDAH activity and expression in metabolic disorders and in chronic wounds. However, limited animal studies have linked PRMT overexpression with obesity, nonalcoholic fatty liver disease, and diabetic retinopathy [37, 38] and DDAH downregulation with diabetic retinopathy [38] and impaired vascular homeostasis [39]. PRMT and DDAH might be altered more strongly among patients with chronic wounds than without as they are positively (PRMTs) and negatively (DDAHs) affected by inflammatory mediators [31, 40] and, as we have previously demonstrated, chronic wounds are accompanied by systemic elevation in proinflammatory cytokines [41].

An interesting observation is the difference between SDMA, which was elevated in patients with cardiometabolic burden as compared to controls, and ADMA, which was not. It might result from differences in sensitivity of distinct PRMT enzymes. It has been shown that ADMA-yielding PRMT2 expression is inhibited by high glucose concentration, a common occurrence among our patients, which, in turn, upregulates SDMA synthesis owing to substrate scavenging by type II PRMTs [37].

A direct link between arginine and NO concentrations is further disturbed by NOS uncoupling [29]. The lack of arginine [42], high ADMA concentrations [43], inflammation and oxidative stress [44], and tetrahydrobiopterin deficiency [45] are considered main culprits of switching enzyme activity from NO synthesis to the production of superoxide anion. As such, the uncoupling of NOS leads not only to the concomitant decrease in NO availability but also to the exacerbation of oxidative stress. Furthermore, NOS enzymes compete for arginine with arginases, the enzymes converting arginine to ornithine. Correspondingly, the upregulated ARG1 expression has been reported in patients with diabetic foot and venous ulcers [46] as well as in chronic wounds in recessive dystrophic epidermolysis bullosa [47].

Data regarding citrulline association with chronic wounds in the course of cardiometabolic diseases are missing, and those on citrulline in underlying conditions seem to be contradictory. Elevated citrulline has been associated with an increased CVD risk [28] and has a negative impact on arginine bioavailability in obesity and T2DM [48]. However, it is also an effective antioxidant [49], argued to be more effective in restoring cardiometabolic health via increasing NO availability than arginine [49]. In addition to improving endothelial function via NO-associated mechanisms, citrulline supplementation in patients with vasospastic angina has been shown to reduce the concentrations of oxidized LDL thus alleviating oxidative stress [50]. Citrulline in our study was diminished in patients with cardiometabolic burden as compared to healthy individuals and strongly and positively correlated with NOS inhibitors—ADMA and SDMA. Considering that citrulline is a second reaction product and an effective arginine precursor, these findings seem to confirm reduced rates of NO synthesis among patients with cardiometabolic burden and especially among patients with gangrene. Still, citrulline was less diminished in patients with chronic wounds than those without, particularly in case of wounds of venous stasis etiology. Also, in line with its negative impact on arginine availability, it negatively and strongly correlated with the Arg/SDMA ratio. Debats et al. [51], in turn, found citrulline to be elevated exclusively in patients with infected chronic wounds but not with noninfected or acute wounds.

Inflammatory cytokines are among the initiators of endothelial dysfunction [44] and key players in sustaining inflammation in chronic wounds. Among others, they induce the expression of iNOS [16] but inhibit that of eNOS [52, 53] and contribute to ADMA accumulation [31, 40]. Recently, we have demonstrated that chronic wounds are accompanied by systemic elevation of IL-1β, IL-4, IL-6, IL-8, FGF-2, MIP-1α, PDGF-BB, and VEGF-A [41]. Also, markedly elevated CRP and reduced HDL in patients with chronic wounds compared to those with similar cardiometabolic burden are indicative of a higher grade of inflammation in the former. Among our patients, ADMA concentrations were independently and inversely associated with VEGF-A, indicative of the negative impact of ADMA accumulation and resulting diminished NO synthesis on angiogenesis in patients with chronic wounds. We also observed that the higher inflammatory response, indicated by IL-6 concentration, the lower the NO availability, indicated by the reduced Arg/ADMA ratio. We found that GM-CSF was an independent predictor for citrulline and SDMA and G-CSF for Arg/SDMA. G-CSF and GM-CSF are hematopoietic cytokines displaying immunomodulatory and antibiotic-enhancing activities with a proven beneficial effect on wound healing [54–56]. Their concentrations are reduced in patients with chronic wounds [41]. Park et al. [57] demonstrated that G-CSF exerts a protective effect on endothelial cells via stimulating eNOS expression and phosphorylation and thus enhancing NO synthesis and signalling. The close relation between G-CSF and Arg/SDMA observed here may indicate an additional mechanism, that is, increased arginine availability.

5. Conclusions

Taken together, our results demonstrate that patients with chronic wounds in the course of cardiometabolic diseases have reduced bioavailability of NO and its substrate, arginine, resulting from ADMA and SDMA accumulation rather than from arginine deficiency. Citrulline, in turn, is decreased in patients with cardiometabolic diseases in general, but the presence of chronic wounds is associated with its elevation, reflecting degree of ADMA, and SDMA accumulation and inversely related to NO and arginine bioavailability. As such, our findings do not support arginine or citrulline supplementation in patients with chronic wounds and rather suggest the need for treatment aiming at decreasing ADMA and SDMA concentrations.

Data Availability

The raw data used to support the findings of this study are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare that there is no conflict of interest regarding the publication of this paper.

Authors’ Contributions

Małgorzata Krzystek-Korpacka and Jerzy Wiśniewski contributed equally.

Acknowledgments

The research was supported by statutory funding from Wroclaw Medical University (#ST-911).

Supplementary Materials

Supplementary 1. Supplementary Table 1. Effect of sex on intermediates in the arginine/NO pathway among controls and patients with cardiometabolic burden without or with chronic wounds.

Supplementary 2. Supplementary Figure 1. The association of the gangrene presence with intermediates in the arginine/NO pathway.

Supplementary 3. Supplementary Figure 2. The association of the gangrene type with intermediates in the arginine/NO pathway.

Supplementary 4. Supplementary Figure 3. The association of the phlegmon presence with intermediates in the arginine/NO pathway.

Supplementary 5. Supplementary Figure 4. The association of ulcers with intermediates in the arginine/NO pathway.

Supplementary 6. Supplementary Figure 5. Difference in intermediates in the arginine/NO pathway between ulnar and femoral veins.

References

J. Barthelmes, M. P. Nägele, V. Ludovici, F. Ruschitzka, I. Sudano, and A. J. Flammer, “Endothelial dysfunction in cardiovascular disease and Flammer syndrome-similarities and differences,” EPMA Journal, vol. 8, no. 2, pp. 99–109, 2017.
View at: Publisher Site | Google Scholar
E. Avishai, K. Yeghiazaryan, and O. Golubnitschaja, “Impaired wound healing: facts and hypotheses for multi-professional considerations in predictive, preventive and personalised medicine,” EPMA Journal, vol. 8, no. 1, pp. 23–33, 2017.
View at: Publisher Site | Google Scholar
M. Olsson, K. Järbrink, U. Divakar et al., “The humanistic and economic burden of chronic wounds: a systematic review,” Wound Repair and Regeneration, vol. 27, no. 1, pp. 114–125, 2019.
View at: Publisher Site | Google Scholar
R. E. Jones, D. S. Foster, and M. T. Longaker, “Management of chronic wounds-2018,” JAMA, vol. 320, no. 14, pp. 1481-1482, 2018.
View at: Publisher Site | Google Scholar
G. Han and R. Ceilley, “Chronic wound healing: a review of current management and treatments,” Advances in Therapy, vol. 34, no. 3, pp. 599–610, 2017.
View at: Publisher Site | Google Scholar
C. M. Hales, M. D. Carroll, C. D. Fryar, and C. L. Ogden, ““Prevalence of obesity among adults and youth: United States, 2015–2016,” NCHS Data Brief,” no. 288, pp. 1–8, 2017, October 2017, https://www.cdc.gov/nchs/data/databriefs/db288.pdf.
View at: Google Scholar
Y. Zheng, S. H. Ley, and F. B. Hu, “Global aetiology and epidemiology of type 2 diabetes mellitus and its complications,” Nature Reviews Endocrinology, vol. 14, no. 2, pp. 88–98, 2018.
View at: Publisher Site | Google Scholar
T. R. Einarson, A. Acs, C. Ludwig, and U. H. Panton, “Prevalence of cardiovascular disease in type 2 diabetes: a systematic literature review of scientific evidence from across the world in 2007–2017,” Cardiovascular Diabetology, vol. 17, no. 1, pp. 83–101, 2018.
View at: Publisher Site | Google Scholar
D.-M. Olinic, M. Spinu, M. Olinic et al., “Epidemiology of peripheral artery disease in Europe: VAS Educational Paper,” International Angiology, vol. 37, no. 4, pp. 327–334, 2018.
View at: Publisher Site | Google Scholar
R. Rayner, K. Carville, J. Keaton, J. Prentice, and N. Santamaria, “Leg ulcers: atypical presentations and associated comorbidities,” Wound Practice and Research, vol. 17, pp. 168–185, 2017.
View at: Google Scholar
J. Green, R. Jester, R. McKinley, and A. Pooler, “The impact of chronic venous leg ulcers: a systematic review,” Journal of Wound Care, vol. 23, no. 12, pp. 601–612, 2014.
View at: Publisher Site | Google Scholar
J. Durão, N. Vale, S. Gomes, P. Gomes, C. C. Barrias, and L. Gales, “Nitric oxide release from antimicrobial peptide hydrogels for wound healing,” Biomolecules, vol. 9, no. 1, p. 4, 2019.
View at: Publisher Site | Google Scholar
J. C. L. Neyens, E. Cereda, E. P. Meijer, C. Lindholm, and J. M. G. A. Schols, “Arginine-enriched oral nutritional supplementation in the treatment of pressure ulcers: a literature review,” Wound Medicine, vol. 16, pp. 46–51, 2017.
View at: Publisher Site | Google Scholar
S. Guo and L. A. DiPietro, “Factors affecting wound healing,” Journal of Dental Research, vol. 89, no. 3, pp. 219–229, 2010.
View at: Publisher Site | Google Scholar
J. D. Luo and A. F. Chen, “Nitric oxide: a newly discovered function on wound healing,” Acta Pharmacologica Sinica, vol. 26, no. 3, pp. 259–264, 2005.
View at: Publisher Site | Google Scholar
P. Tripathi, P. Tripathi, L. Kashyap, and V. Singh, “The role of nitric oxide in inflammatory reactions,” FEMS Immunology & Medical Microbiology, vol. 51, no. 3, pp. 443–452, 2007.
View at: Publisher Site | Google Scholar
C. Napoli, G. Paolisso, A. Casamassimi et al., “Effects of nitric oxide on cell proliferation: novel insights,” Journal of the American College of Cardiology, vol. 62, no. 2, pp. 89–95, 2013.
View at: Publisher Site | Google Scholar
J. V. Boykin Jr., “Wound nitric oxide bioactivity,” Journal of Wound, Ostomy and Continence Nursing, vol. 37, no. 1, pp. 25–32, 2010.
View at: Publisher Site | Google Scholar
W. T. Weng, C. S. Wu, F. S. Wang et al., “α-Melanocyte-stimulating hormone attenuates neovascularization by inducing nitric oxide deficiency via MC-Rs/PKA/NF-κB signaling,” International Journal of Molecular Sciences, vol. 19, no. 12, p. 3823, 2018.
View at: Publisher Site | Google Scholar
K. Yamasaki, H. D. Edington, C. McClosky et al., “Reversal of impaired wound repair in iNOS-deficient mice by topical adenoviral-mediated iNOS gene transfer,” Journal of Clinical Investigation, vol. 101, no. 5, pp. 967–971, 1998.
View at: Publisher Site | Google Scholar
P. C. Lee, A. N. Salyapongse, G. A. Bragdon et al., “Impaired wound healing and angiogenesis in eNOS-deficient mice,” American Journal of Physiology-Heart and Circulatory Physiology, vol. 277, no. 4, pp. H1600–H1608, 1999.
View at: Publisher Site | Google Scholar
M. Jones, J. G. Ganopolsky, A. Labbé et al., “Novel nitric oxide producing probiotic wound healing patch: preparation and in vivo analysis in a New Zealand white rabbit model of ischaemic and infected wounds,” International Wound Journal, vol. 9, no. 3, pp. 330–343, 2012.
View at: Publisher Site | Google Scholar
K. S. B. Masters, S. J. Leibovich, P. Belem, J. L. West, and L. A. Poole-Warren, “Effects of nitric oxide releasing poly(vinyl alcohol) hydrogel dressings on dermal wound healing in diabetic mice,” Wound Repair and Regeneration, vol. 10, no. 5, pp. 286–294, 2002.
View at: Publisher Site | Google Scholar
R. Keshet and A. Erez, “Arginine and the metabolic regulation of nitric oxide synthesis in cancer,” Disease Models & Mechanisms, vol. 11, no. 8, pp. dmm033332–dmm033341, 2018.
View at: Publisher Site | Google Scholar
H. O. El-Mesallamy, N. M. Hamdy, O. A. Ezzat, and A. M. Reda, “Levels of soluble advanced glycation end product-receptors and other soluble serum markers as indicators of diabetic neuropathy in the foot,” Journal of Investigative Medicine, vol. 59, no. 8, pp. 1233–1238, 2011.
View at: Publisher Site | Google Scholar
J. Wiśniewski, M. G. Fleszar, J. Piechowicz et al., “A novel mass spectrometry-based method for simultaneous determination of asymmetric and symmetric dimethylarginine, l-arginine and l-citrulline optimized for LC-MS-TOF and LC-MS/MS,” Biomedical Chromatography, vol. 31, no. 11, article e3994, 2017.
View at: Publisher Site | Google Scholar
M. G. Fleszar, J. Wiśniewski, M. Krzystek-Korpacka et al., “Quantitative analysis of L-arginine, dimethylated arginine derivatives, L-citrulline, and dimethylamine in human serum using liquid chromatography-mass spectrometric method,” Chromatographia, vol. 81, no. 6, pp. 911–921, 2018.
View at: Publisher Site | Google Scholar
M. Magnusson, T. Wang, B. Hedblad et al., “High levels of arginine, citrulline and ADMA are independent predictors of cardiovascular disease,” European Heart Journal, vol. 34, article P5687, Supplement 1, 2013.
View at: Publisher Site | Google Scholar
Y. C. Luiking, G. A. M. Ten Have, R. R. Wolfe, and N. E. P. Deutz, “Arginine de novo and nitric oxide production in disease states,” American Journal of Physiology Endocrinology and Metabolism, vol. 303, no. 10, pp. E1177–E1189, 2012.
View at: Publisher Site | Google Scholar
P. Willeit, D. F. Freitag, J. A. Laukkanen et al., “Asymmetric dimethylarginine and cardiovascular risk: systematic review and meta-analysis of 22 prospective studies,” Journal of the American Heart Association, vol. 4, no. 6, article e001833, 2015.
View at: Publisher Site | Google Scholar
G. Bouras, S. Deftereos, D. Tousoulis et al., “Asymmetric dimethylarginine (ADMA): a promising biomarker for cardiovascular disease?” Current Topics in Medicinal Chemistry, vol. 13, no. 2, pp. 180–200, 2013.
View at: Publisher Site | Google Scholar
H. Kajimoto, H. Kai, H. Aoki et al., “Inhibition of eNOS phosphorylation mediates endothelial dysfunction in renal failure: new effect of asymmetric dimethylarginine,” Kidney International, vol. 81, no. 8, pp. 762–768, 2012.
View at: Publisher Site | Google Scholar
S. Schlesinger, S. R. Sonntag, W. Lieb, and R. Maas, “Asymmetric and symmetric dimethylarginine as risk markers for total mortality and cardiovascular outcomes: a systematic review and meta-analysis of prospective studies,” PLoS ONE, vol. 11, no. 11, article e0165811, 2016.
View at: Publisher Site | Google Scholar
S. Zewinger, M. E. Kleber, L. Rohrer et al., “Symmetric dimethylarginine, high-density lipoproteins and cardiovascular disease,” European Heart Journal, vol. 38, no. 20, pp. 1597–1607, 2017.
View at: Publisher Site | Google Scholar
P. Jud, F. Hafner, N. Verheyen et al., “Homoarginine/ADMA ratio and homoarginine/SDMA ratio as independent predictors of cardiovascular mortality and cardiovascular events in lower extremity arterial disease,” Scientific Reports, vol. 8, no. 1, article 14197, 2018.
View at: Publisher Site | Google Scholar
I. E. Emrich, A. M. Zawada, J. Martens-Lobenhoffer et al., “Symmetric dimethylarginine (SDMA) outperforms asymmetric dimethylarginine (ADMA) and other methylarginines as predictor of renal and cardiovascular outcome in non-dialysis chronic kidney disease,” Clinical Research in Cardiology, vol. 107, no. 3, pp. 201–213, 2018.
View at: Publisher Site | Google Scholar
R. S. Blanc and S. Richard, “Arginine methylation: the coming of age,” Molecular Cell, vol. 65, no. 1, pp. 8–24, 2017.
View at: Publisher Site | Google Scholar
Y. Chen, X. Xu, M. Sheng, X. Zhang, Q. Gu, and Z. Zheng, “PRMT-1 and DDAHs-induced ADMA upregulation is involved in ROS- and RAS-mediated diabetic retinopathy,” Experimental Eye Research, vol. 89, no. 6, pp. 1028–1034, 2009.
View at: Publisher Site | Google Scholar
J. Leiper, M. Nandi, B. Torondel et al., “Disruption of methylarginine metabolism impairs vascular homeostasis,” Nature Medicine, vol. 13, no. 2, pp. 198–203, 2007.
View at: Publisher Site | Google Scholar
J. H. Kim, B. C. Yoo, W. S. Yang, E. Kim, S. Hong, and J. Y. Cho, “The role of protein arginine methyltransferases in inflammatory responses,” Mediators of Inflammation, vol. 2016, Article ID 4028353, 11 pages, 2016.
View at: Publisher Site | Google Scholar
M. Krzystek-Korpacka, K. Kędzior, L. Masłowski et al., “Impact of chronic wounds of various etiology on systemic profiles of key inflammatory cytokines, chemokines, and growth factors and their interplay,” Advances in Clinical and Experimental Medicine, vol. 28, no. 10, 2019.
View at: Google Scholar
S. Luo, H. Lei, H. Qin, and Y. Xia, “Molecular mechanisms of endothelial NO synthase uncoupling,” Current Pharmaceutical Design, vol. 20, no. 22, pp. 3548–3553, 2014.
View at: Publisher Site | Google Scholar
C. Xuan, F. J. Chang, X. C. Liu et al., “Endothelial nitric oxide synthase enhancer for protection of endothelial function from asymmetric dimethylarginine–induced injury in human internal thoracic artery,” The Journal of Thoracic and Cardiovascular Surgery, vol. 144, no. 3, pp. 697–703, 2012.
View at: Publisher Site | Google Scholar
S. Karbach, P. Wenzel, A. Waisman, T. Munzel, and A. Daiber, “eNOS uncoupling in cardiovascular diseases–the role of oxidative stress and inflammation,” Current Pharmaceutical Design, vol. 20, no. 22, pp. 3579–3594, 2014.
View at: Publisher Site | Google Scholar
A. Daiber, N. Xia, S. Steven et al., “New therapeutic implications of endothelial nitric oxide synthase (eNOS) function/dysfunction in cardiovascular disease,” International Journal of Molecular Sciences, vol. 20, no. 1, p. 187, 2019.
View at: Publisher Site | Google Scholar
S. A. Abd-El-Aleem, M. W. J. Ferguson, I. Appleton et al., “Expression of nitric oxide synthase isoforms and arginase in normal human skin and chronic venous leg ulcers,” The Journal of Pathology, vol. 191, no. 4, pp. 434–442, 2000.
View at: Publisher Site | Google Scholar
E. B. Jude, A. J. M. Boulton, M. W. J. Ferguson, and I. Appleton, “The role of nitric oxide synthase isoforms and arginase in the pathogenesis of diabetic foot ulcers: possible modulatory effects by transforming growth factor beta 1,” Diabetologia, vol. 42, no. 6, pp. 748–757, 1999.
View at: Publisher Site | Google Scholar
M. Sailer, C. Dahlhoff, P. Giesbertz et al., “Increased plasma citrulline in mice marks diet-induced obesity and may predict the development of the metabolic syndrome,” PLoS ONE, vol. 8, no. 5, article e63950, 2013.
View at: Publisher Site | Google Scholar
T. D. Allerton, D. N. Proctor, J. M. Stephens, T. R. Dugas, G. Spielmann, and B. A. Irving, “L-Citrulline supplementation: impact on cardiometabolic health,” Nutrients, vol. 10, no. 7, p. 921, 2018.
View at: Publisher Site | Google Scholar
M. Morita, M. Sakurada, F. Watanabe et al., “Effects of oral L-citrulline supplementation on lipoprotein oxidation and endothelial dysfunction in humans with vasospastic angina,” Immunology, Endocrine & Metabolic Agents in Medicinal Chemistry, vol. 13, no. 3, pp. 214–220, 2013.
View at: Publisher Site | Google Scholar
I. B. J. G. Debats, D. Booi, N. E. P. Deutz, W. A. Buurman, W. D. Boeckx, and R. R. W. J. van der Hulst, “Infected chronic wounds show different local and systemic arginine conversion compared with acute wounds,” Journal of Surgical Research, vol. 134, no. 2, pp. 205–214, 2006.
View at: Publisher Site | Google Scholar
K. P. Koh, Y. Wang, T. Yi et al., “T cell–mediated vascular dysfunction of human allografts results from IFN-γ dysregulation of NO synthase,” Journal of Clinical Investigation, vol. 114, no. 6, pp. 846–856, 2004.
View at: Publisher Site | Google Scholar
P. F. Lai, F. Mohamed, J. C. Monge, and D. J. Stewart, “Downregulation of eNOS mRNA expression by TNFalpha: identification and functional characterization of RNA-protein interactions in the 3UTR,” Cardiovascular Research, vol. 59, no. 1, pp. 160–168, 2003.
View at: Publisher Site | Google Scholar
F. de Lalla, G. Pellizzer, M. Strazzabosco et al., “Randomized prospective controlled trial of recombinant granulocyte colony-stimulating factor as adjunctive therapy for limb-threatening diabetic foot infection,” Antimicrobial Agents and Chemotherapy, vol. 45, no. 4, pp. 1094–1098, 2001.
View at: Publisher Site | Google Scholar
S. Dogra and R. Sarangal, “Summary of recommendations for leg ulcers,” Indian Dermatology Online Journal, vol. 5, no. 3, pp. 400–407, 2014.
View at: Publisher Site | Google Scholar
S. K. Beidler, C. D. Douillet, D. F. Berndt, B. A. Keagy, P. B. Rich, and W. A. Marston, “Inflammatory cytokine levels in chronic venous insufficiency ulcer tissue before and after compression therapy,” Journal of Vascular Surgery, vol. 49, no. 4, pp. 1013–1020, 2009.
View at: Publisher Site | Google Scholar
K. W. Park, Y. W. Kwon, H. J. Cho et al., “G-CSF exerts dual effects on endothelial cells–opposing actions of direct eNOS induction versus indirect CRP elevation,” Journal of Molecular and Cellular Cardiology, vol. 45, no. 5, pp. 670–678, 2008.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2019 Małgorzata Krzystek-Korpacka et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

1763

Downloads

1049

Citations