Next Article in Journal
Birdshot Chorioretinopathy: A Review
Previous Article in Journal
Association of the Heart Rate Variability Response to Active Standing with the Severity of Calcific Aortic Valve Disease: Novel Insights of a Neurocardiovascular Pathology
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Corneal Nerve Changes Observed by In Vivo Confocal Microscopy in Patients Receiving Oxaliplatin for Colorectal Cancer: The COCO Study

by
Ellen F. Tyler
1,
Charles N. J. McGhee
1,
Benjamin Lawrence
2,
Geoffrey D. Braatvedt
3,
Joseph L. Mankowski
4,
Jonathan D. Oakley
5,
Sargun Sethi
1 and
Stuti L. Misra
1,*
1
Department of Ophthalmology, New Zealand National Eye Centre, Faculty of Medical and Health Sciences, The University of Auckland, Auckland 1142, New Zealand
2
Department of Oncology, The University of Auckland, Auckland 1142, New Zealand
3
Department of Endocrinology, Greenlane Clinical Centre, Auckland District Health Board, Auckland 1051, New Zealand
4
Department of Molecular and Comparative Pathobiology, Johns Hopkins University, Baltimore, MD 21205, USA
5
Voxeleron LLC, 13809 Research Blvd., Suite 500, Austin, TX 78750, USA
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2022, 11(16), 4770; https://doi.org/10.3390/jcm11164770
Submission received: 12 July 2022 / Revised: 8 August 2022 / Accepted: 8 August 2022 / Published: 16 August 2022
(This article belongs to the Section Clinical Neurology)

Abstract

:
An objective method of early identification of people at risk of chemotherapy-induced peripheral neuropathy is needed to minimize long-term toxicity and maximize dose intensity. The aims of the study were to observe corneal nerve microstructure and corneal sensitivity changes and peripheral neuropathy in patients receiving oxaliplatin, and to determine its association with corneal parameters at different stages of treatment and assess utility as non-invasive markers to detect and monitor peripheral neuropathy. Twenty-three patients scheduled to receive oxaliplatin chemotherapy with intravenous 5-FU for gastro-intestinal cancer were recruited and followed up with for 12 months. Ocular examinations including corneal and retinal evaluations, alongside peripheral neuropathy assessment, were performed. The corneal nerve density did not show significant change after chemotherapy when measured with a widely used semi-automated program or an automated analysis technique. Macula and optic nerve function did not change during or after oxaliplatin chemotherapy. However, the corneal nerve density modestly correlated with clinical peripheral neuropathy after 20 weeks of chemotherapy (r = 0.61, p = 0.01) when peripheral neuropathy is typical most profound, and corneal nerve sensitivity correlated with neuropathy at 12 (r = 0.55, p = 0.01) and 20 weeks (r = 0.64, p = 0.006). In conclusion, corneal changes detected on confocal microscopy show moderate association with peripheral neuropathy, indicating their potential to identify the development of oxaliplatin-induced peripheral neuropathy. However, further studies are required to confirm these findings.

1. Introduction

Oxaliplatin and cisplatin can cause severe peripheral sensory neuropathy [1]. Oxaliplatin chemotherapy is in widespread use across the world, coupled with either 5-fluorouracil or oral capecitabine, as the standard of care for many gastrointestinal cancers in both curative and palliative settings and improves survival [2,3,4]. Chemotherapy-induced peripheral neuropathy negatively affects these patients’ quality of life, increases health care costs [5] and is the most common dose-limiting toxicity of oxaliplatin [2].
An objective prospective method of assessing chemotherapy-induced peripheral neuropathy is needed to minimize long-term toxicity and maximize dose intensity. Corneal in vivo confocal microscopy (IVCM) is a unique non-invasive tool that allows the assessment of small sensory fibres by direct observation of corneal nerve microstructure. Recently, it was shown that corneal IVCM and corneal sensitivity threshold (CST) assessment are sensitive clinical tools to detect early diabetic peripheral neuropathy and may be clinically used to diagnose and monitor the progression of neuropathy [6,7,8,9,10]. Therefore, it may be possible to use corneal IVCM and CST as surrogate, or even prognostic, markers for chemotherapy-induced peripheral neuropathy. Two separate studies, comprising 13 and 15 participants, respectively, showed that peripheral neuropathy and corneal nerve changes co-exist during or after chemotherapy [11,12]. Recently, a cross-sectional study reported reduced corneal nerve density in patients with breast or gynaecological cancer who had been treated with paclitaxel, and a case report revealed a high number of corneal dendritic cells after paclitaxel treatment [13,14]. A number of atypical bulb-like enlarged nerve endings, termed neuromas, were also detected in the corneal sub-basal nerve plexus of patients treated for multiple myeloma [13,14,15]. Despite evidence of corneal nerve dysfunction developing in patients receiving chemotherapy in different type of cancers, limited longitudinal studies exist assessing these changes over time.
Dose intensity of oxaliplatin chemotherapy is positively associated with colorectal cancer survival, but unfortunately, there is also a clear association between the total cumulative dose and the development of chronic peripheral neuropathy. Whereas oncologists decrease the dose delivered or terminate oxaliplatin therapy in response to the development of peripheral neuropathy, the dose adjustment often occurs too late to prevent chronic permanent peripheral neuropathy [16].
Currently, there are no objective methods by which clinicians can predict the onset of chronic peripheral neuropathy in patients receiving chemotherapy, nor identify those at most risk. A recent study shows that corneal changes can be detected up to 2 years after oxaliplatin-based chemotherapy [17], but limited literature exists for prospective, longitudinal studies investigating potential chemotherapy-induced corneal abnormalities temporally associated with developing peripheral neuropathy. IVCM could potentially provide a more refined, objective surrogate for the detection of oxaliplatin-related peripheral neuropathy. The overall aim of the study was to study corneal nerve microstructure changes observed by in vivo confocal microscopy in patients receiving oxaliplatin (COCO), and secondly, to assess oxaliplatin-induced peripheral neuropathy and determine its correlation with corneal nerve microstructure and corneal sensitivity at different stages of treatment. If changes in nerve microstructure are detected in the cornea, and these changes are associated with the development of chemotherapy-induced neuropathy, there is potential to utilise such changes as non-invasive markers in the detection and monitoring of oxaliplatin-induced peripheral neuropathy.

2. Materials and Methods

The current study is part of a larger research project approved by the local ethics committee (NTX/11/06/051/AM02) and adheres to the tenets of the Declaration of Helsinki. All subjects gave written informed consent before participating in the study. Annually, approximately 200 patients are treated using oxaliplatin in Auckland Hospital, and the drug has been reported to cause sensory neuropathy in up to 80% of these patients [18]. Attempting to calculate a sample size based on repeated measures analysis was difficult due to the novel nature of the study. At present, there is no estimate for the value of the mean corneal nerve density (the primary outcome measure) at each time point, nor is there a value for the correlation between each time point, and these would be needed to calculate sample size. Hence, this research was defined as a longitudinal observational study without any need of sample size calculation. All the patients undergoing oxaliplatin treatment for gastrointestinal cancer who meet the criteria will be requested to participate. This observational study will gather the data and values needed to form the foundation for a detailed sample size calculation for future randomized trials.
Patients commencing oxaliplatin chemotherapy with intravenous 5-FU for any gastro-intestinal cancer were recruited. Patients with history of any bilateral ocular surgery, current contact lens wear or any systemic disease causing peripheral neuropathy, were excluded. All patients were recruited under the supervision of a senior medical oncologist (BL). Patients underwent ophthalmologic assessments at baseline (prior to first dose of oxaliplatin) and at six, 12, 20, 36 and 52 weeks after the first chemotherapy session. In addition, each patient was requested to undergo standard peripheral nerve electrophysiology at baseline and again at the 20-week follow up.
The external and anterior ocular structures were examined using a Topcon slit lamp biomicroscope (Topcon Medical Systems, Oakland, NJ, USA). CST was evaluated with the Non-Contact Corneal Aesthesiometer [19]. Assessment of colour vision deficiency was performed with Ishihara test plates. Colour vision assessment reflects optic nerve function and deficiencies can indicate the presence of an optic neuropathy. Pupil responses were checked individually and then alternately in the swinging light test to detect RAPD (relative afferent pupillary defects). Abnormal pupillary responses indicate a potential optic neuropathy.
The central cornea of the right eye of each patient was examined at each visit with laser scanning in vivo confocal microscopy in accordance with a well-established protocol [6,20]. The cornea was anaesthetised with one drop of 0.4% benoxinate hydrochloride (Chauvin Pharmaceuticals Ltd., Kingston, UK). A drop of Viscotears liquid gel (Viscotears Carbomer, Novartis Pharmaceuticals Ltd., London, UK) was placed on the lens objective, avoiding bubbles and serving as a contact substance. A disposable Tomocap was then mounted over the objective lens of the confocal microscope. The captured images represent two-dimensional optical sections through the cornea at the location of the focal plane. These images were individually evaluated to calculate the density of the sub-basal nerve plexus. All images were collected, and all follow up visits were completed before any analysis of IVCM images was started. Images were sent to an independent observer (SM) and randomised through a computer-based random number generator. The randomised and de-identified images were subsequently traced by an experienced clinician for corneal nerve density (ET) and processed to determine the presence of neuromas or dendritic cells (SS). Visible nerves were traced with an electronic pen with a digital caliper tool (Wacom Technology Group, Vancouver, BC, Canada) and measuring the total length of nerves per frame using semi-automated software ImageJ with NeuronJ (National Institutes of Health, Bethesda, Rockville, MD, USA). This parameter is arguably the most repeatable and provides maximum information about corneal nerve microstructure [21]. To note, the terms sub-basal nerve density and sub-basal nerve length, measured as mm/mm2, are used interchangeably in the literature due to lack of unanimous consensus in the terminology [6,20,22,23,24].
Automated analysis of corneal nerves was also performed to complement semi-automated assessments. A customised deep learning-based approach named deepNerve has been recently developed to objectively measure corneal nerve density or corneal nerve fibre length—the total length of the nerves divided by the image area, expressed as mm/mm2—as well as secondary metrics such as tortuosity [25]. Initially validated using the manually traced IVCM images of macaque cornea, the approach is now used in studies of pre-clinical animal models [25,26]. The output from the network is a nerve probability map where pixels are in the range 0, indicating no nerves, to 1, where nerves are noted [25]. A final thresholding of this result creates a binary image from which quantitative parameters are derived.
Optical Coherence Tomography (OCT) is a standard non-invasive assessment of the retina based on a coherent light source and principles of interferometry to capture high resolution, cross-sectional images. At every visit, OCT was performed on the patient’s right retina and optic nerve to assess any retinal changes or optic neuropathy. The specific OCT scan used was a nine-line raster cross of the macula, to assess for potential Oxaliplatin maculopathy.
The Total Neuropathy Score (TNS) was calculated by combining a three-part assessment: questionnaire, biothesiometry and clinical assessment. The first part involved filling in a “symptoms of neuropathy” questionnaire that evaluates and grades the severity of sensory symptoms such as numbness, pain and sensitivity in the extremities; the second part comprised a peripheral nervous system assessment including biothesiometry by an experienced clinician (ET); and the third part included testing the vibration threshold of the nerves of the feet using a bioesthesiometer—ankle and knee reflexes and big toe proprioception as well as the ten-gram monofilament test [27]. The score ranged between 0 to 30, and the higher the score, the worse the neuropathy. A subset of patients underwent a baseline nerve conduction study (NCS) and a 20-week follow up review. This is a measurement of sural and peroneal conduction velocity and amplitude [27]. The study determines myelinated nerve function by preferentially assessing the fastest conducting subset of the alpha motor axon population. A reduction in conduction velocity or amplitude is indicative of neuropathy. A score is calculated between 0 to 10, with 0 being no neuropathy and 10 being the worst case scenario. NCS scores were not included in the TNS due to limited (eight) patient data at baseline and at 20-week assessment. The Kolmogronov–Smirnov test was performed to confirm normality of the data distributions. Multiple imputation methodology was administered to process the missing data due to missed assessments [28]. Repeated measures ANOVA was administered to assess changes due to oxaliplatin over the one-year period, with and without employing imputation models. p < 0.05 was considered significant. SPSS Statistics 23 (IBM Corporation, Armonk, NY, USA) was used for analysis. Data are presented as mean ± SD.

3. Results

Twenty-three patients (15 males:8 females) were recruited over a 12-month recruitment period. The mean age of patients was 61.0 ± 11.0 years (mean ± standard deviation) at baseline, and 19 were Caucasian, three were Asian and one was New Zealand Māori.
The median oxaliplatin cumulative dose was 762.5 mg (range 150 to 1780 mg) across the three cycles. All patients had intra-venous 5FU. Twenty-three patients were assessed at the baseline visit—20 at 6 weeks, 22 at 12 weeks, 19 at 20 weeks, 6 at 36 weeks and 11 at the final 52-week visit.
At baseline, the corneal sub-basal nerve density was 15.9 ± 6.2 mm/mm2 (mean ± standard deviation), shown in Figure 1 and Table 1. The box and whisker plot (Figure 2) did not show a change in corneal nerve density over the course of the study. Similarly, no changes were noted after applying an imputation model with the worst case imputation scenario Wilk’s Lambda = 0.65, F(5,18) = 1.82, p = 0.16, n2 = 0.37. This included the 20-week assessment conducted while receiving chemotherapy and the follow up at 52 weeks to capture any change after cessation of treatment.
The corneal nerve density measurement with semi-automated tracing software NeuronJ and deepNerve automated analysis showed excellent comparability (r2 = 0.88, Figure 3). Table 2 summarises the corneal nerve density of each patient at each follow-up assessment, as well as the final patient outcome after the follow up time frame.
The corneal sensitivity threshold was 0.3 ± 0.1 mBAR at the baseline visit. Table 1 presents the means of the corneal sensitivity threshold as measured by NCCA, along with the number of patients showing the presence of neuropathy, RAPD or any retinal abnormalities.
Out of 23 patients, nine patients had corneal neuromas and 11 had corneal dendritic cells at baseline, including two who had both. During and after the treatment conclusion, a further 14 had neuromas and 11 had dendritic cells. Amongst these patients, ten developed both dendritic cells as well as neuromas. All of these patients except one exhibited some degree of peripheral neuropathy during or after chemotherapy. Representative examples of neuromas and dendritic cells are shown in Figure 4.
No macular abnormalities were documented on baseline OCT scans and no change in OCT appearances was noted in any patient during this study. No patient had RAPD at any of the assessments, and no patient reported any change in their colour vision as assessed by Ishihara colour plates. Two patients had colour blindness (inherited red-green colour anomaly) that did not change at any stage of the study.
Peripheral neuropathy was assessed using the TNS and the electrophysiological NCS. Out of 23, six patients had minimal neuropathy detected at the baseline visit by NCS, whereas TNS (questionnaire, clinical assessment and biothesiometry) did not suggest neuropathy. During chemotherapy at the 20-week assessment, 16 out of 17 had some degree of neuropathy detected by TNS or NCS (Table 1). Only three patients out of 11 available for follow up had some level of neuropathy at the concluding 52-week visit. Ten patients underwent nerve conduction study at baseline, whereas only nine were re-assessed at 20-week time-point (Table 1). The peroneal distal compound muscle action potential (p = 0.93) and sural sensory nerve action potential amplitude (p = 0.1) did not change from baseline to the 20-week timepoint. These amplitudes did not correlate with corneal nerve density; however, this lack of association should be interpreted with caution due to lower number of participants with NCS. All had normal TNS at the baseline visit, which showed a minor change at 20-week timepoint.
There was no association between corneal nerve density, peripheral neuropathy as indicated by total neuropathy score and cumulative oxaliplatin dosing (Table 3) in most of the timepoints, apart from the 20-week assessment, which revealed a moderate association between corneal nerve density and cumulative dosing (r = 0.61, p = 0.01). There was no trend or association between neuroma or dendritic cell development with chemotherapy cycles. However, there was moderate correlation between corneal sensitivity and the total neuropathy score at the 12- (r = 0.55, p = 0.01) and 20-week (r = 0.64, p = 0.006) timepoint (Table 3).

4. Discussion

The current prospective, longitudinal study did not detect changes in the corneal density, macula or optic nerve during or after oxaliplatin chemotherapy, in contrast to previous studies that showed significant oxaliplatin related ocular surface changes [11,12]. This study, however, did reveal a moderate association between corneal sensitivity and total neuropathy score, suggesting functional changes in the cornea that are not mirrored in corneal nerve density. The inconsistencies between the studies could potentially be due to discontinuation of follow up following chemotherapy cessation in previous studies.
The association between corneal changes and peripheral neuropathy at 20 weeks corresponds with the usual timepoint that peripheral neuropathy becomes severe in the oncology clinic, suggesting that both corneal nerve density and corneal sensitivity threshold are affected at the same time. Interestingly, peripheral neuropathy occurring after 12 weeks of oxaliplatin is usually mild, so the association of peripheral neuropathy with corneal sensitivity at this early timepoint (and again at 20 weeks) suggests corneal sensitivity might be a more sensitive measure than corneal sub-basal nerve density. There is possible merit in assessing the corneal sensitivity threshold in patients undergoing chemotherapy to monitor peripheral neuropathy at various stages of their treatment.
Oxaliplatin has been associated with several ocular side effects. Several studies report the common occurrence of dry eye, epiphora, eye pain and ptosis associated with the acute phase of neurotoxicity and rare cases of reduced visual acuity, optic neuropathy, visual changes and visual loss [17,29,30,31]. Patients in the current reported study frequently reported symptoms of dry eye and associated eye discomfort (often associated with 5-flourouracil); however, none of the patients experienced any visual loss, visual changes or optic neuropathy associated with oxaliplatin. Painful dry eye disease is associated with corneal nerve microstructural changes [32]. Further research is needed to investigate the role of dry eye associated corneal nerve in patients undergoing chemotherapy. Furthermore, optic nerve function testing, visual acuity and OCT scans through the macula remained unchanged throughout the follow up period.
Of note, the measurement of corneal nerve density using the conventional manual tracing and novel automated deepNerve methodology produced almost identical outcomes in the current study. The deepNerve methodolgy has previously been used in animal as well as human studies [25,26,33]. The corneal nerve density or corneal nerve length measured as mm/mm2 is a reproducible parameter reported to reduce in diseases often associated with peripheral neuropathy, for example with diabetes and Parkinson’s disease [21,22,23,24,34].
Previous case series observed significant corneal changes, as imaged by IVCM, in patients with peripheral sensory neuropathy caused by oxaliplatin-based chemotherapy treatment [11,35]. In a case-control series, Campagnolo et al. recruited fifteen patients receiving oxaliplatin chemotherapy, assessing them prior to commencement of chemotherapy and after completion of chemotherapy [11]. They were matched with sixteen healthy age-matched subjects. Investigations at both time points included corneal IVCM, corneal aesthesiometry TNS, NCS, OCT and pupillometry [11]. Out of the fifteen oxaliplatin treated patients in the Campagnolo et al. study, ten had reduced TNS at the end of chemotherapy and eight had clinical signs of neuropathy [11]. At the same timepoint in the current study, a similar proportion of patients (17 of 19) had peripheral neuropathy.
The translational aim of the current study was to determine whether corneal changes could be used as an early biomarker for subsequent permanent neuropathy. Two of the four patients with IVCM changes but stable TNS scores in the Campagnolo et al. study developed clinical peripheral neuropathy several weeks after completing their final cycle of chemotherapy, suggesting the IVCM has potential in identifying patients who are likely to experience the coasting effect of oxaliplatin neuropathy [11]. Although corneal nerve microstructure was associated with peripheral neuropathy at 20 weeks in the current study, notably, corneal sensitivity was correlated with the total neuropathy score. We were not able to determine an association with later permanent neuropathy because it was rare at the 52-week mark; in fact, peripheral neuropathy was detected at lower levels than at baseline. Patient attrition also possibly played a role.
A recent cross-sectional study by Chiang et al. showed a difference in sub-basal nerve length, as measured by mm/mm2, in 29 patients with breast or gynaecological cancer (14.2 mm/mm2 ± 4.0) compared to control participants (16.4 mm/mm2 ± 4.0) [13]. The current study noted 15.9 mm/mm2 ± 6.2 at the baseline visit (23 patients) and 15.5 mm/mm2 ± 4.8 at the 20-week visit (17 patients), whereas the Chiang et al. patient cohort had a history of chemotherapy between 3 to 24 months prior to ocular assessment [13]. Another study by Chiang et al. showing significant differences in oxaliplatin-induced peripheral neuropathy and oxaliplatin-related ocular toxicity between patients who underwent chemotherapy, and control participants without cancer or chemotherapy is clearly unsurprising [17]. However, a study of thirteen patients did exhibit changes in corneal nerve microstructure after three cycles of oxaliplatin or cisplatin. Interestingly, a study of 13 patients with gastro-intestinal cancer showed re-generation of corneal nerves after three cycles of oxaliplatin, epirubicin, cisplatin or capecitabine [12]. It is imperative to assess patients before, during and after cessation of treatment to draw firm conclusions. Our study did assess patients at various timepoints, but patient attrition due to morbidity and mortality has the potential to bias the results.
The presence of dendritic cells and neuromas in patients with cancer and chemotherapy warrants further longitudinal studies with larger patient cohorts. The dendritic cells migrate from the peripheral corneal towards the centre during an inflammatory state [36,37]. Although the current study did observe dendritic cells in 15/23 patients over the course of chemotherapy, there was no trend or association with treatment time-line. In this study, neuromas were noted in 18/23 patients, and these were noted in a previous study in 18/25 of patients with multiple myeloma [15]. Neuromas are described as anomalous nerve features that are often associated with corneal neuropathy and ocular surface disease [38,39]. However, there is no consensus amongst researchers regarding the importance and relevance of these structures due to lack of standard neuroma definition in the literature [40].
In comparison with the preceding published literature, the current COCO study has the longest follow up period, wherein the patients were assessed before, during and after chemotherapy. Interestingly, at most time points, no statistically significant correlation was identified between cumulative doses of oxaliplatin and corneal nerve density or between oxaliplatin-induced peripheral neuropathy and corneal nerve density, except at the time of most peripheral nerve damage, and a moderate association between corneal nerve density and cumulative dosing was noted (r = 0.61, p = 0.01). The correlations are suggestive, but at an individual level, some patients showed a decrease in corneal nerve density, where other did not, suggesting that IVCM corneal nerve density is currently an insensitive method of detecting oxaliplatin-induced peripheral neuropathy. Yet, the association between corneal sensitivity and total neuropathy score does suggest potential parallel changes in the cornea and peripheral extremities, introducing a potential confounding variable into studies of neuropathy in the treatment of cancers.
Interestingly, corneal nerve fibre length and density were reduced in patients with upper gastrointestinal cancer without chemotherapy in comparison to age-matched controls, which was attributed to systemic peripheral neuropathy due to cancer [12]. The current study also noted lower sub-basal nerve density prior to commencement of chemotherapy.
A limitation of the current study was slow recruitment and loss of patients during the study. In addition to lower-than-expected numbers of eligible patients presenting to the new patient clinics, an atypically low uptake was experienced in the recruitment period. Indeed, of the 117 potentially eligible patients, only 23 patients agreed to participate, whereas an additional four patients initially consented to the study but withdrew their consent before the baseline examination. Several patients who did not consent to the study contacted the investigator following commencement of chemotherapy, expressing interest but could not be included as no baseline data could be established. Of the 23 patients recruited, only ten patients (39%) consented to additional nerve conduction testing, two of whom did not undergo their second testing at 20 weeks.
Overall, patients expressed anxiety at the initial recruitment approach at the Oncology New Patient clinic, and although most patients were already aware of their diagnosis of cancer, this was their first meeting with an oncologist. Understandably, this is an emotional time for the patient and their family members, and a lot of information is presented in a short space of time. There was then attrition during the study despite considerable effort made to make the ophthalmic and nerve conduction testing as convenient and straightforward as possible to attend.
Oxaliplatin-induced peripheral neuropathy is related to the cumulative dose of oxaliplatin; the higher the cumulative dose, the greater the risk of developing neuropathy [41]. Unfortunately, the only effective method of preventing oxaliplatin-induced peripheral neuropathy is to reduce the dose of oxaliplatin delivered or terminate treatment. The COCO study did not identify significant changes in corneal nerves during oxaliplatin chemotherapy, found only moderate correlations between peripheral neuropathy and corneal innervation and could not assess the potential of corneal innervation as a surrogate for peripheral neuropathy. At this stage, it cannot be suggested that corneal nerve density is a reliable surrogate biomarker for oxaliplatin neuropathy. Subsequent larger studies may be able to more clearly define any role that IVCM of corneal nerve density may play in the assessment of chemotherapy-induced peripheral neuropathy. Further investigations including corneal sensitivity measurements are required to conclude whether its moderate association with peripheral neuropathy occurs in tandem.

5. Conclusions

The current study suggests that corneal nerve density may not be an effective biomarker for oxaliplatin-induced peripheral neuropathy; however, further studies are required to confirm these findings.

Author Contributions

Conceptualization, G.D.B., S.L.M. and C.N.J.M.; validation, G.D.B., B.L. and S.L.M., methodology, B.L., G.D.B., C.N.J.M. and S.L.M.; software, J.D.O.; formal analysis, E.F.T., S.S., J.D.O. and S.L.M.; investigation, E.F.T.; resources, C.N.J.M.; data curation, E.F.T., S.S. and S.L.M.; writing—original draft preparation, E.F.T.; writing—review and editing, S.L.M., B.L., G.D.B., J.D.O., J.L.M., S.S. and C.N.J.M.; visualization, S.L.M., C.N.J.M., J.L.M. and B.L.; supervision, S.L.M., C.N.J.M., G.D.B. and B.L.; project administration, E.F.T. and S.L.M.; funding acquisition, S.L.M., E.F.T. and C.N.J.M. All authors have read and agreed to the published version of the manuscript.

Funding

Ellen F Tyler was funded by Clinical Research Fellowship, Health Research Council of New Zealand. Sargun Sethi was funded by the University of Auckland Summer Scholarship.

Institutional Review Board Statement

The current study is part of a larger research project approved by the local ethics committee (NTX/11/06/051/AM02) and adhered to the tenets of the Declaration of Helsinki.

Informed Consent Statement

All subjects gave written informed consent before participating in the study.

Data Availability Statement

Data is available upon request.

Acknowledgments

Authors are thankful to Avinash Pillai, Department of Statistics, University of Auckland, for advice on statistical analysis.

Conflicts of Interest

Jonathan Oakley is an employee of Voxeleron LLC. The authors declare no conflict of interest.

References

  1. Paice, J.A. Clinical challenges: Chemotherapy-induced peripheral neuropathy. Semin. Oncol. Nurs. 2009, 25, S8–S19. [Google Scholar] [CrossRef] [PubMed]
  2. Beijers, A.J.; Mols, F.; Tjan-Heijnen, V.C.; Faber, C.G.; van de Poll-Franse, L.V.; Vreugdenhil, G. Peripheral neuropathy in colorectal cancer survivors: The influence of oxaliplatin administration. Results from the population-based PROFILES registry. Acta Oncol. 2015, 54, 463–469. [Google Scholar] [CrossRef] [PubMed]
  3. Haller, D.G.; Tabernero, J.; Maroun, J.; De Braud, F.; Price, T.; Van Cutsem, E.; Hill, M.; Gilberg, F.; Rittweger, K.; Schmoll, H.-J. Capecitabine plus oxaliplatin compared with fluorouracil and folinic acid as adjuvant therapy for stage III colon cancer. J. Clin. Oncol. 2011, 29, 1465–1471. [Google Scholar] [CrossRef]
  4. Osti, M.F.; Agolli, L.; Bracci, S.; Masoni, L.; Valeriani, M.; Falco, T.; De Sanctis, V.; Maurizi Enrici, R. Neoadjuvant chemoradiation with concomitant boost radiotherapy associated to capecitabine in rectal cancer patients. Int. J. Colorectal Dis. 2014, 29, 835–842. [Google Scholar] [CrossRef] [PubMed]
  5. Argyriou, A.A.; Kyritsis, A.P.; Makatsoris, T.; Kalofonos, H.P. Chemotherapy-induced peripheral neuropathy in adults: A comprehensive update of the literature. Cancer Manag. Res. 2014, 6, 135. [Google Scholar] [CrossRef] [PubMed]
  6. Misra, S.L.; Craig, J.P.; Patel, D.V.; McGhee, C.N.; Pradhan, M.; Ellyett, K.; Kilfoyle, D.; Braatvedt, G.D. In Vivo Confocal Microscopy of Corneal Nerves: An Ocular Biomarker for Peripheral and Cardiac Autonomic Neuropathy in Type 1 Diabetes Mellitus. Investig. Ophthalmol. Vis. Sci. 2015, 56, 5060–5065. [Google Scholar] [CrossRef]
  7. Misra, S.L.; Goh, Y.W.; Patel, D.V.; Riley, A.F.; McGhee, C.N. Corneal microstructural changes in nerve fiber, endothelial and epithelial density after cataract surgery in patients with diabetes mellitus. Cornea 2015, 34, 177–181. [Google Scholar] [CrossRef]
  8. Petropoulos, I.N.; Green, P.; Chan, A.W.; Alam, U.; Fadavi, H.; Marshall, A.; Asghar, O.; Efron, N.; Tavakoli, M.; Malik, R.A. Corneal confocal microscopy detects neuropathy in patients with type 1 diabetes without retinopathy or microalbuminuria. PLoS ONE 2015, 10, e0123517. [Google Scholar] [CrossRef]
  9. Quattrini, C.; Tavakoli, M.; Jeziorska, M.; Kallinikos, P.; Tesfaye, S.; Finnigan, J.; Marshall, A.; Boulton, A.J.; Efron, N.; Malik, R.A. Surrogate markers of small fiber damage in human diabetic neuropathy. Diabetes 2007, 56, 2148–2154. [Google Scholar] [CrossRef]
  10. Tavakoli, M.; Petropoulos, I.N.; Malik, R.A. Corneal confocal microscopy to assess diabetic neuropathy: An eye on the foot. J. Diabetes Sci. Technol. 2013, 7, 1179–1189. [Google Scholar] [CrossRef] [PubMed]
  11. Campagnolo, M.; Lazzarini, D.; Fregona, I.; Cacciavillani, M.; Bergamo, F.; Parrozzani, R.; Midena, E.; Briani, C. Corneal confocal microscopy in patients with oxaliplatin-induced peripheral neuropathy. J. Peripher. Nerv. Syst. 2013, 18, 269–271. [Google Scholar] [CrossRef] [PubMed]
  12. Ferdousi, M.; Azmi, S.; Petropoulos, I.N.; Fadavi, H.; Ponirakis, G.; Marshall, A.; Tavakoli, M.; Malik, I.; Mansoor, W.; Malik, R.A. Corneal confocal microscopy detects small fibre neuropathy in patients with upper gastrointestinal cancer and nerve regeneration in chemotherapy induced peripheral neuropathy. PLoS ONE 2015, 10, e0139394. [Google Scholar] [CrossRef] [PubMed]
  13. Chiang, J.C.B.; Goldstein, D.; Trinh, T.; Au, K.; Park, S.B.; Krishnan, A.V.; Markoulli, M. A cross-sectional study of ocular surface discomfort and corneal nerve dysfunction after paclitaxel treatment for cancer. Sci. Rep. 2021, 11, 1786. [Google Scholar] [CrossRef]
  14. Sterenczak, K.A.; Stache, N.; Bohn, S.; Allgeier, S.; Köhler, B.; Bartschat, A.; George, C.; Guthoff, R.F.; Stachs, O.; Stachs, A. Burst of corneal dendritic cells during trastuzumab and paclitaxel treatment. Diagnostics 2021, 11, 838. [Google Scholar] [CrossRef] [PubMed]
  15. Koschmieder, A.; Stachs, O.; Kragl, B.; Stahnke, T.; Sterenczak, K.A.; Henze, L.; Jünemann, A.G.; Junghanss, C.; Guthoff, R.F.; Murua Escobar, H. Non-invasive detection of corneal sub-basal nerve plexus changes in multiple myeloma patients by confocal laser scanning microscopy. Biosci. Rep. 2020, 40, BSR20193563. [Google Scholar] [CrossRef] [PubMed]
  16. Mols, F.; Beijers, T.; Lemmens, V.; van den Hurk, C.J.; Vreugdenhil, G.; van de Poll-Franse, L.V. Chemotherapy-induced neuropathy and its association with quality of life among 2-to 11-year colorectal cancer survivors: Results from the population-based PROFILES registry. J. Clin. Oncol. 2013, 31, 2699–2707. [Google Scholar] [CrossRef]
  17. Chiang, J.C.B.; Goldstein, D.; Trinh, T.; Au, K.; Mizrahi, D.; Muhlmann, M.; Crowe, P.; O’Neill, S.; Edwards, K.; Park, S.B. A cross-sectional study of sub-basal corneal nerve reduction following neurotoxic chemotherapy. Transl. Vis. Sci. Technol. 2021, 10, 24. [Google Scholar] [CrossRef] [PubMed]
  18. Han, C.; McKeage, M. Neuropathies associated with oxaliplatin therapy. Asia-Pac. J. Clin. Oncol. 2012, 8, 107–110. [Google Scholar] [CrossRef]
  19. Swanevelder, S.K.; Misra, S.L.; Tyler, E.F.; McGhee, C.N. Precision, agreement and utility of a contemporary non-contact corneal aesthesiometer. Clin. Exp. Optom. 2020, 103, 798–803. [Google Scholar] [CrossRef]
  20. Patel, D.V.; McGhee, C.N. Mapping of the normal human corneal sub-basal nerve plexus by in vivo laser scanning confocal microscopy. Investig. Ophthalmol. Vis. Sci. 2005, 46, 4485–4488. [Google Scholar] [CrossRef]
  21. Hertz, P.; Bril, V.; Orszag, A.; Ahmed, A.; Ng, E.; Nwe, P.; Ngo, M.; Perkins, B. Reproducibility of in vivo corneal confocal microscopy as a novel screening test for early diabetic sensorimotor polyneuropathy. Diabet. Med. 2011, 28, 1253–1260. [Google Scholar] [CrossRef] [PubMed]
  22. Messmer, E.M.; Schmid-Tannwald, C.; Zapp, D.; Kampik, A. In vivo confocal microscopy of corneal small fiber damage in diabetes mellitus. Graefes. Arch. Clin. Exp. Ophthalmol. 2010, 248, 1307–1312. [Google Scholar] [CrossRef] [PubMed]
  23. Tavakoli, M.; Kallinikos, P.; Iqbal, A.; Herbert, A.; Fadavi, H.; Efron, N.; Boulton, A.J.; Malik, R.A. Corneal confocal microscopy detects improvement in corneal nerve morphology with an improvement in risk factors for diabetic neuropathy. Diabet. Med. 2011, 28, 1261–1267. [Google Scholar] [CrossRef] [PubMed]
  24. Zhivov, A.; Winter, K.; Hovakimyan, M.; Peschel, S.; Harder, V.; Schober, H.-C.; Kundt, G.; Baltrusch, S.; Guthoff, R.F.; Stachs, O. Imaging and Quantification of Subbasal Nerve Plexus in Healthy Volunteers and Diabetic Patients with or without Retinopathy. PLoS ONE 2013, 8, e52157. [Google Scholar] [CrossRef]
  25. Oakley, J.D.; Russakoff, D.B.; McCarron, M.E.; Weinberg, R.L.; Izzi, J.M.; Misra, S.L.; McGhee, C.N.; Mankowski, J.L. Deep learning-based analysis of macaque corneal sub-basal nerve fibers in confocal microscopy images. Eye Vis. 2020, 7, 27. [Google Scholar] [CrossRef]
  26. McCarron, M.E.; Weinberg, R.L.; Izzi, J.M.; Queen, S.E.; Tarwater, P.M.; Misra, S.L.; Russakoff, D.B.; Oakley, J.D.; Mankowski, J.L. Combining In Vivo Corneal Confocal Microscopy with Deep Learning–Based Analysis Reveals Sensory Nerve Fiber Loss in Acute Simian Immunodeficiency Virus Infection. Cornea 2021, 40, 635–642. [Google Scholar] [CrossRef]
  27. Cornblath, D.; Chaudhry, V.; Carter, K.; Lee, D.; Seysedadr, M.; Miernicki, M.; Joh, T. Total neuropathy score: Validation and reliability study. Neurology 1999, 53, 1660. [Google Scholar] [CrossRef]
  28. Sterne, J.A.; White, I.R.; Carlin, J.B.; Spratt, M.; Royston, P.; Kenward, M.G.; Wood, A.M.; Carpenter, J.R. Multiple imputation for missing data in epidemiological and clinical research: Potential and pitfalls. BMJ 2009, 338, b2393. [Google Scholar] [CrossRef]
  29. Beijers, A.; Mols, F.; Vreugdenhil, G. A systematic review on chronic oxaliplatin-induced peripheral neuropathy and the relation with oxaliplatin administration. Supportive Care Cancer 2014, 22, 1999–2007. [Google Scholar] [CrossRef]
  30. Park, S.B.; Goldstein, D.; Lin, C.S.-Y.; Krishnan, A.V.; Friedlander, M.L.; Kiernan, M.C. Acute abnormalities of sensory nerve function associated with oxaliplatin-induced neurotoxicity. J. Clin. Oncol. 2009, 27, 1243–1249. [Google Scholar] [CrossRef]
  31. Schmid, K.E.; Kornek, G.V.; Scheithauer, W.; Binder, S. Update on ocular complications of systemic cancer chemotherapy. Surv. Ophthalmol. 2006, 51, 19–40. [Google Scholar] [CrossRef] [PubMed]
  32. Guerrero-Moreno, A.; Liang, H.; Moreau, N.; Luzu, J.; Rabut, G.; Melik Parsadaniantz, S.; Labbé, A.; Baudouin, C.; Réaux-Le Goazigo, A. Corneal Nerve Abnormalities in Painful Dry Eye Disease Patients. Biomedicines 2021, 9, 1424. [Google Scholar] [CrossRef] [PubMed]
  33. Petropoulos, I.N.; Fitzgerald, K.C.; Oakley, J.; Ponirakis, G.; Khan, A.; Gad, H.; George, P.; Deleu, D.; Canibano, B.G.; Akhtar, N.; et al. Corneal confocal microscopy demonstrates axonal loss in different courses of multiple sclerosis. Sci. Rep. 2021, 11, 21688. [Google Scholar] [CrossRef] [PubMed]
  34. Misra, S.L.; Kersten, H.M.; Roxburgh, R.H.; Danesh-Meyer, H.V.; McGhee, C.N. Corneal nerve microstructure in Parkinson’s disease. J. Clin. Neurosci. 2017, 39, 53–58. [Google Scholar] [CrossRef]
  35. Mesquida, M.; Sanchez-Dalmau, B.; Ortiz-Perez, S.; Pelegrín, L.; Molina-Fernandez, J.J.; Figueras-Roca, M.; Casaroli-Marano, R.; Adán, A. Oxaliplatin-related ocular toxicity. Case Rep. Oncol. 2010, 3, 423–427. [Google Scholar] [CrossRef]
  36. Marsovszky, L.; Nemeth, J.; Resch, M.D.; Toldi, G.; Legány, N.; Kovács, L.; Balog, A. Corneal Langerhans cell and dry eye examinations in ankylosing spondylitis. Innate Immun. 2014, 20, 471–477. [Google Scholar] [CrossRef]
  37. Wang, E.F.; Misra, S.L.; Patel, D.V. In vivo confocal microscopy of the human cornea in the assessment of peripheral neuropathy and systemic diseases. BioMed Res. Int. 2015, 2015, 951081. [Google Scholar] [CrossRef]
  38. Aggarwal, S.; Kheirkhah, A.; Cavalcanti, B.M.; Cruzat, A.; Colon, C.; Brown, E.; Borsook, D.; Prüss, H.; Hamrah, P. Autologous serum tears for treatment of photoallodynia in patients with corneal neuropathy: Efficacy and evaluation with in vivo confocal microscopy. Ocul. Surf. 2015, 13, 250–262. [Google Scholar] [CrossRef]
  39. Giannaccare, G.; Buzzi, M.; Fresina, M.; Velati, C.; Versura, P. Efficacy of 2-month treatment with cord blood serum eye drops in ocular surface disease: An in vivo confocal microscopy study. Cornea 2017, 36, 915–921. [Google Scholar] [CrossRef]
  40. Chinnery, H.R.; Rajan, R.; Jiao, H.; Wu, M.; Zhang, A.C.; De Silva, M.E.H.; Makrai, E.; Stepp, M.A.; Di Girolamo, N.; Downie, L.E. Identification of presumed corneal neuromas and microneuromas using laser-scanning in vivo confocal microscopy: A systematic review. Br. J. Ophthalmol. 2021, 10, 1136. [Google Scholar] [CrossRef]
  41. Pulvers, J.N.; Marx, G. Factors associated with the development and severity of oxaliplatin-induced peripheral neuropathy: A systematic review. Asia-Pac. J. Clin. Oncol. 2017, 13, 345–355. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Scatterplot of corneal nerve fibre density of participants at baseline assessment showing the spread of corneal nerve density at baseline. Note a group of patients with a baseline density below 15 mm/mm2.
Figure 1. Scatterplot of corneal nerve fibre density of participants at baseline assessment showing the spread of corneal nerve density at baseline. Note a group of patients with a baseline density below 15 mm/mm2.
Jcm 11 04770 g001
Figure 2. Box and whisker plot of change in corneal nerve fibre density over time. Whiskers represent 95% confidence intervals.
Figure 2. Box and whisker plot of change in corneal nerve fibre density over time. Whiskers represent 95% confidence intervals.
Jcm 11 04770 g002
Figure 3. (left) comparability of sub-basal nerve density measurement using deepNerve and manual tracing expressed as mm/mm2; (right) Bland and Altman plot to compare manual tracing and deepNerve to measure sub-basal nerve density.
Figure 3. (left) comparability of sub-basal nerve density measurement using deepNerve and manual tracing expressed as mm/mm2; (right) Bland and Altman plot to compare manual tracing and deepNerve to measure sub-basal nerve density.
Jcm 11 04770 g003
Figure 4. Representative central corneal IVCM images. Arrows highlight neuromas (A,B) and dendritic cells (C,D), identified on the images obtained from the central cornea sub-basal nerve plexus of patients undergoing oxaliplatin chemotherapy for colorectal cancer. Scale bar = 100 µm.
Figure 4. Representative central corneal IVCM images. Arrows highlight neuromas (A,B) and dendritic cells (C,D), identified on the images obtained from the central cornea sub-basal nerve plexus of patients undergoing oxaliplatin chemotherapy for colorectal cancer. Scale bar = 100 µm.
Jcm 11 04770 g004
Table 1. Means of corneal nerve density and corneal sensitivity threshold at each visit with standard deviations noted. The presence of dendritic cells, neuromas and neuropathy, alongside total neuropathy score and nerve conduction study (NCS) scores are along with the number of patients with Relative Afferent Pupillary Defect (RAPD) and retinal abnormalities are shown. NCS was only done at baseline and at 20 weeks. n = number of patients.
Table 1. Means of corneal nerve density and corneal sensitivity threshold at each visit with standard deviations noted. The presence of dendritic cells, neuromas and neuropathy, alongside total neuropathy score and nerve conduction study (NCS) scores are along with the number of patients with Relative Afferent Pupillary Defect (RAPD) and retinal abnormalities are shown. NCS was only done at baseline and at 20 weeks. n = number of patients.
Baseline 6 Weeks 12 Weeks20 Weeks 36 Weeks 52 Weeks
n = 23n = 20n = 22n = 18n = 6n = 11
Corneal sub-basal nerve density 15.91 ± 6.214.73 ± 6.814.74 ± 5.815.51 ± 4.817.51 ± 4.914.91 ± 4.9
Presence of dendritic cells (n)1137414
Presence of neuromas (n)9106833
Corneal sensitivity threshold 0.39 ± 0.10.38 ± 0.20.49 ± 0.30.47 ± 0.30.25 ± 0.30.19 ± 0.3
Presence of peripheral neuropathy (n) (NCS or TNS) 616171633
TNS score (0–30)Median01353.50
Range00–70–70–130–130–14
NCS (0–10)Median0 6
Range0 (n = 10) 0–6 (n = 9)
Presence of RAPD (n) 000000
Retinal abnormalities (n) 000000
Table 2. The corneal nerve density (CND) of each patient at each follow-up assessment and the final patient outcome at the completion of the follow-up time frame and reasons for dropout. Patients 1, 6, 8, 13, 15 and 17 showed a decrease (light grey), whereas patients 4, 5, 7, 18 and 22 showed an increase (dark grey) in corneal nerve density.
Table 2. The corneal nerve density (CND) of each patient at each follow-up assessment and the final patient outcome at the completion of the follow-up time frame and reasons for dropout. Patients 1, 6, 8, 13, 15 and 17 showed a decrease (light grey), whereas patients 4, 5, 7, 18 and 22 showed an increase (dark grey) in corneal nerve density.
Baseline CND6 Weeks CND12 Weeks CND20 Weeks CND36 Weeks CND52 Weeks CNDPatient Outcome
Patient 117.9411.9812.47 Deceased prior to 20 weeks
Patient 218.0220.6215.3619.84 Disease progression at 20 weeks and referred to hospice
Patient 312.2312.188.9914.0611.9112.01Completed follow up
Patient 46.534.436.6110.26 Disease progression at 20 weeks Rx 2nd line treatment. Lost to follow up
Patient 515.9519.8316.5920.0524.9124.82Completed follow up
Patient 69.855.826.04 Moved overseas and deceased
Patient 77.7314.4914.4915.4113.3813.38Completed follow up
Patient 826.1920.7814.1617.3121.113.33Completed follow up
Patient 912.8912.9612.9614.61 12.88Completed follow up
Patient 1022.0217.8217.0614.8216.3716.37Completed follow up
Patient 1128.6630.1130.11 Had a stroke, chemotherapy terminated and too unwell to attend clinics
Patient 1220.19 18.73 Disease progression at 20 weeks and Rx 2nd line treatment. Lost to follow up
Patient 1324.6715.349.1311.92 Offered resection of metastases at 20 weeks, no response to contact thereafter
Patient 1413.18 11.68 Too unwell to attend
Patient 1518.717.5219.817.28 9.9Completed follow up
Patient 1620.8623.9623.9622.17 Lost to follow up after completion of Rx
Patient 1711.276.77 5.99 Lost to follow up after completion of Rx
Patient 189.74 10.948.9915.2517.3Completed follow up
Patient 1916.6313.820.2819.34 20.34Completed follow up
Patient 2011.1617.3915.6415.64 16.39Completed follow up
Patient 218.896.2313.289.31 7.29Completed follow up
Patient 2211.217.927.9218.63 Lost to follow up after completion of Rx
Patient 2321.55 18.123.61 Lost to follow up after completion of Rx
Table 3. Spearman’s rho correlation between corneal nerve density vs. total neuropathy score and corneal nerve density vs. cumulative dose of oxaliplatin was computed. The correlation analysis was not possible at 36 weeks due to missing data. Asterisk * indicates statistically significant results.
Table 3. Spearman’s rho correlation between corneal nerve density vs. total neuropathy score and corneal nerve density vs. cumulative dose of oxaliplatin was computed. The correlation analysis was not possible at 36 weeks due to missing data. Asterisk * indicates statistically significant results.
Baseline 6 Weeks 12 Weeks20 Weeks 52 Weeks
n = 23n = 20n = 22n = 18n = 11
Corneal nerve density vs. TNSr−0.04−0.40.15−0.1−0.48
p0.830.090.540.690.13
Corneal sensitivity vs. TNSr0.120.340.55 *0.64 *0.05
p0.570.170.01 *0.006 *0.88
Corneal nerve density vs. r 0.080.10.610.12
Cumulative dose of oxaliplatinp 0.740.690.010.72
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Tyler, E.F.; McGhee, C.N.J.; Lawrence, B.; Braatvedt, G.D.; Mankowski, J.L.; Oakley, J.D.; Sethi, S.; Misra, S.L. Corneal Nerve Changes Observed by In Vivo Confocal Microscopy in Patients Receiving Oxaliplatin for Colorectal Cancer: The COCO Study. J. Clin. Med. 2022, 11, 4770. https://doi.org/10.3390/jcm11164770

AMA Style

Tyler EF, McGhee CNJ, Lawrence B, Braatvedt GD, Mankowski JL, Oakley JD, Sethi S, Misra SL. Corneal Nerve Changes Observed by In Vivo Confocal Microscopy in Patients Receiving Oxaliplatin for Colorectal Cancer: The COCO Study. Journal of Clinical Medicine. 2022; 11(16):4770. https://doi.org/10.3390/jcm11164770

Chicago/Turabian Style

Tyler, Ellen F., Charles N. J. McGhee, Benjamin Lawrence, Geoffrey D. Braatvedt, Joseph L. Mankowski, Jonathan D. Oakley, Sargun Sethi, and Stuti L. Misra. 2022. "Corneal Nerve Changes Observed by In Vivo Confocal Microscopy in Patients Receiving Oxaliplatin for Colorectal Cancer: The COCO Study" Journal of Clinical Medicine 11, no. 16: 4770. https://doi.org/10.3390/jcm11164770

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop