Next Article in Journal
Foliar Zinc-Selenium and Nitrogen Fertilization Affects Content of Zn, Fe, Se, P, and Cd in Wheat Grain
Previous Article in Journal
Bioactivity-Guided Extract Optimization of Osmanthus fragrans var. aurantiacus Leaves and Anti-Inflammatory Activities of Phillyrin
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Raman Spectroscopy and Machine-Learning for Early Detection of Bacterial Canker of Tomato: The Asymptomatic Disease Condition

by
Moisés Roberto Vallejo-Pérez
1,2,*,
Jesús Antonio Sosa-Herrera
3,
Hugo Ricardo Navarro-Contreras
2,
Luz Gabriela Álvarez-Preciado
2,
Ángel Gabriel Rodríguez-Vázquez
2 and
José Pablo Lara-Ávila
4
1
Consejo Nacional de Ciencia y Tecnología-Universidad Autónoma de San Luis Potosí, CIACYT, Alvaro Obregon 64, Col. Centro, San Luis Potosí 78000, Mexico
2
Coordinación para la Innovación y la Aplicación de la Ciencia y la Tecnología (CIACYT), Universidad Autónoma de San Luis Potosí, Av. Sierra Leona 550, Col Lomas 2a. Sección, San Luis Potosí 78210, Mexico
3
Consejo Nacional de Ciencia y Tecnología-Centro de Investigación en Ciencias de Información Geoespacial A. C., Laboratorio Nacional de Geointeligencia, Aguascalientes 20313, Mexico
4
Facultad de Agronomía y Veterinaria, Universidad Autónoma de San Luis Potosí, Km. 14.5 Carretera San Luis Potosí, Matehuala, Ejido Palma de la Cruz, Soledad de Graciano Sánchez, San Luis Potosí 78321, Mexico
*
Author to whom correspondence should be addressed.
Plants 2021, 10(8), 1542; https://doi.org/10.3390/plants10081542
Submission received: 11 June 2021 / Revised: 17 July 2021 / Accepted: 22 July 2021 / Published: 28 July 2021
(This article belongs to the Section Plant Protection and Biotic Interactions)

Abstract

:
Bacterial canker of tomato is caused by Clavibacter michiganensis subsp. michiganensis (Cmm). The disease is highly destructive, because it produces latent asymptomatic infections that favor contagion rates. The present research aims consisted on the implementation of Raman spectroscopy (RS) and machine-learning spectral analysis as a method for the early disease detection. Raman spectra were obtained from infected asymptomatic tomato plants (BCTo) and healthy controls (HTo) with 785 nm excitation laser micro-Raman spectrometer. Spectral data were normalized and processed by principal component analysis (PCA), then the classifiers algorithms multilayer perceptron (PCA + MLP) and linear discriminant analysis (PCA + LDA) were implemented. Bacterial isolation and identification (16S rRNA gene sequencing) were realized of each plant studied. The Raman spectra obtained from tomato leaf samples of HTo and BCTo exhibited peaks associated to cellular components, and the most prominent vibrational bands were assigned to carbohydrates, carotenoids, chlorophyll, and phenolic compounds. Biochemical changes were also detectable in the Raman spectral patterns. Raman bands associated with triterpenoids and flavonoids compounds can be considered as indicators of Cmm infection during the asymptomatic stage. RS is an efficient, fast and reliable technology to differentiate the tomato health condition (BCTo or HTo). The analytical method showed high performance values of sensitivity, specificity and accuracy, among others.

Graphical Abstract

1. Introduction

The world population is rising continuously, therefore, it is essential to maintain an adequate food supply in order to satisfy the nutritional requirements of people living in urban and rural areas. The increase of crop productivity, without causing farmland degradation and overexploitation of natural resources poses a great challenge to producers. The adoption of improved agricultural practices contributes to increase crop efficiency, but food security is threatened by outbreaks of pests and plant diseases [1]. Therefore, highly efficient technologies applied for monitoring plant health are necessary, and those that provide an early detection of potential phytosanitary problems are strongly desired [2].
Tomato (Solanum lycopersicum L.) cultivars can be infected by Clavibacter michiganensis subsp. michiganensis (Cmm); a plant pathogenic actinomycete considered to be the causal agent of bacterial canker of tomato (BCTo). Cmm is directly responsible of important economic losses in tomato-growing areas worldwide and it is classified as a quarantine organism [3]. Potential yield losses can be severe (20–84%), but they vary according to year, phenological stage of host infection, cultivar, cultural practices, etc. [4]. There are no Cmm-resistant tomato cultivars and chemical control is not effective [5]. Bacteria can survive in soil and organic debris for several years, so preventive practices are the best alternative for its control, because bacterial dispersion is favored by cultural practices and irrigation [6,7]. The generation of fast, sensitive and cost-efficient methods is necessary for early disease detection. The European and Mediterranean Plant Protection Organization (OEPP/EPPO) has proposed a standard diagnostic protocol to isolate and identify the Cmm bacterium from plants and seeds [3]. The advantages and disadvantages considering the sensitivity and specificity of each diagnostic method, are discussed in [8,9,10]. The standard methods to diagnose and identify the causal agent Cmm involve bacterial isolation from the host tissue and its growth in a semi-selective media. Then bacterial colonies with suspicious cultural morphology are purified and analyzed by biochemical, serological, or molecular methods [3]. The diagnostic procedure is usually labor intensive, costly, and requires specialized technical training and scientific equipment.
BCTo disease detection in the field is currently based on the visual search of typical symptoms in the plant, such as the unilateral wilting of leaflets and leaves, the presence of corky spots on the stems and petioles, marginal leaf necrosis and internal stem discoloration, which can lead to sudden plant wilting and death [9]. However, the number of infected plants is usually higher than those with visible symptoms, and in many cases, the contagionʼs incidence is underestimated because Cmm can produce latent asymptomatic infections [7,11]. Previous works have found evidence that Cmm behaves as an endophyte during early stages of infection but, over time, the bacterium changes its behavior inducing disease symptoms. The transition from endophyte to pathogen is governed by the expression of putative virulence factors and the evasion or suppression of plant defense reactions. The phenomenon is modulated by bacterial population density (quorum-sensing), plant age, genetic diversity and the prevalent environmental conditions [4,8,9,10].
Raman spectroscopy (RS) is a spectroscopic technique used to determine the vibrational modes of molecules by recording the inelastic scattering of photons. A major technological innovation occurred with the invention of solid-state continuous wavelength lasers and highly stable CCDs that allowed Raman spectrometer miniaturization and portability. Currently, RS is implemented in multiple research areas, and its application in plant pathology are focused on early disease detection, because RS can differentiate diseased plants based on the biochemical changes induced by a specific phytopathogen during the plant-pathogen interaction [12]. RS procedures are fast, non-invasive and does not require previous sample preparations [13]. Several plant diseases with diverse etiology have been already studied using RS with the intention of performing an early plant disease diagnostic: Candidatus Liberibacter asiaticus and Xanthomonas axonopodis pv. citri bacterial pathogens in orange [Citrus x sinensis (L.) Osbeck] [14,15,16], pepper mild mottle virus (PMMoV) and Obuda pepper virus (ObPV) in chili crops (Capsicum annuum L.) [17]; Tomato yellow leaf curl Sardinia virus (TYLCSV) and tomato spotted wilt virus (TSWV) in tomato cultivars (S. lycopersicum) [18], the fungus Aspergillus flavus, A. niger, Fusarium spp., and, Diplodia spp., affecting maize grain (Zea mays L.) [19], the abutilon mosaic virus (AbMV) affecting abutilon (Abutilum hybridum Voss) cultivars [20] and the diagnosis of rose rosette disease (Rosa spp.) caused by the rose rosette virus (RRV) which is transmitted by eriophyid mites [21], among others.
Considering the aforementioned, the present research aim consists on the implementation of RS as a method for the early detection of the bacterial canker of tomato (BCTo), and thus, being able to differente the asymptomatic diseased plants from the healthy ones. At the same time, we also performed the quantitative validation of this technique as a preventive, rapid and accurate diagnostic tool.

2. Materials and Methods

2.1. Experimental Setup

Tomato seeds (S. lycopersicum) of Seminis® Reserva F1 variety (Bayer AG, Leverkusen, Germany) were germinated in peat moss (Premier Horticulture Inc., Rivière-du Loup, QC, Canada), transplanted and kept in plastic containers. Subsequently, tomato plants at the four-leaf stage were infected with Cmm bacteria according to the procedure described by [5] to compose the infected plants treatment (BCTo). The healthy control plants (HTo) were inoculated with sterilized water under the same experimental conditions. Each treatment was on sets of ten plants and the experiment was repeated under the same conditions in order to verify the observed results. Cultural practices were done in accordance to local recommendations [22] and growth temperature was 23 ± 2 °C.

2.2. Raman Spectra Data Acquisition

Treatments were analyzed 30 days after the inoculation (DAI). The procedure consisted of randomly selecting three asymptomatic leaves from each asymptomatic plant. Leaf samples with no nutrient deficiency symptoms, chlorosis, physical damage, nor strange particles such as residues from insects or dust were selected. The leaves were rinsed with deionized sterile water and once dried leaflets were cut, and immediately analyzed at two-four points on the adaxial side. The Raman spectra were recorded by using a Horiba XploRA ONE™ confocal microscope spectrometer (Horiba Scientific, Ltd., Minami-ku, OP, Japan) equipped with a 785 nm DPSS laser, CCD photodetector and 2 cm−1 of spectral resolution. The Raman measurement conditions were 800–1800 cm−1 of spectral range, 10 s of acquisition time, 5 accumulations, ≈20 mW laser power, 1200 gr/mm grating, 100 μm slit, 300 μm hole and 20x magnification objective (micro spot with 10 μm ø). The calibration was performed daily by recording the Raman signal of a silicon wafer. In total, 177 spectra were obtained from infected plants (BCTo) and 120 spectra from the healthy control plants (HTo). Raman spectra shown in this work correspond to the raw baseline corrected results.

2.3. DNA Confirmatory Diagnosis

Bacterial isolation was done from vascular tissue of each tomato plant studied. The extracted tissue (0.5 g) was immersed in 20 mL of saline solution (NaCl 0.85%) and later 50 μL of the suspension were seeded in Petri dishes with yeast peptone glucose agar (YPGA) solid medium, and incubated at 28 °C. The isolated colonies with typical morphology to Cmm were identified by using 16S rRNA gene sequencing [3,23]. Single bacterial colonies were grown in NBY broth (nutrient broth 8 g/L, yeast extract 2 g/L, glucose 5 g/L, MgSO4 7H2O 0.24 g/L) for 24 h at 28 °C. The bacterial cell pellets were harvested (centrifuged at 12,000 rpm/10 min) and resuspended in lysis buffer (Tris-HCl 50 mM, EDTA 50 mM, SDS 3%), and incubated at 65 °C for 40 min. The lysates were mixed with an equal volume of phenol:chloroform:isoamyl alcohol (25:24:1) and centrifuged at 13,000 rpm for 5 min. The aqueous phases were then transferred to a new Eppendorf tube and mixed with 100 μL sodium acetate (3 M) and 1 mL of cold ethanol (−20 °C). The mixes were incubated on ice for 25 min and centrifuged at 13,000 rpm for 15 min. The supernatants were decanted, the DNA pellets were washed with 500 μL of ethanol 70% and centrifuged at 13,000 rpm for 2 min. The ethanol was decanted, and the DNA pellets were dried at room temperature. The pellets were resuspended in 50 μL of sterile Milli-Q® water and stored at −20 °C. A fragment of 16S rRNA gene was PCR amplified using the universal primers F27 (5′-AGAGTTTGATCMTGGCTCAG-3′) and R1492 (5′-TACGGYTACCTTGTTACGACTT-3′) [24]. PCR products of expected sizes were purified and sequenced. The partial sequences of 16S rRNA genes were analyzed using Basic Local Alignment Search Tool Ver. 2.9.0 (BLASTn) at National Center for Biotechnology Information (NCBI, Bethesda, MD, USA) to identify strains for similarity comparison at the DNA sequence level [25].

2.4. Chemometric Analysis

In order to have an automated characterization of the spectral features from healthy (HTo) and asymptomatic infected plants (BCTo), the original spectra were first preprocessed by eliminating the background fluorescence by subtracting a fifth-order polynomial [26]. Once the baseline correction was done, a standard normal variate (SNV) normalization was applied taking in all the available data samples [27]. SNV normalization is given by applying the following equation:
s n i = s i s i ¯ 1 N ( s i s i ¯ ) 2 / ( N 1 )
where s n i is the entry corresponding to the i-th wavenumber (Raman shift) of the normalized vector, which correspond to the i-th Raman shift of each spectral raw data vector after the detrending process by subtraction of the fifth-order polynomial; it stands for the mean of all vectors and represents the total number of samples. Previous works [28,29] proposed to normalize Raman spectra to specific vibrational bands, because spectral intensities can vary with coloration of each specimen, and symptoms induced by biotic (phytopathogens) or abiotic (nutrient deficiencies) factors [30]. However, BCTo disease is characterized by the lack of symptoms during early disease stages, so we use SNV normalization due to the particularities of the analyzed pathosystem [10].
After data was prepossessed, we implemented the following sequence of algorithms using the Python programing language [31] for a mechanized feature extraction procedure. Starting by computing the first principal components (PCs) [32] of the set of vectors obtained by normalizing the debased numeric values of Raman spectra for the samples. These PCs were calculated by employing the Sklearn scientific programming libraries [33], as well as the corresponding fractions of explained variances for each PC. Once these data were obtained, with the intention of determining the spectral wavenumbers that have the greatest influence over the PCs, we developed a mechanism for the inspection of the coefficients of the correlation matrix obtained by the factor analysis procedure [34]. The criterion used to select the most important wavenumber for the classification was to consider those which’s associated correlation factors (loadings) satisfy the following inequality:
2 N i = 1 n | c i | σ i | c m a x |
where c i is the correlation between the PC i with the Raman shift to be analyzed, σ i is the explained variance for PC i , and | c m a x | represents the maximum of the absolute values of the correlation matrix. In this way, we manage to assign the largest weight to the correlations associated with the PCs that explain most of the variance among the spectral samples. With this set of wavenumber values, we created a sequence of continuous intervals, which were related to the vibrational modes of the compounds that differentiate the plant samples into the HTo (healthy) and BCTo (asymptomatic infected) classes. These spectrum areas give the main wavenumber intervals that reveal the largest contributions to the variances between both types of samples. The procedures described above convert such differences into a comparative metric for the quantitative description of the intervals with most influence in the classification. With the purpose of providing predictive capabilities to this methodology to differentiate their health condition (BCTo or HTo), we employed a classifier implemented by a neural network of the multilayer perceptron (MLP) type [35] employing the Sklearn library. A model with 1000 hidden layers was used with the logistic function acting as activation rule. To train the neural network, the Raman spectra were divided into two subsets. By doing so, 70% of the samples were used as a training set, the remaining 30% of the spectra were used for validation, such dataset division is commonly employed in artificial intelligence (AI) training stages in order to avoid overfitting [36] and as it is influenced by the proportion rather than the number of samples taken. Additionally, a classic classifier based on internal and external class variations was employed. The method of linear discriminant analysis (LDA) [37] was added in order to have comparative metrics and to ensure that the classification is not dependent on the classifier method, but on the information contained in the spectral samples. In the two classification models employed on this research, PCA is used for feature extraction, and then a classifier is applied over such features represented by the principal components after the criterion stated in Equation (2) is applied. Thus, comparing performances on disease detection with each of the two classifiers operating on the principal components of the spectra, we executed both procedures in combination with the principal component analysis (PCA). We identify each mechanism as (PCA + MLP) when a neural network is being used on the principal components and as (PCA + LDA) for the classifier using the principal components with the linear discriminant analysis. For each classifier we evaluate their performance with sensitivity values (SENS), specificity (SPEC), accuracy (ACC), positive prediction values (PPV), negative prediction values (NPV) and F1-Score. The equations employed in terms of true positives (TP), false positives (FP), true negatives (TN) and false negatives (FN) are described in [38].
To make sure that classifier agreement results are not influenced by chance, we evaluated the Cohen’s kappa coefficient [39] given by:
K = ( p o p e ) ( 1 p e )
where p o is the measured agreement between classifications and p e represents the probability for the classifications to be in agreement.

3. Results and Discussion

The group of infected plants (BCTo) remained asymptomatic during the evaluation, and they only displayed a general growth reduction as described by [40]. Bacterial colonies were isolated in YPGA medium from the BCTo group, and these colonies were circular, convex, with smooth edges and mucoid texture, opaque, of yellowish color and Gram (+) bacillus. Such features correspond to the ones described for Cmm [3]. The isolated strains were identified by sequencing a > 1 kilobase (kb) of genomic region 16S rRNA gene fragment and searching for homology at DNA level with BLASTn in NCBI. The analysis allowed to classify the isolated strains as related to Clavibacter michiganensis subsp. michiganensis when comparing with the reference sequences (NCBI Accession Number: HQ144239.1, KR922121.1, KR922121.1, HQ144230.1). No bacterial colonies similar to Cmm were isolated from control plants (HTo).
Bacterial isolation and DNA analysis (standard diagnostic protocol) confirmed the plants health condition: asymptomatic infected (BCTo) and healthy (HTo), so Raman spectroscopy is used to determine changes in plant metabolism of both groups, to provide a confirmatory diagnostic of the bacterial canker of tomato disease induced by Cmm. Previous studies have demonstrated that RS can allows to rapid confirmatory diagnostic, before symptoms onset [18,29].

3.1. Spectral Differences between Groups: HTo and BCTo

The Raman spectra obtained from tomato leaves of healthy (HTo) and infected plants (BCTo) exhibited peaks associated to cellular components, and the most prominent vibrational bands were associated to monomeric and polymeric carbohydrates, carotenoids, chlorophyll, and phenolic compounds (Table 1). The compatible pathogen-plant interaction (Cmm-tomato) is an extremely complex biological system, because Cmm can manipulate the plant metabolism and evade defense responses allowing the bacteria to multiply and to shift from an endophytic to a pathogenic state, the process induce latent asymptomatic infections [10]. Biochemical alterations induced during the tomato-Cmm interaction were also detectable in the Raman spectral patterns (Figure 1).
BCTo group displayed an increased relative intensity at 1037–1090 cm−1 region, and bands of 1070 and 1310 cm−1, which are related to cellulose polymers [41,42]. The 1112 cm−1 wavenumber showed a higher relative intensity, the band is associated to carbohydrates monomer [18]; which suggests possible degradation processes on cell walls [4]. Different enzymes produced by Cmm take part in the degradation of cell walls during the infection process and these are responsible for the virulence of the pathogen [9,10].
Table 1. Vibrational bands and their assignments for tomato leaves.
Table 1. Vibrational bands and their assignments for tomato leaves.
Band (cm−1)Vibrational ModeMolecular Assignation
915ν(C-O-H) in plane, symmetricCellulose, lignin [41]
985δ(CH3)Chlorophylls [43]
1001δ(C-CH3)Carotenoids [44,45]
1037–1090CC and CO stretchingCellulose [42]
1070ν(CO)Cellulose [41]
1112δ(C-OH)Carbohydrates [18]
1156ν(C-C)Carotenoids [44,45]
1180ν(C-C) γ(CH)Chlorophylls [18,46]
1227δ(CCH)Cuticle Triterpenoids [41]
1263(=CH)Carotenoids [18]
1284δ(phenyl-OH)Phenolics [44]
1310δCH2 bendingCellulose [41]
1328δ(CH)·ν(CN)Chlorophylls, Pyrrole ring br.- [18]
1350CH3 BendChlorophylls [46]
1370C-H deformation (asymmetric)Lignin [47]
1384δCH2 bendingAliphatic [48]
1435δ(CH2), δ(CH3)Cuticle Triterpenoids [48]
1462δ(CH2), δ(CH3)
1482δ(CH2), δ(CH3)
1522ν1(C=C)Carotenoids [44]
1545C=O stretchingFlavonoids [49]
1600C=C (aromatic ring)Lignin [47]
1620β sheetProteins [50]
1665β sheetAmide I [51,52]
1680Cycl. [ν(C=O)]Flavonoids [49]
1690β turnProteins [50]
Diverse reports state that Cmm-infected plants accumulate phenolic compounds, such as lignin and callose, at their xylem tissues [53,54], the lignin are cross-linked phenolic polymers that also form part of cell walls, the associated bands exhibited an enhancement at 1370 and 1600 cm−1 [47]. Other Raman bands assigned to phenolic nature compounds also showed changes in the relative intensity, because the 1284 cm−1 wavenumber increased in diseased plants (BCTo). Flavonoids are substances considered with antimicrobial activity [53]. The healthy tomato group (HTo) showed higher intensity at 1545 and 1680 cm−1 wavenumbers, both Raman bands associated to flavonoids [49], which can be considered as indicators of Cmm infection during the asymptomatic stage.
Triterpenoids are compounds commonly found in plant cuticular wax, which have important functions, such as protection against pathogens [41,48]. The bands associated to triterpenoid compounds at 1227 [41], 1435, 1462 and 1482 cm−1 [48] showed an intensity difference between HTo and BCTo groups. Histological studies reported by [55] have stated that tomato plants infected by Cmm showed changes in the deposition of waxy substances on epidermal cells. Later, the thickening and lignification of cell walls were observed in infected plants. Changes on Raman bands associated with triterpenoids are important indicators of Cmm-infected plants during the asymptomatic stage.
Plants have a basal system for defense, and a second system based on signals that induce the activation of genes to deal with infections in progress [56,57]. Cmm has the ability of inhibiting these defense mechanisms in the tomato plants, because peroxidases and other enzymes are generally downregulated, while maintaining the functional photosynthetic activity [58,59]. In addition, during the oxidative stress induced by the infection process [58], the carotenoid compounds reduce the concentration of oxygen reactive species (ROS) [60] and, consequently, the stability of cell membranes and photosynthetic activity are maintained [61]. The representative chlorophyll Raman bands (985, 1180 and 1350 cm−1) remained more or less stable, only slightly increasing their relative intensity in the infected plants group (BCTo). The bands associated with carotenoid compounds showed similar behavior between the analyzed groups (HTo and BCTo), and these were represented by wavenumbers of 1001, 1156 and 1263, but the band at 1522 cm−1 has higher intensity in the healthy group (HTo).
Finally, changes were detected in the intensities of 1665 and 1690 cm−1 in the healthy tomato group (HTo), which can be assigned to proteins [50,51,52], this change probably indicates the plant long distance signaling transduction triggered by the biotic stressor (Cmm bacteria), characterized by the down-regulation of genes at early stages of Cmm infection [59].
The previously described observations match the biochemical changes induced by Cmm in tomato plant [8,9,10]. Previous works have demonstrated that RS techniques provide a clear differentiation between biotic stress (bacterial infection), abiotic stress (nutritional deficiencies) and healthy plants [16]. RS has the sensitivity to differentiate a simple or multiple viral infection in the same host [18,62], including the presence of secondary infections [30]. Additional works are required to determine the Raman spectral specificities to the different diseases that affect tomato plant.

3.2. Chemometric Analysis and Spectral Classification

By using the PCA methodology, components of the six eigenvalues with the largest absolute contributing values to the spectral differences were obtained. These first 6 PCs explained up to 82% of the variance in the Raman spectra of the analyzed samples. The choice of use of PCA for feature extraction is based on the fact that the most spectral samples are linearly separable by hyperplanes in the component spaces [32] defined by PC1 to PC3 and PC4 to PC6 (Figure 2).
The absolute loading values are represented in Figure 3, they show which wavenumbers have bigger correlations with the features (in our case, principal components) that make the largest distinctions between Raman spectra corresponding to healthy (HTo) and the asymptomatic tomato infected plants (BCTo). The correlation matrix involved in the PCA process was examined under the procedure described in the methodology section of this document to automatically detect the spectral band intervals, which are associated to chemical species of interest (Table 1) considered as disease markers [18].
The main wavenumbers in the first principal components, can be thought as the ones implicated with the changes of Raman intensity bands associated to the biochemical compounds that distinguish the infected plants from healthy ones [18,30]. Therefore, the largest loadings and the associated wavenumbers with their respective related chemical compounds. Although, there are other features not presented with large influence in the correlation matrix for the first PCs (Figure 3), such characteristics cannot be directly associated to changes of Raman intensity bands associated to biochemical compound of interest. The larger correlation values (0.01–0.02) were associated to compounds from the photosynthetic system (chlorophyll and carotenoids), the cell walls components (cellulose and lignin) and other substances considered as antimicrobial metabolites (phenolic and flavonoids). It is worth noting that while Figure 1 depicts only the centroids of the spectra for the two HTo and BCTo sets, their respective variances are not considered in the figure. Therefore, it is difficult in this case, if not impossible, to effectively make a characterization of the two groups by only considering spectral centroids. Such centroids are not used by the feature extraction procedure employed here. Instead, a combination of PCs and linear discriminant loading-based criteria determined by Equation (2) is used. Variances are best analyzed along principal component axes, and that is the justification for which PCA are taken as input for the proposed classifier. On the other hand, we found that, considering principal components, the spectra samples exhibited great class separability between the two groups on the feature spaces regarding PC1–3 and PC 4–5, depicted at Figure 2. It is important to note that, in comparison with the centroids of the spectra shown in Figure 1, where some important bands present similar average values, as should be expected due to the fact that most infected plants were asymptomatic, PC vectors plotted in Figure 2 are distributed in a more separable manner. This separability comes from the different behavior presented by the variances of each group along the considered range of the spectra for both classes and is quantitatively computed by the LDA method. To make sure that such separability correlates to BCTo-associated compounds, the automated technique described in the methodology section was executed, the results showed that many of the wavenumbers that have larger contributions to the main PCs, corresponded to chemical compound associated to the compatible pathogen-plant interaction as described in the previous section.
The classifiers algorithms multilayer perceptron (PCA + MLP) and linear discriminant analysis (PCA + LDA) can differentiate the classes analyzed (HTo and BCTo). Performance of the PCA + MLP and PCA + LDA classifiers presented high sensitivity values in both cases (1.0), but the specificity was superior for PCA + MLP (0.95) compared to the PCA + LDA (0.88) classifier. The accuracy and positive predictive value were slightly higher in PCA + MLP (0.99 and 0.98) when compared to PCA + LDA (0.97 and 0.97), respectively. The metric parameters NPV and F1-score showed adequate performance for both classifiers (1.0 and 0.99). Performance measurements for the classification strategies employed in this works are shown in Table 2. The few cases that cannot be easily distinguished in a linear fashion (LDA), the multilayer perceptron (MLP) can operate over features in a non-linear way, which is probably the reason for its superior performance. Therefore, the steps described in the sections above provide a way to detect asymptomatic infected plants, by means of Raman spectroscopy.
Cohen’s kappa coefficients were obtained between the two classifiers PCA + MLP and PCA + LDA ( κ m l p l d a ) and for each of them with accordance to the ground truth ( κ m l p g n d ) and ( κ l d a g n d ) respectively according to Equation (3). Table 3 shows the coefficients resulted from each calculation.
All values shown in Table 3 are close to 1, which means that the agreement on class labels obtained is not influenced by chance, and that the result is not dependent on the classifier. Besides, having ( κ m l p g n d )   as the value nearest to 1, confirms that the method using the neural network is more accurate with respect to the ground truth than the more traditional PCA + LDA approach.

4. Conclusions

Early detection of bacterial canker of tomato is essential for epidemiological monitoring and plant disease management. The present work has demonstrated the usefulness of Raman spectroscopy as an efficient, fast and reliable technology to differentiate the infected asymptomatic plants (BCTo) from their healthy counterparts (HTo), by means of Raman spectral signatures obtained from their developing leaves. The biochemical changes induced by the plant-pathogen interaction were detectable by Raman spectra and separable by machine-learning. The multilayer perceptron (MLP) and linear discriminant analysis (LDA) algorithms showed reliable performance values after data treatment by means of principal component analysis (PCA), but PCA + MLP was slightly compared to PCA + LDA. High accuracy in discerning asymptomatic infected plants from healthy ones with the procedures here described comes from the fact that the principal components of the spectra belonging to each group are distributed across highly separable sets on the principal component space. Despite having, at first glance, very similar spectral centroids, their respective variances differ significantly among spectral frequency bands, identified in this work by the wavenumbers that have larger contributions to the main PCs. These bands are associated the vibrational modes of key chemical compounds associated to the disease process, and such conditions were exploited for an effective detection of the infected plants with Cmm bacteria.

Author Contributions

Conceptualization, M.R.V.-P. and L.G.Á.-P.; study design and methodology, M.R.V.-P., J.A.S.-H. and J.P.L.-Á.; data collection, M.R.V.-P.; formal analysis, M.R.V.-P., J.A.S.-H. and H.R.N.-C.; writing, M.R.V.-P. and J.A.S.-H.; supervision, M.R.V.-P., J.A.S.-H., Á.G.R.-V. and H.R.N.-C. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Council of Science and Technology, México (CONACYT) through the Catedras CONACYT program (project 2210 and 2643) and the project CONACYT INFR-2015-254907.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data that support the findings of this study are available from the corresponding author upon reasonable request.

Acknowledgments

The authors acknowledge the access to the Raman spectrometer at Laboratorio Nacional de Análisis Físicos, Químicos y Biológicos-UASLP, during this research. Special thanks to anonymous reviewers for their constructive and precise observations.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. FAO. The Future of Food and Agriculture-Trends and Challenges. Food and Agriculture Organization of the United Nations. Rome. 2017. Available online: http://www.fao.org/3/i6583e/i6583e.pdf (accessed on 10 March 2020).
  2. Martinelli, F.; Scalenghe, R.; Davino, S.; Panno, S.; Scuderi, G.; Ruisi, P.; Stroppiana, D.; Boschetti, M.; Goulart, L.R.; Davis, C.E.; et al. Advanced methods of plant disease detection. A review. Agron. Sustain. Dev. 2015, 35, 1–25. [Google Scholar] [CrossRef] [Green Version]
  3. EPPO. PM 7/42 (3) Clavibacter michiganensis subsp. michiganensis. EPPO Bull. 2016, 46, 2002–2225. [Google Scholar] [CrossRef]
  4. Nandi, M.; Macdonald, J.; Liu, P.; Weselowski, B.; Yuan, Z.-C. Clavibacter michiganensis subsp. michiganensis: Bacterial canker of tomato, molecular interactions and disease management. Mol. Plant Pathol. 2018, 19, 2036–2050. [Google Scholar] [CrossRef] [Green Version]
  5. Sen, Y.; Feng, Z.; Vandenbroucke, H.; Van Der Wolf, J.; Visser, R.G.F.; Van Heusden, A.W. Screening for new sources of resistance to Clavibacter michiganensis subsp. michiganensis (Cmm) in tomato. Euphytica 2013, 190, 309–317. [Google Scholar] [CrossRef]
  6. Chang, R.J.; Ries, S.M.; Pataky, J.K. Dissemination of Clavibacter michiganensis subsp. michiganensis by practices used to produce tomato transplants. Phytopathology 1991, 81, 1276–1281. [Google Scholar] [CrossRef]
  7. Kawaguchi, A.; Tanina, K.; Inoue, K. Molecular typing and spread of Clavibacter michiganensis subsp. michiganensis in greenhouses in Japan. Plant Pathol. 2010, 59, 76–83. [Google Scholar] [CrossRef]
  8. Eichenlaub, R.; Gartemann, K.-H. The Clavibacter michiganensis subspecies: Molecular investigation of gram-positive bacterial plant pathogens. Annu. Rev. Phytopathol. 2011, 49, 445–464. [Google Scholar] [CrossRef]
  9. Sen, Y.; Van Der Wolf, J.; Visser, R.G.F.; Van Heausden, S. Bacterial canker of tomato: Current knowledge of detection, management, resistance and interactions. Plant Dis. 2015, 99, 4–13. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Martínez-Castro, E.; Jarquín-Gálvez, R.; Alpuche-Solís, A.G.; Vallejo-Pérez, M.R.; Colli-Mull, Á.; Lara-Ávila, J.P. Bacterial wilt and canker of tomato: Fundamentals of a complex biological system. Euphytica 2018, 214, 72. [Google Scholar] [CrossRef]
  11. Vallejo-Pérez, M.R.; Navarro-Contreras, H.R.; Sosa-Herrera, J.A.; Lara-Ávila, J.P.; Ramírez-Tobías, H.M.; Díaz-Barriga, F.; Flores-Ramírez, R.; Rodríguez, A.G. Detection of Clavibacter michiganensis subsp. michiganensis by Micro-Raman spectroscopy under laboratory conditions. Plant Pathol. J. 2018, 34, 381–392. [Google Scholar] [CrossRef]
  12. Payne, W.Z.; Kurouski, D. Raman-based diagnostics of biotic and abiotic stresses in plants. A review. Front. Plant. Sci. 2021, 11, 616672. [Google Scholar] [CrossRef]
  13. Alfadhl, Y.K.; Samsunana, A.A.; Siti, K.B.; Nazmi, M.N.; Idris, A.S.; Daniel, I.O. Early detection of diseases in plant tissue using spectroscopy application and limitations. Appl. Spectrosc. Rev. 2018, 53, 36–64. [Google Scholar] [CrossRef]
  14. Vallejo-Pérez, M.R.; Galindo, M.M.G.; Ramirez, E.M.G.; González, F.J.; Navarro-Contreras, H.R.; Contreras, S.C. Raman spectroscopy an option for the early detection of citrus Huanglongbing. Appl. Spectrosc. 2016, 70, 829–839. [Google Scholar] [CrossRef]
  15. Wang, K.; Liao, Y.; Meng, Y.; Jiao, X.; Huang, W.; Liu, T.C. The early, rapid, and non-invasive detection of citrus Huanglongbing (HLB) based on microscopic confocal Raman. Food Anal. Methods 2019, 12, 2500–2508. [Google Scholar] [CrossRef]
  16. Sanchez, L.; Pant, S.; Irey, M.; Mandadi, K.; Kurouski, D. Detection and identification of canker and blight on orange trees using hand-held Raman spectrometer. J. Raman Spectrosc. 2019, 50, 1875–1880. [Google Scholar] [CrossRef]
  17. Rys, M.; Juhász, C.; Surówka, E.; Janeczko, A.; Saja, D.; Tóbiás, I.; Skoczowski, A.; Barna, B.; Gullner, G. Comparison of a compatible and an incompatible pepper-tobamovirus interaction by biochemical and non-invasive techniques: Chlorophyll a fluorescence, isothermal calorimetry and FT-Raman spectroscopy. Plant Physiol. Biochem. 2014, 83, 267–278. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Mandrile, L.; Rotunno, S.; Miozzi, L.; Vaira, A.M.; Giovannozzi, A.M.; Rossi, A.M.; Noris, E. Non-destructive Raman spectroscopy as a tool for early detection and discrimination of the infection of tomato plants by two economically important viruses. Anal. Chem. 2019, 91, 9025–9031. [Google Scholar] [CrossRef]
  19. Farber, C.; Kurouski, D. Detection and identification of plant pathogens on maize kernels with a hand-held Raman spectrometer. Anal. Chem. 2018, 90, 3009–3012. [Google Scholar] [CrossRef] [Green Version]
  20. Yeturu, S.; Vargas-Jentzsch, P.; Ciobota, V.; Guerrero, R.; Garrido, P.; Ramos, L.A. Handheld Raman spectroscopy for the early detection of plant diseases: Abutilon mosaic virus infecting Abutilon sp. Anal. Methods 2016, 8, 3450–3457. [Google Scholar] [CrossRef]
  21. Farber, C.; Shires, M.; Ong, K.; Byrne, D.; Kurouski, D. Raman spectroscopy as an early detection tool for rose rosette infection. Planta 2019, 250, 1247–1254. [Google Scholar] [CrossRef]
  22. Jasso, C.C.; Martínez, G.M.A.; Chávez, V.J.R.; Ramírez, T.J.A.; Garza, U.E. Guía Para Cultivar Jitomate en Condiciones de Malla Sombra en San Luis Potosí; INIFAP: San Luis Potosí, Mexico, 2012; pp. 1–5. [Google Scholar]
  23. Medina-Salazar, S.A.; Rodríguez-Aguilar, M.; Vallejo-Pérez, M.R.; Flores-Ramírez, R.; Marín-Sánchez, J.; Aguilar-Benítez, G.; Jarquín-Gálvez, R.; Lara-Ávila, J.P. Biodiversity of epiphytic Pseudomonas strains isolated from leaves of pepper and lettuce. Biologia 2020, 75, 773–784. [Google Scholar] [CrossRef]
  24. Heuer, H.; Krsek, M.; Baker, P.; Smalla, K.; Wellington, E.M.H. Analysis of actinomycete communities by specific amplification of genes encoding 16S rRNA and gel electrophoretic separation in denaturing gradients. Appl. Environ. Microbiol. 1997, 63, 3233–3241. [Google Scholar] [CrossRef] [Green Version]
  25. Benson, D.A.; Karsch-Mizrachi, I.; Lipman, D.J.; Ostell, J.; Sayers, E.W. GenBank. Nucleic Acids Res. 2010, 38, D46–D51. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Zhao, J.; Lui, H.; MacLean, D.; Zeng, H. Automated autofluorescence background subtraction algorithm for biomedical spectroscopy. Appl. Spectrosc. 2007, 61, 1225–1232. [Google Scholar] [CrossRef]
  27. Gautam, R.; Vanga, S.; Ariese, F.; Umapathy, S. Review of multidimencional data processing approaches for Raman and Infrared spectroscopy. EPJ Tech. Instrum. 2015, 2, 8. [Google Scholar] [CrossRef] [Green Version]
  28. Krimmer, M.; Farber, C.; Kurouski, D. Rapid and noninvasive typing and assessment of nutrient content of maize kernels using a handheld Raman spectrometer. ACS Omega 2019, 4, 16330–16335. [Google Scholar] [CrossRef] [Green Version]
  29. Sanchez, L.; Ermolenkov, A.; Tang, X.-T.; Tamborindeguy, C.; Kurouski, D. Non-invasive diagnostics of Liberibacter disease on tomatoes using a hand-held Raman spectrometer. Planta 2020, 251, 64. [Google Scholar] [CrossRef]
  30. Sanchez, L.; Pant, S.; Xing, Z.; Mandadi, K.; Kurouski, D. Rapid and noninvasive diagnostics of huanglongbing and nutrient deficits on citrus trees with a handheld Raman spectrometer. Anal. Bioanal. Chem. 2019, 411, 3125–3133. [Google Scholar] [CrossRef]
  31. Van Rossum, G.; Drake, F.L. Python 3 Reference Manual; CreateSpac: Scotts Valley, CA, USA, 2009. [Google Scholar]
  32. Wold, S.; Esbensen, K.; Geladi, P. Principal component analysis. Chemom. Intell. Lab. Syst. 1987, 2, 37–52. [Google Scholar] [CrossRef]
  33. Pedregosa, F.; Varoquaux, G.F.; Rainey, F.A.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; et al. Scikit-Learn: Machine Learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar]
  34. Jolliffe, I.T. Principal Component Analysis; Springer Series in Statistics: New York, NY, USA, 2002. [Google Scholar]
  35. Pal, S.K.; Mitra, S. Multilayer perceptron, fuzzy sets, classification. IEEE Trans. Neural Netw. 1992, 3, 683–697. [Google Scholar] [CrossRef]
  36. Dreiseitl, S.; Ohno-Machado, L. Logistic regression and artificial neuronal network classification models: A methodology review. J. Biomed. Inform. 2002, 35, 352–359. [Google Scholar] [CrossRef] [Green Version]
  37. Balakrishnama, S.; Ganapathiraju, A. Linear Discriminant Analysis-A Brief Tutorial. Institute for Signal and Information Processing; Mississippi State University: Starkville, MI, USA, 1998; pp. 1–8. [Google Scholar]
  38. Tharwat, A. Classification assessment methods. Appl. Comput. Inform. 2020, 17, 168–192. [Google Scholar] [CrossRef]
  39. Viera, A.J.; Garrett, J.M. Understanding interobserver agreement: The kappa statistic. Fam. Med. 2005, 37, 360–363. [Google Scholar]
  40. Sharabani, G.; Shtienberg, D.; Borenstein, M.; Shullhani, R.; Lofthouse, M.; Sofer, M.; Chalupowics, L.; Barel, V.; Manulis-Sasson, S. Effects of plant age on disease development and virulence of Clavibacter michiganensis subsp. michiganensis on tomato. Plant Pathol. 2013, 62, 1114–1122. [Google Scholar] [CrossRef]
  41. Edwards, H.G.M.; Farwell, D.W.; Webster, D. FT Raman microscopy of untreated natural plant fibres. Spectrochim. Acta Part A 1997, 53, 1383–2392. [Google Scholar] [CrossRef]
  42. Wiley, J.H.; Atalla, R.H. Band assignments in the Raman spectra of celluloses. Carbohydr. Res. 1987, 160, 113–129. [Google Scholar] [CrossRef]
  43. Trebolazabala, J.; Maguregui, M.; Morillas, H.; Diego, A.; Madariaga, J.M. Use of portable devices and confocal Raman spectrometers at different wavelength to obtain the spectral information of the main organic components in tomato (Solanum lycopersicum) fruits. Spectrochim. Acta Part A 2013, 105, 391–399. [Google Scholar] [CrossRef] [PubMed]
  44. Gill, D.; Kilponen, R.G.; Rimai, L. Resonance Raman scattering of laser radiation by vibrational modes of carotenoid pigment molecules in intact plant tissues. Nature 1970, 227, 743–744. [Google Scholar] [CrossRef]
  45. Qin, J.; Chao, K.; Kim, M.S. Nondestructive evaluation of internal maturity of tomatoes using spatially offset Raman spectroscopy. Postharvest Biol. Technol. 2012, 71, 21–31. [Google Scholar] [CrossRef]
  46. Chen, A.; Zeng, H.; Larkum, A.W.D.; Cai, Z.-L. Raman properties of chorophyll d, the major pigment of Acaryochloris marina: Studies using both Raman spectroscopy and density functional theory. Spectrochim. Acta Part A 2004, 60, 527–534. [Google Scholar] [CrossRef]
  47. Bock, P.; Nousiainen, P.; Elder, T.; Blaukopf, M.; Amer, H.; Zirbs, R.; Potthast, A.; Gierlinger, N. Infrared and Raman spectra of lignin substructures: Dibenzodioxocin. J. Raman Spectrosc. 2020, 51, 422–431. [Google Scholar] [CrossRef] [Green Version]
  48. Yu, M.M.L.; Schulze, H.G.; Jetter, R.; Blades, M.W.; Turner, R.F.B. Raman microspectroscopic analysis of triterpenoids found in plant cuticles. Appl. Spectrosc. 2007, 61, 32–37. [Google Scholar] [CrossRef]
  49. Jurasekova, Z.; García-Ramos, J.V.; Domingo, C.; Sánchez-Cortes, S. Surface-enhance Raman scattering of flavonoids. J. Raman Spectrosc. 2006, 37, 1239–1241. [Google Scholar] [CrossRef]
  50. Sadat, A.; Joye, I.J. Peak fitting applied to fourier transform infrared and Raman spectroscopic analysis of proteins. Appl. Sci. 2020, 10, 5918. [Google Scholar] [CrossRef]
  51. Kuhar, N.; Sil, S.; Verma, T.; Umapathy, S. Challenges in application of Raman spectroscopy to biology and material. RSC Adv. 2018, 8, 25888–25908. [Google Scholar] [CrossRef] [Green Version]
  52. Maiti, N.C.; Apetri, M.M.; Zagorski, M.G.; Carey, P.R.; Anderson, V.E. Raman spectroscopic characterization of secondary structure in native unfolded proteins: Alpha-synuclein. J. Am. Chem. Soc. 2004, 126, 2399–2408. [Google Scholar] [CrossRef]
  53. Beimen, A.; Bermpohl, A.; Meletzus, D.; Eichenlaub, R.; Barz, W. Accumulation of phenolic compounds in leaves of tomato plants after infection with Clavibacter michiganensis subsp. michiganensis strains differing in virulence. Z. Naturforsch. 1992, 47, 898–909. [Google Scholar] [CrossRef] [Green Version]
  54. Stüwe, B.; Von Tiedemann, A. Bacterial canker of tomatoes-histological characterization of cultivars resistance and seed transmission. J. Plant Dis. Prot. 2013, 120, 194–200. [Google Scholar] [CrossRef]
  55. Kolomiiets, Y.; Grygoryuk, I.; Likhanov, A.; Butsenko, L.; Blume, Y. Induction of bacterial canker resistance in tomato plants using plant growth promoting rhizobacteria. Open Agric. J. 2019, 13, 215–222. [Google Scholar] [CrossRef] [Green Version]
  56. Jones, J.D.G.; Dangl, J.L. The plant immune system. Nature 2006, 444, 323–329. [Google Scholar] [CrossRef] [Green Version]
  57. Bolton, M.D. Primary metabolism and plant defense-Fuel for the fire. Mol. Plant-Microbe Interact. 2009, 22, 487–497. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  58. Balaji, V.; Mayrose, M.; Sherf, O.; Jacob-Hirsch, J.; Eichenlaub, R.; Iraki, N.; Manulis-Sasson, S.; Rechavi, G.; Barash, I.; Sessa, G. Tomato transcriptional changes in response to Clavibacter michiganensis subsp. michiganensis reveal a role for ethylene in disease development. Plant Physiol. 2008, 146, 1797–1809. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  59. Lara-Ávila, J.P.; Isordia-Jasso, M.I.; Castillo-Collazo, R.; Simpson, J.; Alpuche-Solís, A.G. Gene expression analysis during interaction of tomato and related wild species with Clavibacter michiganensis subsp. michiganensis. Plant Mol. Biol. Rep. 2012, 30, 498–511. [Google Scholar] [CrossRef]
  60. Havaux, M. Carotenoid oxidation products as stress signals in plants. Plant J. 2013, 79, 597–606. [Google Scholar] [CrossRef]
  61. Thapa, S.P.; Pattathil, S.; Hahn, M.G.; Jacques, M.-A.; Gilbertson, R.L.; Coaker, G. Genomic analysis of Clavibacter michiganensis subsp. michiganensis reveals insight into virulence strategies and genetic diversity of a gram-positive bacterial pathogen. Mol. Plant-Microbe Interact. 2017, 30, 786–802. [Google Scholar] [CrossRef] [Green Version]
  62. Farber, C.; Bryan, R.; Paetzold, L.; Rush, C.; Kurouski, D. Non-invasive characterization of single-, double- and triple-viral diseases of wheat with a hand-held Raman spectrometer. Front. Plant Sci. 2020, 11, 01300. [Google Scholar] [CrossRef]
Figure 1. Normalized Raman spectra obtained from healthy tomato plants (HTo) and asymptomatic infected plants (BCTo). Dashed lines represent the wavenumber associated with key compounds.
Figure 1. Normalized Raman spectra obtained from healthy tomato plants (HTo) and asymptomatic infected plants (BCTo). Dashed lines represent the wavenumber associated with key compounds.
Plants 10 01542 g001
Figure 2. Class separability between HTo and BCTo sets across principal component spaces PC1–PC3 and PC4–PC6.
Figure 2. Class separability between HTo and BCTo sets across principal component spaces PC1–PC3 and PC4–PC6.
Plants 10 01542 g002
Figure 3. Correlation matrix for principal components (PCs) and the contribution (loading) of each wavenumber of the Raman spectra to the PC.
Figure 3. Correlation matrix for principal components (PCs) and the contribution (loading) of each wavenumber of the Raman spectra to the PC.
Plants 10 01542 g003
Table 2. Classifier performance comparison for characterization of Raman spectra of healthy (HTo) and asymptomatic infected plants (BCTo).
Table 2. Classifier performance comparison for characterization of Raman spectra of healthy (HTo) and asymptomatic infected plants (BCTo).
MetricsPCA + MLPPCA + LDA
SENS1.01.0
SPEC0.950.88
ACC0.990.97
PPV0.980.97
NPV1.01.0
F1-Score0.990.99
SENS = Sensitivity, SPEC = Specificity, ACC = Accuracy, PPV = Positive Predictive Value, NPV = Negative Predictive Value.
Table 3. Cohen’s kappa coefficients (κ) comparing agreement.
Table 3. Cohen’s kappa coefficients (κ) comparing agreement.
κmlp−ldaκmlp−gndκlda−gnd
0.9373260.9224520.985053
Subscripts: mlp = multilayer perceptron; lda = linear discriminant analysis; gnd = ground truth
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Vallejo-Pérez, M.R.; Sosa-Herrera, J.A.; Navarro-Contreras, H.R.; Álvarez-Preciado, L.G.; Rodríguez-Vázquez, Á.G.; Lara-Ávila, J.P. Raman Spectroscopy and Machine-Learning for Early Detection of Bacterial Canker of Tomato: The Asymptomatic Disease Condition. Plants 2021, 10, 1542. https://doi.org/10.3390/plants10081542

AMA Style

Vallejo-Pérez MR, Sosa-Herrera JA, Navarro-Contreras HR, Álvarez-Preciado LG, Rodríguez-Vázquez ÁG, Lara-Ávila JP. Raman Spectroscopy and Machine-Learning for Early Detection of Bacterial Canker of Tomato: The Asymptomatic Disease Condition. Plants. 2021; 10(8):1542. https://doi.org/10.3390/plants10081542

Chicago/Turabian Style

Vallejo-Pérez, Moisés Roberto, Jesús Antonio Sosa-Herrera, Hugo Ricardo Navarro-Contreras, Luz Gabriela Álvarez-Preciado, Ángel Gabriel Rodríguez-Vázquez, and José Pablo Lara-Ávila. 2021. "Raman Spectroscopy and Machine-Learning for Early Detection of Bacterial Canker of Tomato: The Asymptomatic Disease Condition" Plants 10, no. 8: 1542. https://doi.org/10.3390/plants10081542

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop