Evaluation of GBLUP, BayesB and elastic net for genomic prediction in Chinese Simmental beef cattle

Xiaoqiao Wang; Jian Miao; Tianpeng Chang; Jiangwei Xia; Binxin An; Yan Li; Lingyang Xu; Lupei Zhang; Xue Gao; Junya Li; Huijiang Gao

doi:10.1371/journal.pone.0210442

Abstract

Chinese Simmental beef cattle are the most economically important cattle breed in China. Estimated breeding values for growth, carcass, and meat quality traits are commonly used as selection criteria in animal breeding. The objective of this study was to evaluate the accuracy of alternative statistical methods for the estimation of genomic breeding values. Analyses of the accuracy of genomic best linear unbiased prediction (GBLUP), BayesB, and elastic net (EN) were performed with an Illumina BovineHD BeadChip on 1,217 animals by applying 5-fold cross-validation. Overall, the accuracies ranged from 0.17 to 0.296 for ten traits, and the heritability estimates ranged from 0.36 to 0.63. The EN (alpha = 0.001) model provided the most accurate prediction, which was also slightly higher (0.2–2%) than that of GBLUP for most traits, such as average daily weight gain (ADG) and carcass weight (CW). BayesB was less accurate for each trait than were EN (alpha = 0.001) and GBLUP. These findings indicate the importance of using an appropriate variable selection method for the genomic selection of traits and suggest the influence of the genetic architecture of the traits we analyzed.

Citation: Wang X, Miao J, Chang T, Xia J, An B, Li Y, et al. (2019) Evaluation of GBLUP, BayesB and elastic net for genomic prediction in Chinese Simmental beef cattle. PLoS ONE 14(2): e0210442. https://doi.org/10.1371/journal.pone.0210442

Editor: Alex V. Chaves, The University of Sydney, AUSTRALIA

Received: May 20, 2018; Accepted: December 21, 2018; Published: February 28, 2019

Copyright: © 2019 Wang et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Data Availability: We confirm that all data underlying our findings are publicly available without restriction. Data is available from the Dryad Digital Repository: doi:10.5061/dryad.4qc06.

Funding: This work was supported by funds from the National Natural Science Foundation of China 31872975 for Huijiang Gao, National Natural Science Foundation of China 31672384 for Lupei Zhang, National Natural Science Foundation of China 31572376 for Xue Gao, and the Chinese Academy of Agricultural Sciences of Technology Innovation Project (CAAS-XTCX2016010, CAAS-ZDXT2018006 and ASTIP-IAS03) for Junya Li.

Competing interests: The authors have declared that no competing interests exist.

Introduction

Chinese Simmental beef cattle play an important role in the Chinese beef industry because of their high adaptability and the rapid growth of their young with sufficient feeding. The beef is also well marbled and tender, contributing to its marketability. The primary objective of beef production is to improve beef quality and yield grades. Estimated breeding values of economical traits, such as carcass weight (CW), eye muscle area (EMA), and marbling score (MS), are generally considered to be the major selection criteria in beef cattle breeding. The average daily weight gain (ADG) is also important as an indicator of growth.

In China, small holders manage a large proportion of young bulls, in some cases keeping fewer than 100 cattle. Considering this situation, these bulls cannot be managed well. The bulls often lack phenotypic or pedigree records due to the absence of unified management. In this context, an alternative to traditional genetic evaluations is genomic selection (GS), which was originally introduced by [1]. GS is the selection for economic quantitative traits in animals and plants based on their genome-wide estimated breeding values (GEBVs), which are calculated based on dense markers and do not depend on pedigree information. With the availability of high-throughput dense genotyping of SNPs and several statistical models, GS is currently being adopted in animal breeding. The predictive accuracy is key to the success of genomic prediction. However, no consensus exists on the best approach, which is dependent on the genetic architecture of traits.

The methods for genomic prediction can be classified into two groups: linear and nonlinear methods. The commonly used linear methods include unbiased and biased prediction models. Unbiased prediction models include genomic best linear unbiased prediction (GBLUP) and ridge regression best linear unbiased prediction (RR-BLUP) [2], while biased prediction models are also known as regularized (penalized) linear regression models such as ridge regression (RR) [3], the least absolute shrinkage and selection operator (LASSO) [4], and elastic net (EN) [5]. Bayesian methods are nonlinear methods and include Bayes A/B/C/Cπ/R. They are often implemented by MCMC (Markov chain Monte Carlo) sampling to obtain the variable of shrinkage coverage. GBLUP is a routine genetic evaluation for livestock because it is simple and less computationally demanding. RR-BLUP has been found to be equivalent to GBLUP procedures [6]. The EN with alpha, an adjustable parameter, set to 0 is equivalent to RR, and with alpha close to 1 performs very similarly to LASSO. Moreover, EN produces more correctly identified influential variables than LASSO and has a much lower false positive rate than RR [7].

Previous studies have reported the performance of genomic prediction methods for various traits in different breeds. These studies suggested that statistical methods may perform differently for different traits because of the large differences in the genetic architecture of complex traits [8]. When fewer genes with large effects influence traits, Bayesian models have a small advantage over linear models such as GBLUP, whereas GBLUP may outperform BayesB for a trait with many loci with small effects. LASSO and EN approaches can compress the small size effect to zero with a penalty based on functions of magnitude of effect for each SNP [9]. Previous studies have investigated the application of Bayesian methods for GS with several traits in Chinese Simmental beef cattle [10,11]. However, the GS of bone weight (BNW), MS and carcass length (CL) has not been reported. Moreover, the accuracy of GS using regularized linear regression models for many growth, carcass, and meat quality traits in Chinese Simmental beef cattle and even other breeds of beef cattle remains largely unknown, particularly the accuracy of the EN method. When setting an appropriate alpha in an EN model, the results may be better than those of Bayesian methods and GBLUP.

The aim of this study was to provide a scientific basis for the application of GS to the Chinese Simmental population. A comparative evaluation of the performance of multiple methods is essential to identify those best suited to GS for Chinese Simmental cattle. Here, we evaluated the relative performance of five methods for GS. We expected to identify suitable methods for estimating the predictive accuracy for various growth, carcass and meat quality traits of economic relevance using the BovineHD SNP array in the Chinese Simmental cattle population.

Materials and methods

Ethics statement

All animals used in the study were treated following the guidelines established by the Council of China Animal Welfare. The research was undertaken with the approval of the Committee on the Ethics of Animal Experiments of the Chinese Academy of Agricultural Sciences (CAAS) (Beijing, China). The use of animals and private land in this study was approved by the respective owners.

Animal and phenotypic data

Our resource population included 1,225 Chinese Simmental cattle born between 2008 and 2014 in Ulgai, Xilingol League and Inner Mongolia of China. After weaning, these cattle were moved to Jinweifuren Co., Ltd. for fattening, with all animals sharing uniform feeding and management conditions. More detailed descriptions of the breeding and management have been described previously [12]. The cattle were slaughtered at an average age of 16–18 months. At slaughter, the carcass trait and meat quality traits were assessed according to the Institutional Meat Purchase Specifications for Fresh Beef Guidelines. Traits in this study were the following: ADG (kg/d), live weight (LW, kg), CW (kg), BNW (kg), tenderloin weight (TW, kg), sirloin weight (SW, kg), EMA (cm²), CL (cm), hind leg length (HLL, cm), and MS. The ADG was the rate of weight gain per day over the fattening duration. LW was measured before slaughter after fasting for 24 h. CW was the remaining cold carcass measured after slaughter and bloodletting by eliminating the hide, head, feet, tail, entrails and gut fill. The total BNW was created to sum the weights of the carcass bones. EMA was measured at the 12th and 13th rib interface 48 h postmortem via the dot grid method. TW, SW and CL were measured directly from carcass anatomy. MS was visually scored on a seven-point scale depending on the degree of marbling on the cut surface of the rib eye. The statistics used for each trait to estimate variance components are presented in Table 1.

Download:

Table 1. Descriptive statistics of phenotypic data used in the genomic prediction.

https://doi.org/10.1371/journal.pone.0210442.t001

The fixed effects were used to adjust the phenotypic values of traits of interest before the analysis: where y is a vector of observed phenotypic values, β is a vector of fixed effects (year of birth and sex as a contemporary group; fattening duration and initial body weight as a covariate), X is the design matrix of relevant observations to the corresponding fixed effects, and y* is the random residual. The residual y* was subsequently used in the prediction models.

Genotyping and quality control

Genotypes were generated with the Illumina BovineHD BeadChip. Quality control of genotypes was conducted through an iterative process using the following SNP selection criteria: call rate (CR) higher than 0.95, minor allele frequency (MAF) higher than 0.05 and P-value for Hardy-Weinberg equilibrium test (HWE) higher than 10⁻⁵. The samples with more than 10% missing genotypes were excluded, which resulted in a final dataset of 1,217 cattle with 608,696 SNPs. Additionally, the imputation for sporadic missing alleles was performed using Beagle 3.3.2 [13].

Genomic prediction methods

GBLUP and BayesB: GEBVs were calculated based on the following equation: (1) where y* is the vector of the corrected phenotype, μ is the overall mean, and is a vector of residual error, where is the residual variance. I is an identity matrix. For GBLUP, Z is an incidence matrix for individual effects. γ is the vector of breeding values assumed to follow a multivariate normal distribution , where is genetic variance, K is calculated following [14], and . Z_k is the vector of SNP genotypes for n individuals at locus k for k = 1, …, m, where m is the number of markers and n is the number of individuals. SNP genotypes are represented as 1, 0, or -1 to denote a diploid genotype value of 11, 12, or 22, respectively. For BayesB, Z is a genotype matrix corresponding to γ. is the vector of SNP effects. The variance of the k^th SNP effect, , is assigned an informative prior to show the presence (with probability 1 − π) and absence (with probability π) of the marker k.

Elastic net method: y* is treated as the corrected phenotype and is described by the following multiple regression model: (2) where y* is the vector of the corrected phenotype. Z is the matrix of genotype codes for SNPs with -1, 0, and 1. γ is the vector of SNP effects. is the vector of residual error. Z_k is the vector of SNP genotypes for n individuals at locus k for k = 1, …, m, where m is the number of markers and n is the number of individuals. γ_k is the SNP effects for marker k. The ordinary least squares (OLS) estimates the parameter γ by minimizing the residual sum of squares: (3)

The LASSO [15] penalty estimates marker effects via adding an L1-norm in the OLS: (4)

The RR [3] penalty estimates marker effects via adding an L2-norm in the OLS: (5)

The EN [5] penalty estimates marker effects via adding a synthetic of L1-norm and L2-norm in the OLS. Thus, EN is based on a compromise between LASSO and RR, where alpha is for the EN mixing parameter (0 ≤ α ≤ 1): (6)

The lambda in Eqs (4), (5) and (6) is a regularization parameter that controls the amount of shrinkage. The optimal value of λ can then be found by k-fold cross-validation (CV) to identify the minimum mean squared error (minMSE).

All analyses were conducted using R language; GBLUP was obtained by solving the mixed model equations (MMEs). The BGLR package was used to conduct BayesB. RR, LASSO, and EN were conducted in the glmnet R package. For BayesB, the MCMC was run for 50,000 iterations with a burn in of 2,500 and thinning of 10. These numbers of iterations were sufficient in that increasing the number did not change the results. An MCMC sampler with shorter chain and burn-in (22,000 iterations and 2,500 burn in) was tested, but the results were discarded. To identify the best performance of the EN method, we used penalty weights of α = 0.001, 0.01, 0.05, 0.1, 0.4, 0.7, and 1.

Estimation of genetic parameters

Genomic heritability, genetic correlation, and phenotypic correlation were analyzed using the ASReml v3.0 software package [16]. An animal model was applied to estimate the heritability of all traits. A pairwise bivariate animal model was applied to estimate the genetic correlation between both traits. The model is (7) where y₁ and y₂ are vectors of trait 1 and 2, respectively; X₁ and X₂ are incidence matrices for fixed effects; b₁ and b₂ are the vctors of the fixed effects; Z₁ and Z₂ are incidence matrices relating the phenotypic observations to vectors of the polygenic effects for two traits; and e₁ and e₂ are random residuals for two traits.

For GBLUP, the GEBVs of all genotyped individuals were predicted by solving the MMEs. For BayesB and EN methods, the GEBV was calculated by adding all the marker effects estimated from the training population. The formula was .

Validation population

Two validation procedures were considered for assessing the predictive accuracy of different methods in this article. We mainly used 5-fold CV procedures. The other method is a generation validation procedure. Because phenotype records were not available for all genotyped animals for all traits, the number of animals in the training and test datasets differed among traits. However, the test populations were the same for each method. In 5-fold CV procedures, the population (for each trait) was randomly split into five parts of approximately equal size. Then, the analysis was performed using each subset of the data as the validation sample and the other 4 subsets as the training population. For EMA, the numbers of animals in training and test populations were 893 and 224, respectively. For the other traits, the sizes of the training and validation populations depended on the traits.

In generation validation procedures, the dataset was divided into training (animals from 2008 to 2013) and test (animals from 2014) subgroups, which contained 1135 and 82 animals, respectively. Three traits were measured in this part, including ADG, CW and MS. The accuracy of the genomic predictions was measured as the Pearson correlation between y* and predicted GEBV on the test subgroup using the formula . Realized accuracy was calculated as [17].

Results

Descriptive statistics and genetic parameters

The estimates of heritability for ten traits are presented in Table 1. Of the ten traits, the one growth trait, ADG, had a median heritability of 0.44. Eight traits were carcass traits, including LW, CW, BNW, SW, TW, EMA, CL and HLL, and most had high heritability that ranged from 0.57 for EMA to 0.63 for TW. As a meat quality trait, MS had moderate heritability (0.36). The heritabilities of the traits ADG, CW, EMA, and MS for other breeds of beef cattle are shown in Table 2. The estimated heritabilities for CW (0.59) and TW (0.63) were higher (+0.14) than those previously reported in Chinese Simmental beef cattle, but the heritability of CW was similar to that of Japanese Black cattle [18]. Heritabilities for traits ADG (0.44) and EMA (0.57) were consistent with previous reports for Chinese Simmental beef cattle (0.47) and American Angus cattle (0.51), respectively. Heritability for trait MS (0.36) was below the range of 0.4–0.69 reported in previous studies. The reason for such large differences in heritability is partially the different populations and different marker-based relationship matrices used for heritability estimations. The phenotypic and genetic correlations among the 10 traits are shown in Fig 1 and S1 Table. ADG had low genetic and phenotypic correlations with both EMA and MS. Carcass traits had moderate, even high, genetic and phenotypic correlation with one another in most cases. EMA had low genetic and phenotypic correlations with both ADG, CL and HLL. MS also had the lowest phenotypic correlations, ranging from -0.05 for LW to 0.24 for TW, although MS had a moderate genetic correlation with most traits. Additionally, a heat map was used to visualize the kinship among individuals (S1 Fig).

Download:

Fig 1. Heat map of phenotypic (a) and genetic correlation (b) across ten traits.

https://doi.org/10.1371/journal.pone.0210442.g001

Download:

Table 2. Summary of the genomic prediction accuracy and heritability of five traits in beef cattle from different countries.

https://doi.org/10.1371/journal.pone.0210442.t002

Accuracy of GEBV with LASSO and EN models in 5-fold CV

Table 3 shows the accuracy of genomic prediction using the EN method for the ten traits. All traits were evaluated at the following penalty weights: α = 1, 0.7, 0.4, 0.1, 0.05, 0.01 and 0.001, where α = 1 is equivalent to LASSO. We also performed RR with α = 0, but the results were poor and included some NA, which might have been caused by nonconvergence. Thus, Table 3 does not show the results of the RR method. There is a tendency for higher accuracies to appear in the EN model with a smaller alpha setting. In particular, when setting alpha = 0.001, the results were generally better than the others, except for the trait BNW, which performed better with an α = 0.1. Thus, the EN method (α = 0.001) was used to compare with the GBLUP and BayesB.

Download:

Table 3. Accuracies of genomic EBV of 5-fold cross-validation population using regularized regression methods for ten traits.

https://doi.org/10.1371/journal.pone.0210442.t003

Accuracy of GEBV in the GBLUP, EN and BayesB models in 5-fold CV

Table 4 shows the genomic prediction accuracy using different methods for the ten traits and their coefficients of variation (C_v). The average accuracy of the GEBV for the ten traits was approximately 0.25, ranging from 0.18 to 0.30. Among the three methods, the lowest GEBV accuracy was found in BayesB for each trait. The prediction method yielding the highest accuracy differed among traits. GBLUP had the highest accuracy for traits EMA, CL, and MS, whereas EN had the highest accuracy for traits ADG, LW, BNW, SW, TW, and HLL. The comparable performances of the GBLUP, BayesB and EN methods suggested that the accuracy of the EN method (α = 0.001) was slightly better (0.1 to 2.5%) than that of the GBLUP and BayesB methods for six traits. GBLUP usually performed well, whereas the BayesB method performed poorly. The C_vs were similar among the methods, except for trait BNW, which was higher (+0.07) in the EN method than that of the other two methods. Additionally, we computed the accuracy of the GEBV using the RR-BLUP method, and the results were the same as those using GBLUP for each trait; therefore, the results are not shown in this study. We also fixed π = 0.99 and 0.999 in the BayesB method for the CW, ADG, EMA, and MS traits (Table 5).

Download:

Table 4. Comparison of the genomic prediction accuracy (Acc) and coefficient variation (C_v) for ten traits using three methods.

https://doi.org/10.1371/journal.pone.0210442.t004

Download:

Table 5. Accuracies of genomic EBV of 5-fold cross-validation population using BayesB method for two traits.

https://doi.org/10.1371/journal.pone.0210442.t005

Accuracy of GEBV in the GBLUP, EN and BayesB models in generation validation

Table 6 shows the genomic prediction accuracy using different methods for the trait ADG, CW, and MS in generation validation. The EN method (α = 0.0001) performed the best among the three methods for each trait. For ADG, the BayesB method had the lowest accuracy, of 0.243 compared to 0.261 for EN and 0.250 for GBLUP. For CW, the three methods had similar results, at approximately 0.31. The accuracy of these two traits using GBLUP was slightly lower (0.004, 0.01 respectively) than that using the EN method. GBLUP had the lowest accuracy, 0.186, for measuring MS.

Download:

Table 6. Accuracies of genomic EBV of generation validation population for three traits using three method.

https://doi.org/10.1371/journal.pone.0210442.t006

Discussion

The primary aim of this study was to compare the prediction ability of different methods and identify a suitable GS model for the most economical traits in Chinese Simmental cattle. Based on the empirical prediction accuracy results, EN (α = 0.001) and GBLUP outperformed BayesB. Compared with those of the GBLUP and BayesB methods, EN (α = 0.001) predictions had higher accuracy for most traits. LASSO had the lowest accuracy for most traits. In a previous study on genomic prediction, most cases showed that the accuracy of GBLUP outperformed that of the Bayesian method with real data, with the opposite trend for simulation data [19,20].

Comparison of regularized linear regression models to estimate GEBV in 5-fold CV

EN, LASSO and RR are penalized least-squares methods. We used the glmnet/R package to perform EN, LASSO and RR analyses because glmnet/R is extremely fast for use with our dataset. In glmnet/R, the optimal value of the tuning parameter λ, which controls the degree of shrinkage, can be obtained through CV. The λ value producing the minMSE is deemed the optimal tuning parameter in training sets. To avoid the overfitting problem in training sets, some scientists advise using minMSE+1SE to obtain the optimal λ [21]. We tested the minMSE+1SE stopping criterion, but the results were not as good as those using minMSE.

RR assumes that many predictors all have nonzero coefficients and that they obey a normal distribution [22]. Specifically, the performance is good when there are many predictors, each of which has a small effect. However, in our investigation, the performance of RR was unsatisfactory. A trend occurred in which higher accuracy values appeared in the EN model with a smaller alpha setting. Specifically, when the setting α = 0.001, the results were generally better than those of the other scenarios, particularly the LASSO method (α = 0). For the trait BNW, EN with α = 0.1 performed the best. These results are consistent with those of a previous study in which EN outperformed LASSO [23]. The regularization of LASSO results in many regression coefficients trending toward zero; therefore, LASSO as an automatic variable selection method could select one predictor effectively among several relevant predictors [9]. The failure of LASSO in this analysis might have been caused by one of two possible reasons: (1) LASSO is a penalized least-squares method with constraints on the absolute values of the regression coefficients. Due to this special penalty, LASSO leads to sparse selection of independent variables by shrinking most of the regression coefficients to zero. It might discard the most relevant coefficients. (2) The traits analyzed are controlled by polygenes, i.e., the infinitesimal model applies to the traits. EN regularization does both ridge and LASSO penalties simultaneously; thus, the result of the EN penalty is a combination of the effects of the two methods [5]. Because ridge penalty shrinks predictors efficiently, these coefficients are nonnull with a large number of SNPs; therefore, it was inefficient and led many estimates to vanish. LASSO penalty compresses the small coefficients to zero, which provides effective control for high-dimensional variable selection, particularly in cases in which only a small subset of SNPs with large coefficients are associated with the trait. By combining ridge and LASSO penalties, EN can average markers that are highly related with a trait and then the averaged marker is entered into the model. Thus, EN is an adjustable model to fit traits with different genetic structures. Our results provide guidance for choosing the optimal parameter α.

Comparison of EN, GBLUP and BayesB models to estimate GEBV in two validation procedures

The GBLUP method, which assumes a normal distribution of marker effects with an equal variance and that all SNPs have a nonnull effect, performed better than the BayesB method for each trait. Many studies show that the GBLUP model performs well for most polygenic traits in livestock [8,24]. The worst performance of BayesB for most traits in our study is not particularly notable. Previous studies have reported that the accuracy of BayesB differs among traits, which depends on the genetic architecture of the traits [8]. Bayesian methods divide the SNPs into two parts, in which a high proportion SNPs have null effect (π), while other SNPs have large or moderate effects. Therefore, the performance is better for traits controlled by a few QTLs. We also fixed π = 0.99 and 0.999 in the BayesB method for the CW, ADG, EMA, and MS traits (Table 5), but the results were worse than those at π = 0.9 for each trait. These results suggested that four traits are controlled by many SNPs, especially ADG and MS. Previous studies suggest a value for π, but the challenge remains to identify the most accurate π in a BayesB model. Other challenges were computational speed and memory consumption. BayesB had no computational advantage, requiring 1.4 days for a prediction. With GBLUP, more time (32 min) was required to construct the genomic matrix, but the average total time for GBLUP (32.26 min) was approximately 20 min less than that with the EN method with alpha = 0.001 (52.4 min). However, we were only required to compute the genomic matrix once for a common population. Thus, GBLUP had the absolute advantage in computing time.

In the comparison of the EN with BayesB and GBLUP, the EN model was superior to the BayesB and GBLUP for most traits. The computational speed of EN was between those of GBLUP and BayesB. EN is a machine learning method that uses training sets to learn parameters in models and then predict the test sets with these models. Unlike GBLUP, which only outperformed in traits controlled by large SNPs with small effects, EN performed well in two models (the infinitesimal model and finite model) if a suitable alpha was set. Since the EN method provided higher prediction accuracy for six of ten traits and because of its adjustability, it was a good choice for further GS in Chinese Simmental beef cattle.

Comparison of the traits analyzed in two validation procedures

GS in Chinese Simmental beef cattle has been evaluated since 2008, but to date, GS has been not implemented in practical breeding. The reference population has been continuously updated, although with a limited increase in number. Many factors hamper the development of GS in China. A comparison of our results from the CV procedure with those in other beef cattle (Table 2) shows that [25] reported a prediction accuracy of MS lower than that for CW and EMS but with a higher heritability in Hanwoo beef cattle, which was the same result as in our study. For the CW trait, other studies show that the accuracy of the Bayesian method was higher than that of GBLUP and that of Simmental cattle in previous studies [11,26], which suggests that CW is controlled by QTLs with large effect. However, our study produced a different result. For the EMA trait, the accuracy for Hanwoo, Nellore, American Angus, and Japanese Black was 0.317, 0.47 (realized accuracy), 0.698, and 0.42, respectively. The highest accuracy for the EMA trait in this study was 0.287 using GBLUP, which corresponded with that of Nellore using BayesLasso. For the ADG trait, the performance of prediction differed in methods with Chinese Simmental, Nellore and multibreed cattle. The highest accuracy for the ADG trait in our study was 0.251 using EN (α = 0.001). The accuracy values for Chinese Simmental in a previous study, Nellore and multibreeds were 0.214, 0.26 and 0.24, respectively.

In contrast, when generation validation was used, the accuracies of three traits using three methods were slightly higher. This might be caused by the larger training dataset and smaller test dataset. Few reports are available about the traits TW, SW, BNW, CL, and HLL. However, clear correlations between traits were observed, and TW and SW are also of economic interest. These observations may indicate that the genetic architecture of these traits is different among breeds, which could cause the different characteristics in different breeds of cattle. We suggest that ADG, CW, EMA and MS traits are suitable for the infinitesimal model, as these traits have small effects distributed on many loci.

The accuracy of genomic predictions is influenced by the density of the SNP panel, the heritability of the trait, the training population size and the effective population size [27]. In this study, the estimated effective population size five generations ago (N_e = 103) was consistent with that reported by [11]. The estimates of heritability were moderate to high but with low to moderate prediction accuracies. One of the main reasons for the limited accuracies, ranging from 0.17 to 0.295, could be due to the small reference population size (N ≈ 973). Another influence factor is CV strategy to assess the predictive ability of different methods. There are already a few studies that show that a stronger genetic relationship between the training and test datasets results in the highest accuracy for GEBV [28,29]. The averages of the relationship between two datasets in each validation procedure ranged from 0.08 to 0.09. This result indicates that the level of relationship between the training and validation populations was relatively low, which may have affected the accuracy. To improve the accuracy of the genomic prediction in this population, the key point would be to increase the number of reference animals. Considering the cost of genotyping, we can use lower density panels (80 K or 50 K). Another alternative method is to obtain the pedigree information and use this information simultaneously with genotype information in one model, such as single-step GBLUP (ssGBLUP). Therefore, the use of genomic prediction in real breeding programs for Chinese Simmental cattle is far off since there is no reasonable reference population.

Conclusions

The performance of the statistical methods used depended on the trait analyzed. The results showed that GBLUP and EN were clearly superior to BayesB for each trait, particularly LW and CL. When an appropriate alpha was set in the EN model, the results were better than those of GBLUP for most traits, with the exception of traits EMA, CL and MS. EN and GBLUP methods could be equally recommended for the implementation of GS for carcass traits in Chinese Simmental cattle. In addition, the results also suggest that the genetic architecture underlying the ADG, CW, EMA and MS traits are similar and are controlled by many SNPs. Overall, our results can be used as a reference for implementing genomic prediction in Chinese Simmental beef cattle.

Supporting information

S1 Fig. Kinship plot for all individuals.

https://doi.org/10.1371/journal.pone.0210442.s001

(PNG)

S1 Table. Genotypic (below diagonal) and phenotypic (above diagonal) correlations and standard errors (SE) between all pairs of ten traits.

https://doi.org/10.1371/journal.pone.0210442.s002

(DOCX)

References

1. Meuwissen THE, Hayes BJ, Goddard ME. Prediction of Total Genetic Value Using Genome-Wide Dense Marker Maps. GENETICS 2001;157:1819–1829 pmid:11290733
- View Article
- PubMed/NCBI
- Google Scholar
2. Piepho HP. Ridge regression and extensions for genomewide selection in maize. CROP SCI 2009;49:1165–1176
- View Article
- Google Scholar
3. Hoerl A, Kennard R. Ridge Regression: Applications to Nonorthogonal Problems. TECHNOMETRICS 1970;12:69–82
- View Article
- Google Scholar
4. Legarra A, Robert-Granié C, Croiseau P, Guillaume F, Fritz S. Improved Lasso for genomic selection. GENET RES 2011;93:77–87
- View Article
- Google Scholar
5. Hui Z, Hastie T. Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society 2005;67:301–320
- View Article
- Google Scholar
6. Goddard M. Genomic selection: prediction of accuracy and maximisation of long term response. GENETICA 2009;136:245–257 pmid:18704696
- View Article
- PubMed/NCBI
- Google Scholar
7. Tutz G, Ulbricht J. Penalized regression with correlation-based penalty. Statistics & Computing 2009;19:239–253
- View Article
- Google Scholar
8. Hayes BJ, Bowman PJ, Chamberlain AJ, Goddard ME. Invited review: Genomic selection in dairy cattle: Progress and challenges. J DAIRY SCI 2009;92:433–443 pmid:19164653
- View Article
- PubMed/NCBI
- Google Scholar
9. Tibshirani R. Regression Selection and Shrinkage via the Lasso. 1996
10. Guo P, Zhu B, Xu L, et al. Genomic prediction with parallel computing for slaughter traits in Chinese Simmental beef cattle using high-density genotypes. PLOS ONE 2017;12:e179885
- View Article
- Google Scholar
11. Zhu B, Zhu M, Jiang J, et al. The Impact of Variable Degrees of Freedom and Scale Parameters in Bayesian Methods for Genomic Prediction in Chinese Simmental Beef Cattle. PLOS ONE 2016;11:e154118
- View Article
- Google Scholar
12. Fan H, Wu Y, Zhou X, et al. Pathway-Based Genome-Wide Association Studies for Two Meat Production Traits in Simmental Cattle. SCI REP-UK 2015;5:18389
- View Article
- Google Scholar
13. Browning BL, Browning SR. A unified approach to genotype imputation and haplotype-phase inference for large data sets of trios and unrelated individuals. AM J HUM GENET 2009;84:210–223 pmid:19200528
- View Article
- PubMed/NCBI
- Google Scholar
14. Xu S. Genetic mapping and genomic selection using recombination breakpoint data. GENETICS 2013;195:1103–1115 pmid:23979575
- View Article
- PubMed/NCBI
- Google Scholar
15. Grandvalet Y. Least Absolute Shrinkage is Equivalent to Quadratic Penalization: Springer London; 1998:201–206
16. Gilmour A, Gogel B, Cullis B, Thompson R. ASReml User Guide Release 3.0. VSN International Ltd. 2009
17. Hayes BJ, Pryce J, Chamberlain AJ, Bowman PJ, Goddard ME. Genetic architecture of complex traits and accuracy of genomic prediction: coat colour, milk-fat percentage, and type in Holstein cattle as contrasting model traits. PLOS GENET 2010;6:e1001139 pmid:20927186
- View Article
- PubMed/NCBI
- Google Scholar
18. Onogi A, Ogino A, Komatsu T, et al. Genomic prediction in Japanese Black cattle: application of a single-step approach to beef cattle. J ANIM SCI 2014;92:1931–1938 pmid:24782393
- View Article
- PubMed/NCBI
- Google Scholar
19. Sun X, Habier D, Fernando RL, Garrick DJ, Dekkers JC. Genomic breeding value prediction and QTL mapping of QTLMAS2010 data using Bayesian Methods. BMC Proc 2011;5 Suppl 3:S13
- View Article
- Google Scholar
20. Zhang Z, Liu J, Ding X, et al. Best linear unbiased prediction of genomic breeding values using a trait-specific marker-derived relationship matrix. PLOS ONE 2010;5
- View Article
- Google Scholar
21. Waldmann P, Meszaros G, Gredler B, Fuerst C, Solkner J. Evaluation of the lasso and the elastic net in genome-wide association studies. FRONT GENET 2013;4:270 pmid:24363662
- View Article
- PubMed/NCBI
- Google Scholar
22. Ogutu JO. Genomic selection using regularized linear regression models: ridge regression, lasso, elastic net and their extensions. BMC Proceedings,6,Suppl 2(2012-05-21) 2012;6:S10
- View Article
- Google Scholar
23. Shikha M, Kanika A, Rao AR, et al. Genomic Selection for Drought Tolerance Using Genome-Wide SNPs in Maize. FRONT PLANT SCI 2017;8:550 pmid:28484471
- View Article
- PubMed/NCBI
- Google Scholar
24. VanRaden PM, Van Tassell CP, Wiggans GR, et al. Invited review: reliability of genomic predictions for North American Holstein bulls. J DAIRY SCI 2009;92:16–24 pmid:19109259
- View Article
- PubMed/NCBI
- Google Scholar
25. Mehrban H, Lee DH, Moradi MH, et al. Predictive performance of genomic selection methods for carcass traits in Hanwoo beef cattle: impacts of the genetic architecture. GENET SEL EVOL 2017;49:1 pmid:28093066
- View Article
- PubMed/NCBI
- Google Scholar
26. Saatchi M, Mcclure MC, Mckay SD, et al. Accuracies of genomic breeding values in American Angus beef cattle using K-means clustering for cross-validation. Genetics Selection Evolution,43,1(2011-11-28) 2011;43:40
- View Article
- Google Scholar
27. Goddard ME, Hayes BJ. Mapping genes for complex traits in domestic animals and their use in breeding programmes. NAT REV GENET 2009;10:381–391 pmid:19448663
- View Article
- PubMed/NCBI
- Google Scholar
28. Clark SA, Hickey JM, Daetwyler HD, Jh VDW. The importance of information on relatives for the prediction of genomic breeding values and the implications for the makeup of reference data sets in livestock breeding schemes. Genetics Selection Evolution,44,1(2012-02-09) 2012;44:4
- View Article
- Google Scholar
29. Pérezcabal MA, Vazquez AI, Gianola D, Rosa GJM, Weigel KA. Accuracy of Genome-Enabled Prediction in a Dairy Cattle Population using Different Cross-Validation Layouts. 2012;3:27
- View Article
- Google Scholar
30. Fernandes JG, Rosa GJ, Valente BD, et al. Genomic prediction of breeding values for carcass traits in Nellore cattle. GENET SEL EVOL 2016;48:7 pmid:26830208
- View Article
- PubMed/NCBI
- Google Scholar
31. Somavilla AL, Regitano L, Rosa G, et al. Genome-Enabled Prediction of Breeding Values for Feedlot Average Daily Weight Gain in Nelore Cattle. G3 (Bethesda) 2017;7:1855–1859
- View Article
- Google Scholar
32. Lu D, Akanno EC, Crowley JJ, et al. Accuracy of genomic predictions for feed efficiency traits of beef cattle using 50K and imputed HD genotypes. J ANIM SCI 2016;94:1342–1353 pmid:27135994
- View Article
- PubMed/NCBI
- Google Scholar

[ref1] 1. Meuwissen THE, Hayes BJ, Goddard ME. Prediction of Total Genetic Value Using Genome-Wide Dense Marker Maps. GENETICS 2001;157:1819–1829 pmid:11290733
View Article
PubMed/NCBI
Google Scholar

[2] View Article

[3] PubMed/NCBI

[4] Google Scholar

[ref2] 2. Piepho HP. Ridge regression and extensions for genomewide selection in maize. CROP SCI 2009;49:1165–1176
View Article
Google Scholar

[6] View Article

[7] Google Scholar

[ref3] 3. Hoerl A, Kennard R. Ridge Regression: Applications to Nonorthogonal Problems. TECHNOMETRICS 1970;12:69–82
View Article
Google Scholar

[9] View Article

[10] Google Scholar

[ref4] 4. Legarra A, Robert-Granié C, Croiseau P, Guillaume F, Fritz S. Improved Lasso for genomic selection. GENET RES 2011;93:77–87
View Article
Google Scholar

[12] View Article

[13] Google Scholar

[ref5] 5. Hui Z, Hastie T. Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society 2005;67:301–320
View Article
Google Scholar

[15] View Article

[16] Google Scholar

[ref6] 6. Goddard M. Genomic selection: prediction of accuracy and maximisation of long term response. GENETICA 2009;136:245–257 pmid:18704696
View Article
PubMed/NCBI
Google Scholar

[18] View Article

[19] PubMed/NCBI

[20] Google Scholar

[ref7] 7. Tutz G, Ulbricht J. Penalized regression with correlation-based penalty. Statistics & Computing 2009;19:239–253
View Article
Google Scholar

[22] View Article

[23] Google Scholar

[ref8] 8. Hayes BJ, Bowman PJ, Chamberlain AJ, Goddard ME. Invited review: Genomic selection in dairy cattle: Progress and challenges. J DAIRY SCI 2009;92:433–443 pmid:19164653
View Article
PubMed/NCBI
Google Scholar

[25] View Article

[26] PubMed/NCBI

[27] Google Scholar

[ref9] 9. Tibshirani R. Regression Selection and Shrinkage via the Lasso. 1996

[ref10] 10. Guo P, Zhu B, Xu L, et al. Genomic prediction with parallel computing for slaughter traits in Chinese Simmental beef cattle using high-density genotypes. PLOS ONE 2017;12:e179885
View Article
Google Scholar

[30] View Article

[31] Google Scholar

[ref11] 11. Zhu B, Zhu M, Jiang J, et al. The Impact of Variable Degrees of Freedom and Scale Parameters in Bayesian Methods for Genomic Prediction in Chinese Simmental Beef Cattle. PLOS ONE 2016;11:e154118
View Article
Google Scholar

[33] View Article

[34] Google Scholar

[ref12] 12. Fan H, Wu Y, Zhou X, et al. Pathway-Based Genome-Wide Association Studies for Two Meat Production Traits in Simmental Cattle. SCI REP-UK 2015;5:18389
View Article
Google Scholar

[36] View Article

[37] Google Scholar

[ref13] 13. Browning BL, Browning SR. A unified approach to genotype imputation and haplotype-phase inference for large data sets of trios and unrelated individuals. AM J HUM GENET 2009;84:210–223 pmid:19200528
View Article
PubMed/NCBI
Google Scholar

[39] View Article

[40] PubMed/NCBI

[41] Google Scholar

[ref14] 14. Xu S. Genetic mapping and genomic selection using recombination breakpoint data. GENETICS 2013;195:1103–1115 pmid:23979575
View Article
PubMed/NCBI
Google Scholar

[43] View Article

[44] PubMed/NCBI

[45] Google Scholar

[ref15] 15. Grandvalet Y. Least Absolute Shrinkage is Equivalent to Quadratic Penalization: Springer London; 1998:201–206

[ref16] 16. Gilmour A, Gogel B, Cullis B, Thompson R. ASReml User Guide Release 3.0. VSN International Ltd. 2009

[ref17] 17. Hayes BJ, Pryce J, Chamberlain AJ, Bowman PJ, Goddard ME. Genetic architecture of complex traits and accuracy of genomic prediction: coat colour, milk-fat percentage, and type in Holstein cattle as contrasting model traits. PLOS GENET 2010;6:e1001139 pmid:20927186
View Article
PubMed/NCBI
Google Scholar

[49] View Article

[50] PubMed/NCBI

[51] Google Scholar

[ref18] 18. Onogi A, Ogino A, Komatsu T, et al. Genomic prediction in Japanese Black cattle: application of a single-step approach to beef cattle. J ANIM SCI 2014;92:1931–1938 pmid:24782393
View Article
PubMed/NCBI
Google Scholar

[53] View Article

[54] PubMed/NCBI

[55] Google Scholar

[ref19] 19. Sun X, Habier D, Fernando RL, Garrick DJ, Dekkers JC. Genomic breeding value prediction and QTL mapping of QTLMAS2010 data using Bayesian Methods. BMC Proc 2011;5 Suppl 3:S13
View Article
Google Scholar

[57] View Article

[58] Google Scholar

[ref20] 20. Zhang Z, Liu J, Ding X, et al. Best linear unbiased prediction of genomic breeding values using a trait-specific marker-derived relationship matrix. PLOS ONE 2010;5
View Article
Google Scholar

[60] View Article

[61] Google Scholar

[ref21] 21. Waldmann P, Meszaros G, Gredler B, Fuerst C, Solkner J. Evaluation of the lasso and the elastic net in genome-wide association studies. FRONT GENET 2013;4:270 pmid:24363662
View Article
PubMed/NCBI
Google Scholar

[63] View Article

[64] PubMed/NCBI

[65] Google Scholar

[ref22] 22. Ogutu JO. Genomic selection using regularized linear regression models: ridge regression, lasso, elastic net and their extensions. BMC Proceedings,6,Suppl 2(2012-05-21) 2012;6:S10
View Article
Google Scholar

[67] View Article

[68] Google Scholar

[ref23] 23. Shikha M, Kanika A, Rao AR, et al. Genomic Selection for Drought Tolerance Using Genome-Wide SNPs in Maize. FRONT PLANT SCI 2017;8:550 pmid:28484471
View Article
PubMed/NCBI
Google Scholar

[70] View Article

[71] PubMed/NCBI

[72] Google Scholar

[ref24] 24. VanRaden PM, Van Tassell CP, Wiggans GR, et al. Invited review: reliability of genomic predictions for North American Holstein bulls. J DAIRY SCI 2009;92:16–24 pmid:19109259
View Article
PubMed/NCBI
Google Scholar

[74] View Article

[75] PubMed/NCBI

[76] Google Scholar

[ref25] 25. Mehrban H, Lee DH, Moradi MH, et al. Predictive performance of genomic selection methods for carcass traits in Hanwoo beef cattle: impacts of the genetic architecture. GENET SEL EVOL 2017;49:1 pmid:28093066
View Article
PubMed/NCBI
Google Scholar

[78] View Article

[79] PubMed/NCBI

[80] Google Scholar

[ref26] 26. Saatchi M, Mcclure MC, Mckay SD, et al. Accuracies of genomic breeding values in American Angus beef cattle using K-means clustering for cross-validation. Genetics Selection Evolution,43,1(2011-11-28) 2011;43:40
View Article
Google Scholar

[82] View Article

[83] Google Scholar

[ref27] 27. Goddard ME, Hayes BJ. Mapping genes for complex traits in domestic animals and their use in breeding programmes. NAT REV GENET 2009;10:381–391 pmid:19448663
View Article
PubMed/NCBI
Google Scholar

[85] View Article

[86] PubMed/NCBI

[87] Google Scholar

[ref28] 28. Clark SA, Hickey JM, Daetwyler HD, Jh VDW. The importance of information on relatives for the prediction of genomic breeding values and the implications for the makeup of reference data sets in livestock breeding schemes. Genetics Selection Evolution,44,1(2012-02-09) 2012;44:4
View Article
Google Scholar

[89] View Article

[90] Google Scholar

[ref29] 29. Pérezcabal MA, Vazquez AI, Gianola D, Rosa GJM, Weigel KA. Accuracy of Genome-Enabled Prediction in a Dairy Cattle Population using Different Cross-Validation Layouts. 2012;3:27
View Article
Google Scholar

[92] View Article

[93] Google Scholar

[ref30] 30. Fernandes JG, Rosa GJ, Valente BD, et al. Genomic prediction of breeding values for carcass traits in Nellore cattle. GENET SEL EVOL 2016;48:7 pmid:26830208
View Article
PubMed/NCBI
Google Scholar

[95] View Article

[96] PubMed/NCBI

[97] Google Scholar

[ref31] 31. Somavilla AL, Regitano L, Rosa G, et al. Genome-Enabled Prediction of Breeding Values for Feedlot Average Daily Weight Gain in Nelore Cattle. G3 (Bethesda) 2017;7:1855–1859
View Article
Google Scholar

[99] View Article

[100] Google Scholar

[ref32] 32. Lu D, Akanno EC, Crowley JJ, et al. Accuracy of genomic predictions for feed efficiency traits of beef cattle using 50K and imputed HD genotypes. J ANIM SCI 2016;94:1342–1353 pmid:27135994
View Article
PubMed/NCBI
Google Scholar

[102] View Article

[103] PubMed/NCBI

[104] Google Scholar

Figures

Abstract

Introduction

Materials and methods

Ethics statement

Animal and phenotypic data

Genotyping and quality control

Genomic prediction methods

Estimation of genetic parameters

Validation population

Results

Descriptive statistics and genetic parameters

Accuracy of GEBV with LASSO and EN models in 5-fold CV

Accuracy of GEBV in the GBLUP, EN and BayesB models in 5-fold CV

Accuracy of GEBV in the GBLUP, EN and BayesB models in generation validation

Discussion

Comparison of regularized linear regression models to estimate GEBV in 5-fold CV

Comparison of EN, GBLUP and BayesB models to estimate GEBV in two validation procedures

Comparison of the traits analyzed in two validation procedures

Conclusions

Supporting information

S1 Fig. Kinship plot for all individuals.

S1 Table. Genotypic (below diagonal) and phenotypic (above diagonal) correlations and standard errors (SE) between all pairs of ten traits.

References