This is a preview of subscription content, log in via an institution to check access.
References
Archer, G., Salteli, A., and Sobol, I. M.: 1997, 'Sensitivity Measures, ANOVA like Techniques, and the Use of Bootstrap', Journal of Statistical Computation and Simulation 58, 99–120.
Barron, E. J.: 1995, 'Climate Models: How Reliable are their Predictions?', Consequences: The Nature and Implications of Environmental Change 1(3), 17–27.
Berk, R. A. and Freedman, D.: 1995, 'Statistical Assumptions as Empirical Commitments', in Blomberg, T. and Cohen S. (eds.), Law, Punishment and Social Control: Essays in Honor of Sheldon Messinger, Aldine de Gruyter, New York, pp. 245–248.
Berk, R. A., Bickel, P., Campbell, K., Keller-McNulty, S., Kelly, E., and Sacks, J.: 2000a, 'Workshop on the Statistical Approaches for the Evaluation of Complex Computer Models', Working Paper (under review), Statistics Group, Los Alamos National Laboratory, Los Alamos, New Mexico.
Berk, R. A., Bond, J., Lu, R., Turco, R., and Weiss, R. E.: 2000b, 'Computer Simulations as Experiments: Using Program Evaluation Tools to Assess the Validity of Interventions in Virtual Worlds', in L. Bickman (ed.), Research Design: Donald Campbell's Legacy, Sage Publications, Newbury Park, CA, pp. 195-214
Berk, R. A., Western, B., and Weiss, R.: 1995, 'Statistical Inference for Apparent Populations', in Marsden, P. (ed.), Sociological Methodology, Blackwell Publishing, Cambridge, U.K., pp. 178–203.
Bonan, G. B.: 1997, 'Effect of Land use on Climate in the United States', Clim. Change 3, 449–486.
Breiman, L., Friedman, J. H., Olshen, R. A., and Stone, C. J.: 1993, Classification and Regression Trees, Chapman & Hall, New York.
Briffa, K. R.: 1999, 'The Simulation of Weather Types in GCMs: A Regional Approach to Control Run Validation', in von Storch, H. and Navarra, A. (eds.), Analysis of Climate Variability: Applications of Statistical Techniques, Springer, New York.
Chambers, J. M., Cleveland, W. S., Kleiner, B., and Tukey, J.: 1983, Graphical Methods for Data Analysis, Duxbury Press, Boston.
Cleveland, W.W.: 1979, 'Robust LocallyWeighted Regression and Smoothing Scatterplots', Journal of the American Statistical Association 74: 829–836.
Cleveland, W. S.: 1993, Visualizing Data, Summit, Hobart Press, New Jersey.
Cook, R. D.: 1986, 'Assessment of Local Influence', (with discussion) J Royal Statistical Society, Series B, 48, 133–155.
Cook, R. D.: 1998a, Regression Graphics: Ideas for Studying Regressions Through Graphics, John Wiley, New York.
Cook, R. D. (1998b), 'Principal Hessian Directions Revisited', (with discussion), Journal of the American Statistical Association 91, 84–100.
Crowley, T. J. and Berner, R. A.: 2001, 'CO2 and Climate Change', Science 292, 870–872.
Cumberland, W. G.: 1998, 'Ratio, Regression, and Related Estimates in Sample Survey Methodology', in Armitage, P. and Colton, T. (eds.), Encyclopedia of Biostatistics, John Wiley, New York.
Currin, C., Mitchell, T., Morris, M., and Ylvisaker, D.: 1991, 'Bayesian Prediction of Deterministic Functions, with Applications to Design and Analysis of Computer Experiments', Journal of the American Statistical Association 86, 953–963.
Daley, R.: 1993, Atmospheric Data Analysis. Cambridge University press, Cambridge.
Daley, R. and Mayer, T.: 1986, 'Estimates of Global Analysis Error from the Global Weather Experiment Observational Network', Mon. Wea. Rev. 114, 1642–1653.
Duan, N. and Li, K. C.: 1991, 'Slicing Regression: A Link-Free Regression Method', Annals of Statistics 19, 505–530.
Frankignoul, C.: 1999, 'Statistical Analysis of GCM Output', in von Storch, H. and Navarra, A. (eds.), Analysis of Climate Variability: Applications of Statistical Techniques, Springer, New York.
Ghil, M. and Yiou, P.: 1996, 'Spectral Methods: What They Can and Cannot Do for Climate Time Series', in Anderson, D. T. L. and Willebrand, J. (eds.), Decadal Climate Variability: Dynamics and Predictability, NATO ASI Series, Vol. I 44, Springer-Verlag, Berlin.
Grassl, H.: 2000, 'Status and Improvement of Coupled Circulation Models', Science 288, 1991–1997.
Greve, R.: 2000, 'On the Response of the Greenland Ice Sheet to Greenhouse Climate Change', Clim. Change 46, 289–303.
Hand, D. J.: 1998, 'Data Mining: Statistics and More?', The American Statistician 52, 112–118.
Hänninen, H.: 1995, 'Assessing Ecological Implications of Climate Change: Can We Rely on Our Simulation Models?', Clim. Change 31, 1–4.
Hastie, T. J. and Tibshirani, R. J.: 1990, Generalized Additive Models, Chapman Hall, London.
Haylock, R. G. and O'Hagan, A.: 1996, 'On Inference for Outputs of Computationally Expensive Algorithms with Uncertainty on the Inputs', in Bernardo, J. M. et al (eds.), Bayesian Statistics 5, Oxford University Press, London, pp. 629–637.
Jiang, N., Ghil, M., Neelin, J. D.: 1995, 'Forecasts of Equatorial Pacific SST Anomalies Using and Autoregressive Process Using Singular Spectrum Analysis', Experimental Long-lead Forecast Bulletin 4(1), 24–27.
Kennedy, M., Oakley, J., and O'Hagan, A.: forthcoming, 2000, 'Uncertainty Analysis and Other Inference Tools for Complex Computer Codes', in J.M. Bernardo, J. M. et al (eds.), Bayesian Statistics 6, Oxford University Press, London.
Kerr, R. A.: 2000, 'Second Thoughts on Skill of El Niño Predictions', Science 290, 257–258.
Li, W. and Nachtsheim, C. J.: 2000, 'Model-Robust Factorial Designs', Technometrics 424, 345–352.
Lim, Y. B., Sacks, J, Studden, W. J., and Welch, W. J.: 1997, Design and Analysis of Computer Experiments When the Output is Highly Correlated Over the Input Space, Technical Report No. 62, National Institute of Statistical Sciences, Research Triangle, North Carolina.
Livezey, R. E.: 1999, 'Field Intercomparison', in von Storch, H. and Navarra, A. (eds.), Analysis of Climate Variability: Applications of Statistical Techniques, Springer, New York.
Lu, R., Turco, R. P., and Jacobson, M. A.: 1997a, 'An Integrated Air Pollution Modeling System for Urban and Regional Scales: 1. Simulations for SCAQS 1987', J. Geophys. Res. 102, 6063–6079.
Lu, R., Turco, R. P., and Jacobson, M. A.: 1997b, 'An Integrated Air Pollution Modeling System for Urban and Regional Scales: 2. Simulations for SCAQS 1987', J. Geophys. Res. 102, 6081–6098.
Mearns, L. O., Rosenzweig, C., and Goldberg, R.: 1997, 'Mean and Variance Change in Climate Scenarios: Methods, Agricultural Applications, and measures of Uncertainty', Clim. Change 35, 367–396.
Moorthi, S.: 2000, 'Application of Relaxed Arakawa-Schubert Cumulus Parameterization of the NCEP Climate Model: Some Sensitivity Experiments', in Randall, D. A. (ed.), General Circulation Model Development: Past Present and Future, Academic Press, New York.
Mosteller, F. and Tukey, J.: 1977, Data Analysis and Regression, Addison-Wesley, Reading, MA.
Ogden, R. T.: 1997, Essential Wavelets for Statistical Applications and Data Analysis, Birkhäuser, Boston.
Sacks, J., Welch, W., Mitchell, T. J., and Wynn, H. P.: 1989, 'Design and Analysis of Computer Experiments', Statistical Science 4, 409–435.
Saltelli, A., Tarantola, S., and Chan, K. P.-S.: 1999, 'A Quantitative Model-Independent Method for Global Sensitivity Analysis of Model Output', Technometrics 41, 39–56.
Schoenberg, F., Berk, R. A., Fovell, R. G., Lu, R., and Weiss, R. E.: 2000, 'Approximation of Inversion of a Complex Meteorological System via Local Linear Filters', J. Appl. Meteorol., forthcoming.
Shackley, S., Young, P., Parkinson, S., and Wynne, B.: 1998 'Uncertainty, Complexity, and Concepts of Good Science in Climate Change Modeling: Are GCMs the Best Tools?', Clim. Change 38, 159–205.
Simhadri, K. K., Iyengar, S. S., Holyer, R. J., Lybanon, M., and Zachary, J. H.: 1998, 'Wavelet-Based Feature Extraction from Oceanographic Images', IEEE Transactions on Geoscience and Remove Sensing 36(3), 767–778.
Skiles, J. W.: 1995, 'Modeling Climate Change in the Absence of Climate Change Data', Clim. Change 30, 1–6.
Soong, S.-T. and Kim, J.: 1996, 'Simulation of a HeavyWintertime Precipitation Event in California', Clim. Change 32, 55–77.
Syu, H.-H. and Neelin, J. D.: 2000a, 'ENSO in a Hybrid Model, Part I: Sensitivity to Physical Parameterizations', Clim. Dyn. 16, 19–34.
Syu, H.-H. and Neelin, J. D.: 2000b, 'ENSO in a Hybrid Coupled Model. Part II: Prediction with Piggyback Data Assimilation', Clim. Dyn. 16, 35–48.
Talagrand, O. and Courtier, P.: 1987, 'Variational Assimilation of Meteorological Observations with the Adjoint Vorticity Equation. I: Theory', Quart. J. Roy. Meteorol. Soc. 113, 1311–1328.
Thompson, S. K. and Seber, G. A. F.: 1996, Adaptive Sampling, John Wiley, New York.
Van Minnen, J. G., Alcamo, J., and Haupt, W.: 2000, 'Deriving and Applying Response Surface Diagrams for Evaluating Climate Change Impacts on Crop Production', Clim. Change 46, 317–338.
Williams, L. J., Shaw, D., and Mendelsohn, R.: 1998, 'Evaluating GCM Output with Impact Models', Clim. Change 39, 111–133.
Wilks, D. S.: 1995, Statistical Methods in the Atmospheric Sciences, Academic Press, New York.
Xue Y., Cane M. A., Zebiak, S. E., and Blumenthal, B.: 1994, 'On the Prediction of ENSO: A Study with a Low-Order Markov Model', Tellus 46A, 512–528.
Zhu, S. C., Wu, Y., and Mumford, D. B.: 1997, 'Filter, Random Field, and Maximum Entropy (FRAME): Towards a Unified Theory for Texture Modeling', International Journal of Computer Vision 27(2), 107–126
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Berk, R.A., Fovell, R.G., Schoenberg, F. et al. The Use of Statistical Tools for Evaluating Computer Simulations – An Editorial Essay. Climatic Change 51, 119–130 (2001). https://doi.org/10.1023/A:1012241427060
Issue Date:
DOI: https://doi.org/10.1023/A:1012241427060