Skip to main content

Advertisement

Log in

BLUE against OLSE in the location model: energy minimization and asymptotic considerations

  • Regular Article
  • Published:
Statistical Papers Aims and scope Submit manuscript

Abstract

The main purpose of the paper is to uncover the connections between kriging, energy minimization and properties of the ordinary least squares and best linear unbiased estimators in the location model with correlated observations. We emphasize the special role of the constant function and illustrate our results by several examples.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Berlinet A, Thomas-Agnan C (2011) Reproducing Kernel Hilbert Spaces in Probability and Statistics. Springer, New York

    MATH  Google Scholar 

  • Bloomfield P, Watson GS (1975) The inefficiency of least squares. Biometrika 62(1):121–128

    Article  MathSciNet  MATH  Google Scholar 

  • Borodachov SV, Hardin DP, Saff EB (2019) Discrete Energy on Rectifiable Sets. Springer, New York

    Book  MATH  Google Scholar 

  • Dette H, Zhigljavsky A (2021) Reproducing kernel Hilbert spaces, polynomials, and the classical moment problem. SIAM/ASA J Uncertain Quantification 9(4):1589–1614

    Article  MathSciNet  Google Scholar 

  • Dette H, Pepelyshev A, Zhigljavsky A (2019) The BLUE in continuous-time regression models with correlated errors. Ann Stat 47(4):1928–1959

    Article  MathSciNet  MATH  Google Scholar 

  • Dijk G (2013) Distribution Theory: Convolution, Fourier Transform, and Laplace Transform. Walter de Gruyter, Berlin

    Book  MATH  Google Scholar 

  • Gauthier B, Pronzato L (2017) Convex relaxation for IMSE optimal design in random field models. Comput Stat Data Anal 113:375–394

    Article  MathSciNet  MATH  Google Scholar 

  • Hájek J (1956) Linear estimation of the mean value of a stationary random process with convex correlation function. Czechoslov Math J 6(81):94–117

    Article  MathSciNet  MATH  Google Scholar 

  • Knott M (1975) On the minimum efficiency of least squares. Biometrika 62(1):129–132

    Article  MathSciNet  MATH  Google Scholar 

  • Näther W (1985) Effective Observation of Random Fields. Teubner

  • Parzen E (1961) An approach to time series analysis. Ann Math Stat 32(4):951–989

    Article  MATH  Google Scholar 

  • Paulsen VI, Raghupathi M (2016) An Introduction to the Theory of Reproducing Kernel Hilbert Spaces. Cambridge University Press, Cambridge

    Book  MATH  Google Scholar 

  • Pronzato, L.: Performance analysis of greedy algorithms for minimising a maximum mean discrepancy. Statistics and Computing. (to appear, hal-03114891, arXiv:2101.07564) (2023)

  • Pronzato L, Zhigljavsky A (2020) Bayesian quadrature, energy minimization, and space-filling design. SIAM/ASA J Uncertain Quantification 8(3):959–1011

    Article  MathSciNet  MATH  Google Scholar 

  • Pronzato L, Zhigljavsky A (2021) Minimum-energy measures for singular kernels. J Comput Appl Math 382:113089

    Article  MathSciNet  MATH  Google Scholar 

  • Puntanen S, Styan GPH, Isotalo J (2011) Matrix Tricks for Linear Statistical Models: Our Personal Top Twenty. Springer, New York

    Book  MATH  Google Scholar 

  • Saitoh S, Sawano Y (2016) Theory of Reproducing Kernels and Applications. Springer, New York

    Book  MATH  Google Scholar 

  • Santner TJ, Williams BJ, Notz WI (2003) The Design and Analysis of Computer Experiments. Springer, Heidelberg

    Book  MATH  Google Scholar 

  • Schaback R (1999) Native Hilbert spaces for radial basis functions I. In: New Developments in Approximation Theory. Springer, New York, pp 255–282

  • Schoenberg IJ (1938) Metric spaces and positive definite functions. Trans Am Math Soc 44(3):522–536

    Article  MathSciNet  MATH  Google Scholar 

  • Sejdinovic S, Sriperumbudur B, Gretton A, Fukumizu K (2013) Equivalence of distance-based and RKHS-based statistics in hypothesis testing. Ann Stat 41(5):2263–2291

    Article  MathSciNet  MATH  Google Scholar 

  • Smit JC (1961) Estimation of the mean of a stationary stochastic process by equidistant observations. Trabajos de Estadistica 12(1):35–45

    Article  MathSciNet  MATH  Google Scholar 

  • Sriperumbudur BK, Gretton A, Fukumizu K, Schölkopf B, Lanckriet GRG (2010) Hilbert space embeddings and metrics on probability measures. J Mach Learn Res 11:1517–1561

    MathSciNet  MATH  Google Scholar 

  • Székely GJ, Rizzo ML (2013) Energy statistics: a class of statistics based on distances. J Stat Plann Inference 143(8):1249–1272

    Article  MathSciNet  MATH  Google Scholar 

  • Vilenkin SY (1959) On the estimation of the mean in stationary processes. Theory Probab. Appl. 4(4):415–416

    Article  MATH  Google Scholar 

  • Zhigljavsky A, Dette H, Pepelyshev A (2010) A new approach to optimal design for linear models with correlated observations. J Am Stat Assoc 105:1093–1103

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

The work of the first author was partly supported by project INDEX (INcremental Design of EXperiments) ANR-18-CE91-0007 of the French National Research Agency (ANR). The authors are grateful to Toni Karvonen (University of Helsinki) for useful advice and especially for proposing a family of translation- invariant kernels with non-convex functions \(\Psi \) and \(\textrm{1}_{{\mathscr {X}}}\in {{{\mathcal {P}}}}_K\) used in Example 1.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Luc Pronzato.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pronzato, L., Zhigljavsky, A. BLUE against OLSE in the location model: energy minimization and asymptotic considerations. Stat Papers 64, 1187–1208 (2023). https://doi.org/10.1007/s00362-023-01423-2

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00362-023-01423-2

Navigation