Abstract.
The extraction of a physical law y=yo(x) from joint experimental data about x and y is treated. The joint, the marginal and the conditional probability density functions (PDF) are expressed by given data over an estimator whose kernel is the instrument scattering function. As an optimal estimator of yo(x) the conditional average is proposed. The analysis of its properties is based upon a new definition of prediction quality. The joint experimental information and the redundancy of joint measurements are expressed by the relative entropy. With the number of experiments the redundancy on average increases, while the experimental information converges to a certain limit value. The difference between this limit value and the experimental information at a finite number of data represents the discrepancy between the experimentally determined and the true properties of the phenomenon. The sum of the discrepancy measure and the redundancy is utilized as a cost function. By its minimum a reasonable number of data for the extraction of the law yo(x) is specified. The mutual information is defined by the marginal and the conditional PDFs of the variables. The ratio between mutual information and marginal information is used to indicate which variable is the independent one. The properties of the introduced statistics are demonstrated on deterministically and randomly related variables.
Similar content being viewed by others
References
I. Grabec, W. Sachse, Synergetics of Measurement, Prediction and Control (Springer-Verlag, Berlin, 1997)
J.C.G. Lesurf, Information and Measurement (Institute of Physics Publishing, Bristol, 2002)
I. Grabec, Eur. Phys. J. B 22, 129 (2001)
R.O. Duda, P.E. Hart, Pattern Classification and Scene Analysis (J. Wiley and Sons, New York, 1973), Chap. 4
E. Parzen, Ann. Math. Stat. 35, 1065 (1962)
S. Haykin, Neural Networks (Prentice Hall International, Inc., Upper Saddle River, New Jersey, 1999)
D.J.C. MacKay, Information Theory, Inference, and Learning Algorithms (Cambridge University Press, Cambridge, UK, 2003)
T.M. Cover, J.A. Thomas, Elements of Information Theory (John Wiley & Sons, New York, 1991)
A.N. Kolmogorov, IEEE Trans. Inf. Theory IT-2, 102 (1956)
B.S. Clarke, A.R. Barron, IEEE Trans. Inf. Theory 36, 453 (1990)
D. Haussler, M. Opper, Annals of Statistics 25, 2451 (1997)
D. Haussler, IEEE Trans. Inform. Theory 43, 1276 (1997)
C.E. Shannon, Bell. Syst. Tech. J. 27, 379 (1948)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Grabec, I. Extraction of physical laws from joint experimental data. Eur. Phys. J. B 48, 279–289 (2005). https://doi.org/10.1140/epjb/e2005-00391-0
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1140/epjb/e2005-00391-0