Abstract
The problem of predicting time series originating from mixtures of signals from independent dynamical systems is considered. We show that the problem of finding representations for the dynamics of such systems is hard if the mixing structure of the system is not taken into account. If, on the contrary, the sources can be unmixed in a preprocessing step the complexity of system identification may be drastically reduced. This is demonstrated using chaotic maps. It is shown that applications of methods for blind separation of sources can substantially improve both: prediction performance and prediction horizon.
This is a preview of subscription content, log in via an institution.
Preview
Unable to display preview. Download preview PDF.
References
Amari, S., Cichocki, A., Yang, H., A new learning algorithm for blind signal separation, Advances in Neural Information Processing Systems 8 (NIPS 95), D.S. Touretzky, M.C. Mozer and M.E. Hasselmo (eds.), MIT Press: Cambridge, MA (1996)
Bell, A.J., Sejnowski, T., An information-maximization approach to blind separation and blind deconvolution, Neural Computation 7, 1129–1159 (1995)
Bengio, Y., Frasconi, P. (1994). Credit assignment through time: Alternatives to backpropagation. NIPS 93, Morgan Kaufmann.
Cardoso, J.F., Laheld, B., Equivariant adaptive source separation, to appear in IEEE Trans. on Signal Processing (1996)
Jutten, C., Herault, J., Blind separation of sources, Part I: An adaptive algorithm based on neuromimetic architecture, Signal Processing 24, 1–10 (1991)
Kohlmorgen, J., Müller, K.-R., Pawelzik, K. (1994). Competing Predictors Segment and Identify Switching Dynamics. ICANN'94, Springer London, 1045–1048.
Kohlmorgen, J., Müller, K.-R., Pawelzik, K. (1995). Improving short-term prediction with competing experts. ICANN'95, EC2 & Cie, Paris, 2:215–220.
Liebert, W., Pawelzik, K., Schuster, H.G., Optimal embeddings of chaotic attractors from topological considerations, Europhys. Lett. 14, 521 (1991).
Mackey, M., Glass, L., Oscillation and chaos in a physiological control system, Science 197, 287 (1977).
Molgedey, L., Schuster, H.G., Separation of a mixture of independent signals using time delayed correlations, Phys. Rev. Lett. 72, 23, 3634–3637 (1994)
Moody, J., C. Darken (1989). Fast Learning in Networks of Locally-Tuned Processing Units. Neural Computation 1, 281–294, 1989.
Müller, K.-R., Kohlmorgen, J., Pawelzik, K. (1995). Analysis of Switching Dynamics with Competing Neural Networks, IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, E78-A, No.10, 1306–1315.
Pawelzik, K., Kohlmorgen, J., Müller, K.-R. (1996). Annealed Competition of Experts for a Segmentation and Classification of Switching Dynamics, Neural Computation, 8:2, 342–358.
Rumelhart, D.E., McClelland, J.L., Parallel distributed processing, MIT Press, Cambridge Massachusetts (1984).
Takens, F., Detecting strange attractors in turbulence, in: Rand, D., Young, L.-S., (Eds.), Dynamical Systems and Turbulence, Springer Lecture Notes in Mathematics, 898, 366 (1981).
Weigend, A.S., Gershenfeld, N.A. (Eds.), Time Series Prediction: Forecasting the Future and Understanding the Past, Addison-Wesley (1994)
Weigend, A.S., Mangeas, M., Nonlinear gated experts for time series: discovering regimes and avoiding overfitting, University of Colorado tech. Report. CU-CS-764-95 and submitted to Machine Learning (1995)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1996 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Pawelzik, K., Müller, K.R., Kohlmorgen, J. (1996). Prediction of mixtures. In: von der Malsburg, C., von Seelen, W., Vorbrüggen, J.C., Sendhoff, B. (eds) Artificial Neural Networks — ICANN 96. ICANN 1996. Lecture Notes in Computer Science, vol 1112. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-61510-5_25
Download citation
DOI: https://doi.org/10.1007/3-540-61510-5_25
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-61510-1
Online ISBN: 978-3-540-68684-2
eBook Packages: Springer Book Archive