Abstract
In Independent Factor Analysis (IFA), latent components (or sources) are recovered from only their linear observed mixtures. Both the mixing process and the source densities (that are assumed to be generated according to mixtures of Gaussians) are learned from observed data. This paper investigates the possibility of estimating the IFA model in its noiseless setting when two kinds of prior information are incorporated: constraints on the mixing process and partial knowledge on the cluster membership of some examples. Semi-supervised or partially supervised learning frameworks can thus be handled. These two proposals have been initially motivated by a real-world application that concerns fault diagnosis of a railway device. Results from this application are provided to demonstrate the ability of our approach to enhance estimation accuracy and remove indeterminacy commonly encountered in unsupervised IFA such as source permutations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Hyvärinen, A., Karhunen, J., Oja, E.: Independent Component Analysis. Wiley, Chichester (2001)
Bell, A.J., Sejnowski, T.J.: An information maximization approach to blind separation and blind deconvolution. Neural Computation 7(6), 1129–1159 (1995)
Jutten, C., Comon, P.: Séparation de source 2, au-delà de l’aveugle et application. Hermés (2007)
Moulines, E., Cardoso, J., Cassiat, E.: Maximum likelihood for blind separation and deconvolution of noisy signals using mixture models. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 3617–3620 (1997)
Attias, H.: Independent factor analysis. Neural Computation 11(4), 803–851 (1999)
Attias, H.: Independent factor analysis with temporally structured factors. In: Proceedings of the 12th NIPS Conference, pp. 386–392. MIT Press, Cambridge (2000)
Moussaoui, S., Hauksdóttir, H., Schmidt, F., Jutten, C., Chanussot, J., Brie, D., Douté, D., Benediktosson, J.: On the decomposition of Mars Hyperspectral data by ICA and Bayesian positive source separation. Neurocomputing for Vision Research; Advances in Blind Signal Processing 71, 2194–2208 (2008)
Hyvärinen, A., Karthikesh, R.: Imposing sparsity on the mixing matrix in independent component analysis. Neurocomputing 49(1), 151–162 (2002)
Zhang, K., Chan, L.W.: ICA with sparse connections. In: Proceedings of Intelligent Data Engineering and Automated Learning Conference (IDEAL), pp. 530–537. Springer, Heidelberg (2006)
Bartholomew, D.J., Martin, K.: Latent variable models and factor analysis, 2nd edn. Kendall’s library of satistics, Arnold (1999)
Bakir, T., Peter, A., Riley, R., Hackett, J.: Non-negative maximum likelihood ICA for blind source separation of images and signals with application to hyperspectral image subpixel demixing. In: Proceedings of the IEEE International Conference on Image Processing, pp. 3237–3240 (2006)
Bollen, K.A.: Structural Equations with Latent Variables. Wiley, Chichester (1989)
Cǒme, E.: Apprentissage de modèles génératifs pour le diagnostic de systèmes complexes avec labellisation douce et contraintes spatiales PhD thesis, Université de Technologie de Compiégne (2009)
Amari, S., Cichocki, A., Yang, H.H.: A New Learning Algorithm for Blind Signal Separation. In: Proceedings of the 8th Conference on Advances in Neural Information Processing Systems (NIPS). MIT Press, Cambridge (1995)
Shafer, G.: A mathematical theory of evidence. Princeton University Press, Princeton (1976)
Cǒme, E., Oukhellou, L., Denœux, T., Aknin, P.: Learning from partially supervised data using mixture models and belief functions. Pattern recognition 42, 334–348 (2009)
Debiolles, A., Oukhellou, L., Denoeux, T., Aknin, P.: Output coding of spatially dependent subclassifiers in evidential framework. Application to the diagnosis of railway track-vehicle transmission system. In: Proceedings of FUSION 2006, Florence, Italy (July 2006)
Mclachlan, G.J., Krishnan, T.: The EM algorithm and Extension. Wiley, Chichester (1996)
Cichocki, A., Amari, S.: Adaptive Blind Signal and Image Processing. Wiley, Chichester (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Côme, E., Oukhellou, L., Denœux, T., Aknin, P. (2009). Noiseless Independent Factor Analysis with Mixing Constraints in a Semi-supervised Framework. Application to Railway Device Fault Diagnosis. In: Alippi, C., Polycarpou, M., Panayiotou, C., Ellinas, G. (eds) Artificial Neural Networks – ICANN 2009. ICANN 2009. Lecture Notes in Computer Science, vol 5769. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04277-5_42
Download citation
DOI: https://doi.org/10.1007/978-3-642-04277-5_42
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04276-8
Online ISBN: 978-3-642-04277-5
eBook Packages: Computer ScienceComputer Science (R0)