Skip to main content
SpringerLink
Log in

Radar HRRP statistical recognition with temporal factor analysis by automatic Bayesian Ying-Yang harmony learning

  • Research Article
  • Published:
Frontiers of Electrical and Electronic Engineering in China

Abstract

Radar high-resolution range profiles (HRRPs) are typical high-dimensional and interdimension dependently distributed data, the statistical modeling of which is a challenging task for HRRP-based target recognition. Supposing that HRRP samples are independent and jointly Gaussian distributed, a recent work [Du L, Liu H W, Bao Z. IEEE Transactions on Signal Processing, 2008, 56(5): 1931–1944] applied factor analysis (FA) to model HRRP data with a two-phase approach for model selection, which achieved satisfactory recognition performance. The theoretical analysis and experimental results reveal that there exists high temporal correlation among adjacent HRRPs. This paper is thus motivated to model the spatial and temporal structure of HRRP data simultaneously by employing temporal factor analysis (TFA) model. For a limited size of high-dimensional HRRP data, the two-phase approach for parameter learning and model selection suffers from intensive computation burden and deteriorated evaluation. To tackle these problems, this work adopts the Bayesian Ying-Yang (BYY) harmony learning that has automatic model selection ability during parameter learning. Experimental results show stepwise improved recognition and rejection performances from the two-phase learning based FA, to the two-phase learning based TFA and to the BYY harmony learning based TFA with automatic model selection. In addition, adding many extra free parameters to the classic FA model and thus becoming even worse in identifiability, the model of a general linear dynamical system is even inferior to the classic FA model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Kosir P, DeWal R. Feature alignment techniques for pattern recognition. In: Proceedings of IEEE National Conference on Aerospace and Electronics. 1994, 1: 128–132

    Google Scholar 

  2. Webb A R. Gamma mixture models for target recognition. Pattern Recognition, 2000, 33(12): 2045–2054

    Article  MATH  Google Scholar 

  3. Copsey K, Webb A R. Bayesian Gamma mixture model approach to radar target recognition. IEEE Transactions on Aerospace and Electronic Systems, 2003, 39(4): 1201–1217

    Article  Google Scholar 

  4. Seibert M, Waxman A M. Adaptive 3-D object recognition from multiple views. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992, 14(2): 107–124

    Article  Google Scholar 

  5. Jacobs S P. Automatic target recognition using high-resolution radar range profiles. Dissertation for the Doctoral Degree. St. Louis: Washington University, 1999

    Google Scholar 

  6. Du L, Liu H W, Bao Z, Zhang J Y. A two-distribution compounded statistical model for radar HRRP target recognition. IEEE Transactions on Signal Processing, 2006, 54(6): 2226–2238

    Article  Google Scholar 

  7. Du L, Liu H W, Bao Z. Radar HRRP statistical recognition based on hypersphere model. Signal Processing, 2008, 88(5): 1176–1190

    Article  MathSciNet  MATH  Google Scholar 

  8. Du L, Liu H W, Bao Z. Radar HRRP statistical recognition: parametric model and model selection. IEEE Transactions on Signal Processing, 2008, 56(5): 1931–1944

    Article  MathSciNet  Google Scholar 

  9. Zhu F, Zhang X D, Hu Y F. Gabor filter approach to joint feature extraction and target recognition. IEEE Transactions on Aerospace and Electronic Systems, 2009, 45(1): 17–30

    Article  Google Scholar 

  10. Wong S K. High range resolution profiles as motion-invariant features for moving ground targets identification in SAR-based automatic target recognition. IEEE Transactions on Aerospace and Electronic Systems, 2009, 45(3): 1017–1039

    Article  Google Scholar 

  11. Xu L. Bayesian Ying-Yang system and theory as a unified statistical learning approach: (v) temporal modeling for temporal perception and control. In: Proceedings of the International Conference on Neural Information Processing. 1998, 2: 877–884

    Google Scholar 

  12. Xu L. Temporal Bayesian Ying-Yang dependence reduction, blind source separation and principal independent components. In: Proceedings of International Joint Conference on Neural Networks. 1999, 2: 1071–1076

    Google Scholar 

  13. Xu L. Temporal BYY learning for state space approach, hidden Markov model, and blind source separation. IEEE Transactions on Signal Processing, 2000, 48(7): 2132–2144

    Article  MathSciNet  MATH  Google Scholar 

  14. Xu L. BYY harmony learning, independent state space, and generalized APT financial analyses. IEEE Transactions on Neural Networks, 2001, 12(4): 822–849

    Article  Google Scholar 

  15. Xu L. Temporal factor analysis: stable-identifiable family, orthogonal flow learning, and automated model selection. In: Proceedings of International Joint Conference on Neural Networks. 2002, 472–476

  16. Xu L. Independent component analysis and extensions with noise and time: a Bayesian Ying-Yang learning perspective. Neural Information Processing—Letters and Reviews, 2003, 1(1): 1–52

    Google Scholar 

  17. Xu L. Temporal BYY encoding, Markovian state spaces, and space dimension determination. IEEE Transactions on Neural Networks, 2004, 15(5): 1276–1295

    Article  Google Scholar 

  18. Xu L. Learning algorithms for RBF functions and subspace based functions. Handbook of Research on Machine Learning, Applications and Trends: Algorithms, Methods and Techniques. Hershey: IGI Global, 2009, 60–94

  19. Xu L. Bayesian Ying-Yang system, best harmony learning and five action circling. Frontiers of Electrical and Electronic Engineering in China, 2010, 5(3): 281–328

    Article  Google Scholar 

  20. Chiu K C, Xu L. Arbitrage pricing theory based Gaussian temporal factor analysis for adaptive portfolio management. Decision Support Systems, 2004, 37(4): 485–500

    Article  Google Scholar 

  21. Chiu K C, Xu L. Optimizing financial portfolios from the perspective of mining temporal structures of stock returns. In: Proceedings of the 3rd International Conference on Machine Learning. 2003, 266–275

  22. Burnham K P, Anderson D. Model Selection and Multi-Model Inference. New York: Springer, 2002

    Google Scholar 

  23. Akaike H. Factor analysis and AIC. Psychometrika, 1987, 52(3): 317–332

    Article  MathSciNet  MATH  Google Scholar 

  24. Akaike H. A new look at the statistical model identification. IEEE Transactions on Automatic Control, 1974, 19(6): 714–723

    Google Scholar 

  25. Bozdogan H. Model selection and Akaike’s information criterion (AIC): the general theory and its analytical extension. Psychometrika, 1987, 52(3): 345–370

    Article  MathSciNet  MATH  Google Scholar 

  26. Anderson T W, Rubin H. Statistical inference in factor analysis. In: Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability. 1956, 5: 111–150

    MathSciNet  Google Scholar 

  27. Ghahramani Z, Hinton G. Parameter estimation for linear dynamical systems. Technical Report CRG-TR-96-2, 1996

  28. Roweis S, Ghahramani Z. A unifying review of linear Gaussian models. Neural Computation, 1999, 11(2): 305–345

    Article  Google Scholar 

  29. Ghahramani Z, Hinton G E. Variational learning for switching state-space models. Neural Computation, 2000, 12(4): 831–864

    Article  Google Scholar 

  30. Carrara W G, Goodman R S, Majewski R M. Spotlight Synthetic Aperture Radar — Signal Processing Algorithms. Boston: Arthech House, 1995

    MATH  Google Scholar 

  31. Parzen E. On the estimation of a probability density function and mode. Annals of Mathematical Statistics, 1962, 33(3): 1065–1076

    Article  MathSciNet  MATH  Google Scholar 

  32. Rubin D B, Thayer D T. EM algorithms for ML factor analysis. Psychometrika, 1982, 47(1): 69–76

    Article  MathSciNet  MATH  Google Scholar 

  33. Schwarz G. Estimating the dimension of a model. Annals of Statistics, 1978, 6(2): 461–464

    Article  MathSciNet  MATH  Google Scholar 

  34. Shi L, Wang P, Liu H, Xu L, Bao Z. Radar HRRP statistical recognition with local factor analysis by automatic Bayesian Ying-Yang harmony learning. IEEE Transactions on Signal Processing, 2011, 59(2): 610–617

    Article  Google Scholar 

  35. Salah A A, Alpaydin E. Incremental mixtures of factor analyzers. In: Proceedings of the 17th International Conference on Pattern Recognition. 2004, 1: 276–279

    Article  Google Scholar 

  36. Tipping M E, Bishop C M. Mixtures of probabilistic principal component analyzers. Neural Computation, 1999, 11(2): 443–482

    Article  Google Scholar 

  37. Shumway R H, Stoffer D S. An approach to time series smoothing and forecasting using the EM algorithm. Journal of Time Series Analysis, 1982, 3(4): 253–264

    Article  MATH  Google Scholar 

  38. Xu L. YING-YANG machine for temporal signals. In: Proceedings of 1995 IEEE International Conference on Neural Networks and Signal Processing. 1995, I: 644–651

    Google Scholar 

  39. Xu L. Bayesian Ying Yang system and theory as a unified statistical learning approach: (ii) from unsupervised learning to supervised learning and temporal modeling. In: Wong K M, King I, Yeung D Y, eds. Proceedings of Theoretical Aspects of Neural Computation: A Multidisciplinary Perspective. 1997, 25–42

  40. Xu L. Temporal BYY learning and its applications to extended Kalman filtering, hidden Markov model, and sensor-motor integration. In: Proceedings of International Joint Conference on Neural Networks. 1999, 2: 949–954

    Google Scholar 

  41. Shumway R H, Stoffer D S. Dynamic linear models with switching. Journal of the American Statistical Association, 1991, 86(415): 763–769

    Article  MathSciNet  Google Scholar 

  42. Elliott R J, Aggoun L, Moore J B. Hidden Markov Models: Estimation and Control. New York: Springer-Verlag, 1995

    MATH  Google Scholar 

  43. Digalakis V, Rohlicek J R, Ostendorf M. ML estimation of a stochastic linear system with the EM algorithm and its application to speech recognition. IEEE Transactions on Speech and Audio Processing, 1993, 1(4): 431–442

    Article  Google Scholar 

  44. Xu L. Bayesian-Kullback coupled YING-YANG machines: unified learning and new results on vector quantization. In: Proceedings of the International Conference on Neural Information Processing. 1995, 977–988 (A further version in NIPS8. In: Touretzky D S, et al. eds. Cambridge: MIT Press, 444–450)

  45. Xu L. Another perspective of BYY harmony learning: representation in multiple layers, co-decomposition of data covariance matrices, and applications to network biology. Frontiers of Electrical and Electronic Engineering in China, 2011, 6(1): 86–119

    Article  Google Scholar 

  46. Xu L. Bayesian Ying Yang system and theory as a unified statistical learning approach: (i) unsupervised and semi-unsupervised learning. In: Amari S, Kassabov N, eds. Brain-Like Computing and Intelligent Information Systems. New Zealand: Springer-Verlag, 1997, 241–274

    Google Scholar 

  47. Tu S, Xu L. Parameterizations make different model selections: empirical findings from factor analysis. Frontiers of Electrical and Electronic Engineering in China, 2011 (in Press)

  48. Xu L. Data smoothing regularization, multi-sets-learning, and problem solving strategies. Neural Networks, 2003, 16(5–6): 817–825

    Article  Google Scholar 

  49. Egan J P. Signal Detection Theory and ROC Analysis. San Diego: Academic Press, 1975

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. National Laboratory of Radar Signal Processing, Xidian University, Xi’an, 710071, China

    Penghui Wang, Lan Du, Hongwei Liu & Zheng Bao

  2. Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China

    Lei Shi & Lei Xu

Authors
  1. Penghui Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lei Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lan Du
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hongwei Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lei Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Zheng Bao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lei Xu.

Additional information

Penghui WANG received the B.Eng. degree in communication engineering from the National University of Defense Technology, Changsha, China, in 2005. He is currently working toward the Ph.D degree with the National Laboratory of Radar Signal Processing, Xidian University. His research interests include radar signal processing, radar automatic target recognition (RATR), and pattern recognition.

Lei SHI received the B.Eng. degree in computer science and technology from the University of Science and Technology of China, Hefei, in 2005. He is currently a Ph.D student with the Department of Computer Science and Engineering, the Chinese University of Hong Kong. His research interests include statistical learning and neural computing.

Lan DU received the B.S., M.S. and Ph.D degrees in electronic engineering from Xidian University, Xi’an, China, in Jul. 2001, Mar. 2004 and Jun. 2007 respectively. Her doctoral dissertation was granted Top 100 Doctoral Dissertation in China in 2009. She is currently an Associate Professor in Xidian University. Her main research interests are in the fields of statistical signal processing and machine learning with application to radar target recognition.

Hongwei LIU received the B.Eng. degree from Dalian University of Technology in electronic engineering in 1992, and the M.Eng. and Ph.D degrees in electronic engineering from Xidian University, Xi’an, China, in 1995 and 1999, respectively. He is currently the Director and a Professor with the National Laboratory of Radar Signal Processing, Xidian University. His research interests include radar automatic target recognition (RATR), radar signal processing, and adaptive signal processing.

Lei XU, IEEE Fellow (2001–) and Fellow of International Association for Pattern Recognition (2002–), and Academician of European Academy of Sciences (2002–); a Chair Professor with the Chinese University of Hong Kong, a Chang Jiang Chair Professor with Peking University, China, and an Honorary Professor with Xidian University (See Front. Electr. Electron. Eng. China, 2011, 6(1): 119 for a detailed introduction).

Zheng BAO received the B.Eng. degree from the Communication Engineering Institution of China in 1953. Currently, he is a Professor at Xidian University, Xi’an, China. He is the author or coauthor of six books and has published more than 300 papers. His current research work focuses on the areas of space-time adaptive processing (STAP), radar imaging (SAR/ISAR), radar automatic target recognition (RATR), over-the-horizon radar (OTHR) signal processing, and passive coherent location (PCL). Prof. Bao is a member of the Chinese Academy of Sciences.

About this article

Cite this article

Wang, P., Shi, L., Du, L. et al. Radar HRRP statistical recognition with temporal factor analysis by automatic Bayesian Ying-Yang harmony learning. Front. Electr. Electron. Eng. China 6, 300–317 (2011). https://doi.org/10.1007/s11460-011-0149-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11460-011-0149-8

Keywords

Search

Navigation