Skip to main content

MultiSR: A SR-Based Framework for Multivariate Time Series Anomaly Detection in Complex Unmanned Scenarios

  • Conference paper
  • First Online:
Proceedings of 2021 International Conference on Autonomous Unmanned Systems (ICAUS 2021) (ICAUS 2021)

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 861))

Included in the following conference series:

  • 306 Accesses

Abstract

Nowadays, more and more unmanned systems are adopting time series anomaly detection algorithms as the primary tool for KPI monitoring. However, many anomalous data in real environments often have complex features such as large data fluctuations, irregular data fluctuations and large data drift. Traditional univariate or multivariate anomaly detection algorithms can hardly meet the demand for anomaly detection of time series with many features and large fluctuations. Therefore, we propose a multivariate anomaly detection framework adapted to complex environments, which can effectively reduce the complexity of time series data and improve the overall performance of anomaly detection algorithms in complex real systems. First, data preprocessing is performed on the time series before anomaly detection to reduce the impact of temporal bias of different data items in multivariate time series data. Second, to intuitively analyze the anomalous fluctuation characteristics of the time series, we use Spectral Residual to process the significance of the time series. Then, we combine the Spectral Residual processed data and Logistic Regression algorithm to construct anomaly classifiers for anomaly detection of real-time data in complex real systems. Finally, by experimenting with a prototype system on a private cloud platform, our approach obtains superior results under multiple anomaly patterns compared with traditional univariate and multivariate anomaly detection algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Ren, H., et al.: Time-series anomaly detection service at microsoft. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 3009–3017, July 2019

    Google Scholar 

  2. Ma, M., Zhang, S., Pei, D., Huang, X., Dai, H.: Robust and rapid adaption for concept drift in software system anomaly detection. In: 2018 IEEE 29th International Symposium on Software Reliability Engineering (ISSRE), pp. 13–24. IEEE, October 2018

    Google Scholar 

  3. Gao, J., Song, X., Wen, Q., Wang, P., Sun, L., Xu, H.: RobustTAD: Robust time series anomaly detection via decomposition and convolutional neural networks. arXiv preprint arXiv:2002.09545 (2020)

    Google Scholar 

  4. Karimi, M.: Finite sample AIC for autoregressive model order selection. In: 2007 IEEE International Conference on Signal Processing and Communications, pp. 1219–1222. IEEE, November 2007

    Google Scholar 

  5. Badeau, R., David, B.: Weighted maximum likelihood autoregressive and moving average spectrum modeling. In: 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 3761–3764. IEEE, March 2008

    Google Scholar 

  6. Box, G.E., Jenkins, G.M., Reinsel, G.C., Ljung, G.M.: Time Series Analysis: Forecasting and Control. Wiley, Hoboken (2015)

    MATH  Google Scholar 

  7. Chen, X., Jiang, T., Zeng, X., Yin, X., Shao, G.: Network anomaly detection based on multidimensional time series analysis. Eng. Sci. Technol. 49(1), 144–150 (2017)

    Article  Google Scholar 

  8. Madan, R., Mangipudi, P.S.: Predicting computer network traffic: a time series forecasting approach using DWT, ARIMA and RNN. In: 2018 Eleventh International Conference on Contemporary Computing (IC3), pp. 1–5. IEEE, August 2018

    Google Scholar 

  9. Khokhar, S., Zin, A.A.M., Memon, A.P., Mokhtar, A.S.: A new optimal feature selection algorithm for classification of power quality disturbances using discrete wavelet transform and probabilistic neural network. Measurement 95, 246–259 (2017)

    Article  Google Scholar 

  10. Khandelwal, I., Satija, U., Adhikari, R.: Efficient financial time series forecasting model using DWT decomposition. In: 2015 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT), pp. 1–5. IEEE, July 2015

    Google Scholar 

  11. Qiao, Y., Xin, X.W., Bin, Y., Ge, S.: Anomaly intrusion detection method based on HMM. Electron. Lett. 38(13), 663–664 (2002)

    Article  Google Scholar 

  12. Tago, K., Jin, Q.: Detection of anomaly health data by specifying latent factors with SEM and estimating hidden states with HMM. In: 2018 9th International Conference on Information Technology in Medicine and Education (ITME), pp. 137–141. IEEE, October 2018

    Google Scholar 

  13. Shorewala, V.: Anomaly detection and improvement of clusters using enhanced K-means algorithm. In: 2021 5th International Conference on Computer, Communication and Signal Processing (ICCCSP), pp. 115–121. IEEE, May 2021

    Google Scholar 

  14. Ester, M., Kriegel, H.P., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: KDD, vol. 96, no. 34, pp. 226–231, August 1996

    Google Scholar 

  15. Zuo, J., Chen, Z.: Anomaly detection algorithm based on improved K-means clustering. Comput. Sci. 43(8), 258–261 (2016)

    MathSciNet  Google Scholar 

  16. Tzortzis, G., Likas, A.: The MinMax k-Means clustering algorithm. Pattern Recogn. 47(7), 2505–2516 (2014)

    Article  Google Scholar 

  17. Jia, R.: Research on multidimensional time series data mining technology, pp. 1–52. Nanjing University of Aeronautics and Astronautics, Nanjing (2008)

    Google Scholar 

  18. Sun, D.: Research on classification and regression of support vector machines, pp. 17–18. Central South University, Changsha (2004)

    Google Scholar 

  19. Weng, X., Shen, J.: Recognition of exception patterns in multivariate time series. Pattern Recogn. Artif. Intell. 20(3), 336–342 (2007)

    Google Scholar 

Download references

Acknowledgment

This work is supported by National Key R&D Program of China (2018YFE0205502) and National Natural Science Foundation of China (NSFC) under Grant Nos. 61871048 and 61872253.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhaoyang Liu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liu, Z., Yang, S., Ding, Z., Ma, T., Feng, Z. (2022). MultiSR: A SR-Based Framework for Multivariate Time Series Anomaly Detection in Complex Unmanned Scenarios. In: Wu, M., Niu, Y., Gu, M., Cheng, J. (eds) Proceedings of 2021 International Conference on Autonomous Unmanned Systems (ICAUS 2021). ICAUS 2021. Lecture Notes in Electrical Engineering, vol 861. Springer, Singapore. https://doi.org/10.1007/978-981-16-9492-9_220

Download citation

Publish with us

Policies and ethics