Abstract
Nowadays, more and more unmanned systems are adopting time series anomaly detection algorithms as the primary tool for KPI monitoring. However, many anomalous data in real environments often have complex features such as large data fluctuations, irregular data fluctuations and large data drift. Traditional univariate or multivariate anomaly detection algorithms can hardly meet the demand for anomaly detection of time series with many features and large fluctuations. Therefore, we propose a multivariate anomaly detection framework adapted to complex environments, which can effectively reduce the complexity of time series data and improve the overall performance of anomaly detection algorithms in complex real systems. First, data preprocessing is performed on the time series before anomaly detection to reduce the impact of temporal bias of different data items in multivariate time series data. Second, to intuitively analyze the anomalous fluctuation characteristics of the time series, we use Spectral Residual to process the significance of the time series. Then, we combine the Spectral Residual processed data and Logistic Regression algorithm to construct anomaly classifiers for anomaly detection of real-time data in complex real systems. Finally, by experimenting with a prototype system on a private cloud platform, our approach obtains superior results under multiple anomaly patterns compared with traditional univariate and multivariate anomaly detection algorithms.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ren, H., et al.: Time-series anomaly detection service at microsoft. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 3009–3017, July 2019
Ma, M., Zhang, S., Pei, D., Huang, X., Dai, H.: Robust and rapid adaption for concept drift in software system anomaly detection. In: 2018 IEEE 29th International Symposium on Software Reliability Engineering (ISSRE), pp. 13–24. IEEE, October 2018
Gao, J., Song, X., Wen, Q., Wang, P., Sun, L., Xu, H.: RobustTAD: Robust time series anomaly detection via decomposition and convolutional neural networks. arXiv preprint arXiv:2002.09545 (2020)
Karimi, M.: Finite sample AIC for autoregressive model order selection. In: 2007 IEEE International Conference on Signal Processing and Communications, pp. 1219–1222. IEEE, November 2007
Badeau, R., David, B.: Weighted maximum likelihood autoregressive and moving average spectrum modeling. In: 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 3761–3764. IEEE, March 2008
Box, G.E., Jenkins, G.M., Reinsel, G.C., Ljung, G.M.: Time Series Analysis: Forecasting and Control. Wiley, Hoboken (2015)
Chen, X., Jiang, T., Zeng, X., Yin, X., Shao, G.: Network anomaly detection based on multidimensional time series analysis. Eng. Sci. Technol. 49(1), 144–150 (2017)
Madan, R., Mangipudi, P.S.: Predicting computer network traffic: a time series forecasting approach using DWT, ARIMA and RNN. In: 2018 Eleventh International Conference on Contemporary Computing (IC3), pp. 1–5. IEEE, August 2018
Khokhar, S., Zin, A.A.M., Memon, A.P., Mokhtar, A.S.: A new optimal feature selection algorithm for classification of power quality disturbances using discrete wavelet transform and probabilistic neural network. Measurement 95, 246–259 (2017)
Khandelwal, I., Satija, U., Adhikari, R.: Efficient financial time series forecasting model using DWT decomposition. In: 2015 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT), pp. 1–5. IEEE, July 2015
Qiao, Y., Xin, X.W., Bin, Y., Ge, S.: Anomaly intrusion detection method based on HMM. Electron. Lett. 38(13), 663–664 (2002)
Tago, K., Jin, Q.: Detection of anomaly health data by specifying latent factors with SEM and estimating hidden states with HMM. In: 2018 9th International Conference on Information Technology in Medicine and Education (ITME), pp. 137–141. IEEE, October 2018
Shorewala, V.: Anomaly detection and improvement of clusters using enhanced K-means algorithm. In: 2021 5th International Conference on Computer, Communication and Signal Processing (ICCCSP), pp. 115–121. IEEE, May 2021
Ester, M., Kriegel, H.P., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: KDD, vol. 96, no. 34, pp. 226–231, August 1996
Zuo, J., Chen, Z.: Anomaly detection algorithm based on improved K-means clustering. Comput. Sci. 43(8), 258–261 (2016)
Tzortzis, G., Likas, A.: The MinMax k-Means clustering algorithm. Pattern Recogn. 47(7), 2505–2516 (2014)
Jia, R.: Research on multidimensional time series data mining technology, pp. 1–52. Nanjing University of Aeronautics and Astronautics, Nanjing (2008)
Sun, D.: Research on classification and regression of support vector machines, pp. 17–18. Central South University, Changsha (2004)
Weng, X., Shen, J.: Recognition of exception patterns in multivariate time series. Pattern Recogn. Artif. Intell. 20(3), 336–342 (2007)
Acknowledgment
This work is supported by National Key R&D Program of China (2018YFE0205502) and National Natural Science Foundation of China (NSFC) under Grant Nos. 61871048 and 61872253.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Liu, Z., Yang, S., Ding, Z., Ma, T., Feng, Z. (2022). MultiSR: A SR-Based Framework for Multivariate Time Series Anomaly Detection in Complex Unmanned Scenarios. In: Wu, M., Niu, Y., Gu, M., Cheng, J. (eds) Proceedings of 2021 International Conference on Autonomous Unmanned Systems (ICAUS 2021). ICAUS 2021. Lecture Notes in Electrical Engineering, vol 861. Springer, Singapore. https://doi.org/10.1007/978-981-16-9492-9_220
Download citation
DOI: https://doi.org/10.1007/978-981-16-9492-9_220
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-9491-2
Online ISBN: 978-981-16-9492-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)