skip to main content
research-article

Temporal Hierarchical Graph Attention Network for Traffic Prediction

Authors Info & Claims
Published:29 November 2021Publication History
Skip Abstract Section

Abstract

As a critical task in intelligent traffic systems, traffic prediction has received a large amount of attention in the past few decades. The early efforts mainly model traffic prediction as the time-series mining problem, in which the spatial dependence has been largely ignored. As the rapid development of deep learning, some attempts have been made in modeling traffic prediction as the spatio-temporal data mining problem in a road network, in which deep learning techniques can be adopted for modeling the spatial and temporal dependencies simultaneously. Despite the success, the spatial and temporal dependencies are only modeled in a regionless network without considering the underlying hierarchical regional structure of the spatial nodes, which is an important structure naturally existing in the real-world road network. Apart from the challenge of modeling the spatial and temporal dependencies like the existing studies, the extra challenge caused by considering the hierarchical regional structure of the road network lies in simultaneously modeling the spatial and temporal dependencies between nodes and regions and the spatial and temporal dependencies between regions. To this end, this article proposes a new Temporal Hierarchical Graph Attention Network (TH-GAT). The main idea lies in augmenting the original road network into a region-augmented network, in which the hierarchical regional structure can be modeled. Based on the region-augmented network, the region-aware spatial dependence model and the region-aware temporal dependence model can be constructed, which are two main components of the proposed TH-GAT model. In addition, in the region-aware spatial dependence model, the graph attention network is adopted, in which the importance of a node to another node, of a node to a region, of a region to a node, and of a region to another region, can be captured automatically by means of the attention coefficients. Extensive experiments are conducted on two real-world traffic datasets, and the results have confirmed the superiority of the proposed TH-GAT model.

REFERENCES

  1. [1] Ben-Akiva Moshe, Bierlaire Michel, Koutsopoulos Haris, and Mishalani Rabi. 1998. DynaMIT: A simulation-based system for traffic prediction. In DACCORD Short Term Forecasting Workshop. 112.Google ScholarGoogle Scholar
  2. [2] Bishop Christopher M. et al. 1995. Neural Networks for Pattern Recognition. Oxford University Press. Google ScholarGoogle ScholarCross RefCross Ref
  3. [3] Chen Chenyi, Wang Yin, Li Li, Hu Jianming, and Zhang Zuo. 2012. The retrieval of intra-day trend and its influence on traffic prediction. Transport. Res. C: Emerg. Technol. 22 (2012), 103118.Google ScholarGoogle ScholarCross RefCross Ref
  4. [4] Chen Hao, Wang Senzhang, Deng Zengde, Zhang Xiaoming, and Li Zhoujun. 2019. FGST: Fine-grained spatial-temporal based regression for stationless bike traffic prediction. In Proceedings of the 23rd Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining (PAKDD’19), Vol. 11439. 265279.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. [5] Cheng Weiyu, Shen Yanyan, Zhu Yanmin, and Huang Linpeng. 2018. A neural attention model for urban air quality inference: Learning the weights of monitoring stations. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence, (AAAI-18), the 30th Innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18). 21512158. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. [6] Cho Kyunghyun, van Merrienboer Bart, Bahdanau Dzmitry, and Bengio Yoshua. 2014. On the properties of neural machine translation: Encoder-decoder approaches. In Proceedings of the 8th Workshop on Syntax, Semantics and Structure in Statistical Translation (SSST@EMNLP’14), Wu Dekai, Carpuat Marine, Carreras Xavier, and Vecchi Eva Maria (Eds.). 103111.Google ScholarGoogle ScholarCross RefCross Ref
  7. [7] Clark Stephen. 2003. Traffic prediction using multivariate nonparametric regression. J. Transport. Eng. 129, 2 (2003), 161168.Google ScholarGoogle ScholarCross RefCross Ref
  8. [8] Drucker Harris, Burges Christopher J. C., Kaufman Linda, Smola Alexander J., and Vapnik Vladimir. 1996. Support vector regression machines. In Proceedings of the Advances in Neural Information Processing Systems (NIPS’96). 155161. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. [9] Du Bowen, Peng Hao, Wang Senzhang, Bhuiyan Md. Zakirul Alam, Wang Lihong, Gong Qiran, Liu Lin, and Li Jing. 2020. Deep irregular convolutional residual LSTM for urban traffic passenger flows prediction. IEEE Trans. Intell. Transport. Syst. 21, 3 (2020), 972985.Google ScholarGoogle ScholarCross RefCross Ref
  10. [10] Duan Lian, Hu Tao, Cheng En, Zhu Jianfeng, and Gao Chao. 2017. Deep convolutional neural networks for spatiotemporal crime prediction. In Proceedings of the International Conference on Information and Knowledge Engineering (IKE’17). 6167.Google ScholarGoogle Scholar
  11. [11] Endo Yuki, Toda Hiroyuki, Nishida Kyosuke, and Ikedo Jotaro. 2016. Classifying spatial trajectories using representation learning. Int. J. Data Sci. Anal. 2, 3–4 (2016), 107117.Google ScholarGoogle ScholarCross RefCross Ref
  12. [12] Gao Zhongke, Wang Xinmin, Yang Yuxuan, Mu Chaoxu, Cai Qing, Dang Wei-Dong, and Zuo Siyang. 2019. EEG-based spatio-temporal convolutional neural network for driver fatigue evaluation. IEEE Trans. Neural Netw. Learn. Syst. 30, 9 (2019), 27552763.Google ScholarGoogle ScholarCross RefCross Ref
  13. [13] Gu Yuanli, Lu Wenqi, Qin Lingqiao, Li Meng, and Shao Zhuangzhuang. 2019. Short-term prediction of lane-level traffic speeds: A fusion deep learning model. Transport. Res. C: Emerg. Technol. 106 (2019), 116.Google ScholarGoogle ScholarCross RefCross Ref
  14. [14] Gu Yuanli, Lu Wenqi, Xu Xinyue, Qin Lingqiao, Shao Zhuangzhuang, and Zhang Hanyu. 2020. An improved Bayesian combination model for short-term traffic prediction with deep learning. IEEE Trans. Intell. Transport. Syst. 21, 3 (2020), 13321342.Google ScholarGoogle ScholarCross RefCross Ref
  15. [15] Hinton Geoffrey E. and Salakhutdinov Ruslan R.. 2006. Reducing the dimensionality of data with neural networks. Science 313, 5786 (2006), 504507.Google ScholarGoogle ScholarCross RefCross Ref
  16. [16] Hochreiter Sepp and Schmidhuber Jürgen. 1997. Long short-term memory. Neural Comput. 9, 8 (1997), 17351780. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. [17] Huang Ling, Chao Hong-Yang, and Xie Guangqiang. 2020. MuMod: A micro-unit connection approach for hybrid-order community detection. In Proceedings of the AAAI International Conference on Artificial Intelligence (AAAI’20). 107114.Google ScholarGoogle ScholarCross RefCross Ref
  18. [18] Huang Wenhao, Song Guojie, Hong Haikun, and Xie Kunqing. 2014. Deep architecture for traffic flow prediction: Deep belief networks with multitask learning. IEEE Trans. Intell. Transport. Syst. 15, 5 (2014), 21912201.Google ScholarGoogle ScholarCross RefCross Ref
  19. [19] Ishak Sherif and Al-Deek Haitham. 2002. Performance evaluation of short-term time-series traffic prediction model. J. Transport. Eng. 128, 6 (2002), 490498.Google ScholarGoogle ScholarCross RefCross Ref
  20. [20] Jiang Bo, Wang Xixi, and Luo Bin. 2019. PH-GCN: Person re-identification with part-based hierarchical graph convolutional network. CoRR abs/1907.08822.Google ScholarGoogle Scholar
  21. [21] Kipf Thomas N. and Welling Max. 2017. Semi-supervised classification with graph convolutional networks. In Proceedings of the 5th International Conference on Learning Representations (ICLR’17).Google ScholarGoogle Scholar
  22. [22] Koesdwiady Arief, Soua Ridha, and Karray Fakhreddine. 2016. Improving traffic flow prediction with weather information in connected cars: A deep learning approach. IEEE Trans. Vehic. Technol. 65, 12 (2016), 95089517.Google ScholarGoogle ScholarCross RefCross Ref
  23. [23] Kurth Thorsten, Treichler Sean, Romero Joshua, Mudigonda Mayur, Luehr Nathan, Phillips Everett, Mahesh Ankur, Matheson Michael, Deslippe Jack, Fatica Massimiliano, et al. 2018. Exascale deep learning for climate analytics. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC’18). 649660. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. [24] Li Xiucheng, Zhao Kaiqi, Cong Gao, Jensen Christian S., and Wei Wei. 2018. Deep representation learning for trajectory similarity computation. In Proceedings of the 34th IEEE International Conference on Data Engineering (ICDE’18). 617628.Google ScholarGoogle ScholarCross RefCross Ref
  25. [25] Li Yang, Zheng Wenming, Wang Lei, Zong Yuan, and Cui Zhen. 2019. From regional to global brain: A novel hierarchical spatial-temporal neural network model for EEG emotion recognition. IEEE Trans. Affect. Comput. (2019).Google ScholarGoogle ScholarCross RefCross Ref
  26. [26] Li Yexin, Zheng Yu, Zhang Huichu, and Chen Lei. 2015. Traffic prediction in a bike-sharing system. In Proceedings of the 23rd SIGSPATIAL International Conference on Advances in Geographic Information Systems. 110. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. [27] Lin Lei, He Zhengbing, and Peeta Srinivas. 2018. Predicting station-level hourly demand in a large-scale bike-sharing network: A graph convolutional neural network approach. Transport. Res. C: Emerg. Technol. 97 (2018), 258276.Google ScholarGoogle ScholarCross RefCross Ref
  28. [28] Lv Yisheng, Duan Yanjie, Kang Wenwen, Li Zhengxi, and Wang Fei-Yue. 2015. Traffic flow prediction with big data: A deep learning approach. IEEE Trans. Intell. Transport. Syst. 16, 2 (2015), 865873.Google ScholarGoogle Scholar
  29. [29] Ma Xiaolei, Tao Zhimin, Wang Yinhai, Yu Haiyang, and Wang Yunpeng. 2015. Long short-term memory neural network for traffic speed prediction using remote microwave sensor data. Transport. Res. C: Emerg. Technol. 54 (2015), 187197.Google ScholarGoogle ScholarCross RefCross Ref
  30. [30] Min Wanli and Wynter Laura. 2011. Real-time road traffic prediction with spatio-temporal correlations. Transport. Res. C: Emerg. Technol. 19, 4 (2011), 606616.Google ScholarGoogle ScholarCross RefCross Ref
  31. [31] Peng Hao, Wang Hongfei, Du Bowen, Bhuiyan Md. Zakirul Alam, Ma Hongyuan, Liu Jianwei, Wang Lihong, Yang Zeyu, Du Linfeng, Wang Senzhang, and Yu Philip S.. 2020. Spatial temporal incidence dynamic graph neural networks for traffic flow forecasting. Inf. Sci. 521 (2020), 277290.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. [32] Polson Nicholas G. and Sokolov Vadim O.. 2017. Deep learning for short-term traffic flow prediction. Transportation Research Part C: Emerging Technologies 79 (2017), 117.Google ScholarGoogle ScholarCross RefCross Ref
  33. [33] Qi Yan and Ishak Sherif. 2014. A hidden markov model for short term prediction of traffic conditions on freeways. Transport. Res. C: Emerg. Technol. 43 (2014), 95111.Google ScholarGoogle ScholarCross RefCross Ref
  34. [34] Rajaraman Anand and Ullman Jeffrey David. 2011. Mining of Massive Datasets. Cambridge University Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. [35] Shu Yantai, Jin Zhigang, Zhang Lianfang, Wang Lei, and Yang Oliver W. W.. 1999. Traffic prediction using FARIMA models. In Proceedings of the IEEE International Conference on Communications, Vol. 2. 891895.Google ScholarGoogle Scholar
  36. [36] Sutskever Ilya, Vinyals Oriol, and Le Quoc V.. 2014. Sequence to sequence learning with neural networks. In Proceedings of the Annual Conference on Neural Information Processing Systems. 31043112. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. [37] Velickovic Petar, Cucurull Guillem, Casanova Arantxa, Romero Adriana, Liò Pietro, and Bengio Yoshua. 2018. Graph attention networks. In Proceedings of the 6th International Conference on Learning Representations (ICLR’18). OpenReview.net.Google ScholarGoogle Scholar
  38. [38] Wang Jiawei, Chen Ruixiang, and He Zhaocheng. 2019. Traffic speed prediction for urban transportation network: A path based deep learning approach. Transport. Res. C: Emerg. Technol. 100 (2019), 372385.Google ScholarGoogle ScholarCross RefCross Ref
  39. [39] Wang Senzhang, Cao Jiannong, Chen Hao, Peng Hao, and Huang Zhiqiu. 2020. SeqST-GAN: Seq2Seq generative adversarial nets for multi-step urban crowd flow prediction. ACM Trans. Spatial Algor. Syst. 6, 4 (2020), 22:1–22:24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. [40] Wang Senzhang, Cao Jiannong, and Yu Philip S.. 2020. Deep learning for spatio-temporal data mining: A survey. IEEE Trans. Knowl. Data Eng. (2020).Google ScholarGoogle ScholarCross RefCross Ref
  41. [41] Wu Zonghan, Pan Shirui, Chen Fengwen, Long Guodong, Zhang Chengqi, and Philip S. Yu. 2020. A comprehensive survey on graph neural networks. IEEE Trans. Neural Netw. Learn. Syst. (2020).Google ScholarGoogle Scholar
  42. [42] Xiao Xinping, Yang Jinwei, Mao Shuhua, and Wen Jianghui. 2017. An improved seasonal rolling grey forecasting model using a cycle truncation accumulated generating operation for traffic flow. Appl. Math. Model. 51 (2017), 386404.Google ScholarGoogle ScholarCross RefCross Ref
  43. [43] Yang Cheng, Sun Maosong, Zhao Wayne Xin, Liu Zhiyuan, and Chang Edward Y.. 2017. A neural network approach to jointly modeling social networks and mobile trajectories. ACM Trans. Inf. Syst. 35, 4 (2017), 36:1–36:28. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. [44] Yao Huaxiu, Tang Xianfeng, Wei Hua, Zheng Guanjie, and Li Zhenhui. 2019. Revisiting spatial-temporal similarity: A deep learning framework for traffic prediction. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 56685675. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. [45] Yin Xueyan, Wu Genze, Wei Jinze, Shen Yanming, Qi Heng, and Yin Baocai. 2020. A comprehensive survey on traffic prediction. arXiv:2004.08555. Retrieved from https://arxiv.org/abs/2004.08555.Google ScholarGoogle Scholar
  46. [46] Yu Haiyang, Wu Zhihai, Wang Shuqin, Wang Yunpeng, and Ma Xiaolei. 2017. Spatiotemporal recurrent convolutional networks for traffic prediction in transportation networks. Sensors 17, 7 (2017), 1501.Google ScholarGoogle ScholarCross RefCross Ref
  47. [47] Zhang Na, Guan Xuefeng, Cao Jun, Wang Xinglei, and Wu Huayi. 2019. A hybrid traffic speed forecasting approach integrating wavelet transform and motif-based graph convolutional recurrent neural network. CoRR abs/1904.06656 (2019).Google ScholarGoogle Scholar
  48. [48] Zhang Tong, Zheng Wenming, Cui Zhen, Zong Yuan, and Li Yang. 2019. Spatial-temporal recurrent neural network for emotion recognition. IEEE Trans. Cybern. 49, 3 (2019), 839847.Google ScholarGoogle ScholarCross RefCross Ref
  49. [49] Zhang Yuxuan, Wang Senzhang, Chen Bing, and Cao Jiannong. 2019. GCGAN: Generative adversarial nets with graph CNN for network-scale traffic prediction. In Proceedings of the International Joint Conference on Neural Networks (IJCNN’19). 18.Google ScholarGoogle ScholarCross RefCross Ref
  50. [50] Zhang Yuxuan, Wang Senzhang, Chen Bing, Cao Jiannong, and Huang Zhiqiu. 2019. TrafficGAN: Network-scale deep traffic prediction with generative adversarial nets. IEEE Trans. Intell. Transport. Syst. (2019).Google ScholarGoogle Scholar
  51. [51] Zhao Ling, Song Yujiao, Zhang Chao, Liu Yu, Wang Pu, Lin Tao, Deng Min, and Li Haifeng. 2020. T-GCN: A temporal graph convolutional network for traffic prediction. IEEE Trans. Intell. Transport. Syst. 21, 9 (2020), 38483858.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Temporal Hierarchical Graph Attention Network for Traffic Prediction

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Intelligent Systems and Technology
      ACM Transactions on Intelligent Systems and Technology  Volume 12, Issue 6
      December 2021
      356 pages
      ISSN:2157-6904
      EISSN:2157-6912
      DOI:10.1145/3501281
      • Editor:
      • Huan Liu
      Issue’s Table of Contents

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 29 November 2021
      • Revised: 1 December 2020
      • Accepted: 1 December 2020
      • Received: 1 November 2020
      Published in tist Volume 12, Issue 6

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    View Full Text

    HTML Format

    View this article in HTML Format .

    View HTML Format