ABSTRACT
Travel time estimation of a given route with respect to real-time traffic condition is extremely useful for many applications like route planning. We argue that it is even more useful to estimate the travel time distribution, from which we can derive the expected travel time as well as the uncertainty. In this paper, we develop a deep generative model - DeepGTT - to learn the travel time distribution for any route by conditioning on the real-time traffic. DeepGTT interprets the generation of travel time using a three-layer hierarchical probabilistic model. In the first layer, we present two techniques, amortization and spatial smoothness embeddings, to share statistical strength among different road segments; a convolutional neural net based representation learning component is also proposed to capture the dynamically changing real-time traffic condition. In the middle layer, a nonlinear factorization model is developed to generate auxiliary random variable i.e., speed. The introduction of this middle layer separates the statical spatial features from the dynamically changing real-time traffic conditions, allowing us to incorporate the heterogeneous influencing factors into a single model. In the last layer, an attention mechanism based function is proposed to collectively generate the observed travel time. DeepGTT describes the generation process in a reasonable manner, and thus it not only produces more accurate results but also is more efficient. On a real-world large-scale data set, we show that DeepGTT produces substantially better results than state-of-the-art alternatives in two tasks: travel time estimation and route recovery from sparse trajectory data.
- Christophe Andrieu, Nando De Freitas, Arnaud Doucet, and Michael I Jordan. 2003. An introduction to MCMC for machine learning. Machine learning 50, 1-2 (2003), 5-43.Google Scholar
- Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural Machine Translation by Jointly Learning to Align and Translate. CoRR abs/1409.0473(2014).Google Scholar
- Atilim Gunes Baydin, Barak A. Pearlmutter, Alexey Andreyevich Radul, and Jeffrey Mark Siskind. 2017. Automatic Differentiation in Machine Learning: a Survey. JMLR 18(2017), 153:1-153:43. Google ScholarDigital Library
- Christopher M Bishop. 2006. Pattern recognition and machine learning. springer. Google ScholarDigital Library
- David M. Blei, Alp Kucukelbir, and Jon D. McAuliffe. 2016. Variational Inference: A Review for Statisticians. CoRR abs/1601.00670(2016).Google Scholar
- David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet Allocation. JMLR 3(2003), 993-1022. Google ScholarDigital Library
- Yun Cheng, Xiucheng Li, Zhijun Li, Shouxu Jiang, and Xiaofan Jiang. 2014. Fine-Grained Air Quality Monitoring Based on Gaussian Process Regression. In ICONIP 2014. 126-134.Google Scholar
- Yun Cheng, Xiucheng Li, Zhijun Li, Shouxu Jiang, Yilong Li, Ji Jia, and Xiaofan Jiang. 2014. AirCloud: a cloud-based air-quality monitoring system for everyone. In Proceedings of the 12th ACM Conference on Embedded Network Sensor Systems, SenSys '14, Memphis, Tennessee, USA, November 3-6, 2014. 251-265. Google ScholarDigital Library
- Peter Dayan, Geoffrey E Hinton, Radford M Neal, and Richard S Zemel. 1995. The helmholtz machine. Neural computation (1995), 889-904. Google ScholarDigital Library
- S. M. Ali Eslami, Nicolas Heess, Theophane Weber, Yuval Tassa, David Szepesvari, Koray Kavukcuoglu, and Geoffrey E. Hinton. 2016. Attend, Infer, Repeat: Fast Scene Understanding with Generative Models. In NIPS 2016, December 5-10, 2016, Barcelona, Spain. 3225-3233. Google ScholarDigital Library
- Raghu K. Ganti, Mudhakar Srivatsa, and Tarek F. Abdelzaher. 2014. On Limits of Travel Time Predictions: Insights from a New York City Case Study. In ICDCS 2014, Madrid, Spain, June 30 - July 3, 2014. 166-175. Google ScholarDigital Library
- Andrew Gelman, John B Carlin, Hal S Stern, and Donald B Rubin. 1995. Bayesian data analysis. Chapman and Hall/CRC.Google Scholar
- Prem Gopalan, Jake M Hofman, and David M Blei. 2013. Scalable recommendation with poisson factorization. CORR (2013).Google Scholar
- Prem K Gopalan, Laurent Charlin, and David Blei. 2014. Content-based recommendations with poisson factorization. In NIPS 2014. 3176-3184. Google ScholarDigital Library
- Matthew D Hoffman, David M Blei, Chong Wang, and John Paisley. 2013. Stochastic variational inference. JMLR 14, 1 (2013), 1303-1347. Google ScholarDigital Library
- Liangjie Hong, Amr Ahmed, Siva Gurumurthy, Alexander J. Smola, and Kostas Tsioutsiouliklis. 2012. Discovering geographical topics in the twitter stream. In WWW 2012, Lyon, France, April 16-20, 2012. 769-778. Google ScholarDigital Library
- Timothy Hunter, Aude Hofleitner, Jack Reilly, Walid Krichene, Jerome Thai, Anastasios Kouvelas, Pieter Abbeel, and Alexandre M. Bayen. 2013. Arriving on time: estimating travel time distributions on large-scale road networks. CoRR abs/1302.6617(2013).Google Scholar
- Tsuyoshi Ide´ and Masashi Sugiyama. 2011. Trajectory Regression on Road Networks. In AAAI 2011, San Francisco, California, USA, August 7-11, 2011. Google ScholarDigital Library
- Diederik P. Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. ICLR 2015 abs/1412.6980(2014).Google Scholar
- Diederik P. Kingma, Shakir Mohamed, Danilo Jimenez Rezende, and Max Welling. 2014. Semi-supervised Learning with Deep Generative Models. In NIPS 2014, December 8-13 2014, Montreal, Quebec, Canada. 3581-3589. Google ScholarDigital Library
- Diederik P. Kingma and Max Welling. 2013. Auto-Encoding Variational Bayes. ICLR 2013 abs/1312.6114 (2013).Google Scholar
- Günter Klambauer, Thomas Unterthiner, Andreas Mayr, and Sepp Hochreiter. 2017. Self-Normalizing Neural Networks. In NIPS 2017, 4-9 December 2017, Long Beach, CA, USA. 972-981. Google ScholarDigital Library
- Mu Li, Amr Ahmed, and Alexander J. Smola. 2015. Inferring Movement Trajectories from GPS Snippets. In WSDM 2015, Shanghai, China, February 2-6, 2015. 325-334. Google ScholarDigital Library
- Xiucheng Li, Kaiqi Zhao, Gao Cong, Christian S. Jensen, and Wei Wei. 2018. Deep Representation Learning for Trajectory Similarity Computation. In ICDE 2018, Paris, France, April 16-19, 2018. 617-628.Google Scholar
- Yaguang Li, Kun Fu, Zheng Wang, Cyrus Shahabi, Jieping Ye, and Yan Liu. 2018. Multi-task Representation Learning for Travel Time Estimation. In SIGKDD 2018, London, UK, August, 2018. Google ScholarDigital Library
- Dawen Liang, Rahul G. Krishnan, Matthew D. Hoffman, and Tony Jebara. 2018. Variational Autoencoders for Collaborative Filtering. In WWW 2018, Lyon, France, April 23-27, 2018. 689-698. Google ScholarDigital Library
- Kevin P Murphy. 2012. Machine learning: a probabilistic perspective. Cambridge, MA. Google ScholarDigital Library
- Paul Newson and John Krumm. 2009. Hidden Markov map matching through noise and sparseness. In SIGSPATIAL 2009, November 4-6, 2009, Seattle, Washington, USA, Proceedings. 336-343. Google ScholarDigital Library
- Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. DeepWalk: online learning of social representations. In SIGKDD 2014, New York, NY, USA - August 24 - 27, 2014. 701-710. Google ScholarDigital Library
- Ian Porteous, David Newman, Alexander Ihler, Arthur Asuncion, Padhraic Smyth, and Max Welling. 2008. Fast collapsed gibbs sampling for latent dirichlet allocation. In SIGKDD 2008. ACM, 569-577. Google ScholarDigital Library
- Sashank J Reddi, Satyen Kale, and Sanjiv Kumar. 2018. On the convergence of adam and beyond. ICLR 2018.Google Scholar
- Danilo Jimenez Rezende and Shakir Mohamed. 2015. Variational Inference with Normalizing Flows. In ICML 2015, Lille, France, 6-11 July 2015. 1530-1538. Google ScholarDigital Library
- Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra. 2014. Stochastic Backpropagation and Approximate Inference in Deep Generative Models. In ICML 2014, Beijing, China, 21-26 June 2014. 1278-1286. Google ScholarDigital Library
- Dalia Tiesyte and Christian S. Jensen. 2008. Similarity-based prediction of travel times for vehicles traveling on known routes. In SIGSPATIAL 2008, November 5-7, 2008, Irvine, California, USA, Proceedings. 14. Google ScholarDigital Library
- Aäron van den Oord, Oriol Vinyals, and Koray Kavukcuoglu. 2017. Neural Discrete Representation Learning. In NIPS 2017, 4-9 December 2017, Long Beach, CA, USA. 6309-6318. Google ScholarDigital Library
- Dong Wang, Junbo Zhang, Wei Cao, Jian Li, and Yu Zheng. 2018. When Will You Arrive? Estimating Travel Time Based on Deep Neural Networks. In AAAI 2018, New Orleans, Louisiana, USA, February 2-7, 2018.Google Scholar
- Hongjian Wang, Yu-Hsuan Kuo, Daniel Kifer, and Zhenhui Li. 2016. A simple baseline for travel time estimation using large-scale trip data. In SIGSPATIAL 2016, Burlingame, California, USA, October 31 - November 3, 2016. 61:1-61:4. Google ScholarDigital Library
- Yilun Wang, Yu Zheng, and Yexiang Xue. 2014. Travel time estimation of a path using sparse trajectories. In SIGKDD 2014, New York, NY, USA - August 24 - 27, 2014. 25-34. Google ScholarDigital Library
- Zheng Wang, Kun Fu, and Jieping Ye. 2018. Learning to Estimate the Travel Time. In KDD 2018, London, UK, August 19-23, 2018. 858-866. Google ScholarDigital Library
- Hao Wu, Jiangyun Mao, Weiwei Sun, Baihua Zheng, Hanyuan Zhang, Ziyang Chen, and Wei Wang. 2016. Probabilistic Robust Route Recovery with Spatio-Temporal Dynamics. In SIGKDD 2016, San Francisco, CA, USA, August 13-17, 2016. 1915-1924. Google ScholarDigital Library
- Xinchen Yan, Jimei Yang, Kihyuk Sohn, and Honglak Lee. 2016. Attribute2image: Conditional image generation from visual attributes. In ECCV 2016. 776-791.Google ScholarCross Ref
- Di Yao, Gao Cong, Chao Zhang, and Jingping Bi. 2019. Computing Trajectory Similarity in Linear Time: A Generic Seed-Guided Neural Metric Learning Approach. In ICDE 2019, Macau, China, April 8-12, 2019.Google Scholar
- Zhijun Yin, Liangliang Cao, Jiawei Han, Chengxiang Zhai, and Thomas S. Huang. 2011. Geographical topic discovery and comparison. In WWW 2011, Hyderabad, India, March 28 - April 1, 2011. 247-256. Google ScholarDigital Library
- Quan Yuan, Gao Cong, and Chin-Yew Lin. 2014. COM: a generative model for group recommendation. In KDD '14, New York, NY, USA - August 24 - 27, 2014. 163-172. Google ScholarDigital Library
- Quan Yuan, Gao Cong, Zongyang Ma, Aixin Sun, and Nadia Magnenat-Thalmann. 2013. Who, where, when and what: discover spatio-temporal topics for twitter users. In KDD 2013, Chicago, IL, USA, August 11-14, 2013. 605-613. Google ScholarDigital Library
- Jiangchuan Zheng and Lionel M. Ni. 2013. Time-Dependent Trajectory Regression on Road Networks via Multi-Task Learning. In AAAI 2013, July 14-18, 2013, Bellevue, Washington, USA. Google ScholarDigital Library
Recommendations
Learn Travel Time Distribution with Graph Deep Learning and Generative Adversarial Network
2021 IEEE International Intelligent Transportation Systems Conference (ITSC)How to obtain accurate travel time predictions is among the most critical problems in Intelligent Transportation Systems (ITS). Recent literature has shown the effectiveness of machine learning models on travel time forecasting problems. However, most of ...
Geometry of Deep Generative Models for Disentangled Representations
ICVGIP '18: Proceedings of the 11th Indian Conference on Computer Vision, Graphics and Image ProcessingDeep generative models like variational autoencoders approximate the intrinsic geometry of high dimensional data manifolds by learning a set of low-dimensional latent-space variables and an embedding function. The geometrical properties of these latent ...
Factorized deep generative models for end-to-end trajectory generation with spatiotemporal validity constraints
SIGSPATIAL '22: Proceedings of the 30th International Conference on Advances in Geographic Information SystemsA growing number of research areas such as location-based social networks, intelligent transportation systems, and urban computing utilize large amounts of trajectory data for benchmarking data management approaches and analysis methods. Given the ...
Comments