Jing Yang
Carsten Eickhoff
Skip Abstract Section
Skip Supplemental Material SectionAbstract
Many social network applications depend on robust representations of spatio-temporal data. In this work, we present an embedding model based on feed-forward neural networks which transforms social media check-ins into dense feature vectors encoding geographic, temporal, and functional aspects for modeling places, neighborhoods, and users. We employ the embedding model in a variety of applications including location recommendation, urban functional zone study, and crime prediction. For location recommendation, we propose a Spatio-Temporal Embedding Similarity algorithm (STES) based on the embedding model.
In a range of experiments on real life data collected from Foursquare, we demonstrate our model’s effectiveness at characterizing places and people and its applicability in aforementioned problem domains. Finally, we select eight major cities around the globe and verify the robustness and generality of our model by porting pre-trained models from one city to another, thereby alleviating the need for costly local training.
Supplemental Material
- Jie Bao, Yu Zheng, and Mohamed F. Mokbel. 2012. Location-based and preference-aware recommendation using sparse geo-social networking data. In Proceedings of the 20th International Conference on Advances in Geographic Information Systems. ACM, 199--208. Google Scholar
Digital Library
- David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet allocation. Journal of Machine Learning Research 3, (Jan. 2003), 993--1022. Google ScholarDigital Library
- Chen Cheng, Haiqin Yang, Irwin King, and Michael R. Lyu. 2012. Fused matrix factorization with geographical and social influence in location-based social networks. In Proceedings of the 26th AAAI Conference on Artificial Intelligence (AAAI’12), 17--23. Google ScholarDigital Library
- Chen Cheng, Haiqin Yang, Michael R. Lyu, and Irwin King. 2013. Where you like to go next: Successive point-of-interest recommendation. In Proceedings of the 23rd International Joint Conference on Artificial Intelligence (IJCAI’13), 2605--2611. Google ScholarDigital Library
- Zhiyuan Cheng, James Caverlee, Kyumin Lee, and Daniel Z. Sui. 2011. Exploring millions of footprints in location sharing services. In Proceedings of the International Conference on Web and Social Media (ICWSM’11), 81--88.Google Scholar
- Andrew Church, Martin Frost, and Keith Sullivan. 2000. Transport and social exclusion in London. Transport Policy 7, 3 (2000), 195--205.Google ScholarCross Ref
- Justin Cranshaw, Raz Schwartz, Jason I. Hong, and Norman Sadeh. 2012. The livehoods project: Utilizing social media to understand the dynamics of a city.Google Scholar
- Huiji Gao, Jiliang Tang, Xia Hu, and Huan Liu. 2013. Exploring temporal effects for location recommendation on location-based social networks. In Proceedings of the 7th ACM Conference on Recommender Systems. ACM, 93--100. Google ScholarDigital Library
- Matthew S. Gerber. 2014. Predicting crime using Twitter and kernel density estimation. Decision Support Systems 61 (2014), 115--125.Google ScholarCross Ref
- Samiul Hasan and Satish V. Ukkusuri. 2014. Urban activity pattern classification using topic models from online geo-location data. Transportation Research Part C: Emerging Technologies 44 (2014), 363--381.Google ScholarCross Ref
- Samiul Hasan, Xianyuan Zhan, and Satish V. Ukkusuri. 2013. Understanding urban human activity and mobility patterns using large-scale location-based data from online social media. In Proceedings of the 2nd ACM SIGKDD International Workshop on Urban Computing. ACM, 6. Google ScholarDigital Library
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 770--778.Google ScholarCross Ref
- Tieke He, Hongzhi Yin, Zhenyu Chen, Xiaofang Zhou, Shazia Sadiq, and Bin Luo. 2016. A spatial-temporal topic model for the semantic annotation of POIs in LBSNs. ACM Transactions on Intelligent Systems and Technology (TIST) 8, 1 (2016), 12. Google ScholarDigital Library
- Francis Heylighen and Johan Bollen. 2002. Hebbian algorithms for a digital library recommendation system. In Proceedings of the International Conference on Parallel Processing Workshops. IEEE, 439--446. Google ScholarDigital Library
- Liangjie Hong, Amr Ahmed, Siva Gurumurthy, Alexander J. Smola, and Kostas Tsioutsiouliklis. 2012. Discovering geographical topics in the Twitter stream. In Proceedings of the 21st International Conference on World Wide Web. ACM, 769--778. Google ScholarDigital Library
- Bo Hu and Martin Ester. 2013. Spatial topic modeling in online social media for location recommendation. In Proceedings of the 7th ACM Conference on Recommender Systems. ACM, 25--32. Google ScholarDigital Library
- Bo Hu, Mohsen Jamali, and Martin Ester. 2013. Spatio-temporal topic modeling in mobile social media for location recommendation. In Proceedings of the 2013 IEEE 13th International Conference on Data Mining. IEEE, 1073--1078.Google ScholarCross Ref
- Rizwan Iqbal, Masrah Azrifah Azmi Murad, Aida Mustapha, Payam Hassany Shariat Panahy, and Nasim Khanahmadliravi. 2013. An experimental study of classification algorithms for crime prediction. Indian Journal of Science and Technology 6, 3 (2013), 4219--4225.Google ScholarCross Ref
- Donald E. Knuth. 1985. Dynamic Hhuffman coding. Journal of Algorithms 6, 2 (1985), 163--180. Google ScholarDigital Library
- Yehuda Koren. 2010. Collaborative filtering with temporal dynamics. Communications of the ACM 53, 4 (2010), 89--97. Google ScholarDigital Library
- Yehuda Koren, Robert Bell, Chris Volinsky, and others. 2009. Matrix factorization techniques for recommender systems. Computer 42, 8 (2009), 30--37. Google ScholarDigital Library
- John Krumm and Dany Rouhana. 2013. Placer: Semantic place labels from diary data. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 163--172. Google ScholarDigital Library
- Takeshi Kurashima, Tomoharu Iwata, Takahide Hoshide, Noriko Takaya, and Ko Fujimura. 2013. Geo topic model: Joint modeling of user’s activity area and interests for location recommendation. In Proceedings of the 6th ACM International Conference on Web Search and Data Mining. ACM, 375--384. Google ScholarDigital Library
- Juha K. Laurila, Daniel Gatica-Perez, Imad Aad, Olivier Bornet, Trinh-Minh-Tri Do, Olivier Dousse, Julien Eberle, Markus Miettinen, and others. 2012. The mobile data challenge: Big data for mobile computing research. In Pervasive Computing.Google Scholar
- Jia Li, Hua Xu, Xingwei He, Junhui Deng, and Xiaomin Sun. 2016. Tweet modeling with LSTM recurrent neural networks for hashtag recommendation. In Proceedings of the 2016 International Joint Conference on Neural Networks (IJCNN’16). IEEE, 1570--1577.Google ScholarCross Ref
- Wen Li, Carsten Eickhoff, and Arjen P de Vries. 2016. Probabilistic local expert retrieval. In European Conference on Information Retrieval. Springer, 227--239.Google ScholarCross Ref
- Wen Li, Pavel Serdyukov, Arjen P. de Vries, Carsten Eickhoff, and Martha Larson. 2011. The where in the tweet. In Proceedings of the 20th ACM International Conference on Information and Knowledge Management. ACM, 2473--2476. Google ScholarDigital Library
- Xutao Li, Gao Cong, Xiao-Li Li, Tuan-Anh Nguyen Pham, and Shonali Krishnaswamy. 2015. Rank-GeoFM: A ranking based geographical factorization method for point of interest recommendation. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 433--442. Google ScholarDigital Library
- Defu Lian, Cong Zhao, Xing Xie, Guangzhong Sun, Enhong Chen, and Yong Rui. 2014. GeoMF: Joint geographical modeling and matrix factorization for point-of-interest recommendation. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 831--840. Google ScholarDigital Library
- Zhouhan Lin, Minwei Feng, Cicero Nogueira dos Santos, Mo Yu, Bing Xiang, Bowen Zhou, and Yoshua Bengio. 2017. A structured self-attentive sentence embedding. arXiv:1703.03130.Google Scholar
- Bin Liu, Yanjie Fu, Zijun Yao, and Hui Xiong. 2013. Learning geographical preferences for point-of-interest recommendation. In Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1043--1051. Google ScholarDigital Library
- Qiang Liu, Shu Wu, Liang Wang, and Tieniu Tan. 2016. Predicting the next location: A recurrent model with spatial and temporal contexts. In Proceedings of the 30th AAAI Conference on Artificial Intelligence. Google ScholarDigital Library
- Xin Liu, Yong Liu, and Xiaoli Li. 2016. Exploring the context of locations for personalized location recommendations. In IJCAI (pp. 1188--1194). Google ScholarDigital Library
- Yiding Liu, Tuan-Anh Nguyen Pham, Gao Cong, and Quan Yuan. 2017. An experimental evaluation of point-of-interest recommendation in location-based social networks. Proceedings of the VLDB Endowment 10, 10 (2017), 1010--1021. Google ScholarDigital Library
- Paolo Massa and Paolo Avesani. 2007. Trust-aware recommender systems. In Proceedings of the 2007 ACM Conference on Recommender Systems. ACM, 17--24. Google ScholarDigital Library
- Wesley Mathew, Ruben Raposo, and Bruno Martins. 2012. Predicting future locations with hidden Markov models. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing. ACM, 911--918. Google ScholarDigital Library
- Quinn McNemar. 1947. Note on the sampling error of the difference between correlated proportions or percentages. Psychometrika 12, 2 (1947), 153--157.Google ScholarCross Ref
- Tomas Mikolov, Quoc V. Le, and Ilya Sutskever. 2013. Exploiting similarities among languages for machine translation. arXiv:1309.4168.Google Scholar
- Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems. 3111--3119. Google ScholarDigital Library
- Glenn W. Milligan and Martha C. Cooper. 1985. An examination of procedures for determining the number of clusters in a dataset. Psychometrika 50, 2 (1985), 159--179.Google ScholarCross Ref
- Anastasios Noulas, Salvatore Scellato, Cecilia Mascolo, and Massimiliano Pontil. 2011. Exploiting semantic annotations for clustering geographic areas and users in location-based social networks. The Social Mobile Web 11 (2011), 02.Google Scholar
- Makbule Gulcin Ozsoy. 2016. From word embeddings to item recommendation. arXiv:1601.01356.Google Scholar
- Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. Deepwalk: Online learning of social representations. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 701--710. Google ScholarDigital Library
- Van-Thuy Phi, Liu Chen, and Yu Hirate. 2016. Distributed representation-based recommender systems in E-commerce. In DEIM Forum.Google Scholar
- William M. Rand. 1971. Objective criteria for the evaluation of clustering methods. Journal of the American Statistical Association 66, 336 (1971), 846--850.Google ScholarCross Ref
- Daniele Riboni and Claudio Bettini. 2013. A platform for privacy-preserving geo-social recommendation of points of interest. In Proceedings of the 2013 IEEE 14th International Conference on Mobile Data Management (MDM’13), Vol. 1. IEEE, 347--349. Google ScholarDigital Library
- Peter J. Rousseeuw. 1987. Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. Journal of Computational and Applied Mathematics 20 (1987), 53--65. Google ScholarDigital Library
- Ruslan Salakhutdinov and Andriy Mnih. 2011. Probabilistic matrix factorization. In NIPS, Vol. 20. 1--8.Google ScholarDigital Library
- Siddharth Sarda, Carsten Eickhoff, and Thomas Hofmann. 2016. Semantic place descriptors for classification and map discovery. arXiv:1601.05952.Google Scholar
- Salvatore Scellato, Anastasios Noulas, and Cecilia Mascolo. 2011. Exploiting place features in link prediction on location-based social networks. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1046--1054. Google ScholarDigital Library
- Yang Song, Ali Mamdouh Elkahky, and Xiaodong He. 2016. Multi-rate deep learning for temporal recommendation. In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 909--912. Google ScholarDigital Library
- Duyu Tang, Bing Qin, and Ting Liu. 2015. Learning semantic representations of users and products for document level sentiment classification. In Proceedings of ACL.Google ScholarCross Ref
- Duyu Tang, Bing Qin, Ting Liu, and Yuekui Yang. 2015. User modeling with neural network for review rating prediction. In Proceedings of the 24th International Conference on Artificial Intelligence. AAAI Press, 1340--1346. Google ScholarDigital Library
- Duyu Tang, Furu Wei, Nan Yang, Ming Zhou, Ting Liu, and Bing Qin. 2014. Learning sentiment-specific word embedding for Twitter sentiment classification. In ACL (1). 1555--1565.Google Scholar
- Mozhgan Tavakolifard and Kevin C. Almeroth. 2012. Social computing: An intersection of recommender systems, trust/reputation systems, and social networks. IEEE Network 26, 4 (2012), 53--58.Google ScholarCross Ref
- Guangjin Tian, Jianguo Wu, and Zhifeng Yang. 2010. Spatial pattern of urban functions in the Beijing metropolitan region. Habitat International 34, 2 (2010), 249--255.Google ScholarCross Ref
- Peter J. Van Koppen and Robert W. J. Jansen. 1999. The time to rob: Variations in time of number of commercial robberies. Journal of Research in Crime and Delinquency 36, 1 (1999), 7--29.Google ScholarCross Ref
- Weiqing Wang, Hongzhi Yin, Ling Chen, Yizhou Sun, Shazia Sadiq, and Xiaofang Zhou. 2015. Geo-sage: A geographical sparse additive generative model for spatial item recommendation. In Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1255--1264. Google ScholarDigital Library
- Weiqing Wang, Hongzhi Yin, Shazia Sadiq, Ling Chen, Min Xie, and Xiaofang Zhou. 2016. Spore: A sequential personalized spatial item recommender system. In Proceedings of the 2016 IEEE 32nd International Conference on Data Engineering (ICDE’16). IEEE, 954--965.Google ScholarCross Ref
- Xiaofeng Wang, Matthew S. Gerber, and Donald E. Brown. 2012. Automatic crime prediction using events extracted from Twitter posts. In International Conference on Social Computing, Behavioral-Cultural Modeling, and Prediction. Springer, 231--238. Google ScholarDigital Library
- David Weisburd, Shawn Bushway, Cynthia Lum, and Sue-Ming Yang. 2004. Trajectories of crime at places: A longitudinal study of street segments in the city of Seattle. Criminology 42, 2 (2004), 283--322.Google ScholarCross Ref
- Marius Wernke, Frank Dürr, and Kurt Rothermel. 2012. PShare: Position sharing for location privacy based on multi-secret sharing. In Proceedings of the 2012 IEEE International Conference on Pervasive Computing and Communications (PerCom’12). IEEE, 153--161.Google ScholarCross Ref
- Sanjaya Wijeratne, Lakshika Balasuriya, Derek Doran, and Amit Sheth. 2016. Word embeddings to enhance Twitter gang member profile identification. In Proceedings of the IJCAI Workshop on Semantic Machine Learning (SML’16). New York City, NY: CEUR-WS, Vol. 7.Google Scholar
- Min Xie, Hongzhi Yin, Hao Wang, Fanjiang Xu, Weitong Chen, and Sen Wang. 2016. Learning graph-based POI embedding for location-based recommendation. In Proceedings of the 25th ACM International on Conference on Information and Knowledge Management. ACM, 15--24. Google ScholarDigital Library
- Xingxing Xing, Wenhao Huang, Guojie Song, and Kunqing Xie. 2014. Traffic zone division using mobile billing data. In Proceedings of the 2014 11th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD’14). IEEE, 692--697.Google ScholarCross Ref
- Wang Yajun and others. 2006. The functionality analysis to urban green space system structural configuration plan {J}. Journal of Shandong Forestry Science and Technology 6 (2006), 033.Google Scholar
- Mao Ye, Dong Shou, Wang-Chien Lee, Peifeng Yin, and Krzysztof Janowicz. 2011. On the semantic annotation of places in location-based social networks. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 520--528. Google ScholarDigital Library
- Mao Ye, Peifeng Yin, and Wang-Chien Lee. 2010. Location recommendation for location-based social networks. In Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, 458--461. Google ScholarDigital Library
- Hongzhi Yin, Bin Cui, Yizhou Sun, Zhiting Hu, and Ling Chen. 2014. Lcars: A spatial item recommender system. ACM Transactions on Information Systems (TOIS) 32, 3 (2014), 11. Google ScholarDigital Library
- Hongzhi Yin, Bin Cui, Xiaofang Zhou, Weiqing Wang, Zi Huang, and Shazia Sadiq. 2016. Joint modeling of user check-in behaviors for real-time point-of-interest recommendation. ACM Transactions on Information Systems (TOIS) 35, 2 (2016), 11. Google ScholarDigital Library
- Hongzhi Yin, Weiqing Wang, Hao Wang, Ling Chen, and Xiaofang Zhou. 2017. Spatial-aware hierarchical collaborative deep learning for POI recommendation. IEEE Transactions on Knowledge and Data Engineering 29, 11 (2017), 2537--2551.Google ScholarDigital Library
- Hongzhi Yin, Xiaofang Zhou, Bin Cui, Hao Wang, Kai Zheng, and Quoc Viet Hung Nguyen. 2016. Adapting to user interest drift for POI recommendation. IEEE Transactions on Knowledge and Data Engineering 28, 10 (2016), 2566--2581. Google ScholarDigital Library
- Hongzhi Yin, Xiaofang Zhou, Yingxia Shao, Hao Wang, and Shazia Sadiq. 2015. Joint modeling of user check-in behaviors for point-of-interest recommendation. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. ACM, 1631--1640. Google ScholarDigital Library
- Nicholas Jing Yuan, Yu Zheng, Xing Xie, Yingzi Wang, Kai Zheng, and Hui Xiong. 2015. Discovering urban functional zones using latent activity trajectories. IEEE Transactions on Knowledge and Data Engineering 27, 3 (2015), 712--725.Google ScholarDigital Library
- Jia-Dong Zhang, Chi-Yin Chow, and Yanhua Li. 2014. LORE: Exploiting sequential influence for location recommendations. In Proceedings of the 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, 103--112. Google ScholarDigital Library
- Shenglin Zhao, Tong Zhao, Irwin King, and Michael R. Lyu. 2016. GT-SEER: Geo-temporal sequential embedding rank for point-of-interest recommendation. arXiv:1606.05859.Google Scholar
- Zack Zhu, Jing Yang, Chen Zhong, Julia Seiter, and Gerhard Tröster. 2015. Learning functional compositions of urban spaces with crowd-augmented travel survey data. In Proceedings of the 23rd SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, 22. Google ScholarDigital Library
Index Terms
- Unsupervised Learning of Parsimonious General-Purpose Embeddings for User and Location Modeling
Recommendations
Location recommendation for location-based social networks
GIS '10: Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information SystemsIn this paper, we study the research issues in realizing location recommendation services for large-scale location-based social networks, by exploiting the social and geographical characteristics of users and locations/places. Through our analysis on a ...
Modeling Location-Based User Rating Profiles for Personalized Recommendation
TKDD Special Issue (SIGKDD'13)This article proposes LA-LDA, a location-aware probabilistic generative model that exploits location-based ratings to model user profiles and produce recommendations. Most of the existing recommendation models do not consider the spatial information of ...
Spatiotemporal Sequential Influence Modeling for Location Recommendations: A Gravity-based Approach
Recommending to users personalized locations is an important feature of Location-Based Social Networks (LBSNs), which benefits users who wish to explore new places and businesses to discover potential customers. In LBSNs, social and geographical ...
Comments