skip to main content
research-article
Public Access

Edge2vec: Edge-based Social Network Embedding

Published:30 May 2020Publication History
Skip Abstract Section

Abstract

Graph embedding, also known as network embedding and network representation learning, is a useful technique which helps researchers analyze information networks through embedding a network into a low-dimensional space. However, existing graph embedding methods are all node-based, which means they can just directly map the nodes of a network to low-dimensional vectors while the edges could only be mapped to vectors indirectly. One important reason is the computational cost, because the number of edges is always far greater than the number of nodes. In this article, considering an important property of social networks, i.e., the network is sparse, and hence the average degree of nodes is bounded, we propose an edge-based graph embedding (edge2vec) method to map the edges in social networks directly to low-dimensional vectors. Edge2vec takes both the local and the global structure information of edges into consideration to preserve structure information of embedded edges as much as possible. To achieve this goal, edge2vec first ingeniously combines the deep autoencoder and Skip-gram model through a well-designed deep neural network. The experimental results on different datasets show edge2vec benefits from the direct mapping in preserving the structure information of edges.

References

  1. Sami Abu-El-Haija, Bryan Perozzi, and Rami Al-Rfou. 2017. Learning edge representations via low-rank asymmetric projections. In Proceedings of the 2017 ACM Conference on Information and Knowledge Management (CIKM’17).1787--1796. DOI:https://doi.org/10.1145/3132847.3132959Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Mikhail Belkin and Partha Niyogi. 2002. Laplacian eigenmaps and spectral techniques for embedding and clustering. In Proceedings of the 14th International Conference on Neural Information Processing Systems. T.G. Dietterich, S. Becker, and Z. Ghahramani (Eds.). MIT Press, 585--591. Retrieved from http://papers.nips.cc/paper/1961-laplacian-eigenmaps-and-spectral-techniques-for-embedding-and-clustering.pdf.Google ScholarGoogle Scholar
  3. Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating embeddings for modeling multi-relational data. In Proceedings of the 26th International Conference on Advances in Neural Information Processing Systems.C.J.C. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K.Q. Weinberger (Eds.). Curran Associates, Inc., 2787--2795. Retrieved from http://papers.nips.cc/paper/5071-translating-embeddings-for-modeling-multi-relational-data.pdf.Google ScholarGoogle Scholar
  4. Antoine Bordes, Jason Weston, Ronan Collobert, and Yoshua Bengio. 2011. Learning structured embeddings of knowledge bases. In Proceedings of the 25th AAAI Conference on Artificial Intelligence (AAAI’11). Retrieved from http://www.aaai.org/ocs/index.php/AAAI/AAAI11/paper/view/3659.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Shaosheng Cao, Wei Lu, and Qiongkai Xu. 2015. GraRep: Learning graph representations with global structural information. In Proceedings of the 24th ACM International Conference on Information and Knowledge Management (CIKM’15).891--900. DOI:https://doi.org/10.1145/2806416.2806512Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Kai-Yang Chiang, Cho-Jui Hsieh, Nagarajan Natarajan, Inderjit S. Dhillon, and Ambuj Tewari. 2014. Prediction and clustering in signed networks: A local to global perspective. Journal of Machine Learning Research 15, 1 (2014), 1177--1213. Retrieved from http://dl.acm.org/citation.cfm?id=2638573.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Daniel M. Dunlavy, Tamara G. Kolda, and Evrim Acar. 2011. Temporal link prediction using matrix and tensor factorizations. ACM Transactions on Knowledge Discovery from Data 5, 2, Article 10 (Feb. 2011), 27 pages. DOI:https://doi.org/10.1145/1921632.1921636Google ScholarGoogle Scholar
  8. Eric Gilbert and Karrie Karahalios. 2009. Predicting tie strength with social media. In Proceedings of the 27th International Conference on Human Factors in Computing Systems (CHI’09). 211--220. DOI:https://doi.org/10.1145/1518701.1518736Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Aditya Grover and Jure Leskovec. 2016. node2vec: Scalable feature learning for networks. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 855--864. DOI:https://doi.org/10.1145/2939672.2939754Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Aditya Grover, Aaron Zweig, and Stefano Ermon. 2019. Graphite: Iterative generative modeling of graphs. In Proceedings of the 36th International Conference on Machine Learning (ICML’19). Kamalika Chaudhuri and Ruslan Salakhutdinov (Eds.), Vol. 97. PMLR, 2434--2444. Retrieved from http://proceedings.mlr.press/v97/grover19a.html.Google ScholarGoogle Scholar
  11. John Hannon, Mike Bennett, and Barry Smyth. 2010. Recommending Twitter users to follow using content and collaborative filtering approaches. In Proceedings of the 2010 ACM Conference on Recommender Systems (RecSys’10). 199--206. DOI:https://doi.org/10.1145/1864708.1864746Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Frank Harary and Robert Z. Norman. 1960. Some properties of line digraphs. Rendiconti del Circolo Matematico di Palermo 9, 2 (1960), 161--168.Google ScholarGoogle Scholar
  13. Indika Kahanda and Jennifer Neville. 2009. Using transactional information to predict link strength in online social networks. In Proceedings of the 3rd International Conference on Weblogs and Social Media (ICWSM’09). Retrieved from http://aaai.org/ocs/index.php/ICWSM/09/paper/view/213.Google ScholarGoogle Scholar
  14. Maurice G. Kendall. 1938. A new measure of rank correlation. Biometrika 30, 1/2 (1938), 81--93.Google ScholarGoogle ScholarCross RefCross Ref
  15. Diederik P. Kingma and Max Welling. 2014. Auto-encoding variational bayes. In Proceedings of the International Conference on Learning Representations (ICLR’14).Google ScholarGoogle Scholar
  16. Thomas N. Kipf and Max Welling. 2016. Variational graph auto-encoders. In Proceedings of the NIPS Workshop on Bayesian Deep Learning.Google ScholarGoogle Scholar
  17. Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In Proceedings of the International Conference on Learning Representations (ICLR’17).Google ScholarGoogle Scholar
  18. Risi Kondor and John D. Lafferty. 2002. Diffusion kernels on graphs and other discrete input spaces. In Proceedings of the 19th International Conference on Machine Learning (ICML’02). 315--322.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Jure Leskovec, Daniel P. Huttenlocher, and Jon M. Kleinberg. 2010. Predicting positive and negative links in online social networks. In Proceedings of the 19th International Conference on World Wide Web (WWW’10). 641--650. DOI:https://doi.org/10.1145/1772690.1772756Google ScholarGoogle Scholar
  20. Juzheng Li, Jun Zhu, and Bo Zhang. 2016. Discriminative deep random walk for network classification. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL’16). 1004--1013. Retrieved from http://aclweb.org/anthology/P/P16/P16-1095.pdf.Google ScholarGoogle ScholarCross RefCross Ref
  21. Rong-Hua Li, Jeffrey Xu Yu, and Jianquan Liu. 2011. Link prediction: The power of maximal entropy random walk. In Proceedings of the 20th ACM Conference on Information and Knowledge Management (CIKM’11). 1147--1156. DOI:https://doi.org/10.1145/2063576.2063741Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. David Liben-Nowell and Jon M. Kleinberg. 2003. The link prediction problem for social networks. In Proceedings of the 2003 ACM CIKM International Conference on Information and Knowledge Management. 556--559. DOI:https://doi.org/10.1145/956863.956972Google ScholarGoogle Scholar
  23. Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, and Xuan Zhu. 2015. Learning entity and relation embeddings for knowledge graph completion. In Proceedings of the 29th AAAI Conference on Artificial Intelligence.2181--2187. Retrieved from http://www.aaai.org/ocs/index.php/AAAI/AAAI15/paper/view/9571.Google ScholarGoogle Scholar
  24. Masoud Makrehchi. 2011. Social link recommendation by learning hidden topics. In Proceedings of the 2011 ACM Conference on Recommender Systems (RecSys’11). 189--196. DOI:https://doi.org/10.1145/2043932.2043968Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Aditya Krishna Menon and Charles Elkan. 2011. Link prediction via matrix factorization. In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases. 437--452. DOI:https://doi.org/10.1007/978-3-642-23783-6_28Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Proceedings of the 26th International Conference on Neural Information Processing Systems. C. J. C. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K.Q. Weinberger (Eds.). Curran Associates, Inc., 3111--3119. Retrieved from http://papers.nips.cc/paper/5021-distributed-representations-of-words-and-phrases-and-their-compositionality.pdf.Google ScholarGoogle Scholar
  27. Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. DeepWalk: Online learning of social representations. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’14). 701--710. DOI:https://doi.org/10.1145/2623330.2623732Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Sam T. Roweis and Lawrence K. Saul. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science 290, 5500 (2000), 2323--2326. DOI:https://doi.org/10.1126/science.290.5500.2323Google ScholarGoogle ScholarCross RefCross Ref
  29. Ruslan Salakhutdinov and Geoffrey E. Hinton. 2009. Semantic hashing. International Journal of Approximate Reasoning 50, 7 (2009), 969--978. DOI:https://doi.org/10.1016/j.ijar.2008.11.006Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, and Qiaozhu Mei. 2015. LINE: Large-scale information network embedding. In Proceedings of the 24th International Conference on World Wide Web (WWW’15). 1067--1077. DOI:https://doi.org/10.1145/2736277.2741093Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Joshua B. Tenenbaum, Vin de Silva, and John C. Langford. 2000. A global geometric framework for nonlinear dimensionality reduction. Science 290, 5500 (2000), 2319--2323. DOI:https://doi.org/10.1126/science.290.5500.2319Google ScholarGoogle ScholarCross RefCross Ref
  32. Fei Tian, Bin Gao, Qing Cui, Enhong Chen, and Tie-Yan Liu. 2014. Learning deep representations for graph clustering. In Proceedings of the 28th AAAI Conference on Artificial Intelligence.1293--1299. Retrieved from http://www.aaai.org/ocs/index.php/AAAI/AAAI14/paper/view/8527.Google ScholarGoogle Scholar
  33. Cunchao Tu, Weicheng Zhang, Zhiyuan Liu, and Maosong Sun. 2016. Max-margin DeepWalk: Discriminative learning of network representation. In Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI’16). 3889--3895. Retrieved from http://www.ijcai.org/Abstract/16/547.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Daixin Wang, Peng Cui, and Wenwu Zhu. 2016. Structural deep network embedding. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1225--1234. DOI:https://doi.org/10.1145/2939672.2939753Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Xiao Wang, Peng Cui, Jing Wang, Jian Pei, Wenwu Zhu, and Shiqiang Yang. 2017. Community preserving network embedding. In Proceedings of the 31st AAAI Conference on Artificial Intelligence. 203--209. Retrieved from http://aaai.org/ocs/index.php/AAAI/AAAI17/paper/view/14589.Google ScholarGoogle ScholarCross RefCross Ref
  36. Zheng Wang, Xiaojun Ye, Chaokun Wang, Yuexin Wu, Changping Wang, and Kaiwen Liang. 2018. RSDNE: Exploring relaxed similarity and dissimilarity from completely-imbalanced labels for network embedding. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence. 475--482. Retrieved from https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/view/16062.Google ScholarGoogle Scholar
  37. Zhen Wang, Jianwen Zhang, Jianlin Feng, and Zheng Chen. 2014. Knowledge graph embedding by translating on hyperplanes. In Proceedings of the 28th AAAI Conference on Artificial Intelligence. 1112--1119. Retrieved from http://www.aaai.org/ocs/index.php/AAAI/AAAI14/paper/view/8531.Google ScholarGoogle ScholarCross RefCross Ref
  38. Rongjing Xiang, Jennifer Neville, and Monica Rogati. 2010. Modeling relationship strength in online social networks. In Proceedings of the 19th International Conference on World Wide Web (WWW’10). 981--990. DOI:https://doi.org/10.1145/1772690.1772790Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Linchuan Xu, Xiaokai Wei, Jiannong Cao, and Philip S. Yu. 2017. Embedding of embedding (EOE): Joint embedding for coupled heterogeneous networks. In Proceedings of the 10th ACM International Conference on Web Search and Data Mining (WSDM’17). 741--749. Retrieved from http://dl.acm.org/citation.cfm?id=3018723.Google ScholarGoogle Scholar
  40. Cheng Yang, Zhiyuan Liu, Deli Zhao, Maosong Sun, and Edward Y. Chang. 2015. Network representation learning with rich text information. In Proceedings of the 24th International Joint Conference on Artificial Intelligence (IJCAI’15). 2111--2117. Retrieved from http://ijcai.org/Abstract/15/299.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Liang Yang, Xiaochun Cao, Dongxiao He, Chuan Wang, Xiao Wang, and Weixiong Zhang. 2016. Modularity based community detection with deep learning. In Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI’16). 2252--2258. Retrieved from http://www.ijcai.org/Abstract/16/321.Google ScholarGoogle Scholar
  42. Shuang-Hong Yang, Alexander J. Smola, Bo Long, Hongyuan Zha, and Yi Chang. 2012. Friend or frenemy?: Predicting signed ties in social networks. In The Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’12). 555--564. DOI:https://doi.org/10.1145/2348283.2348359Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Jihang Ye, Hong Cheng, Zhe Zhu, and Minghua Chen. 2013. Predicting positive and negative links in signed social networks by transfer learning. In Proceedings of the 22nd International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 1477--1488.Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Ching-man Au Yeung and Tomoharu Iwata. 2011. Strength of social influence in trust networks in product review sites. In Proceedings of the 4h International Conference on Web Search and Web Data Mining (WSDM’11). 495--504. DOI:https://doi.org/10.1145/1935826.1935899Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Zhijun Yin, Manish Gupta, Tim Weninger, and Jiawei Han. 2010. LINKREC: A unified framework for link recommendation with user attributes and graph structure. In Proceedings of the 19th International Conference on World Wide Web (WWW’10). 1211--1212. DOI:https://doi.org/10.1145/1772690.1772879Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Jun Zhang, Chaokun Wang, Jianmin Wang, Jeffrey Xu Yu, Jun Chen, and Changping Wang. 2016. Inferring directions of undirected social ties. IEEE Transactions on Knowledge and Data Engineering 28, 12 (2016), 3276--3292. DOI:https://doi.org/10.1109/TKDE.2016.2605081Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Jun Zhang, Chaokun Wang, Philip S. Yu, and Jianmin Wang. 2013. Learning latent friendship propagation networks with interest awareness for link prediction. In Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’13). 63--72. DOI:https://doi.org/10.1145/2484028.2484029Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Jinfeng Zhuang, Tao Mei, Steven C. H. Hoi, Xian-Sheng Hua, and Shipeng Li. 2011. Modeling social strength in social media community via kernel-based learning. In Proceedings of the 19th International Conference on Multimedia. 113--122. DOI:https://doi.org/10.1145/2072298.2072315Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Edge2vec: Edge-based Social Network Embedding

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Transactions on Knowledge Discovery from Data
          ACM Transactions on Knowledge Discovery from Data  Volume 14, Issue 4
          August 2020
          316 pages
          ISSN:1556-4681
          EISSN:1556-472X
          DOI:10.1145/3403605
          Issue’s Table of Contents

          Copyright © 2020 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 30 May 2020
          • Online AM: 7 May 2020
          • Accepted: 1 March 2020
          • Revised: 1 April 2019
          • Received: 1 June 2017
          Published in tkdd Volume 14, Issue 4

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format