Skip to main content

A Survey of the State-of-the-Art and Some Extensions of Recommender System Based on Big Data

  • Conference paper
  • First Online:
Big Data and Security (ICBDS 2022)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1796))

Included in the following conference series:

  • 345 Accesses

Abstract

Recommender systems (RSs) based on big data have been shown to be very powerful tools for solving the information overload to assist the choice-making when dealing with the massive amount information in the age of big data and artificial intelligence. This paper presents an overview of the state-of-art RS that can be classified into four categories: content-based algorithms (CR), collaborative filtering-based algorithms (CF), and knowledge-based algorithms (KR), as well as hybrid recommendation-based algorithms (HR). The popular CF-based recommender algorithms are especially focused by classifying them into the memory-based algorithms, and model-based algorithms as they show the advantages of great rating prediction without contextual features compared to the rest of RS approaches. By reviewing the current RS and understanding their limitations, the emerging solutions or possible extensions that would improve recommendation capabilities involving deep learning, knowledge graphs, and parallel computing techniques are significantly discussed for future RS research direction. At the same time, by identifying current problems, some possible solutions will be shown in the last part.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Hdioud, F., Frikh, B., Ouhbi, B.: A comparison study of some algorithms in Recommender Systems. In: 2012 Colloquium in Information Science and Technology, pp. 130–135 (2012)

    Google Scholar 

  2. Lekakos, G., Giaglis, G.M.: Improving the prediction accuracy of recommendation algorithms: approaches anchored on human factors. Interact. Comput. 18(3), 410–431 (2006)

    Article  Google Scholar 

  3. Adomavicius, G., Tuzhilin, A.: Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans. Knowl. Data Eng. 17(6), 734–749 (2005)

    Article  Google Scholar 

  4. Ghazanfar, M.A., et al.: A scalable, accurate hybrid recommender system. In: 2010 Third International Conference on Knowledge Discovery and Data Mining, pp. 94–98 (2010)

    Google Scholar 

  5. Hornick, M., Tamayo, P.: Extending recommender systems for disjoint user/item sets: the conference recommendation problem. IEEE Trans. Knowl. Data Eng. 24(8), 1478–1490 (2012)

    Article  Google Scholar 

  6. Munoz-Organero, M., et al.: A collaborative recommender system based on space-time similarities. IEEE Pervasive Comput. 9(3), 81–87 (2010)

    Article  Google Scholar 

  7. Liang, F., et al.: Search engine for the internet of things: lessons from web search, vision, and opportunities. IEEE Access 7, 104673–104691 (2019)

    Article  Google Scholar 

  8. Malone, T.W., et al.: The information lens: an intelligent system for information sharing in organizations. Acm Sigchi Bull. 17(4), 1–8 (1986)

    Article  Google Scholar 

  9. Balabanović, M.: An adaptive Web page recommendation service. In: Proceedings of the first International Conference on Autonomous Agents, pp. 378–385 (1997)

    Google Scholar 

  10. Armstrong, R., et al.: Webwatcher: a learning apprentice for the world wide web. In: AAAI Spring Symposium on Information Gathering from Heterogeneous, Distributed Environments, vol. 93, p. 107. Stanford (1995)

    Google Scholar 

  11. Goldberg, D., et al.: Using collaborative filtering to weave an information tapestry. Commun. ACM 35(12), 61–70 (1992)

    Article  Google Scholar 

  12. Maltz, D., Ehrlich, K.: Pointing the way: active collaborative filtering. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (1995)

    Google Scholar 

  13. Harper, F.M., Konstan, J.A.: The movielens datasets: history and context. ACM Trans. Interact. Intell. Syst. 5(4), 1–19 (2015)

    Article  Google Scholar 

  14. Jiao, J., et al.: A novel learning rate function and its application on the SVD++ recommendation algorithm. IEEE Access 8, 14112–14122 (2020)

    Article  Google Scholar 

  15. Chen, T., et al.: Xgboost: extreme gradient boosting. R package version 0.4–2, pp. 1–4 (2015)

    Google Scholar 

  16. Ke, G., et al.: Lightgbm: a highly efficient gradient boosting decision tree. Advances in Neural Information Processing Systems 30 (2017)

    Google Scholar 

  17. Lemire, D., Maclachlan, A.: Slope one predictors for online ratingbased collaborative filtering. In Proceedings of the 2005 SIAM International Conference on Data Mining, pp. 471–480 (2005)

    Google Scholar 

  18. Huang, M.: Design and Implementation of Incremental Music Recommendation System Based on Slope One Algorithm. Chongqing University (2016)

    Google Scholar 

  19. Do, M.P.T., et al.: Model-based approach for collaborative filtering. In: 6th International Conference on Information Technology for Education, pp. 217–228 (2010)

    Google Scholar 

  20. Luo, X., et al.: An efficient non-negative matrix-factorization-based approach to collaborative filtering for recommender systems. IEEE Trans. Industr. Inf. 10(2), 1273–1284 (2014)

    Article  Google Scholar 

  21. Wang, H.: MatMat: matrix factorization by matrix fitting. In: 2021 IEEE 4th International Conference on Information Systems and Computer Aided Education (ICISCAE), pp.99–101 (2021)

    Google Scholar 

  22. Wang, H.: MovieMat: context-aware movie recommendation with matrix factorization by matrix fitting. In: 2021 7th International Conference on Computer and Communications (ICCC), pp. 1642–1645 (2021)

    Google Scholar 

  23. Jamali, M., Lakshmanan, L.: Heteromf: recommendation in heterogeneous information networks using context dependent factor models. In: Proceedings of the 22nd international conference on World Wide Web, pp. 643–654 (2013)

    Google Scholar 

  24. Shi, C., et al.: Semantic path based personalized recommendation on weighted heterogeneous information networks. In: Acm International on Conference on Information and Knowledge Management, pp. 453–462 (2015)

    Google Scholar 

  25. Sun, Y., Han, J.: Mining heterogeneous information networks: a structural analysis approach. ACM SIGKDD Explor. Newsl. 14(2), 20–28 (2013)

    Article  Google Scholar 

  26. Xu, J., et al.: Local matrix factorization with social network embedding. In: 2021 IEEE International Conference on Artificial Intelligence and Industrial Design (AIID), pp. 492–495 (2021)

    Google Scholar 

  27. Barathy, R., et al.: Applying matrix factorization in collaborative filtering recommender systems. In: 2020 6th international conference on advanced computing and communication systems (ICACCS), pp. 635–639 (2022)

    Google Scholar 

  28. Ma, H., et al.: Sorec: social recommendation using probabilistic matrix factorization. In: Proceedings of the 17th ACM Conference on Information and Knowledge Management, pp. 931–940 (2008)

    Google Scholar 

  29. Yang, B., et al.: Social collaborative filtering by trust. IEEE Trans. Pattern Anal. Mach. Intell. 39(8), 1663–1747 (2013)

    Google Scholar 

  30. Han, J., Pan, Y.: A noise-aware asymmetric spectral regularization collective matrix factorization algorithm for recommender system in cloud services. In: 2020 IEEE 13th International Conference on Cloud Computing (CLOUD), pp.502–506 (2020)

    Google Scholar 

  31. Laseno, F.U.D., et al.: Knowledge-based filtering recommender system to propose design elements of serious game. In: 2019 International Conference on Electrical Engineering and Informatics (ICEEI), pp.158–163 (2019)

    Google Scholar 

  32. Tran, T.: Combining collaborative filtering and knowledge-based approaches for better recommendation systems. J. Bus. Technol. 2(2), 17–24 (2007)

    Google Scholar 

  33. Zhou, F.Y., Jin, L.P., Dong, J.: Review of convolutional neural network. Chin. J. Comput. 40(6), 23 (2017)

    MathSciNet  Google Scholar 

  34. Yan, C., Shi, Y.: A personalized location recommendation based on convolutional neural network. In: 2020 IEEE 5th Information Technology and Mechatronics Engineering Conference (ITOEC), pp. 1516–1519 (2020)

    Google Scholar 

  35. Liu, J.: Research on Application of Autoencoder in Recommendation System. Tianjin University of Technology (2022)

    Google Scholar 

  36. Chen, R.: Recommendation Algorithm Based on Heterogeneous Graph Attention Network and Recurrent Neural Network. Chongqing University (2021)

    Google Scholar 

  37. Yao, Q., Liao, X., Jin, H.: Hierarchical attention based recurrent neural network framework for mobile MOBA game recommender systems. In: 2018 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Ubiquitous Computing & Communications, Big Data & Cloud Computing, Social Computing & Networking, Sustainable Computing & Communications (ISPA/IUCC/BDCloud/SocialCom/SustainCom), pp. 338–345. (2018)

    Google Scholar 

  38. Ruimeng, C.: Research and Application of Recommendation Algorithm Based on Recurrent Neural Network and Weighted Knowledge Graph. Chongqing University of Technology (2021)

    Google Scholar 

  39. Xu, B.: Research on Fairness of Recommendation System Based on Knowledge Graph. School of Computer Science and Engineering (2022)

    Google Scholar 

  40. Yin, H., et al.: Social influence-based group representation learning for group recommendation. In: 2019 IEEE 35th International Conference on Data Engineering (ICDE), pp. 566–577 (2019)

    Google Scholar 

  41. Guo, L., et al.: Group recommendation with latent voting mechanism. In: 2020 IEEE 36th International Conference on Data Engineering (ICDE), pp. 121–132 (2020)

    Google Scholar 

  42. Zhiyi, D.: Research on the Solution of Data Sparsity Problem of Recommendation System Based on Knowledge Graph. School of Computer Science and Engineering (2022)

    Google Scholar 

  43. Yinren, L.: Enhanced Personalized Learning Recommender System Based on Knowledge Graph. School of Computer Science and Engineering (2022)

    Google Scholar 

  44. Gürbüz, H.G., Tekinerdogan, B.: Software metrics for green parallel computing of big data systems. In: 2016 IEEE International Congress on Big Data (BigData Congress), pp. 345–348 (2016)

    Google Scholar 

  45. Li, H., et al.: MSGD: a novel matrix factorization approach for large-scale collaborative filtering recommender systems on GPUs. IEEE Trans. Parallel Distrib. Syst. 29(7), 1530–1544 (2017)

    Article  Google Scholar 

  46. Zhao, X.: A study on e-commerce recommender system based on big data. In: 2019 IEEE 4th International Conference on Cloud Computing and Big Data Analysis (ICCCBDA), pp. 222–226 (2019)

    Google Scholar 

  47. Koohi, A., Homayoun, H.: Parallel multi-view graph matrix completion for large input matrix. In: 2019 IEEE 9th Annual Computing and Communication Workshop and Conference (CCWC), pp. 0337–0341 (2019)

    Google Scholar 

  48. Sun, J., et al.: A parallel recommender system using a collaborative filtering algorithm with correntropy for social networks. IEEE Trans. Netw. Sci. Eng. 7(1), 91–103 (2020)

    Article  MathSciNet  Google Scholar 

  49. Al-Doulat, A.: Surprise and curiosity in a recommender system. In: 2018 IEEE/ACS 15th International Conference on Computer Systems and Applications (AICCSA), pp. 1–2 (2018)

    Google Scholar 

  50. Abbas, F.: Serendipity in recommender system: a holistic overview. In: 2018 IEEE/ACS 15th International Conference on Computer Systems and Applications (AICCSA), pp. 1–2 (2018)

    Google Scholar 

Download references

Acknowledgement

This work is supported by the grant of National Natural Science Foundation of China (62103184), in part by China Postdoctoral Science Foundation (2021M690630), in part by Basic Science (Natural science) Research project of Jiangsu Province(No.22KJB510022), in part by Jiangsu Provincial Double-Innovation Doctor Program (No. (2020)30696), in part by Scientific Research Foundation of Nanjing Institute of Technology of China (No.YKJ201978).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lihang Feng .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Jia, L., Jia, L., Feng, L. (2023). A Survey of the State-of-the-Art and Some Extensions of Recommender System Based on Big Data. In: Tian, Y., Ma, T., Jiang, Q., Liu, Q., Khan, M.K. (eds) Big Data and Security. ICBDS 2022. Communications in Computer and Information Science, vol 1796. Springer, Singapore. https://doi.org/10.1007/978-981-99-3300-6_12

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-3300-6_12

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-3299-3

  • Online ISBN: 978-981-99-3300-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics