Yuya Moroto
ABSTRACT
Multimedia content recommendation needs to consider users' preferences for each content. Conventional recommender systems consider them with wearable sensors, however, wearing such sensors can lead to a burden on users. In this paper, we construct a recommender system that can explicitly estimate users' preferences without wearable sensors. Specifically, by constructing lightweight but strong machine learning models suitable for our system, the users' interest levels for contents can be estimated from facial images obtained from a widely used webcam. In addition, through the interaction that the user selects displayed contents, our system finds the tendency of personal preferences for recommending contents with high user satisfaction. Our system is available on https://www.lmd-demo.org/2022/start_eng.html.
Supplemental Material
- Raman Arora and Karen Livescu. 2013. Multi-view CCA-based acoustic features for phonetic recognition across speakers and domains. In Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing. 7135--7139.Google Scholar
Cross Ref
- Octavio Arriaga, Matias Valdenegro-Toro, and Paul Plöger. 2017. Real-time convolutional neural networks for emotion and gender classification. arXiv preprint arXiv:1710.07557 (2017).Google Scholar
- Deger Ayata, Yusuf Yaslan, and Mustafa E Kamasak. 2018. Emotion based music recommendation system using wearable physiological sensors. IEEE Transactions on Consumer Electronics, Vol. 64, 2 (2018), 196--203.Google ScholarDigital Library
- Valentin Bazarevsky, Yury Kartynnik, Andrey Vakunov, Karthik Raveendran, and Matthias Grundmann. 2019. Blazeface: Sub-millisecond neural face detection on mobile gpus. arXiv preprint arXiv:1907.05047 (2019).Google Scholar
- Christiane Fellbaum. 1998. WordNet: An electronic lexical database. MIT Press.Google Scholar
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 770--778.Google ScholarCross Ref
- Guang Huang, Qin Zhu, and Chee Siew. 2004. Extreme learning machine: A new learning scheme of feedforward neural networks. In Proceedings of IEEE International Joint Conference on Neural Networks, Vol. 2. 985--990.Google Scholar
- Yury Kartynnik, Artsiom Ablavatski, Ivan Grishchenko, and Matthias Grundmann. 2019. Real-time facial surface geometry from monocular video on mobile GPUs. arXiv preprint arXiv:1907.06724 (2019).Google Scholar
- Hyeyoung Ko, Suyeon Lee, Yoonseo Park, and Anna Choi. 2022. A survey of recommendation systems: recommendation models, techniques, and application fields. Electronics, Vol. 11, 1 (2022), 141.Google ScholarCross Ref
- Qidong Liu, Jiaxi Hu, Yutian Xiao, Jingtong Gao, and Xiangyu Zhao. 2023. Multimodal Recommender Systems: A Survey. arXiv preprint arXiv:2302.03883 (2023).Google Scholar
- Yoh Pao, Gwang Park, and Dejan Sobajic. 1994. Learning and generalization characteristics of the random vector functional-link net. Neurocomputing, Vol. 6, 2 (1994), 163--180.Google ScholarCross Ref
- Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, et al. 2015. Imagenet large scale visual recognition challenge. International Journal of Computer Vision, Vol. 115 (2015), 211--252.Google ScholarDigital Library
- Luz Santamaria-Granados, Juan Francisco Mendoza-Moreno, Angela Chantre-Astaiza, Mario Munoz-Organero, and Gustavo Ramirez-Gonzalez. 2021. Tourist Experiences Recommender System Based on Emotion Recognition with Wearable Data. Sensors, Vol. 21, 23 (2021), 7854.Google ScholarCross Ref
- Wouter Schmidt, Martin Kraaijveld, and Robert Duin. 1992. Feedforward neural networks with random weights. In Proceedings of International Conference on Pattern Recognition Methodology and Systems. 1--4.Google ScholarCross Ref
- Marko Tkalcic, Ante Odic, Andrej Kosir, and Jurij Tasic. 2012. Affective labeling in a content-based recommender system for images. IEEE Transactions on Multimedia, Vol. 15, 2 (2012), 391--400.Google ScholarDigital Library
- Dandan Wang and Xiaoming Zhao. 2022. Affective video recommender systems: A survey. Frontiers in Neuroscience, Vol. 16 (2022), 984404Google ScholarCross Ref
Index Terms
- Personalized Content Recommender System via Non-verbal Interaction Using Face Mesh and Facial Expression
Recommendations
Collaborative user modeling for enhanced content filtering in recommender systems
Recommender systems, which have emerged in response to the problem of information overload, provide users with recommendations of content suited to their needs. To provide proper recommendations to users, personalized recommender systems require ...
Improving Accuracy of Recommender System by Item Clustering
Recommender System (RS) predicts user's ratings towards items, and then recommends highly-predicted items to user. In recent years, RS has been playing more and more important role in the agent research field. There have been a great deal of researches ...
A New Approach for Recommender System
ICACS '17: Proceedings of the 1st International Conference on Algorithms, Computing and SystemsIn today's e-commerce environment, Collaborative Filtering (CF) is a widely used algorithm for recommender system, which is to identify the users who have similar preferences to the target user, and to predict the preference of the target user according ...
Comments