Andreas Grün
ABSTRACT
After multiple years of successfully applying recommendation algorithms at ZDF, a German Public Service Media provider, we have faced certain challenges in regards to the optimization of our systems and the resulting recommendations. The design and the optimization of our systems are guided by various, partially competing objectives and are, therefore, influenced by various factors. Similarly to commercial video on demand services, ZDF is interested in binding its audience by providing personalized recommendations in its streaming media service. However, more importantly, as a Public Service Media provider, we are committed to offer diverse, universal, unbiased, and transparent recommendations while following established editorial guidelines and strict privacy regulations. Additionally, we are committed to provide environmentally-friendly or green recommendations optimizing our systems for run time and power consumption. With the intent to start a public discussion, we describe the challenges that arise when optimizing Public Service Media recommendation systems towards machine learning metrics, business Key Performance Indicators, Public Service Media values, and run-time simultaneously, while aiming to keep the results transparent.
Supplemental Material
- Martín Vaz Álvarez, José Miguel Túñez López, and María José Ufarte Ruíz. 2020. What Are You Offering?: An Overview of VODs and Recommender Systems in European Public Service Media. In International Conference on Information Technology & Systems. Springer, 725–732.Google Scholar
Cross Ref
- Maurizio Ferrari Dacrema, Paolo Cremonesi, and Dietmar Jannach. 2019. Are we really making much progress? A worrying analysis of recent neural recommendation approaches. In Proceedings of the 13th ACM Conference on Recommender Systems. 101–109.Google ScholarDigital Library
- Ben Fields, Rhianne Jones, and Tim Cowlishaw. 2018. The case for public service recommender algorithms. BBC London (2018), 22–24.Google Scholar
- Asela Gunawardana and Guy Shani. 2009. A survey of accuracy evaluation metrics of recommendation tasks.Journal of Machine Learning Research 10, 12 (2009).Google Scholar
- Natali Helberger, Kari Karppinen, and Lucia D’acunto. 2018. Exposure diversity as a design principle for recommender systems. Information, Communication & Society 21, 2 (2018), 191–207.Google Scholar
- Balázs Hidasi, Alexandros Karatzoglou, Linas Baltrunas, and Domonkos Tikk. 2015. Session-based Recommendations with Recurrent Neural Networks. arXiv preprint arXiv:1511.06939(2015).Google Scholar
- Jockum Hildén. [n.d.]. The Public Service Approach to Recommender Systems: Filtering to Cultivate. Television & New Media([n. d.]).Google Scholar
- Mahdi Jalili, Sajad Ahmadian, Maliheh Izadi, Parham Moradi, and Mostafa Salehi. 2018. Evaluating collaborative filtering recommender algorithms: a survey. IEEE access 6(2018), 74003–74024.Google ScholarCross Ref
- Marius Kaminskas and Derek Bridge. 2016. Diversity, serendipity, novelty, and coverage: a survey and empirical analysis of beyond-accuracy objectives in recommender systems. ACM Transactions on Interactive Intelligent Systems (TiiS) 7, 1(2016), 1–42.Google ScholarDigital Library
- Denis Kotkov, Joseph Konstan, Qian Zhao, and Jari Veijalainen. 2018. Investigating serendipity in recommender systems based on real user feedback. In Proceedings of the 33rd Annual ACM Symposium on Applied Computing. 1341–1350.Google ScholarDigital Library
- Denis Kotkov, Shuaiqiang Wang, and Jari Veijalainen. 2016. A survey of serendipity in recommender systems. Knowledge-Based Systems 111 (2016), 180–192.Google ScholarDigital Library
- Malte Ludewig and Dietmar Jannach. 2018. Evaluation of session-based recommendation algorithms. User Modeling and User-Adapted Interaction 28, 4-5 (2018), 331–390.Google ScholarDigital Library
- Malte Ludewig, Noemi Mauro, Sara Latifi, and Dietmar Jannach. 2019. Performance comparison of neural and non-neural approaches to session-based recommendation. In Proceedings of the 13th ACM conference on recommender systems. 462–466.Google ScholarDigital Library
- Xia Ning and George Karypis. 2011. Slim: Sparse linear methods for top-n recommender systems. In 2011 IEEE 11th International Conference on Data Mining. IEEE, 497–506.Google ScholarDigital Library
- Myrthe Reuver and Nicolas Mattis. 2021. Implementing evaluation metrics based on theories of democracy in news comment recommendation (Hackathon report). In Proceedings of the EACL Hackashop on News Media Content Analysis and Automated Report Generation. 134–139.Google Scholar
- Jannick Kirk Sørensen and Jonathon Hutchinson. 2018. Algorithms and public service media. In Public Service Media in the Networked Society: RIPE@ 2017. Nordicom, 91–106.Google Scholar
- Kim Tallerås, Terje Colbjørnsen, Knut Oterholm, and Håkon Larsen. 2020. Cultural Policies, Social Missions, Algorithms and Discretion: What Should Public Service Institutions Recommend?. In International Conference on Information. Springer, 588–595.Google ScholarCross Ref
- Saúl Vargas, Linas Baltrunas, Alexandros Karatzoglou, and Pablo Castells. 2014. Coverage, redundancy and size-awareness in genre diversity for recommender systems. In Proceedings of the 8th ACM Conference on Recommender systems. 209–216.Google ScholarDigital Library
- Sanne Vrijenhoek, Mesut Kaya, Nadia Metoui, Judith Möller, Daan Odijk, and Natali Helberger. 2021. Recommenders with a mission: assessing diversity in news recommendations. In Proceedings of the 2021 Conference on Human Information Interaction and Retrieval. 173–183.Google ScholarDigital Library
- Shoujin Wang, Longbing Cao, Yan Wang, Quan Z Sheng, Mehmet Orgun, and Defu Lian. 2019. A survey on session-based recommender systems. arXiv preprint arXiv:1902.04864(2019).Google Scholar
- Fajie Yuan, Alexandros Karatzoglou, Ioannis Arapakis, Joemon M. Jose, and Xiangnan He. 2019. A Simple Convolutional Generative Network for Next Item Recommendation. In Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining(WSDM ’19). 582–590.Google ScholarDigital Library
Recommendations
New Recommendation Techniques for Multicriteria Rating Systems
Traditional single-rating recommender systems have been successful in a number of personalization applications, but the research area of multicriteria recommender systems has been largely untouched. Taking full advantage of multicriteria ratings in ...
Transparently Serving the Public: Enhancing Public Service Media Values through Exploration
RecSys '23: Proceedings of the 17th ACM Conference on Recommender SystemsIn the last few years, we have reportedly underlined the importance of the Public Service Media Remit for ZDF as a Public Service Media provider. Offering fair, diverse, and useful recommendations to users is just as important for us as being ...
Effects of Personalized and Aggregate Top-N Recommendation Lists on User Preference Ratings
Prior research has shown a robust effect of personalized product recommendations on user preference judgments for items. Specifically, the display of system-predicted preference ratings as item recommendations has been shown in multiple studies to bias ...
Comments