Abstract
Collaborative tagging systems have emerged as a successful solution for annotating contributed resources to online sharing platforms, facilitating searching, browsing, and organizing their contents. To aid users in the annotation process, several tag recommendation methods have been proposed. It has been repeatedly hypothesized that these methods should contribute to improving annotation quality and reducing the cost of the annotation process. It has been also hypothesized that these methods should contribute to the consolidation of the vocabulary of collaborative tagging systems. However, to date, no empirical and quantitative result supports these hypotheses. In this work, we deeply analyze the impact of a tag recommendation system in the folksonomy of Freesound, a real-world and large-scale online sound sharing platform. Our results suggest that tag recommendation effectively increases vocabulary sharing among users of the platform. In addition, tag recommendation is shown to contribute to the convergence of the vocabulary as well as to a partial increase in the quality of annotations. However, according to our analysis, the cost of the annotation process does not seem to be effectively reduced. Our work is relevant to increase our understanding about the nature of tag recommendation systems and points to future directions for the further development of those systems and their analysis.
- Jeff Alstott, Ed Bullmore, and Dietmar Plenz. 2014. Powerlaw: A python package for analysis of heavy-tailed distributions. PLoS ONE 9, 1, e85777. DOI:http://dx.doi.org/10.1371/journal.pone.0085777Google ScholarCross Ref
- Morgan Ames and Mor Naaman. 2007. Why we tag: Motivations for annotation in mobile and online media. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’07). 971--980. DOI:http://dx.doi.org/10.1145/1240624.1240772 Google ScholarDigital Library
- Alain Barrat, Marc Barthélemy, Romualdo Pastor-Satorras, and Alessandro Vespignani. 2004. The architecture of complex weighted networks. Proceedings of the National Academy of Sciences of the United States of America 101, 11, 3747--3752. DOI:http://dx.doi.org/10.1073/pnas.0400087101Google ScholarCross Ref
- Kerstin Bischoff, Claudiu S. Firan, Wolfgang Nejdl, and Raluca Paiu. 2008. Can all tags be used for search? Categories and subject descriptors. In Proceedings of the 17th ACM Conference on Information and Knowledge Management. 203--212. DOI:http://dx.doi.org/10.1145/1458082.1458112 Google ScholarDigital Library
- Ivan Cantador, Ioannis Konstas, and Joemon M. Jose. 2011. Categorising social tags to improve folksonomy-based recommendations. Journal of Web Semantics 9, 1, 1--15. DOI:http://dx.doi.org/10.1016/j.websem.2010.10.001 Google ScholarDigital Library
- Jean Carletta. 1996. Assessing agreement on classification tasks: The kappa statistic. Computational Linguistics 22, 2, 249--254. DOI:http://dx.doi.org/10.1.1.48.4108 Google ScholarDigital Library
- Ciro Cattuto. 2006. Semiotic dynamics in online social communities. European Physical Journal C-Particles and Fields 37, 33--37. DOI:http://dx.doi.org/10.1140/epjcd/s2006-03-004-4Google Scholar
- Aaron Clauset, Cosma Rohilla Shalizi, and Mark E. J. Newman. 2007. Power-law distributions in empirical data. SIAM Review 51, 4, 661--703 http://arxiv.org/abs/0706.1062. Google ScholarDigital Library
- Gregory W. Corder and Dale I. Foreman. 2009. Nonparametric Statistics for Non-Statisticians: A Step-by-Step Approach. Wiley.Google Scholar
- Pasqueale De Meo, Emilio Ferrara, Fabian Abel, Lora Aroyo, and Geert-Jan Houben. 2013. Analyzing user behavior across social sharing environments. ACM Transactions on Intelligent Systems and Technology 5, 1, Article No. 14. DOI:http://dx.doi.org/10.1145/2535526 Google ScholarDigital Library
- Pasquale De Meo, Giovanni Quattrone, and Domenico Ursino. 2009. Exploitation of semantic relationships and hierarchical data structures to support a user in his annotation and browsing activities in folksonomies. Journal of Information Systems 34, 6, 511--535. DOI:http://dx.doi.org/10.1016/j.is.2009.02.004 Google ScholarDigital Library
- Umer Farooq, Thomas G. Kannampallil, Yang Song, Craig H. Ganoe, John M. Carroll, and Lee Giles. 2007. Evaluating tagging behavior in social bookmarking systems: Metrics and design heuristics. In Proceedings of the ACM International Conference on Supporting Group Work. 351--360. DOI:http://dx.doi.org/10.1145/1316624.1316677 Google ScholarDigital Library
- Frederic Font, Gerard Roma, and Xavier Serra. 2013a. Freesound technical demo. In Proceedings of the 21st ACM Conference on Multimedia (MM’13). 411--412. Google ScholarDigital Library
- Frederic Font, Joan Serrà, and Xavier Serra. 2013b. Folksonomy-based tag recommendation for collaborative tagging systems. International Journal on Semantic Web and Information Systems 9, 2, 1--30. DOI:http://dx.doi.org/10.4018/jswis.2013040101Google ScholarCross Ref
- Frederic Font, Joan Serrà, and Xavier Serra. 2014a. Audio clip classification using social tags and the effect of tag expansion. In Proceedings of the 53rd AES Conference on Semantic Audio.Google Scholar
- Frederic Font, Joan Serrà, and Xavier Serra. 2014b. Class-based tag recommendation and user-based evaluation in online audio clip sharing. Journal on Knowledge Based Systems 67, 131--142. DOI:http://dx.doi.org/10.1016/j.knosys.2014.06.003 Google ScholarDigital Library
- Nikhil Garg and Ingmar Weber. 2008. Personalized, interactive tag recommendation for Flickr. In Proceedings of the 2nd ACM Conference on Recommender Systems (RecSys’08). 67--74. DOI:http://dx.doi.org/10.1145/1454008.1454020 Google ScholarDigital Library
- Scott A. Golder and Bernardo A. Huberman. 2006. Usage patterns of collaborative tagging systems. Journal of Information Science 32, 2, 198--208. DOI:http://dx.doi.org/10.1177/0165551506062337 Google ScholarDigital Library
- Marieke Guy and Emma Tonkin. 2006. Folksonomies: Tidying up tags? D-Lib Magazine 12, 1.Google ScholarCross Ref
- Harry Halpin, Valentin Robu, and Hana Shepard. 2006. The dynamics and semantics of collaborative tagging. In Proceedings of the 1st Semantic Authoring and Annotation Workshop. 1--21.Google Scholar
- Ivan Ivanov, Peter Vajda, Lutz Goldmann, Jong-Seok Lee, and Touradj Ebrahimi. 2010. Object-based tag propagation for semi-automatic annotation of images. In Proceedings of the International Conference on Multimedia Information Retrieval. 497--506. DOI:http://dx.doi.org/10.1145/1743384.1743471 Google ScholarDigital Library
- Robert Jäschke, Folke Eisterlehner, Andreas Hotho, and Gerd Stumme. 2009. Testing and evaluating tag recommenders in a live system. In Proceedings of the 3rd ACM Conference on Recommender Systems (RecSys’09). 369--372. DOI:http://dx.doi.org/10.1145/1639714.1639790 Google ScholarDigital Library
- Robert Jäschke, Andreas Hotho, Folke Mitzlaff, and Gerd Stumme. 2012. Challenges in tag recommendations for collaborative tagging systems. In Recommender Systems for the Social Web. Springer, Berlin, 65--87. DOI:http://dx.doi.org/10.1007/978-3-642-25694-3\_3Google Scholar
- Robert Jäschke, Leandro Marinho, Andreas Hotho, Lars Schmidt-Thieme, and Gerd Stumme. 2007. Tag recommendations in folksonomies. In Knowledge Discovery in Databases: PKDD 2007. Lecture Notes in Computer Science, Vol. 4702. Springer, 506--514. DOI:http://dx.doi.org/10.1007/978-3-540-74976-9Google Scholar
- Jia Li and James Z. Wang. 2008. Real-time computerized annotation of pictures. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 985--1002. DOI:http://dx.doi.org/10.1109/TPAMI.2007.70847 Google ScholarDigital Library
- Cameron Marlow, Mor Naaman, Danah Boyd, and Marc Davis. 2006. HT06, tagging paper, taxonomy, Flickr, academic article, toread. In Proceedings of the 17th ACM Conference on Hypertext and Hypermedia (Hypertext’06). 31--41. DOI:http://dx.doi.org/10.1145/1149941.1149949 Google ScholarDigital Library
- Adam Mathes. 2004. Folksonomies? Cooperative classification and communication through shared metadata. Computer Mediated Communication LIS590CMC, 1--13. DOI:http://dx.doi.org/10.1.1.135.1000Google Scholar
- Peter Mika. 2007. Ontologies are us: A unified model of social networks and semantics. Web Semantics: Science, Services, and Agents on the World Wide Web 5, 1, 5--15. DOI:http://dx.doi.org/10.1016/j.websem.2006.11.002 Google ScholarDigital Library
- George A. Miller. 1995. WordNet: A lexical database for English. Communications of the ACM 38, 11, 39--41. DOI:http://dx.doi.org/10.1145/219717.219748 Google ScholarDigital Library
- Valentin Robu, Harry Halpin, and Hana Shepherd. 2009. Emergence of consensus and shared vocabularies in collaborative tagging systems. ACM Transactions on the Web 3, 4, Article No. 14. DOI:http://dx.doi.org/10.1145/1594173.1594176 Google ScholarDigital Library
- Shilad Sen, Shyong K. Lam, Al Mamunur Rashid, Dan Cosley, Dan Frankowski, Jeremy Osterhouse, F. Maxwell Harper, and John Riedl. 2006. Tagging, communities, vocabulary, evolution. In Proceedings of the 20th Conference on Community Supported Cooperative Work. 181--190. DOI:http://dx.doi.org/10.1145/1180875.1180904 Google ScholarDigital Library
- Börkur Sigurbjörnsson and Roelof Zwol. 2008. Flickr tag recommendation based on collective knowledge. In Proceedings of the 17th International Conference on World Wide Web (WWW’08). 327--336. DOI:http://dx.doi.org/10.1145/1367497.1367542 Google ScholarDigital Library
- Sanjay C. Sood, Sara H. Owsley, Kristian J. Hammond, and Larry Birnbaum. 2007. TagAssist: Automatic tag suggestion for blog posts. In Proceedings of the 1st International Conference on Weblogs and Social Media (ICWSM’07). 1--8.Google Scholar
- Louise F. Spiteri. 2013. The structure and form of folksonomy tags: The road to the public library catalog. Information Technology and Libraries 26, 3, 13--25. DOI:http://dx.doi.org/10.6017/ital.v26i3.3272Google ScholarCross Ref
- George Toderici, Hrishikesh Aradhye, Marius Pasca, Luciano Sbaiz, and Jay Yagnik. 2010. Finding meaning on YouTube: Tag recommendation and category discovery. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’10). 3447--3454.Google ScholarCross Ref
- Douglas Turnbull, Luke Barrington, David Torres, and Gert Lanckriet. 2008. Semantic annotation and retrieval of music and sound effects. IEEE Transactions on Audio Speech and Language Processing 16, 2, 467--476. DOI:http://dx.doi.org/10.1109/TASL.2007.913750 Google ScholarDigital Library
- Thomas Vander Wal. 2005. Explaining and showing broad and narrow folksonomies. Retrieved September 3, 2015, from http://www.vanderwal.net/random/entrysel.php?blog=1635Google Scholar
- Thomas Vander Wal. 2007. Folksonomy. Retrieved September 3, 2015, from http://vanderwal.net/folksonomy.html.Google Scholar
- Claudia Wagner, Markus Strohmaier, and Bernardo Huberman. 2014. Semantic stability and implicit consensus in social tagging streams. In Proceedings of the 23rd International Conference on World Wide Web. 735--746. DOI:http://dx.doi.org/10.1145/2566486.2567979 Google ScholarDigital Library
- Meng Wang, Bingbing Ni, Xian-Sheng Hua, and Tat-Seng Chua. 2012. Assistive tagging: A survey of multimedia tagging with human-computer joint exploration. ACM Computing Surveys 44, 4, 1--24. DOI:http://dx.doi.org/10.1145/2333112.2333120 Google ScholarDigital Library
- Eva Zangerle, Wolfgang Gassler, and Gunther Specht. 2011. Using tag recommendations to homogenize folksonomies in microblogging environments. In Social Informatics. Lecture Notes in Computer Science, Vol. 6984. Springer, 113--126. Google ScholarDigital Library
Index Terms
- Analysis of the Impact of a Tag Recommendation System in a Real-World Folksonomy
Recommendations
Class-based tag recommendation and user-based evaluation in online audio clip sharing
Online sharing platforms often rely on collaborative tagging systems for annotating content. In this way, users themselves annotate and describe the shared contents using textual labels, commonly called tags. These annotations typically suffer from a ...
Folksonomy link prediction based on a tripartite graph for tag recommendation
Nowadays social tagging has become a popular way to annotate, search, navigate and discover online resources, in turn leading to the sheer amount of user-generated metadata. This paper addresses the problem of recommending suitable tags during ...
MAP-based image tag recommendation using a visual folksonomy
Descriptive tags are needed to enable efficient and effective search in vast collections of images. Tag recommendation represents a trade-off between automatic image annotation techniques and manual tagging. In this letter, we formulate image tag ...
Comments