skip to main content
research-article

Analysis of the Impact of a Tag Recommendation System in a Real-World Folksonomy

Authors Info & Claims
Published:22 September 2015Publication History
Skip Abstract Section

Abstract

Collaborative tagging systems have emerged as a successful solution for annotating contributed resources to online sharing platforms, facilitating searching, browsing, and organizing their contents. To aid users in the annotation process, several tag recommendation methods have been proposed. It has been repeatedly hypothesized that these methods should contribute to improving annotation quality and reducing the cost of the annotation process. It has been also hypothesized that these methods should contribute to the consolidation of the vocabulary of collaborative tagging systems. However, to date, no empirical and quantitative result supports these hypotheses. In this work, we deeply analyze the impact of a tag recommendation system in the folksonomy of Freesound, a real-world and large-scale online sound sharing platform. Our results suggest that tag recommendation effectively increases vocabulary sharing among users of the platform. In addition, tag recommendation is shown to contribute to the convergence of the vocabulary as well as to a partial increase in the quality of annotations. However, according to our analysis, the cost of the annotation process does not seem to be effectively reduced. Our work is relevant to increase our understanding about the nature of tag recommendation systems and points to future directions for the further development of those systems and their analysis.

References

  1. Jeff Alstott, Ed Bullmore, and Dietmar Plenz. 2014. Powerlaw: A python package for analysis of heavy-tailed distributions. PLoS ONE 9, 1, e85777. DOI:http://dx.doi.org/10.1371/journal.pone.0085777Google ScholarGoogle ScholarCross RefCross Ref
  2. Morgan Ames and Mor Naaman. 2007. Why we tag: Motivations for annotation in mobile and online media. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’07). 971--980. DOI:http://dx.doi.org/10.1145/1240624.1240772 Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Alain Barrat, Marc Barthélemy, Romualdo Pastor-Satorras, and Alessandro Vespignani. 2004. The architecture of complex weighted networks. Proceedings of the National Academy of Sciences of the United States of America 101, 11, 3747--3752. DOI:http://dx.doi.org/10.1073/pnas.0400087101Google ScholarGoogle ScholarCross RefCross Ref
  4. Kerstin Bischoff, Claudiu S. Firan, Wolfgang Nejdl, and Raluca Paiu. 2008. Can all tags be used for search? Categories and subject descriptors. In Proceedings of the 17th ACM Conference on Information and Knowledge Management. 203--212. DOI:http://dx.doi.org/10.1145/1458082.1458112 Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Ivan Cantador, Ioannis Konstas, and Joemon M. Jose. 2011. Categorising social tags to improve folksonomy-based recommendations. Journal of Web Semantics 9, 1, 1--15. DOI:http://dx.doi.org/10.1016/j.websem.2010.10.001 Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Jean Carletta. 1996. Assessing agreement on classification tasks: The kappa statistic. Computational Linguistics 22, 2, 249--254. DOI:http://dx.doi.org/10.1.1.48.4108 Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Ciro Cattuto. 2006. Semiotic dynamics in online social communities. European Physical Journal C-Particles and Fields 37, 33--37. DOI:http://dx.doi.org/10.1140/epjcd/s2006-03-004-4Google ScholarGoogle Scholar
  8. Aaron Clauset, Cosma Rohilla Shalizi, and Mark E. J. Newman. 2007. Power-law distributions in empirical data. SIAM Review 51, 4, 661--703 http://arxiv.org/abs/0706.1062. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Gregory W. Corder and Dale I. Foreman. 2009. Nonparametric Statistics for Non-Statisticians: A Step-by-Step Approach. Wiley.Google ScholarGoogle Scholar
  10. Pasqueale De Meo, Emilio Ferrara, Fabian Abel, Lora Aroyo, and Geert-Jan Houben. 2013. Analyzing user behavior across social sharing environments. ACM Transactions on Intelligent Systems and Technology 5, 1, Article No. 14. DOI:http://dx.doi.org/10.1145/2535526 Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Pasquale De Meo, Giovanni Quattrone, and Domenico Ursino. 2009. Exploitation of semantic relationships and hierarchical data structures to support a user in his annotation and browsing activities in folksonomies. Journal of Information Systems 34, 6, 511--535. DOI:http://dx.doi.org/10.1016/j.is.2009.02.004 Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Umer Farooq, Thomas G. Kannampallil, Yang Song, Craig H. Ganoe, John M. Carroll, and Lee Giles. 2007. Evaluating tagging behavior in social bookmarking systems: Metrics and design heuristics. In Proceedings of the ACM International Conference on Supporting Group Work. 351--360. DOI:http://dx.doi.org/10.1145/1316624.1316677 Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Frederic Font, Gerard Roma, and Xavier Serra. 2013a. Freesound technical demo. In Proceedings of the 21st ACM Conference on Multimedia (MM’13). 411--412. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Frederic Font, Joan Serrà, and Xavier Serra. 2013b. Folksonomy-based tag recommendation for collaborative tagging systems. International Journal on Semantic Web and Information Systems 9, 2, 1--30. DOI:http://dx.doi.org/10.4018/jswis.2013040101Google ScholarGoogle ScholarCross RefCross Ref
  15. Frederic Font, Joan Serrà, and Xavier Serra. 2014a. Audio clip classification using social tags and the effect of tag expansion. In Proceedings of the 53rd AES Conference on Semantic Audio.Google ScholarGoogle Scholar
  16. Frederic Font, Joan Serrà, and Xavier Serra. 2014b. Class-based tag recommendation and user-based evaluation in online audio clip sharing. Journal on Knowledge Based Systems 67, 131--142. DOI:http://dx.doi.org/10.1016/j.knosys.2014.06.003 Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Nikhil Garg and Ingmar Weber. 2008. Personalized, interactive tag recommendation for Flickr. In Proceedings of the 2nd ACM Conference on Recommender Systems (RecSys’08). 67--74. DOI:http://dx.doi.org/10.1145/1454008.1454020 Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Scott A. Golder and Bernardo A. Huberman. 2006. Usage patterns of collaborative tagging systems. Journal of Information Science 32, 2, 198--208. DOI:http://dx.doi.org/10.1177/0165551506062337 Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Marieke Guy and Emma Tonkin. 2006. Folksonomies: Tidying up tags? D-Lib Magazine 12, 1.Google ScholarGoogle ScholarCross RefCross Ref
  20. Harry Halpin, Valentin Robu, and Hana Shepard. 2006. The dynamics and semantics of collaborative tagging. In Proceedings of the 1st Semantic Authoring and Annotation Workshop. 1--21.Google ScholarGoogle Scholar
  21. Ivan Ivanov, Peter Vajda, Lutz Goldmann, Jong-Seok Lee, and Touradj Ebrahimi. 2010. Object-based tag propagation for semi-automatic annotation of images. In Proceedings of the International Conference on Multimedia Information Retrieval. 497--506. DOI:http://dx.doi.org/10.1145/1743384.1743471 Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Robert Jäschke, Folke Eisterlehner, Andreas Hotho, and Gerd Stumme. 2009. Testing and evaluating tag recommenders in a live system. In Proceedings of the 3rd ACM Conference on Recommender Systems (RecSys’09). 369--372. DOI:http://dx.doi.org/10.1145/1639714.1639790 Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Robert Jäschke, Andreas Hotho, Folke Mitzlaff, and Gerd Stumme. 2012. Challenges in tag recommendations for collaborative tagging systems. In Recommender Systems for the Social Web. Springer, Berlin, 65--87. DOI:http://dx.doi.org/10.1007/978-3-642-25694-3\_3Google ScholarGoogle Scholar
  24. Robert Jäschke, Leandro Marinho, Andreas Hotho, Lars Schmidt-Thieme, and Gerd Stumme. 2007. Tag recommendations in folksonomies. In Knowledge Discovery in Databases: PKDD 2007. Lecture Notes in Computer Science, Vol. 4702. Springer, 506--514. DOI:http://dx.doi.org/10.1007/978-3-540-74976-9Google ScholarGoogle Scholar
  25. Jia Li and James Z. Wang. 2008. Real-time computerized annotation of pictures. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 985--1002. DOI:http://dx.doi.org/10.1109/TPAMI.2007.70847 Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Cameron Marlow, Mor Naaman, Danah Boyd, and Marc Davis. 2006. HT06, tagging paper, taxonomy, Flickr, academic article, toread. In Proceedings of the 17th ACM Conference on Hypertext and Hypermedia (Hypertext’06). 31--41. DOI:http://dx.doi.org/10.1145/1149941.1149949 Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Adam Mathes. 2004. Folksonomies? Cooperative classification and communication through shared metadata. Computer Mediated Communication LIS590CMC, 1--13. DOI:http://dx.doi.org/10.1.1.135.1000Google ScholarGoogle Scholar
  28. Peter Mika. 2007. Ontologies are us: A unified model of social networks and semantics. Web Semantics: Science, Services, and Agents on the World Wide Web 5, 1, 5--15. DOI:http://dx.doi.org/10.1016/j.websem.2006.11.002 Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. George A. Miller. 1995. WordNet: A lexical database for English. Communications of the ACM 38, 11, 39--41. DOI:http://dx.doi.org/10.1145/219717.219748 Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Valentin Robu, Harry Halpin, and Hana Shepherd. 2009. Emergence of consensus and shared vocabularies in collaborative tagging systems. ACM Transactions on the Web 3, 4, Article No. 14. DOI:http://dx.doi.org/10.1145/1594173.1594176 Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Shilad Sen, Shyong K. Lam, Al Mamunur Rashid, Dan Cosley, Dan Frankowski, Jeremy Osterhouse, F. Maxwell Harper, and John Riedl. 2006. Tagging, communities, vocabulary, evolution. In Proceedings of the 20th Conference on Community Supported Cooperative Work. 181--190. DOI:http://dx.doi.org/10.1145/1180875.1180904 Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Börkur Sigurbjörnsson and Roelof Zwol. 2008. Flickr tag recommendation based on collective knowledge. In Proceedings of the 17th International Conference on World Wide Web (WWW’08). 327--336. DOI:http://dx.doi.org/10.1145/1367497.1367542 Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Sanjay C. Sood, Sara H. Owsley, Kristian J. Hammond, and Larry Birnbaum. 2007. TagAssist: Automatic tag suggestion for blog posts. In Proceedings of the 1st International Conference on Weblogs and Social Media (ICWSM’07). 1--8.Google ScholarGoogle Scholar
  34. Louise F. Spiteri. 2013. The structure and form of folksonomy tags: The road to the public library catalog. Information Technology and Libraries 26, 3, 13--25. DOI:http://dx.doi.org/10.6017/ital.v26i3.3272Google ScholarGoogle ScholarCross RefCross Ref
  35. George Toderici, Hrishikesh Aradhye, Marius Pasca, Luciano Sbaiz, and Jay Yagnik. 2010. Finding meaning on YouTube: Tag recommendation and category discovery. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’10). 3447--3454.Google ScholarGoogle ScholarCross RefCross Ref
  36. Douglas Turnbull, Luke Barrington, David Torres, and Gert Lanckriet. 2008. Semantic annotation and retrieval of music and sound effects. IEEE Transactions on Audio Speech and Language Processing 16, 2, 467--476. DOI:http://dx.doi.org/10.1109/TASL.2007.913750 Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Thomas Vander Wal. 2005. Explaining and showing broad and narrow folksonomies. Retrieved September 3, 2015, from http://www.vanderwal.net/random/entrysel.php?blog=1635Google ScholarGoogle Scholar
  38. Thomas Vander Wal. 2007. Folksonomy. Retrieved September 3, 2015, from http://vanderwal.net/folksonomy.html.Google ScholarGoogle Scholar
  39. Claudia Wagner, Markus Strohmaier, and Bernardo Huberman. 2014. Semantic stability and implicit consensus in social tagging streams. In Proceedings of the 23rd International Conference on World Wide Web. 735--746. DOI:http://dx.doi.org/10.1145/2566486.2567979 Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Meng Wang, Bingbing Ni, Xian-Sheng Hua, and Tat-Seng Chua. 2012. Assistive tagging: A survey of multimedia tagging with human-computer joint exploration. ACM Computing Surveys 44, 4, 1--24. DOI:http://dx.doi.org/10.1145/2333112.2333120 Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Eva Zangerle, Wolfgang Gassler, and Gunther Specht. 2011. Using tag recommendations to homogenize folksonomies in microblogging environments. In Social Informatics. Lecture Notes in Computer Science, Vol. 6984. Springer, 113--126. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Analysis of the Impact of a Tag Recommendation System in a Real-World Folksonomy

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Intelligent Systems and Technology
        ACM Transactions on Intelligent Systems and Technology  Volume 7, Issue 1
        October 2015
        293 pages
        ISSN:2157-6904
        EISSN:2157-6912
        DOI:10.1145/2830012
        • Editor:
        • Yu Zheng
        Issue’s Table of Contents

        Copyright © 2015 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 22 September 2015
        • Accepted: 1 March 2015
        • Revised: 1 January 2015
        • Received: 1 September 2014
        Published in tist Volume 7, Issue 1

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader