ABSTRACT
Many quantitative, log-based studies of participation and contribution in CSCW and CMC systems measure the activity of users in terms of output, based on metrics like posts to forums, edits to Wikipedia articles, or commits to code repositories. In this paper, we instead seek to estimate the amount of time users have spent contributing. Through an analysis of Wikipedia log data, we identify a pattern of punctuated bursts in editors' activity that we refer to as edit sessions. Based on these edit sessions, we build a metric that approximates the labor hours of editors in the encyclopedia. Using this metric, we first compare labor-based analyses with output-based analyses, finding that the activity of many editors can appear quite differently based on the kind of metric used. Second, we use edit session data to examine phenomena that cannot be adequately studied with purely output-based metrics, such as the total number of labor hours for the entire project.
- Adler, B. T., Alfaro, L. de, Pye, I., and Raman, V. Measuring Author Contributions to the Wikipedia. Proc WikiSym 2008, ACM Press (2008). Google ScholarDigital Library
- Barabási, A.-L. The origin of bursts and heavy tails in human dynamics. Nature 435, 7039 (2005), 207--211.Google ScholarCross Ref
- Brooks, F. P. The Mythical Man-Month. Addison-Wesley, 1995. Google ScholarDigital Library
- Burke, M. and Kraut, R. Taking up the mop: identifying future wikipedia administrators. Proc CHI 2008, ACM (2008), 3441--3446. Google ScholarDigital Library
- Cutler, D. Facts on the Channel Tunnel. Reuters, 2010. http://www.reuters.com/article/2010/10/07/siemens-eurostar-tunnel-idUSLDE69623720101007.Google Scholar
- Geiger, R. and Ribes, D. The work of sustaining order in wikipedia: the banning of a vandal. Proc CSCW 2010, ACM (2010). Google ScholarDigital Library
- Geiger, R. S. and Ribes, D. Trace Ethnography: Following Coordination Through Documentary Practices. Proc HICSS 2011., IEEE (2011). Google ScholarDigital Library
- Halfaker, A., Geiger, R. S., Morgan, J. T., and Riedl, J. The Rise and Decline of an Open Collaboration System. American Behavioral Scientist. (In press). Accessed online 27 Aug 2012 at http://halfaker.info/archive/halfaker12rise.pdfGoogle Scholar
- Halfaker, A., Kittur, A., Kraut, R., and Riedl, J. A Jury of Your Peers: Quality, Experience and Ownership in Wikipedia. Proc WikiSym 2009, ACM Press (2009). Google ScholarDigital Library
- Halfaker, A., Kittur, A., and Riedl, J. Don't bite the newbies: how reverts affect the quantity and quality of Wikipedia work. Proc WikiSym 2011, ACM (2011). Google ScholarDigital Library
- Kogan, H. The Great EB: The Story of the Encyclopædia Britannica. University of Chicago Press, Chicago, 1958.Google Scholar
- Kriplean, T., Beschastnikh, I., and McDonald, D. Articulations of wikiwork: uncovering valued work in wikipedia through barnstars. Proc CSCW 2008, ACM (2008), 47--56. Google ScholarDigital Library
- Lampe, C. and Resnick, P. Slash(dot) and burn: distributed moderation in a large online conversation space. Proc CHI 2004, ACM (2004), 543--550. Google ScholarDigital Library
- Langmead, D. and Garnaut, C. Encyclopedia of Architectural and Engineering Feats. ABC-CLIO, Santa Barbara, 2001.Google Scholar
- van Liere, D. and Fung, H. Editor Trends Study. 2011. Accessed 13 April 2012 from http://strategy.wikimedia.org/wiki/Editor_Trends_Study.Google Scholar
- Lipponen, L., Rahikainen, M., Lallimo, J., and Hakkarainen, K. Patterns of participation and discourse in elementary students' computer-supported collaborative learning. Learning and Instruction 13, 5 (2003), 487--509.Google ScholarCross Ref
- Ludford, P. J., Cosley, D., Frankowski, D., and Terveen, L. Think different: increasing online community participation using uniqueness and group dissimilarity. Proc CHI 2004, ACM Press (2004), 631--638. Google ScholarDigital Library
- Mark, G., Gonzalez, V. M., and Harris, J. No task left behind?: examining the nature of fragmented work. Proc CSCW 2005, ACM Press (2005).Google ScholarDigital Library
- McDonald, D. W., Javanmardi, S., and Zachry, M. Finding patterns in behavioral observations by automatically labeling forms of wikiwork in Barnstars. Proc WikiSym 2011, ACM Press (2011). Google ScholarDigital Library
- Mongomery, Alan L., Li, S., Srinivasan, K., and Leichty, J. C. Modeling Online Browsing and Path Analysis Using Clickstream Data. Marketing Science 23, 4 (2004), 579--595. Google ScholarDigital Library
- Panciera, K., Halfaker, A., and Terveen, L. Wikipedians are born, not made: a study of power editors on Wikipedia. Proc GROUP 2009, ACM (2009), 51--60. Google ScholarDigital Library
- Priedhorsky, R., Chen, J., Lam, S. T. K., Panciera, K., Terveen, L., and Riedl, J. Creating, destroying, and restoring value in wikipedia. Proc GROUP 2007, ACM Press (2007), 259--268. Google ScholarDigital Library
- S 23 WikiStats: List of Wikipedias. 2012. http://s23.org/wikistats/wikipedias_html.php.Google Scholar
- Shirky, C. Cognitive Surplus: Creativity and Generosity in a Connected Age. Penguin, New York, 2010.Google Scholar
- Smith, C. B. Program Management B. C. Civil Engineering 69, 6 (1999).Google Scholar
- Smith, N. Classic Projects: Great Pyramid at Giza. Engineering and Technology Magazine 6, 1 (2011).Google Scholar
- Suh, B., Convertino, G., Chi, E., and Pirolli, P. The Singularity is Not Near: Slowing Growth of Wikipedia. Proc WikiSym 2009, ACM (2009). Google ScholarDigital Library
- Wikipedia contributors. "Wikipedia:Editcountitis." Wikipedia. http://enwp.org/W:ITIS, accessed 7 Dec 2012.Google Scholar
- Wilkinson, D. M. Strong regularities in online peer production. Proc EC 2008, ACM Press (2008), 302. Google ScholarDigital Library
- Zachte, E. Wikipedia Statistics. 2012. Accessed 13 April 2012 at http://stats.wikimedia.org/EN/TablesWikipediaZZ.htmGoogle Scholar
Index Terms
- Using edit sessions to measure participation in wikipedia
Recommendations
Two-stage approach to named entity recognition using Wikipedia and DBpedia
IMCOM '17: Proceedings of the 11th International Conference on Ubiquitous Information Management and CommunicationIn natural language understanding, extraction of named entity (NE) mentions in given text and classification of the mentions into pre-defined NE types are important processes. Most NE recognition (NER) relies on resources such as a training corpus or NE ...
Examining Wikipedia With a Broader Lens: Quantifying the Value of Wikipedia's Relationships with Other Large-Scale Online Communities
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsThe extensive Wikipedia literature has largely considered Wikipedia in isolation, outside of the context of its broader Internet ecosystem. Very recent research has demonstrated the significance of this limitation, identifying critical relationships ...
Out With The Old, In With The New?: Unpacking Member Turnover in Online Production Groups
Nearly any group is subject to turnover : some people leave, while others join. Turnover can be especially high in online groups, since participation typically is strictly voluntary. We investigated the effects of member turnover in online groups, ...
Comments