skip to main content
10.1145/2470654.2470730acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Analyzing crowd workers in mobile pay-for-answer q&a

Authors Info & Claims
Published:27 April 2013Publication History

ABSTRACT

Despite the popularity of mobile pay-for-answer Q&A services, little is known about the people who answer questions on these services. In this paper we examine 18.8 million question and answer pairs from Jisiklog, the largest mobile pay-foranswer Q&A service in Korea, and the results of a complementary survey study of 245 Jisiklog workers. The data are used to investigate key motivators of participation, working strategies of experienced users, and longitudinal interaction dynamics. We find that answerers are rarely motivated by social factors but are motivated by financial incentives and intrinsic motives. Additionally, although answers are provided quickly, an answerer's topic selection tends to be broad, with experienced workers employing unique strategies to answer questions and judge relevance. Finally, analysis of longitudinal working patterns and community dynamics demonstrate the robustness of mobile pay-for-answer Q&A. These findings have significant implications on the design of mobile pay-for-answer Q&A.

References

  1. Jisiklog Service Guide. http://cs.jisikman.com/cs/h_info/info.jsp.Google ScholarGoogle Scholar
  2. Kokoma Korean Morpheme Analysis. http://kkma.snu.ac.kr/.Google ScholarGoogle Scholar
  3. Adamic, L. A., Zhang, J., Bakshy, E., and Ackerman, M. S. Knowledge Sharing and Yahoo Answers: Everyone Knows Something. In WWW (2008). Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Barry, C. L., and Schamber, L. Users' Criteria for Relevance Evaluation: A Cross-situational Comparison. Information Processing & Management (1998). Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Bigham, J. P., Jayant, C., Ji, H., Little, G., Miller, A., Miller, R. C., Miller, R., Tatarowicz, A., White, B., White, S., and Yeh, T. VizWiz: Nearly Real-time Answers to Visual Questions. In UIST (2010). Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Chen, Y., Ho, T.-H., and Kim, Y.-M. Knowledge Market Design: A Field Experiment at Google Answers. Journal of Public Economics Theory (2010).Google ScholarGoogle Scholar
  7. Edelman, B. Earnings and Ratings at Google Answers. Economic Inquiry (2012).Google ScholarGoogle Scholar
  8. Granovetter, M. The Strength of Weak Ties: A Network Theory Revisited. Sociological Theory (1983).Google ScholarGoogle Scholar
  9. Harper, F. M., Raban, D., Rafaeli, S., and Konstan, J. A. Predictors of Answer Quality in Online Q&A Sites. In CHI (2008). Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Heyman, J., and Ariely, D. Effort for Payment: A Tale of Two Markets. Psychological Science (2004).Google ScholarGoogle Scholar
  11. Horton, J. J. Online Labor Markets. In WINE (2010). Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Horton, J. J., and Chilton, L. B. The Labor Economics of Paid Crowdsourcing. In EC (2010). Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Hsieh, G., and Counts, S. mimir: A Market-Based Real-Time Question and Answer Service. In CHI (2009). Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Hsieh, G., Kraut, R. E., and Hudson, S. E. Why Pay?: Exploring How Financial Incentives are Used for Question & Answer. In CHI (2010). Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Ipeirotis, P. G. Analyzing the Amazon Mechanical Turk Marketplace. Journal XRDS: Crossroads (2010). Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Jovanovic, B., and Nyarko, Y. Learning by Doing and the Choice of Technology. Econometrica (1996).Google ScholarGoogle Scholar
  17. Lee, U., Kang, H., Yi, E., Yi, M. Y., and Kantola, J. Understanding Mobile Q&A Usage: An Exploratory Study. In CHI (2012). Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Mason, W., and Watts, D. J. Financial Incentives and the "Performance of Crowds". In KDD-HCOMP (2009). Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Nam, K. K., Ackerman, M. S., and Adamic, L. A. Questions in, Knowledge iN?: A Study of Naver's Question Answering Community. In CHI (2009). Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Raban, D., and Harper, F. M. Motivations for Answering Questions Online. In New Media and Innovative Technologies (2008).Google ScholarGoogle Scholar
  21. Raban, D. R. The Incentive Structure in an Online Information Market. JASIST (2008). Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Shah, C., Oh, J. S., and Oh, S. Exploring Characteristics and Effects of User Participation in Online Social Q&A Sites. First Monday (2008).Google ScholarGoogle Scholar
  23. Wang, S., and Noe, R. A. Knowledge Sharing: A Review and Directions for Future Research. Human Resource Management Review (2010).Google ScholarGoogle Scholar
  24. Yang, J., Adamic, L. A., and Ackerman, M. S. Competing to Share Expertise: the Taskcn Knowledge Sharing Community. In ICWSM (2008).Google ScholarGoogle Scholar
  25. Yang, J., Adamic, L. A., and Ackerman, M. S. Crowdsourcing and Knowledge Sharing: Strategic User Behavior on Taskcn. In EC (2008). Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Yang, J., Wei, X., Ackerman, M., and Adamic, L. Activity Lifespan: An Analysis of User Survival Patterns in Online Knowledge Sharing Communities. In ICWSM (2010).Google ScholarGoogle Scholar

Index Terms

  1. Analyzing crowd workers in mobile pay-for-answer q&a

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
      April 2013
      3550 pages
      ISBN:9781450318990
      DOI:10.1145/2470654

      Copyright © 2013 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 27 April 2013

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      CHI '13 Paper Acceptance Rate392of1,963submissions,20%Overall Acceptance Rate6,199of26,314submissions,24%

      Upcoming Conference

      CHI PLAY '24
      The Annual Symposium on Computer-Human Interaction in Play
      October 14 - 17, 2024
      Tampere , Finland

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader