To Reuse or Not To Reuse?: A Framework and System for Evaluating Summarized Knowledge

Authors:
Michael Xieyang Liu

Carnegie Mellon University, Pittsburgh, PA, USA

Carnegie Mellon University, Pittsburgh, PA, USA
View Profile

,
Aniket Kittur

Carnegie Mellon University, Pittsburgh, PA, USA

Carnegie Mellon University, Pittsburgh, PA, USA
View Profile

,
Brad A. Myers

Carnegie Mellon University, Pittsburgh, PA, USA

Carnegie Mellon University, Pittsburgh, PA, USA
View Profile

Proceedings of the ACM on Human-Computer Interaction Volume 5 Issue CSCW1Article No.: 166pp 1–35https://doi.org/10.1145/3449240

Published:22 April 2021Publication History

Proceedings of the ACM on Human-Computer Interaction

Abstract

As the amount of information online continues to grow, a correspondingly important opportunity is for individuals to reuse knowledge which has been summarized by others rather than starting from scratch. However, appropriate reuse requires judging the relevance, trustworthiness, and thoroughness of others' knowledge in relation to an individual's goals and context. In this work, we explore augmenting judgements of the appropriateness of reusing knowledge in the domain of programming, specifically of reusing artifacts that result from other developers' searching and decision making. Through an analysis of prior research on sensemaking and trust, along with new interviews with developers, we synthesized a framework for reuse judgements. The interviews also validated that developers express a desire for help with judging whether to reuse an existing decision. From this framework, we developed a set of techniques for capturing the initial decision maker's behavior and visualizing signals calculated based on the behavior, to facilitate subsequent consumers' reuse decisions, instantiated in a prototype system called Strata. Results of a user study suggest that the system significantly improves the accuracy, depth, and speed of reusing decisions. These results have implications for systems involving user-generated content in which other users need to evaluate the relevance and trustworthiness of that content.

References

[n.d.]. Build software better, together - Github. https://github.comGoogle Scholar
[n.d.]. Getting started with machine learning. https://github.com/collections/machine-learningGoogle Scholar
[n.d.]. npm | build amazing things. https://www.npmjs.com/ Library Catalog: www.npmjs.com.Google Scholar
[n.d.]. Programming languages: A list of programming languages that are actively developed on GitHub. https: //github.com/collections/programming-languagesGoogle Scholar
[n.d.]. Stack Overflow - Where Developers Learn, Share, & Build Careers. https://stackoverflow.com/Google Scholar
[n.d.]. Wikipedia. https://www.wikipedia.org/Google Scholar
2009. PUT vs. POST in REST. https://stackoverflow.com/a/32524385Google Scholar
2009. Which equals operator (== vs ===) should be used in JavaScript comparisons? https://stackoverflow.com/a/ 26923895Google Scholar
2019. Front-end JavaScript frameworks. https://github.com/collections/front-end-javascript-frameworksGoogle Scholar
2020. "exports" config · Issue #20 · then/is-promise. https://github.com/then/is-promise/issues/20 Library Catalog: github.com.Google Scholar
2020. pip - The Python Package Installer - pip 20.1 documentation. https://pip.pypa.io/en/stable/Google Scholar
2020. Python Lists VS Numpy Arrays. https://www.geeksforgeeks.org/python-lists-vs-numpy-arrays/ Library Catalog: www.geeksforgeeks.org Section: Python.Google Scholar
2020. Stack Overflow Developer Survey 2020. https://insights.stackoverflow.com/survey/2020/Google Scholar
B. Thomas Adler and Luca de Alfaro. 2007. A content-driven reputation system for the wikipedia. In Proceedings of the 16th international conference on World Wide Web (WWW '07). Association for Computing Machinery, Banff, Alberta, Canada, 261--270. https://doi.org/10.1145/1242572.1242608Google ScholarDigital Library
Janet E. Alexander and Marsha A. Tate. 1999. Web Wisdom; How to Evaluate and Create Information Quality on the Webb (1st ed.). L. Erlbaum Associates Inc., USA.Google ScholarDigital Library
Rana Alkadhi, Teodora Lata, Emitza Guzmany, and Bernd Bruegge. 2017. Rationale in Development Chat Messages: An Exploratory Study. In 2017 IEEE/ACM 14th International Conference on Mining Software Repositories (MSR). 436--446. https://doi.org/10.1109/MSR.2017.43Google ScholarDigital Library
Saleema Amershi and Meredith Ringel Morris. 2008. CoSearch: A System for Co-located Collaborative Web Search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 1647--1656. https://doi.org/10.1145/1357054.1357311Google ScholarDigital Library
Jonathan Howard Amsbary and Larry Powell. 2003. Factors influencing evaluations of web site information. Psychological Reports 93, 1 (Aug. 2003), 191--198. https://doi.org/10.2466/pr0.2003.93.1.191Google ScholarCross Ref
B.H. Barns and T.B. Bollinger. 1991. Making reuse cost-effective. IEEE Software 8, 1 (Jan. 1991), 13--24. https: //doi.org/10.1109/52.62928 Conference Name: IEEE Software.Google ScholarDigital Library
David Baxter, James Gao, Keith Case, Jenny Harding, Bob Young, Sean Cochrane, and Shilpa Dani. 2007. An engineering design knowledge reuse methodology using process modelling. Research in Engineering Design 18, 1 (May 2007), 37--48. https://doi.org/10.1007/s00163-007-0028-8Google ScholarCross Ref
David Baxter, James Gao, Keith Case, Jenny Harding, Bob Young, Sean Cochrane, and Shilpa Dani. 2008. A framework to integrate design knowledge reuse and requirements management in engineering design. Robotics and Computer-Integrated Manufacturing 24, 4 (Aug. 2008), 585--593. https://doi.org/10.1016/j.rcim.2007.07.010Google ScholarDigital Library
Andrew Begel and Beth Simon. 2008. Novice software developers, all over again. In Proceedings of the Fourth international Workshop on Computing Education Research (ICER '08). Association for Computing Machinery, Sydney, Australia, 3--14. https://doi.org/10.1145/1404520.1404522Google ScholarDigital Library
Krishna Bharat. 2000. SearchPad: explicit capture of search context to support Web search. Computer Networks 33, 1 (June 2000), 493--501. https://doi.org/10.1016/S1389-1286(00)00047-5Google ScholarDigital Library
Eric A. Bier, Maureen C. Stone, Ken Pier, William Buxton, and Tony D. DeRose. 1993. Toolglass and magic lenses: the see-through interface. In Proceedings of the 20th annual conference on Computer graphics and interactive techniques (SIGGRAPH '93). Association for Computing Machinery, New York, NY, USA, 73--80. https://doi.org/10.1145/166117. 166126Google ScholarDigital Library
Pia Borlund. 2003. The concept of relevance in IR. Journal of the American Society for Information Science and Technology 54, 10 (2003), 913--925. https://doi.org/10.1002/asi.10286 _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/asi.10286.Google ScholarDigital Library
D. Scott Brandt. 1996. Evaluating Information on the Internet. Computers in Libraries 16, 5 (1996), 44--46.Google ScholarDigital Library
Joel Brandt, Mira Dontcheva, Marcos Weskamp, and Scott R. Klemmer. 2010. Example-centric Programming: Integrating Web Search into the Development Environment. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 513--522. https://doi.org/10.1145/1753326.1753402Google ScholarDigital Library
Joel Brandt, Philip J. Guo, Joel Lewenstein, Mira Dontcheva, and Scott R. Klemmer. 2009. Two Studies of Opportunistic Programming: Interleaving Web Foraging, Learning, and Writing Code. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1589--1598. https://doi.org/10.1145/ 1518701.1518944 event-place: Boston, MA, USA.Google Scholar
Joseph Chee Chang, Nathan Hahn, and Aniket Kittur. 2020. Mesh: Scaffolding Comparison Tables for Online Decision Making. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST '20). Association for Computing Machinery, New York, NY, USA, 391--405. https://doi.org/10.1145/3379337.3415865Google ScholarDigital Library
Joseph Chee Chang, Nathan Hahn, Adam Perer, and Aniket Kittur. 2019. SearchLens: composing and capturing complex user interests for exploratory search. In Proceedings of the 24th International Conference on Intelligent User Interfaces (IUI '19). Association for Computing Machinery, Marina del Ray, California, 498--509. https://doi.org/10. 1145/3301275.3302321Google ScholarDigital Library
Kathy Charmaz. 2006. Constructing Grounded Theory: A Practical Guide through Qualitative Analysis. SAGE. Google-Books-ID: 2ThdBAAAQBAJ.Google Scholar
Yan Chen, Sang Won Lee, Yin Xie, YiWei Yang, Walter S. Lasecki, and Steve Oney. 2017. Codeon: On-Demand Software Development Assistance. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 6220--6231. https://doi.org/10.1145/3025453.3025972Google ScholarDigital Library
Herbert H. Clark and Susan E. Brennan. 1991. Grounding in communication. In Perspectives on socially shared cognition. American Psychological Association, Washington, DC, US, 127--149. https://doi.org/10.1037/10096-006Google ScholarCross Ref
Thomas H. Davenport, Sirkka L. Jarvenpaa, and Michael C. Beers. 1996. Improving Knowledge Work Processes. Sloan management review 37, 4 (1996), 53--65. https://dialnet.unirioja.es/servlet/articulo?codigo=2514140 Publisher: MIT press Section: Sloan management review.Google Scholar
Peter Denning, Jim Horning, David Parnas, and Lauren Weinstein. 2005. Wikipedia risks. Commun. ACM 48, 12 (Dec. 2005), 152. https://doi.org/10.1145/1101779.1101804Google ScholarDigital Library
Nancy M. Dixon. 2000. Common Knowledge: How Companies Thrive by Sharing What They Know. Harvard Business School Press, USA.Google ScholarDigital Library
Paul Dourish and Victoria Bellotti. 1992. Awareness and coordination in shared workspaces. In Proceedings of the 1992 ACM conference on Computer-supported cooperative work (CSCW '92). Association for Computing Machinery, Toronto, Ontario, Canada, 107--114. https://doi.org/10.1145/143457.143468Google ScholarDigital Library
Thomas Erickson and Wendy A. Kellogg. 2000. Social translucence: an approach to designing systems that support social processes. ACM Transactions on Computer-Human Interaction 7, 1 (March 2000), 59--83. https://doi.org/10. 1145/344949.345004Google ScholarDigital Library
Gunther Eysenbach and Christian Köhler. 2002. How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews. BMJ (Clinical research ed.) 324, 7337 (March 2002), 573--577. https://doi.org/10.1136/bmj.324.7337.573Google ScholarCross Ref
Facebook. 2018. React - A JavaScript library for building user interfaces. https://reactjs.org/Google Scholar
Kristie Fisher, Scott Counts, and Aniket Kittur. 2012. Distributed Sensemaking: Improving Sensemaking by Leveraging the Efforts of Previous Users. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 247--256. https://doi.org/10.1145/2207676.2207711Google ScholarDigital Library
Andrew J. Flanagin and Miriam J. Metzger. 2000. Perceptions of Internet Information Credibility. Journalism & Mass Communication Quarterly 77, 3 (Sept. 2000), 515--540. https://doi.org/10.1177/107769900007700304 Publisher: SAGE Publications Inc.Google ScholarCross Ref
B. J. Fogg. 2002. Persuasive technology: using computers to change what we think and do. Ubiquity 2002, December (Dec. 2002), 5:2. https://doi.org/10.1145/764008.763957Google ScholarDigital Library
B. J. Fogg and Hsiang Tseng. 1999. The elements of computer credibility. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (CHI '99). Association for Computing Machinery, Pittsburgh, Pennsylvania, USA, 80--87. https://doi.org/10.1145/302979.303001Google ScholarDigital Library
Adam Fourney and Meredith Ringel Morris. 2013. Enhancing Technical Q&A Forums with CiteHistory. In Seventh International AAAI Conference on Weblogs and Social Media. https://www.aaai.org/ocs/index.php/ICWSM/ICWSM13/ paper/view/6082Google Scholar
William Frakes and Carol Terry. 1996. Software reuse: metrics and models. Comput. Surveys 28, 2 (June 1996), 415--435. https://doi.org/10.1145/234528.234531Google ScholarDigital Library
W B Frakes and B A Nejmeh. 1986. Software reuse through information retrieval. ACM SIGIR Forum 21, 1--2 (Sept. 1986), 30--36. https://doi.org/10.1145/24634.24636Google ScholarDigital Library
John W. Fritch and Robert L. Cromwell. 2001. Evaluating Internet resources: Identity, affiliation, and cognitive authority in a networked world. Journal of the American Society for Information Science and Technology 52, 6 (2001), 499--507. https://doi.org/10.1002/asi.1081 _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/asi.1081.Google ScholarCross Ref
Andreas Gizas, Sotiris Christodoulou, and Theodore Papatheodorou. 2012. Comparative Evaluation of Javascript Frameworks. In Proceedings of the 21st International Conference on World Wide Web (WWW '12 Companion). ACM, New York, NY, USA, 513--514. https://doi.org/10.1145/2187980.2188103Google ScholarDigital Library
Stefan Haefliger, Georg von Krogh, and Sebastian Spaeth. 2007. Code Reuse in Open Source Software. Management Science 54, 1 (Nov. 2007), 180--193. https://doi.org/10.1287/mnsc.1070.0748 Publisher: INFORMS.Google ScholarDigital Library
Nathan Hahn, Joseph Chang, Ji Eun Kim, and Aniket Kittur. 2016. The Knowledge Accelerator: Big Picture Thinking in Small Pieces. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2258--2270. https://doi.org/10.1145/2858036.2858364Google ScholarDigital Library
Nathan Hahn, Joseph Chee Chang, and Aniket Kittur. 2018. Bento Browser: Complex Mobile Search Without Tabs. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, Montreal QC, Canada, 251:1--251:12. https://doi.org/10.1145/3173574.3173825Google ScholarDigital Library
Udo Hahn and Ulrich Reimer. 1999. Knowledge-based text summarization: Salience and generalization operators for knowledge base abstraction. Advances in automatic text summarization (1999), 215--232. Publisher: MIT Press, Cambridge, Mass.Google Scholar
Tom-Michael Hesse, Veronika Lerche, Marcus Seiler, Konstantin Knoess, and Barbara Paech. 2016. Documented decision-making strategies and decision knowledge in open source projects: An empirical study on Firefox issue reports. Information and Software Technology 79 (Nov. 2016), 36--51. https://doi.org/10.1016/j.infsof.2016.06.003Google ScholarDigital Library
Johan F. Hoorn and Teunis D. van Wijngaarden. 2010. Web Intelligence for the Assessment of Information Quality: Credibility, Correctness, and Readability. Web Intelligence and Intelligent Agents (March 2010). https://doi.org/10. 5772/8372 Publisher: IntechOpen.Google Scholar
Eric Horvitz. 1999. Principles of mixed-initiative user interfaces. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (CHI '99). Association for Computing Machinery, New York, NY, USA, 159--166. https://doi.org/10.1145/302979.303030Google ScholarDigital Library
Jane Hsieh, Michael Xieyang Liu, Brad A. Myers, and Aniket Kittur. 2018. An Exploratory Study of Web Foraging to Understand and Support Programming Decisions. In 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). 305--306. https://doi.org/10.1109/VLHCC.2018.8506517 ISSN: 1943--6092.Google ScholarCross Ref
Donghan Hu and Sang Won Lee. 2020. ScreenTrack: Using a Visual History of a Computer Screen to Retrieve Documents and Web Pages. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, Honolulu, HI, USA, 1--13. https://doi.org/10.1145/3313831.3376753Google ScholarDigital Library
Robert F. Hurley and G. Tomas M. Hult. 1998. Innovation, Market Orientation, and Organizational Learning: An Integration and Empirical Examination. Journal of Marketing 62, 3 (July 1998), 42--54. https://doi.org/10.1177/ 002224299806200303 Publisher: SAGE Publications Inc.Google ScholarCross Ref
Haojian Jin, Swarun Kumar, and Jason Hong. 2020. Providing architectural support for building privacy-sensitive smart home applications. In Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers (UbiComp-ISWC '20). Association for Computing Machinery, New York, NY, USA, 212--217. https://doi.org/10.1145/3410530.3414328Google ScholarDigital Library
Haojian Jin, Minyi Liu, Kevan Dodhia, Yuanchun Li, Gaurav Srivastava, Matthew Fredrikson, Yuvraj Agarwal, and Jason I. Hong. 2018. Why Are They Collecting My Data? Inferring the Purposes of Network Traffic in Mobile Apps. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 4 (Dec. 2018), 173:1--173:27. https://doi.org/10.1145/3287051Google ScholarDigital Library
Haojian Jin, Tetsuya Sakai, and Koji Yatani. 2014. ReviewCollage: a mobile interface for direct comparison using online reviews. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services (MobileHCI '14). Association for Computing Machinery, New York, NY, USA, 349--358. https://doi.org/10. 1145/2628363.2628373Google ScholarDigital Library
Aniket Kittur, Andrew M. Peters, Abdigani Diriye, and Michael Bove. 2014. Standing on the Schemas of Giants: Socially Augmented Information Foraging. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '14). ACM, New York, NY, USA, 999--1010. https://doi.org/10.1145/2531602.2531644Google ScholarDigital Library
Aniket Kittur, Andrew M. Peters, Abdigani Diriye, Trupti Telang, and Michael R. Bove. 2013. Costs and Benefits of Structured Information Foraging. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2989--2998. https://doi.org/10.1145/2470654.2481415Google ScholarDigital Library
Aniket Kittur, Bongwon Suh, and Ed H. Chi. 2008. Can you ever trust a wiki? impacting perceived trustworthiness in wikipedia. In Proceedings of the 2008 ACM conference on Computer supported cooperative work (CSCW '08). Association for Computing Machinery, San Diego, CA, USA, 477--480. https://doi.org/10.1145/1460563.1460639Google ScholarDigital Library
Amy J. Ko, Robert DeLine, and Gina Venolia. 2007. Information Needs in Collocated Software Development Teams. In 29th International Conference on Software Engineering (ICSE'07). IEEE, 344--353.Google ScholarDigital Library
Amy J. Ko, Brad A. Myers, and Htet Htet Aung. 2004. Six Learning Barriers in End-User Programming Systems. In Proceedings of the 2004 IEEE Symposium on Visual Languages - Human Centric Computing (VLHCC '04). IEEE Computer Society, Washington, DC, USA, 199--206. https://doi.org/10.1109/VLHCC.2004.47Google ScholarDigital Library
Professor of Management and Director at the Institute of Management Georg Von Krogh, Georg von Krogh, Associate Professor in the Faculty of Social Sciences and the Graduate School of International Corporate Strategy Kazuo Ichijo, Kazuo Ichijo, Ikujiro Nonaka, and Professor of Graduate School of International Corporate Strategy at Hitotsubashi University and the Xerox Distinguished Professor in Knowledge at Hass School of Business Ikujiro Nonaka. 2000. Enabling Knowledge Creation: How to Unlock the Mystery of Tacit Knowledge and Release the Power of Innovation. Oxford University Press, USA. Google-Books-ID: JVESDAAAQBAJ.Google Scholar
Charles W. Krueger. 1992. Software reuse. Comput. Surveys 24, 2 (June 1992), 131--183. https://doi.org/10.1145/ 130844.130856Google ScholarDigital Library
Thomas D. LaToza and Brad A. Myers. 2010. Hard-to-answer Questions About Code. In Evaluation and Usability of Programming Languages and Tools (PLATEAU '10). ACM, New York, NY, USA, 8:1--8:6. https://doi.org/10.1145/ 1937117.1937125Google Scholar
Thomas D. LaToza, Gina Venolia, and Robert DeLine. 2006. Maintaining Mental Models: A Study of Developer Work Habits. In Proceedings of the 28th International Conference on Software Engineering (ICSE '06). ACM, New York, NY, USA, 492--501. https://doi.org/10.1145/1134285.1134355Google ScholarDigital Library
John Lawrence, Jonas Malmsten, Andrey Rybka, Daniel Sabol, and Ken Triplin. 2017. Comparing TensorFlow Deep Learning Performance Using CPUs, GPUs, Local PCs and Cloud. Publications and Research (May 2017). https://academicworks.cuny.edu/bx_pubs/50Google Scholar
Toby Jia-Jun Li, Amos Azaria, and Brad A. Myers. 2017. SUGILITE: Creating Multimodal Smartphone Automation by Demonstration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). Association for Computing Machinery, Denver, Colorado, USA, 6038--6049. https://doi.org/10.1145/3025453.3025483Google ScholarDigital Library
Toby Jia-Jun Li, Jingya Chen, Brandon Canfield, and Brad A. Myers. 2020. Privacy-Preserving Script Sharing in GUI-based Programming-by-Demonstration Systems. Proceedings of the ACM on Human-Computer Interaction 4, CSCW1 (May 2020), 060:1--060:23. https://doi.org/10.1145/3392869Google ScholarDigital Library
Toby Jia-Jun Li, Jingya Chen, Haijun Xia, Tom M. Mitchell, and Brad A. Myers. 2020. Multi-Modal Repairs of Conversational Breakdowns in Task-Oriented Dialogs. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST '20). Association for Computing Machinery, New York, NY, USA, 1094--1107. https://doi.org/10.1145/3379337.3415820Google ScholarDigital Library
Toby Jia-Jun Li, Igor Labutov, Xiaohan Nancy Li, Xiaoyi Zhang, Wenze Shi, Wanling Ding, Tom M. Mitchell, and Brad A. Myers. 2018. APPINITE: A Multi-Modal Interface for Specifying Data Descriptions in Programming by Demonstration Using Natural Language Instructions. In 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). 105--114. https://doi.org/10.1109/VLHCC.2018.8506506 ISSN: 1943--6106Google ScholarCross Ref
Toby Jia-Jun Li, Marissa Radensky, Justin Jia, Kirielle Singarajah, Tom M. Mitchell, and Brad A. Myers. 2019. PUMICE: A Multi-Modal Agent that Learns Concepts and Conditionals from Natural Language and Demonstrations. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST '19). Association for Computing Machinery, New Orleans, LA, USA, 577--589. https://doi.org/10.1145/3332165.3347899Google ScholarDigital Library
Toby Jia-Jun Li and Oriana Riva. 2018. Kite: Building Conversational Bots from Mobile Apps. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys '18). Association for Computing Machinery, Munich, Germany, 96--109. https://doi.org/10.1145/3210240.3210339Google ScholarDigital Library
Brian Y. Lim and Anind K. Dey. 2009. Assessing demand for intelligibility in context-aware applications. In Proceedings of the 11th international conference on Ubiquitous computing (UbiComp '09). Association for Computing Machinery, Orlando, Florida, USA, 195--204. https://doi.org/10.1145/1620545.1620576Google ScholarDigital Library
Brian Y. Lim and Anind K. Dey. 2010. Toolkit to support intelligibility in context-aware applications. In Proceedings of the 12th ACM international conference on Ubiquitous computing (UbiComp '10). Association for Computing Machinery, Copenhagen, Denmark, 13--22. https://doi.org/10.1145/1864349.1864353Google ScholarDigital Library
Michael Xieyang Liu, Shaun Burley, Emily Deng, Angelina Zhou, Aniket Kittur, and Brad A. Myers. 2018. Supporting Knowledge Acceleration for Programming from a Sensemaking Perspective. Sensemaking Workshop at CHI Conference on Human Factors in Computing Systems (April 2018). https://par.nsf.gov/biblio/10152063-supporting-knowledge-acceleration-programming-from-sensemaking-perspectiveGoogle Scholar
Michael Xieyang Liu, Nathan Hahn, Angelina Zhou, Shaun Burley, Emily Deng, Aniket Kittur, and Brad A. Myers. 2018. UNAKITE: Support Developers for Capturing and Persisting Design Rationales When Solving Problems Using Web Resources. Workshop on Designing Technologies to Support Human Problem Solving at the IEEE Symposium on Visual Languages and Human-Centric Computing (Oct. 2018). https://par.nsf.gov/biblio/10152060-unakite-support-developers-capturing-persisting-design-rationales-when-solving-problems-using-web-resourcesGoogle Scholar
Michael Xieyang Liu, Jane Hsieh, Nathan Hahn, Angelina Zhou, Emily Deng, Shaun Burley, Cynthia Taylor, Aniket Kittur, and Brad A. Myers. 2019. Unakite: Scaffolding Developers' Decision-Making Using the Web. In Proceedings of the 32Nd Annual ACM Symposium on User Interface Software and Technology (UIST '19). ACM, New Orleans, LA, USA, 67--80. https://doi.org/10.1145/3332165.3347908 event-place: New Orleans, LA, USA.Google ScholarDigital Library
Ann Majchrzak, Lynne P. Cooper, and Olivia E. Neece. 2004. Knowledge Reuse for Innovation. Management Science 50, 2 (Feb. 2004), 174--188. https://doi.org/10.1287/mnsc.1030.0116 Publisher: INFORMS.Google ScholarDigital Library
Lynne M. Markus. 2001. Toward a Theory of Knowledge Reuse: Types of Knowledge Reuse Situations and Factors in Reuse Success. Journal of Management Information Systems 18, 1 (May 2001), 57--93. https://doi.org/10.1080/ 07421222.2001.11045671 Publisher: Routledge _eprint: https://doi.org/10.1080/07421222.2001.11045671.Google ScholarCross Ref
Marc Meola. 2004. Chucking the Checklist: A Contextual Approach to Teaching Undergraduates Web-Site Evaluation. portal: Libraries and the Academy 4, 3 (July 2004), 331--344. https://doi.org/10.1353/pla.2004.0055 Publisher: Johns Hopkins University Press.Google ScholarCross Ref
Miriam J. Metzger. 2007. Making sense of credibility on the Web: Models for evaluating online information and recommendations for future research. Journal of the American Society for Information Science and Technology 58, 13 (2007), 2078--2091. https://doi.org/10.1002/asi.20672Google ScholarCross Ref
Miriam J. Metzger, Andrew J. Flanagin, Keren Eyal, Daisy R. Lemus, and Robert M. Mccann. 2003. Credibility for the 21st Century: Integrating Perspectives on Source, Message, and Media Credibility in the Contemporary Media Environment. Annals of the International Communication Association 27, 1 (Jan. 2003), 293--335. https://doi.org/10. 1080/23808985.2003.11679029 Publisher: Routledge _eprint: https://doi.org/10.1080/23808985.2003.11679029.Google ScholarCross Ref
Miriam J. Metzger, Andrew J. Flanagin, and Ryan B. Medders. 2010. Social and Heuristic Approaches to Credibility Evaluation Online. Journal of Communication 60, 3 (2010), 413--439. https://doi.org/10.1111/j.1460--2466.2010.01488.xGoogle ScholarCross Ref
Audris Mockus. 2007. Large-Scale Code Reuse in Open Source Software. In First International Workshop on Emerging Trends in FLOSS Research and Development (FLOSS'07: ICSE Workshops 2007). 7--7. https://doi.org/10.1109/FLOSS.2007. 10Google ScholarCross Ref
Dan Morris, Meredith Ringel Morris, and Gina Venolia. 2008. SearchBar: A Search-centric Web History for Task Resumption and Information Re-finding. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 1207--1216. https://doi.org/10.1145/1357054.1357242Google ScholarDigital Library
Meredith Ringel Morris and Eric Horvitz. 2007. SearchTogether: An Interface for Collaborative Web Search. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST '07). ACM, New York, NY, USA, 3--12. https://doi.org/10.1145/1294211.1294215Google ScholarDigital Library
B. Myers, R. Malkin, M. Bett, A. Waibel, B. Bostwick, R.C. Miller, Jie Yang, M. Denecke, E. Seemann, Jie Zhu, Choon Hong Peck, D. Kong, J. Nichols, and B. Scherlis. 2002. Flexi-modal and multi-machine user interfaces. In Proceedings. Fourth IEEE International Conference on Multimodal Interfaces. 343--348. https://doi.org/10.1109/ICMI.2002.1167019Google ScholarDigital Library
Brad A. Myers, Amy J. Ko, Chris Scaffidi, Stephen Oney, YoungSeok Yoon, Kerry Chang, Mary Beth Kery, and Toby Jia-Jun Li. 2017. Making End User Development More Natural. In New Perspectives in End-User Development, Fabio Paternòand Volker Wulf (Eds.). Springer International Publishing, Cham, 1--22. https://doi.org/10.1007/978-3-319-60291-2_1Google ScholarCross Ref
lkujiro Nonaka, Hirotaka Takeuchi, and Katsuhiro Umemoto. 1996. A theory of organizational knowledge creation. International Journal of Technology Management 11, 7--8 (Jan. 1996), 833--845. https://doi.org/10.1504/IJTM.1996.025472 Publisher: Inderscience Publishers.Google ScholarCross Ref
Carla O'Dell and C. Jackson Grayson. 1998. If Only We Knew What We Know: Identification and Transfer of Internal Best Practices:. California Management Review (April 1998). https://doi.org/10.2307/41165948 Publisher: SAGE PublicationsSage CA: Los Angeles, CA.Google ScholarCross Ref
Stephen Oney and Joel Brandt. 2012. Codelets: Linking Interactive Documentation and Example Code in the Editor. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2697--2706. https://doi.org/10.1145/2207676.2208664Google ScholarDigital Library
Margit Osterloh and Bruno S. Frey. 2000. Motivation, Knowledge Transfer, and Organizational Forms. Organization Science 11, 5 (Oct. 2000), 538--550. https://doi.org/10.1287/orsc.11.5.538.15204 Publisher: INFORMS.Google ScholarDigital Library
Emily S. Patterson and David D. Woods. 2001. Shift Changes, Updates, and the On-Call Architecture in Space Shuttle Mission Control. Computer Supported Cooperative Work 10, 3--4 (Dec. 2001), 317--346. https://doi.org/10.1023/A: 1012705926828Google ScholarDigital Library
Sharoda A. Paul and Meredith Ringel Morris. 2009. CoSense: Enhancing Sensemaking for Collaborative Web Search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1771--1780. https://doi.org/10.1145/1518701.1518974Google ScholarDigital Library
Sharoda A. Paul and Meredith Ringel Morris. 2011. Sensemaking in Collaborative Web Search. Human--Computer Interaction 26, 1--2 (March 2011), 72--122. https://doi.org/10.1080/07370024.2011.559410Google ScholarCross Ref
Luca Ponzanelli, Alberto Bacchelli, and Michele Lanza. 2013. Seahawk: Stack Overflow in the IDE. In 2013 35th International Conference on Software Engineering (ICSE). IEEE, San Francisco, CA, USA, 1295--1298. https://doi.org/10. 1109/ICSE.2013.6606701Google Scholar
N. Rutar, C. B. Almazan, and J. S. Foster. 2004. A comparison of bug finding tools for Java. In 15th International Symposium on Software Reliability Engineering. 245--256. https://doi.org/10.1109/ISSRE.2004.1Google ScholarDigital Library
Eldar Sadikov, Jayant Madhavan, Lu Wang, and Alon Halevy. 2010. Clustering query refinements by user intent. In Proceedings of the 19th international conference on World wide web (WWW '10). Association for Computing Machinery, Raleigh, North Carolina, USA, 841--850. https://doi.org/10.1145/1772690.1772776Google ScholarDigital Library
Tefko Saracevic. [n.d.]. Relevance reconsidered.Google Scholar
Ann Scholz-Crane. 1998. Evaluating the Future: A Preliminary Study of the Process of How Undergraduate Students Evaluate Web Sources. RSR: Reference Services Review 26 (1998), 53--60.Google ScholarCross Ref
Rever Score. 2017. Why we moved from Angular 2 to Vue.js (and why we didn't choose React). https://medium.com/ reverdev/why-we-moved-from-angular-2-to-vue-js-and-why-we-didnt-choose-react-ef807d9f4163 Library Catalog: medium.com.Google Scholar
Mirjam Seckler, Silvia Heinz, Seamus Forde, Alexandre N. Tuch, and Klaus Opwis. 2015. Trust and distrust on the web: User experiences and website characteristics. Computers in Human Behavior 45 (April 2015), 39--50. https://doi.org/10.1016/j.chb.2014.11.064Google ScholarDigital Library
Nikhil Sharma. 2008. Sensemaking handoff: When and how? Proceedings of the American Society for Information Science and Technology 45, 1 (Jan. 2008), 1--12. https://doi.org/10.1002/meet.2008.1450450234Google ScholarCross Ref
Nikhil Sharma. 2011. Role of available and provided resources in sensemaking. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). Association for Computing Machinery, Vancouver, BC, Canada, 1807--1816. https://doi.org/10.1145/1978942.1979204Google ScholarDigital Library
Nikhil Sharma and George Furnas. 2009. Artifact usefulness and usage in sensemaking handoffs. Proceedings of the American Society for Information Science and Technology 46 (2009). https://doi.org/10.1002/meet.2009.1450460219Google ScholarCross Ref
B. Shneiderman. 1996. The eyes have it: a task by data type taxonomy for information visualizations. In Proceedings 1996 IEEE Symposium on Visual Languages. 336--343. https://doi.org/10.1109/VL.1996.545307 ISSN: 1049--2615.Google ScholarCross Ref
Ben Shneiderman. 2000. Designing trust into online experiences. Commun. ACM 43, 12 (Dec. 2000), 57--59. https: //doi.org/10.1145/355112.355124Google ScholarDigital Library
Jonathan Sillito, Gail C. Murphy, and Kris De Volder. 2006. Questions Programmers Ask During Software Evolution Tasks. In Proceedings of the 14th ACM SIGSOFT International Symposium on Foundations of Software Engineering (SIGSOFT '06/FSE-14). ACM, New York, NY, USA, 23--34. https://doi.org/10.1145/1181775.1181779Google ScholarDigital Library
Manuel Sojer and Joachim Henkel. 2010. Code Reuse in Open Source Software Development: Quantitative Evidence, Drivers, and Impediments. SSRN Scholarly Paper ID 1489789. Social Science Research Network, Rochester, NY. https://papers.ssrn.com/abstract=1489789Google Scholar
Bongwon Suh, Ed H. Chi, Aniket Kittur, and Bryan A. Pendleton. 2008. Lifting the veil: improving accountability and social transparency in Wikipedia with wikidashboard. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). Association for Computing Machinery, Florence, Italy, 1037--1040. https://doi.org/10.1145/1357054.1357214Google ScholarDigital Library
Yi Yi Thaw, Ahmad Kamil Mahmood, and P. Dhanapal Durai Dominic. 2009. A Study on the Factors That Influence the Consumers Trust on Ecommerce Adoption. arXiv:0909.1145 [cs] (Sept. 2009). http://arxiv.org/abs/0909.1145 arXiv: 0909.1145.Google Scholar
Meinald T. Thielsch and Gerrit Hirschfeld. 2019. Facets of Website Content. Human--Computer Interaction 34, 4 (July 2019), 279--327. https://doi.org/10.1080/07370024.2017.1421954Google ScholarCross Ref
Michael L Van De Vanter. 2002. The documentary structure of source code. Information and Software Technology 44, 13 (Oct. 2002), 767--782.Google ScholarCross Ref
Laton Vermette, Parmit Chilana, Michael Terry, Adam Fourney, Ben Lafreniere, and Travis Kerr. 2015. CheatSheet: A Contextual Interactive Memory Aid for Web Applications. In Proceedings of the 41st Graphics Interface Conference (GI '15). Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 241--248. http://dl.acm.org/citation. cfm?id=2788890.2788933 event-place: Halifax, Nova Scotia, Canada.Google ScholarDigital Library
Michela Del Vicario, Alessandro Bessi, Fabiana Zollo, Fabio Petroni, Antonio Scala, Guido Caldarelli, H. Eugene Stanley, and Walter Quattrociocchi. 2016. The spreading of misinformation online. Proceedings of the National Academy of Sciences 113, 3 (Jan. 2016), 554--559. https://doi.org/10.1073/pnas.1517441113 Publisher: National Academy of Sciences Section: Physical Sciences.Google ScholarCross Ref
Fernanda B. Viégas, Martin Wattenberg, and Kushal Dave. 2004. Studying cooperation and conflict between authors with . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). Association for Computing Machinery, Vienna, Austria, 575--582. https://doi.org/10.1145/985692.985765Google ScholarDigital Library
Fernanda B. Viégas, Martin Wattenberg, and Matthew M. McKeon. 2007. The Hidden Order of Wikipedia. In Online Communities and Social Computing (Lecture Notes in Computer Science), Douglas Schuler (Ed.). Springer, Berlin, Heidelberg, 445--454. https://doi.org/10.1007/978--3--540--73257-0_49Google ScholarCross Ref
Ye Diana Wang and Henry H. Emurian. 2005. An overview of online trust: Concepts, elements, and implications. Computers in Human Behavior 21, 1 (Jan. 2005), 105--125. https://doi.org/10.1016/j.chb.2003.11.008Google ScholarCross Ref
Sharon Watson and Kelly Hewett. 2006. A Multi-Theoretical Model of Knowledge Transfer in Organizations: Determinants of Knowledge Contribution and Knowledge Reuse*. Journal of Management Studies 43, 2 (2006), 141-- 173. https://doi.org/10.1111/j.1467--6486.2006.00586.x _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/j.1467- 6486.2006.00586.x.Google ScholarCross Ref
Zhen Yue, Shuguang Han, and Daqing He. 2012. An investigation of search processes in collaborative exploratory web search. Proceedings of the American Society for Information Science and Technology 49, 1 (2012), 1--4. https: //doi.org/10.1002/meet.14504901386Google ScholarCross Ref
Honglei Zeng, Maher A. Alhossaini, Li Ding, Richard Fikes, and Deborah L. McGuinness. 2006. Computing trust from revision history. In Proceedings of the 2006 International Conference on Privacy, Security and Trust: Bridge the Gap Between PST Technologies and Business Services (PST '06). Association for Computing Machinery, Markham, Ontario, Canada, 1. https://doi.org/10.1145/1501434.1501445Google ScholarDigital Library
Honglei Zeng, Maher A. Alhossaini, Richard Fikes, and Deborah L. McGuinness. 2006. Mining Revision History to Assess Trustworthiness of Article Fragments. In 2006 International Conference on Collaborative Computing: Networking, Applications and Worksharing. 1--10. https://doi.org/10.1109/COLCOM.2006.361890Google ScholarCross Ref
Amy X. Zhang and Justin Cranshaw. 2018. Making Sense of Group Chat Through Collaborative Tagging and Summarization. Proc. ACM Hum.-Comput. Interact. 2, CSCW (Nov. 2018), 196:1--196:27. https://doi.org/10.1145/3274465Google ScholarDigital Library
Amy X. Zhang, Lea Verou, and David Karger. 2017. Wikum: Bridging Discussion Forums and Wikis Using Recursive Summarization. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 2082--2096. https://doi.org/10.1145/2998181.2998235Google ScholarDigital Library
Jian Zhao, Michael Glueck, Petra Isenberg, Fanny Chevalier, and Azam Khan. 2018. Supporting Handoff in Asynchronous Collaborative Sensemaking Using Knowledge-Transfer Graphs. IEEE Transactions on Visualization and Computer Graphics 24, 1 (Jan. 2018), 340--350. https://doi.org/10.1109/TVCG.2017.2745279 Conference Name: IEEE Transactions on Visualization and Computer GraphicsGoogle ScholarCross Ref

Index Terms

To Reuse or Not To Reuse?: A Framework and System for Evaluating Summarized Knowledge

Recommendations

Knowledge reuse through electronic repositories: A study in the context of customer service support

Organizations are implementing electronic repository systems to facilitate knowledge reuse but with varying degrees of success. There is a lack of understanding of how individual and technical factors interact in determining knowledge reuse and the ...
Read More
Viewpoint-centred reuse: bridging the gap between reusability and the needs of the reuser

The "Reuse without Reusers" SyndromeThe problems of low productivity, late delivery and poor software quality are, unfortunately, characteristic of the software industry (Horowitz and Munson 1989). Increasingly, software developers are looking towards ...
Read More
Toward a Theory of Knowledge Reuse: Types of Knowledge Reuse Situations and Factors in Reuse Success

This paper represents a step toward a theory of knowledge reusability with emphasis on knowledge management systems and repositories, often called organizational memory systems. Synthesis of evidence from a wide variety of sources suggests four distinct ...
Read More

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Published in
Proceedings of the ACM on Human-Computer Interaction Volume 5, Issue CSCW1
CSCW
April 2021
5016 pages
EISSN:2573-0142
DOI:10.1145/3460939
Editor:
Jeff Nichols
Apple Inc., United States
Issue’s Table of Contents
Copyright © 2021 Owner/Author
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
- Published: 22 April 2021
Published in pacmhci Volume 5, Issue CSCW1

Check for updates
Badges
- Best Paper
Author Tags
decision making
developer tools
knowledge reuse
sensemaking
Qualifiers
- research-article
Conference
Funding Sources
Other Metrics
View Article Metrics

Article Metrics
- 65
  Total Citations
  View Citations
- 944
  Total Downloads
- Downloads (Last 12 months)261
- Downloads (Last 6 weeks)51
Other Metrics
View Author Metrics
Cited By
View all

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

To Reuse or Not To Reuse?: A Framework and System for Evaluating Summarized Knowledge

Proceedings of the ACM on Human-Computer Interaction

Abstract

References

Cited By

Index Terms

Recommendations

Knowledge reuse through electronic repositories: A study in the context of customer service support

Viewpoint-centred reuse: bridging the gap between reusability and the needs of the reuser

Toward a Theory of Knowledge Reuse: Types of Knowledge Reuse Situations and Factors in Reuse Success