Nor Shahida Mohamad Yusop
John Grundy
Rajesh Vasa
ABSTRACT
Capturing good quality defect reports is critical for ensuring quick resolution of defects. While a range of studies into defect reporting exists, to date, very few focused on usability defect reporting issues can be found. To better understand issues specific to usability defect reporting, we carried out a survey of 56 contributors to the Mozilla and Google Chromium software projects spanning both usability defect reporters and developers. We discovered a range of limitations and key issues in current usability defect reporting tools and approaches identified as important by reporters and developers. In addition, we highlight opportunities to improve defect-reporting tools based on these open source communities' needs.
- M. B. Twidale, D. M. Nichols, and N. Zealand, "Exploring Usability Discussions in Open Source Development," in Proceedings of the 38th Annual Hawaii Internatioal Conference on System Sciences, 2005, pp. 1--10. Google Scholar
Digital Library
- M. G. Capra, "Usability Problem Description and the Evaluator Effect in Usability Testing,". PhD Thesis. Viginia Tech, Blacksburg, VA, 2006. Google ScholarDigital Library
- S. L. Keenan, H. R. Hartson, dennis G. Kafura, and R. S. Schulman, "The Usability Problem Taxonomy : A Framework for Classification and Analysis," Empir. Softw. Eng., vol. 4, pp. 71--104, 1999. Google ScholarDigital Library
- T. S. Andre, S. M. Belz, F. a. McCrearys, and H. R. Hartson, "Testing a Framework for Reliable Classification of Usability Problems," in Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2000, vol. 44, no. 37, pp. 573--576.Google ScholarCross Ref
- N. Bettenburg, C. Weiß, S. Just, and A. Schröter, "Quality of Bug Reports in Eclipse," in Proceedings of the 2007 OOPSLA workshop on eclipse technology eXchange, 2007, pp. 21--25. Google ScholarDigital Library
- T. Zimmermann, R. Premraj, N. Bettenburg, C. Weiss, S. Just, and A. Schro, "What Makes a Good Bug Report?," IEEE Trans. Softw. Eng., vol. 36, no. 5, pp. 618--643, 2010. Google ScholarDigital Library
- E. I. Laukkanen and M. V. Mantyla, "Survey Reproduction of Defect Reporting in Industrial Software Development," 2011 Int. Symp. Empir. Softw. Eng. Meas., pp. 197--206, Sep. 2011. Google ScholarDigital Library
- F. P. Simões, "Supporting End User Reporting of HCI Issues in Open Source Software,". PhD Thesis. Pontificia Universidade Catolica, Do Rio De Janeiro, 2013.Google Scholar
- P. Schugerl, J. Rilling, and P. Charland, "Mining Bug Repositories--A Quality Assessment," 2008 Int. Conf. Comput. Intell. Model. Control Autom., pp. 1105--1110, 2008. Google ScholarDigital Library
- D. M. Nichols and M. B. Twidale, "Usability processes in open source projects," Softw. Process Improv. Pract., vol. 11, no. 2, pp. 149--162, Mar. 2006.Google ScholarCross Ref
- L. Zhao and F. P. Deek, "Improving Open Source Software Usability," in Proceeedings of the Eleventh Americas Conference on Information Systems, 2005.Google Scholar
- G. Guest, K. MacQueen, and E. Namey, Introduction to applied thematic analysis. London, UK: Sage, 2012, pp. 3--20.Google Scholar
- S. Zaman, B. Adams, and A. E. Hassan, "Security Versus Performance Bugs : A Case Study on Firefox," in Proceedings of the 8th Working Conference on Mining Software Repositories, 2011. Google ScholarDigital Library
- S. Herbold, J. Grabowski, S. Waack, and U. Bünting, "Improved Bug Reporting and Reproduction through Non-intrusive GUI Usage Monitoring and Automated Replaying," 2011 IEEE Fourth Int. Conf. Softw. Testing, Verif. Valid. Work., pp. 232--241, Mar. 2011. Google ScholarDigital Library
- D. M. Nichols, D. Mckay, N. Zealand, and M. B. Twidale, "Participatory Usability : supporting proactive users," in Proceedings of the 4th Annual Conference of the ACM Special Interest Group on Computer-Human Interaction, 2003, pp. 63--68. Google ScholarDigital Library
- S. G. Vilbergsdottir, E. T. Hvannberg, and E. L. C. Law, "Assessing the reliability, validity and acceptance of a classification scheme of usability problems (CUP)," J. Syst. Softw., vol. 87, pp. 18--37, 2014. Google ScholarDigital Library
- http://opinio.online.swin.edu.au/admin/folder.doGoogle Scholar
- https://developer.mozilla.org/en-US/docs/Mozilla/QA/Bug_writing_guidelinesGoogle Scholar
Index Terms
- Reporting Usability Defects: Limitations of Open Source Defect Repositories and Suggestions for Improvement
Recommendations
Understanding Usability Defect Reporting in Software Defect Repositories
ASWEC ' 15 Vol. II: Proceedings of the ASWEC 2015 24th Australasian Software Engineering ConferenceSoftware defect management is a critical component of good software engineering practice. The information reported about a defect is a key element to ensure defects are rectified effectively. However, based on research, reporting usability defects using ...
Reporting usability defects: do reporters report what software developers need?
EASE '16: Proceedings of the 20th International Conference on Evaluation and Assessment in Software EngineeringReporting usability defects can be a challenging task, especially in convincing the software developers that the reported defect actually requires attention. Stronger evidence in the form of specific details is often needed. However, research to date in ...
A revised open source usability defect classification taxonomy
Abstract Context: Reporting usability defects is a critical part of improving software. Accurately classifying these reported usability defects is critical for reporting, understanding, triaging, prioritizing and ultimately fixing ...
Comments