Emelie Engström
Robert Feldt
Richard Torkar
ABSTRACT
Background: There is a need for efficient regression testing in most software development organizations. Often the proposed solutions involve automation. However, despite this being a well researched area, research results are rarely applied in industrial practice. Aim: In this paper we aim to bridge the gap between research and practice by providing examples of how evidence-based regression testing approaches can be adopted in industry. We also discuss challenges for the research community. Method: An industrial case study was carried out to evaluate the possibility to improve regression testing at Sony Ericsson Mobile Communications. We analyse the procedure undertaken based on frameworks from the evidence based software engineering, EBSE, paradigm (with a focus on the evidence) and automation literature (with a focus on the practical effects). Results: Our results pinpoint the need for systematic approaches when introducing a new tool. Practitioners and researchers need congruent guidelines supporting the appraisal of both the evidence base and the pragmatic effects, both direct but also indirect, of the changes. This is illustrated by the introduction of the automation perspective.
- M. Borg. Findability through traceability - a realistic application of candidate trace links? In 7th International Conference on Evaluation of Novel Approaches to Software Engineering, ENASE 2012, pages 173--181, June 2012.Google Scholar
- P. Clements and L. Northrop. Software Product Lines: Practices and Patterns. Addison-Wesley, Boston, 2001. Google ScholarDigital Library
- T. Dybå, B. A. Kitchenham, and M. Jorgensen. Evidence-based software engineering for practitioners. IEEE Software, 22(1):58 -- 65, Jan. 2005. Google ScholarDigital Library
- E. Engström and P. Runeson. A qualitative survey of regression testing practices. In M. Ali Babar, M. Vierimaa, and M. Oivo, editors, Product-Focused Software Process Improvement, volume 6156 of Lecture Notes in Computer Science, pages 3--16. Springer Berlin / Heidelberg, 2010. Google ScholarDigital Library
- E. Engström and P. Runeson. Test overlay in an emerging software product line -- an industrial case study. Information and Software Technology, 2012.Google Scholar
- E. Engström, P. Runeson, and A. Ljung. Improving regression testing transparency and efficiency with history based prioritization -- an industrial case study. In Proceedings of the 4th International Conference on Software Testing Verification and Validation. IEEE Computer Society, 2011. Google ScholarDigital Library
- E. Engström, P. Runeson, and M. Skoglund. A systematic review on regression test selection techniques. Information and Software Technology, 52(1):14--30, Jan. 2010. Google ScholarDigital Library
- Y. Fazlalizadeh, A. Khalilian, M. A. Azgomi, and S. Parsa. Prioritizing test cases for resource constraint environments using historical test case performance data. In Computer Science and Information Technology, 2009. ICCSIT 2009. 2nd IEEE International Conference on, pages 190--195, Aug. 2009.Google ScholarCross Ref
- M. Fewster and D. Graham. Software Test Automation. Addison-Wesley Professional, Sept. 1999.Google Scholar
- S. Mujtaba, R. Feldt, and K. Petersen. Waste and lead time reduction in a software product customization process with value stream maps. In Software Engineering Conference (ASWEC), 2010 21st Australian, pages 139--148. IEEE, 2010. Google ScholarDigital Library
- R. Parasuraman, T. B. Sheridan, and C. D. Wickens. A model for types and levels of human interaction with automation. Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on, 30(3):286--297, May 2000. Google ScholarDigital Library
- K. Petersen and C. Wohlin. Context in industrial software engineering research. In 3rd International Symposium on Empirical Software Engineering and Measurement, 2009. ESEM 2009, ESEM '09, pages 401--404, Washington, DC, USA, Oct. 2009. IEEE. Google ScholarDigital Library
- A. Rainer and S. Beecham. A follow-up empirical evaluation of evidence based software engineering by undergraduate students. In 12th International Conference on Evaluation and Assessment in Software Engineering, University of Bari, Italy, 2008. Google ScholarDigital Library
- A. Rainer, T. Hall, and N. Baddoo. A preliminary empirical investigation of the use of evidence based software engineering by under-graduate students. https://uhra.herts.ac.uk/dspace/handle/2299/2270, 2006. Google ScholarDigital Library
- G. Rothermel and M. J. Harrold. Analyzing regression test selection techniques. IEEE Transactions on Software Engineering, 22(8):529--551, Aug. 1996. Google ScholarDigital Library
- G. Rothermel, R. H. Untch, C. Chengyun, and M. J. Harrold. Test case prioritization: an empirical study. In Proceedings IEEE International Conference on Software Maintenance, pages 179--188, 1999. Google ScholarDigital Library
- T. B. Sheridan and W. L. Verplank. Human and computer control of undersea teleoperators. Technical report, July 1978.Google Scholar
- D. Talby, A. Keren, O. Hazzan, and Y. Dubinsky. Agile software testing in a large-scale project. Software, IEEE, 23(4):30--37, 2006. Google ScholarDigital Library
- S. Yoo and M. Harman. Regression testing minimization, selection and prioritization: a survey. Software Testing, Verification and Reliability, 22(2):67--120, Mar. 2012. Google ScholarCross Ref
Index Terms
- Indirect effects in evidential assessment: a case study on regression test technology adoption
Recommendations
Revisiting group-based technology adoption as a dynamic process: the role of changing attitude-rationale configurations
In this study, we set out to better understand the dynamics behind group-based technology adoption by investigating the underlying mechanisms of changes in collective adoption decisions over time. Using a longitudinal multi-case study of production ...
Predicting e-readiness at firm-level: An analysis of technological, organizational and environmental (TOE) effects on e-maintenance readiness in manufacturing firms
This study predicts the impact of technological, organizational and environmental (TOE) determinants on e-maintenance technology readiness in manufacturing firms. Survey responses of 308 managers from a wide spectrum of manufacturing firms have been ...
Antecedents and Effects of Green IS Adoptions: Insights from Nordea
This article develops an empirically grounded model of antecedents and effects of green information systems IS initiatives. The model is empirically based on an in-depth case of the Nordic financial institution. The authors' study examines the effect of ...
Comments