Abstract
Mutation testing is an effective technique for assessing a quality of test sets for software systems, but it suffers from high computational costs of generating and executing a large number of mutants. In the domain of BPEL processes each mutant needs to be deployed before it can be executed, thus the cost of processing mutants increases further. In contrast to mutation testing, fault injection is able to inject faults directly into the original process what reduces the redeployment requirement. The paper presents an experiment of the application of software fault injection to assess quality of test sets for BPEL processes. Faults are introduced by a Software Fault Injector for BPEL Processes (SFIBP). SFIBP simulates effects of the faults by modifying invocations of web-services and their internal variables. The experiment proved high superiority of the application of the SFIBP over the mutation testing, especially in the case of time requirements.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
OASIS, Web Services Business Process Execution Language 2.0, Organization for the Advancement of Structured Information Standards (2007), http://docs.oasis-open.org/wsbpel/2.0/OS/wsbpel-v2.0-OS.html
Offutt, A.J., Untch, R.H.: Mutation testing for the new century. In: Mutation, Uniting the Orthogonal, pp. 34–44. Kluwer Academic Publishers, Norwell (2001)
Woodward, M.R.: Mutation testing — its origin and evolution. Information and Software Technology 35(3), 163–169 (1993)
Strug, J., Strug, B.: Machine Learning Approach in Mutation Testing. In: Nielsen, B., Weise, C. (eds.) ICTSS 2012. LNCS, vol. 7641, pp. 200–214. Springer, Heidelberg (2012)
Grela, D., Sapiecha, K., Strug, J.: An application of software fault injection for assessment of quality of test sets for business processes orchestrating web-services. In: Proceedings of the 8th International Conference On Evaluation of Novel Approaches to Software Engineering (ENASE 2013), Angers, France, pp. 56–62 (2013)
Hsueh, M.C., Tsai, T.K., Iyer, R.K.: Fault Injection Techniques and Tools. IEEE Computer 30(4), 75–82 (1997)
Dong, W.-L., Yu, H., Zhang, Y.-B.: Testing BPEL-based web service composition using high-level Petri nets. In: EDOC 2006: Tenth IEEE International Enterprise Distributed Object Computing Conference, Hong Kong, China (2006)
Yan, J., Li, Z., Yuan, Y., Sun, W., Zhang, J.: BPEL4WS unit testing: Test case generation using a concurrent path analysis approach. In: ISSRE 2006: 17th International Symposium on Software Reliability Engineering, Raleigh, North Carolina, USA, pp. 75–84 (2006)
Yuan, Y., Li, Z., Sun, W.: A graph-search based approach to BPEL4WS test generation. In: ICSEA 2006: International Conference on Software Engineering Advances, Papeete, Tahiti, French Polynesia, p. 14 (2006)
Sapiecha, K., Grela, D.: Test scenarios generation for certain class of processes defined in BPEL language. In: Annales UMCS - Informatica, vol. 8(2), pp. 75–87 (2008)
Sapiecha, K., Grela, D.: Automating test case generation for requirements specification for processes orchestrating web services. In: Information Systems Analysis and Specification, Barcelona, Spain. 10th International Conference on Enterprise Information Systems (ICEIS), vol. 1, pp. 381–384 (2008)
Wagner, S., Gericke, J., Wiemann, M.: Multi-Dimensional Measures for Test Case Quality. In: IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2008 (2008)
Farooq, U., Lam, C.P.: Evolving the Quality of a Model Based Test Suite. In: International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2009 (2009)
Estero-Botaro, A., Palomo-Lozano, F., Medina-Bulo, I.: Mutation operators for WS-BPEL 2.0. In: ICSSEA 2008: 21th International Conference on Software & Systems Engineering and their Applications, Paris, France (2008)
Reinecke, P., Wolter, K.: Towards a multi-level fault injection test-bed for service-oriented architectures - requirements for parameterisations. In: 27th International Symposium on Reliable Distributed Systems, Napoli, Italy (2008)
Juszczyk, L., Dustdar, S.: Programmable fault injection test-beds for complex SOA. In: Maglio, P.P., Weske, M., Yang, J., Fantinato, M. (eds.) ICSOC 2010. LNCS, vol. 6470, pp. 411–425. Springer, Heidelberg (2010)
MuBPEL - WS-BPEL Testing Tools, http://neptuno.uca.es/redmine/projects/sources-fm/wiki/MuBPEL
Mayer, P., Lubke, D.: Towards a BPEL unit testing framework. In: Proceedings of the workshop on Testing, analysis and verification of web services and applications, TAV-WEB 2006, pp. 33–42. ACM, New York (2006)
University of Cadiz WS-BPEL Composition Repository, http://neptuno.uca.es/redmine/projects/wsbpel-comp-repo
Benso, A., Prinetto, P.: Fault injection techniques and tools for embedded systems reliability evaluation. Kluwer Academic Publishers, Holland (2003)
Durães, J., Madeira, H.: Software Faults - A field data Study and a practical approach. Trans. of Software Engineering (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Grela, D., Sapiecha, K., Strug, J. (2013). A Fault Injection Based Approach to Assessment of Quality of Test Sets for BPEL Processes. In: Filipe, J., Maciaszek, L.A. (eds) Evaluation of Novel Approaches to Software Engineering. ENASE 2013. Communications in Computer and Information Science, vol 417. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-54092-9_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-54092-9_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-54091-2
Online ISBN: 978-3-642-54092-9
eBook Packages: Computer ScienceComputer Science (R0)