Abstract
Functional testing of web applications has become increasingly complex. Browser-based interfaces incorporate rich, client-side scripting that is increasingly independent of server-side application logic. At the same time, the server side application logic interacts with reusable components for key elements (security, shopping cart, product catalog, order processing) within the framework of a component-based architecture, using beans and web services. In this paper, we illustrate how a test specification approach using a language like TTCN-3 can be used to define test cases at different levels of abstraction that are more robust in the face of volatile presentation and implementation details. A case study of a shopping cart scenario with order processing is used as an illustration. Features of TTCN-3 are demonstrated, including a powerful matching mechanism that allows a separation between behavior and the conditions governing behavior. As well, TTCN-3’s data types and set-based operations allow one to track and verify the information management done by a web application, independent of implementation details. These features allow a tester to take a systematic approach to testing web applications but requires more sophistication and skills. The advantages and challenges of a test specification approach are characterized in comparison to approaches based on unit testing and test automation tools.
Similar content being viewed by others
References
Amyot D., Roy J.-F., Weiss M.: UCM-driven testing of web applications. In: 12th SDL Forum Grimstad, Norway, June 2005 in Computer Science 3530, pp. 247–264. Springer, Heidelberg (2005)
Bertolino, A., Frantzen, L., Polini, A., Tretmans, J.: Audition of web services for testing conformance to open specified protocols. In: Reussner, R., Stafford, J., Szyperski, C.(eds) Architecting Systems with Trustworthy Components, Number 3938 in LNCS, Springer-Verlag, Heidelberg (2006)
Craggs, I., Sardis, M., Heuillard, T.: AGEDIS case studies: model-based testing in industry. In: Proceeding of 1st European Conference on Model Driven Software Engineering (Nuremberg, Germany, December 2003), imbus AG, Moehrendorf pp 106–117
Decker, S., Melnik, S., Harmelen, F. , van Fensel, D., Klein, M.C.A., Broekstra, J.: The semantic web: the respective roles of XML and RDF. IEEE Internet Comput. 4(5), 63–74 (2000)
Erl, T.: Service-Oriented Architecture: A field Guide to Integrating XML and Web Services, ISBN 0-13-142898-5. Prentice Hall PTR, New York (2004)
ETSI ES 201 873-1: The Testing and Test Control Notation version 3, Part1: TTCN-3 Core notation, V3.2.1, February 2007
Jia, X., Liu, H.: Rigorous and automatic testing of web applications. In: 6th IASTED International Conference on Software Engineering and Applications, Cambridge, November 2002, pp. 280–285
Mesbah, A., van Deursen, A.: An architectural style for AJAX. In: Proceedings of the 6th Working IEEE/IFIP Conference on Software Architecture (WICSA’07). IEEE Computer Society, Washington, DC (2007)
Probert, R.L., Xiong, P., Stepien, B.: A life-cycle e-commerce testing with OO-TTCN-3. In: FORTE’04 Workshops proceedings, September 2004
Probert, R.L., Stepien, B., Xiong, P.: Formal testing of web content using TTCN-3. In: TTCN-3 User Conference 2005, June 2005
Rankin, C.: The software testing automation framework. IBM Syst. J. Softw. Test. Verif. 41(1) 2002
Singh, I., Stearns, B., Johnson, M.: Designing Enterprise Applications with the J2EE Platform, 2nd edn., ISBN 0201787903. Prentice Hall, New York (2002)
Stepien, B., Schieferdecker, I.: Automated testing of XML/SOAP based web services. In: Proceedings of the 13th Fachkonferenz der Gesellschaft für Informatik (GI) Fachgruppe KiVS, February 2003
Tan, R.P., Edwards, S.H.: Experiences Evaluating the Effectiveness of JML-JUnit Testing, ACM SIGSOFT Software Engineering Notes, Vol. 29, Number 5. ACM, New York (2004)
W3C Working Group, Web Services Architecture Note 11 February 2004. http://www.w3.org/TR/ws-arc. Accessed 28 October 2006
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Stepien, B., Peyton, L. & Xiong, P. Framework testing of web applications using TTCN-3. Int J Softw Tools Technol Transf 10, 371–381 (2008). https://doi.org/10.1007/s10009-008-0082-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10009-008-0082-1