Skip to main content
SpringerLink
Log in

Are web applications more defect-prone than desktop applications?

  • WSE 2009
  • Published:
International Journal on Software Tools for Technology Transfer Aims and scope Submit manuscript

Abstract

A lot of effort in the literature has been devoted to define and validate fault taxonomies and models related to different domains, e.g. Service-oriented and Web systems, and properties, e.g. software quality and security. Nevertheless, few attempts were carried out to understand the specific nature of Web bugs and their distribution among the layers of a typical application’s architecture—presentation layer, business logic and data logic. In this paper, we present an experimental investigation aimed at studying the distribution of bugs among different layers of Web and Desktop applications. The experiment follows a well-defined procedure executed by six bachelor students. Overall, the analysis considers 1,472 bugs belonging to 20 different applications. The experimental study provides strong evidence that the presentation layer in Web applications is more defect-prone than the analogous layer in Desktop applications. An additional factor influencing the distribution of defects is represented by the application domain.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Andrews A., Offutt J., Alexander R.: Testing Web applications by modeling with FSMs. Softw. Syst. Model. 4(3), 326–345 (2005)

    Article  Google Scholar 

  2. Arisholm, E., Briand, L.C., Fuglerud, M.: Data mining techniques for building fault-proneness models in telecom java software. In: In IEEE International Symposium on Software Reliability (ISSRE), pp. 215–224 (2007)

  3. Artho, C., Biere, A., Honiden, S.: Enforcer-efficient failure injection. In: Formal Methods (FM), pp. 412–427 (2006)

  4. Artzi, S., Kiezun, A., Dolby, J., Tip, F., Dig, D., Paradkar, A., Ernst, M.D.: Finding bugs in web applications using dynamic test generation and explicit state model checking. In: IEEE Transaction on Software Engineering (2010, preprint)

  5. Baresi, L., Garzotto, F., Paolini, P.: From web sites to web applications: new issues for conceptual modeling. In: Workshops on Conceptual Modeling Approaches for E-Business and The World Wide Web and Conceptual Modeling: Conceptual Modeling for E-Business and the Web, pp. 89–100 (2000)

  6. Basili V.R., Selby R.W.: Comparing the effectiveness of software testing strategies. IEEE Trans. Softw. Eng. 13(12), 1278–1296 (1987)

    Article  Google Scholar 

  7. Becker S.A., Berkemeyer A.: Rapid application design and testing of web usability. IEEE MultiMed. 9(4), 38–46 (2002)

    Article  Google Scholar 

  8. Bellini, P., Bruno, I., Nesi, P., Rogai, D.: Comparing fault-proneness estimation models. In: In International Conference on Engineering of Complex Computer Systems (ICECCS), pp. 205–214 (2005)

  9. Briand L., Wuest J.: Empirical studies of quality models in object-oriented systems. Adv. Comput. 59, 97–166 (2002)

    Article  Google Scholar 

  10. Cataldo M., Mockus A., Roberts J., Herbsleb J.: Software dependencies, work dependencies and their impact on failures. IEEE Trans. Softw. Eng. 35(6), 864–878 (2009)

    Article  Google Scholar 

  11. Cohen J.: Statistical Power Analysis for the Behavioral Sciences, 2nd edn. Lawrence Earlbaum Associates, Hillsdale (1988)

    MATH  Google Scholar 

  12. Deshpande Y., Murgesan S., Ginige A., Hansen S., Schwabe D., Gaedke M., White B.: Web engineering. J. Web Eng. (JWE) 1(1), 3–17 (2002)

    Google Scholar 

  13. Di Lucca G., Fasolino A.R.: Testing web-based applications: the state of the art and future trends. Inform. Softw. Technol. 48(12), 1172–1186 (2006)

    Article  Google Scholar 

  14. Di Lucca, G.A., Di Penta, M.: Considering browser interaction in web application testing. In: In International Workshop on Web Site Evolution (WSE), pp. 74–84. IEEE Computer Society (2003)

  15. Di Lucca, G.A., Fasolino, A.R., Faralli, F., De Carlini, U.: Testing Web applications. In: Proceedings of the International Conference on Software Maintenance (ICSM), pp. 310–319. IEEE Computer Society, Montreal, Canada (2002)

  16. Draheim, D., Grundy, J., Hosking, J.: Realistic load testing of web applications. In: Conference on Software Maintenance and Reengineering (CSMR), pp. 57–70 (2006)

  17. Ecott, S., Sprenkle, S., Pollock, L.: Fault seeding vs. mutation operators: an empirical comparison of testing techniques for web applications. In: Grace Hopper Celebration of Women in Computing (2006)

  18. El Emam K., Benlarbi S., Goel N., Rai S.: The confounding effect of class size on the validity of object-oriented metrics. IEEE Trans. Softw. Eng. 27(7), 630–650 (2001)

    Article  Google Scholar 

  19. Elbaum, S., Karre, S., Rothermel, G.: Improving Web application testing with user session data. In: International Conference on Software Engineering (ICSE), pp. 49–59. IEEE Computer Society, Portland, USA (2003)

  20. Eldh, S., Hansson, H., Punnekka, S., Pettersson, A., Sundmark D.: A framework for comparing efficiency, effectiveness and applicability of software testing techniques. In: Testing: Academic & Industrial Conference: Practice And Research Techniques (TAIC PART), pp. 159–170. IEEE Computer Society (2006)

  21. Giang, L.T., Kang, D., Bae, D.-H.: Software fault prediction models for web applications (compsac). In: Annual IEEE Computer Software and Applications (2010)

  22. Guo, Y., Sampath, S.: Web application fault classification: an exploratory study. In: Empirical Software Engineering and Measurement (ESEM), pp. 303–305 (2008)

  23. Gyimóthy T., Ferenc R., Siket I.: Empirical validation of object-oriented metrics on open source software for fault prediction. IEEE Trans. Softw. Eng. 31(10), 897–910 (2005)

    Article  Google Scholar 

  24. Gyimothy T., Ferenc R., Siket I.: Empirical validation of object-oriented metrics on open source software for fault prediction. IEEE Trans. Softw. Eng. 31(10), 897–910 (2005)

    Article  Google Scholar 

  25. Harrold M.J., Offutt A.J., Tewary K.: An approach to fault modeling and fault seeding using the program dependence graph. J. Syst. Softw. 36(3), 273–295 (1997)

    Article  Google Scholar 

  26. Hartikainen, J.: Is web application development less challenging than desktop application development? Utopia (2008, published on-line on code)

  27. Hieatt E., Mee R., Faster G.: Testing the web application engineering internet. IEEE Softw. 19(2), 60–65 (2002)

    Article  Google Scholar 

  28. Karre S., Elbaum S., Rothermel G., Fisher M. II: Leveraging user session data to support web application testing. IEEE Trans. Softw. Eng. 31(3), 187–202 (2005)

    Article  Google Scholar 

  29. Koru A., El Emam K.: Theory of relative dependency: higher coupling concentration in smaller modules. IEEE Softw. 27(2), 81–89 (2010)

    Article  Google Scholar 

  30. Koru, A., Zhang, D., Liu, H.: Modeling the effect of size on defect proneness for open-source software. In: International Workshop on Predictor Models in Software Engineering (PROMISE), pp. 1–10 (2007)

  31. Larson, J.: Testing Ajax Applications with Selenium. InfoQ Magazine (2006)

  32. Li, L., Leung, H.: Using the number of faults to improve fault-proneness prediction of the probability models. In: World Congress on Computer Science and Information Engineering, pp. 722–726, March (2009)

  33. Liu C.-H., Kung D.C., Hsia P., Hsu C.-T.: An object-based data flow testing approach for web applications. Int. J. Softw. Eng. Knowl. Eng. 11(2), 157–179 (2001)

    Article  Google Scholar 

  34. Livshits, V.B., Lam, M.S.L.: Finding security vulnerabilities in java applications with static analysis. In: Conference on USENIX Security Symposium, pp. 18–28, Bari, Italy (2005)

  35. Marchetto A., Ricca F., Tonella P.: An empirical validation of a web fault taxonomy and its usage for web testing. Int. J. Web Eng. 8(4), 316–345 (2009)

    Google Scholar 

  36. Marchetto, A., Tonella, P., Ricca, F.: Empirical validation of a web fault taxonomy and its usage for fault seeding. In: IEEE International Symposium on Web Site Evolution (WSE). IEEE Computer Society, Paris, France, pp. 31–38, October (2007)

  37. Marchetto A., Tonella P., Ricca F.: A case study-based comparison of web testing techniques applied to ajax web applications. Int. J. Softw. Tools Technol. Transf. (STTT) 10(6), 477–492 (2008)

    Article  Google Scholar 

  38. Marchetto, A., Tonella, P., Ricca, F.: State-based testing of ajax web applications. In: International Conference on Software Testing Verification and Validation (ICST). IEEE Computer Society, Lillehammer, Norway, pp. 121–130, April (2008)

  39. Marchetto, A., Trentini, A.: Evaluating web applications testability by combining metrics and analogies. In: International Conference on Information and Communications Technology (ITI), pp. 751–779, December (2005)

  40. Mesbah, A., van Deursen, A.: Migrating multi-page web applications to single-page ajax interfaces. In: European Conference on Software Maintenance and Reengineering (CSMR). IEEE Computer Society, pp. 181–190 (2007)

  41. Mesbah, A., van Deursen, A.: Invariant-based automatic testing of ajax user interfaces. In: 31st International Conference on Software Engineering (ICSE). IEEE Computer Society, pp. 210–220, May (2009)

  42. Olague H., Etzkorn L., Gholston S., Quattlebaum S.: Empirical validation of three software metrics suites to predict fault-proneness of object-oriented classes developed using highly iterative or agile software development processes. IEEE Trans. Softw. Eng. 33(6), 402–419 (2007)

    Article  Google Scholar 

  43. Pai G., Dugan J.: Empirical analysis of software fault content and fault proneness using bayesian methods. IEEE Trans. Softw. Eng. 33(10), 675–686 (2007)

    Article  Google Scholar 

  44. Ricca, F., Tonella, P.: Analysis and testing of Web applications. In: International Conference on Software Engineering (ICSE), Canada, pp. 25–34, May (2001)

  45. Ricca F., Tonella P.: Testing processes of web applications. Ann. Softw. Eng. 14, 93–114 (2002)

    Article  MATH  Google Scholar 

  46. Selvarani, R., Nair, T., Prasad, V.: Estimation of defect proneness using design complexity measurements in object-oriented software. In: International Conference on Signal Processing Systems, pp. 766–770 (2009)

  47. Shaffer J.P.: Multiple hypothesis testing. Ann. Rev. Psych. 46, 561–584 (1995)

    Article  Google Scholar 

  48. Sheskin D.: Handbook of parametric and nonparametric statistical procedures, 4th edn. Chapman & All, London (2007)

    MATH  Google Scholar 

  49. Sprenkle, S., Gibson, E., Sampath, S., Pollock, L.: Automated replay and failure detection for web applications. In: IEEE international conference on Automated software engineering (ASE). IEEE Computer Society, pp. 253–262 (2005)

  50. Tal, O., Knight, S., Dean, T.: Syntax-based vulnerability testing of frame-based network protocols. In: Privacy, Security and Trust 2004 Fredericton, pp. 155–160 (2004)

  51. Torchiano, M., Ricca, F., Marchetto, A.: Defect location in traditional vs. web applications: an empirical investigation. In: IEEE International Symposium on Web Systems Evolution (WSE). IEEE Computer Society, Edmonton, Canada, pp. 121–129 (2009)

  52. Wassermann, G., Yu, D., Chander, A., Dhurjati, D., Inamura, H., Su, Z.: Dynamic test input generation for web applications. In: International Symposium on software testing (ISSTA), pp. 249–260 (2008)

  53. White S.A.: BPMN Modeling and Reference Guide. Future Strategies Inc., Lighthouse Pt (2008)

    Google Scholar 

  54. Wohlin C., Runeson P., Höst M., Ohlsson M., Regnell B., Wesslén A.: Experimentation in Software Engineering: An Introduction. Kluwer Academic Publishers, Norwell (2000)

    MATH  Google Scholar 

  55. Zammetti, F.: Practical Ajax Projects with Java Technology. ApressCorporate (2006)

  56. Ziemer, S.: The use of trade-offs in the development of web applications. In: ICWE Workshops 2004, pp. 249–281 (2004)

Download references

Author information

Authors and Affiliations

  1. Politecnico di Torino, Turin, Italy

    Marco Torchiano

  2. DISI, Università di Genova, Genoa, Italy

    Filippo Ricca

  3. Fondazione Bruno Kessler–IRST, Trento, Italy

    Alessandro Marchetto

Authors
  1. Marco Torchiano
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Filippo Ricca
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Alessandro Marchetto
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alessandro Marchetto.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Torchiano, M., Ricca, F. & Marchetto, A. Are web applications more defect-prone than desktop applications?. Int J Softw Tools Technol Transfer 13, 151–166 (2011). https://doi.org/10.1007/s10009-010-0182-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10009-010-0182-6

Keywords

Search

Navigation