Skip to main content
SpringerLink
Log in

Increasing testing productivity and software quality: A comparison of software testing methodologies within NASA

  • Published:
Empirical Software Engineering Aims and scope Submit manuscript

Abstract

Pressure to compress the development life cycle and reduce the duration and resources committed to testing lead to experimentation in testing at the NASA Goddard Space Flight Centerís Software Engineering Laboratory. This study investigates the trend to reduce developer testing and increasingly rely upon inspection techniques and independent functional testing to shorten the development life cycle, improve testing productivity, and improve software quality.

An approach is developed to conduct this comparison. In particular, the problem faced by software researchers, having a comprehensive characterization of software projects so similar types may be identified for comparative studies, is addressed using expert opinion.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • A comparison of software verification techniques. 1985. Software Engineering Laboratory Series, SEL-85-001, Goddard Space Flight Center, Greenbelt, MD.

  • A study on size and reuse trends in Attitude Ground Support Systems (AGSS) developed for the Flight Dynamics Division (FDD) (1976–1988). 1989. CSC/TM/-89/603.

  • Basili, V., and Hutches, D. 1983. An empirical study of a syntactic complexity family. IEEE Transactions on Software Engineering SE-9 (6): 664–672.

    Google Scholar 

  • Basili, V., Green, S., Kouchakdjiian, A., and Weidow, D. 1990. The Cleanroom case study in the SEL: Project description and early analysis. Software Engineering Laboratory Series SEL-90-002.

  • Currit, P., Dyer, M., and Mills, H. 1986. Certifying the reliability of software. IEEE TSE 12:1.

    Google Scholar 

  • Dyer, M. 1992. The Cleanroom Approach to Quality Software Development. New York: John Wiley and Sons, Inc.

    Google Scholar 

  • Embrey, D. E., Rosa, E. A., Kirwan, B., and Rea, K. 1984. SLIM-MAUD: An approach to assessing human error probabilities using expert judgement. NUREG/CR 3518 Vol I and II.

  • Fagan, M. 1976. Design and code inspections to reduce errors in program development. IBM Systems Journal 15(3).

  • Gilb, T. 1988. Principles of Software Engineering Management. Wokingham, England: Addison-Wesley Publishing Co.

    Google Scholar 

  • Hall, K. 1992. A study of acceptance testing in flight dynamics operation. NASA Goddard Space Flight Center, report 553-FDD-92/090ROUDO.

  • IEEE Glossary of Software Engineering Terminology. 1991. IEEE Std 610.12-90. New York: Institute of Electrical and Electronics Engineers, Inc.

  • IEEE Guide for the Use of IEEE Standard Dictionary of Measures to Produce Reliable Software. 1988. IEEE Std 928.2-1988. Institute of Electrical and Electronics Engineers, Inc., New York.

  • Linger, R., Mills, H., and Witt, B. 1979. Structured Programming: Theory and Practice. New York: Addison-Wesley.

    Google Scholar 

  • McCabe, T. J. 1976. A complexity measure. IEEE Transactions on Software Engineering. December.

  • Manager's Handbook for Software Development. Revision 1. 1990. NASA Goddard Space Flight Center, Software Engineering Laboratory Series, SEL-84-101, November.

  • Myers, G. 1979. The Art of Software Testing. IBM Systems Research Institute, Wiley-Interscience Publication. New York: John Wiley and Sons.

    Google Scholar 

  • Pressman, R. 1992. Software Engineering A Practioner's Approach, 3rd edition. New York: McGraw-Hill, Inc.

    Google Scholar 

  • Recommended Approach to Software Development, Revision 3. 1992. NASA Goddard Space Flight Center, Software Engineering Laboratory Series, SEL-81-305.

  • Software Engineering Laboratory (SEL) study of the system and acceptance test phases for four telemetry simulator projects. 1990. NASA Goddard Space Flight Center, report FDD/552-90/010.

  • Software Engineering Laboratory (SEL) Cleanroom Process Model. 1991. NASA Goddard Space Flight Center, Software Engineering Laboratory Series, SEL-91-004.

  • Proceedings of the Twentieth Annual Software Engineering Workshop. 1995. NASA Goddard Space Flight Center, Software Engineering Laboratory Series, SEL-95-004.

  • Sheppard, M. 1988. A critique of cyclomatic complexity as a software metric. Software Engineering Journal, March.

  • Wertz, J. (ed.) 1978. Spacecraft Attitude Determination and Control, D. Reidel Publishing Co. Dordrecht, Holland.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. NASA Headquarters, Washington, D.C., USA

    Donald W. Sova

  2. University of Maryland, College Park, Maryland, USA

    Carol Smidts

Authors
  1. Donald W. Sova
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Carol Smidts
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sova, D.W., Smidts, C. Increasing testing productivity and software quality: A comparison of software testing methodologies within NASA. Empirical Software Engineering 1, 165–188 (1996). https://doi.org/10.1007/BF00368703

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00368703

Keywords

Search

Navigation