Skip to main content
SpringerLink
Log in

Harmonization of ISO/IEC 9001:2000 and CMMI-DEV: from a theoretical comparison to a real case application

  • Published:
Software Quality Journal Aims and scope Submit manuscript

Abstract

In the past years, both industrial and research communities in Software Engineering have shown special interest in Software Process Improvement—SPI. This is evidenced by the growing number of publications on the topic. The literature offers numerous quality frameworks for addressing SPI practices, which may be classified into two groups: ones that describe “what” should be done (ISO 9001, CMMI) and ones that describe “how” it should be done (Six Sigma, Goal Question Metrics-GQM). When organizations decide to adopt improvement initiatives, many models may be implied, each leveraging the best practices provided, in the quest to address the improvement challenges as well as possible. This may at the same time, however, generate confusion and overlapping activities, as well as extra effort and cost. That, in turn, risks generating a series of inefficiencies and redundancies that end up leading to losses rather than to effective process improvement. Consequently, it is important to move toward a harmonization of quality frameworks, aiming to identify intersections and overlapping parts, as well as to create a multi-model improvement solution. Our aim in this work is twofold: first of all, we propose a theoretical harmonization process that supports organizations interested in introducing quality management and software development practices or concerned about improving those they already have. This is done with specific reference to CMMI-DEV and ISO 9001 models in the direction “ISO to CMMI-DEV”, showing how GQM is used to define operational goals that address ISO 9001 statements, reusable in CMMI appraisals. Secondly, we apply the theoretical comparison process to a real case, i.e., a Small Enterprise certified ISO 9001.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  • Ardimento, P., Baldassarre, M. T., Caivano, D., & Visaggio, G. (2004). Multi view framework for goal oriented measurement plan design. In Proceedings of the 5th international conference on product focused software process improvement (PROFES), Nara, Japan, pp. 159–173.

  • ARMONÍAS. (2009). A process for driving multi-models harmonization, ARMONÍAS project from http://www.alarcos.esi.uclm.es/armonias/.

  • Baldassarre, M. T., Caivano, D., Pino, F., Piattini, M., & Visaggio, G. (2010a). A strategy to harmonize ISO/IEC 9001:2000 and CMMI-DEV. In Proceedings of the 4th international workshop on software quality and maintainability. Madrid, Spain, pp. 65–74.

  • Baldassarre, M. T., Caivano, D., Pino F, Piattini, M., & Visaggio, G. (2010b). A strategy for painless harmonization of quality standards: A real case. In Proceedings of the product-focused software process improvement, 11th international conference. LNCS, Limerick, Ireland.

  • Baldassarre, M. T., & Pino, F. (2010c). Technical report: Armonizzazione dei Modelli di Qualità ISO 9001:2000 e CMMI-DEV v.1.2. http://www.serlab.di.uniba.it/files/HarmonizationISO-CMMI.pdf.

  • Basili, V. R., Caldiera, G., & Rombach, H. D. (1994). Goal question metric paradigm. Encyclopedia of software engineering, Vol. 1 (pp. 528–532). USA: Wiley.

    Google Scholar 

  • Ferchichi, A., Bigand, M. & Lefebvre, H. (2008). An ontology for quality standards integration in software collaborative projects. In Proceedings of the 1st international workshop on model driven interoperability for sustainable information systems, France.

  • Ferreira, A. L., & Machado, R. (2009). Software process improvement in multimodel environments. In Proceedings of the 4th international conference on software engineering advances, pp. 512–517.

  • Ferreira, A. L., Machado, R. J., & Paulk, M. C. (2010). Size and complexity attributes for multi-model improvement framework taxonomy. In Proceedings of the 36th euromicro conference on software engineering and advanced applications, Lille, France, pp. 306–309.

  • Godfrey, S. (2008). What is CMMI? NASA presentation. Available from: http://www.software.gsfc.nasa.gov/docs/What%20is%20CMMI.ppt.

  • Halvorsen, C. P., & Conradi, R. (2001). A taxonomy to compare SPI frameworks. In V. Ambriola (Ed.), Software process technology. Lecture notes in computer science, Vol. 2077 (pp. 217–235). Berlin: Verlag.

    Google Scholar 

  • Hefner, R., & Sturgeon, M. (2002). Optimize your solution: Integrating six sigma and CMM/CMMI-based process improvement. In Proceedings of the software technology conference.

  • Heston, K., & Phifer, W. (2011). The multiple quality models paradox: How much ‘best practice’ is just enough? Journal of Software Maintenance and Evolution: Research and Practice, 23(n/a). doi:10.1002/spip.434.

  • Humphrey, W. S. (2006). TSP(SM): Coaching development teams. Boston: Wesley.

    Google Scholar 

  • ISO. (2000). ISO 9001:2000 quality management systems-requirements. Geneva: International Organization for Standardization.

    Google Scholar 

  • ISO Press. (2008). ISO publishes new edition of ISO 9001 QMS standard. http://www.iso.org/iso/pressrelease.htm, November 14, 2008.

  • Jalote, P. (1999). CMM in practice: Processes for executing software projects at Infosys. Boston: Wesley.

    Google Scholar 

  • Kitson, D. H., Vickroy, R., Walz, J., & Wynn, D. (2009). An initial comparative analysis of the CMMI version 1.2 development constellation and the ISO 9000 family (p. 70). USA: Software Engineering Institute.

    Google Scholar 

  • Lepasaar, M., Mäkinen, T., & Varkoi, T. (2002). Structural comparison of SPICE and continuous CMMI. In Proceedings of SPICE 2002, Venice, Italy.

  • Mutafelija, B., & Stromber, H. (2003). ISO 9001:2000: CMMI V1.1 mappings, Vol. 31. USA: Software Engineering Institute.

    Google Scholar 

  • Mutafelija, B., & Stromber, H. (2009). ISO 9001:2000–CMMI v.1.2 map. Software Engineering Institute. http://www.sei.cmu.edu/cmmi/casestudies/mappings/cmmi12-iso.cfm.

  • Pardo, C., Pino, F., García, F., & Piattini, M. (2009). Homogenization of models to support multi-model processes in improvement environments. In Proceedings of the 4th international conference on software and data technologies, Sofía.

  • Pardo, C., Pino, F. J., García, F., Piattini, M., & Baldassarre, M. T. (2010a). A process for driving the harmonization of models. In Proceedings of the 11th international conference on product focused software development and process improvement (PROFES 2010). Second proceeding: Short papers, doctoral symposium and workshops 2010, Limerick, pp. 53–56.

  • Pardo, C., Pino, F., Garcìa, F., Piattini, M., & Baldassarre, M. T. (2010b). A systematic review on the harmonization of reference models. In Proceedings of the 5th international conference on evaluation of novel approaches to software engineering (ENASE 2010), Athens, Greece, pp. 40–46.

  • Paulk, M. C. (1993). Comparing ISO 9001 and the capability maturity model for software. Software Quality Journal, 2(4), 245–256.

    Article  Google Scholar 

  • Paulk, M. C. (1994). A comparison of ISO 9001 and the capability maturity model for software (CMU/SEI-94-TR-12). USA: Software Engineering Institute.

    Google Scholar 

  • Paulk, M. C. (1995). How ISO 9001 compares with the CMM? IEEE Software, 12(1), 74–83.

    Article  Google Scholar 

  • Paulk, M. C. (2008). A taxonomy for improvement frameworks. In Proceedings of the 4th world congress for software quality, Bethesda, MD.

  • Pino, F., Garcia, F., & Piattini, M. (2008). Software process improvement in small and medium software enterprises: A systematic review. Software Quality Journal, 16(2), 237–261.

    Article  Google Scholar 

  • Pino, F., Baldassarre, M. T., Piattini, M., Visaggio, G., & Caivano, D. (2009a) Harmonizing improvement technologies: A comparison between CMMI-ACQ and ISO/IEC 12207:2008. In Proceedings of the 4th international conference on evaluation of novel approaches to software engineering (ENASE 2009), Milan, Italy, pp. 177–188.

  • Pino, F., Baldassarre, M. T., Piattini, M., & Visaggio, G. (2009b). Relationship between maturity levels of ISO/IEC 15504–15507 and CMMI-DEV v1.2. In Proceedings of the software process improvement and capability determination conference (SPICE 2009), Turku, Finland, pp. 69–76.

  • Pino, F., Baldassarre, M. T., Piattini, M., & Visaggio, G. (2010). Harmonizing maturity levels from CMMI to DEV and ISO/IEC 15504. Journal of Software Maintenance and Evolution: Research and Practice, 22(4), 279–296.

    Google Scholar 

  • PMI-Project Management Institute. (2009). A guide to the project management body of knowledge. Pmbok guide (4th ed.). ISBN: 978-1933890517.

  • Rout, T. P., & Tuffley, A. (2007). Harmonizing ISO/IEC 15504 and CMMI. Software Process: Improvement and Practice, 12(4), 361–371.

    Article  Google Scholar 

  • SEI. (2006). CMMI for development, version 1.2. Technical report CMU/SEI-2006-TR-008. Pittsburgh: Software Engineering Institute (SEI).

    Google Scholar 

  • SEI. (2010). The PrIME project from http://www.sei.cmu.edu/process/research/prime-details.cfm.

  • Siviy, J., Kirwan, P., Marino, L., & Morley, J. (2008a). The value of harmonization multiple improvement technologies: A process improvement professional’s view. Software Engineering Institute, Carnegie Mellon.

  • Siviy, J., Kirwan, P., Morley, J., & Marino, L. (2008b). Maximizing your process improvement ROI through harmonization. USA: Software Engineering Institute (SEI).

    Google Scholar 

  • Siviy, J., Kirwan, P., Renato, V., Peter, K., & Gerhard, G. (2008c). In Proceedings of the multimodel improvement in practice. SEPG Europe 2008.

  • SPICE. (2008). Enterprise SPICE. An enterprise integrated standards-base model. From: http://www.enterprisespice.com/.

  • Violino, B. (2005). Frameworks boost business efficiency. Optimize Magazine, 4(3), 68–70.

    Google Scholar 

  • Wangenheim, C. G. V., & Thiry, M. (2005). Analyzing the integration of ISO/IEC 15504 and CMMI-SE/SW. San José, Brasil, LQPSL: Laboratorio de Qualidade e Productividade de Software. Universidad do Vale do Itajaí: UNIVALI: 28.

  • Wohlin, C., Runeson, P., Host, M., Ohlsson, M. C., Regnell, B., & Wesslèn, A. (2002). Experimentation in software engineering. Dodrecht: Kluwer.

    Google Scholar 

  • Yoo, C., Yoon, J., Lee, B., Lee, C., Lee, J., Hyun, S., et al. (2006). A unified model for the implementation of both ISO 9001:2000 and CMMI by ISO-certified organizations. Journal of Systems and Software, 79(7), 954–961.

    Article  Google Scholar 

  • Zelkowitz, M. V., & Wallace, D. R. (1998). Experimental model for validating technology. IEEE Computer, 31(5), 23–31.

    Article  Google Scholar 

Download references

Acknowledgments

We acknowledge the assistance of the following projects: DIPIS (Italian MIUR, EU and Regione Puglia grants), ARMONIAS (PII2109-0223-7948, JCCM of Spain), PEGASO-MAGO (TIN2009-13718-C02-01, FEDER and MEC of Spain), INGENIOSO (PEII11-0025-9533, JCCM of Spain).

Author information

Authors and Affiliations

  1. Department of Informatics, University of Bari, SER&Practices SPINOFF Via E. Orabona 4, 70126, Bari, Italy

    Maria Teresa Baldassarre, Danilo Caivano & Giuseppe Visaggio

  2. IDIS Research Group, Electronic and Telecommunications Engineering Faculty, University of Cauca, Calle 5 # 4-70 Popayán, Colombia, Spain

    Francisco J. Pino

  3. Alarcos Research Group, Institute of Information Technologies and Systems, University of Castilla-La Mancha, Paseo de la Universidad, 4, 13071, Ciudad Real, Spain

    Mario Piattini

Authors
  1. Maria Teresa Baldassarre
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Danilo Caivano
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Francisco J. Pino
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mario Piattini
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Giuseppe Visaggio
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maria Teresa Baldassarre.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Baldassarre, M.T., Caivano, D., Pino, F.J. et al. Harmonization of ISO/IEC 9001:2000 and CMMI-DEV: from a theoretical comparison to a real case application. Software Qual J 20, 309–335 (2012). https://doi.org/10.1007/s11219-011-9154-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11219-011-9154-7

Keywords

Search

Navigation