skip to main content
10.1145/2896839.2896844acmconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
research-article

Case studies in industry: what we have learnt

Published:14 May 2016Publication History

ABSTRACT

Case study research has become an important research methodology for exploring phenomena in their natural contexts. Case studies have earned a distinct role in the empirical analysis of software engineering phenomena which are difficult to capture in isolation. Such phenomena often appear in the context of methods and development processes for which it is difficult to run large, controlled experiments as they usually have to reduce the scale in several respects and, hence, are detached from the reality of industrial software development. The other side of the medal is that the realistic socio-economic environments where we conduct case studies -- with real-life cases and realistic conditions -- also pose a plethora of practical challenges to planning and conducting case studies. In this experience report, we discuss such practical challenges and the lessons we learnt in conducting case studies in industry. Our goal is to help especially inexperienced researchers facing their first case studies in industry by increasing their awareness for typical obstacles they might face and practical ways to deal with those obstacles.

References

  1. S. Adolph, W. Hall, and P. Kruchten. Using Grounded Theory to study the Experience of Software Development. Journal of Empirical Software Engineering, 16(4), 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. A. A. Amschler and A. S. Pradhan. Ethical issues in empirical software engineering: The limits of policy. Empirical Software Engineering, 6(2):105--110, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. V. Basili. A Personal Perspective on the Evolution of Empirical Software Engineering. In J. Muench and K. Schmid, editors, Perspectives on the Future of Software Engineering, pages 255--273. Springer, 2013.Google ScholarGoogle ScholarCross RefCross Ref
  4. N. Carayol. Objectices, Agreements and Matching in Science-Industry Collaborations: Reassembling the Pieces of the Puzzle. Research Policy, 32:887--908, 2003.Google ScholarGoogle ScholarCross RefCross Ref
  5. P. Diebold, A. Vetrò, and D. Méndez Fernández. An Exploratory Study on Technology Transfer in Software Engineering. In Proc. 9th International Symposium on Empirical Software Engineering and Measurement. IEEE, 2015.Google ScholarGoogle ScholarCross RefCross Ref
  6. I. Jacobson and I. Spence. Why we need a Theory for Software Engineering. Dr. Dobb's Journal, 2009.Google ScholarGoogle Scholar
  7. M. Junker, M. Broy, B. Hauptmann, W. Boehm, H. Femmer, S. Eder, E. Juergens, and R. Janssen. Principles and a Process for Successful Industry Cooperation -- The Case of TUM and Munich Re. In Proc. Intl. Workshop on Software Engineering Research and Industrial Practice. IEEE, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. G. Kalus and M. Kuhrmann. Criteria for Software Process Tailoring: A Systematic Review. In Proc. 8th International Conference on Global Software Engineering. ACM, 2013.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. D. Méndez Fernández, J. Mund, H. Femmer, and A. Vetrò. In Quest for Requirements Engineering Oracles: Dependent Variables and Measurements for (good) RE. In Proc. 18th International Conference on Evaluation and Assessment in Software Engineering. ACM, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. D. Méndez Fernández, S. Wagner, K. Lochmann, A. Baumann, and H. de Carne. Field Study on Requirements Engineering: Investigation of Artefacts, Project Parameters, and Execution Strategies. Information and Software Technology, 54(2):162--178, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. P. Runeson and M. Höst. Guidelines for Conducting and Reporting Case Study Research in Software Engineering. Empirical Software Engineering, 14(2):131--164, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. P. Runeson, M. Höst, A. Rainer, and B. Regnell. Case Study Research in Software Engineering: Guidelines and Examples. Wiley, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. J. M. Verner, J. Sampson, V. Tosic, N. A. A. Bakar, and B. A. Kitchenham. Guidelines for Industrially-based Multiple Case Studies in Software Engineering. In Proc. Third International Conference on Research Challenges in Information Science. IEEE, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  14. A. Vetro, S. Ognawala, D. Méndez Fernández, and S. Wagner. Fast Feedback Cycles in Empirical Software Engineering Research. In Proc. 37th International Conference on Software Engineering. IEEE, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Wagner, S. and Mendez Fernandez, D. Analysing Text in Software Projects. In Bird, C. and Menzies, T. and Zimmermann, T., editor, The Art and Science of Analyzing Software Data. Morgan Kaufmann, 2015.Google ScholarGoogle Scholar
  16. R. Wieringa. Empirical Research Methods for Technology Validation: Scaling up to Practice. Journal of Systems and Software, 95:19--31, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. R. Wieringa and M. Aycse. Technical Action Research as a Validation Method in Information Systems Design Science. In Proc. 7th International Conference on Design Science Research in Information Systems: Advances in Theory and Practice. Springer, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. R. K. Yin. Case Study Research. Sage Publications, 2013.Google ScholarGoogle Scholar

Index Terms

  1. Case studies in industry: what we have learnt

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CESI '16: Proceedings of the 4th International Workshop on Conducting Empirical Studies in Industry
      May 2016
      48 pages
      ISBN:9781450341547
      DOI:10.1145/2896839

      Copyright © 2016 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 14 May 2016

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Upcoming Conference

      ICSE 2025

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader