Skip to main content

Advertisement

SpringerLink
Log in

What distinguishes a novice from an expert mixed methods researcher?

  • Published:
Quality & Quantity Aims and scope Submit manuscript

Abstract

Mixed methods research is growing in use throughout countries and disciplines. Consequently, more people are learning methodology and providing training. Yet, only a paucity of empirical studies addresses the topic of teaching and learning mixed methods. Our current understanding of how to distinguish novices from experts at mixed methods, an important question for instructors and mentors, is anecdotal. While related literature tends to focus on teaching mixed methods research, this study took a different perspective. I used a proficiency framework to explore the skills needed to conduct mixed methods research as identified by experienced researchers, mixed methods curricula, and the mixed methods literature and to develop a typology of mixed methods proficiency. Data collection involved multiple data sources: qualitative interviews (n = 8) with individuals highly regarded for their expertise in mixed methods research and documents in the form of course syllabi, curricula materials, and workshop materials. I then conducted theme-based and type-building text analysis of the data. Four themes emerged: mixed methods skills, knowledge, researcher characteristics, and professional experiences. This article presents a typology of descriptors at three levels of mixed methods proficiency: novices, researchers, and methodologists. The proficiency typology and resultant understanding of what distinguishes mixed methods experts will be useful to learners, instructors, and mentors in developing courses, workshops, and professional development plans.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Baran, M.: Teaching multi-methodology research courses to doctoral students. Int. J. Mult. Res. Approach 4(1), 19–27 (2010)

    Article  Google Scholar 

  • Bazeley, P.: Teaching mixed methods. Qual. Res. J. 3, 117–126 (2003)

    Google Scholar 

  • Bryman, A.: Integrating quantitative and qualitative research: how is it done? Qual. Res. 6, 97–113 (2006). doi:10.1177/1468794106058877

    Article  Google Scholar 

  • Bryman, A.: Barriers to integrating quantitative and qualitative research. J. Mixed Methods Res. 1, 8–22 (2007). doi:10.1177/2345678906290531

    Article  Google Scholar 

  • Bryman, A., Becker, S., Sempik, J.: Quality criteria for quantitative, qualitative and mixed methods research: a view from social policy. Int. J. Soc. Res. Method. 11, 261–276 (2008). doi:10.1080/13645570701401644

    Article  Google Scholar 

  • Camfield, L., Guillen-Royo, M., Velazco, J.: Does needs satisfaction matter for psychological and subjective wellbeing in developing countries: a mixed-methods illustration from Bangladesh and Thailand. J. Happiness Stud. 11(4), 497–516 (2010). doi:10.1007/s10902-009-9154-5

    Article  Google Scholar 

  • Chandler, C.I.R., Chonya, S., Mtei, F., Reyburn, H., Whitty, C.J.M.: Motivation, money and respect: a mixed-method study of Tanzanian non-physician clinicians. Soc. Sci. Med. 68(11), 2078–2088 (2009). doi:10.1016/j.socscimed.2009.03.007

    Article  Google Scholar 

  • Christ, T.: Teaching mixed methods and action research: pedagogical, practical, and evaluative considerations. In: Tashakkori, A., Teddlie, C. (eds.) Sage Handbook of Mixed Methods in Social and Behavioral Research, pp. 643–676. Sage, Thousand Oaks (2010)

    Chapter  Google Scholar 

  • Christ, T.W.: Designing, teaching, and evaluating two complementary mixed methods research courses. J. Mixed Methods Res. 3(4), 292–325 (2009). doi:10.1177/1558689809341796

    Article  Google Scholar 

  • Collins, K.M.: Introduction: crafting significant learning experiences in the context of teaching mixed methodologies. Int. J. Mult. Res. Approach. 4(1), 6–8 (2010)

    Article  Google Scholar 

  • Coronel Llamas, J.M., Boza, Á.: Teaching research methods for doctoral students in education: Learning to enquire in the university. Int. J. Soc. Res. Methodol. 14(1), 77–90 (2010). doi:10.1080/13645579.2010.492136

    Article  Google Scholar 

  • Council of Europe: Common European Framework of Reference for Languages: Learning, Teaching, and Assessment. Cambridge University Press, Cambridge (2001)

    Google Scholar 

  • Creswell, J.W.: Qualitative Inquiry and Research Design: Choosing Among Five Approaches, 3rd edn. Sage, Thousand Oaks (2013)

    Google Scholar 

  • Creswell, J.W.: A Concise Introduction to Mixed Methods Research. Sage, Thousand Oaks (2015)

    Google Scholar 

  • Creswell, J.W., Klassen, A.C., Plano Clark, V.L., Smith, K.C.: Best practices for mixed methods research in the health sciences. In: National Institutes of Health, Washington, DC (2011)

  • Creswell, J.W., Plano Clark, V.L.: Designing and Conducting Mixed Methods Research, 2nd edn. Sage, Thousand Oaks (2011)

    Google Scholar 

  • Creswell, J.W., Tashakkori, A., Jensen, K.D., Shapley, K.L.: Teaching mixed methods research: Practices, dilemmas, and challenges. In: Tashakkori, A., Teddlie, C. (eds.) Handbook of Mixed Methods in Social & Behavioral Research, pp. 619–637. Sage, Thousand Oaks (2003)

    Google Scholar 

  • Denscombe, M.: Communities of practice: a research paradigm for the mixed methods approach. J. Mixed Methods Res. 2, 270–283 (2008). doi:10.1177/1558689808316807

    Article  Google Scholar 

  • Earley, M.: Developing reflective researchers. In: Garner, M., Wagner, C., Kawulich, B. (eds.) Teaching Research Methods in the Social Sciences, pp. 103–110. Ashgate, Surrey (2009)

    Google Scholar 

  • Earley, M.A.: Developing a syllabus for a mixed-methods research course. Int. J. Soc. Res. Method. 10(2), 145–162 (2007). doi:10.1080/13645570701334118

    Article  Google Scholar 

  • Emmel, N.: Sampling and Choosing Cases in Qualitative Research: A Realist Approach. Sage, Thousand Oaks (2013)

    Book  Google Scholar 

  • Fetters, M.D., Freshwater, D.: The 1 + 1 = 3 integration challenge. J. Mixed Methods Res. 9, 115–117 (2015). doi:10.1177/1558689815581222

    Article  Google Scholar 

  • Fink, L.D.: Creating Significant Learning Experiences in College Classrooms. Jossey-Bass, San Francisco (2003)

    Google Scholar 

  • Frels, R.K., Newman, I., Newman, C.: Mentoring the next generation in mixed methods research. In: Hesse-Biber, S., Johnson, R.B. (eds.) The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry, pp. 333–353. New York, Oxford (2015)

    Google Scholar 

  • Frels, R.K., Onwuegbuzie, A.J., Leech, N.L., Collins, K.M.: Challenges to teaching mixed research courses. J. Effect. Teach. 12(2), 23–44 (2012)

    Google Scholar 

  • Frels, R.K., Onwuegbuzie, A.J., Leech, N.L., Collins, K.M.T.: Pedagogical strategies used by selected leading mixed methodologists in mixed research courses. J. Effect. Teach. 14(2), 5–34 (2014)

    Google Scholar 

  • Greene, J.C.: Foreword: Beginning the conversation. Int. J. Mult. Res. Approach. 4(1), 2–5 (2010). doi:10.5172/mra.2010.4.1.002

    Article  Google Scholar 

  • Guest, G., Bunce, A., Johnson, L.: How many interviews are enough? An experiment with data saturation and variability. Field Methods 18(1), 59–82 (2006)

    Article  Google Scholar 

  • Guetterman, T.C.: Descriptions of sampling practices within five approaches to qualitative research in education and the health sciences. Forum Qualitative Sozialforschung/Forum: Qualitative Social Research 16(2) (2015)

  • Hansson, J.: Program implementation in health services. Int. J. Mult. Res. Approach. 4(1), 40–48 (2010)

    Article  Google Scholar 

  • Ivankova, N.V.: Teaching and learning mixed methods research in computer- mediated environment: educational gains and challenges. Int. J. Mult. Res. Approach. 4, 49–66 (2010)

    Article  Google Scholar 

  • Ivankova, N.V., Kawamura, Y.: Emerging trends in the utilization of integrated designs in the social, behavioral, and health sciences. In: Tashakkori, A., Teddlie, C. (eds.) Sage Handbook of Mixed Methods in Social and Behavioral Research, pp. 581–611. Sage, Thousand Oaks (2010)

    Chapter  Google Scholar 

  • Kuckartz, U.: Qualitative Text Analysis: A Guide to Methods, Practice and Using Software. Sage, London (2014)

    Book  Google Scholar 

  • Leech, N.L., Goodwin, L.D.: Building a methodological foundation: Doctoral-level methods courses in colleges of education. Res. Sch. 15, 1–8 (2008)

    Google Scholar 

  • Leech, N.L., Onwuegbuzie, A.J.: A typology of mixed methods research designs. Qual. Quant. 43(2), 265–275 (2009)

    Article  Google Scholar 

  • Leech, N.L., Onwuegbuzie, A.J.: EPILOGUE: the journey: from where we started to where we hope to go. Int. J. Mult. Res. Approach. 4(1), 73–88 (2010)

    Article  Google Scholar 

  • Maxwell, J.A.: Qualitative Research Design: An Interactive Approach, 3rd edn. Sage, Thousand Oaks (2013)

    Google Scholar 

  • Mertens, D.M.: Philosophy in mixed methods teaching: the transformative paradigm as illustration. Int. J. Mult. Res. Approach. 4(1), 9–18 (2010)

    Article  Google Scholar 

  • Mikecz, R.: Interviewing Elites: addressing methodological issues. Qual. Inq. 18(6), 482–493 (2012). doi:10.1177/1077800412442818

    Article  Google Scholar 

  • Morse, J.M.: Determining sample size. Qual. Health Res. 10(1), 3–5 (2000). doi:10.1177/104973200129118183

    Article  Google Scholar 

  • Morse, J.M.: Data were saturated. Qual. Health Res. 25, 587–588 (2015). doi:10.1177/1049732315576699

    Article  Google Scholar 

  • Morse, J.M., Niehaus, L.: Mixed Methods Design: Principles and Procedures. Left Coast Press, Walnut Creek (2009)

    Google Scholar 

  • Ngulube, P.: Mapping mixed methods research in library and information science journals in Sub-Saharan Africa 2004–2008. Int. Inf. Lib. Rev. 42(4), 252–261 (2010). doi:10.1080/10572317.2010.10762870

    Article  Google Scholar 

  • Niglas, K.: Introducing the qualitative-quantitative continuum: An alternative view of teaching research methods courses. In: Murtonen, M., Rautopuro, J., Vaisanen, P. (eds.) Learning and teaching of research methods at university. Research in Educational Sciences, pp. 185–203. Finnish Educational Research Association, Turku (2007)

  • O’Cathain, A.: Assessing the quality of mixed methods research: toward a comprehensive framework. In: Tashakkori, A., Teddlie, C. (eds.) SAGE Handbook of Mixed Methods in Social & Behavioral Research, pp. 531–556. Sage, Thousand Oaks (2010)

    Chapter  Google Scholar 

  • O’Cathain, A., Murphy, E., Nicholl, J.: The quality of mixed methods studies in health services research. J. Health Serv. Res. Policy 13, 92–98 (2008). doi:10.1258/jhsrp.2007.007074

    Article  Google Scholar 

  • O’Cathain, A., Murphy, E., Nicholl, J.: Three techniques for integrating data in mixed methods studies. Br. Med. J. 341(7783), 1147–1150 (2010). doi:10.1136/bmj.c5487

    Google Scholar 

  • Onwuegbuzie, A.J., Frels, R.K., Collins, K.M., Leech, N.L.: Conclusion: a four-phase model for teaching and learning mixed research. Int. J. Mult. Res. Approach. 7(1), 133–156 (2013)

    Article  Google Scholar 

  • Onwuegbuzie, A.J., Frels, R.K., Leech, N.L., Collins, K.M.: A mixed research study of pedagogical approaches and student learning in doctoral-level mixed research courses. Int. J. Mult. Res. Approach. 5, 169–199 (2011)

    Article  Google Scholar 

  • Onwuegbuzie, A.J., Leech, N.L., Murtonen, M., Tähtinen, J.: Utilizing mixed methods in teaching environments to reduce statistics anxiety. Int. J. Mult. Res. Approach. 4(1), 28–39 (2010)

    Article  Google Scholar 

  • Onwuegbuzie, A.J., Leech, N.L.: Taking the “Q” out of research: teaching research methodology courses without the divide between quantitative and qualitative paradigms. Qual. Quant. 39(3), 267–295 (2005). doi:10.1007/s11135-004-1670-0

    Article  Google Scholar 

  • Palinkas, L.A., Horwitz, S.M., Chamberlain, P., Hurlburt, M.S., Landsverk, J.: Mixed-methods designs in mental health services research: a review. Psychiatr. Serv. 62(3), 255–263 (2011)

    Article  Google Scholar 

  • Patton, M.Q.: Qualitative Research & Evaluation Methods: Integrating Theory and Practice, 4th edn. Sage, Thousand Oaks CA (2015)

    Google Scholar 

  • Plano Clark, V.L.: The adoption and practice of mixed methods: U.S. trends in federally funded health-related research. Qual. Inq. 16, 428–440 (2010). doi:10.1177/1077800410364609

    Article  Google Scholar 

  • Plowright, D.: To what extent do postgraduate students understand the principles of mixed methods in educational research? Int. J. Mult. Res. Approach. 7, 66–82 (2013)

    Article  Google Scholar 

  • Poth, C.: What constitutes effective learning experiences in a mixed methods research course? An examination from the student perspective. Int. J. Mult. Res. Approach. 8, 74–86 (2014)

    Article  Google Scholar 

  • Schifferdecker, K.E., Reed, V.A.: Using mixed methods research in medical education: basic guidelines for researchers. Med. Edu. 43(7), 637–644 (2009). doi:10.1111/j.1365-2923.2009.03386.x

    Article  Google Scholar 

  • Stephens, N.: Collecting data from elites and ultra elites: telephone and face-to-face interviews with macroeconomists. Qual. Res. 7(2), 203–216 (2007). doi:10.1177/1468794107076020

    Article  Google Scholar 

  • Tashakkori, A., Teddlie, C.: The past and future of mixed methods research: From data triangulation to mixed model designs. In: Tashakkori, A., Teddlie, C. (eds.) Handbook of Mixed Methods in Social & Behavioral Research, pp. 671–701. Sage, Thousand Oaks, CA (2003)

  • Teddlie, C., Tashakkori, A.: Foundations of Mixed Methods Research: Integrating Quantitative and Qualitative Approaches in the Social and Behavioral Sciences. Sage, Thousand Oaks (2009)

    Google Scholar 

  • Verbi GmbH: MAXQDA. In: p. Computer Software. Berlin (2015)

  • Wagner, C., Garner, M., Kawulich, B.: The state of the art of teaching research methods in the social sciences: towards a pedagogical culture. Stud. High. Edu. 36(1), 75–88 (2011). doi:10.1080/03075070903452594

    Article  Google Scholar 

  • Zhou, Y., Creswell, J.W.: The use of mixed methods by Chinese scholars in East China: a case study. Int. J. Mult. Res. Approach. 6(1), 73–87 (2012). doi:10.5172/mra.2012.6.1.73

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Michigan, 1018 Fuller Street, Ann Arbor, MI, 48104-1213, USA

    Timothy C. Guetterman

Authors
  1. Timothy C. Guetterman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Timothy C. Guetterman.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Guetterman, T.C. What distinguishes a novice from an expert mixed methods researcher?. Qual Quant 51, 377–398 (2017). https://doi.org/10.1007/s11135-016-0310-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11135-016-0310-9

Keywords

Search

Navigation