Skip to main content
SpringerLink
Log in

Design and evaluation of an electronic performance support system for quantitative data analysis

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

The purpose of the current research was to develop an electronic performance support system (EPSS) for quantitative data analysis by using design-based research. https://nicelanalizlericindesteksistemi.blogspot.com/ website was designed in Turkish to address the needs of educational researchers. There were four phases in the study. In the first phase of the research, the tendencies, challenges, and problems of educational researchers in terms of quantitative research were identified. In the second phase, a prototype of the EPSS for quantitative data analysis was designed. In the third phase of the research, the EPSS was tested and evaluated in three cycles. The results of the need analysis demonstrated that there were many challenges that researchers faced, such as deciding on the appropriate statistical analysis, controlling the assumptions, making analysis with statistical software, interpreting the analysis results, and reporting the results according to the APA format. The results of the evaluation phase showed that the system proved to be useful to solve the problems encountered during the quantitative data analysis process.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Data availability

The dataset is available from the authors upon request.

References

  • Abulela, M. A., & Harwell, M. M. (2020). Data analysis: Strengthening inferences in quantitative education studies conducted by novice researchers. Educational Sciences: Theory and Practice, 20(1), 59–78. https://doi.org/10.12738/jestp.2020.1.005

    Article  Google Scholar 

  • Aydın, H. (2000). Öğretmenlerin hizmet içi eğitiminde elektronik performans destek sisteminin kullanılması. Pamukkale University Journal of Education, 8(8), 141–150.

    Google Scholar 

  • Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An empirical evaluation of the system usability scale. International Journal of Human-Computer Interaction, 24(6), 574–594. https://doi.org/10.1080/10447310802205776

    Article  Google Scholar 

  • Barutçu, F., & Onaylı, S. (2016). Tez ssürecinde karşılaşılan zorluklar. In Ö. Demirel & S. Dinçer (Eds.), Eğitim bilimlerinde yenilikler ve nitelik arayışı içinde (pp. 678–690). Pegem Akademi. https://doi.org/10.14527/9786053183563.042

    Chapter  Google Scholar 

  • Başman, M., Uluman, M., & Tunç, E. B. (2018). Use assumptions in dissertations. Abant İzzet Baysal Üniversitesi Eğitim Fakültesi Dergisi, 18(2), 736–751. https://doi.org/10.17240/aibuefd.2018.18.37322-431426

    Article  Google Scholar 

  • Brooke, J. (1996). SUS: A ‘quick and dirty’ usability. Usability Evaluation in Industry, 189 (194), 4–7.

  • Carliner, S. (2002). Designing e-learning. American Society for Training and Development. ASTD.

    Google Scholar 

  • Celik, E., Gedik, N., Karaman, G., Demirel, T., & Göktaş, Y. (2014). Mistakes encountered in manuscripts on education and their effects on journal rejections. Scientometrics, 98(3), 1837–1853. https://doi.org/10.1007/s11192-013-1137-y

    Article  Google Scholar 

  • Çetin, A. & Dikici, R. (2014). The effectiveness of “research methods in educational sciences” course. Kastamonu Education Journal, 22(3), 981–994. Retrieved January 22, 2020 from https://dergipark.org.tr/en/pub/kefdergi/issue/22601/241476

  • Chang, C. C. (2004). The relationship between the performance and the perceived benefits of using an electronic performance support system (EPSS). Innovations in Education and Teaching International, 41(3), 343–364. https://doi.org/10.1080/14703290410001733249

    Article  Google Scholar 

  • Christensen, L. B., Johnson, B., & Turner, L. A. (2015). Research methods, design, and analysis. Anı Yayıncılık.

    Google Scholar 

  • Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research. Pearson.

    Google Scholar 

  • Demir, E., Saatçioğlu, Ö., & İmrol, F. (2016). Examination of educational researches published in international journals in terms of normality assumptions. Current Research in Education, 2(3), 130–148.

    Google Scholar 

  • Demirkol, D., & Şeneler, Ç. (2018). A Turkish translation of the system usability scale: The SUS-TR. Uşak Üniversitesi Sosyal Bilimler Dergisi, 11(3), 237–253. https://doi.org/10.29217/uujss.495

    Article  Google Scholar 

  • Ehikhamenor, F. A. (2002). Socio-economic factors in the application of information and communication technologies in Nigerian print media. Journal of the American Society for Information Science and Technology, 53(7), 602–611. https://doi.org/10.1002/asi.10044

    Article  Google Scholar 

  • Evrekli, E., İnel, D., Deniş, H., & Balım, A. G. (2011). Methodological and statistical problems in graduate theses in the field of science education. Ilkogretim Online, 10(1), 206–218.

    Google Scholar 

  • İlhan, M. (2016). An analysis of researchers’ difficulties in quantitative data analysis with the use of pairwise comparisons. Journal of Measurement and Evaluation in Education and Psychology, 7(1), 73–84. https://doi.org/10.21031/epod.28154

    Article  MathSciNet  Google Scholar 

  • Gery, G. (1991). Electronic performance support systems: How and why to remake the workplace through the strategic application of technology. Gery Performance Press.

    Google Scholar 

  • Hannafin, M. J., Hill, J., & McCarthy, J. (2002). Designing resource-based learning and performance support systems. The Instructional Use of Learning Objects, 99–129.

  • Jaykaran, C. (2010). How to select appropriate statistical test? Journal of Pharmaceutical Negative Results, 1(2), 61–63. https://doi.org/10.4103/0976-9234.75708

    Article  Google Scholar 

  • Kabaca, T., & Erdoğan, Y. (2007). Examining of statistical properties of the thesis studies in the fields. Pamukkale University Journal of Education, 22, 54–63.

    Google Scholar 

  • Karadağ, E. (2009). A thematic analysis on doctoral dissertations made in the area of education sciences. Journal of Ahi Evran University Faculty of Education, 10(3), 75–87.

    Google Scholar 

  • Karadağ, E. (2010). Research models used in doctoral dissertations in the area of education sciences in Turkey: Quality of research and analytical errors. Kuram Ve Uygulamada Eğitim Yönetimi, 1(1), 49–71.

    MathSciNet  Google Scholar 

  • Kashy, D. A., Donnellan, M. B., Ackerman, R. A., & Russell, D. W. (2009). Reporting and interpreting research in PSPB: Practices, principles, and pragmatics. Personality and Social Psychology Bulletin, 35(9), 1131–1142. https://doi.org/10.1177/0146167208331253

    Article  Google Scholar 

  • Kert, S. B., Uz, Ç., & Gecü, Z. (2014). Effectiveness of an electronic performance support system on computer ethics and ethical decision-making education. Journal of Educational Technology & Society, 17(3), 320–331. https://doi.org/10.2307/jeductechsoci.17.3.320

    Article  Google Scholar 

  • Keskinkılıç, S. B., & Ertürk, A. (2009). Statistical Competency of the Postgraduate Students. Journal of Ahi Evran University Faculty of Education, 10(1), 141–151.

    Google Scholar 

  • Kouzes, R. T., Myers, J. D., & Wulf, W. A. (1996). Collaboratories: Doing science on the internet. Computer, 29(8), 40–46. https://doi.org/10.1109/2.532044

    Article  Google Scholar 

  • Moore, J. L., & Orey, M. A. (2001). The implementation of an electronic performance support system for teachers: An examination of usage, performance, and attitudes. Performance Improvement Quarterly, 14(1), 26–56. https://doi.org/10.1111/j.1937-8327.2001.tb00200.x

    Article  Google Scholar 

  • Ozan, C., & Köse, E. (2014). Research trends in curriculum and instruction. Sakarya University Journal of Education, 4(1), 116–136.

    Article  Google Scholar 

  • Özşahin, M., & Yüreğir, O. H. (2008). An expert system for statistical data analysis. Çukurova Üniversitesi MMF Dergisi, 23(1), 345–357.

    Google Scholar 

  • Pandey, P., & Pandey, M. M. (2015). Research methodology: Tools and techniques. Bridge Center.

    Google Scholar 

  • Raybould, B. (1990). Solving human performance problems with computers. Performance & Instruction, 29(11), 4–14.

    Article  Google Scholar 

  • Reeves, T. C. (2006). Design research from a technology perspective. Educational Design Research, 1(3), 52–66.

    Google Scholar 

  • Sarı, M. (2017). Computer-aided selection of correct statistical tests in data analysis (Publication no 467953) [Master’s thesis, Karadeniz Technical University]. Council of Higher Education Thesis Center.

  • Sijtsma, K., Veldkamp, C. L., & Wicherts, J. M. (2016). Improving the conduct and reporting of statistical analysis in psychology. Psychometrika, 81(1), 33–38. https://doi.org/10.1007/s11336-015-9444-2

    Article  MathSciNet  MATH  Google Scholar 

  • Şimşek, A., Özdamar, N., Uysal, Ö., Kobak, K., Berk, C., Kılıçer, T., & Çiğdem, H. (2009). Current trends in educational technology research in turkey in the new millennium. Educational Sciences: Theory & Practice, 9(2), 115–120.

    Google Scholar 

  • Ulutaş, F., & Ubuz, B. (2008). Research and trends in mathematics education: 2000 to 2006. Ilkogretim Online, 7(3), 615–626.

    Google Scholar 

  • Uysal, M. (2014). Creating an expandable decision tree for data analysis, developing web and mobile applications ((Publicatio no 362476)[Master’sthesis, Gazi University]. Council of Higher Education Thesis Center..

  • Van Schaik, P., Pearson, R., & Barker, P. (2002). Designing electronic performance support systems to facilitate learning. Innovations in Education and Teaching International, 39, 289–306. https://doi.org/10.1080/13558000210161043

    Article  Google Scholar 

  • Laerdstatistics.com. (n.d.). We make statistics easy. The ultimate IBM® SPSS® Statistics guides. Retrieved January 25, 2021, from https://statistics.laerd.com/

  • Yim, K. H., Nahm, F. S., Han, K. A., & Park, S. Y. (2010). Analysis of statistical methods and errors in the articles published in the Korean journal of pain. The Korean Journal of Pain, 23(1), 35. https://doi.org/10.3344/kjp.2010.23.1.35

    Article  Google Scholar 

  • Yücel-Toy, B., & Tosunoğlu, N. G. (2007). Scientifıc research process, statistical techniques and mistakes in social research. The Journal of Gazi University Faculty of Commerce and Tourism Education, 1(1), 1–20.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Education, Eskisehir Osmangazi University, Eskisehir, Turkey

    Kubra Karakaya-Ozyer

  2. Faculty of Science, Eskisehir Osmangazi University, Eskisehir, Turkey

    Zeki Yildiz

Authors
  1. Kubra Karakaya-Ozyer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zeki Yildiz
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Kubra KARAKAYA-OZYER is the main author in this article. She proposed the research problem to Zeki YILDIZ and they both desided to the research design. Kubra KARAKAYA-OZYER collected the data and analyzed the data. Besides, Zeki YILDIZ verified the analytical methods. Zeki YILDIZ also supervised the findings of this work. All authors discussed the results and contributed to the final manuscript. Kubra KARAKAYA –OZYER wrote the manuscript with support from Zeki YILDIZ.

Corresponding author

Correspondence to Kubra Karakaya-Ozyer.

Ethics declarations

Ethical approval

All participation was voluntary, anonymous, and was conducted under an approved institutional IRB.

Conflict of interest

The authors declare that they have no conflict of interest, this research was conducted without external funding.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Karakaya-Ozyer, K., Yildiz, Z. Design and evaluation of an electronic performance support system for quantitative data analysis. Educ Inf Technol 27, 2407–2434 (2022). https://doi.org/10.1007/s10639-021-10712-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10639-021-10712-y

Keywords

Search

Navigation