Skip to main content

Advertisement

SpringerLink
Log in

Computational Modeling of the Effects of the Science Writing Heuristic on Student Critical Thinking in Science Using Machine Learning

  • Published:
Journal of Science Education and Technology Aims and scope Submit manuscript

Abstract

This study is intended to provide an example of computational modeling (CM) experiment using machine learning algorithms. Specific outcomes modeled in this study are the predicted influences associated with the Science Writing Heuristic (SWH) and associated with the completion of question items for the Cornell Critical Thinking Test. The Student Task and Cognition Model in this study uses cognitive data from a large-scale randomized control study. Results of the computational model experiment provide for the possibility to increase student success via targeted cognitive retraining of specific cognitive attributes via the SWH. This study also illustrates that computational modeling using machine learning algorithms (MLA) is a significant resource for testing educational interventions, informs specific hypotheses, and assists in the design and development of future research designs in science education research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Ab Kadir, M. A. (2018). An inquiry into critical thinking in the Australian curriculum: examining its conceptual understandings and their implications on developing critical thinking as a “general capability” on teachers’ practice and knowledge. Asia Pacific Journal of Education, 38(4), 533–549.

    Google Scholar 

  • Albus, J. S. (2010). A model of computation and representation in the brain. Information Sciences, 180(9), 1519–1554.

    Google Scholar 

  • Arciniegas, D. B. (2013). Structural and Functional Neuroanatomy. Behavioral Neurology & Neuropsychiatry, 266.

  • Barbey, A. K., Colom, R., Solomon, J., Krueger, F., Forbes, C., & Grafman, J. (2012). An integrative architecture for general intelligence and executive function revealed by lesion mapping. Brain, 135(4), 1154-1164.

    Google Scholar 

  • Berger, T. W., Song, D., Chan, R. H., Marmarelis, V. Z., LaCoss, J., Wills, J., & Granacki, J. J. (2012). A hippocampal cognitive prosthesis: multi-input, multi-output nonlinear modeling and VLSI implementation. Neural Systems and Rehabilitation Engineering, IEEE Transactions on, 20(2), 198–211.

    Google Scholar 

  • Bichi, A. A., & Talib, R. (2018). Item response theory: an introduction to latent trait models to test and item development. International Journal of Evaluation and Research in Education, 7(2), 142–151.

    Google Scholar 

  • Bond, C. E., Philo, C., & Shipton, Z. K. (2011). When there isn’t a right answer: interpretation and reasoning, key skills for twenty-first century geoscience. International Journal of Science Education, 33, 629–652.

    Google Scholar 

  • Borra, S., & Di Ciaccio, A. (2010). Measuring the prediction error: a comparison of cross-validation, bootstrap and covariance penalty methods. Computational statistics & data analysis, 54(12), 2976–2989.

    Google Scholar 

  • Chen, S., & Tan, D. (2018). A SA-ANN-based modeling method for human cognition mechanism and the PSACO cognition algorithm. Complexity 2018.

  • Choubin, B., Khalighi-Sigaroodi, S., Malekian, A., & Kişi, Ö. (2016). Multiple linear regression, multi-layer perceptron network and adaptive neuro-fuzzy inference system for forecasting precipitation based on large-scale climate signals. Hydrological Sciences Journal, 61(6), 1001-1009.

    Google Scholar 

  • Cowan, N. (2017). The many faces of working memory and short-term storage. Psychonomic bulletin & review, 24(4), 1158–1170.

    Google Scholar 

  • De La Torre, J. (2008). An empirically based method of Q-matrix validation for the DINA model: development and applications. Journal of educational measurement, 45(4), 343–362.

    Google Scholar 

  • Dimitrov, D. (2012). Statistical methods for validation of assessment scale data in counseling and related fields. Alexandria, VA: American Counseling Association using their item response theory parameters. Applied Psychological Measurement, 31, 367–387.

    Google Scholar 

  • Eason, S. H., & Ramani, G. B. (2017). Parental guidance and children’s executive function: working memory and planning as moderators during joint problem-solving. Infant and Child Development, 26(2), e1982.

    Google Scholar 

  • Ennis, R. H., Millman, J., & Tomko, T. N. (1985). Cornell Critical Thinking Test, level X & level Z-manual (3rd ed.). PacificGrove, CA: Midwest.

    Google Scholar 

  • Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological bulletin, 76(5), 378.

    Google Scholar 

  • Frank, M. J., Loughry, B., & O’Reilly, R. C. (2001). Interactions between frontal cortex and basal ganglia in working memory: a computational model. Cognitive, Affective, & Behavioral Neuroscience, 1(2), 137–160.

    Google Scholar 

  • Galbraith, D. (2009). Cognitive models of writing.German as a foreign language, (2-3), 7-22.

  • Gallant, S. (1993). Neural network learning and expert systems. London, England: MIT Press.

    Google Scholar 

  • Galotti, K. M. (2013). Cognitive psychology in and out of the laboratory. Incorporated: SAGE Publications.

    Google Scholar 

  • Gavin, H. P. (2019). The Levenberg-Marquardt algorithm for nonlinear least squares curve-fitting problems.

  • Goertzel, B., Lian, R., Arel, I., De Garis, H., & Chen, S. (2010). A world survey of artificial brain projects, part II: biologically inspired cognitive architectures. Neurocomputing, 74(1–3), 30–49.

    Google Scholar 

  • Güçlü, U., & van Gerven, M. A. (2014). Unsupervised feature learning improves prediction of human brain activity in response to natural images. PLoS Comput Biol, 10(8), e1003724.

    Google Scholar 

  • Hand, B., & Keys, C. W. (1999). Inquiry investigation. The Science Teacher, 66(4), 27.

    Google Scholar 

  • Hanes, D. P., & Schall, J. D. (1996). Neural control of voluntary movement initiation. Science, 274(5286), 427–430.

    Google Scholar 

  • Hass, R. W., & Beaty, R. E. (2018). Use or consequences: probing the cognitive difference between two measures of divergent thinking. Frontiers in psychology, 9, 2327.

    Google Scholar 

  • Havaei, M., Davy, A., Warde-Farley, D., Biard, A., Courville, A., Bengio, Y., & Larochelle, H. (2017). Brain tumor segmentation with deep neural networks. Medical image analysis, 35, 18–31.

    Google Scholar 

  • Hebb, D.O. (1961). Distinctive features of learning in the higher animal J. F. Delafresnaye (Ed.) Brain mechanisms and learning, London: Oxford University Press.

  • Huys, Q. J., Maia, T. V., & Frank, M. J. (2016). Computational psychiatry as a bridge from neuroscience to clinical applications. Nature neuroscience, 19(3), 404.

    Google Scholar 

  • Hwang, G. J., & Chang, H. F. (2011). A formative assessment-based mobile learning approach to improving the learning attitudes and achievements of students. Computers & Education, 56(4), 1023–1031.

    Google Scholar 

  • Jager, W. (2017). Enhancing the realism of simulation (EROS): on implementing and developing psychological theory in social simulation. Journal of Artificial Societies and Social Simulation, 20(3).

  • Japardi, K., Bookheimer, S., Knudsen, K., Ghahremani, D. G., & Bilder, R. M. (2018). Functional magnetic resonance imaging of divergent and convergent thinking in Big-C creativity. Neuropsychologia, 118, 59–67.

    Google Scholar 

  • Jeon, H. (2014). Hierarchical processing in the prefrontal cortex in a variety of cognitive domains. Frontiers in systems neuroscience, 8, 223.

    Google Scholar 

  • Kang, C. Y., Duncan, G. J., Clements, D. H., Sarama, J., & Bailey, D. H. (2018). The roles of transfer of learning and forgetting in the persistence and fadeout of early childhood mathematics interventions. Journal of Educational Psychology.

  • Kriegeskorte, N., & Douglas, P. K. (2018). Cognitive computational neuroscience. Nature neuroscience, 21(9), 1148–1160.

    Google Scholar 

  • Lachaux, J. P., Axmacher, N., Mormann, F., Halgren, E., & Crone, N. E. (2012). High-frequency neural activity and human cognition: past, present and possible future of intracranial EEG research. Progress in Neurobiology.

  • Lam, Y. W., Hew, K. F., & Chiu, K. F. (2018). Improving argumentative writing: effects of a blended learning approach and gamification. Language learning & technology, 22(1), 97–118.

    Google Scholar 

  • Lamb, R. L. (2013). The application of cognitive diagnostic approaches via neural network analysis of serious educational games (Doctoral dissertation).

  • Lamb, R., & Annetta, L. (2009). A pilot study of online simulations and problem based learning in a chemistry classroom. Journal of Virginia Science Educator, 3(2), 34-50.

    Google Scholar 

  • Lamb, R., & Premo, J. (2015). Computational modeling of teaching and learning through application of evolutionary algorithms. Computation, 3(3), 427-443.

    Google Scholar 

  • Lamb, R., Annetta, L., & Vallet, D. (2015). The interface of creativity, fluency, lateral thinking and technology while designing Serious Educational Games in a science classroom.

  • Lamb, R., Firestone, J. B., & Ardasheva, Y. (2016). A computational modeling of rapid attitude formation during surveys about immigrants and immigration. Computers in Human Behavior, 63, 179-188.

    Google Scholar 

  • Lamb, R., Hand, B., & Yoon, S. (2017). Examinations of cognitive processing of science writing tasks. Journal of Psychology and Brain Studies, 1(1), 1-5.

    Google Scholar 

  • Lamb, R. L., Annetta, L., Meldrum, J., & Vallett, D. (2012). Measuring science interest: Rasch validation of the science interest survey. International Journal of Science and Mathematics Education, 10(3), 643-668.

    Google Scholar 

  • Lamb, R. L., Annetta, L., Vallett, D. B., & Sadler, T. D. (2014). Cognitive diagnostic like approaches using neural-network analysis of serious educational videogames. Computers & Education, 70, 92-104.

    Google Scholar 

  • Lamb, R. L., Etopio, E., Hand, B., & Yoon, S. Y. (2019). Virtual reality simulation: Effects on academic performance within two domains of writing in science. Journal of Science Education and Technology, 28(4), 371-381.

    Google Scholar 

  • Lamb, R. L., Vallett, D. B., Akmal, T., & Baldwin, K. (2014). A computational modeling of student cognitive processes in science education. Computers & Education, 79, 116-125.

    Google Scholar 

  • Lamb, R., Annetta, L., Hoston, D., Shapiro, M., & Matthews, B. (2018). Examining human behavior in video games: The development of a computational model to measure aggression. Social neuroscience, 13(3), 301-317.

    Google Scholar 

  • López, D., Vera, N., & Pedraza, L. (2017). Analysis of multilayer neural network modeling and long short-term memory. International Journal of Mathematical and Computational Sciences, 10(12), 697–702.

    Google Scholar 

  • Love, B. C., Medin, D. L., & Gureckis, T. M. (2004). SUSTAIN: a network model of category learning. Psychological review, 111(2), 309.

    Google Scholar 

  • Ma, W., & de la Torre, J. (2020). An empirical Q-matrix validation method for the sequential generalized DINA model. British Journal of Mathematical and Statistical Psychology, 73(1), 142–163.

    Google Scholar 

  • Manktedlow, K. (2012). Thinking and reasoning: an introduction to the psychology of reason, judgment, and decision making. New York, NY: Psychology Press.

    Google Scholar 

  • Meltzoff, J., & Cooper, H. (2018).Critical thinking about research: Psychology and related fields. American psychological association.

  • Montague, P. R., Dolan, R. J., Friston, K. J., & Dayan, P. (2012). Computational psychiatry.Trends in cognitive sciences,16(1), 72-80.

  • Morrison, T. M., Pathmanathan, P., Adwan, M., & Margerrison, E. (2018). Advancing regulatory science with computational modeling for medical devices at the FDA’s Office of Science and Engineering Laboratories. Frontiers in medicine, 5, 241.

    Google Scholar 

  • Myers, N. E., Stokes, M. G., & Nobre, A. C. (2017). Prioritizing information during working memory: beyond sustained internal attention. Trends in Cognitive Sciences, 21(6), 449–461.

    Google Scholar 

  • National Institutes of Health. (2020). RFA-AI 19–0011. Rederived from: https://grants.nih.gov/grants/guide/rfa-files/RFA-Ai-19-011.html.

  • National Science Foundation. (2020). NSF Award Abstract #9314946. Retrieved from: https://www.nsf.gov/awardsearch/showAward?AWD_ID=9314946.

  • O’Reilly, R. C. (2006). Biologically based computational models of high-level cognition. Science, 314(5796), 91–94.

    Google Scholar 

  • Palmeri, T. J., Love, B. C., & Turner, B. M. (2017). Model-based cognitive neuroscience.

  • Palminteri, S., Wyart, V., & Koechlin, E. (2017). The importance of falsification in computational cognitive modeling. Trends in cognitive sciences, 21(6), 425–433.

    Google Scholar 

  • Park, H. J., & Friston, K. (2013). Structural and functional brain networks: from connections to cognition. Science, 342(6158), 1238411.

    Google Scholar 

  • Prasad, J. A. (2018). Exploring executive functions using a distributed circuit model. The Journal of Neuroscience, 38(22), 5039.

    Google Scholar 

  • Sarıca, H. Ç, & Usluel, Y. K. (2016). The effect of digital storytelling on visual memory and writing skills. Computers & Education, 94, 298–309.

    Google Scholar 

  • Serban, I. V., Sordoni, A., Bengio, Y., Courville, A., & Pineau, J. (2016, March). Building end-to-end dialogue systems using generative hierarchical neural network models. In Thirtieth AAAI Conference on Artificial Intelligence.

  • Schoerning, E., Hand, B., Shelley, M., & Therrien, W. (2015). Language, access, and power in the elementary science classroom. Science Education, 99(2), 238–259.

    Google Scholar 

  • Simmons, B. (2010). Clinical reasoning: concept analysis. Journal of advanced nursing, 66(5), 1151–1158.

    Google Scholar 

  • Stephenson, N. S., & Sadler-McKnight, N. P. (2016). Developing critical thinking skills using the science writing heuristic in the chemistry laboratory. Chemistry Education Research and Practice, 17(1), 72–79.

    Google Scholar 

  • Tatsuoka, K. K. (2009).Cognitive assessment: An introduction to the rule space method. Routledge.

  • Trafimow, D. (2018). Some implications of distinguishing between unexplained variance that is systematic or random. Educational and psychological measurement, 78(3), 482–503.

    Google Scholar 

  • Turner, B. M., van Maanen, L., & Forstmann, B. U. (2015). Informing cognitive abstractions through neuroimaging: the neural drift diffusion model. Psychological Review, 122(2), 312–336. https://doi.org/10.1037/a0038894

    Article  Google Scholar 

  • Unsworth, N. (2016). Working memory capacity and recall from long-term memory: examining the influences of encoding strategies, study time allocation, search efficiency, and monitoring abilities. Journal of Experimental Psychology: Learning, Memory, and Cognition, 42(1), 50.

    Google Scholar 

  • Wijayasekara, D., Manic, M., Sabharwall, P., & Utgikar, V. (2011). Optimal artificial neural network architecture selection for performance prediction of compact heat exchanger with the EBaLM-OTR technique. Nuclear Engineering and Design, 241(7), 2549–2557.

    Google Scholar 

  • Wilson, R. A., & Keilm, F. C. (2001). The MIT encyclopedia of cognitive science. Cambridge, MA: MIT Press.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Education, Neurocognition Science Laboratory, East Carolina University, 128 Rivers Building, Greenville, NC, 27858, USA

    Richard Lamb, Brian Hand & Amanda Kavner

Authors
  1. Richard Lamb
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Brian Hand
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Amanda Kavner
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Richard Lamb.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Human Subject Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration, its later amendments, or comparable ethical standards. Informed consent was obtained from all individual participants included in the study.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lamb, R., Hand, B. & Kavner, A. Computational Modeling of the Effects of the Science Writing Heuristic on Student Critical Thinking in Science Using Machine Learning. J Sci Educ Technol 30, 283–297 (2021). https://doi.org/10.1007/s10956-020-09871-3

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10956-020-09871-3

Keywords

Search

Navigation