Skip to main content
Log in

Effects of disfluency and test expectancy on learning with text

  • Published:
Metacognition and Learning Aims and scope Submit manuscript

Abstract

Do students learn better with texts that are (i.e., disfluent)? Previous research yielded discrepant findings concerning this question. To clarify these discrepancies, the present study aimed at identifying a boundary condition that determines when disfluent text is, and is not, beneficial to learning. This boundary condition is knowledge about whether a test will follow (high test expectancy) versus not (low test expectancy). Participants with high test expectancy may already engage in effortful processing, so that making text harder-to-read (disfluent) might not change their processing mode any further. Thus, particularly when no test is expected, disfluency is supposed to exert its beneficial effect. This assumption was tested in a 2 × 2 design (N = 97) with text legibility (fluent vs. disfluent) and test expectancy (low vs. high) as factors, and learning outcomes (retention, transfer) and learning times as main dependent variables. Results revealed that high test expectancy led to better learning outcomes (for retention and transfer), but disfluent text did not. Unlike expected, there was no interaction between the two factors. Moreover, both high test expectancy and disfluency led to longer learning times, resulting in a lower efficiency when learning with disfluent compared to fluent text. Hence, the present results further question the stability and generalizability of a positive disfluency effect on learning, because only high test expectancy – but not disfluency - stimulated better learning through more effortful processing the way it was supposed to.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

Notes

  1. We chose this procedure, because participants in the same group had to work on all the tests simultaneously. Given that learning times were expected to differ rather greatly between the condition with “reading” (low test expectancy) versus “learning” (high test expectancy) instruction, homogeneous groups for this factor were used to rule out the fact that participants with low test expectancy would have had worse learning outcomes, because they finished studying (reading) earlier and therefore had to wait longer for the assessment than participants with high test expectancy. Thus, the potentially confounding factor of a longer delay between studying and testing was diminished by testing groups with low vs. high test expectancy separately. Moreover, to assess its potential impact within the homogeneous groups, the delay between finishing the learning phase and starting with the knowledge test was logged.

  2. To test whether students would quickly adapt to the increased difficulty in reading the disfluent font, we included the position of the page (page 1 vs. page 2 vs. page 3) as within-subjects factor in a 3 × 2 × 2 ANOVA mixed design, with text legibility and test expectancy as between-subjects factors. If students quickly adapted to the font, an interaction between position of the page and text legibility should be found: Learning times should be longer in the disfluent than in the fluent conditions, especially in the beginning of the instruction (on page 1), and this difference should decrease across pages. However, the analysis revealed no interaction between page position and text legibility (F < 1), suggesting that quick adaptation to the disfluent font did not play a major role. The three remaining interactions, including the three-way interaction, were also not significant (all p s  > .15).

  3. The specific predictions made by the moderated disfluency hypothesis could also not be confirmed when testing the hypothesized pattern of results directly, that is, by using orthogonal contrast analysis (cf. Niedenthal et al. 2002).

References

  • Alter, A. L., & Oppenheimer, D. M. (2009). Uniting the tribes of fluency to form a metacognitive nation. Personality and Social Psychology Review, 13, 219–235. doi:10.1177/1088868309341564.

    Article  Google Scholar 

  • Alter, A. L., Oppenheimer, D. M., Epley, N., & Eyre, R. N. (2007). Overcoming intuition: metacognitive difficulty activates analytic reasoning. Journal of Experimental Psychology: General, 136, 569–576. doi:10.1037/0096-3445.136.4.569.

    Article  Google Scholar 

  • Ball, B. H., Klein, K. N., & Brewer, G. A. (2014). Processing fluency mediates the influence of perceptual information on monitoring learning of educationally relevant materials. Journal of Experimental Psychology: Applied, 20, 336–348. doi:10.1037/xap0000023.

    Google Scholar 

  • Bertsch, S., Pesta, B. J., Wiscott, R., & McDaniel, M. A. (2007). The generation effect: a meta-analytic review. Memory and Cognition, 35, 201–210. doi:10.3758/BF03193441.

    Article  Google Scholar 

  • Bjork, E. L., & Bjork, R. A. (2011). Making things hard on yourself, but in a good way: Creating desirable difficulties to enhance learning. In M. A. Gernsbacher, R. W. Pew, L. M. Hough, & J. R. Pomerantz (Eds.), Psychology and the real world: Essays illustrating fundamental contributions to society (pp. 56–64). New York: Worth Publishers.

    Google Scholar 

  • Bjork, R. A., Dunlosky, J., & Kornell, N. (2013). Self-regulated learning: beliefs, techniques, and illusions. Annual Review of Psychology, 64, 417–444. doi:10.1146/annurev-psych-113011-143823.

    Article  Google Scholar 

  • Bless, H., Wänke, M., Bohner, G., Fellhauer, R. F., & Schwarz, N. (1994). Need for Cognition: Eine Skala zur Erfassung von Engagement und Freude bei Denkaufgaben [Need for cognition:Ascale measuring engagement and happiness in cognitive tasks]. Zeitschrift für Sozialpsychologie, 25, 147–154.

    Google Scholar 

  • Craik, F. I. M., & Lockhart, S. E. (1972). Levels of processing: a framework for memory research. Journal of Verbal Learning and Verbal Behavior, 11, 671–684. doi:10.1016/S0022-5371(72)80001-X.

    Article  Google Scholar 

  • Diemand-Yauman, C., Oppenheimer, D. M., & Vaughan, E. B. (2011). Fortune favors the bold (and the italicized): effects of disfluency on educational outcomes. Cognition, 118, 114–118. doi:10.1016/j.cognition.2010.09.012.

    Article  Google Scholar 

  • Eitel, A., Kühl, T., Scheiter, K., & Gerjets, P. (2014). Disfluency meets cognitive load in multimedia learning: does harder-to-read mean better-to-understand? Applied Cognitive Psychology, 28, 488–501. doi:10.1002/acp.3004.

    Article  Google Scholar 

  • French, M. M. J., Blood, A., Bright, N. D., Futak, D., Grohmann, M. J., Hasthorpe, A., Heritage, J., Poland, R. L., Reece, S., & Tabor, J. (2013). Changing fonts in education: how the benefits vary with ability and dyslexia. The Journal of Educational Research, 106, 301–304. doi:10.1080/00220671.2012.736430.

    Article  Google Scholar 

  • Gao, X., Levinthal, B. R., & Stine-Morrow, E. A. (2012). The effects of ageing and visual noise on conceptual integration during sentence reading. The Quarterly Journal of Experimental Psychology, 65, 1833–1847. doi:10.1080/17470218.2012.674146.

    Article  Google Scholar 

  • Graesser, A. C., Singer, M., & Trabasso, T. (1994). Constructing inferences during narrative text comprehension. Psychological Review, 101, 371–395. doi:10.1037/0033-295X.101.3.371.

    Article  Google Scholar 

  • Guenther, R. K. (2012). Does the processing fluency of a syllabus affect the forecasted grade and course difficulty? Psychological Reports, 110, 946–954. doi:10.2466/01.11.28.PR0.110.3.946-954.

    Article  Google Scholar 

  • Kühl, T. & Eitel, A. (in press). Effects of disfluency on cognitive and metacognitive processes and outcomes. Metacognition and Learning. (this issue).

  • Kühl, T., Eitel, A., Damnik, G., & Körndle, H. (2014a). The impact of disfluency, pacing, and students’ need for cognition on learning with multimedia. Computers in Human Behavior, 35, 189–198. doi:10.1016/j.chb.2014.03.004.

    Article  Google Scholar 

  • Kühl, T., Eitel, A., Scheiter, K., & Gerjets, P. (2014b). A call for an unbiased search for moderators in disfluency research: reply to Oppenheimer and Alter (2014). Applied Cognitive Psychology, 28, 805–806. doi:10.1002/acp.3030.

    Article  Google Scholar 

  • Lehmann, J., Goussios, C., & Seufert, T. (2015). Working memory capacity and disfluency effect: An aptitude-treatment-interaction study. Metacognition and Learning. doi:10.1007/s11409-015-9149-z.

  • Lorch, R. F., Lorch, E. P., & Klusewitz, M. A. (1993). College students’ conditional knowledge about reading. Journal of Educational Psychology, 85, 239–252. doi:10.1037/0022-0663.85.2.239.

    Article  Google Scholar 

  • Magreehan, D. A., Serra, M. J., Schwartz, N. H., & Narciss, S. (2015). Further boundary conditions for the effects of perceptual disfluency on judgments of learning. Metacognition and Learning. doi:10.1007/s11409-015-9147-1. (this issue).

  • Maki, R. H., Foley, J. M., Kajer, W. K., Thompson, R. C., & Willert, M. G. (1990). Increased processing enhances calibration of comprehension. Journal of Experimental Psychology: Learning, Memory, and Cognition, 16, 609. doi:10.1037/0278-7393.16.4.609.

    Google Scholar 

  • Mautone, P. D., & Mayer, R. E. (2001). Signaling as a cognitive guide in multimedia learning. Journal of Educational Psychology, 93, 377–389. doi:10.1037/0022-0663.93.2.377.

    Article  Google Scholar 

  • Mayer, R. E. (2009). Multimedia learning (2nd ed.). Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • McCrudden, M. T., Schraw, G., & Lehman, S. (2009). The use of adjunct displays to facilitate comprehension of causal relationships in expository text. Instructional Science, 37, 65–86. doi:10.1007/s11251-007-9036-3.

    Article  Google Scholar 

  • McDaniel, M. A., Blischak, D. M., & Challis, B. (1994). The effects of test expectancy on processing and memory of prose. Contemporary Educational Psychology, 19, 230–248. doi:10.1006/ceps.1994.1019.

    Article  Google Scholar 

  • Niedenthal, P. M., Brauer, M., Robin, L., & Innes-Ker, Å. H. (2002). Adult attachment and the perception of facial expression of emotion. Journal of Personality and Social Psychology, 82, 419–433. doi:10.1037/0022-3514.82.3.419.

    Article  Google Scholar 

  • Oppenheimer, D. M., & Alter, A. L. (2014). The search for moderators in disfluency research. Applied Cognitive Psychology, 28, 502–504. doi:10.1002/acp.3023.

    Article  Google Scholar 

  • Richland, L. E., Bjork, R. A., Finley, J. R., & Linn, M. C. (2005). Linking cognitive science to education: Generation and interleaving effects. In B. G. Bara, L. Barsalou, & M. Bucciarelli (Eds.), Proceedings of the twenty-seventh annual conference of the cognitive science society. Mahwah: Lawrence Erlbaum.

    Google Scholar 

  • Rummer, R., Schweppe, J., & Schwede, A. (2015). Fortune is fickle: Null-effects of disfluency on educational outcomes. Metacognition and Learning. doi:10.1007/s11409-015-9151-5.

  • Salomon, G. (1984). Television is “easy” and print is “tough”: the differential investment of mental effort in learning as a function of perceptions and attributions. Journal of Educational Psychology, 76, 647–658. doi:10.1037/0022-0663.76.4.647.

    Article  Google Scholar 

  • Schneider, W., Schlagmüller, M. & Ennemoser, M. (2007). Lesegeschwindigkeits- und verständnistest für die Klassenstufen 6–12 (LGVT 6–12) [Reading speed and comprehension test for class levels 6–12]. Göttingen: Hogrefe.

  • Song, H., & Schwarz, N. (2008). If it’s hard to read, it’s hard to do. Psychological Science, 19, 986–988. doi:10.1111/j.1467-9280.2008.02189.x.

    Article  Google Scholar 

  • Strukelj, A., Scheiter, K., Nyström, M., Oliva, M., & Holmqvist, K. (2015). Exploring the lack of a disfluency effect: Evidence from eye movements. Metacognition and Learning. doi:10.1007/s11409-015-9146-2. (this issue).

  • Sungkhasettee, V. W., Friedman, M. C., & Castel, A. D. (2011). Memory and metamemory for inverted words: illusions of competency and desirable difficulties. Psychonomic Bulletin and Review, 18, 973–978. doi:10.3758/s13423-011-0114-9.

    Article  Google Scholar 

  • Szpunar, K. K., McDermott, K. B., & Roediger, H. L., III. (2007). Expectation of a final cumulative test enhances long-term retention. Memory and Cognition, 35, 1007–1013. doi:10.3758/BF03193473.

    Article  Google Scholar 

  • Thiede, K. W., Wiley, J., & Griffin, T. D. (2011). Test expectancy affects metacomprehension accuracy. British Journal of Educational Psychology, 81, 264–273. doi:10.1348/135910710X510494.

    Article  Google Scholar 

  • Thompson, V. A., Turner, J. A. P., Pennycook, G., Ball, L. J., Brack, H., Ophir, Y., & Ackerman, R. (2013). The role of answer fluency and perceptual fluency as metacognitive cues for initiating analytic thinking. Cognition, 128, 237–251. doi:10.1016/j.cognition.2012.09.012.

    Article  Google Scholar 

  • Van den Broek, P., Lorch, R. F., Linderholm, T., & Gustafson, M. (2001). The effects of readers’ goals on inference generation and memory for texts. Memory and Cognition, 29(8), 1081–1087. doi:10.3758/BF03206376.

    Article  Google Scholar 

  • Yue, C. L., Castel, A. D., & Bjork, R. A. (2013). When disfluency is—and is not—a desirable difficulty: the influence of typeface clarity on metacognitive judgments and memory. Memory and Cognition, 41, 229–241. doi:10.3758/s13421-012-0255-8.

    Article  Google Scholar 

Download references

Acknowledgments

Special thanks to Thérése-Felicitas Eder for the assistance in conducting the studies.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alexander Eitel.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Eitel, A., Kühl, T. Effects of disfluency and test expectancy on learning with text. Metacognition Learning 11, 107–121 (2016). https://doi.org/10.1007/s11409-015-9145-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11409-015-9145-3

Keywords

Navigation