Elsevier

Computers & Education

Volume 55, Issue 1, August 2010, Pages 363-377
Computers & Education

The identification, implementation, and evaluation of critical user interface design features of computer-assisted instruction programs in mathematics for students with learning disabilities

https://doi.org/10.1016/j.compedu.2010.02.002Get rights and content

Abstract

Critical user interface design features of computer-assisted instruction programs in mathematics for students with learning disabilities and corresponding implementation guidelines were identified in this study. Based on the identified features and guidelines, a multimedia computer-assisted instruction program, ‘Math Explorer’, which delivers addition and subtraction word problem-solving instruction for students with learning disabilities at the early elementary level, was designed and developed. Lastly, usability testing was conducted to assess whether Math Explorer was well-designed in terms of the interface for students with learning disabilities. Given the results of the usability testing, this study corroborated the fact that the critical user interface design features and guidelines in mathematics computer-assisted instruction programs would be essential for facilitating the mathematical learning of students with learning disabilities. Implications for practice and future research were discussed.

Introduction

With the advanced technology of the past decade, researchers in the field of special education have made efforts to incorporate technology into the instructional curriculum for students with a wide range of disabilities in order to enhance their learning outcomes in an effective and efficient way (Ferretti and Okolo, 1996, Torgesen and Barker, 1995, Woodward and Carnine, 1993). Such efforts have made it possible for students with learning disabilities (LD) to gain access to technology which assists their learning in various subject areas such as reading, mathematics, social studies, and science (Woodward & Carnine, 1993).

In mathematics, such technology has been advocated as a potential tool for students with LD to foster their successful learning (Lin et al., 1994, Okolo, 1992a, Robinson et al., 1989). Because of the comprehensive and abstract natures of mathematics, students with LD require a sufficient number of fast-paced practices, modeling with representative examples, and immediate feedback to learn and understand mathematics (Fuchs et al., 2008, Swanson et al., 1999). Such vital instructional components can be effectively delivered by technology (Anderson-Inman, Knox-Quinn, & Horney, 1996). Also, with technology, mathematics instruction can be individualized and adapted for students with LD to meet their special learning characteristics (National Council of Teachers of Mathematics (NCTM), 2000). Given these assets, a new trend of emphasizing technology as one of the critical mathematics instructional features for students with LD has been created in the field of special education (Hasselbring et al., 1988, Swanson et al., 1999, Symington and Stranger, 2000).

As a result of this trend, a large body of research involving computer-assisted instruction (CAI), defined as the use of a computer to provide instructional content, in mathematics for students with LD has emerged and proved CAI’s effectiveness in teaching mathematics to these students (Adydin, 2005, Gleason et al., 1990, Lewis, 1998). For example, several group-design CAI studies (Moore, 1988, Trifiletti et al., 1984, Watkins and Webb, 1981) focusing on CAI versus teacher-directed instruction (TDI) found that the students in the CAI group outperformed their counterparts in the TDI group. Similarly, two single-subject design CAI studies (Howell et al., 1987, Wilson et al., 1996) focusing CAI versus TDI reported that the student(s) with LD showed achievement gains during the CAI intervention period only. These CAI studies successfully demonstrated that CAI was an effective method of improving the mathematical skills of students with LD. These studies, however, did not fully describe the CAI programs’ design features, which were the key to facilitating students’ mathematical learning (Seo & Bryant, 2009). The importance of the design features of CAI programs has been emphasized in a review of media research by Clark (1983) who claimed that the instructional principles and features embedded in CAI programs, rather than a CAI program itself, are the critical factors most closely related to students’ positive academic outcomes. In response to Clark’s argument, several researchers conducted CAI studies focusing on the effects of the instructional features (e.g., cognitive strategy or mnemonic strategy) embedded in CAI programs on the mathematical performance of students with LD and argued that these instructional features helped create successful mathematical learning outcomes for these students (Irish, 2002, Okolo, 1992b, Shiah et al., 1994).

In line with these CAI studies in mathematics for students with LD, the critical instructional features of CAI programs for students with LD have been emphasized, but the orthogonal technical issue regarding how to effectively deliver such instructional features has not been fully addressed. In other words, a good user interface scheme for delivering such instructional features effectively via the interaction between CAI programs and students with LD has not been explored. In general, a well-designed user interface plays a crucial role in delivering the content, maintaining users’ attention and interest in the content, and increasing users’ interaction with CAI programs (Cho et al., 2009, Hinostroza and Mellar, 2001). Such interaction with CAI programs can cause users to actively participate in the learning process, comprehend instruction, and, finally, improve their learning outcomes (Cho et al., 2009, Chou, 2003, Crowther et al., 2004, Hinostroza and Mellar, 2001). Particularly, in the case of mathematics CAI programs, instruction regarding abstract mathematical concepts and relationships can be effectively delivered by using various user interface features (e.g., interactive graphics and virtual simulation), thereby increasing students’ mathematical learning and understanding (Akpinar and Hartley, 1996, Kong, 2008, Pierce et al., 2007, Reimer and Moyer, 2005, Steffe and Olive, 1996). For example, interactive two- and three-dimensional graphics embedded in mathematics CAI programs allow students to visually explore the properties of geometric shapes and help them understand geometric relationships (Ittigson and Zewe, 2003, Steen et al., 2006). Given the importance of the user interface design of CAI programs for students’ mathematical learning, many studies in the field of educational technology have analyzed the critical user interface design features of mathematics CAI programs (Baki and Güveli, 2008, Jonassen et al., 2003, Kong, 2008, Pierce et al., 2007). Because the previous studies targeted normally achieving students who do not have LD or learning difficulties, rather than students with LD, a systematic analysis of the critical user interface design features of mathematics CAI programs for students with LD has been limited. In fact, there is a dearth of studies focusing on the user interface design features of mathematics CAI programs for students with LD based on an in-depth analysis of their mathematical performance and biological characteristics. Therefore, little is known about how the user interface of such CAI programs must be designed for students with LD in order to effectively deliver mathematics instructions and, consequently, improve their mathematical learning.

Given the absence of this information, this study was conducted to (1) identify the critical user interface design features of mathematics CAI programs for students with LD, (2) design and develop a multimedia CAI program, ‘Math Explorer,’ to demonstrate how the identified user interface design features could be practically embedded in mathematics CAI programs for students with LD and (3) conduct usability testing to assess whether Math Explorer was usefully designed in terms of its interface for students with LD.

Section snippets

Identification of critical user interface design features of CAI programs in mathematics for students with LD

To identify the critical user interface design features of mathematics CAI programs for students with LD, this study analyzed the relationship between the mathematical performance and biological characteristics of students with LD, and the critical mathematics instructional features for these students through a review of related studies in the field of special education (Bryant et al., 2008, Carnine, 1997, Geary, 1990, Geary, 1993, Geary, 2004, Geary et al., 1991, Geary et al., 2000, Geary et

Implementation of critical user interface design features of CAI programs in mathematics for students with LD: Math Explorer development

A multimedia CAI program, ‘Math Explorer,’ was designed and developed to demonstrate how the identified user interface design features and guidelines could be practically embedded in mathematics CAI programs for students with LD. Math Explorer was created by the researcher using Macromedia Flash Professional 8 (Macromedia, 2006) through consultations with the professors and graduate students in the department of instructional technology and the graduate students in the department of computer

Evaluation of critical user interface design features of CAI Program in mathematics for students with LD: Math Explorer usability testing

Upon completion of Math Explorer’s development, the first usability testing was conducted to assess whether Math Explorer was usefully designed in terms of the interface for students with LD and obtain participants’ feedback for revising the program. After revising Math Explorer based on the results of the first usability testing, the second usability testing was conducted to assess whether the program’s interface features were improved and well-designed for students with LD. All procedures and

Results

The scores for each usability task question for tasks 1 and 2 were collected, summed and averaged. Table 4 shows that the teachers’ average rating scores for tasks 1 and 2 in the first usability testing were 4.78 and 4.82, respectively. Given the fact that 5.0 was a maximum average score, the results for tasks 1 and 2 indicated that the teachers were satisfied with the overall interface design features of Math Explorer and able to execute the instructional activities successfully. Table 4 also

Conclusions

In the field of special education, the instructional features of mathematics CAI programs have been emphasized and considered as critical factors to improve the mathematical performance of students with LD (Seo & Bryant, 2009). Beyond the instructional features, the user interface design features of mathematics CAI programs are also critical because the instructional features can be effectively delivered depending on how the interface of mathematics CAI programs is designed. However, there is a

References (85)

  • E. Adydin

    The use of computers in mathematics education: A paradigm shift from “computer assisted instruction” towards “students programming”

    The Turkish Online Journal of Educational Technology

    (2005)
  • A. Akpinar et al.

    Designing interactive learning environments

    Journal of Computer Assisted Learning

    (1996)
  • L. Anderson-Inman et al.

    Computer based study strategies for students with learning disabilities: Individual differences associated with adoption level

    Journal of Learning Disabilities

    (1996)
  • B.C. Babbit et al.

    Using hypermedia to improve the mathematics problem-solving skills of students with learning disabilities

    Journal of Learning Disabilities

    (1996)
  • Babbitt, B. C. (1999). 10 tips for software selection for math instruction....
  • D. Banes et al.

    The Internet: A new frontier for pupils with severe learning difficulties

    British Journal of Special Education

    (1997)
  • H.J. Becker et al.

    Equity in school computer use: National data and neglected considerations

    Journal of Educational Computing Research

    (1987)
  • N.S. Bley et al.

    Teaching mathematics to students with learning disabilities

    (2001)
  • B.R. Bryant et al.

    Preventing mathematics difficulties in the primary grades: The critical features of instruction in textbooks as part of equation

    Learning Disability Quarterly

    (2008)
  • D. Carnine

    Instructional design in mathematics for students with learning disabilities

    Journal of Learning Disabilities

    (1997)
  • D. Carnine et al.

    Effective strategies for teaching mathematics

  • C. Chou

    Interactivity and interactive functions in web-based learning systems: A technical framework for designers

    British Journal of Educational Technology

    (2003)
  • M.S. Crowther et al.

    Improving the quality and effectiveness of computer-mediated instruction through usability evaluations

    British Journal of Educational Technology

    (2004)
  • J. Davidoff

    The role of colour in visual displays

    International Reviews of Ergonomics

    (1987)
  • T. Faiola

    Principles and guidelines for screen display interface

    The Videodisc Monitor

    (1989)
  • T. Faiola et al.

    Designing a visual factors-based screen display interface. The new role of the graphic technologist

    Educational Technology

    (1988)
  • R.P. Ferretti et al.

    Authenticity in learning: Multimedia design projects in the social studies for students with disabilities

    Journal of Learning Disabilities

    (1996)
  • L.S. Fuchs et al.

    Intensive intervention for students with mathematics disabilities: Seven principles of effective practice

    Learning Disability Quarterly

    (2008)
  • W.O. Galitz

    Handbook of screen format design

    (1989)
  • K.H. Garner

    20 Rules for arranging text on a screen

    CBT Directions

    (1990)
  • D.C. Geary

    Mathematical disabilities: Cognitive, neuropsychological, and genetic components

    Psychological Bulletin

    (1993)
  • D.C. Geary

    Mathematics and learning disabilities

    Journal of Learning Disabilities

    (2004)
  • D.C. Geary et al.

    Cognitive addition: A short longitudinal study of strategy choice and speed-of-processing differences in normal and mathematically disabled children

    Developmental Psychology

    (1991)
  • D.C. Geary et al.

    Numerical and arithmetical cognition: Patterns of functions and deficits in children at risk for a mathematical disability

    Journal of Experimental Child Psychology

    (1999)
  • M. Gleason et al.

    Improving CAI effectiveness with attention to instructional design in teaching story problems to mildly handicapped students

    Journal of Special Education Technology

    (1990)
  • T.S. Hasselbring et al.

    Developing math automaticity in learning handicapped children: The role of computerized drill and practice

    Focus on Exceptional Children

    (1988)
  • K. Higgins et al.

    Evaluating educational software for special education

    Intervention in School and Clinic

    (2000)
  • Higgins, K., Boone, R., & Pierce, T. B. (2005). Evaluating software for use by students with disabilities to foster...
  • R. Howell et al.

    The effects of computer use on the acquisition of multiplication facts by a student with learning disabilities

    Journal of Learning Disabilities

    (1987)
  • P. Hudson et al.

    Designing and implementing mathematics instruction for students with diverse learning needs

    (2006)
  • C. Irish

    Using peg- and keyword mnemonics and computer-assisted instruction to enhance basic multiplication performance in elementary students with learning and cognitive disabilities

    Journal of Special Education Technology

    (2002)
  • R.J. Ittigson et al.

    Technology in the mathematics classroom

  • Cited by (55)

    • Effectiveness of digital-based interventions for children with mathematical learning difficulties: A meta-analysis

      2020, Computers and Education
      Citation Excerpt :

      Design features recommendations also include reducing the amount of instructions, using visually attractive animations and graphics as well as graphic characters to increase the learning motivation. It is also recommended to locate the mechanics in a playful environment, to avoid using too many –potentially distracting– graphics unrelated to the instructional purposes, and to present simple and consistent interfaces acting as a background for the game activities (e.g. Cezarotto; Battaiola, 2016; Seo & Woo, 2010). Highly innovative intervention programs as well as adaptive computer videogames based on neuroscience research have been recently developed for the remediation of dyscalculia (e.g. Butterworth et al., 2011; Kucian et al., 2011; Räsänen, Salminen, Wilson, Aunio, & Dehaene, 2009; Wilson et al., 2006).

    • Design principles of an interactive tangible mobile application for students with specific learning disabilities

      2023, Closing the Educational Achievement Gap for Students With Learning Disabilities
    • Influence of Website-Based E-Learning in the Pandemic Era: Improving Students’ Creative Thinking Skills through Educational Management

      2022, International Journal on E-Learning: Corporate, Government, Healthcare, and Higher Education
    View all citing articles on Scopus
    View full text