Elsevier

Computers in Human Behavior

Volume 68, March 2017, Pages 83-95
Computers in Human Behavior

Full length article
Mobile-Based Assessment: Integrating acceptance and motivational factors into a combined model of Self-Determination Theory and Technology Acceptance

https://doi.org/10.1016/j.chb.2016.11.020Get rights and content

Highlights

  • The study explores students' acceptance of Mobile-Based Assessment (MBA).

  • We propose Mobile Based Assessment - Motivation and Acceptance Model (MBA-MAM).

  • The model is based on Self-Determination Theory and Technology Acceptance Model.

  • Intention to use MBA is explained in terms of motivation and acceptance factors.

Abstract

Mobile-Based Assessment (MBA) is an alternative or complementary to paper- or computer-based assessment delivery mode. Its successful implementation depends on users' acceptance. However, no study exists exploring the factors that influence students' acceptance of mobile-based assessment. Furthermore, research that combines acceptance with motivational factors is limited. The current study builds on the theoretical framework of the Self-Determination Theory (SDT) of Motivation and the Technology Acceptance Model (TAM) and proposes the Mobile Based Assessment - Motivational and Acceptance Model (MBA-MAM), a combined model that explains and predicts Behavioral Intention to Use Mobile-based Assessment. One-hundred and forty students (N = 140) from a European senior-level secondary school participated in mobile-assisted assessment activities and self-reported their perceptions about ΜΒΑ afterwards. Structured equation modeling used to analyze quantitative survey data. The study confirmed the proposed model, explaining and predicting students’ intention to use MBA in terms of both acceptance and motivational (autonomy, competence and relatedness) factors. The study provides a better understanding towards the development of mobile-based assessments by relating acceptance and motivational factors into an integrated model. Implications are discussed within the wider context of mobile learning acceptance research.

Introduction

With the rapid growth of mobile technologies and the widespread adoption of BYOD policies, Mobile-Based Assessment (MBA) has started to emerge as another delivery mode of assessment - alternative and/or complementary to paper- or computer-based testing (Johnson et al., 2016). MBA offers a number of benefits such as easier administration, time and location independence, ubiquity and context awareness, adaptivity, personalization and social interactivity (Nikou & Economides, 2013).However, despite the important learning opportunities that MBA may provide, its successful development depends on user acceptance. The current study investigates acceptance and motivational factors that influence the acceptance of Mobile-Based Assessment.

The study is based on the Self-Determination Theory (SDT) of Motivation (Deci & Ryan, 2002) and the Technology Acceptance Model (TAM) (Davis, 1989) and has two research objectives.

The first objective is to build a model about the acceptance of mobile-based assessment. While many studies exist about mobile learning acceptance (Liu et al., 2010, Park et al., 2012), no study exists to investigate the acceptance of mobile-based assessment. The current study explores students' acceptance of mobile-based assessment introducing the following external variables: educational content with feedback, students’ mobile device-self efficacy, interactivity and collaboration during the assessment process, and the ubiquity features of mobile device. The study examines the impact of these factors on the behavioral intention to use MBA.

The second objective is to introduce motivational variables into technology acceptance. Researchers argue that in order to achieve a more inclusive approach to technology acceptance in educational contexts, there is a need to introduce motivational variables into the technology acceptance models (Pedrotti & Nistor, 2016). The current study introduces into TAM, the SDT motivational variables of autonomy, competence and relatedness and examines their impact on perceived ease of use and perceived usefulness, predicting behavioral intention to use. While studies exist that relate SDT with information technology (Chen and Jang, 2010, Lee et al., 2015) and e-learning acceptance (Sørebø, Halvari, Gulli, & Kristiansen, 2009), to the best of our knowledge, no study exists to investigate mobile-based acceptance based on both TAM and SDT. Our study is aiming to propose a combined model of both acceptance and motivational factors towards the prediction of students’ behavioral intention to use mobile-based assessment.

The study is organized as follows: the next section provides a brief literature review about the Technology Acceptance Model, Self-Determination Theory of Motivation and a combined view of Technology Acceptance and Self-Determination for e-learning and mobile learning and assessment, providing the rationale for modeling MBA acceptance based on SDT and TAM. Next, the study presents the proposed conceptual model with the hypotheses to be tested. Following that, the sections of methodology (participants, instruments and procedure) and the data analysis and results follow. Discussions and conclusions for the impact in education follow next along with the study limitations and future work.

Section snippets

Technology acceptance model

A critical factor for the successful implementation of any information system is its user acceptance. Technology Acceptance Model (TAM) (Davis, 1989) is a well-established model that is based on the psychological interaction of a user with technology and it addresses the issue of how users accept and use information technology. TAM utilizes the constructs of Perceived Usefulness (PU), Perceived Ease of Use (PEOU) and Attitudes Towards Usage (ATU) to explain and predict technology system

Conceptual framework and hypotheses

Based on the Self-Determination Theory of Motivation (SDT) (Deci & Ryan, 1985) and the original Technology Acceptance Model (TAM) (Davis, 1989), the current study is aiming at providing a combined model of SDT and TAM in order to explain and predict Behavioral Intention to Use (BIU) Mobile-Based Assessment. For that purpose, we have developed the following hypotheses.

Participants

The participants were 140 students drawn from five classes from a senior-level high school in an urban area in Europe. Students were enrolled in an environmental course about biodiversity. All students taught by the same STEM instructor, an experience science teacher. There were 65 males (46%) and 75 females (54%). The average age of students was 16.7 (SD = 1.15). All students had had already used mobile devices either for communication, information searching and entertainment purposes or for

Data analysis and results

Partial Least-Squares (PLS) with Smart PLS 2.0 (Ringle, Wende, & Will, 2005) was used as the analysis technique to predict factors influencing mobile-based assessment adoption. Our sample size exceeds the recommended value of 50 e.g.10 times the largest number of independent variables impacting a depended variable (Chin, 1998).

Discussions and conclusions

The current study introduces motivational factors into technology acceptance, in the context of mobile-based assessment, proposing Mobile Based Assessment-Motivational and Acceptance Model (MBA-MAM). While researchers have already recognized the importance of integrating motivational factors into technology acceptance (Fagan et al., 2008, Pedrotti and Nistor, 2016), not many studies exist with few exceptions (Lee et al., 2015, Zhou, 2016). The study employs the constructs of autonomy,

References (80)

  • M.K. Lee et al.

    Acceptance of internet-based learning medium: The role of extrinsic and intrinsic motivation

    Information & Management

    (2005)
  • Y. Lee et al.

    Relating motivation to information and communication technology acceptance: Self-determination theory perspective

    Computers in Human Behavior

    (2015)
  • S.S. Liaw et al.

    An activity-theoretical approach to investigate learners' factors toward e-learning systems

    Computers in Human Behavior

    (2007)
  • Y. Liu et al.

    Factors driving the adoption of m-learning: An empirical study

    Computers & Education

    (2010)
  • H. Lu et al.

    The effects of computer self-efficacy, training satisfaction and test anxiety on attitude and performance in computerized adaptive testing

    Computers & Education

    (2016)
  • K. Mac Callum et al.

    Comparing the role of ICT literacy and anxiety in the adoption of mobile learning

    Computers in Human Behavior

    (2014)
  • J. Mumm et al.

    Designing motivational agents: The role of praise, social comparison, and embodiment in computer feedback

    Computers in Human Behavior

    (2011)
  • S. Narciss et al.

    Exploring feedback and student characteristics relevant for personalizing feedback strategies

    Computers & Education

    (2014)
  • J.C.M. Roca et al.

    Understanding e-learning continuance intention in the workplace: A self-determination theory perspective

    Computers in Human Behavior

    (2008)
  • R.M. Ryan et al.

    Intrinsic and extrinsic motivations: Classic definitions and new directions

    Contemporary Educational Psychology

    (2000)
  • D.Y. Shee et al.

    Multi-criteria evaluation of the web-based e-learning system: A methodology based on learner satisfaction and its applications

    Computer & Education

    (2008)
  • H.-P. Shih

    Assessing the effects of self-efficacy and competence on individual satisfaction with computer use: An IT student perspective

    Computers in Human Behavior

    (2006)
  • H.-J. So et al.

    Student perceptions of collaborative learning, social presence and satisfaction in a blended learning environment: Relationships and critical factors

    Computers & Education

    (2008)
  • Ø. Sørebø et al.

    The role of self-determination theory in explaining teachers' motivation to continue to use e-learning technology

    Computers & Education

    (2009)
  • B. Sumak et al.

    A meta-analysis of e-learning technology acceptance: The role of user types and e-learning technology types

    Computers in Human Behavior

    (2011)
  • V. Terzis et al.

    The acceptance and use of computer based assessment

    Computers & Education

    (2011)
  • V. Terzis et al.

    The effect of emotional feedback on behavioral intention to use computer based assessment

    Computers & Education

    (2012)
  • S.-L. Wang et al.

    The role of feedback and self-efficacy on web-based learning: The social cognitive perspective

    Computers & Education

    (2008)
  • S.J. Yoo et al.

    The roles of intrinsic motivators and extrinsic motivators in promoting e-learning in the workplace: A case from South Korea

    Computers in Human Behavior

    (2012)
  • S. Zhang et al.

    Extending TAM for online learning systems: An intrinsic motivation perspective

    Tsinghua Science & Technology

    (2008)
  • M. Zhou

    Chinese university students' acceptance of MOOCs: A self-determination perspective

    Computers & Education

    (2016)
  • A. Abu-Al-Aish et al.

    Factors influencing students' acceptance of mlearning: An investigation in higher education

    The International Review of Research in Open and Distance Learning

    (2013)
  • S.A. Nikou et al.

    Mobile assessment: state of the art

  • P.P. Baard et al.

    Intrinsic need satisfaction: A motivational basis of performance and well-being in two work settings

    Journal of Applied Social Psychology

    (2004)
  • Z. Bogdanovic et al.

    Evaluation of mobile assessment in a learning management system

    British Journal of Educational Technology

    (2013)
  • L. Briz-Ponce et al.

    Learning with mobile technologies – students' behavior

    Computers in Human Behavior

    (25 May 2016)
  • K. Burden et al.

    Research in Science Education

    (2016)
  • K.-C. Chen et al.

    Motivation in online learning: Testing a model of self-determination theory

    Computers in Human Behavior

    (2010)
  • W.W. Chin

    The partial least squares approach to structural equation Modeling

  • D. Compeau et al.

    Computer self-efficacy: development of a measure and initial test

    MIS Quarterly

    (1995)
  • Cited by (250)

    • Why drivers use in-vehicle technology: The role of basic psychological needs and motivation

      2024, Transportation Research Part F: Traffic Psychology and Behaviour
    View all citing articles on Scopus
    View full text