Skip to main content
Log in

Psychometric properties of a computerized adaptive test for assessing mobility in older adults using novel video-animation technology

  • Published:
Quality of Life Research Aims and scope Submit manuscript

Abstract

Purpose

This paper reports on the psychometric properties of a computerized adaptive test (CAT) version of the Mobility Assessment Tool (MAT) for older adults (MAT-CAT).

Methods

An item pool of 78 video-animation-based items for mobility was developed, and response data were collected from a sample of 234 participants aged 65–90 years. The video-animation-based instrument was designed to minimize ambiguity in the presentation of task demands. In addition to evaluating traditional psychometric properties including dimensionality, differential item functioning (DIF), and local dependence, we extensively tested the performance of several MAT-CAT measures and compared their performances with a fixed format.

Results

Operationally, the MAT-CAT was sufficiently unidimensional and had acceptable levels of local independence. One DIF item was removed. Most importantly, the CAT measures showed that even starting with a single fixed item at the mean ability, the adaptive version delivered better performance than the fixed format in terms of several criteria including the standard error of estimate.

Conclusion

The MAT-CAT demonstrated satisfactory psychometric properties and superior performance to a fixed format. The video-animation-based adaptive instrument can be used for assessing mobility with specificity and precision.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Abbreviations

DIF:

Differential item functioning

MAT:

Mobility Assessment Tool

HRQOL:

Health-related quality of life

PRO:

Patient-reported outcome

HIPAA:

Health Insurance Portability and Accountability Act of 1996

CAT:

Computerized adaptive test

References

  1. Rejeski, W. J., Mihalko, S. (2001). Physical activity and quality of life in older adults. The Journals of Gerontology, 56A(Special Issue II), 23–35.

  2. Guralnik, J. M., Ferrucci, L., Simonsick, E. M., Salive, M. E., & Wallace, R. B. (1994). A short physical performance battery assessing lower extremity function: Association with self-reported disability and prediction of mortality and nursing home admission. The Journals of Gerontology, 49, M85–M94.

    CAS  Google Scholar 

  3. Newman, A. B., Simonsick, E. M., Naydeck, B. L., et al. (2006). Association of long-distance corridor walk performance with mortality, cardiovascular disease, mobility limitation, and disability. JAMA, 295(17), 2018–2026.

    Article  PubMed  CAS  Google Scholar 

  4. Ware, J. E., Kosinski, M., & Keller, S. K. (1994). SF-36 physical and mental health summary scales: A user’s manual. Boston, MA: The Health Institute.

    Google Scholar 

  5. Cella, D. F., Tulsky, D. S., Gray, G., et al. (1993). The functional assessment of cancer therapy scale: Development and validation of the general measure. Journal of Clinical Oncology, 11(3), 570–579.

    PubMed  CAS  Google Scholar 

  6. Rejeski, W., Ip, E., Marsh, A., Miller, M., & Farmer, D. (2008). Measuring disability in older adults: The ICF framework. Geriatrics & Gerontology International, 8(1), 48–54.

    Article  Google Scholar 

  7. Reeve, B. B., Hays, R. D., Bjorner, J. B., et al. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care, 45, S22–S31.

    Article  PubMed  Google Scholar 

  8. Marsh, A. P., Ip, E. H., Barnard, R. T., Wong, Y. L., & Rejeski, W. J. (2011). Using video animation to assess mobility in older adults. Journals of Gerontology. Series A, Biological Sciences and Medical Sciences, 66(2), 217–227.

    Article  Google Scholar 

  9. Rejeski, W. J., Ip, E. H., Marsh, A. P., & Barnard, R. T. (2010). Development and validation of a video-animated tool for assessing mobility. Journals of Gerontology. Series A, Biological Sciences and Medical Sciences, 65(6), 664–671.

    Article  Google Scholar 

  10. Curcio, C. L., Gómez, J. F., Lord, C., Ip, E. H., Marsh, A. P., Rejeski, W. J., Alvarado, B. E. (2011). Validity and reliability of Spanish version of the Mobility Assessment Tool short version: Results from a Colombian study in elderly populations. Presented at the 2011 Canadian Association on Gerontology Pan-American Congress on Geriatrics and Gerontology, Ottawa, Canada, October 2011.

  11. Wainer, H., et al. (Eds.). (2000). Computerized adaptive testing: A primer (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  12. R Development Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. 2011. ISBN: 3-900051-07-0, http://www.R-project.org/.

  13. Rizopoulos, D. (2006). ltm: An R package for latent variable modeling and item response theory analyses. Journal of Statistical Software, 17(5), 1–25.

    Google Scholar 

  14. Gibbons, R. D., & Hedeker, D. R. (1992). Full-information item bifactor analysis. Psychometrika, 57(3), 423–436.

    Article  Google Scholar 

  15. Sharma, S., Mukherjee, S., Kumar, A., & Dillon, W. R. (2005). A simulation study to investigate the use of cutoff values for assessing model fit in covariance structure models. Journal of Business Research, 58(1), 935–943.

    Article  Google Scholar 

  16. Yen, W. M. (1984). Effects of local item dependence on the fit and equating performance of the three-parameter logistic model. Applied Psychological Measurement, 8(2), 125–145.

    Article  Google Scholar 

  17. Hochberg, Y. (1988). A sharper Bonferroni procedure for multiple tests of significance. Biometrika, 75(4), 800–802.

    Article  Google Scholar 

  18. Lord, F. M. (1977). A broad-range tailored test of verbal ability. Applied Psychological Measurement, 1(1), 95–100.

    Article  Google Scholar 

  19. Cai, L., Thissen, D., & du Toit, S. (2011). IRTPRO user’s guide. Lincolnwood: Scientific Software International, IL.

    Google Scholar 

  20. Muthén, L. K., & Muthén, B. O. (2007). Mplus user’s guide (5th ed.). Los Angeles, CA: Muthén & Muthén.

    Google Scholar 

  21. Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B, 57(1), 289–300.

    Google Scholar 

Download references

Acknowledgments

The research has been supported by the following grants from the National Institute of Aging: P30 AG21332.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Edward H. Ip.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ip, E.H., Rejeski, W.J., Marsh, A.P. et al. Psychometric properties of a computerized adaptive test for assessing mobility in older adults using novel video-animation technology. Qual Life Res 22, 1907–1915 (2013). https://doi.org/10.1007/s11136-012-0346-9

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11136-012-0346-9

Keywords

Navigation