Skip to main content

Advertisement

SpringerLink
Log in

Calibration and initial validation of a general self-efficacy item bank and short form for the NIH PROMIS®

  • Published:
Quality of Life Research Aims and scope Submit manuscript

Abstract

Aims

General self-efficacy is associated with adaptive coping and positive health outcomes. The Patient-Reported Outcomes Measurement Information System (PROMIS®) has developed self-efficacy item banks for managing chronic conditions, but lacks a general self-efficacy measure. We sought to refine and validate an item-response theory (IRT)-based measure of general self-efficacy for PROMIS®.

Methods

Ten items were modified from the NIH Toolbox® Self-Efficacy Item Bank by creating “confidence” response options, and administered to a general population sample (n = 1000) with the Toolbox® Self-Efficacy Item Bank, Life Orientation Test-Revised (LOT-R), and Generalized Expectancy for Success Scale (GESS). We split the sample in half for exploratory factor analysis (EFA) followed by confirmatory factor analysis (CFA). IRT analyses included evaluation of differential item functioning (DIF).

Results

Participants had a mean age of 47.8 years and 50.3% were male. EFA showed all items loaded onto one dominant factor and CFA yielded a good fitting model for a general self-efficacy bank with confidence response options (CFI = 0.987, TLI = 0.984, RMSEA = 0.090). Items showed no evidence of DIF by gender, age, education, or race. Internal consistency reliability was α = .94 and .88 for a new 10-item general self-efficacy bank and 4-item short form, respectively. The new bank was correlated with the LOT-R (r = .58), the GESS (r = .55), and the Toolbox® Self-Efficacy Item Bank (r = .87).

Conclusions

The PROMIS® General Self-Efficacy measure demonstrated sufficient unidimensionality and displayed good internal consistency reliability, model fit, and convergent validity. Further psychometric testing of the PROMIS® General Self-Efficacy Item Bank and Short Form can evaluate its utility in people with chronic health conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Bandura, A. (1997). Self-efficacy: The exercise of control. New York: W.H. Freeman.

    Google Scholar 

  2. Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78.

    Article  CAS  PubMed  Google Scholar 

  3. Carver, C. S., & Scheier, M. (1981). Attention and self-regulation. New York: Springer.

    Book  Google Scholar 

  4. Rahman, A., et al. (2008). Factors affecting self-efficacy and pain intensity in patients with chronic musculoskeletal pain seen in a specialist rheumatology pain clinic. Rheumatology, 47(12), 1803–1808.

    Article  CAS  PubMed  Google Scholar 

  5. Schwerdtfeger, A., Konermann, L., & Schönhofen, K. (2008). Self-efficacy as a health-protective resource in teachers? A biopsychological approach. Health Psychology, 27(3), 358–368.

    Article  PubMed  Google Scholar 

  6. Jones, F., Partridge, C., & Reid, F. (2008). The Stroke Self-Efficacy Questionnaire: Measuring individual confidence in functional performance after stroke. Journal of Clinical Nursing, 17(7b), 244–252.

    Article  PubMed  Google Scholar 

  7. Merluzzi, T. V., et al. (2001). Self-efficacy for coping with cancer: Revision of the Cancer Behavior Inventory (version 2.0). Psychooncology, 10(3), 206–217.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  8. Merluzzi, T. V., et al. (2018). Self-efficacy for coping with cancer: Revision of the Cancer Behavior Inventory (Version 3.0). Psychol Assessment, 30(4), 486–499.

    Article  Google Scholar 

  9. Sheeran, P., et al. (2016). The impact of changing attitudes, norms, and self-efficacy on health-related intentions and behavior: A meta-analysis. Health Psychology, 35(11), 1178–1188.

    Article  PubMed  Google Scholar 

  10. Schwarzer, R., & Jerusalem, M. (1995). Generalized self efficacy scale. In J. Weinman, S. Wright, & M. Johnston (Eds.), Measures in health psychology (pp. 35–37). Windsor: NFER-Nelson.

    Google Scholar 

  11. Schwarzer, R., & Warner, L. M. (2013) Perceived self-efficacy and its relationship to resilience. In Resilience in children, adolescents, and adults (pp. 139–150). New York: Springer.

  12. Courneya, K. S., et al. (2012). Effects of supervised exercise on motivational outcomes and longer-term behavior. Medicine and Science in Sports and Exercise, 44(3), 542–549.

    Article  PubMed  Google Scholar 

  13. Demark-Wahnefried, W., et al. (2003). Design of FRESH START: A randomized trial of exercise and diet among cancer survivors. Medicine and Science in Sports and Exercise, 35(3), 415–424.

    Article  PubMed  Google Scholar 

  14. Chesney, M. A., et al. (2006). A validity and reliability study of the coping self-efficacy scale. British Journal of Health Psychology, 11(Pt 3), 421–437.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Lorig, K. R., et al. (2001). Effect of a self-management program on patients with chronic disease. Effective Clinical Practice, 4(6), 256–262.

    CAS  PubMed  Google Scholar 

  16. Cella, D., et al. (2010). Initial adult health item banks and first wave testing of the Patient-Reported Outcomes Measurement Information System (PROMIS™) Network: 2005–2008. Journal of Clinical Epidemiology, 63(11), 1179.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Cella, D., et al. (2016). PROMIS fatigue item bank had clinical validity across diverse chronic conditions. Journal of Clinical Epidemiology, 73, 128–134.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Cook, K. F., et al. (2016). PROMIS measures of pain, fatigue, negative affect, physical function, and social function demonstrated clinical validity across a range of chronic conditions. Journal of Clinical Epidemiology, 73, 89–102.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Gruber-Baldini, A. L., et al. (2017). Validation of the PROMIS® measures of self-efficacy for managing chronic conditions. Quality of Life Research. https://doi.org/10.1007/s11136-017-1527-3.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Kupst, M. J., et al. (2015). Assessment of stress and self-efficacy for the NIH Toolbox for Neurological and Behavioral Function. Anxiety Stress and Coping, 28(5), 531–544.

    Article  PubMed  Google Scholar 

  21. Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191–215.

    Article  CAS  PubMed  Google Scholar 

  22. Salsman, J. M., et al. (2018). Refining and supplementing candidate measures of psychological well-being for the NIH PROMIS®: Qualitative results from a mixed cancer sample. Quality of Life Research. https://doi.org/10.1007/s11136-018-1896-2.

    Article  PubMed  PubMed Central  Google Scholar 

  23. PROMIS Health Organization and PROMIS Cooperative Group. (2013). PROMIS ® instrument development and validation: Scientific standards version 2.0 (revised May 2013). Retrieved September 19, 2013, from http://www.nihpromis.org/Documents/PROMISStandards_Vers2.0_Final.pdf.

  24. Liu, H., et al. (2010). Representativeness of the PROMIS Internet Panel. Journal of Clinical Epidemiology, 63(11), 1169–1178.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Roster, C. A., et al. (2004). A comparison of response characteristics from web and telephone surveys. International Journal of Market Research, 46(3), 359–374.

    Article  Google Scholar 

  26. Scheier, M. F., Carver, C. S., & Bridges, M. W. (1994). Distinguishing optimism from neuroticism (and trait anxiety, self-mastery, and self-esteem): A reevaluation of the Life Orientation Test. Journal of Personality and Social Psychology, 67(6), 1063–1078.

    Article  CAS  PubMed  Google Scholar 

  27. Fung, H. H., & Carstensen, L. L. (2004). Motivational changes in response to blocked goals and foreshortened time: Testing alternatives to socioemotional selectivity theory. Psychology and Aging, 19(1), 68–78.

    Article  PubMed  Google Scholar 

  28. Hale, W. D., Fiedler, L. R., & Cochran, C. D. (1992). The revised Generalized Expectancy for Success Scale: A validity and reliability study. Journal of Clinical Psychology, 48(4), 517–521.

    Article  CAS  PubMed  Google Scholar 

  29. Hays, R. D., et al. (2009). Development of physical and mental health summary scores from the Patient Reported Outcomes Measurement Information System (PROMIS) global items. Quality of Life Research, 18(7), 873–880.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Pilkonis, P. A., et al. (2011). Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS): Depression, anxiety, and anger. Assessment, 18(3), 263–283.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Reeve, B. B., et al. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care, 45(5 Suppl 1), S22–S31.

    Article  PubMed  Google Scholar 

  32. R Core Development Team. (2018). R: A language and environment for statistical computing. R Foundation for Statistical Computing. http://www.r-project.org/.

  33. Revelle, W. (2018). Psych: Procedures for personality and psychological research. (R Package Version 1.8.12). (Computer Software). Evanston, IL: Northwestern University. https://cran.r-project.org/web/packages/psych/index.html.

  34. Schmid, J., & Leiman, J. (1957). The development of hierarchical factor solutions. Psychometrika, 22(1), 53–61.

    Article  Google Scholar 

  35. Reise, S. P., et al. (2013). Multidimensionality and structural coefficient bias in structural equation modeling: A bifactor perspective. Educational and Psychological Measurement, 73(1), 5–26.

    Article  Google Scholar 

  36. Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika monograph supplement, no. 17. Richmond, VA: Psychometric Society.

  37. Li, C., Thissen, D., & du Toit, S. (2011). IRTPRO 2.1 for Windows. Lincolnwood, IL: Scientific Software International, Inc.

    Google Scholar 

  38. Orlando, M., & Thissen, D. (2003). Further examination of the performance of S-X2, an item fit index for dichotomous item response theory models. Applied Psychological Measurement, 27, 289–298.

    Article  Google Scholar 

  39. Kang, T., & Chen, T. T. (2011). Performance of the generalized S-X2 item fit index for the graded response model. Asia–Pacific Education Review, 12(1), 89–96.

    Article  Google Scholar 

  40. Choi, S. W., Gibbons, L. E., & Crane, P. K. (2011). LORDIF: An R package for detecting differential item functioning using iterative hybrid ordinal logistic regression/item response theory and Monte Carlo simulations. Journal of Statistical Software, 39(8), 1–30.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Choi, S. W., et al. (2014). Establishing a common metric for depressive symptoms: Linking the BDI-II, CES-D, and PHQ-9 to PROMIS depression. Psychological Assessment, 26(2), 513–527.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Chen, G., Gully, S. M., & Eden, D. (2001). Validation of a new general self-efficacy scale. Organizational Research Methods, 4(1), 62–83.

    Article  CAS  Google Scholar 

  43. Sherer, M., et al. (1982). The self-efficacy scale: Construction and validation. Psychological Reports, 51(2), 663–671.

    Article  Google Scholar 

  44. Babakhanyan, I., et al. (2018). National Institutes of Health Toolbox Emotion Battery for English- and Spanish-speaking adults: Normative data and factor-based summary scores. Patient Related Outcome Measures, 9, 115–127.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Kostka, T., & Jachimowicz, V. (2010). Relationship of quality of life to dispositional optimism, health locus of control and self-efficacy in older subjects living in different environments. Quality of Life Research, 19(3), 351–361.

    Article  PubMed  Google Scholar 

  46. Magaletta, P. R., & Oliver, J. M. (1999). The hope construct, will, and ways: Their relations with self-efficacy, optimism, and general well-being. Journal of Clinical Psychology, 55(5), 539–551.

    Article  CAS  PubMed  Google Scholar 

  47. Bonsaksen, T., et al. (2018). Self-diagnosed depression in the Norwegian general population—Associations with neuroticism, extraversion, optimism, and general self-efficacy. BMC Public Health, 18(1), 1076.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Hajek, A., & Hans Helmut, K. (2017). The role of self-efficacy, self-esteem and optimism for using routine health check-ups in a population-based sample. A longitudinal perspective. Preventive Medicine, 105, 47–51.

    Article  PubMed  Google Scholar 

  49. Schwarzer, R., et al. (1997). The assessment of optimistic self-beliefs: Comparison of the German, Spanish, and Chinese versions of the general self-efficacy scale. Applied Psychology, 46(1), 69–88.

    Article  Google Scholar 

  50. Scholz, U., et al. (2002). Is general self-efficacy a universal construct? Psychometric findings from 25 countries. European Journal of Psychological Assessment, 18(3), 242.

    Article  Google Scholar 

  51. Roddenberry, A., & Renk, K. (2010). Locus of control and self-efficacy: Potential mediators of stress, illness, and utilization of health services in college students. Child Psychiatry and Human Development, 41(4), 353–370.

    Article  PubMed  Google Scholar 

  52. Ryff, C. D., & Keyes, C. L. M. (1995). The structure of psychological well-being revisited. Journal of Personality and Social Psychology, 69(4), 719–727.

    Article  CAS  PubMed  Google Scholar 

  53. Kobasa, S. C. (1982). The hardy personality: Toward a social psychology of stress and health. Social Psychology of Health and Illness, 4, 3–32.

    Google Scholar 

  54. Connor, K. M., & Davidson, J. R. (2003). Development of a new resilience scale: The Connor–Davidson resilience scale (CD-RISC). Depression and Anxiety, 18(2), 76–82.

    Article  PubMed  Google Scholar 

  55. Cella, D., et al. (2014). Setting standards for severity of common symptoms in oncology using the PROMIS item banks and expert judgment. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 23(10), 2651–2661.

    Article  Google Scholar 

Download references

Funding

Research reported in this publication was supported by the National Cancer Institute of the NIH under Award Number K07CA158008. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.

Author information

Authors and Affiliations

  1. Department of Social Sciences and Health Policy, Wake Forest School of Medicine, Medical Center Boulevard, Winston-Salem, NC, 27157, USA

    John M. Salsman

  2. Wake Forest Baptist Comprehensive Cancer Center, Medical Center Boulevard, Winston-Salem, NC, 27157, USA

    John M. Salsman

  3. Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA

    Benjamin D. Schalet, Elizabeth A. Hahn & David Cella

  4. Department of Psychology, University of Notre Dame, Notre Dame, IN, USA

    Thomas V. Merluzzi

  5. Department of Psychological Sciences, University of Connecticut, Storrs, CT, USA

    Crystal L. Park

  6. The Robert H. Lurie Comprehensive Cancer Center of Northwestern University, Chicago, IL, USA

    Elizabeth A. Hahn & David Cella

  7. University Research Administration, The University of Chicago, Chicago, IL, USA

    Mallory A. Snyder

Authors
  1. John M. Salsman
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Benjamin D. Schalet
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Thomas V. Merluzzi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Crystal L. Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Elizabeth A. Hahn
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Mallory A. Snyder
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. David Cella
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to John M. Salsman.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

All procedures performed involving human participants were in accordance with the Ethical Standards of the Institutional Review Board of Northwestern University and with the 1964 Helsinki Declaration and its later amendments.

Informed consent

Informed consent was obtained from all participants in the study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Salsman, J.M., Schalet, B.D., Merluzzi, T.V. et al. Calibration and initial validation of a general self-efficacy item bank and short form for the NIH PROMIS®. Qual Life Res 28, 2513–2523 (2019). https://doi.org/10.1007/s11136-019-02198-6

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11136-019-02198-6

Keywords

Search

Navigation