Skip to main content

Advertisement

SpringerLink
Log in

Development and Psychometric Evaluation of the Youth and Caregiver Service Satisfaction Scale

  • Original Paper
  • Published:
Administration and Policy in Mental Health and Mental Health Services Research Aims and scope Submit manuscript

Abstract

There is widespread need for the inclusion of service satisfaction measures in mental health services evaluation. The current paper introduces the Service Satisfaction Scale (SSS), a practical and freely available measure of global youth and adult caregiver service satisfaction. The development process, as well as results from a comprehensive psychometric evaluation in a large sample of clinically referred youth (N = 490) receiving home-based care, and their caregivers (N = 383), are presented. Multiple models for psychometric analyses were used including classical test theory, item response theory, and confirmatory factor analysis. As expected, SSS total scores were negatively skewed but the measure displayed otherwise adequate scale characteristics for both the youth and caregiver versions. Thus, the SSS is a brief and psychometrically sound instrument for measuring global satisfaction in home-based mental health service settings. It has several advantages compared to existing measures including brevity, parallel youth and caregiver forms, availability at no cost, and its development on a large sample of youth and caregivers with rigorous psychometric methodology.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Aarons, G. A., Covert, J., Skriner, L. C., Green, A., Marto, D., Garland, A. F., et al. (2010). The eye of the beholder: Youths and parents differ on what matters in mental health services. Administration and Policy in Mental Health, 37, 459–467.

    Article  PubMed  Google Scholar 

  • Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561–573.

    Article  Google Scholar 

  • Attkisson, C. C., & Greenfield, T. K. (1994). Client satisfaction questionnaire-8 and service satisfaction scale-30. In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcome assessment (pp. 402–420). Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Attkisson, C. C., & Zwick, R. (1982). The client satisfaction questionnaire: Psychometric properties and correlations with service utilization and psychotherapy outcome. Evaluation and Program Planning, 5, 223–237.

    Article  Google Scholar 

  • Ayton, A., Mooney, M., Sillifant, K., Powels, J., & Rasool, H. (2007). The development of the child and adolescent versions of the Verona service satisfaction scale (CAMHSSS). Social Psychiatry and Psychiatric Epidemiology, 42, 892–901.

    Article  PubMed  Google Scholar 

  • Bickman, L. (2000). Are you satisfied with satisfaction? (Editorial). Mental Health Service Research, 2, 125.

    Article  Google Scholar 

  • Bickman, L., Athay, M.M., Riemer, M., Lambert, E.W., Kelley, S.D., Breda, C., Tempesti, T., Dew-Reeves, S.E., Brannan, A.M., & Vides de Andrade, A.R. (Eds.). (2010). Manual of the Peabody Treatment Progress Battery, 2nd ed. [Electronic version]. Nashville, TN: Vanderbilt University. http://peabody.vanderbilt.edu/ptpb\.

  • Bickman, L., Reimer, M., Lambert, E.W., Kelley, S.D., Breda, C., Dew., S., et al. (2007). Manual of the Peabody Treatment and Progress Battery [Electronic version]. Nashville, TN: Vanderbilt University. http://peabody.vanderbilt.edu/ptpb/.

  • Biering, P. (2010). Child and adolescent experience of and satisfaction with psychiatric care: A critical review of the research literature. Journal of Psychiatric and Mental Health Nursing, 17, 65–72.

    Article  PubMed  CAS  Google Scholar 

  • Brannan, A. M., & Heflinger, C. A. (1993). Client satisfaction with mental health services. Paper presented at the 21st Annual Meeting of the American Public Health Association, San Francisco, CA.

  • Brannan, A. M., & Heflinger, C. A. (1994). Parental satisfaction with their children’s mental health service. Paper presented at Building on Family Strengths Conference, Portland, OR.

  • Brannan, A. M., Sonnichsen, S. E., & Heflinger, C. A. (1996). Measuring satisfaction with children’s mental health services: Validity and reliability of satisfaction scales. Evaluation and Program Planning, 19(2), 131–141.

    Article  Google Scholar 

  • Burnam, M. A. (1996). Measuring outcomes of care for substance abuse and mental disorders. New Directions in Mental Health Services, 71, 3–17.

    Article  Google Scholar 

  • Copeland, V. C., Koeske, G., & Greeno, C. G. (2004). Child and mother client satisfaction questionnaire scores regarding mental health services: Race, age, and gender correlates. Research on Social Work Practice, 14(6), 434–442.

    Article  Google Scholar 

  • Embretson, S. E. (1996). The new rules of measurement. Psychological Assessment, 8, 341–349.

    Article  Google Scholar 

  • Ferguson, E., & Cox, T. (1993). Exploratory factor analysis: A user’s guide. International Journal of Selection and Assessment, 1, 84–94.

    Article  Google Scholar 

  • Fontana, A., Ford, J. D., & Rosenheck, R. (2003). A multivariate model of patients’ satisfaction with treatment for posttraumatic stress disorder. Journal of Traumatic Stress, 16, 93–106.

    Article  PubMed  Google Scholar 

  • Garland, A. F., Aarons, G. A., Hawley, K. M., & Hough, R. H. (2003). Relationship of youth satisfaction with mental health services and changes in symptoms and functioning. Psychiatric Services, 54(11), 1544–1546.

    Article  PubMed  Google Scholar 

  • Garland, A. F., Haine, R. A., & Boxmeyer, C. L. (2007). Determinants of youth and parent satisfaction in usual care psychotherapy. Evaluation and Program Planning, 30, 45–54.

    Article  PubMed  Google Scholar 

  • Garland, A. F., Saltzman, M. D., & Aarons, G. A. (2000). Adolescent satisfaction with mental health services: Development of a multidimensional scale. Evaluation and Program Planning, 23, 165–175.

    Article  Google Scholar 

  • Hawkins, E. J., Baer, J. S., & Kivlahan, D. R. (2008). Concurrent monitoring of psychological distress and satisfaction measures as predictors of addiction treatment retention. Journal of Substance Abuse Treatment, 35, 207–216.

    Article  PubMed  Google Scholar 

  • Kaplan, S., Busner, J., Chibnall, J., et al. (2001). Consumer satisfaction at a child and adolescent state psychiatric hospital. Psychiatric Services, 52, 202–206.

    Article  PubMed  CAS  Google Scholar 

  • Lambert, W., Salzar, M. S., & Bickman, L. (1998). Clinical outcome, consumer satisfaction, and ad hoc ratings of improvement in children’s mental health. Journal of Consulting and Clinical Psychology, 66, 270–279.

    Article  PubMed  CAS  Google Scholar 

  • Larsen, D. L., Attkisson, C. C., Hargreaves, W. A., et al. (1979). Assessment of client/patient satisfaction: Development of a general scale. Evaluation and Program Planning, 2, 197–207.

    Article  PubMed  CAS  Google Scholar 

  • Lebow, J. L. (1983). Research assessing consumer satisfaction with mental health treatment. Evaluation and Program Planning, 6, 211–236.

    Article  PubMed  CAS  Google Scholar 

  • Linacre, J.M. (2007). WINSTEPS® 2.26.0 [Computer Software]. http://www.winsteps.com/index.htm. Accessed 8 Jan 2007.

  • Luk, E. S. L., Staiger, P., Mathai, J., Wong, L., Birleson, P., & Adler, R. (2001). Evaluation of outcome in child and adolescent mental health services: Children with persistent conduct problems. Clinical Child Psychology and Psychiatry, 6(1), 109–124.

    Article  Google Scholar 

  • Lunnen, K. M., & Ogles, B. M. (1998). A multiperspective, multivariable evaluation of reliable change. Journal of Consulting and Clinical Psychology, 66, 400–410.

    Article  PubMed  CAS  Google Scholar 

  • Lunnen, K. M., Ogles, B. M., & Pappas, L. N. (2008). A multiperspective comparison of satisfaction, symptomatic change, perceived change and end-point functioning. Professional Psychology: Research and Practice, 39(2), 145–152.

    Article  Google Scholar 

  • Ogles, B. M., Melendez, G., Davis, D. C., & Lunnen, K. M. (2001). The Ohio Scales: Practical outcome assessment. Journal of Child and Family Studies, 10, 199–212.

    Article  Google Scholar 

  • Pascoe, G. C. (1983). Patient satisfaction in primary health care: A literature review and analysis. Evaluation and Program Planning, 6, 185–210.

    Article  PubMed  CAS  Google Scholar 

  • Reise, S. P., & Waller, N. G. (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27–48.

    Article  PubMed  Google Scholar 

  • Riemer, M., Athay, M.M., Bickman, L., Breda, C., Kelley, S.D., & Vides de Andrade, A. (2012). The Peabody Treatment Progress Battery: History and methods for developing a comprehensive measurement battery for youth mental health. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0404-1.

  • Stüntzner-Gibson, D., Koren, P. E., & DeChillo, N. (1995). The youth satisfaction questionnaire: What kids think of services. Families in Society, 76, 616–624.

    Google Scholar 

  • Turchik, J. A., Kerpenko, V., Ogles, B. M., Demireva, P., & Probst, D. R. (2010). Parent and adolescent satisfaction with mental health services: Does it relate to youth diagnosis, age, gender, or treatment outcome? Community Mental Health Journal, 46, 282–288.

    Article  PubMed  Google Scholar 

  • Wright, B.D., & Linacre, J.M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8, 370. www.rasch.org/rmt/rmt83b.htm. Accessed 10 Mar 2011.

Download references

Acknowledgments

This research was supported by NIMH Grants R01-MH068589 and 4264600201 awarded to Leonard Bickman.

Author information

Authors and Affiliations

  1. Center for Evaluation and Program Improvement, Vanderbilt University, Peabody #151, 230 Appleton Place, Nashville, TN, 37203, USA

    M. Michele Athay & Leonard Bickman

Authors
  1. M. Michele Athay
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Leonard Bickman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. Michele Athay.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Athay, M.M., Bickman, L. Development and Psychometric Evaluation of the Youth and Caregiver Service Satisfaction Scale. Adm Policy Ment Health 39, 71–77 (2012). https://doi.org/10.1007/s10488-012-0407-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-012-0407-y

Keywords

Search

Navigation