Abstract
The present study investigates treatment satisfaction (TS) rated by multiple informants (patient, parent, therapist) following routine outpatient cognitive-behavioral therapy (CBT) within a large sample (n = 965) of clinically referred adolescents aged 11–20 years. Moreover, potential predictors of TS were analyzed (patient-related variables, mental disorder characteristics, socio-demographic factors and treatment variables). Overall, our results show a high treatment satisfaction in patient, parent and therapist ratings, with the therapists being the most critical raters (completely/predominantly satisfied: 87.8% in patient, 92.0% in parent, and 64.0% in therapist ratings). Correlations between the three raters were only small to moderate, but statistically significant. Regression analysis examining differential effects found that mental disorder characteristics (parent- and patient-reported symptoms at post) and treatment variables (especially cooperation of patients and parents as rated by therapists) explained most of the variance in TS, whereas patient-related or socio-demographic variables did not emerge as relevant predictors of TS. The amounts of explained variance were R 2adj. = 0.594 in therapist rating, R 2adj. = 0.322 in patient rating and R 2adj. = 0.203 in parent rating.
Similar content being viewed by others
References
Wittchen U, Jacobi F, Rehm J, Gustavsson A, Svensson M, Jönsson B, Olesen J, Allgulander C, Alonso J, Faravelli C, Fratiglioni L, Jennum P, Lieb R, Maercker A, van Os J, Preisig M, Salvador-Carulla L, Simon R, Steinhausen HC (2011) The size and burden of mental disorders and other disorders of the brain in Europe 2010. Eur Neuropsychopharmacol 21(9):655–679. https://doi.org/10.1016/j.euroneuro.2011.07.018
Merikangas K, He J, Burstein M, Swanson S, Avenevoli S, Cui L, Benjet C, Georgiades K, Swendsen J (2010) Lifetime prevalence of mental disorders in US adolescents: results from the National Comorbidity Survey Replication-Adolescent Supplement (NCS-A). J Am Acad Child Adolesc Psychiatry 49(10):980–989. https://doi.org/10.1016/j.jaac.2010.05.017
Kim-Cohen J, Caspi A, Moffitt TE, Harrington H, Milne BJ, Poulton R (2003) Prior juvenile diagnoses in adults with mental disorder: developmental follow-back of a prospective-longitudinal cohort. Arch Gen Psychiatry 60:709–717. https://doi.org/10.1001/archpsyc.60.7.709
Hofstra MB, van der Ende J, Verhulst FC (2002) Child and adolescent problems predict DSM-IV disorders in adulthood: a 14-year follow-up of a Dutch epidemiological sample. J Am Acad Child Adolesc Psychiatry 41:182–189. https://doi.org/10.1097/00004583-200202000-00012
de Haan AM, Boon AE, de Jong JTVM, Hoeve M, Vermeiren RRJM (2013) A meta-analytic review on treatment dropout in child and adolescent outpatient mental health care. Clin Psychol Rev 33(5):698–711. https://doi.org/10.1016/j.cpr.2013.04.005
Lewinsohn PM, Shankman SA, Gau JM, Klein DN (2004) The prevalence and co-morbidity of subthreshold psychiatric conditions. Psychol Med 34:613–622. https://doi.org/10.1017/S0033291703001466
MacLeod K, Brownlie E (2014) Mental health and transitions from adolescence to emerging adulthood: developmental and diversity considerations. Can J Community Ment Health 33(1):77–86. https://doi.org/10.7870/cjcmh-2014-007
Walter D, Dachs L, Faber M, Goletz H, Görtz-Dorten A, Hautmann C, Kinnen C, Rademacher C, Schuermann S, Metternich-Kaizman TW, Döpfner M (2017) Effectiveness of outpatient cognitive-behavioral therapy for adolescents under routine care conditions on behavioral and emotional problems rated by parents and patients: an observational study. Eur Child Adolesc Psychiatry 27(1):65–77. https://doi.org/10.1007/s00787-017-1021-z
McNicholas F (2012) To adhere or not, and what we can do to help. Eur Child Adolesc Psychiatry 21(12):657–663. https://doi.org/10.1007/s00787-012-0304-7
Athay MM, Bickman L (2012) Development and psychometric evaluation of the youth and caregiver Service Satisfaction Scale. Adm Policy Ment Health 39(1–2):71–77. https://doi.org/10.1007/s10488-012-0407-y
Garland AF, Haine RA, Boxmeyer CL (2007) Determinates of youth and parent satisfaction in usual care psychotherapy. Eval Program Plan 30(1):45–54. https://doi.org/10.1016/j.evalprogplan.2006.10.003
Biering P (2010) Child and adolescent experience of and satisfaction with psychiatric care: a critical review of the research literature. J Psychiatr Ment Health Nurs 17(1):65–72. https://doi.org/10.1111/j.1365-2850.2009.01505.x
Achenbach TM, McConaughy SH, Howell CT (1987) Child/adolescent behavioral and emotional problems: implications of cross-informant correlations for situational specificity. Psychol Bull 101(2):213–232. https://doi.org/10.1037/0033-2909.101.2.213
Karver MS (2006) Determinants of multiple informant agreement on child and adolescent behavior. J Abnorm Child Psychol 34(2):242–253. https://doi.org/10.1007/s10802-005-9015-6
Kapp C, Perlini T, Jeanneret T, Stéphan P, Rojas-Urrego A, Macias M, Halfon O, Holzer L, Urben S (2017) Identifying the determinants of perceived quality in outpatient child and adolescent mental health services from the perspectives of parents and patients. Eur Child Adolesc Psychiatry 26(10):1269–1277. https://doi.org/10.1007/s00787-017-0985-z
Barber AJ, Tischler VA, Healy E (2006) Consumer satisfaction and child behaviour problems in child and adolescent mental health services. J Child Health Care 10(1):9–21. https://doi.org/10.1177/1367493506060200
Garland AF, Aarons GA, Saltzman MD, Kruse MI (2000) Correlates of adolescents’ satisfaction with mental health services. Ment Health Serv Res 2(3):127–139. https://doi.org/10.1023/A:1010137725958
Mattejat F, Remschmidt H (1998) Fragebogen zur Beurteilung der Behandlung (FBB). Handanweisung [Therapy Evaluation Questionnaire (TEQ). Manual]. Hogrefe, Göttingen
Turchik JA, Karpenko V, Ogles BM, Demireva P, Probst DR (2010) Parent and adolescent satisfaction with mental health services: does it relate to youth diagnosis, age, gender, or treatment outcome? Community Ment Health J 46(3):282–288. https://doi.org/10.1007/s10597-010-9293-5
Godley SH, Fiedler EM, Funk RR (1998) Consumer satisfaction of parents and their children with child/adolescent mental health services. Eval Program Plan 21(1):31–45. https://doi.org/10.1016/S0149-7189(97)00043-8
Marriage K, Petrie J, Worling D (2001) Consumer satisfaction with an adolescent inpatient psychiatric unit. Can J Psychiatry 46(10):969–975. https://doi.org/10.1177/070674370104601011
Copeland VC, Koeske G, Greeno CG (2004) Child and mother client satisfaction questionnaire scores regarding mental health services: race, age, and gender correlates. Res Soc Work Pract 14(6):434–442. https://doi.org/10.1177/1049731504265839
Bunge EL, Maglio AL, Musich FM, Savage C (2014) Consumer satisfaction with private child and adolescent mental health services in Buenos Aires. Child Youth Serv Rev 47(3):291–296. https://doi.org/10.1016/j.childyouth.2014.10.002
Lambert W, Salzer M, Bickman L (1998) Clinical outcome, consumer satisfaction, and ad hoc ratings of improvement in children’s mental health. J Consult Clin Psychol 66(2):270
Stüntzner-Gibson D, Koren PE, DeChillo N (1995) The Youth Satisfaction Questionnaire: what kids think of services. Fam Soc 76(10):616–624
Day C, Michelson D, Hassan I (2011) Child and adolescent service experience (ChASE): measuring service quality and therapeutic process. Br J Clin Psychol 50(4):452–464. https://doi.org/10.1111/j.2044-8260.2011.02008.x
Schneider N, Korte A, Lenz K, Pfeiffer E, Lehmkuhl U, Salbach-Andrae H (2010) Subjektive Therapiebeurteilung jugendlicher Patientinnen mit Essstörungen und deren Übereinstimmung mit Eltern- und Therapeutenbeurteilungen [Subjective evaluation of DBT treatment by adolescent patients with eating disorders and the correlation with evaluations by their parents and psychotherapists]. Z Kinder Jugendpsychiatr Psychother 38(1):51–57. https://doi.org/10.1024/1422-4917.a000006
Mattejat F, Remschmidt H (1993) Evaluation von Therapien mit psychisch kranken Kindern und Jugendlichen. Entwicklung und Überprüfung eines Fragebogens zur Beurteilung der Behandlung (FBB) [Evaluation of therapies with children and adolescents with mental disorders. Development and evaluation of a therapy evaluation questionnaire (TEQ)]. Z Klin Psychol 22(2):192–233
Kinnen C, Döpfner M (2013) Zusammenhang von therapeutischer Beziehung mit Symptomminderung und Behandlungszufriedenheit in der Behandlung von Kindern und Jugendlichen mit Aufmerksamkeitsdefizit-/Hyperaktivitätsstörung und/oder Störungen des Sozialverhaltens [The relationship of therapeutic alliance with a symptom reduction and treatment satisfaction in the therapeutic treatment of children and adolescents with ADHD and/or conduct disorder]. Z Kinder Jugendpsychiatr Psychother 41(2):133–144. https://doi.org/10.1024/1422-4917/a000220
Shapiro JP, Welker CJ, Jacobson BJ (1997) The Youth Client Satisfaction Questionnaire: development, construct validation, and factor structure. J Clin Child Psychol 26(1):87–98. https://doi.org/10.1207/s15374424jccp2601_9
Bjorngaard JH, Wessel AH, Osborg OS, Hanssen-Bauer K (2008) User satisfaction with child and adolescent mental health services: impact of the service unit level. Soc Psychiatry Psychiatr Epidemiol 43:635–641. https://doi.org/10.1007/s00127-008-0347-8
Keller F, Peter S, Fegert JM, Naumann A, Goldbeck L (2006) Behandlungsbewertungen von Jugendlichen im Verlauf einer stationär-psychiatrischen Behandlung [Consumer satisfaction trajectories of adolescents during inpatient psychiatric treatment]. Z Kinder Jugendpsychiatr Psychother 34(5):367–376. https://doi.org/10.1024/1422-4917.34.5.367
Gerkensmeyer JE, Austin JK (2005) Development and testing of a scale measuring parent satisfaction with staff interactions. J Behav Health Serv Res 32(1):61–73. https://doi.org/10.1007/bf02287328
Holmboe O, Iversen HH, Hanssen-Bauer K (2011) Determinants of parents’ experiences with outpatient child and adolescent mental health services. Int J Ment Health Syst 5(1):22. https://doi.org/10.1186/1752-4458-5-22
Measelle JR, Weinstein RS, Martinez M (1998) Parent satisfaction with case managed systems of care for children and youth with severe emotional disturbance. J Child Fam Stud 7(4):451–467. https://doi.org/10.1023/A:1022906010113
Achenbach TM (2010) Multicultural evidence-based assessment of child and adolescent psychopathology. Transcult Psychiatry 47:707–726. https://doi.org/10.1177/1363461510382590
Döpfner M, Plück J, Kinnen C, Arbeitsgruppe Deutsche Child Behavior Checklist (2014) Manual deutsche Schulalter-Formen der Child Behavior Checklist von Thomas M. Achenbach. Elternfragebogen über das Verhalten von Kindern und Jugendlichen (CBCL/6-18R), Lehrerfragebogen über das Verhalten von Kindern und Jugendlichen (TRF/6-18R), Fragebogen für Jugendliche (YSR/11-18R) [Manual of the German versions of the Child Behavior Checklist for school-aged children and adolescents by Thomas M. Achenbach. Child Behavior Checklist (CBCL/6-18R), Teacher Report Form (TRF/6-18R), Youth Self-Report (YSR/11-18R)]. Hogrefe, Göttingen
Brestan EV, Jacobs JR, Rayfield AD, Eyberg SM (1999) A consumer satisfaction measure for parent–child treatments and its relation to measures of child behavior change. Behav Ther 30(1):17–30. https://doi.org/10.1016/S0005-7894(99)80043-4
Garland AF, Aarons GA, Hawley KM, Hough RL (2003) Relationship of youth satisfaction with mental health services and changes in symptoms and functioning. Psychiatr Serv 54(11):1544–1546. https://doi.org/10.1176/appi.ps.54.11.1544
Noser K, Bickman L (2000) Quality indicators of children’s mental health services: do they predict improved client outcomes? J Emot Behav Disord 8(1):9–18. https://doi.org/10.1177/106342660000800102
Döpfner M, Görtz-Dorten A, Lehmkuhl G (2008) DISYPS-II: Diagnostik-System für psychische Störungen im Kindes- und Jugendalter nach ICD-10 und DSM-IV [DISYPS-II: Diagnostic system for psychiatric disorders in children and adolescents], 3rd edn. Hans Huber, Bern
Görtz-Dorten A, Döpfner M (2008) Diagnose-Checklisten aus dem Diagnostik-System für Psychische Störungen im Kindes- und Jugendalter (DISYPS-II) - Gütekritereien und klinische Anwendung [Diagnostic-Checklists of the Diagnostic System for Mental Disorders in Childhood and Adolescence (DISYPS-II)—psychometric criteria and clinical application]. Klin Diagn Eval1 1(4):378–394
Schmeck K, Poustka F, Döpfner M, Plück J, Berner W, Lehmkuhl G, Fegert JM, Lenz K, Huss M, Lehmkuhl U (2001) Discriminant validity of the Child Behaviour Checklist CBCL-4/18 in German samples. Eur Child Adolesc Psychiatry 10(4):240–247. https://doi.org/10.1007/s007870170013
Döpfner M, Berner W, Schmeck K, Lehmkuhl G, Poustka F (1995) Internal consistencies and validity of the CBCL and the TRF in a German sample: a cross cultural comparison. In: Sergeant J (ed) Eunethydis: European approaches to hyperkinetic disorder. Egg, Zürich, pp 51–81
Döpfner M, Steinhausen H-C (2012) Kinder-Diagnostik-System (KIDS) [children-diagnostic-system (KIDS)], vol 3: Störungsübergreifende Verfahren zur Diagnostik psychischer Störungen [transdiagnostic instruments to assess mental health disorders]. Hogrefe, Göttingen
World Health Organization (1996) Multiaxial classification of child and adolescent psychiatric disorders: the ICD-10 classification of mental and behavioural disorders in children and adolescents. University Press, Cambridge
Tewes U (1985) Hamburg-Wechsler-Intelligenztest für Kinder - revidierte Auflage [Hamburg-Wechsler test of intelligence for children—revised]. Huber, Bern
von Aster M, Neubauer A, Horn R (2006) Wechsler Intelligenztest für Erwachsene WIE. Deutschsprachige Bearbeitung und Adaptation des WAIS-III von David Wechsler [Wechsler test of intelligence for adults WIE. German adaptation of the WAIS-III by David Wechsler]. Pearson, Frankfurt
Cohen J (1988) Statistical power analysis for the behavioral sciences, 2nd edn. L. Erlbaum Associates, Hillsdale
Bowerman BL, O’Connell RT (1990) Linear statistical models: an applied approach. Duxbury Press, Belmont
Myers RH (1990) Classical and modern regression with applications. Duxbury, Boston
Menard S (1995) Applied logistic regression analysis. Sage University Papers Series, Quantitative applications in the social sciences, 07-106. Sage, Thousand Oaks
Field A (2013) Discovering statistics using IBM SPSS statistics, 4th edn. SAGE Publications, London
Nevill RE, Lecavalier L, Stratis EA (2018) Meta-analysis of parent-mediated interventions for young children with autism spectrum disorder. Autism 22:84–98. https://doi.org/10.1177/1362361316677838
Freitag C, Jensen K, Elsuni L, Sachse M, Herpertz-Dahlmann B, Schulte-Rüther M, Hänig S, von Gontard A, Poustka L, Schad-Hansjosten T, Wenzl C, Sinzig J, Taurines R, Geißler J, Kieser M, Choemkery H (2016) Group-based cognitive behavioural psychotherapy for children and adolescents with ASD: a randomized, multicentre, controlled SOSTA—net trial. J Child Psychol Psychiatry 57:596–605. https://doi.org/10.1111/jcpp.12509
Larsen DL, Attkisson CC, Hargreaves WA, Nguyen TD (1979) Assessment of client/patient satisfaction: development of a general scale. Eval Program Plan 2:197–207. https://doi.org/10.1016/0149-7189(79)90094-6
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical standards
This study has been approved by the ethics committee at the University of Cologne and has, therefore, been performed in accordance with the ethical standards laid down in the 1964 Declaration of Helsinki and its later amendments. All persons gave their informed consent prior to their inclusion in the study.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Viefhaus, P., Döpfner, M., Dachs, L. et al. Treatment satisfaction following routine outpatient cognitive-behavioral therapy of adolescents with mental disorders: a triple perspective of patients, parents and therapists. Eur Child Adolesc Psychiatry 28, 543–556 (2019). https://doi.org/10.1007/s00787-018-1220-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00787-018-1220-2