Skip to main content

Advertisement

SpringerLink
Log in

Assessing the content of mental health services: a review of measures

  • ORIGINAL PAPER
  • Published:
Social Psychiatry and Psychiatric Epidemiology Aims and scope Submit manuscript

Abstract

Background

Measurement of service content is necessary to understand what services actually provide and explain variation in service outcomes. There is no consensus about how to measure content of care in mental health services.

Method

Content of care measures for use in mental health services were identified through a search of electronic databases, hand searching of references from selected studies and consultation with experts in the field. Measures are presented in an organising methodological framework. Studies which introduced or cited the measures were read and investigations of empirical associations between content of care and outcomes were identified.

Results

Twenty five measures of content of care were identified, which used three different data collection methods and five information sources. Seven of these measures have been used to identify links between content of care and outcomes, most commonly in Assertive Community Treatment settings.

Discussion

Measures have been developed which can provide information about service content. However, there is a need for measures to demonstrate more clearly a theoretical or empirical basis, robust psychometric properties and feasibility in a range of service settings. Further comparison of the feasibility and reliability of different measurement methods is needed. Contradictory findings of associations between service content and outcomes may reflect measures’ uncertain reliability, or that crucial process variables are not being measured.

Conclusion

Measures providing a greater depth of information about the nature of interventions are needed. In the absence of a gold standard content of care measure, a multi-methods approach should be adopted.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Abramowitz S, Obten N, Cohen H (1998) Measuring HIV/AIDS Case Management. Soc Work Healthcare 27(3):1–28

    Article  CAS  Google Scholar 

  2. Beecham J, Knapp M (1992) Costing psychiatric interventions. In: Thornicroft G, Brewin CWJ (eds) Measuring mental health needs, Gaskell, pp 163–183

  3. Bond G, Salyers M (2004) Prediction of outcome from the Dartmouth Assertive Community Treatment fidelity Scale. CNS-Spectrums 9(12):937–942

    PubMed  Google Scholar 

  4. Bowers L, Brennan G, Flood C, Lipang M, Oladapo P (2006) Preliminary outcomes of a trial to reduce conflict and containment on acute psychiatric wards: City Nurses. J Psychiatr Mental Health Nursing 13:165–172

    Article  CAS  Google Scholar 

  5. Bowie P, Mountain G (1993) Using direct observation to record the behaviour of long-stay patients with dementia. Int J Geriatr Psychiatry 8:857–864

    Article  Google Scholar 

  6. Brekke J (1987) The model-guided method for monitoring program implementation. Eval Rev 11(3):281–299

    Google Scholar 

  7. Brekke J, Long J (1997) The impact of service characteristics on functional outcomes from Community Support Programs for persons with schizophrenia: a growth curve analysis. J Consult Clin Psychol 65(3):464–475

    Article  PubMed  CAS  Google Scholar 

  8. Brekke J, Ansel J, Long J, Slade E, Weinstein M (1999) Intensity and continuity of services and functional outcomes in the rehabilitation of persons with schizophrenia. Psychiatr Services 50(2):248–256

    CAS  Google Scholar 

  9. Brugha T, Glover G (1998) Process and health outcomes: need for clarity in systematic reviews of case management for severe mental disorders. Health Trends 30(3):76–79

    Google Scholar 

  10. Brugha TS, Lindsay F (1996) Quality of mental health service care: the forgotten pathway from process to outcome. Social Psychiatry Psychiatr Epidemiol 31(2):89–98

    Article  CAS  Google Scholar 

  11. Bryman A (2004) Social research methods, 2nd edn. Oxford University Press

  12. Burns T, Fiander M, Kent A, Ukoumunne OC, Byford S, Fahy T, Kumar KR (2000) Effects of case-load size on the process of care of patients with severe psychotic illness. Report from the UK700 trial. Br J Psychiatry 177:427–433

    PubMed  CAS  Google Scholar 

  13. Burns T, Priebe S (1996) Mental health care systems and their characteristics: A proposal. Acta Psychiatr Scand 94(6):381–385

    PubMed  CAS  Google Scholar 

  14. Dean R, Proudfoot R (1993) The Quality of Interactions Schedule (QUIS): Development, Reliability and Use in the Evaluation of Two Domus Units. Int J Geriatr Psychiatry 8:819–826

    Article  Google Scholar 

  15. De Jong A (2000) Development of the International Classification of Mental Health Care (ICMHC). Acta Psychiatr Scand 102(Suppl 405):8–13

    Article  Google Scholar 

  16. De Jong A, Giel R, Tentlom G (1991) International classification of mental health care: a tool for classifying services providing mental health care Part 1. Dept Social Psychiatry, University of Groningen and World Health organisation Regional office for Europe, Groningen

  17. Dietzen L, Bond G (1993) Relationship between case manager contact and outcome for frequently hospitalised psychiatric clients. Hospital Community Psychiatry 44(9):839–843

    PubMed  CAS  Google Scholar 

  18. Donabedian A (1980) Explorations in Quality Assessment and Monitoring, Volume 1: the Definition of Quality and Approaches to its Assessment Health Administration Press

  19. Falloon I, Fadden G (1995) Integrated mental health care: a comprehensive community-based approach Cambridge University Press

  20. Fiander M, Burns T (2000) A Delphi approach to describing service models of community mental health practice. Psychiatr Serv 51(5):656–658

    Article  PubMed  CAS  Google Scholar 

  21. Fisher G, Landis D, Clark D (1988) Case management service provision and client change. Commun Mental Health J 24(2):134–142

    Article  CAS  Google Scholar 

  22. Glick I, Burti L, Suzuki K, Sacks M (1991) Effectiveness in psychiatric care: 1. A cross-national study of the process of treatment and outcomes of major depressive disorder. J Nerv Mental Disease 179(2):55–63

    Article  CAS  Google Scholar 

  23. Hansson KS, Allebeck P, Malm U (2001) Event recording in psychiatric care: Developing an instrument and 1-year results. J Nordic Psychiatry 55(1):25–31

    Article  CAS  Google Scholar 

  24. Higgins R, Hurst K, Wistow G (1999) Nursing acute psychiatric patients: a quantitative and qualitative study. J Advanced Nursing 29(1):52–63

    Article  CAS  Google Scholar 

  25. Johnson S, Salvador-Carulla L (1998) Description and classification of mental health services: a European perspective. European Psychiatry 13:333–341

    Article  PubMed  Google Scholar 

  26. Johnson S, Kuhlman R (2000) The EPCAT Group, “The European Service Mapping Schedule (ESMS): development of an instrument for the description and classification of mental health services”. Acta Psychiatr Scand 102:14–23

    Article  Google Scholar 

  27. Kitwood T (1997) Evaluating dementia care: the DCM method, 7th edn. Universwity of Bradford

  28. Kovess V, Lafleche M (1988) How do teams practice community psychiatry?”. Canada’s Mental Health 36(2):1–28

    Google Scholar 

  29. McGrew J, Bond G, Dietzen L, Salyers M (1994) Measuring the fidelity of implementation of a mental health program model. J Consult Clin Psychol 62:670–678

    Article  PubMed  CAS  Google Scholar 

  30. McHugo G, Drake R, Teague G, Xie H (1999) Fidelity to assertive community treatment and client outcomes in the new hampshire dual disorders study. Psychiatr Service 50(6):818–824

    CAS  Google Scholar 

  31. Mechanic D (1996) Emerging issues in international mental health services research. Psychiatr Services 47(4):371–375

    CAS  Google Scholar 

  32. Morley S, Snaith P (1992) Principles of psychological assessment. In: Freeman C, Tyrer P (eds) Research methods in psychiatry, 2nd edn. Gaskell, pp 135–152

  33. Morse G, Calsyn R, Klinkenberg W, Helminiak T, Wolff N, Drake R, Yonker R, Lama G, Lemming M, McCudden S (2006) Treating homeless clients with severe mental illness and substance use disorders: costs and outcomes. Commun Mental Health J 42(4):377–404

    Article  Google Scholar 

  34. Olusina AK, Ohaeri JU, Olatawura MO (2003) The quality of interactions between staff and psychiatric inpatients in a Nigerian general hospital. Psychopathology 36(5):269–275

    Article  PubMed  Google Scholar 

  35. Patmore C, Weaver T (1989) A measure of care. Health Serv J 99(5142):330–331

    PubMed  CAS  Google Scholar 

  36. Paul G (1987) Rational operations in residential treatment settings through ongoing assessment of staff and client functioning. In: Peterson D, Fishman D (eds) Assessment for decision, Rutgers University Press, pp 145–203

  37. Pawson R, Tilley N (1997) Realistic Evaluation. Sage

  38. Popkin M, Callies A, Lurie N, Harman J, Stoner T, Manning W (1997) An instrument to evaluate the process of care in ambulatory settings. Psychiatr Service 48(4):524–527

    CAS  Google Scholar 

  39. Quirk A, Lelliot P (2001) What do we know about life on acute psychiatric wards in the UK? A review of the research evidence. Soc Sci Med 53(12):1565–1574

    Article  PubMed  CAS  Google Scholar 

  40. Resnick S, Neale M, Rosenheck R (2003) Impact of Public Support Payments, intensive pychiatric community care and program fidelity on employment outcomes for people with severe mental illness. J Nerv Mental Disease 191(3):139–144

    Article  Google Scholar 

  41. Rossberg J, Friis S (2004) Patients’ and staff’s perceptions of the psychiatric ward environment. Psychiatr Service 55(7):798–803

    Article  Google Scholar 

  42. Rossi P, Freeman H (1989) Evaluation: a systematic approach, 4th edn. Sage

  43. Rossi P, Freeman H, Lipsey G (1999) Evaluation: a systematic approach, 6th edn. Sage

  44. Salize HJ, Kustner BM, Torres-Gonzalez F, Reinhard I, Estevez JFJ, Rossler W (1999) Needs for care and effectiveness of mental health care provision for schizophrenic patients in two European regions: a comparison between Granada (Spain) and Mannheim (Germany). Acta Psychiatr Scand 100(5):328–334

    Article  PubMed  CAS  Google Scholar 

  45. Shepherd G, Richardson R (1979) Organization and interaction in psychiatric day centers. Psychol Med 9:573–579

    Article  PubMed  CAS  Google Scholar 

  46. Slade M, Phelan M, Thornicroft G (1998) A comparison of needs assessed by staff and by and epidemiologically representative sample of patients with psychosis. Psychol Med 28(3):543–550

    Article  PubMed  CAS  Google Scholar 

  47. Slade M, Thornicroft G, Loftus S, Phelan M, Wykes T (1999) The camberwell assessment of need Gaskell, London

    Google Scholar 

  48. Teague G, Bond G, Drake R (1998) Programme fidelity in ACT: development and use of a measure. Am J Orthopsychiatry 68:216–232

    Article  PubMed  CAS  Google Scholar 

  49. Thornicroft G, Tansella M (1999) The mental health matrix: a Manual to Improve Services Cambridge University Press

  50. Thornton A, Hatton A, Tatham A (2004) Dementia care mapping reconsidered: exploring the reliability and validity of the observational tool. Int J Geriatr Psychiatry 19:718–726

    Article  PubMed  CAS  Google Scholar 

  51. Tugwell P (1979) A methodological perspective on process measures of the quality of medical care. Clin Investigat Med 2:113–121

    CAS  Google Scholar 

  52. Tyson G, Lambert G, Beattie L (1995) The quality of psychiatric nurses’ interactions with patients: an observational study. Int J Nursing Studies 32(1):49–58

    Article  CAS  Google Scholar 

  53. Whitley R, Crawford M (2005) Qualitative research in psychiatry. Can J Psychiatry 50(2):108–114

    PubMed  Google Scholar 

  54. Wing J, Brown G (1970) Institutionalism and Schizophrenia Cambridge University Press

  55. Wright R, Sklebar T, Heiman J (1987) Patterns of case management activity in an intensive community support programme. Commun Mental Health J 23(1):53–59

    Article  CAS  Google Scholar 

  56. Young A, Sullivan G, Burnam A, Brook R (1998) Measuring the quality of outpatient treatment for schizophrenia. Arch Gen Psychiatry 55:611–617

    Article  PubMed  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dept. of Mental Health Sciences, University College London, Charles Bell House, 67-73 Riding House Street, London, W1W 7EJ, UK

    Brynmor Lloyd-Evans & Sonia Johnson

  2. Health Services Research Dept., Institute of Psychiatry, London, UK

    Mike Slade

Authors
  1. Brynmor Lloyd-Evans
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sonia Johnson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mike Slade
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Brynmor Lloyd-Evans.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lloyd-Evans, B., Johnson, S. & Slade, M. Assessing the content of mental health services: a review of measures. Soc Psychiat Epidemiol 42, 673–682 (2007). https://doi.org/10.1007/s00127-007-0216-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00127-007-0216-x

Key words

Search

Navigation