Original article
Assessing the performance of a new depression screener for primary care (PC-SAD©)

https://doi.org/10.1016/S0895-4356(01)00430-9Get rights and content

Abstract

As many as 50% of patients with major depression seen in primary care settings are not diagnosed. To facilitate efficient identification of primary care patients with depression, we developed a new patient-administered depression screening instrument (PC-SAD

Introduction

About 7% of patients making a visit to a primary care doctor have a depressive disorder 1, 2, making depressive disorder one of the most prevalent conditions in primary care. The estimated total cost to society is as high as $40 billion [3] For affected individuals, depressive disorders cause tremendous suffering, disrupting families, friendships, and work relationships. Good treatment interventions 4, 5, 6, 7 and guidelines for treatment 8, 9 are available and are known to produce benefits up to a year after they are applied 4, 10, 11, 12, 13, 14, 15, but not necessarily over a longer term 16, 17.

Unfortunately, about half of patients are either not detected or accurately diagnosed 1, 8, 18, 19, 20, 21, 22. Although most patients with depression see a primary care provider at least once during the year [23], few see mental health specialists 5, 18, 24, 25. Some patients are able to access the mental health system directly, but doing so can be expensive, stigmatizing, and presupposes a recognition on the part of the patient of the need to do so. Patients in primary care consistently underutilize mental health treatments 18, 24, 25. Primary care physicians have the means to treat patients, but without screening tools that are accurate, easy to use and inexpensive, it is difficult to do so. Improving diagnostic rates for depressive disorders in primary care settings is a necessary first step in addressing an important public health issue 26, 27, 28. Although many screeners for depression have been developed, they are rarely used 29, 30. Without a reliable assessment of the individual symptoms, shortness by itself does not seem to suffice. Physicians need psychometrically sound instruments—which have excellent specificity and sensitivity—that also provide them with documented symptom data.

In 1997, in preparation for a primary care-based depression intervention trial, we began work on a new depression screening instrument. Based on a review of the literature and extensive conversations with primary care physicians about the barriers to effective office-based screening for depressive disorders, we determined that a practical screener needed to be:

  • 1.

    Patient administered rather than clinician administered 31, 32, 33, 34, 35

  • 2.

    Short—not a time burden to the patient or the office staff 36, 37, 38, 39

  • 3.

    Well-documented with proven good validity and reliability 34, 40

  • 4.

    Transparent—producing an accurate DSM-IV diagnosis [41], including which clinical symptoms of depression are present 34, 42, 43.

Regarding criterion 4, our concern was that a positive result from a screener without corresponding DSM-IV symptom information, may require further probing from the PCP and would be ignored. Screeners that do not provide the DSM-IV diagnosis make physician follow-up more complex and time consuming. Moreover, depression screeners that identify a patient based on simple cutoffs require a great deal of trust in the instrument. Providing DSM-IV symptoms keeps the physician as the locus of decision making and helps him or her distinguish false from true positive cases [44].

Few depression screeners meet all of the above criteria [45]. The Zung [46], the Beck Depression Inventory (BDI) 47, 48, and the CES-D 49, 50 do not produce a documented DSM-IV diagnosis. In addition, the CES-D has inadequate sensitivity and specificity 36, 51. Clinician-administered screeners 38, 39, 52, 53, 54 pose an impractical burden on the primary care physician. Some depression-severity instruments have been adapted as screeners [55], but are not suitable for primary care because they rely heavily on physical symptoms potentially unrelated to depression.

When we started our work, the screener that best met the above four criteria was the Inventory to Diagnose Depression (IDD) [42]. However, it takes 15–20 min for patients to complete—far too long for office-based screening. We, therefore, developed a new, shorter screener to meet all of our criteria.

This paper describes the screening instrument we developed, and compares its performance to the two other screening instruments that most closely met the four criteria, the IDD and the PRIME-MD-PHQ (PHQ) [56]. Our screener is called the Primary Care Screener for Affective Disorders or PC-SAD.

To maximize generalizability, our sample included both inpatients and outpatients from different practice settings (see Table 1). We compared instruments using a symptom-by-symptom approach to determine presence or absence of major depressive disorder (MDD) (i.e., met five or more out of nine criteria). We compared all of these screeners with a gold standard of a psychiatrist's diagnosis when such a diagnosis was available.

Section snippets

Inventory to diagnose depression

At the time we began this work, a 22-item MDD screener developed by Zimmerman 42, 57, 58 came the closest to meeting the four criteria described in the introduction. Each of the 22 items consists of five statements (scored 0 through 4) that range from no symptom (score 0) to the most severe of that symptom (score 4). Each set of statements corresponds to one of the nine DSM-IV symptoms for MDD and most symptoms require more than one set of statements. A symptom is considered positive if any

Patient characteristics

Table 1 describes the samples that were used in this validation study, showing the number of patients from each of the subsamples used in these analyses, and mean MHI-5 scores for each. A mean score of 52 or lower on this scale suggests a mental health problem, and healthy adults are reported to have a mean score of 79 [60]. Both the psychiatric outpatients (46.4 vs. 70.7, P < .0001) and the psychiatric inpatients (41.2 vs. 70.7, P < .0001) had lower mental health scores than the primary care

Discussion

In this analysis, the PC-SAD struck a balance between the very short PHQ and the longer IDD. The prescreener lowers the average completion time of the PC-SAD to the same level as the PHQ. The PHQ has the advantage of being hand scored. The PC-SAD, as we have used it in further work, also gives the SF-12 and a dysthymia screener, as well as possible mania and current alcoholism.

The PC-SAD and the IDD had roughly equivalent performance across all analyses. They had a high agreement with each

Acknowledgements

This work was supported in part by grant MH56214 from the National Institute of Mental Health, Rockville, MD, and could not have been completed without the assistance of Doris Hernandez.

References (77)

  • P.E. Greenberg et al.

    The economic burden of depression in 1990

    J Clin Psychiatry

    (1993)
  • H.C. Schulberg et al.

    Treating major depression in primary care practiceeight-month clinical outcomes

    Arch Gen Psychiatry

    (1996)
  • G.E. Simon

    Can depression be managed appropriately in primary care?

    J Clin Psychiatry

    (1998)
  • K.B. Wells et al.

    Caring for depression

    (1996)
  • R. Frank et al.

    The value of mental health care at the system levelthe case of treating depression

    Health Aff (Millwood)

    (1999)
  • Depression in primary caredetection and diagnosis

    (1993)
  • Crismon ML, Trivedi M, Pigott TA, Rush AJ, Hirschfeld RM, Kahn DA, et al. The Texas Medication Algorithm Project:...
  • W. Katon et al.

    Collaborative management to achieve treatment guidelinesimpact on depression in primary care

    JAMA

    (1995)
  • W. Katon et al.

    A multifaceted intervention to improve treatment of depression in primary care

    Arch Gen Psychiatry

    (1996)
  • W. Katon et al.

    Stepped collaborative care for primary care patients with persistent symptoms of depressiona randomized trial

    Arch Gen Psychiatry

    (1999)
  • D.J. Katzelnick et al.

    Randomized trial of a depression management program in high utilizers of medical care

    Arch Fam Med

    (2000)
  • G.E. Simon et al.

    Randomised trial of monitoring, feedback, and management of care by telephone to improve treatment of depression in primary care

    BMJ

    (2000)
  • K.B. Wells et al.

    Impact of disseminating quality improvement programs for depression in managed primary carea randomized controlled trial

    JAMA

    (2000)
  • E.H. Lin et al.

    Can enhanced acute-phase treatment of depression improve long-term outcomes? A report of randomized trials in primary care

    Am J Psychiatry

    (1999)
  • H.C. Schulberg et al.

    Treating major depression in primary care practice

    Arch Gen Psychiatry

    (1998)
  • M. Klinkman et al.

    Case finding instruments to be used to improve physician detection of depression in primary care

    Arch Fam Med

    (1997)
  • L. Goldman et al.

    Handbook of psychiatry in primary care

    (1998)
  • J. Miranda et al.

    Mental disorders in primary care

    (1994)
  • U.S. Department of Health and Human Services. Mental Health: A report of the surgeon general. Rockville, MD: U.S....
  • L. Eisenberg

    Sounding boardtreating depression and anxiety in primary care: closing the gap between knowledge and practice

    N Engl J Med

    (1992)
  • R.W. Manderscheid et al.

    Congruence of service utilization estimates from the Epidemiologic Catchment Area project and other sources

    Arch Gen Psychiatry

    (1993)
  • T. Schwenk

    Screening for depression in primary carea disease in search of a test

    J Gen Intern Med

    (1996)
  • Guide to clinical preventive services

    (1996)
  • M. Valenstein et al.

    The cost-utility of screening for depression in primary care

    Ann Intern Med

    (2001)
  • C.D. Mulrow et al.

    Case-finding instruments for depression in primary care settings

    Ann Intern Med

    (1995)
  • C.P. Schade

    A ten-year review of the validity and clinical utility of depression screening

    Psychiatr Serv

    (1998)
  • D.M. Berwick et al.

    Performance of a five-item mental health screening test

    Med Care

    (1991)
  • W. Eaton et al.

    A comparison of self-report and clinical diagnostic interviews for depression

    Arch Gen Psychiatry

    (2000)
  • Cited by (49)

    • Improving work outcomes of dysthymia (persistent depressive disorder) in an employed population

      2015, General Hospital Psychiatry
      Citation Excerpt :

      Dysthymia was defined as a minimum of two out of six Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition persistent depressive symptoms lasting 2 years or longer, according to the PC-SAD questionnaire [42]. The PC-SAD has a sensitivity of 87% and specificity of 95%, comparable to the diagnostic accuracy associated with other depression screeners [42]. Work limitations were signified by an at-work PL of score of ≥ 5% from the Work Limitations Questionnaire (WLQ), a validated measurement tool [12,43–45].

    • Suicide risk in skin disorders

      2013, Clinics in Dermatology
    • Capturing complexity: The case for a new classification system for mental disorders in primary care

      2008, European Psychiatry
      Citation Excerpt :

      Screening questionnaires are also used to measure severity. The PHQ has been widely used for this purpose in depression, as have the Inventory to Diagnose Depression [84] and the Primary Care Screener for Affective Disorder (PC-SAD) [60]. All perform as well as the Beck Depression Inventory [59], although most have not been validated in languages other than English.

    View all citing articles on Scopus
    View full text