Abstract
Objectives:To determine the accuracy of experienced nurse practitioners’ judgments of the probability of chlamydial infection of the cervix, to identify the clinical factors (“cues”) related to the judgments, and to discern likely sources of judgment error.
Design:Cross-sectional study with prospective data collection.
Setting:Urban hospital-based clinic.
Patients:492 nonpregnant women receiving primary gynecologic care.
Interventions:Four nurse practitioners recorded clinical data, tested women for chlamydial infection, and judged the probability of chlamydial infection using six categories: <1%, 1–4%, 5–9%, 10–24%, 25–50%, and >50%.
Measurements and main results:Chlamydial infection was detected by immunofluorescent assay in 31 (6%) of the 492 women. Although the median probability judgment was 5–9%, judgments were only weakly related (p=0.08) to actual rates of infection. In a multivariate analysis, eight clinical cues were independently (p<0.05) related to nurse practitioners’ probability judgments: age <20 years; past chlamydial or gonococcal infection; new sex partner; partner with suspected genital infection; genitourinary symptoms; cervicitis, purulent vaginal discharge; and malodorous vaginal discharge. A linear model based on the eight cues, weighted according to their regression coefficients, predicted chlamydial infection more accurately than did the nurse practitioners’ actual judgments (ROC curve areas 0.69 vs. 0.58, respectively; p<0.05). However, only two of the eight cues (age <20 years and purulent vaginal discharge) were actually related to chlamydial infection in a second multivariate model; this model had accuracy similar to that of an empirically derived prediction rule (ROC curve areas 0.77 and 0.80, p=0.27).
Conclusions:Nurse practitioners were often inaccurate in their diagnostic judgments. Our analyses suggest that this inaccuracy stemmed from both the inconsistent use of clinical cues and the use of cues that were not related to chlamydial infection. Therefore, interventions such as algorithms that promote consistency and accuracy in diagnostic use of relevant cues would be likely to improve their diagnostic judgments.
Similar content being viewed by others
References
Drury M, Greenfield S, Stilwell B, Hull FM. A nurse practitioner in general practice: patient perceptions and expectations. J R Coll Gen Pract. 1988;38:503–5.
Mechanic D, Aiken LH. A cooperative agenda for medicine and nursing. N Engl J Med. 1982;307:747–50.
Makadon HJ, Gibbons MP. Nurses and physicians: prospects for collaboration. Ann Intern Med. 1985;103:134–6.
Gietl KA. Role of the nurse practitioner in the management of vaginitis. Am J Obstet Gynecol. 1988;158:1009–11.
Ramsay JA, McKenzie JK, Fish DG. Physicians and nurse practitioners: do they provide equivalent care? Am J Public Health. 1982;72:55–7.
Bessman A. Comparison of medical care in nurse clinician and physician clinics in medical school affiliated hospitals. J Chron Dis. 1974;27:115–25.
Salkever DS, Skinner EA, Steinwachs DM, Katz H. Episode-based efficiency comparisons for physicians and nurse practitioners. Med Care. 1982;20:143–53.
Sackett D, Spitzer W, Gent M, et al. The Burlington randomized trial of the nurse practitioner: health outcomes of patients. Ann Intern Med. 1974;80:137–42.
Flynn B. The effectiveness of nurse clinicians’ service delivery. Am J Public Health. 1974;64:604–11.
Aiken LH, Mullinix CF. The nursing shortage: myth or reality? N Engl J Med. 1987;317:641–6.
Iglehart J. Problems facing the nursing profession. N Engl J Med. 1987;317:646–51.
Stein LI, Watts DT, Howell T. The doctor-nurse game revisited. N Engl J Med. 1990;322:549–9.
Poses RM, Cebul RD, Collins M, Fager SS. The accuracy of experienced physicians’ probability judgments for patients with sore throats: implications for decision making. JAMA. 1985;254:925–9.
Dawes RM, Faust D, Meehl PE. Clinical versus actuarial judgment. Science. 1989;243:1668–74.
Berwick DM, Thibodeau LA. Receiver operating characteristic analysis of diagnostic skill. Med Care. 1983;21:876–85.
Koran LM. The reliability of clinical methods, data, and judgments (part one). N Engl J Med. 1975;293:642–6.
Koran LM. The reliability of clinical methods, data, and judgments (part two). N engl J Med. 1975:295–701.
Dawes RM, Corrigan B. Linear methods in decision making. Psychol Bull. 1974;81:95–106.
Wigton RS. Use of linear models to analyze physicians’ decisions. Med Decis Making. 1988;8:241–52.
Speroff T, Connors AF, Dawson NV. Lens model analysis of hemodynamic status in the critically ill. Med Decis Making. 1989;9:243–52.
Kruse JA, Thill-Baharozian MC, Carlson RW. Comparison of clinical assessment with APACHE II for predicting mortality risk in patients admitted to a medical intensive care unit. JAMA. 1988;260:1739–42.
Brannen AL, Godfrey LJ, Goetter WE. Prediction of outcome from critical illness: a comparison of clinical judgment with a prediction rule. Arch Intern Med. 1989;149:1083–6.
Rosenthal GE, Mettler G, Pare S, Riegger M, Ward M, Landefeld CS. A new diagnostic index for predicting cervical infection with eitherChlamydia trachomatis orNeisseria gonorrhoeae. J Gen Intern Med. 1990;5:319–26.
Harrison HR, Costin M, Meder JB, et al. CervicalChlamydia trachomatis infection in university women: relationship to history, contraception, ectopy, and cervicitis. Am J Obstet Gynecol. 1985;153:244–51.
Brunham RC, Paavonen J, Stevens CE, et al. Mucopurulent cervicitis—the ignored counterpart in women of urethritis in men. N Engl J Med. 1984;311:1–6.
Landefeld CS, McGuire E, Rosenblatt MW. A bleeding risk index for estimating the probability of major bleeding in hospitalized patients starting anticoagulant therapy. Am J Med. 1990;89:569–78.
Harrel FE Jr. The logist procedure. In: SUGI supplemental library user’s guide, 1983 edition. Cary, NC: SAS Institute, Inc, 1983; 181–202.
McCullagh P. Regression models for ordinal data. J R Stat Soc. 1980;41:109–42.
Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36.
McNeil BJ, Hanley JA. Statistical approaches to the analysis of receiver operating characteristic (ROC) curves. Med Decis Making. 1984;137–50.
Handsfield HH, Jasman LL, Roberts PL, Hanson VW, Kothenbeutel RL, Stamm WE. Criteria for selective screening forChlamydia trachomatis infection in women attending family planning clinics. JAMA. 1986;255:1730–4.
Phillips RS, Hanff PA, Holmes MD, Wertheimer A, Aronson MD.Chlamydia trachomatis cervical infection in women seeking routine gynecologic care: criteria for selective screening. Am J Med. 1989;86:515–20.
Johnson BA, Poses RM, Fortner CA, Meier FA, Dalton HP. Derivation and validation of clinical diagnostic model for cervical infection in university women. JAMA. 1990;264:3161–5.
Chlamydia trachomatis infections: policy guidelines for prevention and control. MMWR. 1985;34(suppl):53S–74S.
Woner-Hanssen P, Krieger JN, Stevens CE, et al. Clinical manifestations of vaginal trichomoniasis. JAMA. 1998;261:571–6.
Goldman L, Cook EF, Brand DA, et al. A computer protocol to predict myocardial infarction in emergency department patients with chest pain. N Engl J Med. 1988;318:797–803.
Uyeda CT, Welborn P, Ellison-Birang NE, Shunk K, Tsaouse B. Rapid diagnosis of chlamydial infections with the Micro Trak direct test. J Clin Microbiol. 1984;29:948–50.
Cherneskey MA, Maohny JB, Castriciano S, et al. Detection ofChlamydia trachomatis antigens by enzyme immunoassay and immunofluorescence in genital specimens from symptomatic and asymptomatic men and women.J Infect Dis. 1986;154:141–8.
Phillips RS, Hanff PA, Kauffman RS, Aronson MD. Use of a direct fluorescent antibody test for detectingChlamydia trachomatis cervical infection in women seeking routine gynecologic care. J Infect Dis. 1987;156:575–81.
Copeland KT, Checkoway H, McMichael AJ, Holbrook RH. Bias due to misclassification in the estimation of relative risk. Am J Epidemiol. 1977;105:488–95.
Poses RM, Cebul RD, Centor RM. Evaluating physicians’ probabilistic judgments. Med Decis Making. 1988;8:233–40.
Phillips RS, Aronson MD, Taylor WC, Safran C. Should tests forChlamydia trachomatis cervical infection be done during routine gynecologic visits? Ann Intern Med. 1987;107:188–94.
Author information
Authors and Affiliations
Additional information
Received from the Divisions of General Internal Medicine and Geriatrics and the Clinical Analysis Project, Department of Medicine, Cleveland Veterans Administration Medical Center, University Hospitals of Cleveland and Case Western Reserve University School of Medicine, Cleveland, Ohio.
Rights and permissions
About this article
Cite this article
Rosenthal, G.E., Mettler, G., Pare, S. et al. Diagnostic judgments of nurse practitioners providing primary gynecologic care. J Gen Intern Med 7, 304–311 (1992). https://doi.org/10.1007/BF02598089
Issue Date:
DOI: https://doi.org/10.1007/BF02598089