Abstract
Survey reports of police stops and driving behavior are a potential methodology for examining the magnitude and prevalence of the “Driving While Black” phenomena. However, estimates of the magnitude or correlates of racial disparity in police stops from self-reported survey data are potentially compromised if the accuracy of self-reports of police stops and driving behavior differ by race. We report on the results of a reverse record check survey in which we directly assess the degree and consequences of differences by race in self-reports of police stops. In our sample of drivers who had been cited for speeding in the preceding year, we found that 77% of the White respondents and 71% of the African American respondents admitted to being stopped. While both groups underreport stops, African Americans do so at a higher rate. This finding is consistent with many past studies which report stronger social desirability effects on survey responses among African Americans. Thus, survey data will tend to underestimate the magnitude of the “Driving While Black” phenomena.
Similar content being viewed by others
Explore related subjects
Discover the latest articles and news from researchers in related subjects, suggested using machine learning.Notes
These two surveys are part of a larger methodological study on the “Driving While Black” phenomena. That study was also concerned with developing demographic and observational methods for analyzing official police records of stops and with understanding citizen and police interpretations of how racial information is used in stop decisions. This study is described in Smith et al. (2003).
In the context of a survey of police stops we doubt that there are communication or knowledge sources of response error. We assume that registered drivers in the contemporary United States understand the concepts associated with being pulled over by the police and can recognize it when it happens to them. We design our survey to minimize memory problems, but it is likely that some under reporting reflects forgetting that a stop occurred. We control for this possibility in the analyses that follow.
The survey was originally scheduled to run for 6 months, but was fielded one month later than anticipated and was in the field for 7 months. This meant that for some respondents the survey was administered more than a year after the speeding stop that selected them into the sample. This presents possible telescoping errors in response which we discuss below and correct for statistically.
A cooperation rate is the proportion of all cases interviewed of all eligible units ever contacted. AAPOR (1998) Cooperation Rate 1 (COOP1), or the minimum cooperation rate, is the number of complete interviews divided by the number of interviews (complete plus partial) plus the number of non-interviews that involve the identification of and contact with an eligible respondent (refusal and break-off plus other).
AAPOR Response Rate 1 (RR1), or the minimum response rate, is the number of completed interviews divided by the number of interviews (complete plus partial) plus the number of non-interviews (refusal and break-off plus non-contacts plus others) plus all cases of unknown eligibility (unknown if housing unit, plus unknown, other).
The basic race gap in the odds of reporting a speeding stop is that African Americans are 0.57 times as likely as whites to report a speeding stop. If we adjust this to account for the additional influence of the 1 year race difference in black and white sample selection the odds change only slightly to 0.56.
For our sample we only have the number of stops in the last year for those who report any stop to begin with. Thus it is for the sample that is least likely to displaying social desirability response errors. Among this sample, African Americans report an average of 2.55 stops in the last year while whites report 2.13. Interestingly, African Americans reports only 1.2 speeding stops, while whites report 1.59, suggesting that among the population of cited speeders African Americans are being pulled over for other reasons at higher rates than whites.
This was done to anchor recall by respondents in order to mitigate the possibility of telescoping effects. The reference period for stop recall was set at 12 months to aid respondent memory as well as to ensure that the stop being referenced had occurred during the time period employed by interviewers.
We replicated these analyses with self-reports of any stop in the last year and substantive results were the same.
Although the interaction at 65 mile per hour approaches significance (p = 0.235) the sign is negative suggesting that African American’s who were truthful in reporting their speeding stop actually drive slower than those that were not. There is no evidence here of race specific social desirability response effects on self-reports of driving speed.
These analyses were replicated when any stop in the last year was substituted for speeding stops. We also repeated the analyses in Table 4 using a dummy variable for reporting driving ten or more miles per hour above the speed limit and the results were the same. We also reran the analyses in both Tables 3 and 4 deleting a single African American case with very low reported normal driving speeds but the substantive results were unchanged.
Of course, the process may be more complicated than this. If for example, the consequences of a police stop are higher in locales where there is a larger race disparity in police stops, such as North Carolina, we might expect lower recall error in such places and so a smaller race linked social desirability effect. If this was actually happening, then the NC estimate of race linked social desirability may understate the true race difference in reporting in places with few stops or where stops have low consequences. Of course, since the incidence of stops will also be low the differences in estimates will typically be small.
References
Abramson P, Claggett W (1984) Race-related differences in self-reported and validated turnout. J Polit 46:719–738
Akers RL, Massey J, Clarke W, Lauer RM (1983) Are self-reports of adolescence deviance valid? Biochemical measures, randomized response, and the bogus pipeline in smoking behavior. Soc Forces 62:234–251
American Association for Public Opinion Research (1998) Standard Definitions: Final Disposition of Case Codes and Outcome Rates for RDD Telephone Surveys and In Person Household Surveys, Ann Arbor, MI
Brehm J (1993) The phantom respondents; opinion surveys and political representation. University of Michigan Press, Ann Arbor MI
Biderman A, Lynch J (1981) Recency bias in data on self-reported victimization. American Statistical Association 1981 proceedings of the Social Statistics Section, American Statistical Association, Washington, DC
Bradburn N, Sudman S, Blair E, Stocking C (1978) Question threat and response bias. Public Opin Quart 42:221–234
Bradburn N, Sudman S (1979) Improving interview method and questionnaire design. Jossey Bass, San Francisco
Clark J, Tifft L (1966) Polygraph and interview validation of self-reported deviant behavior. Am Sociol Rev 31:516–523
Cohen S, Carlson B (1995) Characteristics of reluctant respondents in the national medical expenditure survey. J Econ Soc Meas 21:269–296
Cordner G, Williamsn B, Velasco A (2002) Vehicle Stops in San Diego: 2002. Downloaded 2-8-2004 from: http://www.sannet.gov/police/pdf/stoprpt.pdf
Cox BG, Witt MB, Traccarella MA, Perez-Michael AM (1992) Inconsistent reporting of drug use in 1988. In: Turner CF, Lessler JT, Gfroerer JC (eds) Survey measurement of drug use: methodological studies. U.S. Department of Health and Human Services (DHHS Publication No. ADM 92-1929, pp 109–154). Rockville, MD: National Institute on Drug Abuse
Czaja R, Trunzo D, Royston P (1992) Response effects in a network survey. Sociol Method Res 20:340–366
Czaja R, Blair J (1990) Using network sampling in crime victimization surveys. J Quant Criminol 6:185–206
Czaja R, Blair J, Bickart B, Eastman E (1994) Respondent strategies for recall of crime victimization incidents. J Off Stat 10:257–276
DeLamater JD (1982) Response effects of question content. In: Dijkstra W, vanderZouwen J (eds) Response behaviour in the survey interview. Academic Press, London, pp 13–48
Dodge R (1970) Victim Recall Pretest – Washington, DC, U.S. Bureau of the Census, memorandum, Washington, DC
Dodge R (1983) Using record checks. Proceedings, Section on Survey Research Methods, American Statistical Association, pp 680–684
Engel RS, Calnon JM (2004) Examining the influence of drivers’ characteristics during traffic stops with police: results from a national survey. Justice Quart 21:49–90
Farrington DP, Loeber R, Stouthamer-Loeber M, Van Kaamen WB, Schmidt L (1996) Self-reported delinquency and a combined delinquency seriousness scale based on boys, mothers, and teachers: concurrent and predictive validity for African-Americans and Caucasians. Criminology 34:493–517
Fridell L, Lunney R, Diamond D, Kubu B (2001) Racially biased policing: a principled response. Police Executive Research Forum, Washington, DC
Fu H, Darroch J, Henshaw S, Kolb E (1998) Measuring the extent of abortion underreporting in the 1995 national survey of family growth. Family Plann Perspect 30:128–133, 138
Groves R, Couper M (1998) Nonresponse in household interview surveys. John Wiley & Sons, Inc., New York
Hare A (1960) Interview responses: personality or conformity? Public Opin Quart 24:679–685
Harris D (2002) Profiles in injustice: why police profiling cannot work. The New Press, New York
Hawkins D (1975) Estimation of nonresponse bias. Sociol Method Res 3:461–488
Hill KQ, Hurley P (1984) Nonvoters in voters’ clothing: the impact of voting behavior misreporting on voting behavior research. Social Sci Quart 65:199–206
Hindelang MJ, Hirschi T, Weiss JG (1981) Measuring delinquency. Sage Publications, Beverly Hills, CA
Huizinga D, Ellliott D. S. (1986) Reassessing the reliability and validity of self-report delinquency measures. J Quant Criminol 2:293–327
Jackson JS, Tucker MB, Bowman PB (1982) Conceptual and methodological problems in survey research on black Americans. In: Liu WT (ed) Methodological problems in minority research. Pacific/Asian American Health Center, Chicago, pp 11–40
Junger-Tas J, Marshall IH (1999) The self-report methodology in crime research. In: Tonry M (ed) Crime and Justice: A Review of the Research, vol 25. University of Chicago Press, Chicago, pp 297–367
Knowles J, Persico N, Todd P (2001) Racial bias in motor vehicle searches: theory and evidence. J Polit Econ 109:203–229
Kormendi E (1988) The quality of income information in telephone and face-to-face surveys. In: Groves RM, Biemer P, Lyberg L, Massey J, Nicholls WL, Waksberg JL (eds) Telephone survey methodology. Wiley, New York
Langan PA, Greenfeld LA, Smith SK, Durose MR, Levin DJ (2001) Contacts between Police and the Public: Findings from the 1999 National Survey, Bureau of Justice Statistics, U.S. Department of Justice
Lange JE, Johnson MB, Voas RB (2005) Testing the racial profiling hypothesis for seemingly disparate traffic stops on the New Jersey turnpike. Justice Quart 22:193–224
Lenski G, Legget J (1960) Caste, class and deference in the research interview. Am J Sociol 65:463–467
Lundman R, Kaufman R (2003) Driving while black: effects of race, ethnicity, and gender on citizen self-reports of traffic stops and police actions. Criminology 41:601–626
Magura S, Goldsmith D, Casriel C, Goldstein PJ, Lipton DS (1987) The validity of methadone clients’ self-reported drug use. Int J Addict 22:727–49
Meehan AJ, Ponder M (2002) Race and place: the ecology of racial profiling African American motorists. Justice Quart 19:399–430
Meeks K (2000) Driving while black. Broadway Books, New York
Miller PV, Groves RM (1985) Matching survey responses to official records: an exploration of validity in victimization reporting. Public Opin Quart 49:366–380
Mosher CJ, Meithe TD, Phillips DM (2002) The mismeasure of crime. Sage Publications, Thousand Oaks, CA
Murphy LR, Dodge RW (1981) The Baltimore recall study. In: Lenhan RG, Skogan WG (eds) The National Crime Survey: Working Papers, vol 1. Current and Historical Perspectives. U.S. Government Printing Office, Washington, DC, pp 16–21
O’Neil M (1979) Estimating the nonresponse bias due to refusals in telephone surveys. Public Opin Quart 43(1):103–111
Ramirez D, McDevitt J, Farrell A (2000) A resource guide on racial profiling data collection systems. U.S. Department of Justice, Washington, DC
Smith MR, Alpert GP (2002) Searching for direction: courts, social science, and the adjudication of racial profiling claims. Justice Quart 19:673–704
Smith MR, Petrocelli M (2001) Racial profiling? A multivariate analysis of police traffic stop data. Police Quart 4:4–27
Smith W, Tomaskovic-Devey D, Zingraff MT, Mason HM, Warren PY, Wright CP (2003) The North Carolina Highway Traffic Study Final Report to the National Institute of Justice. U.S. Department of Justice, Washington DC
Sparks R (1981) Multiple victimization: evidence theory and future research. J Crim Law Criminol 72:762–778
Stocking C (1979) Reinterpreting the Marlowe–Crowne scale. In: Bradburn N, Sudman S (eds) Improving interview method and questionnaire design. Jossey-Bass, San Francisco
Sudman S, Bradburn N (1974) Response effects in surveys: a review and synthesis. Aldine, Chicago
Sudman S, Bradburn N (1982) Asking questions: a practical guide to questionnaire design. Jossey-Bass, San Francisco
Taylor B, Bennett T (1999) Comparing drug use rates of detained arrestees in the United States and England. National Institute of Justice, Washington, DC
Thomas D (2002) 1st Annual report of Denver Police Department Contact Card Analysis, City and County of Denver. Downloaded 9-12-2003 from http://www.admin.denvergov.org/admin/template3/forms/DPDContactCardAnnualReport102902.pdf
Thornberry TP, Krohn MD (2000) The self-report method for measuring delinquency and crime. In: Duffee D (ed) Measurement and Analysis of Crime and Justice, vol 4. Criminal Justice 2000. National Institute of Justice, Washington, DC, pp 38–84
Tourangeau R, Rips LJ, Rosinski K (2000) The psychology of survey response. Cambridge University Press, New York
Traugott M, Katosh J (1979) Response validity in surveys of voting behavior. Public Opinion Quart 43:359–77
Turner A (1972) The San Jose Methods Test of known crime victims. National Criminal Justice Information and Statistical Service, Washington, DC
Udry R, Gaughan M, Schwingl P, van den Berg B (1996) A medical record linkage analysis of abortion underreporting. Fam Plann Perspect 28:228–31
Yost L, Dodge R (1970) Household survey of victims of crimes: second pretest – Baltimore, Maryland. U.S. Bureau of the Census, memorandum, Washington, DC
Weitzer R, Tuch S (2002). Perceptions of racial profiling: Race, class, and personal experience. Criminology 40:435–457
Witt M, Pantula J, Folsom R, Cox B (1992) Item nonresponse in 1988. In: Turner CF, Lessler JT, Gfroerer JG (eds) Survey measurement of drug use: methodological studies. U.S. Department of Health and Human Services, Washington, DC, pp 85–108
Author information
Authors and Affiliations
Corresponding author
Additional information
This paper is part of a larger project on racial profiling funded by the National Institute of Justice (#99-MU-CX-0022). The points of view expressed in this paper are those of the authors and do not represent the official position of the National Institute of Justice. Matthew Zingraff, William R. Smith, Marcinda Mason, and Patricia Warren all made important contributions to the design of this project and Bill Smith was particularly generous with comments on this paper. An early draft of this paper was presented at the American Society of Criminology Meeting. November 17, 2000, San Francisco, California.
Rights and permissions
About this article
Cite this article
Tomaskovic-Devey, D., Wright, C., Czaja, R. et al. Self-reports of Police Speeding Stops by Race: Results from the North Carolina Reverse Record Check Survey. J Quant Criminol 22, 279–297 (2006). https://doi.org/10.1007/s10940-006-9012-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10940-006-9012-0