Abstract
It is widely known that in practice, different interviewers have different response rates, though there has been no systematic examination of whether this is because of differences among interviewers or differences among those areas allocated to the interviewers (‘area’ effects), or both. Furthermore, the conventional wisdom in survey research suggests that it is advisable to have the same interviewers return to the same respondents in order to maintain good response rates in longitudinal surveys, though once again there has been very little documented experimental research to support this. This paper makes use of the interpenetrated sample design experiment in Wave 2 of the British Household Panel Study (BHPS) (i) to explore the effects of interviewers' background characteristics and years of experience on response rates, (ii) to identify and estimate the differential effects of interviewers on response rates and compare the magnitudes of area and interviewer effects, and (iii) to investigate the impact of ‘interviewer continuity’. The analysis is facilitated by the use of cross-classified multilevel modelling. The paper also looks at the issue of interviewer continuity qualitatively, through the impressions of the interviewers themselves.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bergman, L., Hanve, R., & Rapp, J. (1978). Why do some people refuse to participate in interview surveys? Sartryck ur Statistisk Tidskrift 5: 341–356.
Campanelli, P., Sturgis, P., & Purdon, S. (1997). Can You Hear Me Knocking: An Investigation into the Impact of Interviewers on Survey Response Rates. London: SCPR.
Couper, M. & Groves, R. (1992). The role of the interviewer in survey participation. Survey Methodology 18: 263–277.
DeMaio, T. (1980). Refusals: Who, where, and why. Public Opinion Quarterly 44: 223–233.
Dijkstra, W. & van der Zouwen, J. (1982). Response Behaviour in the Survey Interview. London: Academic Press Inc.
Dillman, D., Gallegos, J., & Frey, J. (1976). Reducing refusal rates for telephone interviews. Public Opinion Quarterly 40: 66–78.
Durbin, J. & Stuart, A. (1951). Differences in response rates of experienced and inexperienced interviewers. Journal of the Royal Statistical Society, Series A 114: 163–195.
Farrant, G. & O'Muircheartaigh, C. (1991). Components of nonresponse bias in the British election surveys. In A. Heath, J. Curtice, R. Jowell, S. Evans, J. Field, and S. Witherspoon (eds), Understanding Political Change. London: Pergamon Press, pp. 235–249.
Fellegi, I.P. (1964). Response variance and its estimation. Journal of the American Statistical Association 59: 1016–1041.
Fellegi, I.P. (1974). An improved method of estimating the correlated response variance. Journal of the American Statistical Association 69: 496–501.
Foster, K. (1996). A comparison of the Census characteristics of respondents and nonrespondents to the 1991 Family Expenditure Survey (FES). Survey Methodology Bulletin 38: 9–17, London: ONS.
Fowler, F.J. & Mangione, T.W. (1990). Standardized Survey Interviewing: Minimizing Interviewer-Related Error. Newbury Park, Calif.: SAGE Publications, Inc.
Goldstein, H. (1995). Multilevel Statistical Models (2nd edn). London: Edward Arnold.
Goudy, W.J. (1976). Nonresponse effects on relationships between variables. Public Opinion Quarterly 40: 360–369.
Gray, R., Campanelli, P., Deepchand, K., & Prescott-Clarke, P. (1996). Seven years on: The impact of attrition on a follow-up of the 1984/85 Health and Lifestyle Survey sample. Statistician 45(2): 1–21.
Groves, R. (1989). Survey Errors and Survey Costs. New York: Wiley.
Groves, R.M., Cialdini, R.B., & Couper, M.P. (1992). Understanding the decision to participate in a survey. Public Opinion Quarterly 56(4): 475–495.
Groves, R. & Couper, M. (1994). Householders and interviewers: The anatomy of pre-interview interactions, SMPWorking Paper No. 11. Ann Arbor,Mich.: Survey Research Centre, University of Michigan.
Groves, R. & Couper, M. (1996). Contact-level influences on cooperation in face-to-face surveys. Journal of Official Statistics 12(1): 63–83.
Hansen, M.H., Hurwitz, W.N., & Bershad, M.A. (1961). Measurement errors in censuses and surveys. Bulletin of the International Statistical Institute 38(2), 359–374.
Hartley, H.O. & Rao, J.N.K. (1978). Estimation of nonsampling variance components in sample surveys. In N.K. Namboodiri (ed.), Survey Sampling and Measurement. New York: Academic Press, pp. 35–43.
House, J. & Wolf, S. (1978). Effects of urban residence and interpersonal trust and helping behaviour. Journal of Personality and Social Psychology 36(9): 1029–1043.
Hox, J. (University of Utrecht) & de Leeuw, E. (University of Amsterdam) (1998). Personal communication.
Hox, J., de Leeuw, E., & Kreft, I. (1991). The effect of interviewer and respondent characteristics on the quality of survey data: a multilevel model. In P. Biemer, R. Groves, L. Lyberg, N. Mathiowetz, and S. Sudman (eds), Measurement Errors in Surveys. New York: Wiley.
Hyman, H. (1954, 1975). Interviewing in Social Research. Chicago: The University of Chicago Press.
Kahn, R. & Cannell, C. (1957). The Dynamics of Interviewing. New York: Wiley.
Kalton, G., Lepkowski, J., Montanari, G.E., & Maligalig, D. (1990). Characteristics of second wave nonrespondents in a panel survey. Proceedings of the Section on Survey Research Methods. American Statistical Association: Alexandria, Va.
Kish, L. (1962). Studies of interviewer variance for attitudinal variables. Journal of the American Statistical Association 57: 92–115.
Lessler, J. & Kalsbeek, W. (1992). Nonsampling Error in Surveys. New York: Wiley.
Lievesley, D. (1986). Unit Non-response in Interview Surveys. London: SCPR.
Mahalanobis, P.C. (1946). Recent experiments in statistical sampling in the Indian Statistical Institute. Journal of the Royal Statistical Society 109: 325–370.
Marcus. A.C. & Telesky, C.W. (1984). Nonparticipation in telephone follow-up interviews. In Proceedings of the Third Biennial Health Survey Methods Conference. Washington DC: National Center for Health Services Research, pp. 128–134.
Morton-Williams, J. (1993). Interviewer Approaches. Aldershot: Dartmouth Publishing Company Limited.
Oksenberg, L., Coleman, L., & Cannell, C. (1986). Interviewer voices and refusal rates in telephone surveys. Public Opinion Quarterly 50: 97–111.
O'Neil, M. et al. (1980). Telephone interview introductions and refusal rates: Experiments in increasing respondent cooperation. Proceedings of the American Statistical Association, Section on Survey Research Methods.
O'Muircheartaigh, C. & Campanelli, P. (1998). Interviewer effects and sample design effects: Relative magnitude and treatment. Journal of the Royal Statistical Society, Series A 161(1): 63–78.
Pavalko, R. & Lutterman, K. (1973). Characteristics of willing and reluctant respondents. Pacific Sociological Review 16(4): 463–476.
Rendtel, U. (1990). Teilnahmebereitschaft in Panelstudien: Zwischen Beeinflussung, Vertrauen und Sozialer Selektion. Kölner Zeitschrift für Soziologie und Sozialpsychologie 42(2): 280–299.
Rasbash, J., Woodhouse, G., Goldstein, H., Yang, M., Howarth, J., & Plewis, I. (1995). MLn Software. London: Multilevel Models Project, Institute of Education, University of London.
Rope, D. (1993). Preliminary longitudinal nonresponse research with the CPS and CE. Paper presented at the 4th International Workshop on Household Survey Nonresponse, Bath, U.K.
Singer, E., Frankel, M., & Glassman, M. (1983). The effect of interviewer characteristics and expectations on response. Public Opinion Quarterly 47: 68–83.
Singer, E., & Kohnke-Aguirre, L. (1979). Interviewer expectation effects: A replication and extension. Public Opinion Quarterly 43(2): 245–260.
Sudman, S. & Bradburn, N. (1974). Response Effects in Survey. Chicago: Aldine.
Vehovar, V. & Zaletel, M. (1995). The matching project in Slovenia: Who are the nonrespondents? Paper presented at the 6th International Workshop on Household Survey Nonresponse, Helsinki.
Waterton J. & Lievesley, D. (1987). Attrition in a panel study of attitudes. Journal of Official Statistics 3: 267–282.
Weaver, C., Holmes, S., & Glenn, G. (1975). Some characteristics of inaccessible respondents in a telephone survey. Journal of Applied Psychology 60(2): 260–262.
Wiggins, R., Longford, N., & O'Muircheartaigh, C. (1992). A variance components approach to interviewer effects. In A. Westlake, R. Banks, C. Payne, and T. Orchard (eds), Survey and Statistical Computing. Amsterdam: North-Holland.
Wilcox, J. (1977). The interaction of refusal and not-at-home sources of nonresponse bias. Journal of Marketing Research XIV: 592–597.
Rights and permissions
About this article
Cite this article
Campanelli, P., O'Muircheartaigh, C. Interviewers, Interviewer Continuity, and Panel Survey Nonresponse. Quality & Quantity 33, 59–76 (1999). https://doi.org/10.1023/A:1004357711258
Issue Date:
DOI: https://doi.org/10.1023/A:1004357711258