Skip to main content
SpringerLink
Log in

Mobile- and Landline-Onlys in Dual-Frame-Approaches: Effects on Sample Quality

  • Chapter
  • First Online:
Telephone Surveys in Europe

Introduction

Mass media, politics, and commercial enterprises are increasingly using social survey data to substantiate their reasoning and interventions. Although the number of telephone surveys is decreasing more than one third of all studies of market and social research in Germany is conducted on the telephone (ADM 2011). This raises questions about the quality of the gathered data. One of the central variables to look at is the quality of the realised sample. Reflecting the number of sample units interviewed as a percentage of the number of eligible sample units, response rates are considered reliable indicators of data quality. However, irrespective of the mode declining response rates question this assumption (Schnell 1997, de Heer 1999, Däubler 2002, de Leeuw and de Heer 2002, Curtin et al. 2005, Stoop 2005). In addition to the number of ineligible cases (including people not part of the target population or unable to participate) the quality of surveys of the general population suffers from nonrespondents. A growing number of contacted persons refuses participation in market and scientific surveys. Numerous studies have examined different aspects of this phenomenon in detail and offered solutions to the problem (Blasius and Reuband 1995, Hüfken 2000, de Leeuw and Hox 2004, Meier et al. 2005, de Leeuw et al. 2007, Schnauber and Daschmann 2008).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  • ADM (Arbeitskreis Deutscher Markt- und Sozialforschungsinstitute e.V.). Figures on the Market for Market Research, vol. 2) (2011), http://www.adm-ev.de/index.php?id=zahlen&type=1&L=1&type=1 (accessed April 13, 2010)

  • AAPOR (The American Association for Public Opinion Research). Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys. Vol. 7 (2011), http://www.aapor.org/Standard_Definitions/3049.htm (accessed June 30, 2011)

  • Aust, F., Schröder, H.: Sinkende Stichprobenausschöpfung in der Umfrageforschung – ein Bericht aus der Praxis (Declining Sampling Coverage in Survey Research – a Report from Practical Experience). In: Weichbold, M., et al. (eds.) Umfrageforschung – Herausforderungen und Grenzen. Österreichische Zeitschrift für Soziologie, vol. 9, pp. 195–212 (2009)

    Google Scholar 

  • Blasius, J., Reuband, K.-H.: Telefoninterviews in der empirischen Sozialforschung: Ausschöpfungsquoten und Antwortqualität (Telephone Interviews in Empirical Social Research: Response Rates and Response Quality). ZA-Information 37, 64–87 (1995)

    Google Scholar 

  • Blumberg, S.J., Luke, J.V., Cynamon, M.L., Frankel, M.R.: Recent Trends in Household Telephone Coverage in the United States. In: Lepkowski, J., et al. (eds.) Telephone Survey Methodology, pp. 56–86. John Wiley & Sons, Hoboken (2008)

    Google Scholar 

  • Busse, B., Fuchs, M.: The components of landline telephone survey coverage bias. The relative importance of nophone and mobile-only populations. Quality & Quantity 45, 1–17 (2011)

    Article  Google Scholar 

  • Carley-Baxter, L.R., Peytchev, A., Black, M.C.: Comparison of Cell Phone and Landline Surveys: A Design Perspective. Field Methods 22(1), 3–15 (2010)

    Article  Google Scholar 

  • Curtin, R., Presser, S., Singer, E.: Changes in telephone survey nonresponse over the past quarter century. Public Opinion Quarterly 69(1), 87–98 (2005)

    Article  Google Scholar 

  • Däubler, T.: Nonresponseanalysen der Stichprobe F des SOEP (Nonresponse Analyses SOEP Sample F). DIW Materialien 15 (2002) http://www.diw-berlin.de/documents/publikationen/73/38830/diw_rn02-05-15.pdf (accessed September 21, 2008)

  • de Heer, W.: International Response Trends: Results of an International Survey. Journal of Official Statistics 15(2), 129–142 (1999)

    Google Scholar 

  • de Leeuw, E.D., Hox, J.J.: I am not selling anything: 29 experiments in telephone introductions. International Journal of Public Opinion Research 16(4), 464–473 (2004)

    Article  Google Scholar 

  • de Leeuw, E.D., Callegaro, M., Hox, J.J., Korendijk, E., Lensvelt-Mulders, G.: The influence of advance letters on response in telephone surveys: a metaanalysis. Public Opinion Quarterly 71(3), 1–31 (2007)

    Article  Google Scholar 

  • de Leeuw, E., de Heer, W.: Trends in household survey nonresponse. A longitudinal and international comparison. In: Groves, R.M., et al. (eds.) Survey Nonresponse, pp. 41–54. John Wiley & Sons, New York (2002)

    Google Scholar 

  • Diekmann, A.: Die Demoskopie verletzt Informationspflichten. Zur Bedeutung von Interview-Verweigerung und misslungenen Kontaktversuchen (Polls Violate Reporting Requirements. On the Importance of Refusals and Unsuccessful Contact Attempts). Neue Züricher Zeitung 276, 14 (2010)

    Google Scholar 

  • Dillman, D.A.: Mail and telephone surveys. In: The total design method. John Wiley & Sons, New York (1978)

    Google Scholar 

  • Dillman, D.A., Gallegos, J.G., Frey, J.H.: Reducing Refusal Rates for Telephone Interviews. Public Opinion Quarterly 40, 66–78 (1976)

    Article  Google Scholar 

  • Ehlen, J., Ehlen, P.: Celluar-Only substituions in the United States as lifestyle adoption. Public Opinion Quarterly 71(4), 717–733 (2007)

    Article  Google Scholar 

  • Europäische Kommission. E-Communications Haushaltsumfrage – Bericht. Spezial-Eurobarometer 335 (Household survey) (2010), http://ec.europa.eu/public_opinion/archives/ebs/ebs_335_de.pdf (accessed October 10, 2010)

  • Field, A.: Discovering statistics using SPSS (and sex, drugs, and rock ’n’ roll). SAGE Publications, London (2005)

    Google Scholar 

  • Fuchs, M.: Zukünftige Herausforderungen der Umfrageforschung (Future Challenges of Survey Research). In: Faulbaum, F., Wolf, C. (eds.) Gesellschaftliche Entwicklungen im Spiegel der Empirischen Sozialforschung, pp. 227–252. VS Verlag für Sozialwissenschaften, Wiesbaden (2010)

    Chapter  Google Scholar 

  • Gerlitz, J.-Y., Schupp, J.: Zur Erhebung der Big-Five-basierten Persönlichkeitsmerkmale im SOEP (Research on Big5 Personality Traits with SOEP Data). DIW Berlin Research Notes 4/2005 (April 2005), http://www.diw.de/sixcms/detail.php?id=diw_02.c.231308.de (accessed April 28, 2011)

  • Goldstein, K.M., Jennings, K.M.: The Effect of Advance Letters on Cooperation in a List Sample telephone Survey. Public Opinion Quarterly 66, 608–617 (2002)

    Article  Google Scholar 

  • Groves, R.M.: Survey Errors and Survey Costs. John Wiley & Sons, New York (1989)

    Book  Google Scholar 

  • Groves, R.M.: Survey Errors and Survey Costs. John Wiley & Sons, Hoboken (2004)

    Google Scholar 

  • Groves, R., Peytcheva, E.: The Impact of Nonresponse Rates on Nonresponse Bias. A Meta-Analysis. Public Opinion Quarterly 72, 167–189 (2008)

    Article  Google Scholar 

  • Häder, M., Häder, S.: Telefonbefragungen über das Mobilfunknetz. Konzept, Design und Umsetzung einer Strategie zur Datenerhebung. In: Telephone Interviews over Mobile Phone. Concept, Design and Implementation of a Data Collection Strategy. VS Verlag für Sozialwissenschaften, Wiesbaden (2009)

    Google Scholar 

  • Häder, M., Häder, S.: Der Einfluss der Persönlichkeit auf die Antwortqualität – empirische Befunde aus der Umfrageforschung über das Festnetz und den Mobilfunk (The Impact of Personality on Answer Quality – Empirical Findings from Research on Landline and Mobile Phone Surveys). In: KZfSS (2011) (in print)

    Google Scholar 

  • Hartmann, P.H., Schimpl-Neimanns, B.: Zur Repräsentativität soziodemographischer Merkmals des ALLBUS – Multivariate Analysen zum Mittelschichtbias der Umfrageforschung (Representativity of Socio-Demographic Characteristics of ALLBUS data – Multivariate Analysis on Middle Class Bias of Survey Research). ZUMA Arbeitsbericht (January 1992)

    Google Scholar 

  • Holbrook, A., Krosnick, J.A., Pfent, A.: The Causes and Consequences of Response Rates in Surveys by the News Media and Government Contractor Survey Research Firms. In: Lepkowski, J.M., et al. (eds.) Telephone Survey Methodology, pp. 499–528. John Wiley & Sons, Hoboken (2008)

    Google Scholar 

  • Hüfken, V.: Kontaktierung bei Telefonumfragen (Contact Modes of Telephone Surveys). In: Hüfken, V. (ed.) Methoden in Telefonumfragen, pp. 11–31. VS Verlag für Sozialwissenschaften, Wiesbaden (2000)

    Google Scholar 

  • Koch, A.: “mehr” nicht gleichbedeutend mit "besser" ist: Ausschöpfungsquoten und Stichprobenverzerrungen in Allgemeinen Bevölkerungsumfragen (If,,more“ is not synonymous with,,better“: response rates and sample bias in general population survey). ZUMA-Nachrichten 42(22), 66–90 (1998)

    Google Scholar 

  • Lang, F.R., Lüdkte, O., Asendorpf, J.B.: Testgüte und psychometrische Äquivalenz der deutschen Version des Big Five Inventory (BFI) bei jungen, mittelalten und alten Erwachsenen (Test Quality and Psychometric Equivalence of the German Version of the Big5 Inventory with Young, Middle and Old Adults). Diagnostica 47(3), 111–121 (2001)

    Article  Google Scholar 

  • Lepkowski, J., Tucker, C., Brick, J.M., de Leeuw, E.D., Japec, L., Lavrakas, P.J., Link, M.W., Sangster, R.L. (eds.): Telephone Survey Methodology. John Wiley & Sons, Hoboken (2008)

    Google Scholar 

  • Meier, G.: Telefonbefragungen über das Mobilfunknetz: Konzept, Design und Umsetzung einer Strategie zur Datenerhebung’ (‘Telephone Interviews over Mobile Phone. Concept, Design and Implementation of a Data Collection Strategy’) (2009); Zu , R., Häder, Häder: In GESIS – Leibniz-Institut für Sozialwissenschaften . Medien, Daten Analysen 3(1), 116-119 (2009)

    Google Scholar 

  • Meier, G., Schneid, M., Stegmann, Y., Stiegler, A.: Steigerung der Ausschöpfungsquote von Telefonumfragen durch geschickte Einleitungstexte (Increasing Response Rates of Telephone Surveys by Using Suitable Introductions). ZUMA-Nachrichten 57(29), 37–56 (2005)

    Google Scholar 

  • Muck, P.: Persönlichkeit und berufsbezogenes Sozialverhalten (Personality and Job-related Social Behaviour). In: Schuler, H. (ed.) Lehrbuch der Personalpsychologie, vol. 2, pp. 527–578. Hogrefe Verlag, Göttingen (2006)

    Google Scholar 

  • Neller, K.: Kooperation und Verweigerung: eine Non-Response-Studie (Cooperation and Refusal: A Nonresponse Study). ZUMA Nachrichten 57(29), 9–36 (2005)

    Google Scholar 

  • Ostendorf, F., Angleitner, A.: NEO-PI-R: NEO-Persönlichkeits-Inventar – revidierte Form (Personality Inventory – Revised Version). In: Sarges, W., Wottawa, H. (eds.) Handbuch Wirtschaftspsychologischer Testverfahren, pp. 409–415. Pabst Science Publishers, Lengerich (2001)

    Google Scholar 

  • Ostendorf, F., Angleitner, A.: NEO-PI-R – NEO Persönlichkeitsinventar nach Costa und McCrae - Revidierte Fassung. NEO-PI-R – NEO Personality Traits Inventory by Costa and McCrae – Revised Version. Hogrefe, Göttingen (2004)

    Google Scholar 

  • Peytchev, A., Carley-Baxter, L.R., Black, M.C.: Coverage Bias in Variances, Associations, and Total Error From Exclusion of the Cell Phone-Only Population in the United States. Social Science Computer Review 28(3), 287–302 (2010)

    Article  Google Scholar 

  • Peytchev, A., Carley-Baxter, L.R., Black, M.C.: Multiple Sources of Nonobservation Error in Telephone Surveys: Coverage and Nonresponse. Social Methods & Research 40(1), 138–168 (2011)

    Article  Google Scholar 

  • Philippens, M., Billiet, J., von Loosveldt, G., Stoop, I., Koch, A.: Non-Response and Fieldwork Efforts in the ESS: Results from the Analysis of Call Record Data. Work Package 7, Data-Bases Quality Assessment in the ESS, http://naticent02.uuhost.uk.uu.net/methodology/nonresponse_fieldwork_efforts.pdf (accessed September 22, 2009)

  • Porst, R.: Ausschöpfungen bei sozialwissenschaftlichen Umfragen. Die Sicht der Institute (Response Rates in Social Surveys. The Perspective of the Institutes). ZUMA-Arbeitsbericht (July 1996)

    Google Scholar 

  • Purdon, S., Campanelli, P., Sturgis, P.: Interviewers’ Calling Strategies on Face-to-Face Interview Surveys. Journal of Official Statistics 15, 199–216 (1999)

    Google Scholar 

  • Rammstedt, B., Koch, K., Borg, I., Reitz, T.: Entwicklung und Validierung einer Kurzskala für die Messung der Big Five Persönlichkeitsdimensionen in Umfragen (Development and Validation of a Short Scale for the Measurement of Big5 Personality Dimensions in Surveys). ZUMA Nachrichten 55, 5–28 (2004)

    Google Scholar 

  • Rammstedt, B., John, O.P.: Kurzversion des Big Five Inventory (BFI-K): Entwicklung und Validierung eines ökonomischen Inventars zur Erfassung der fünf Faktoren der Persönlichkeit (Short Version of Big5 Inventory (BFI-K): Development and Validation of an Economic Inventory for the Assessment of Five Personality Dimensions). Diagnostica 51(4), 195–206 (2005)

    Article  Google Scholar 

  • Rammstedt, B., John, O.P.: Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German. Journal of Research in Personality 41, 203–212 (2007)

    Article  Google Scholar 

  • Rammstedt, B.: The 10-Item Big Five Inventory: Norm Values and Investigation of Sociodemographic Effects Based on a German Population Representative Sample. European Journal of Psychological Assessment 23(3), 193–201 (2007)

    Article  Google Scholar 

  • Schlinzig, T., Schneiderat, G.: Möglichkeiten zur Erhöhung der Teilnahmebereitschaft bei Telefonumfragen über Festnetz und Mobilfunk. Zum Potenzial von Warmkontakt und randomisierter Geburtstagsauswahl (Possibilities to Improve Response Rates in Landline and Mobile Phone Surveys. On Effects of Prior Notices and an Alternative Within Household Respondent Selection Technique). In: Weichbold, M., et al. (eds.) Umfrageforschung. Grenzen und Herausforderung, Sonderheft der Österreichischen Zeitschrift für Soziologie, vol. 9, pp. 21–43. VS Verlag für Sozialwissenschaften, Wiesbaden (2009)

    Google Scholar 

  • Schnauber, A., Daschmann, G.: Was beeinflusst die Teilnahmebereitschaft an telefonischen Interviews ? (Factors Influencing the Willingness to Participate in Telephone Surveys). Methoden, Daten, Analysen 2(2), 97–123 (2008)

    Google Scholar 

  • Schneekloth, U., Leven, I.: Woran bemisst sich eine gute allgemeine Bevölkerungsumfrage ? (How to measure a good general population survey?). ZUMA-Nachrichten 53(27), 16–57 (2003)

    Google Scholar 

  • Schneiderat, G., Schlinzig, T.: Das Mobilfunktelefonverhalten in der Allgemeinbevölkerung (Mobile Phone Habits of the General German Population). In: Häder, M., Häder, S. (eds.) Telefonbefragungen über das Mobilfunknetz. Konzept, Design und Umsetzung einer Strategie zur Datenerhebung, pp. 99–119. VS-Verlag für Sozialwissenschaften, Wiesbaden (2009)

    Google Scholar 

  • Schnell, R.: Non-Response in Bevölkerungsumfragen (Non-response in Population Surveys). Leske + Budrich, Opladen (1997)

    Google Scholar 

  • Stoop, I.A.L.: The Hunt for the Last Respondent. Nonresponse in Sample Surveys. Social and Cultural Planning Office of the Netherlands, The Hague (2005)

    Google Scholar 

  • Struminskaya, B., Schaurer, I., Bandilla, W., Gabler, S., Häder, S., Kaczmirek, L.: Improved cost-effectiveness in mobile surveys using HLR-Lookup. Paper presented at the GOR 11 Conference, Düsseldorf, March 14-16 (2011), http://conftool.gor.de/conftool11/index.php?page=downloadPaper&filename=Struminskaya-Improved_cost-effectiveness_in_mobile_surveys_using_HLR-Lookup-173.pdf&form_id=173&form_index=&form_version=final (accessed April 28, 2011)

  • TNS Infratest Sozialforschung, Methodenbericht zum Befragungsjahr 2009 (Welle 26) des Sozio-ökonomischen Panels. (Methodological Survey Report 2009), München (2010), http://www.tns-infratest-sofo.com/downloads/2010MB_%20SOEP2009.pdf (Accessed April 04, 2011)

Download references

Author information

Authors and Affiliations

  1. Social Empirical Research in the project funded by the German Research Foundation (DFG), TUD, Dresden, Germany

    Götz Schneiderat & Tino Schlinzig

Authors
  1. Götz Schneiderat
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tino Schlinzig
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Methodology at GESIS, Center for Survey Design and, Postfach 12-21-55, Mannheim, 68072, Germany

    Sabine Häder

  2. , Philosophische Fakultät -, Technische Universität Dresden, Helmholtzstraße 10, Dresden, 01069, Sachsen, Germany

    Michael Häder

  3. Helmholtzstr. 10, Dresden, 01069, Germany

    Mike Kühne

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag GmbH Berlin Heidelberg

About this chapter

Cite this chapter

Schneiderat, G., Schlinzig, T. (2011). Mobile- and Landline-Onlys in Dual-Frame-Approaches: Effects on Sample Quality. In: Häder, S., Häder, M., Kühne, M. (eds) Telephone Surveys in Europe. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25411-6_10

Download citation

Publish with us

Policies and ethics

Search

Navigation