Skip to main content

Advertisement

Log in

Longitudinal firm-level data: problems and solutions

  • Published:
Small Business Economics Aims and scope Submit manuscript

Abstract

Empirical measures of firm and employment dynamics based on administrative datasets are biased due to missing links in the longitudinal observation of firms. This paper presents a systematic overview of the problems and evaluates two prevailing solutions. We quantify the biases in a set of widely used empirical measures and show which estimates are most sensitive to missing linkages. The biases are found to be especially large in the size distribution of entrants and exits, in firm-level growth estimates for medium and large firms, and in job reallocation measures. We show that an employee-flow linkage method is more effective in reducing bias than a traditional link method often used by statistical agencies. A consistent approach is developed for imputing firm-level growth measures of linked firms. The analysis is carried out using a longitudinal dataset for Belgium and discussed from an international perspective.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. Abowd et al. (1999) present a linkage method for France, and Bycroft (2003) for New Zealand; Clayton and Spletzer (2009) describe the longitudinal linkage method applied by the US Bureau of Labor Statistics. In Europe, linkage methods adopted by national statistical agencies have led to general Eurostat-OECD recommendations on firm record linking (Eurostat-OECD 2007).

  2. One of the first institutes to implement an employee-flow method has been Statistics Canada (Baldwin et al. 1992), where it is still used for the construction of the National Accounts Longitudinal Microdata File (Dixon and Rollin 2012). Employee-flow methods are also used for the construction of longitudinal employer databases in Denmark (Albaek and Sorensen 1998), Finland (Korkeamäki and Kyyrä 2000), Sweden (Persson 2004), Italy (Contini et al. 2007), Belgium (Geurts et al. 2009), and Germany (Hethey and Schmieder 2013).

  3. See, for example, Abowd et al. (1999) who describe a traditional link method for French establishment data, and Hethey and Schmieder (2013) who use an employee-flow method for German establishment data.

  4. Linked employer–employee data have further been used to analyze a wide variety of labor market issues. For a comprehensive overview, see Abowd and Kramarz (1999).

  5. The methods have been developed for the construction of the DynaM longitudinal employer database. The database is designed to track changes in employment at both the macro and the firm levels and to produce annual series of gross job gains and losses statistics in Belgium. See www.dynam-belgium.org.

  6. The unit of the ‘firm’ or more specifically the ‘employer-enterprise’ in the Belgian business register complies with the EU Regulation (EC) No 177/2008 for the harmonization of the national business registers for statistical purposes. It corresponds to ‘the smallest combination of legal units that is an organizational unit producing goods or services, which benefits from a certain degree of autonomy in decision-making, especially for the allocation of its current resources. An enterprise carries out one or more activities at one or more locations. An enterprise may be a sole legal unit.’ (Eurostat-OECD 2007).

  7. The social security contributions are subject to strict control. The NSSO declarations are filled out electronically by the employer, and missing declarations or unexpected changes in employment are checked by NSSO analysts. This ensures continuity of the firm identification number and makes the data unlikely to be contaminated by measurement error.

  8. Temporary work agencies are left out from the analysis in this paper because the high job turnover in this industry confuses the discussion of average job reallocation.

  9. See, for example, Benedetto et al. (2007) for a discussion of these practices in the USA.

  10. In Belgium, small firms do not need to file full annual accounts or install a work council (with fewer than 100 employees, turnover below 7.3 m EUR, and balance sheet total below 3.65 m EUR).

  11. The matching procedure used by Statistics Belgium is based on the Term Frequency—Inverse Document Frequency method.

  12. The validation process is carried out by making use of the comprehensive business ‘datawarehouse’ DBRIS. DBRIS is a relational database of all Belgian firms, which links information at the firm level of a vast set of administrative sources (national register of legal entities, Annual Accounts, VAT declarations, Social Security declarations,…), business surveys (Structure of Enterprises Survey, Structure of Earnings Survey,…), and statistical registers on enterprise ownership and control structure (including consolidations, participations, and FDI registered by the National Bank of Belgium and the European Group Register).

  13. The minimum threshold of five employees is in line with other recent applications of the employee-flow method (Benedetto et al. 2007; Dixon and Rollin 2012).

  14. The approach of the US Bureau of Labor Statistics (Pinkston and Spletzer 2002) and Statistics Canada (Dixon and Rollin 2012) is to collapse both firms into a consolidated employer and calculate employment change at the level of this merged entity. For aggregate measures of job creation and destruction, our strategy yields the same result as this approach. The disadvantage of using a consolidated entity is that the firm counts will be inconsistent across time and, more importantly, the relation between firm size and firm growth will be biased. Indeed, the size of the consolidated entity is by construction larger than those of the original firms.

  15. Rapidly growing firms have an incentive to split up activities into smaller legal units to remain below the size threshold for legal obligations. See also footnote 10.

  16. Comparable results are reported by Benedetto et al. (2007) and Hethey and Schmieder (2013). Using a more comprehensive typology of events, they also find that large shares of spurious entrants and exits are explained by ID changes, split-offs, and absorptions.

  17. Benedetto et al. (2007) equally show for US data that the employee-flow method has a nontrivial value added to other linkage methods for identifying missing links between firm identifiers.

  18. The average sizes of real versus spurious entrants and exits are reported in Table A.2 in the online Appendix.

  19. As mentioned above, Belgian firm ID numbers do not change after a change in ownership or legal form, in contrast to many other countries.

  20. The OECD and Eurostat statistics discussed here are derived from harmonized national business registers. Countries can either apply their own method to obtain consistent longitudinal data or follow the traditional linkage approach recommended by Eurostat-OECD as discussed above.

  21. Regressions of continuing firms include 1.6 million firm-year observations; those of all firms 1.7 million.

  22. The decomposition is given in the online Appendix E.

  23. By definition, net employment growth is not affected by the linkage procedures since they only redefine the reallocation of jobs across firms.

References

Download references

Acknowledgments

I am grateful for the valuable advice of Jo Van Biesebroeck. I am also grateful to the Belgian National Social Security Office (NSSO), in particular Peter Vets for collaboration on the development of the employee-flow method, and to Statistics Belgium, in particular Youri Baeyens and Antonio Fiordaliso for providing firm linkages created for the Eurostat Structural Business Statistics. I also thank Malcolm Brynin and Alex Schmitt for helpful suggestions, and three anonymous referees for valuable comments. Financial support from ERC Grant No. 241127 and KU Leuven Program Financing is gratefully acknowledged.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Karen Geurts.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 128 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Geurts, K. Longitudinal firm-level data: problems and solutions. Small Bus Econ 46, 425–445 (2016). https://doi.org/10.1007/s11187-015-9693-6

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11187-015-9693-6

Keywords

JEL Classifications

Navigation