Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Environmental risk of leptospirosis infections in the Netherlands: Spatial modelling of environmental risk factors of leptospirosis in the Netherlands

  • Ente J. J. Rood ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Visualization, Writing – original draft, Writing – review & editing

    e.rood@kit.nl

    Affiliation KIT Royal Tropical Institute, Health dept., Amsterdam, The Netherlands

  • Marga G. A. Goris,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Writing – original draft, Writing – review & editing

    Affiliation WHO/FAO/OIE and National Collaborating Centre for Reference and Research on Leptospirosis, Amsterdam, The Netherlands

  • Roan Pijnacker,

    Roles Formal analysis, Visualization, Writing – original draft

    Affiliation KIT Royal Tropical Institute, Health dept., Amsterdam, The Netherlands

  • Mirjam I. Bakker,

    Roles Conceptualization, Methodology, Validation, Writing – review & editing

    Affiliation KIT Royal Tropical Institute, Health dept., Amsterdam, The Netherlands

  • Rudy A. Hartskeerl

    Roles Conceptualization, Formal analysis, Investigation, Supervision, Validation, Writing – review & editing

    Affiliation WHO/FAO/OIE and National Collaborating Centre for Reference and Research on Leptospirosis, Amsterdam, The Netherlands

Abstract

Leptospirosis is a globally emerging zoonotic disease, associated with various climatic, biotic and abiotic factors. Mapping and quantifying geographical variations in the occurrence of leptospirosis and the surrounding environment offer innovative methods to study disease transmission and to identify associations between the disease and the environment. This study aims to investigate geographic variations in leptospirosis incidence in the Netherlands and to identify associations with environmental factors driving the emergence of the disease. Individual case data derived over the period 1995–2012 in the Netherlands were geocoded and aggregated by municipality. Environmental covariate data were extracted for each municipality and stored in a spatial database. Spatial clusters were identified using kernel density estimations and quantified using local autocorrelation statistics. Associations between the incidence of leptospirosis and the local environment were determined using Simultaneous Autoregressive Models (SAR) explicitly modelling spatial dependence of the model residuals. Leptospirosis incidence rates were found to be spatially clustered, showing a marked spatial pattern. Fitting a spatial autoregressive model significantly improved model fit and revealed significant association between leptospirosis and the coverage of arable land, built up area, grassland and sabulous clay soils. The incidence of leptospirosis in the Netherlands could effectively be modelled using a combination of soil and land-use variables accounting for spatial dependence of incidence rates per municipality. The resulting spatially explicit risk predictions provide an important source of information which will benefit clinical awareness on potential leptospirosis infections in endemic areas.

Introduction

Leptospirosis is a globally emerging disease with numerous outbreaks being reported worldwide over the past decades [1,2]. The pathogen is transmitted by exposure to contaminated water or urine from infected animals and may survive for days to months in freshwater, soil, or mud [36]. Livestock farming and agricultural practices are generally believed to be important factors driving endemic leptospirosis transmission leading to human infections [610]. The pathogen is endemic in rodent reservoir populations across Europe as well as tropical America, Australia, Asia and Africa, making it a pan-global threat to public health [10]. Small mammals, notably rats, are the most important reservoirs, but also pet and farm animals, living in close vicinity of humans present potential high risk reservoirs [11].

The interplay between Leptospira occurrence, reservoir host abundance, reservoir infection rates and local environments is believed to affect the emergence of the disease [1,11]. Leptospirosis endemicity has been associated with wet tropical environments where epidemic outbreaks of the disease are strongly driven by seasonal variations or natural disasters [6,12]. In temperate climates, leptospirosis dynamics show seasonal dynamics, with increased numbers of infections during warmer months [5,6,13]. Climate conditions and persistence of high leptospirosis prevalence in reservoir hosts have been suggested to be amongst the foremost factors leading to increased transmission of leptospirosis across different geographical regions and eco-regions [6]. Yet, the causal pathway by which local environments facilitate the transmission of leptospirosis and how these are altered by varying climate regimes remain largely unknown. This apparent gap in our understanding of how local environments can facilitate transmission, poses a disparity to halt transmission.

This study aims to describe and explain geographic variations in endemic leptospirosis morbidity in the Netherlands. Leptospirosis occurs at an average yearly incidence of 0.25 cases/100,000 population and a case fatality rate of 6.5%. Yet, the occurrence of the disease is geographically highly heterogeneous. Spatial variations in the morbidity of leptospirosis are mapped and the contribution of biotic and abiotic environmental factors and endogenous spatial dispersal processes are investigated and quantified. By explicitly considering the spatial variations in the occurrence of leptospirosis infections the scale, intensity and scale of transmission of the disease are quantified.

Materials and methods

Data collection

Case data.

For this study, retrospective epidemiological data of leptospirosis patients in the Netherlands during the period 1995–2012 were used. Data were collected from archived records from the National Leptospirosis Reference Laboratory. Cases confirmed by the microscopic agglutination test (MAT), IgM ELISA and/or, culture and/or PCR were considered in this study. Case reports were entered into a database including case age, place of residence, date of onset of illness and a short description of the likely place of infection. Cases that were infected outside the Netherlands were excluded from the study.

Geocoding.

Each confirmed case of leptospirosis was geocoded using the latitude and longitude of residential address of a patient, which were derived using Google Earth v7.0 (2013 Google Inc.). If information on the probable location of infection was known this was the preferred location to geocode a case. The resulting spatial points were projected into the Dutch national Cartesian coordinate system (Rijksdriehoekstelsel Amerfoort). To assess spatial variations in risk rates, case data were aggregated by municipality and population corrected incidence rates were calculated. Aggregating data had the added advantage that the effect of geographical inaccuracies in geolocations resulting from a mismatch between residence and location of infection was reduced. For each municipality, period incidence rates over the period 1995–2012 were calculated based on the municipality population size in the year 2000. To reduce the effect of inflation of incidence rates due to small population sizes, raw incidence rates were transformed using an Empirical Bayesian standardization [14]. Crude rates were log transformed to normality before any subsequent analysis.

Environmental risk factors.

The occurrence of human leptospirosis infections was compared to biotic and abiotic risk factors derived from a variety of sources and compiled in a single geographic database. Municipality coverage of water infrastructure and land use were obtained from the Dutch national topographic map [15]. Four land use variables were included in the analysis: percentage coverage of arable land, built-up area, grasslands, and forest. Two variables describing surface water infrastructure were included: (1) the total length of narrow waterways in meters per km2. Ditches and waterways with < 6 meters were considered narrow waterways. (2) the total length of water banks in meters per km2. The total length of water banks was calculated by summing the perimeter of ponds, puddles, lakes, fens and the length of waterways with > 6 meters.

Ground soil coverages were obtained from the Wageningen University DANS [16], which determine soil fertility and ability to retain water, were calculated based on the total surface area (km2) of mineral content of soils within a municipality. Mineral soils were divided into sabulous clay, clay, sand and peat. Clay and sabulous clay were distinguished according to the percentage of lutem (clay) particles with a size of <2μm: heavy sabulous clay (17.5–25%), and heavy clay (>35%).

Municipality population and farm densities were obtained from the Dutch Central Bureau for Statistics [17]. The following variables were included in the subsequent analysis: Population per km2 and the number of cattle and cattle/crop combined farms per km2. As our data showed that leptospirosis in the Netherlands is most commonly found in people between the age of 45–65 (RR[95%CI] = 1.63[1.31–2.05]), the proportion of population in this age class per municipality was included in the analysis.

Statistical analysis

Disease mapping.

Individual case reports showed that of all cases for which a likely location of infection was reported (52%), 83% had the infection contracted within the vicinity of the location of residence. Hotspots of leptospirosis were identified using kernel density estimator using a 15 km bandwidth which was subjectively chosen, informed by the likely place of infection relative to the home address. The log transformed leptospirosis incidence rates were mapped and the existence of spatial autocorrelations between all neighbor pairs was assessed over incremental orders of adjacency. First order neighbor pairs are defined as municipalities directly sharing a border. Likewise, second order neighbors are defined as those separated by one directly adjacent neighbor and so forth. Spatial correlations were calculated using Moran’s I statistic and plotted by the order of adjacency in a spatial correlogram [18]. This approach allows assessing the spatial scale at which leptospirosis incidence rates are clustered. The locations of significant clusters were then identified and mapped using Local Indicators of Spatial Association (LISA) [19].

Model fitting and selection.

The existence of spatial clusters of increased incidence rates is indicative of a lack of independence between individual municipality observations. To obtain unbiased estimates of the effect of various risk factors this spatial structure was taken into account when modelling the relation between leptospirosis incidences and various risk factors. Simultaneous Auto Regression (SAR) models accounting for spatially auto correlated residual errors were fitted to the municipal incidence rates. SAR models explicitly model the effect of spatial associations by estimating local incidence rates adding a term describing the effect of residual variation observed in neighboring municipalities to the model [20]. This model framework addresses spatial autocorrelation resulting from the omission of spatially heterogeneous environmental predictors allowing for an unbiased inference of coefficient estimates included in the model [20].

To assess the effect of the different environmental variables, each variable was fitted to the data using a univariate SAR model. Next, multivariate models were specified using the full factorial of all cross combinations of eight environmental predictors found significant (p<0.05) in the univariate analysis. This resulted in 255 different models which were fitted to the data. All models were compared based on their fit using the Akaike Information Criterion (AIC) [21]. Since, the best rating model could not be distinguished based merely on the relative AIC values (ΔAIC < 2), the results of the most parsimonious model, (e.g. based on the lowest number of variables) is reported. The final model was then used to estimate leptospirosis incidence rates per municipality. To test whether a model had effectively accounted for non-independence of observations (e.g. spatial autocorrelation) the residual variation was tested for the presence of spatial autocorrelation using Moran’s I.

All descriptive and subsequent spatial analyses were performed using R-statistical language [22]. Outputs were mapped using ArcGIS vs 10.2.

Ethical issues

Data were collected in compliance with the regulations and principles of the Dutch Public Health Service Policy including ethical consideration (document U05-160JvS.Is). All presented data have been de-identified and are therefore not attributable to individual patients.

Results and discussion

Out of 536 cases which were laboratory confirmed for leptospirosis in the Netherlands between 1995 and 2012, 236 cases contracted the infection outside the Netherlands. Of the remaining 300 autochthonous cases, 91 cases could not be geo-located to their respective location of infection or residential address. Three cases were identified as infections resulting from contact with pets and were also excluded from the subsequent analysis. In total, 206 autochthonous cases of laboratory confirmed leptospirosis originating from 134 different municipalities were included in the final analysis.

Spatial pattern of leptospirosis in the Netherlands

Over the period 1995–2012 the national annual incidence rate was 0.07/100.000 [95%CI: 0.06–0.08]. The pattern of leptospirosis showed a marked geographical pattern and variation between regions (Fig 1a). The kernel density analysis of the case incidences showed clusters of cases to be concentrated in the north and central regions of the Netherlands while low incidences were observed in the south and western part of the country (Fig 1a). The LISA analysis confirmed the presence of seven spatially distinct hotpots of high leptospirosis incidence rates, involving 28 municipalities (Fig 1b). Spatial autocorrelation analysis also showed municipality incidence rates to be correlated up to the 6th order spatial neighbor corresponding to approximately 12.8 km distance [range: 4.8–38.7 km] (Fig 2a).

thumbnail
Fig 1. Kernel density estimates.

(A) kernel density estimate and point location of Lyme cases and (B) spatial distribution of incidence rates across the Netherlands. Hotpots or clusters of municipalities with increased incidences as identified using the Local Indicators of Spatial Autocorrelation (LISA) analysis are indicated.

https://doi.org/10.1371/journal.pone.0186987.g001

thumbnail
Fig 2. Correlogram showing the spatial auto-correlation of leptospirosis incidence rates.

(A) before and (B) after fitting the multivariate model (e.g. residual variation) between municipalities over incremental distances. Lag orders correspond to the order of municipality adjacency ranging from 1st to 15th order neighboring municipalities.

https://doi.org/10.1371/journal.pone.0186987.g002

Environmental risk factors

Fitting univariate SAR models to the municipal incidence rates showed that leptospirosis incidence rates were significantly associated to eight out of the twelve environmental risk factors fitted to the data. Land-use, soil properties, water-infrastructure, the density of cattle farms and the percentage of population between 45–64 years of age were found to be significantly associated to leptospirosis incidence rates (Table 1). Fitting a spatial SAR model including an intercept only significantly improved model fit over a non-spatial model including an intercept only (LR = 47.29, p = 6.1e-12).

thumbnail
Table 1. Overview of the univariate and multivariate effects of environmental predictors to estimate the observed incidence of leptospirosis fitting a spatial auto regression model (SAR) to the data.

https://doi.org/10.1371/journal.pone.0186987.t001

Multivariate model selection resulted in a final set of seven models with indiscriminate AIC scores (e.g. difference of AIC<2). The final most parsimonious multivariate model included five of the eight variables found to be associated to leptospirosis incidence in the univariate analysis (Table 1). The model showed that leptospirosis was significantly associated with a lower coverage of built-up area (β = -0.55, Z = -9.84), a higher coverage of grassland (β = 0.15, Z = 2.82), a high coverage of heavy sabulous clay in the soil (β = 0.17, Z = 3.52) and the proportion of population between 45–64 years of age (β = 0.15, Z = 2.82). Leptospirosis incidence was found to be negatively correlated to the coverage of arable land (β = -0.19, Z = -3.10). Factors which were found to be significantly associated to leptospirosis in the univariate models but not selected in the final multivariate model were: forest cover, the presence of heavy clay soils, the relative length of narrow waterways and density of cattle farms. Including these factors did not lead to a significant improvement of the model fit suggesting strong correlations with other factors included in the final model (see S1 Fig).

As observed in the univariate model, accounting for spatial autocorrelation considerably improved the multivariate model fit (ΔAIC = 19.3). Although the effect of the spatial neighborhood decreased compared to a spatial model including an intercept only (ρ = 0.38, z = 6.7), the spatial pattern of leptospirosis was still found to be significantly spatially auto correlated (ρ = 0.28, z = 4.5). This shows that the spatial pattern of leptospirosis is not fully explained by the underlying geographic pattern of risk factors included in the model. Testing residual variation for the presence of spatial autocorrelation showed that no spatial clustering was present in the model residuals after fitting the final model. Hence autocorrelation was effectively accounted for (Figs 2b and 3).

thumbnail
Fig 3. Leptospirosis disease maps of the Netherlands.

(A) the estimated leptospirosis incidence and (B) residual variation after fitting the multivariate model to the data.

https://doi.org/10.1371/journal.pone.0186987.g003

Discussion

In this study the spatial heterogeneity of leptospirosis was analyzed and associations between the occurrence of the disease and environmental factors were investigated. Both univariate as well as the multivariate analysis showed that leptospirosis was associated with areas depicted by low coverage of built up areas, a high coverage of grassland tenure and high coverage of heavy sabulous clays in the soils. These environmental conditions are typically found in areas of cattle livestock keeping. Surprisingly, the multivariate model did not show this apparent correlation between leptospirosis occurrence and cattle farm density. This is notable considering the fact that farmers present an occupational risk group and outdoor occupation and agricultural activities are commonly associated with increased risk of leptospirosis infection [1,5,6,23]. Over the period 1995–2012, however, farmers in the Netherlands were rarely infected by dairy cattle due to an eradication program for herd infection with serovar Hardjo that was started in 1991 [13]. Therefore, we hypothesize that currently leptospirosis in farmers in the Netherlands is not associated with farm animals as such but is more likely caused by supportive activities outside the farms such as cleaning up ditches and narrow waterways. Moreover, the majority of cattle keeping systems in the Netherlands encompass intensified goat and pig farms which commonly do not have free-ranging animals. Transmission of leptospirosis due to exposure of humans to contaminated natural sources is therefore unlikely. The incidence of human infections is likely to be higher in grassland areas where free ranging cattle keeping systems are common, while this is not indisputably related to cattle farming activities.

Our finding that leptospirosis transmission was higher in areas with high coverage of sabulous clay soils agrees with the results reported by Lau et al. (2012) [24], who conclude that leptospirosis seroprevalence was higher in populations inhabiting areas with loamy clay soils. However, Lau also concludes that leptospirosis seroprevalence is lower on clay soils which contradicts the results of the univariate analysis presented here. In the Netherlands, however, variation in altitude is hardly present, allowing water to inundate on clay soils creating a suitable environment for Leptospira to survive [25].

Spatial analysis of the distribution of leptospirosis showed a distinct spatial pattern across the Netherlands. Municipalities with an increased incidence of leptospirosis were found to be clustered up to distances of approximately 12 km. Both univariate and multivariate SAR models showed significant effects of spatial autocorrelation and distinct clusters of leptospirosis which could not solely be explained by the spatial configuration of environmental factors included in these models. It is therefore hypothesized that the observed pattern is a result of both in situ environmental conditions facilitating host abundance, exposure and transmission as well increased exposure to contaminated sources within a wider spatial neighborhood resulting in the observed clustering of disease not accounted for by the risk factors in the current model.

Albeit providing valuable insights in the environmental conditions facilitating transmission, several limitations were present in the analyses. Firstly, the number of leptospirosis infections is probably underestimated since mild cases are more likely to go unrecognized. Underreporting of mild clinical case could have resulted in the underestimation of incidence rates in this study. Unequal reporting between different areas could introduce biases in the results. Secondly, cases were geocoded based on their home residence or, if available based on an indication of the assumed location of infection. Imprecisions in geocoding could introduce spatial mismatching and erroneous conclusions about the environment from which infections have emerged. Of all cases for which a likely location of infection was reported (52%), 83% had the infection contracted within 10 km distance of the location of residence. It is therefore expected that spatial mismatches have had a limited impact and were accounted for by the spatial error modeling approach used. The omission of 91 patients (30%) who could not be geolocated is expected to have had a limited impact on these results as no sex, age or temporal bias was observed in these cases. Thirdly we recognize that temporal trends in the emergence of leptospirosis are likely to be present. As the main objective of this study was to investigate spatial patterns in Leptospirosis risk, quantified by using the period incidences, we limited the analysis to investigate spatial trends. Temporal trend in land use could have influenced the results. However shifts in soil are assumed to be unlikely to have occurred over the study period. Similarly no significant shifts in land use were expected to have occurred over the duration of this study [26]

Although, case base point pattern data were initially collected, risk rates were used to be able to compare regional differences in the biotic an abiotic environment to spatial variations in risk. This approach was chosen because: 1) the point location of a household is likely not to reflect the location of infection, 2) aggregation allowed the calculation risk rates using municipality level population data. This approach is a well-established and has been successfully used in the fields of ecology and epidemiology likewise. Although a point pattern analysis could have been used, the use of aggregated data in a SAR modeling framework is believed to produce robust and accurate results.

Since the availability of environmental data is not exhaustive, it is likely that additional environmental factors influencing the occurrence of leptospirosis infection were not examined. Since leptospirosis is mostly transmitted through rodents and especially rats in the Netherlands [13], rodent density is expected to explain the observed spatial distribution of leptospirosis to more detail. Including rat distribution patterns or the spatial configuration of key habitats into the analysis could provide an explanation for the association found between the environmental conditions supporting leptospirosis transmission as they are believed to provide also a suitable habitat for rats and other potential reservoirs. However, reliable data on rodent density in the Netherlands is lacking and high spatial and temporal variation in rodent activity would add considerable complexity the to the model and would require more extensive data on spatial and temporal variations in leptospirosis infections in humans, animals and its prevalence in aquatic and mammal reservoirs.

Estimation of the zoonotic transmission of leptospirosis could favor the use of ecological niche models following Huchinsons fundamental niche concept [27]. To generate a species distribution model [28] for Leptospira spp would require modelling the biotic and abiotic interactions between leptospira and a variety of reservoir host. As outlined in this paper the outcome of interest is the emergence of leptospirosis disease rather than leptospire distribution and abundance. Expectedly, the biotic and abiotic factors presented in this study will determine the distribution of reservoirs host, leptospira survival and ultimately human exposure to the bacterium. The nature and strength of these association, however, will depend on human behavioral factors affecting exposure and ultimately infection. The model presented here is not meant to describe an ecological niche of the pathogen distribution. Rather it is used to estimate risk patterns which are key to effective control and prevention to populations at high risk of disease.

Notwithstanding these limitations to the model presented, the environmental drivers of leptospirosis identified in this study provide valuable information to identify areas of potential transmission and could be used to raise clinical awareness on potential risk of leptospirosis. Deviations of retrospectively observed incidence with respect of the predicted incidence should be investigated to identify additional risk factors required to improve the model (Fig 3).

Conclusion

The results of this study show that the emergence of Leptospirosis infections in the Netherlands is closely linked to the environment and can be effectively modelled using a combination of soil properties, land-use variables and spatial processes. The observed incidence of leptospirosis was strongly spatially auto correlated with contiguous areas of increased disease incidence of approximately 5–30 km in diameter. This marked pattern could partly be explained by the spatial configuration of environmental risk factors, yet complete spatial dependence was not accounted for by covariate factors. These findings suggest that leptospirosis arises from exposure to ecological conditions facilitating transmission, yet other factors influencing exposure or leptospirosis survival in the environment should be further investigated.

Supporting information

S1 Fig. Dendrogram of covariate correlations.

A hierarchical cluster dendrogram was created using between-variable distances calculated as the inverse of pairwise variable correlations (1-ρ).

https://doi.org/10.1371/journal.pone.0186987.s001

(DOCX)

Acknowledgments

This study was made possible based on the collaboration between the Dutch institute of Public Health and the Environment (RIVM, Bilthoven) and the Royal Tropical Institute, (KIT Biomedical Research, Amsterdam). We would like to thank Stella van Beers for here insights and critical appraisal of earlier version of this manuscript.

References

  1. 1. Hartskeerl RA, Collares-Pereira M, Ellis WA. Emergence, control and re-emerging leptospirosis: dynamics of infection in the changing world. Clin Microbiol Infect. 2011;17: 494–501. pmid:21414083
  2. 2. Vijayachari P, Sugunan AP, Shriram AN. Leptospirosis: an emerging global public health problem. J Biosci. 2008;33: 557–69. Available: http://www.ncbi.nlm.nih.gov/pubmed/19208981 pmid:19208981
  3. 3. Henry RA, Johnson RC. Distribution of the genus Leptospira in soil and water. Appl Environ Microbiol. 1978;35: 492–9. Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=242868&tool=pmcentrez&rendertype=abstract pmid:637546
  4. 4. Lau CL, Clements ACA, Skelly C, Dobson AJ, Smythe LD, Weinstein P. Leptospirosis in American Samoa—estimating and mapping risk using environmental data. PLoS Negl Trop Dis. 2012;6: e1669. pmid:22666516
  5. 5. Haake DA, Levett PN. Leptospirosis in humans. Curr Top Microbiol Immunol. 2015;387: 65–97. pmid:25388133
  6. 6. Mwachui MA, Crump L, Hartskeerl R, Zinsstag J, Hattendorf J. Environmental and Behavioural Determinants of Leptospirosis Transmission: A Systematic Review. PLoS Negl Trop Dis. 2015;9: e0003843. pmid:26379035
  7. 7. Bourhy P, Herrmann Storck C, Theodose R, Olive C, Nicolas M, Hochedez P, et al. Serovar diversity of pathogenic Leptospira circulating in the French West Indies. PLoS Negl Trop Dis. 2013;7: e2114. pmid:23516654
  8. 8. Schneider MC, Nájera P, Aldighieri S, Bacallao J, Soto A, Marquiño W, et al. Leptospirosis outbreaks in Nicaragua: identifying critical areas and exploring drivers for evidence-based planning. Int J Environ Res Public Health. 2012;9: 3883–910. pmid:23202822
  9. 9. Bandara M, Ananda M, Wickramage K, Berger E, Agampodi S. Globalization of leptospirosis through travel and migration. Global Health. 2014;10: 61. pmid:25112368
  10. 10. Schneider MC, Jancloes M, Buss DF, Aldighieri S, Bertherat E, Najera P, et al. Leptospirosis: a silent epidemic disease. Int J Environ Res Public Health. 2013;10: 7229–34. pmid:24351743
  11. 11. Dupouey J, Faucher B, Edouard S, Richet H, Kodjo A, Drancourt M, et al. Human leptospirosis: an emerging risk in Europe? Comp Immunol Microbiol Infect Dis. 2014;37: 77–83. pmid:24388481
  12. 12. Barcellos C, Sabroza PC. The place behind the case: leptospirosis risks and associated environmental conditions in a flood-related outbreak in Rio de Janeiro. Cad Saude Publica. 2001;17 Suppl: 59–67. Available: http://www.ncbi.nlm.nih.gov/pubmed/11426266
  13. 13. Goris MGA, Boer KR, Duarte TATE, Kliffen SJ, Hartskeerl RA. Human Leptospirosis Trends, the Netherlands, 1925–2008. Emerg Infect Dis. 2013;19: 371–378. pmid:23622144
  14. 14. Anselin L, Syabri I, Kho Y. GeoDa: An Introduction to Spatial Data Analysis. Geogr Anal. 2006;38: 5–22.
  15. 15. Kadaster. Topographic map of the Netherlands. In: Topo50NL [Internet]. 2008 [cited 28 Feb 2013]. https://easy.dans.knaw.nl/ui/datasets/id/easy-dataset:35552
  16. 16. Grondsoortenkaart 2006—Simplified Soil Map of the Netherlands—EASY [Internet]. [cited 23 Feb 2013]. https://easy.dans.knaw.nl/ui/datasets/id/easy-dataset:37221
  17. 17. CBS. Wijk- en buurtkaart 2003 [Internet]. [cited 20 Feb 2013]. http://www.cbs.nl/nl-NL/menu/themas/dossiers/nederland-regionaal/publicaties/geografische-data/archief/2005/2003-wijk-en-buurtkaart.htm
  18. 18. Bivand RS, Pebesma E, Gómez-Rubio V. Applied Spatial Data Analysis with R [Internet]. New York, NY: Springer New York; 2013. https://doi.org/10.1007/978-1-4614-7618-4
  19. 19. Anselin L. Local Indicators of Spatial Association-LISA. Geogr Anal. 2010;27: 93–115.
  20. 20. Dormann CF, McPherson JM, Araújo MB, Bivand R, Bolliger J, Carl G, et al. Methods to account for spatial autocorrelation in the analysis of species distributional data: a review. Ecography (Cop). 2007;30: 609–628.
  21. 21. Akaike H. Information Theory And An Extension Of The Maximum Likelihood Principle By Hirotogu Akaike. Proc Second Int Symp Inf Theory. 1973; 267–281.
  22. 22. CRAN. R: The R Project for Statistical Computing [Internet]. 2015 [cited 27 Oct 2015]. https://www.r-project.org/
  23. 23. Lau CL, Skelly C, Dohnt M, Smythe LD. The emergence of Leptospira borgpetersenii serovar Arborea in Queensland, Australia, 2001 to 2013. BMC Infect Dis. 2015;15: 230. pmid:26072306
  24. 24. Lau CL, Skelly C, Smythe LD, Craig SB, Weinstein P. Emergence of new leptospiral serovars in American Samoa—ascertainment or ecological change? BMC Infect Dis. 2012;12: 19. pmid:22273116
  25. 25. Andre-Fontaine G, Aviat F, Thorin C. Waterborne Leptospirosis: Survival and Preservation of the Virulence of Pathogenic Leptospira spp. in Fresh Water. Curr Microbiol. 2015;71: 136–42. pmid:26003629
  26. 26. Kuhlman T, Tabeau A, Gaaff A, Tongeren FW van, Dekkers JEC. Agrarwirtschaft. [Internet]. Agrarwirtschaft. Sonderheft. A. Strothe; 2006. https://research.vu.nl/en/publications/future-land-use-change-in-the-netherlands-an-analysis-based-on-a-
  27. 27. Hutchinson GE. Concluding Remarks. Cold Spring Harb Symp Quant Biol. Cold Spring Harbor Laboratory Press; 1957;22: 415–427.
  28. 28. Guisan A, Zimmermann NE. Predictive habitat distribution models in ecology. Ecol Modell. 2000;135: 147–186. Available: https://www2.unil.ch/biomapper/Download/Guisan-EcoMod-2000.pdf