Advertisement

  • Loading metrics

Open Access

Peer-reviewed

Research Article

International External Quality Assessment Study for Molecular Detection of Lassa Virus

  • Sergejs Nikisins ,

    nikisinss@rki.de

    Affiliations Highly Pathogenic Viruses (ZBS 1), Centre for Biological Threats and Special Pathogens, Robert Koch Institute, Berlin, Germany, European Public Health Microbiology Training Programme (EUPHEM), European Centre for Disease Prevention and Control (ECDC), Stockholm, Sweden

    ⨯
  • Toni Rieger,

    Affiliation Bernhard-Nocht-Institute for Tropical Medicine, WHO Collaborating Centre for Arboviruses and Hemorrhagic Fever Reference and Research, Hamburg, Germany

    ⨯
  • Pranav Patel,

    Affiliation Highly Pathogenic Viruses (ZBS 1), Centre for Biological Threats and Special Pathogens, Robert Koch Institute, Berlin, Germany

    ⨯
  • Rolf Müller,

    Affiliation Biomatrica, San Diego, California, United States of America

    ⨯
  • Stephan Günther,

    Affiliation Bernhard-Nocht-Institute for Tropical Medicine, WHO Collaborating Centre for Arboviruses and Hemorrhagic Fever Reference and Research, Hamburg, Germany

    ⨯
  • Matthias Niedrig

    Affiliation Highly Pathogenic Viruses (ZBS 1), Centre for Biological Threats and Special Pathogens, Robert Koch Institute, Berlin, Germany

    ⨯

Abstract

Lassa virus (LASV) is a causative agent of hemorrhagic fever in West Africa. In recent years, it has been imported several times to Europe and North America. The method of choice for early detection of LASV in blood is RT-PCR. Therefore, the European Network for Diagnostics of ‘Imported’ Viral Diseases (ENIVD) performed an external quality assessment (EQA) study for molecular detection of LASV. A proficiency panel of 13 samples containing various concentrations of inactivated LASV strains Josiah, Lib-1580/121, CSF, or AV was prepared. Samples containing the LASV-related lymphocytic choriomeningitis virus (LCMV) and negative sera were included as specificity controls. Twenty-four laboratories from 17 countries (13 European, one African, one Asian, two American countries) participated in the study. Thirteen laboratories (54%) reported correct results, 4 (17%) laboratories reported 1 to 2 false-negative results, and 7 (29%) laboratories reported 3 to 5 false-negative results. This EQA study indicates that most participating laboratories have a good or acceptable performance in molecular detection of LASV. However, several laboratories need to review and improve their diagnostic procedures.

Author Summary

A proficiency test panel for molecular diagnostic of Lassa virus provides objective evidence of testing quality of International diagnostic laboratories. Since there are no commercial assays available, it is very important to assess the quality of diagnostic test used as well as evaluate detection sensitivity and specificity performance. Participating laboratories have received samples containing different inactivated Lassa virus strains as well as two negative controls. Participants were asked to provide information on diagnostic test procedure and protocols used for analysis of samples of Lassa virus External Quality Assessment (EQA). Based on received information we were able to compare and evaluate the quality of diagnostic profile and facilitate further improvement. Participating laboratories may use results of Lassa virus EQA to become accredited for Lassa virus molecular diagnostic. Since different Lassa virus strains are not available for most of the laboratories, participants achieved very advanced training for diagnostic of rare and imported viruses.

Citation: Nikisins S, Rieger T, Patel P, Müller R, Günther S, Niedrig M (2015) International External Quality Assessment Study for Molecular Detection of Lassa Virus. PLoS Negl Trop Dis 9(5): e0003793. https://doi.org/10.1371/journal.pntd.0003793

Editor: Remi Charrel, Aix Marseille University, Institute of Research for Development, and EHESP School of Public Health, FRANCE

Received: December 1, 2014; Accepted: April 28, 2015; Published: May 21, 2015

Copyright: © 2015 Nikisins et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited

Data Availability: All relevant data are within the paper.

Funding: The authors received no specific funding for this work.

Competing interests: I have read the journal's policy and the authors of this manuscript have the following competing interests: Company "Biomatrica" (RM) has provided the stabilazers for EQA samples free of charge. This does not alter our adherence to all PLOS NTDs policies on sharing data and materials.

Introduction

Lassa fever was first described in 1969 as the cause of a nosocomial outbreak of hemorrhagic fever in Nigeria [1]. Lassa fever is an acute viral infection associated with a wide spectrum of disease manifestations, which range from mild courses to multiorgan failure [1–3]. The etiologic agent of Lassa fever is Lassa virus (LASV, family Arenaviridae, genus Arenavirus) [4]. The natural host of LASV is the small rodent Mastomys natalensis, which lives close to human settlements [5]. The rodents can become chronically infected at birth and excrete infectious virus in urine and other body fluids, with subsequent transmission to humans [6]. There is evidence of human-to-human transmission in both hospital and community settings [7]. The fact that LASV may be transmitted from human to human gives rise to nosocomial or community-based outbreaks. LASV is endemic in the countries of Nigeria, Liberia, Sierra Leone, and Guinea [8, 9] and was detected in Mali [10, 11]. Seroepidemiological studies and imported cases of Lassa fever indicate that arenaviruses circulate somewhere in the region comprising Côte d’Ivoire and Burkina Faso [12]. The annual incidence is estimated at 300,000 cases, with 5,000 fatalities per year [13, 14]. Additionally, LASV has been introduced several times into Europe, Japan, and North America. Among the hemorrhagic fever viruses of risk group 4 (such as Crimean-Congo hemorrhagic fever, Ebola, and Marburg virus), LASV has been most frequently imported [15]. The virus usually is imported by returning travelers [16, 17]. Within Europe, LASV infections have been imported to Germany [18, 19], The Netherlands [20] and the United Kingdom [21].

Laboratory testing is required to establish a diagnosis, as Lassa fever can hardly be distinguished from other febrile diseases based on clinical symptoms [14, 22]. A suspected case must be rapidly ruled out or verified to facilitate appropriate case management, including treatment, the implementation of isolation measures, or the tracking of contact persons [18].

The method of choice for early detection of LASV in blood is reverse transcription (RT)-PCR [23–29]. However, the high degree of genetic variability of the virus poses a problem with the design of RT-PCR assays for the reliable detection of all virus strains [30]. The performance of the different techniques applied for molecular diagnosis of LASV may vary between laboratories. External quality assessment (EQA) studies for LASV molecular diagnostics have not been performed since 2004 [31]. An EQA study allows the participating laboratories to monitor the quality of their diagnostics and to identify problems with particular diagnostic assays. For these reasons, an EQA study for the molecular diagnosis of LASV was conducted by the European Network for Diagnostics of ‘Imported’ Viral Diseases (ENIVD) (http://www.enivd.org) in 2013. ENIVD is concerned with the development of laboratory diagnostic capacities for imported virus infections, quality control, standardization of laboratory procedures, and training of laboratory staff [32]. Based on the results of this study, the quality of LASV diagnostics may be improved.

Materials and Methods

Call for participation

Twenty-eight laboratories involved in diagnostics of viral hemorrhagic fevers were invited to participate in this study. Invitees were selected from the register of ENIVD network members and from the list of national and regional reference laboratories for rare, emerging, and dangerous viruses. The participation in the study was free of charge. Participants permitted publication of the results in a comparative and anonymous manner. This EQA was coordinated by ENIVD according to the established procedures of the network [33–35].

Sample preparation

The proficiency test panel included 13 LASV preparations derived from culture supernatants of Vero E6 cells (ATCC—American Type Culture Collection) infected with 4 different LASV strains. Virus in cell culture supernatant was inactivated by heat (1 h at 60°C) followed by gamma irradiation (25 kilo gray). The test panel consisted of six samples of LASV strain Josiah from Sierra Leone, obtained by serial 10-fold dilution of cell culture supernatant (1:10 to 1:106), three samples of LASV strain Lib-1580/121 from Liberia (dilutions 1:103 to 1:105), LASV strain CSF from Nigeria (dilution 1:103), and LASV strain AV from Cote d’Ivoire or Burkina Faso (dilution 1:103). The samples were freeze-dried in 3% mannitol based formulation using an EPSILON 2-6D Pilot Freeze Dryer (Martin Christ GmbH, Osterode am Harz, Germany). In addition, we included one sample containing LASV strain Josiah at a dilution of 1:104 (sample #14) that was prepared with a new dry stabilizer method (Biomatrica, Inc., San Diego, CA, USA), and one sample containing LASV strain Lib-1580/121 at dilution of 1:104 (sample #6) that was prepared using a liquid stabilizer (Biomatrica). A sample containing lymphocytic choriomeningitis virus (LCMV), the prototype member of the family Arenaviridae, as well as two negative control sera were included in the test panel as specificity controls.

After lyophilized sample preparation, the samples were tested and quantified by an in-house real-time PCR assay for quality control purpose. The assay was performed by employing 12.5 pmol of forward primer LaV F2 (CCACCATYTTRTgCATRTgCCA), 13 pmol of reverse primer LaV R (gCACATgTNTCHTAYAgYATggAYCA) and 5 pmol of probe LaV TM (FAM-AARTggggYCCDATgATgTgYCCWTT-BBQ). The real-time PCR assay was carried out in one-step format on ABI 7500 real-time PCR system using the AgPath-ID One-Step RT-PCR Kit according to manufacturer´s instruction. Plasmid standards were used for the quantification of the genome copies of Lassa virus RNA.

Ethics statement

The EQA was performed according to National Ethical regulations.

Validation and dispatch of the panel sets

Before dispatching the panel, samples were sent to the reference laboratory for testing the quality and obtaining the reference results. Reference laboratory used RT-PCR protocol described by Ölschläger et al., 2010 [27]. Samples were resuspended in 100 μl of water and the RNA was extracted using the QIAamp viral RNA kit (Qiagen, Hilden, Germany). The presence of LASV or LCMV RNA in the samples was ascertained by RT-PCR and sequencing. The number of LASV genome copies present in these samples was determined by qRT-PCR. Samples were shipped by regular mail at ambient temperature. Participating laboratories were instructed to resuspend the samples in 100 μl of water and to analyze the material like serum samples potentially containing LASV using their routine nucleic acid detection assays. The EQA panel was accompanied by documentation including instructions and an evaluation form for results. Participants were asked to report the assay protocol, the result for each sample, the LASV strain identified, the number of genome copies as well as any problem encountered.

Evaluation of the results

To guarantee anonymous data evaluation and reporting, each participating laboratory was coded with an identifier. The results were scored according to detection rate and specificity as in previous EQA studies of ENIVD [33–35]. We assigned one point for correct results; false-negative, false-positive, and indeterminate results did not count. Results were classified as “good”—when all results were correct; “acceptable”—when 1 to 2 results were incorrect; and “need for improvement”—when more than 2 results were incorrect. Results for the sample containing LCMV (sample #3) were not included in the score, as verification of the sequence was optional. In addition, we excluded from scoring the sample containing LASV strain Josiah at a dilution of 1:106 (sample #15) as this concentration is likely to be below the 95%-detection limit of most assays. Thus, obtaining a positive or negative result becomes a matter of chance. Each laboratory received the complete summary of the results in an anonymous way, by which only the own laboratory was recognizable.

Results

Twenty-four (86%) of the 28 laboratories, which received the EQA material, reported results. The 24 participating laboratories, located in 17 countries—13 European, one African, one Asian, and two American countries (Table 1). The LASV detection rate varied among laboratories and scores ranged from 9 to the maximum of 14 (Table 2). Average score for all participating laboratories was 13 points. Good results were achieved by 13 (54%) laboratories, 4 (17%) laboratories achieved acceptable results, and 7 (29%) laboratories had need for improvement. Table 3 shows that 13 (54%) laboratories correctly detected LASV in all 12 LASV samples (100% detection rate). Three (12%) participants had one false negative result (92% detection rate). Eight participants had a detection rate between 58% and 83%. None of the laboratories reported false-positive results for the negative control samples.

thumbnail
Download:
Table 1. List of participating laboratories.

https://doi.org/10.1371/journal.pntd.0003793.t001

thumbnail
Download:
Table 2. Summary of the EQA study for molecular detection of LASV.

https://doi.org/10.1371/journal.pntd.0003793.t002

thumbnail
Download:
Table 3. LASV detection rate by participant.

https://doi.org/10.1371/journal.pntd.0003793.t003

All participating laboratories were able to detect LASV strain Josiah at 1:10, 1:100, and 1:104 dilution (Table 4). Two laboratories did not detect the Josiah strain at 1:103 dilution (sample #5) but detected the 1:104 to 1:106 dilutions of this strain (Table 2). A mix-up between sample#5 and sample #6 is a likely explanation. LASV strains AV from Cote d’Ivoire/Burkina Faso and CSF from Nigeria were detected correctly by all laboratories. Four laboratories did not detect at all the Liberian LASV strain. Further laboratories did not detect the higher dilutions of the Liberian strain (≥ 1:104).

thumbnail
Download:
Table 4. LASV detection rate by sample.

https://doi.org/10.1371/journal.pntd.0003793.t004

Nineteen participants used published RT-PCR protocols, two laboratories used unpublished in-house RT-PCR assays, one laboratory used a combination of real-time and conventional RT-PCR, and two laboratories did not provide information about the protocol. Three laboratories confirmed their results by using a second published protocol. Table 5 shows that 11 (50%) laboratories used the protocol published by Ölschläger et al., 2010 [26]. These 11 laboratories reported nine false-negative results (detection rate of 93% for this protocol). Seven laboratories using the Ölschläger et al. protocol did not report any false-negative result. Six participants (27%) used the protocol of Vieth et al., 2007 [29] (Table 5). They reported 12 false-negative results (detection rate of 83% for this protocol). Two laboratories using this protocol did not report any false-negative results. Three other protocols (Demby et al., 1994 [23]; Coulibaly N’Golo et al, 2011 [28]; Drosten et al., 2002 [27]) were used by one or two laboratories (Table 5). In the supplementary file (S1 Fig) we are showing partial alignments of the S-segment sequences of LASV strains used in the EQA with position of some published primers: (A) forward primer sequence and position on S-segment alignment; (B) reverse primer sequence and position on S-segment alignment. In comparison to Demby et al., Lassa RT-PCR assay described by Ölschläger et al. had just modified reverse primer in order to detect all described Lassa virus strains.

thumbnail
Download:
Table 5. Summary of the published protocols used by the participating laboratories.

https://doi.org/10.1371/journal.pntd.0003793.t005

Ten laboratories (42%) reported the presence of LCMV in sample #3. In addition, 9 (37%) laboratories reported this sample as negative, which is also considered a correct result because this EQA was conducted to test for the ability to detect LASV. Five laboratories (21%) reported the sample containing LCMV as positive for LASV. These laboratories used protocols for detection of Old World arenaviruses, including LCMV. This underlines the relevance of sequencing the diagnostic PCR products when using pan-virus family detection assays.

Conclusions

This EQA study indicates that most participating laboratories, located in various countries around the world, have a good or acceptable performance in molecular detection of LASV. However, several laboratories need to improve their performance, in particular with respect to detection of the Liberian strain. The data allow the participating laboratories to identify the weakness in their diagnostic procedures and to review and improve their protocols.

One published protocol has achieved 100% detection rate reported by single participant. However, the reference laboratory recommends Ölschläger et al., 2010 published protocol for LASV detection as most commonly used with good detection rate and ability to detect all described Lassa virus strains. The main aim of this EQA study was not to compare published protocols, rather to give chance to participating laboratories to evaluate their testing performance and provide practical exercise for molecular detection of LASV. There should be a follow-up EQA for molecular detection of LASV to evaluate a possible improvement.

Supporting Information

S1 Fig. Partial alignments of the S-Segment sequences of LASV strains used in the EQA with position of some published primers.

https://doi.org/10.1371/journal.pntd.0003793.s001

(TIF)

Acknowledgments

The authors thank Anette Teichmann and Regina Schädler for technical and administrative support, and Aftab Jasir from the European Public Health Microbiology Training Programme (EUPHEM), European Centre for Disease Prevention and Control (ECDC), for support and scientific guidance. We also thank the ECDC-funded European Network for Diagnostics of ‘Imported’ Viral Diseases (ENIVD).

Author Contributions

Conceived and designed the experiments: PP MN. Performed the experiments: PP SN. Analyzed the data: SN. Contributed reagents/materials/analysis tools: TR SG PP RM MN. Wrote the paper: SN SG.

References

  1. 1. Frame JD, Baldwin JM Jr., Gocke DJ, Troup JM. Lassa fever, a new virus disease of man from West Africa. I. Clinical description and pathological findings. The American journal of tropical medicine and hygiene. 1970;19(4):670–6. pmid:4246571
  2. 2. Cummins D, Bennett D, Fisher-Hoch SP, Farrar B, Machin SJ, McCormick JB. Lassa fever encephalopathy: clinical and laboratory findings. The Journal of tropical medicine and hygiene. 1992;95(3):197–201. pmid:1597876
  3. 3. Emond RT, Bannister B, Lloyd G, Southee TJ, Bowen ET. A case of Lassa fever: clinical and virological findings. British medical journal. 1982;285(6347):1001–2. pmid:6812716
  4. 4. Murphy FA. Arenavirus taxonomy: a review. Bulletin of the World Health Organization. 1975;52(4–6):389–91. pmid:1085227
  5. 5. Lecompte E, Fichet-Calvet E, Daffis S, Koulemou K, Sylla O, Kourouma F, et al. Mastomys natalensis and Lassa fever, West Africa. Emerging infectious diseases. 2006;12(12):1971–4. pmid:17326956
  6. 6. Monath TP. Lassa fever: review of epidemiology and epizootiology. Bulletin of the World Health Organization. 1975;52(4–6):577–92. pmid:1085227
  7. 7. Yalley-Ogunro JE, Frame JD, Hanson AP. Endemic Lassa fever in Liberia. VI. Village serological surveys for evidence of Lassa virus activity in Lofa County, Liberia. Transactions of the Royal Society of Tropical Medicine and Hygiene. 1984;78(6):764–70. pmid:6398530
  8. 8. Bowen MD, Peters CJ, Nichol ST. Phylogenetic analysis of the Arenaviridae: patterns of virus evolution and evidence for cospeciation between arenaviruses and their rodent hosts. Molecular phylogenetics and evolution. 1997;8(3):301–16. pmid:9417890
  9. 9. Fichet-Calvet E, Rogers DJ. Risk maps of Lassa fever in West Africa. PLoS neglected tropical diseases. 2009;3(3):e388. pmid:19255625
  10. 10. Atkin S, Anaraki S, Gothard P, Walsh A, Brown D, Gopal R, et al. The first case of Lassa fever imported from Mali to the United Kingdom, February 2009. Euro surveillance: bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin. 2009;14(10).
  11. 11. Safronetz D, Lopez JE, Sogoba N, Traore SF, Raffel SJ, Fischer ER, et al. Detection of Lassa virus, Mali. Emerging infectious diseases. 2010;16(7):1123–6. pmid:20587185
  12. 12. Akoua-Koffi C, Ter Meulen J, Legros D, Akran V, Aidara M, Nahounou N, et al. [Detection of anti-Lassa antibodies in the Western Forest area of the Ivory Coast]. Medecine tropicale: revue du Corps de sante colonial. 2006;66(5):465–8.
  13. 13. Gunther S, Lenz O. Lassa virus. Critical reviews in clinical laboratory sciences. 2004;41(4):339–90. pmid:15487592
  14. 14. Ajayi NA, Nwigwe CG, Azuogu BN, Onyire BN, Nwonwu EU, Ogbonnaya LU, et al. Containing a Lassa fever epidemic in a resource-limited setting: outbreak description and lessons learned from Abakaliki, Nigeria (January-March 2012). International journal of infectious diseases: IJID: official publication of the International Society for Infectious Diseases. 2013;17(11):e1011–6. pmid:23871405
  15. 15. Macher AM, Wolfe MS. Historical Lassa fever reports and 30-year clinical update. Emerging infectious diseases. 2006;12(5):835–7. pmid:16704848
  16. 16. Gunther S, Weisner B, Roth A, Grewing T, Asper M, Drosten C, et al. Lassa fever encephalopathy: Lassa virus in cerebrospinal fluid but not in serum. The Journal of infectious diseases. 2001;184(3):345–9. pmid:11443561
  17. 17. Schmitz H, Kohler B, Laue T, Drosten C, Veldkamp PJ, Gunther S, et al. Monitoring of clinical and laboratory data in two cases of imported Lassa fever. Microbes and infection / Institut Pasteur. 2002;4(1):43–50.
  18. 18. Haas WH, Breuer T, Pfaff G, Schmitz H, Kohler P, Asper M, et al. Imported Lassa fever in Germany: surveillance and management of contact persons. Clinical infectious diseases: an official publication of the Infectious Diseases Society of America. 2003;36(10):1254–8. pmid:12746770
  19. 19. Gunther S, Emmerich P, Laue T, Kuhle O, Asper M, Jung A, et al. Imported lassa fever in Germany: molecular characterization of a new lassa virus strain. Emerging infectious diseases. 2000;6(5):466–76. pmid:10998376
  20. 20. Lassa fever, imported case, Netherlands. Releve epidemiologique hebdomadaire / Section d'hygiene du Secretariat de la Societe des Nations = Weekly epidemiological record / Health Section of the Secretariat of the League of Nations. 2000;75(33):265.
  21. 21. Lassa fever imported to England. Communicable disease report CDR weekly. 2000;10(11):99. pmid:10769489
  22. 22. McCormick JB, King IJ, Webb PA, Johnson KM, O'Sullivan R, Smith ES, et al. A case-control study of the clinical diagnosis and course of Lassa fever. The Journal of infectious diseases. 1987;155(3):445–55. pmid:3805772
  23. 23. Demby AH, Chamberlain J, Brown DW, Clegg CS. Early diagnosis of Lassa fever by reverse transcription-PCR. Journal of clinical microbiology. 1994;32(12):2898–903. pmid:7883875
  24. 24. Lunkenheimer K, Hufert FT, Schmitz H. Detection of Lassa virus RNA in specimens from patients with Lassa fever by using the polymerase chain reaction. Journal of clinical microbiology. 1990;28(12):2689–92. pmid:2279999
  25. 25. Trappier SG, Conaty AL, Farrar BB, Auperin DD, McCormick JB, Fisher-Hoch SP. Evaluation of the polymerase chain reaction for diagnosis of Lassa virus infection. The American journal of tropical medicine and hygiene. 1993;49(2):214–21. pmid:8357084
  26. 26. Olschlager S, Lelke M, Emmerich P, Panning M, Drosten C, Hass M, et al. Improved detection of Lassa virus by reverse transcription-PCR targeting the 5' region of S RNA. Journal of clinical microbiology. 2010;48(6):2009–13. pmid:20351210
  27. 27. Drosten C, Gottig S, Schilling S, Asper M, Panning M, Schmitz H, et al. Rapid detection and quantification of RNA of Ebola and Marburg viruses, Lassa virus, Crimean-Congo hemorrhagic fever virus, Rift Valley fever virus, dengue virus, and yellow fever virus by real-time reverse transcription-PCR. Journal of clinical microbiology. 2002;40(7):2323–30. pmid:12089242
  28. 28. Coulibaly-N'Golo D, Allali B, Kouassi SK, Fichet-Calvet E, Becker-Ziaja B, Rieger T, et al. Novel arenavirus sequences in Hylomyscus sp. and Mus (Nannomys) setulosus from Cote d'Ivoire: implications for evolution of arenaviruses in Africa. PloS one. 2011;6(6):e20893. pmid:21695269
  29. 29. Vieth S, Drosten C, Lenz O, Vincent M, Omilabu S, Hass M, et al. RT-PCR assay for detection of Lassa virus and related Old World arenaviruses targeting the L gene. Transactions of the Royal Society of Tropical Medicine and Hygiene. 2007;101(12):1253–64. pmid:17905372
  30. 30. Bowen MD, Rollin PE, Ksiazek TG, Hustad HL, Bausch DG, Demby AH, et al. Genetic diversity among Lassa virus strains. Journal of virology. 2000;74(15):6992–7004. pmid:10888638
  31. 31. Niedrig M, Schmitz H, Becker S, Gunther S, ter Meulen J, Meyer H, et al. First international quality assurance study on the rapid detection of viral agents of bioterrorism. Journal of clinical microbiology. 2004;42(4):1753–5. pmid:15071040
  32. 32. Niedrig M, Donoso-Mantke O, Schadler R, members E. The European Network for Diagnostics of Imported Viral Diseases (ENIVD)—12 years of strengthening the laboratory diagnostic capacity in Europe. Euro surveillance: bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin. 2007;12(4):E070419 5.
  33. 33. Escadafal C, Olschlager S, Avsic-Zupanc T, Papa A, Vanhomwegen J, Wolfel R, et al. First international external quality assessment of molecular detection of Crimean-Congo hemorrhagic fever virus. PLoS neglected tropical diseases. 2012;6(6):e1706. pmid:22745842
  34. 34. Escadafal C, Paweska JT, Grobbelaar A, le Roux C, Bouloy M, Patel P, et al. International external quality assessment of molecular detection of Rift Valley fever virus. PLoS neglected tropical diseases. 2013;7(5):e2244. pmid:23717706
  35. 35. Domingo C, Niedrig M, Teichmann A, Kaiser M, Rumer L, Jarman RG, et al. 2nd International external quality control assessment for the molecular diagnosis of dengue infections. PLoS neglected tropical diseases. 2010;4(10).