Skip to main content

Evaluation of the loop-mediated isothermal amplification assay for Staphylococcus aureus detection: a systematic review and meta-analysis

Abstract

Background

Staphylococcus aureus can cause many diseases and even death. It’s important to detect Staphylococcus aureus rapidly and reliably. The accuracy of a novel test named LAMP in detecting Staphylococcus aureus is unclear. Therefore, a systematic review and meta-analysis were conducted to evaluate the accuracy of the LAMP assay for Staphylococcus aureus detection.

Methods

Four databases were searched for relevant studies. Meta-DiSc 1.4.0 and Stata 12.0 were used for statistical analysis. At the same time, we used QUADAS-2 to assess the studies we included. Two groups of subgroup analysis were done to differentiate the diagnostic effects of various LAMP tests and in cases of different gold standards.

Results

11 studies were identified and 19 2 × 2 contingency tables were extracted in our study. The results showed that both pooled sensitivity and specificity of the LAMP assay were 99% (95% CI 99–100).

Conclusion

The LAMP assay demonstrated high sensitivity and specificity in diagnosing Staphylococcus aureus.

Introduction

Staphylococcus aureus (S. aureus), including methicillin-resistant Staphylococcus aureus (MRSA), is a momentous human pathogen that can produce all kinds of toxins and cause vomiting, diarrhea, gastroenteritis, toxic shock syndrome, and other infectious diseases. It secretes potent enterotoxins, toxic shock syndrome toxin-1, and Panton-Valentine leucocidin [1,2,3]. With strong virulence, invasiveness, and antibiotic resistance, S. aureus has become the primary pathogen of hospital and community-acquired infections [2]. In particular, MRSA has become one of the most crucial epidemiological problems in hospitals worldwide, resulting in a large number of premature deaths [4]. A recent meta-analysis, focusing on the all-cause mortality of S. aureus and MRSA, found more than one-third of patients who have S. aureus will die within 3 months, and the index of MRSA was higher [5]. Therefore, for diagnosing and treating patients timely, it is vital to establish a reliable and rapid method to detect S. aureus and MRSA [6].

The traditional identification methods of S. aureus and MRSA in the clinical laboratory are based on the standard phenotypic method, including blood culture, colony morphology, biochemical identification, and antimicrobial susceptibility tests. However, these methods are laborious and time-consuming. On the contrary, polymerase chain reaction (PCR) and real-time PCR detection provide rapid and effective function for the identification of S. aureus and MRSA, which become the gold standard at the molecular level [7]. But the relatively expensive thermal cycler limit their applicability in the field [8].

Loop-mediated isothermal amplification (LAMP) was invented by Notomi et al., which is a highly specific method for efficient and rapid amplification of DNA under isothermal conditions. It depends on automated circular strand-substitution DNA synthesis and requires a Bst DNA polymerase with high strand-substitution activity. Besides, a set of internal and external primers for synthesis in LAMP were specially designed to identify all six different sequences on the target DNA. One of the loop primers is needed to bind to the loop structure, which can shorten the reaction time of the LAMP assay. Because its Bst DNA polymerase has isothermal activity and strand-displacement activity, the denaturation steps of the thermocycling reaction can be omitted, thus reducing the technical work and improving the amplification speed [9]. LAMP tests have been developed to rapidly identify all kinds of bacteria, such as S. aureus, Vibrio parahaemolyticus, Campylobacter jejuni, Campylobacter Coli, Leptospira species, Salmonella enterica serovar Typhi and Escherichia coli [3].

Compared with PCR, LAMP detection has the same specificity in the identification of S. aureus and is cheaper. It is more sensitive and robust in dealing with complex biological samples. Compared with the traditional culture, it is simpler and more efficient with higher sensitivity. At present, LAMP is more suitable for clinical diagnosis, laboratories, and fields with limited resources [3, 10]. In recent years, the commonly used versions used to detect S. aureus are eazyplex® MRSAplus (Amplex BioSystems, Giessen, Germany), eazyplex® MRSA (Amplex BioSystems, Giessen, Germany), Loopamp DNA amplification kit (Eiken Chemical Co. Ltd., Tokyo, Japan), LAMP-LFD and m-LAMP-LFB [3]. However, there was no comprehensive evaluation in LAMP for S. aureus. Therefore, we evaluate the accuracy of LAMP in the detection of S. aureus systematically by combining with previous research data.

Methods

Search strategy

Pubmed, Embase, Web of Science, and Cochrane Library were retrieved as of July 30, 2021. The eligible studies were identified according to “Staphylococcus aureus”, “Methicillin-Resistant Staphylococcus aureus”, “Vancomycin-Resistant Staphylococcus aureus”, “loop-mediated isothermal amplification”, “LAMP assay”, etc. The studies we retrieved were imported into Endnote X9 for management.

Inclusion and exclusion criteria

The studies which met the following criteria were included: (1) The samples detected and analyzed come from humanity; (2) The number of the specimens is no fewer than ten; (3) Studies use LAMP to detect S. aureus and it compares with an appropriate reference standard; (4) The values of 2 × 2 contingency table can be extracted from studies. Editorial, reviews, and conference abstracts are excluded.

Data abstraction and quality assessment

Two researchers used a pre-designed excel worksheet to extract data from selected articles together. Data includes author, publication year, study design, location, source of specimens, gold standard, type of LAMP, bacterial species, the values of the 2 × 2 contingency table (true positivity (TP), false positivity (FP), false negativity (FN), and true negativity (TN)).

In the meantime, these two researchers evaluated the selected article together using the Quality of Diagnostic Accuracy Studies-2 (QUADAS-2), a recommended tool for appraising studies in systematic reviews for diagnostic accuracy [11]. It is comprised of eleven criteria in four parts, including Patient Selection, Index Test, Reference Standard, and Flow and Timing. Each part was evaluated by different questions and rated as “High”, “Unclear”, and “Low” with risk of bias. In each part, when the answers to all questions for a domain are “yes,” then the risk of bias can be judged low. If any question is answered “no,” potential for bias exists. If insufficient data exists, the answer and risk of bias will be judged unclear [11].

Statistical analysis

Meta-Disc 1.4.0 and Stata 12.0 were used for statistical analysis. The pooled sensitivity, pooled specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), and SROC curve map were obtained to evaluate the diagnostic accuracy of the LAMP assay by applying Meta-Disc 1.4.0. The Stata 12.0 was used to draw Bivariate Boxplot, Deeks’ funnel plot, and Fagan Nomogram.

Result

Search results

The initial search retrieved 922 studies. After removing duplicates, 594 studies were retained, of which 526 studies were excluded because of the title and abstract. The remaining 68 studies were further read in full text, and finally, a total of 11 studies [3, 4, 6, 12,13,14,15,16,17,18,19] were included in our analysis (Additional file 1: Fig. S1).

Characteristics of included study

We extracted a total of 19 sets of data from these 11 articles, which were summarized in Table 1.

Table 1 The detailed characteristics of the included studies

Quality evaluation

The quality plots were completed by using Review Manager 5.3.0 and were shown in Figs. 1 and 2. In the aspect of patient selection, 6 studies [3, 4, 6, 13, 15, 16] were considered as high risk of bias which was caused by didn’t avoid setting up a case–control trial. Furthermore, 3 studies [14, 17, 19] were evaluated as unclear risk of bias, because didn't mention whether improper exclusions had been avoided. In the aspect of the index test, 4 studies [4, 13, 16, 19] were considered as high risk of bias. Because the index test results were interpreted in a situation where the results of the gold standard were already known. In addition to this, the risk of bias was unclear for 2 studies [14, 18] because of the indistinct description. 2 studies [3, 6] which judged as having a high risk of bias in the domain of reference standard, known the results of LAMP assay when the index results were interpreted, while 3 studies [14, 15, 18] were unclear about it. Besides, 2 studies [3, 6] were considered as high risk of bias because didn’t have an appropriate interval of time, and only 1 study [15] was considered as unclear risk of bias because of the ambiguous description.

Fig. 1
figure 1

The summary of the risk of bias and applicability concerns of the included studies

Fig. 2
figure 2

Quality evaluation of the individual studies

Publication bias

According to the funnel plot (Fig. 3A), there was an existing significant publication bias in studies we included (P = 0.00).

Fig. 3
figure 3

Deek’s funnel plot showing a significant publication bias (A), and Bivariate Boxplot indicating low heterogeneity (B)

Bivariate Boxplot showed that there was low heterogeneity in this systematic review (Fig. 3B).

Diagnostic accuracy of the LAMP assay

The sensitivity of LAMP ranged from 83 (95% CI 36–100) to 100%, whereas its pooled sensitivity in detecting S. aureus was 99% (95% CI 99–100), with the I-square value of 31.8% (Fig. 4A). Its specificity was ranged from 75 (95% CI 48–93) to 100%, whereas its pooled sensitivity was 99% (95% CI 99–100), with the I-square value of 48.2% (Fig. 4B). In addition to this, the NLR was 0.02 (95% CI 0.01 to 0.04, I2 = 19.1%; Fig. 5A), the PLR was 51.06 (95% CI 22.65 to 115.06, I2 = 69.0%; Fig. 5B), the DOR was 3277.07 (95% CI 1503.47 to 7142.94, I2 = 0.0%; Fig. 5C), and the AUC was 0.9976 (Fig. 5D).

Fig. 4
figure 4

Forest plots for the pooled sensitivity (A) and specificity (B)

Fig. 5
figure 5

Negative LR (A), Positive LR (B), Diagnostic OR (C) and SROC curve (D) of the included studies

The Fagan nomogram showed that with a prior probability of 50%, the post-test probability was 100% if the results were positive, and the post-test probability was 0% if the results were negative (Fig. 6).

Fig. 6
figure 6

Fagan’s probability plot

Diagnostic performance of subgroups

Two subgroups were generated in the study. The first subgroup analysis was performed to better distinguish the diagnostic effects of different LAMP types (Figs. 7, 8). In the subgroup, the lamp-FLB and Loopamp DNA Amplification kit have the highest diagnostic accuracy for positive samples (100%, but the latter study only has a four-lattice table). This is followed by eazyplex® MRSA and LAMP (studies that did not indicate LAMP classification were summarized as LAMP groups) (99%) and LAMP-FLD (98%). In terms of diagnostic accuracy for negative samples, from high to low are lamp-FLB, lamp-FLD, and Loopamp DNA Amplification kit (100%), eazyplex® MRSA (99%), and LAMP (98%), respectively.

Fig. 7
figure 7

The results of subgroup analysis. A, B LAMP-LFB, C, D eazyplex® MRSA

Fig. 8
figure 8

The results of subgroup analysis. A, B LAMP-LFD, (C, D) conventional LMAP

Another subgroup analysis was performed according to the type of gold standards. In the result, compared with PCR, the sensitivity and specificity were both 100%. The sensitivity and specificity were both 99%, when compared with traditional identification methods.

Discussion

In the study, we explored the diagnostic efficacy of LAMP for S. aureus by systematic review and meta-analysis. High diagnostic performance of LAMP in the detection of S. aureus was revealed in our study.

In both positive and negative samples, high sensitivity and specificity were evaluated in the study. Among them, there were only 2 studies (4 data in) with low sensitivity and specificity (both < 60% CI). Henares’ study [16] had a minimum sensitivity of 0.36, and Rödel’s study [15] had a minimum sensitivity of 0.54, respectively. In specificity, in Kashani’s study [14] low diagnostic performance was shown, with 0.40 and 0.48 when low. For these 4 data sets, low levels may be owing to two reasons: On the one hand, the small sample size was used in Henares’ study [16]. On the other hand, it should be noticed that MIC and Disk Diffusion were used as the gold standards in Kashani’s study [14], but there is little literature on this diagnostic method as the gold standard in.

In the first subgroup analysis, the best diagnostic performance was found when used m-LAMP-LFB (both sensitivity and specificity reached 100%, short for multiplex loop-mediated isothermal amplification linked to a nanoparticle-based lateral flow biosensor), which uses FLB to interpret LAMP diagnosis results. Compared with other monitoring techniques such as gel electrophoresis and real-time turbidity, LFB is specific for target genes and less likely to result in false–positive results. Besides, it’s effective and quick to be operated [6, 18]. Another subgroup analysis reveals that high diagnostic performance exists whatever the type of goal standards. Although both sensitivity and specificity were higher in LAMP when compared with PCR assay (100%), the difference between PCR and other assays (99%) was mostly negligible.

With a PLR of 51.06 and an NLR of 0.02 in summary, which was classified that LAMP can guarantee higher TP and TN while avoiding FP and FN. In addition, when the prior probability of 50%, LAMP could diagnose with a posterior sensitivity of 100%, and a posterior specificity of 0% in Fagan’s plot.

In general, good diagnostic performance was shown in LAMP in the detection S. aureus. Among them, LAMP-FLD has the best overall diagnostic performance of both positive and negative samples according to comprehensive judgment.

In the part of publication bias, there are many points asymmetrically distributed in Deek’s funnel plot, the result in it is a collection with Publication bias score from Cochrane. Some reasons may lead to this result: (1) Many discontinuous or nonrandomized cases were included in the study; (2) A case–control study design was used; (3) In terms of the application of the blinding method, LAMP results were interpreted under the known gold standard results in many studies; (4) The time interval of LAMP and Gold standard interpretation is ambiguous. These factors may have resulted in a "beautiful" experimental result, but they also led to a significant publication bias in our study [20]. Therefore, although we believe that LAMP has good diagnostic performance, the significant publication bias in the literature included in this systematic review leads us to remain cautious about the results.

In terms of heterogeneity, the results of I-square in forest plots of sensitivity, specificity, and diagnosability show no heterogeneity in our study. Moreover, the Bivariate Boxplot also confirms the results of these I-square from 3 forest plots. Thus, we assess there is no heterogeneity in our study.

Overall, our study demonstrates the efficacy of LAMP in the diagnosis of S. aureus by combining previously published studies. In addition, since there is no systematic review of this area, our study certainly fills the gap.

There are also some shortcomings in this study. On the one hand, only English studies were included in the study. On the other hand, in the subgroup analysis, although we found that all kinds of LAMP had good diagnostic performance, the number of samples in the subgroup was not enough, and there were only a few pieces of data in each subgroup. If confirmed by more clinical studies, the results would be more reliable.

Conclusion

In summary, our study shows that the LAMP assay has high diagnostic accuracy in the diagnosis of S. aureus. Nevertheless, more research is necessary to determine the diagnostic accuracy of LAMP assay.

Availability of data and materials

All data analyzed in this study are included in the article.

References

  1. Xiong J, Huang B, Xu JS, Huang WS. A closed-tube loop-mediated isothermal amplification assay for the visual detection of Staphylococcus aureus. Appl Biochem Biotechnol. 2020;191(1):201–11.

    CAS  Article  Google Scholar 

  2. Kadariya J, Smith TC, Thapaliya D. Staphylococcus aureus and staphylococcal food-borne disease: an ongoing challenge in public health. Biomed Res Int. 2014;2014:827965.

    Article  Google Scholar 

  3. Lim KT, Teh CS, Thong KL. Loop-mediated isothermal amplification assay for the rapid detection of Staphylococcus aureus. Biomed Res Int. 2013;2013:895816.

    PubMed  PubMed Central  Google Scholar 

  4. Nawattanapaiboon K, Prombun P, Santanirand P, Vongsakulyanon A, Srikhirin T, Sutapun B, Kiatpathomchai W. Hemoculture and direct sputum detection of meca-mediated methicillin-resistant Staphylococcus aureus by loop-mediated isothermal amplification in combination with a lateral-flow dipstick. J Clin Lab Anal. 2016;30(5):760–7.

    CAS  Article  Google Scholar 

  5. Bai AD, Lo CK, Komorowski AS, Suresh M, Guo K, Garg A, Tandon P, Senecal J, Del Corpo O, Stefanova I, et al. Staphylococcus aureus bacteremia mortality: a systematic review and meta-analysis. Clin Microbiol Infect. 2022. https://doi.org/10.1016/j.cmi.2022.03.015.

    Article  PubMed  Google Scholar 

  6. Chen X, Ma K, Yi X, Xiong L, Wang Y, Li S. The rapid and visual detection of methicillin-susceptible and methicillin-resistant Staphylococcus aureus using multiplex loop-mediated isothermal amplification linked to a nanoparticle-based lateral flow biosensor. Antimicrob Resist Infect Control. 2020;9(1):111.

    Article  Google Scholar 

  7. Sanchini A. Recent developments in phenotypic and molecular diagnostic methods for antimicrobial resistance detection in Staphylococcus aureus: a narrative review. Diagnostics. 2022;12(1):208.

    CAS  Article  Google Scholar 

  8. Velasco V, Sherwood JS, Rojas-García PP, Logue CM. Multiplex real-time PCR for detection of Staphylococcus aureus, mecA and Panton-Valentine Leukocidin (PVL) genes from selective enrichments from animals and retail meat. PLoS ONE. 2014;9(5): e97617.

    Article  Google Scholar 

  9. Notomi T, Okayama H, Masubuchi H, Yonekawa T, Watanabe K, Amino N, Hase T. Loop-mediated isothermal amplification of DNA. Nucleic Acids Res. 2000;28(12): E63.

    CAS  Article  Google Scholar 

  10. Nguyen AV, Orlofsky A, Pubill K, Tawde M, Li G, Mata D, Bermudes O, Fernandez M, Santana J, Kim W, et al. Loop-mediated isothermal amplification (LAMP) as a rapid, affordable and effective tool to involve students in undergraduate research. Front Microbiol. 2020;11:603381.

    Article  Google Scholar 

  11. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, Leeflang MM, Sterne JA, Bossuyt PM. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529–36.

    Article  Google Scholar 

  12. Metwally L, Gomaa N, Hassan R. Detection of methicillin-resistant Staphylococcus aureus directly by loop-mediated isothermal amplification and direct cefoxitin disk diffusion tests. East Mediterr Health J. 2014;20(4):273–9.

    CAS  Article  Google Scholar 

  13. Leikeim RSM, Kesselmeier M, Löffler B, Rödel J, Höring S. Diagnostic accuracy and clinical impact of loop-mediated isothermal amplification for rapid detection of Staphylococcus aureus bacteremia: a retrospective observational study. Eur J Clin Microbiol Infect Dis. 2020;39(4):679–88.

    CAS  Article  Google Scholar 

  14. Kashani S, Alvandi AH, Abiri R. Diagnostic values of multiplex loop-mediated isothermal amplification and multiplex polymerase chain reaction for detection of methicillin-resistant Staphylococcus aureus. Jundishapur J Microbiol. 2020;13(6):1–6.

    Article  Google Scholar 

  15. Rödel J, Bohnert JA, Stoll S, Wassill L, Edel B, Karrasch M, Löffler B, Pfister W. Evaluation of loop-mediated isothermal amplification for the rapid identification of bacteria and resistance determinants in positive blood cultures. Eur J Clin Microbiol Infect Dis. 2017;36(6):1033–40.

    Article  Google Scholar 

  16. Henares D, Brotons P, Buyse X, Latorre I, de Paz HD, Muñoz-Almagro C. Evaluation of the eazyplex MRSA assay for the rapid detection of Staphylococcus aureus in pleural and synovial fluid. Int J Infect Dis. 2017;59:65–8.

    CAS  Article  Google Scholar 

  17. Hanaki KI, Sekiguchi JI, Shimada K, Sato A, Watari H, Kojima T, Miyoshi-Akiyama T, Kirikae T. Loop-mediated isothermal amplification assays for identification of antiseptic- and methicillin-resistant Staphylococcus aureus. J Microbiol Methods. 2011;84(2):251–4.

    CAS  Article  Google Scholar 

  18. Jiang L, Li X, Gu R, Mu D. Nanoparticles-Based biosensor coupled with multiplex loop-mediated isothermal amplification for detection of Staphylococcus aureus and identification of methicillin-resistant S. aureus. Infect Drug Resist. 2020;13:1251–62.

    CAS  Article  Google Scholar 

  19. Su J, Liu X, Cui H, Li Y, Chen D, Li Y, Yu G. Rapid and simple detection of methicillin-resistance staphylococcus aureus by orfX loop-mediated isothermal amplification assay. BMC Biotechnol. 2014;14:8.

    Article  Google Scholar 

  20. Sterne JA, Sutton AJ, Ioannidis JP, Terrin N, Jones DR, Lau J, Carpenter J, Rücker G, Harbord RM, Schmid CH, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011;343: d4002.

    Article  Google Scholar 

Download references

Acknowledgements

We express our sincere gratitude to all the patients and clinical researchers who were involved in the included studies for their wonderful work and valuable participation.

Funding

No funding was used to support this study.

Author information

Authors and Affiliations

Authors

Contributions

LJL, ML, XM, and X-GG conceived and designed the experiments. L-JL, YRC, and XM analyzed the studies and extracted data. LJL, ML, XM, and YRC contributed to making tables. LJL and ML contributed to the production of figures. All authors participated in the writing, reading, and revision of the manuscript and approved the final version of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Xu-Guang Guo.

Ethics declarations

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file1

: Figure S1. Flow chart for the selection of studies.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Long, LJ., Lin, M., Chen, YR. et al. Evaluation of the loop-mediated isothermal amplification assay for Staphylococcus aureus detection: a systematic review and meta-analysis. Ann Clin Microbiol Antimicrob 21, 27 (2022). https://doi.org/10.1186/s12941-022-00522-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12941-022-00522-6

Keywords

  • Methicillin-resistant Staphylococcus aureus
  • Staphylococcus aureus
  • Loop-mediated isothermal amplification
  • Detection