scispace - formally typeset
Search or ask a question
Journal ArticleDOI

Multi-site assessment of rapid, point-of-care antigen testing for the diagnosis of SARS-CoV-2 infection in a low-prevalence setting: A validation and implementation study

TL;DR: In this paper, the authors evaluated the performance and implementation of rapid antigen-based SARS-CoV-2 testing in a setting with a low prevalence of COVID-19 infections, such as Australia.
Abstract: Background: In Australia, COVID-19 diagnosis relies on RT-PCR testing which is relatively costly and time-consuming To date, few studies have assessed the performance and implementation of rapid antigen-based SARS-CoV-2 testing in a setting with a low prevalence of COVID-19 infections, such as Australia Methods: This study recruited participants presenting for COVID-19 testing at three Melbourne metropolitan hospitals during a period of low COVID-19 prevalence The Abbott PanBioTM COVID-19 Ag point-of-care test was performed alongside RT-PCR In addition, participants with COVID-19 notified to the Victorian Government were invited to provide additional swabs to aid validation Implementation challenges were also documented Findings: The specificity of the Abbott PanBioTM COVID-19 Ag test was 9996% (95% CI 9973 - 100%) Sensitivity amongst participants with RT-PCR-confirmed infection was dependent upon the duration of symptoms reported, ranging from 773% (duration 1 to 33 days) to 100% in those within seven days of symptom onset A range of implementation challenges were identified which may inform future COVID-19 testing strategies in a low prevalence setting Interpretation: Given the high specificity, antigen-based tests may be most useful in rapidly triaging public health and hospital resources while expediting confirmatory RT-PCR testing Considering the limitations in test sensitivity and the potential for rapid transmission in susceptible populations, particularly in hospital settings, careful consideration is required for implementation of antigen testing in a low prevalence setting Funding: This work was funded by the Victorian Department of Health and Human Services The funder was not involved in data analysis or manuscript preparation

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI
TL;DR: A systematic review and meta-analysis of commercially available rapid diagnostic tests (Ag-RDTs) for SARS-CoV-2 up until 30 April 2021 was conducted in this paper.
Abstract: Background SARS-CoV-2 antigen rapid diagnostic tests (Ag-RDTs) are increasingly being integrated in testing strategies around the world. Studies of the Ag-RDTs have shown variable performance. In this systematic review and meta-analysis, we assessed the clinical accuracy (sensitivity and specificity) of commercially available Ag-RDTs. Methods and findings We registered the review on PROSPERO (registration number: CRD42020225140). We systematically searched multiple databases (PubMed, Web of Science Core Collection, medRvix, bioRvix, and FIND) for publications evaluating the accuracy of Ag-RDTs for SARS-CoV-2 up until 30 April 2021. Descriptive analyses of all studies were performed, and when more than 4 studies were available, a random-effects meta-analysis was used to estimate pooled sensitivity and specificity in comparison to reverse transcription polymerase chain reaction (RT-PCR) testing. We assessed heterogeneity by subgroup analyses, and rated study quality and risk of bias using the QUADAS-2 assessment tool. From a total of 14,254 articles, we included 133 analytical and clinical studies resulting in 214 clinical accuracy datasets with 112,323 samples. Across all meta-analyzed samples, the pooled Ag-RDT sensitivity and specificity were 71.2% (95% CI 68.2% to 74.0%) and 98.9% (95% CI 98.6% to 99.1%), respectively. Sensitivity increased to 76.3% (95% CI 73.1% to 79.2%) if analysis was restricted to studies that followed the Ag-RDT manufacturers’ instructions. LumiraDx showed the highest sensitivity, with 88.2% (95% CI 59.0% to 97.5%). Of instrument-free Ag-RDTs, Standard Q nasal performed best, with 80.2% sensitivity (95% CI 70.3% to 87.4%). Across all Ag-RDTs, sensitivity was markedly better on samples with lower RT-PCR cycle threshold (Ct) values, i.e., <20 (96.5%, 95% CI 92.6% to 98.4%) and <25 (95.8%, 95% CI 92.3% to 97.8%), in comparison to those with Ct ≥ 25 (50.7%, 95% CI 35.6% to 65.8%) and ≥30 (20.9%, 95% CI 12.5% to 32.8%). Testing in the first week from symptom onset resulted in substantially higher sensitivity (83.8%, 95% CI 76.3% to 89.2%) compared to testing after 1 week (61.5%, 95% CI 52.2% to 70.0%). The best Ag-RDT sensitivity was found with anterior nasal sampling (75.5%, 95% CI 70.4% to 79.9%), in comparison to other sample types (e.g., nasopharyngeal, 71.6%, 95% CI 68.1% to 74.9%), although CIs were overlapping. Concerns of bias were raised across all datasets, and financial support from the manufacturer was reported in 24.1% of datasets. Our analysis was limited by the included studies’ heterogeneity in design and reporting. Conclusions In this study we found that Ag-RDTs detect the vast majority of SARS-CoV-2-infected persons within the first week of symptom onset and those with high viral load. Thus, they can have high utility for diagnostic purposes in the early phase of disease, making them a valuable tool to fight the spread of SARS-CoV-2. Standardization in conduct and reporting of clinical accuracy studies would improve comparability and use of data.

181 citations

Posted ContentDOI
01 Mar 2021-medRxiv
TL;DR: In this article, a systematic review and meta-analysis of commercially available rapid diagnostic tests (Ag-RDTs) is presented, where the clinical accuracy (sensitivity and specificity) of these tests are assessed.
Abstract: Background SARS-CoV-2 antigen rapid diagnostic tests (Ag-RDTs) are increasingly being integrated in testing strategies around the world. Studies of the Ag-RDTs have shown variable performance. In this systematic review and meta-analysis, we assessed the clinical accuracy (sensitivity and specificity) of commercially available Ag-RDTs. Methods We registered the review on PROSPERO (Registration number: CRD42020225140). We systematically searched multiple databases (PubMed, Web of Science Core Collection, medRvix and bioRvix, FINDdx) for publications up until December 11th, 2020. Descriptive analyses of all studies were performed and when more than four studies were available, a random-effects meta-analysis was used to estimate pooled sensitivity and specificity in comparison to reverse transcriptase polymerase chain reaction testing. We assessed heterogeneity by subgroup analyses ((1) performed con-form with manufacturer’s instructions for use (IFU) or not, (2) symptomatic vs. asymptomatic, (3) duration of symptoms less than seven days vs. more than seven days, (4) Ct-value Results From a total of 11,715 articles, we extracted 98 analytical and clinical data sets. 74 clinical accuracy data sets were evaluated that included 31,202 samples. Across all meta-analyzed samples, the pooled Ag-RDT sensitivity was 73.8% (CI 68.6 to 78.5). If analysis was restricted to studies that followed the Ag-RDT manufacturers’ instructions using fresh upper respiratory swab samples, the sensitivity increased to 79.1% (95%CI 75.0 to 82.8). The SD Biosensor Standard Q and Abbott Panbio showed the highest sensitivity with 81.7% and 72.7%, respectively. The best Ag-RDT performance was found with nasopharyngeal sampling (77.3%, CI 72.0 to 81.9) in comparison to other sample types (e.g., anterior nasal or mid turbinate 63.5%, CI 49.5 to 75.5). Testing in the first week from symptom onset resulted in higher sensitivity (87.5%, CI 86.0 to 89.1) compared to testing after one week (64.1%, CI 54.4 to 73.8). The tests performed markedly better on samples with lower Ct-values, i.e., Conclusion As Ag-RDTs detect most cases within the first week of symptom onset and those with high viral load, they can have high utility for screening purposes in the early phase of disease, and thus can be a valuable tool to fight the spread of SARS-CoV-2. Standardization of conduct and reporting of clinical accuracy studies would improve comparability and use of data. Summary In this living systematic review we analyzed 98 data sets for performance of SARS-CoV-2 Ag-RDTs compared to RT-PCR. Best-performing tests achieved a sensitivity of 81.7%. Highest sensitivity was found in patients within seven days of symptom onset when NP swabs were utilized.

166 citations

Journal ArticleDOI
TL;DR: In this article , the second update of this review was published, which was first published in 2020, and included 152 evaluations of single test applications including 100,462 unique samples (16,822 with confirmed SARS-CoV-2 infection or known absence of infection).
Abstract: Accurate rapid diagnostic tests for SARS-CoV-2 infection would be a useful tool to help manage the COVID-19 pandemic. Testing strategies that use rapid antigen tests to detect current infection have the potential to increase access to testing, speed detection of infection, and inform clinical and public health management decisions to reduce transmission. This is the second update of this review, which was first published in 2020.To assess the diagnostic accuracy of rapid, point-of-care antigen tests for diagnosis of SARS-CoV-2 infection. We consider accuracy separately in symptomatic and asymptomatic population groups. Sources of heterogeneity investigated included setting and indication for testing, assay format, sample site, viral load, age, timing of test, and study design.We searched the COVID-19 Open Access Project living evidence database from the University of Bern (which includes daily updates from PubMed and Embase and preprints from medRxiv and bioRxiv) on 08 March 2021. We included independent evaluations from national reference laboratories, FIND and the Diagnostics Global Health website. We did not apply language restrictions.We included studies of people with either suspected SARS-CoV-2 infection, known SARS-CoV-2 infection or known absence of infection, or those who were being screened for infection. We included test accuracy studies of any design that evaluated commercially produced, rapid antigen tests. We included evaluations of single applications of a test (one test result reported per person) and evaluations of serial testing (repeated antigen testing over time). Reference standards for presence or absence of infection were any laboratory-based molecular test (primarily reverse transcription polymerase chain reaction (RT-PCR)) or pre-pandemic respiratory sample.We used standard screening procedures with three people. Two people independently carried out quality assessment (using the QUADAS-2 tool) and extracted study results. Other study characteristics were extracted by one review author and checked by a second. We present sensitivity and specificity with 95% confidence intervals (CIs) for each test, and pooled data using the bivariate model. We investigated heterogeneity by including indicator variables in the random-effects logistic regression models. We tabulated results by test manufacturer and compliance with manufacturer instructions for use and according to symptom status.We included 155 study cohorts (described in 166 study reports, with 24 as preprints). The main results relate to 152 evaluations of single test applications including 100,462 unique samples (16,822 with confirmed SARS-CoV-2). Studies were mainly conducted in Europe (101/152, 66%), and evaluated 49 different commercial antigen assays. Only 23 studies compared two or more brands of test. Risk of bias was high because of participant selection (40, 26%); interpretation of the index test (6, 4%); weaknesses in the reference standard for absence of infection (119, 78%); and participant flow and timing 41 (27%). Characteristics of participants (45, 30%) and index test delivery (47, 31%) differed from the way in which and in whom the test was intended to be used. Nearly all studies (91%) used a single RT-PCR result to define presence or absence of infection. The 152 studies of single test applications reported 228 evaluations of antigen tests. Estimates of sensitivity varied considerably between studies, with consistently high specificities. Average sensitivity was higher in symptomatic (73.0%, 95% CI 69.3% to 76.4%; 109 evaluations; 50,574 samples, 11,662 cases) compared to asymptomatic participants (54.7%, 95% CI 47.7% to 61.6%; 50 evaluations; 40,956 samples, 2641 cases). Average sensitivity was higher in the first week after symptom onset (80.9%, 95% CI 76.9% to 84.4%; 30 evaluations, 2408 cases) than in the second week of symptoms (53.8%, 95% CI 48.0% to 59.6%; 40 evaluations, 1119 cases). For those who were asymptomatic at the time of testing, sensitivity was higher when an epidemiological exposure to SARS-CoV-2 was suspected (64.3%, 95% CI 54.6% to 73.0%; 16 evaluations; 7677 samples, 703 cases) compared to where COVID-19 testing was reported to be widely available to anyone on presentation for testing (49.6%, 95% CI 42.1% to 57.1%; 26 evaluations; 31,904 samples, 1758 cases). Average specificity was similarly high for symptomatic (99.1%) or asymptomatic (99.7%) participants. We observed a steady decline in summary sensitivities as measures of sample viral load decreased. Sensitivity varied between brands. When tests were used according to manufacturer instructions, average sensitivities by brand ranged from 34.3% to 91.3% in symptomatic participants (20 assays with eligible data) and from 28.6% to 77.8% for asymptomatic participants (12 assays). For symptomatic participants, summary sensitivities for seven assays were 80% or more (meeting acceptable criteria set by the World Health Organization (WHO)). The WHO acceptable performance criterion of 97% specificity was met by 17 of 20 assays when tests were used according to manufacturer instructions, 12 of which demonstrated specificities above 99%. For asymptomatic participants the sensitivities of only two assays approached but did not meet WHO acceptable performance standards in one study each; specificities for asymptomatic participants were in a similar range to those observed for symptomatic people. At 5% prevalence using summary data in symptomatic people during the first week after symptom onset, the positive predictive value (PPV) of 89% means that 1 in 10 positive results will be a false positive, and around 1 in 5 cases will be missed. At 0.5% prevalence using summary data for asymptomatic people, where testing was widely available and where epidemiological exposure to COVID-19 was suspected, resulting PPVs would be 38% to 52%, meaning that between 2 in 5 and 1 in 2 positive results will be false positives, and between 1 in 2 and 1 in 3 cases will be missed.Antigen tests vary in sensitivity. In people with signs and symptoms of COVID-19, sensitivities are highest in the first week of illness when viral loads are higher. Assays that meet appropriate performance standards, such as those set by WHO, could replace laboratory-based RT-PCR when immediate decisions about patient care must be made, or where RT-PCR cannot be delivered in a timely manner. However, they are more suitable for use as triage to RT-PCR testing. The variable sensitivity of antigen tests means that people who test negative may still be infected. Many commercially available rapid antigen tests have not been evaluated in independent validation studies. Evidence for testing in asymptomatic cohorts has increased, however sensitivity is lower and there is a paucity of evidence for testing in different settings. Questions remain about the use of antigen test-based repeat testing strategies. Further research is needed to evaluate the effectiveness of screening programmes at reducing transmission of infection, whether mass screening or targeted approaches including schools, healthcare setting and traveller screening.

54 citations

Journal ArticleDOI
TL;DR: Although the sensitivity of RATs needs to be enhanced, it may still be a viable option in places where laboratory facilities are lacking for diagnostic purposes in the early phase of disease.
Abstract: The identification of viral RNA using reverse transcription quantitative polymerase chain reaction (RT-qPCR) is the gold standard for identifying an infection caused by SARS-CoV-2. The limitations of RT-qPCR such as requirement of expensive instruments, trained staff and laboratory facilities led to development of rapid antigen tests (RATs). The performance of RATs has been widely evaluated and found to be varied in different settings. The present systematic review aims to evaluate the pooled sensitivity and specificity of the commercially available RATs. This review was registered on PROSPERO (registration number: CRD42021278105). Literature search was performed through PubMed, Embase and Cochrane COVID-19 Study Register to search studies published up to 26 August 2021. The overall pooled sensitivity and specificity of RATs and subgroup analyses were calculated. Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) was used to assess the risk of bias in each study. The overall pooled sensitivity and specificity of RATs were 70% (95% CI: 69–71) and 98% (95% CI: 98–98), respectively. In subgroup analyses, nasal swabs showed the highest sensitivity of 83% (95% CI: 80–86) followed by nasopharyngeal swabs 71% (95% CI: 70–72), throat swabs 69% (95% CI: 63–75) and saliva 68% (95% CI: 59–77). Samples from symptomatic patients showed a higher sensitivity of 82% (95% CI: 82–82) as compared to asymptomatic patients at 68% (95% CI: 65–71), while a cycle threshold (Ct) value ≤25 showed a higher sensitivity of 96% (95% CI: 95–97) as compared to higher Ct value. Although the sensitivity of RATs needs to be enhanced, it may still be a viable option in places where laboratory facilities are lacking for diagnostic purposes in the early phase of disease.

49 citations

Journal ArticleDOI
TL;DR: LFIA tests, though with moderate sensitivity, appear as the most attractive method for use in POCs and for performing seroprevalence studies, and rapid ATs show higher sensitivity in symptomatic patients compared to asymptomatic patients.
Abstract: Coronavirus disease 2019 (COVID-19) initiated global health care challenges such as the necessity for new diagnostic tests. Diagnosis by real-time PCR remains the gold-standard method, yet economical and technical issues prohibit its use in points of care (POC) or for repetitive tests in populations. A lot of effort has been exerted in developing, using, and validating antigen-based tests (ATs). Since individual studies focus on few methodological aspects of ATs, a comparison of different tests is needed. Herein, we perform a systematic review and meta-analysis of data from articles in PubMed, medRxiv and bioRxiv. The bivariate method for meta-analysis of diagnostic tests pooling sensitivities and specificities was used. Most of the AT types for SARS-CoV-2 were lateral flow immunoassays (LFIA), fluorescence immunoassays (FIA), and chemiluminescence enzyme immunoassays (CLEIA). We identified 235 articles containing data from 220,049 individuals. All ATs using nasopharyngeal samples show better performance than those with throat saliva (72% compared to 40%). Moreover, the rapid methods LFIA and FIA show about 10% lower sensitivity compared to the laboratory-based CLEIA method (72% compared to 82%). In addition, rapid ATs show higher sensitivity in symptomatic patients compared to asymptomatic patients, suggesting that viral load is a crucial parameter for ATs performed in POCs. Finally, all methods perform with very high specificity, reaching around 99%. LFIA tests, though with moderate sensitivity, appear as the most attractive method for use in POCs and for performing seroprevalence studies.

21 citations

References
More filters
Journal ArticleDOI
TL;DR: Research electronic data capture (REDCap) is a novel workflow methodology and software solution designed for rapid development and deployment of electronic data Capture tools to support clinical and translational research.

29,988 citations

Journal ArticleDOI
TL;DR: A validated diagnostic workflow for 2019-nCoV is presented, its design relying on close genetic relatedness of 2019- nCoV with SARS coronavirus, making use of synthetic nucleic acid technology.
Abstract: Background The ongoing outbreak of the recently emerged novel coronavirus (2019-nCoV) poses a challenge for public health laboratories as virus isolates are unavailable while there is growing evidence that the outbreak is more widespread than initially thought, and international spread through travellers does already occur. Aim We aimed to develop and deploy robust diagnostic methodology for use in public health laboratory settings without having virus material available. Methods Here we present a validated diagnostic workflow for 2019-nCoV, its design relying on close genetic relatedness of 2019-nCoV with SARS coronavirus, making use of synthetic nucleic acid technology. Results The workflow reliably detects 2019-nCoV, and further discriminates 2019-nCoV from SARS-CoV. Through coordination between academic and public laboratories, we confirmed assay exclusivity based on 297 original clinical specimens containing a full spectrum of human respiratory viruses. Control material is made available through European Virus Archive – Global (EVAg), a European Union infrastructure project. Conclusion The present study demonstrates the enormous response capacity achieved through coordination of academic and public laboratories in national and European research networks.

6,229 citations

Journal ArticleDOI
19 May 2020-JAMA
TL;DR: A series of multifaceted public health interventions was temporally associated with improved control of the COVID-19 outbreak in Wuhan, China, and may inform public health policy in other countries and regions.
Abstract: Importance Coronavirus disease 2019 (COVID-19) has become a pandemic, and it is unknown whether a combination of public health interventions can improve control of the outbreak. Objective To evaluate the association of public health interventions with the epidemiological features of the COVID-19 outbreak in Wuhan by 5 periods according to key events and interventions. Design, Setting, and Participants In this cohort study, individual-level data on 32 583 laboratory-confirmed COVID-19 cases reported between December 8, 2019, and March 8, 2020, were extracted from the municipal Notifiable Disease Report System, including patients’ age, sex, residential location, occupation, and severity classification. Exposures Nonpharmaceutical public health interventions includingcordons sanitaire, traffic restriction, social distancing, home confinement, centralized quarantine, and universal symptom survey. Main Outcomes and Measures Rates of laboratory-confirmed COVID-19 infections (defined as the number of cases per day per million people), across age, sex, and geographic locations were calculated across 5 periods: December 8 to January 9 (no intervention), January 10 to 22 (massive human movement due to the Chinese New Year holiday), January 23 to February 1 (cordons sanitaire, traffic restriction and home quarantine), February 2 to 16 (centralized quarantine and treatment), and February 17 to March 8 (universal symptom survey). The effective reproduction number of SARS-CoV-2 (an indicator of secondary transmission) was also calculated over the periods. Results Among 32 583 laboratory-confirmed COVID-19 cases, the median patient age was 56.7 years (range, 0-103; interquartile range, 43.4-66.8) and 16 817 (51.6%) were women. The daily confirmed case rate peaked in the third period and declined afterward across geographic regions and sex and age groups, except for children and adolescents, whose rate of confirmed cases continued to increase. The daily confirmed case rate over the whole period in local health care workers (130.5 per million people [95% CI, 123.9-137.2]) was higher than that in the general population (41.5 per million people [95% CI, 41.0-41.9]). The proportion of severe and critical cases decreased from 53.1% to 10.3% over the 5 periods. The severity risk increased with age: compared with those aged 20 to 39 years (proportion of severe and critical cases, 12.1%), elderly people (≥80 years) had a higher risk of having severe or critical disease (proportion, 41.3%; risk ratio, 3.61 [95% CI, 3.31-3.95]) while younger people ( Conclusions and Relevance A series of multifaceted public health interventions was temporally associated with improved control of the COVID-19 outbreak in Wuhan, China. These findings may inform public health policy in other countries and regions.

1,307 citations

Related Papers (5)