Time scale performance of rapid antigen testing for SARS-CoV-2: Evaluation of 10 rapid antigen assays.
TL;DR: In this paper, the performance of 10 COVID-19 antigen (Ag) rapid test devices for the detection of SARS-CoV-2 antigen was compared to a quantitative reverse transcription-polymerase chain reaction (RT-qPCR).
Abstract: There is a great demand for more rapid tests for SARS-CoV-2 detection to reduce waiting time, boost public health strategies for combating disease, decrease costs, and prevent overwhelming laboratory capacities. This study was conducted to assess the performance of 10 lateral flow device viral antigen immunoassays for the detection of SARS-CoV-2 in nasopharyngeal swab specimens. We analyzed 231 nasopharyngeal samples collected from October 2020 to December 2020, from suspected COVID-19 cases and contacts of positive cases at Biotechnology Research Center laboratories, Tripoli, Libya. The performance of 10 COVID-19 Antigen (Ag) rapid test devices for the detection of SARS-CoV-2 antigen was compared to a quantitative reverse transcription-polymerase chain reaction (RT-qPCR). In this study, 161 cases had symptoms consistent with COVID-19. The mean duration from symptom onset was 6.6 ± 4.3 days. The median cycle threshold (Ct ) of positive samples was 25. Among the 108 positive samples detected by RT-qPCR, the COVID-19 antigen (Ag) tests detected 83 cases correctly. All rapid Ag test devices used in this study showed 100% specificity. While tests from six manufacturers had an overall sensitivity range from 75% to 100%, the remaining four tests had a sensitivity of 50%-71.43%. Sensitivity during the first 6 days of symptoms and in samples with high viral loads (Ct < 25), was 100% in all but two of the test platforms. False-negative samples had a median Ct of 34 and an average duration of onset of symptoms of 11.3 days (range = 5-20 days). Antigen test diagnosis has high sensitivity and specificity in early disease when patients present less than 7 days of symptom onset. Patients are encouraged to test as soon as they get COVID-19-related symptoms within 1 week and to seek medical advice within 24 h if they develop disturbed smell/taste. The use of rapid antigen tests is important for controlling the COVID-19 pandemic and reducing the burden on molecular diagnostic laboratories.
Citations
More filters
TL;DR: In this article , the second update of this review was published, which was first published in 2020, and included 152 evaluations of single test applications including 100,462 unique samples (16,822 with confirmed SARS-CoV-2 infection or known absence of infection).
Abstract: Accurate rapid diagnostic tests for SARS-CoV-2 infection would be a useful tool to help manage the COVID-19 pandemic. Testing strategies that use rapid antigen tests to detect current infection have the potential to increase access to testing, speed detection of infection, and inform clinical and public health management decisions to reduce transmission. This is the second update of this review, which was first published in 2020.To assess the diagnostic accuracy of rapid, point-of-care antigen tests for diagnosis of SARS-CoV-2 infection. We consider accuracy separately in symptomatic and asymptomatic population groups. Sources of heterogeneity investigated included setting and indication for testing, assay format, sample site, viral load, age, timing of test, and study design.We searched the COVID-19 Open Access Project living evidence database from the University of Bern (which includes daily updates from PubMed and Embase and preprints from medRxiv and bioRxiv) on 08 March 2021. We included independent evaluations from national reference laboratories, FIND and the Diagnostics Global Health website. We did not apply language restrictions.We included studies of people with either suspected SARS-CoV-2 infection, known SARS-CoV-2 infection or known absence of infection, or those who were being screened for infection. We included test accuracy studies of any design that evaluated commercially produced, rapid antigen tests. We included evaluations of single applications of a test (one test result reported per person) and evaluations of serial testing (repeated antigen testing over time). Reference standards for presence or absence of infection were any laboratory-based molecular test (primarily reverse transcription polymerase chain reaction (RT-PCR)) or pre-pandemic respiratory sample.We used standard screening procedures with three people. Two people independently carried out quality assessment (using the QUADAS-2 tool) and extracted study results. Other study characteristics were extracted by one review author and checked by a second. We present sensitivity and specificity with 95% confidence intervals (CIs) for each test, and pooled data using the bivariate model. We investigated heterogeneity by including indicator variables in the random-effects logistic regression models. We tabulated results by test manufacturer and compliance with manufacturer instructions for use and according to symptom status.We included 155 study cohorts (described in 166 study reports, with 24 as preprints). The main results relate to 152 evaluations of single test applications including 100,462 unique samples (16,822 with confirmed SARS-CoV-2). Studies were mainly conducted in Europe (101/152, 66%), and evaluated 49 different commercial antigen assays. Only 23 studies compared two or more brands of test. Risk of bias was high because of participant selection (40, 26%); interpretation of the index test (6, 4%); weaknesses in the reference standard for absence of infection (119, 78%); and participant flow and timing 41 (27%). Characteristics of participants (45, 30%) and index test delivery (47, 31%) differed from the way in which and in whom the test was intended to be used. Nearly all studies (91%) used a single RT-PCR result to define presence or absence of infection. The 152 studies of single test applications reported 228 evaluations of antigen tests. Estimates of sensitivity varied considerably between studies, with consistently high specificities. Average sensitivity was higher in symptomatic (73.0%, 95% CI 69.3% to 76.4%; 109 evaluations; 50,574 samples, 11,662 cases) compared to asymptomatic participants (54.7%, 95% CI 47.7% to 61.6%; 50 evaluations; 40,956 samples, 2641 cases). Average sensitivity was higher in the first week after symptom onset (80.9%, 95% CI 76.9% to 84.4%; 30 evaluations, 2408 cases) than in the second week of symptoms (53.8%, 95% CI 48.0% to 59.6%; 40 evaluations, 1119 cases). For those who were asymptomatic at the time of testing, sensitivity was higher when an epidemiological exposure to SARS-CoV-2 was suspected (64.3%, 95% CI 54.6% to 73.0%; 16 evaluations; 7677 samples, 703 cases) compared to where COVID-19 testing was reported to be widely available to anyone on presentation for testing (49.6%, 95% CI 42.1% to 57.1%; 26 evaluations; 31,904 samples, 1758 cases). Average specificity was similarly high for symptomatic (99.1%) or asymptomatic (99.7%) participants. We observed a steady decline in summary sensitivities as measures of sample viral load decreased. Sensitivity varied between brands. When tests were used according to manufacturer instructions, average sensitivities by brand ranged from 34.3% to 91.3% in symptomatic participants (20 assays with eligible data) and from 28.6% to 77.8% for asymptomatic participants (12 assays). For symptomatic participants, summary sensitivities for seven assays were 80% or more (meeting acceptable criteria set by the World Health Organization (WHO)). The WHO acceptable performance criterion of 97% specificity was met by 17 of 20 assays when tests were used according to manufacturer instructions, 12 of which demonstrated specificities above 99%. For asymptomatic participants the sensitivities of only two assays approached but did not meet WHO acceptable performance standards in one study each; specificities for asymptomatic participants were in a similar range to those observed for symptomatic people. At 5% prevalence using summary data in symptomatic people during the first week after symptom onset, the positive predictive value (PPV) of 89% means that 1 in 10 positive results will be a false positive, and around 1 in 5 cases will be missed. At 0.5% prevalence using summary data for asymptomatic people, where testing was widely available and where epidemiological exposure to COVID-19 was suspected, resulting PPVs would be 38% to 52%, meaning that between 2 in 5 and 1 in 2 positive results will be false positives, and between 1 in 2 and 1 in 3 cases will be missed.Antigen tests vary in sensitivity. In people with signs and symptoms of COVID-19, sensitivities are highest in the first week of illness when viral loads are higher. Assays that meet appropriate performance standards, such as those set by WHO, could replace laboratory-based RT-PCR when immediate decisions about patient care must be made, or where RT-PCR cannot be delivered in a timely manner. However, they are more suitable for use as triage to RT-PCR testing. The variable sensitivity of antigen tests means that people who test negative may still be infected. Many commercially available rapid antigen tests have not been evaluated in independent validation studies. Evidence for testing in asymptomatic cohorts has increased, however sensitivity is lower and there is a paucity of evidence for testing in different settings. Questions remain about the use of antigen test-based repeat testing strategies. Further research is needed to evaluate the effectiveness of screening programmes at reducing transmission of infection, whether mass screening or targeted approaches including schools, healthcare setting and traveller screening.
54 citations
TL;DR: LFIA tests, though with moderate sensitivity, appear as the most attractive method for use in POCs and for performing seroprevalence studies, and rapid ATs show higher sensitivity in symptomatic patients compared to asymptomatic patients.
Abstract: Coronavirus disease 2019 (COVID-19) initiated global health care challenges such as the necessity for new diagnostic tests. Diagnosis by real-time PCR remains the gold-standard method, yet economical and technical issues prohibit its use in points of care (POC) or for repetitive tests in populations. A lot of effort has been exerted in developing, using, and validating antigen-based tests (ATs). Since individual studies focus on few methodological aspects of ATs, a comparison of different tests is needed. Herein, we perform a systematic review and meta-analysis of data from articles in PubMed, medRxiv and bioRxiv. The bivariate method for meta-analysis of diagnostic tests pooling sensitivities and specificities was used. Most of the AT types for SARS-CoV-2 were lateral flow immunoassays (LFIA), fluorescence immunoassays (FIA), and chemiluminescence enzyme immunoassays (CLEIA). We identified 235 articles containing data from 220,049 individuals. All ATs using nasopharyngeal samples show better performance than those with throat saliva (72% compared to 40%). Moreover, the rapid methods LFIA and FIA show about 10% lower sensitivity compared to the laboratory-based CLEIA method (72% compared to 82%). In addition, rapid ATs show higher sensitivity in symptomatic patients compared to asymptomatic patients, suggesting that viral load is a crucial parameter for ATs performed in POCs. Finally, all methods perform with very high specificity, reaching around 99%. LFIA tests, though with moderate sensitivity, appear as the most attractive method for use in POCs and for performing seroprevalence studies.
21 citations
TL;DR: Ag-RDTs detect most of the individuals infected with SARS-CoV-2, and almost all when high viral loads are present, they are especially useful to detect persons with high viral load who are most likely to transmit the virus.
Abstract: Background Comprehensive information about the accuracy of antigen rapid diagnostic tests (Ag-RDTs) for Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) is essential to guide public health decision makers in choosing the best tests and testing policies. In August 2021, we published a systematic review and meta-analysis about the accuracy of Ag-RDTs. We now update this work and analyze the factors influencing test sensitivity in further detail. Methods and findings We registered the review on PROSPERO (registration number: CRD42020225140). We systematically searched preprint and peer-reviewed databases for publications evaluating the accuracy of Ag-RDTs for SARS-CoV-2 until August 31, 2021. Descriptive analyses of all studies were performed, and when more than 4 studies were available, a random-effects meta-analysis was used to estimate pooled sensitivity and specificity with reverse transcription polymerase chain reaction (RT-PCR) testing as a reference. To evaluate factors influencing test sensitivity, we performed 3 different analyses using multivariable mixed-effects meta-regression models. We included 194 studies with 221,878 Ag-RDTs performed. Overall, the pooled estimates of Ag-RDT sensitivity and specificity were 72.0% (95% confidence interval [CI] 69.8 to 74.2) and 98.9% (95% CI 98.6 to 99.1). When manufacturer instructions were followed, sensitivity increased to 76.3% (95% CI 73.7 to 78.7). Sensitivity was markedly better on samples with lower RT-PCR cycle threshold (Ct) values (97.9% [95% CI 96.9 to 98.9] and 90.6% [95% CI 88.3 to 93.0] for Ct-values <20 and <25, compared to 54.4% [95% CI 47.3 to 61.5] and 18.7% [95% CI 13.9 to 23.4] for Ct-values ≥25 and ≥30) and was estimated to increase by 2.9 percentage points (95% CI 1.7 to 4.0) for every unit decrease in mean Ct-value when adjusting for testing procedure and patients’ symptom status. Concordantly, we found the mean Ct-value to be lower for true positive (22.2 [95% CI 21.5 to 22.8]) compared to false negative (30.4 [95% CI 29.7 to 31.1]) results. Testing in the first week from symptom onset resulted in substantially higher sensitivity (81.9% [95% CI 77.7 to 85.5]) compared to testing after 1 week (51.8%, 95% CI 41.5 to 61.9). Similarly, sensitivity was higher in symptomatic (76.2% [95% CI 73.3 to 78.9]) compared to asymptomatic (56.8% [95% CI 50.9 to 62.4]) persons. However, both effects were mainly driven by the Ct-value of the sample. With regards to sample type, highest sensitivity was found for nasopharyngeal (NP) and combined NP/oropharyngeal samples (70.8% [95% CI 68.3 to 73.2]), as well as in anterior nasal/mid-turbinate samples (77.3% [95% CI 73.0 to 81.0]). Our analysis was limited by the included studies’ heterogeneity in viral load assessment and sample origination. Conclusions Ag-RDTs detect most of the individuals infected with SARS-CoV-2, and almost all (>90%) when high viral loads are present. With viral load, as estimated by Ct-value, being the most influential factor on their sensitivity, they are especially useful to detect persons with high viral load who are most likely to transmit the virus. To further quantify the effects of other factors influencing test sensitivity, standardization of clinical accuracy studies and access to patient level Ct-values and duration of symptoms are needed.
18 citations
TL;DR: The Q Ag test performed fairly well, especially in the early DSO when a high viral load was present, and the nasal cavity swab can be considered an alternative site for the rapid diagnosis of COVID-19.
Abstract: The rapid diagnosis of SARS-CoV-2 is an essential aspect in the detection and control of the spread of COVID-19. We evaluated the accuracy of the rapid antigen test (RAT) using samples from the nasal cavity and nasopharynx based on sample collection timing and viral load. We enrolled 175 patients, of which 71 patients and 104 patients had tested positive and negative, respectively, based on real time-PCR. Nasal cavity and nasopharyngeal swab samples were tested using STANDARD Q COVID-19 Ag tests (Q Ag, SD Biosensor, Korea). The sensitivity of the Q Ag test was 77.5% (95% confidence interval [CI], 67.8–87.2%) for the nasal cavity and 81.7% (95% [CI, 72.7–90.7%) for the nasopharyngeal specimens. The RAT results showed a substantial agreement between the nasal cavity and nasopharyngeal specimens (Cohen’s kappa index = 0.78). The sensitivity of the RAT for nasal cavity specimens exceeded 89% for <5 days after symptom onset (DSO) and 86% for Ct of E and RdRp < 25. The Q Ag test performed fairly well, especially in the early DSO when a high viral load was present, and the nasal cavity swab can be considered an alternative site for the rapid diagnosis of COVID-19.
11 citations
TL;DR: Both tests showed comparable sensitivity for detection of variants of SARS-CoV-2 and there was a strong relationship between antigen concentration and band positivity.
Abstract: SARS-CoV-2 viral antigen detection may be an interesting alternative to RT-PCR for the diagnosis of SARS-CoV-2 infection as a less laborious or expensive method but requires validation. This study aimed to compare the performance of the DiaSorin™ LiaisonXL automated quantitative antigen test (QAT) and the AAZ™ rapid antigen test (RAT) to the DiaSorin™ MDX RT-PCR assay. A total of 242 nasopharyngeal samples were tested at La Pitié-Salpêtrière University Hospital (Paris, France). Performances for the detection of variants of SARS-CoV-2 were further investigated. RATs were visually read for qualitative results and band intensity was determined. Overall sensitivity was 63.2% for QAT and 58.6% for RAT. For RT-PCR Ct value 25, sensitivity was 89.8% for both tests. Both tests showed comparable sensitivity for detection of variants. There was a strong relationship between antigen concentration and band positivity. On the same set of samples these tests share similar performances.
5 citations
References
More filters
TL;DR: During the first 2 months of the current outbreak, Covid-19 spread rapidly throughout China and caused varying degrees of illness, and patients often presented without fever, and many did not have abnormal radiologic findings.
Abstract: Background Since December 2019, when coronavirus disease 2019 (Covid-19) emerged in Wuhan city and rapidly spread throughout China, data have been needed on the clinical characteristics of...
22,622 citations
TL;DR: The findings are consistent with person-to-person transmission of this novel coronavirus in hospital and family settings, and the reports of infected travellers in other geographical regions.
7,392 citations
TL;DR: Detailed virological analysis of nine cases of coronavirus disease 2019 (COVID-19) provides proof of active replication of the SARS-CoV-2 virus in tissues of the upper respiratory tract.
Abstract: Coronavirus disease 2019 (COVID-19) is an acute infection of the respiratory tract that emerged in late 20191,2. Initial outbreaks in China involved 13.8% of cases with severe courses, and 6.1% of cases with critical courses3. This severe presentation may result from the virus using a virus receptor that is expressed predominantly in the lung2,4; the same receptor tropism is thought to have determined the pathogenicity—but also aided in the control—of severe acute respiratory syndrome (SARS) in 20035. However, there are reports of cases of COVID-19 in which the patient shows mild upper respiratory tract symptoms, which suggests the potential for pre- or oligosymptomatic transmission6–8. There is an urgent need for information on virus replication, immunity and infectivity in specific sites of the body. Here we report a detailed virological analysis of nine cases of COVID-19 that provides proof of active virus replication in tissues of the upper respiratory tract. Pharyngeal virus shedding was very high during the first week of symptoms, with a peak at 7.11 × 108 RNA copies per throat swab on day 4. Infectious virus was readily isolated from samples derived from the throat or lung, but not from stool samples—in spite of high concentrations of virus RNA. Blood and urine samples never yielded virus. Active replication in the throat was confirmed by the presence of viral replicative RNA intermediates in the throat samples. We consistently detected sequence-distinct virus populations in throat and lung samples from one patient, proving independent replication. The shedding of viral RNA from sputum outlasted the end of symptoms. Seroconversion occurred after 7 days in 50% of patients (and by day 14 in all patients), but was not followed by a rapid decline in viral load. COVID-19 can present as a mild illness of the upper respiratory tract. The confirmation of active virus replication in the upper respiratory tract has implications for the containment of COVID-19. Detailed virological analysis of nine cases of coronavirus disease 2019 (COVID-19) provides proof of active replication of the SARS-CoV-2 virus in tissues of the upper respiratory tract.
5,840 citations
TL;DR: Most variants with amino acid change at receptor binding domain were less infectious but variants including A475V, L452R, V483A and F490L became resistant to some neutralizing antibodies, while deletion of both N331 and N343 glycosylation drastically reduced infectivity, revealing the importance of gly cosylation for viral infectivity.
1,282 citations
TL;DR: SARS-CoV-2 Vero cell infectivity was only observed for RT-PCR Ct < 24 and STT < 8 days, suggesting Infectivity of patients with Ct >24 and duration of symptoms >8 days may be low.
Abstract: BACKGROUND: Reverse-transcription polymerase chain reaction (RT-PCR) has become the primary method to diagnose viral diseases, including severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). RT-PCR detects RNA, not infectious virus; thus, its ability to determine duration of infectivity of patients is limited. Infectivity is a critical determinant in informing public health guidelines/interventions. Our goal was to determine the relationship between E gene SARS-CoV-2 RT-PCR cycle threshold (Ct) values from respiratory samples, symptom onset to test (STT), and infectivity in cell culture. METHODS: In this retrospective cross-sectional study, we took SARS-CoV-2 RT-PCR-confirmed positive samples and determined their ability to infect Vero cell lines. RESULTS: Ninety RT-PCR SARS-CoV-2-positive samples were incubated on Vero cells. Twenty-six samples (28.9%) demonstrated viral growth. Median tissue culture infectious dose/mL was 1780 (interquartile range, 282-8511). There was no growth in samples with a Ctâ
>â
24 or STTâ
>â
8 days. Multivariate logistic regression using positive viral culture as a binary predictor variable, STT, and Ct demonstrated an odds ratio (OR) for positive viral culture of 0.64 (95% confidence interval [CI], .49-.84; Pâ
â
24. CONCLUSIONS: SARS-CoV-2 Vero cell infectivity was only observed for RT-PCR Ctâ
â
24 and duration of symptomsâ
>â
8 days may be low. This information can inform public health policy and guide clinical, infection control, and occupational health decisions. Further studies of larger size are needed.
1,020 citations