|Year : 2020 | Volume
| Issue : 1 | Page : 88-94
Pooled testing for COVID-19 diagnosis by real-time RT-PCR: A multi-site comparative evaluation of 5- & 10-sample pooling
Ira Praharaj1, Amita Jain2, Mini Singh3, Anukumar Balakrishnan4, Rahul Dhodapkar5, Biswajyoti Borkakoty6, Munivenkatappa Ashok7, Pradeep Das8, Debasis Biswas9, Usha Kalawat10, Jyotirmayee Turuk11, AP Sugunan4, Shantanu Prakash2, Anirudh K Singh9, Rajamani Barathidasan5, Subhra Subhadra11, Jyotsnamayee Sabat11, MJ Manjunath7, Poonam Kanta3, Nagaraja Mudhigeti10, Rahul Hazarika6, Hricha Mishra2, Kumar Abhishek8, C Santhalembi4, Manas Ranjan Dikhit8, Neetu Vijay12, Jitendra Narayan12, Harmanmeet Kaur12, Sidhartha Giri1, Nivedita Gupta1
1 Divsion of Epidemiology & Communicable Diseases, Indian Council of Medical Research, New Delhi, India
2 Department of Microbiology, King George's Medical University, Lucknow, Uttar Pradesh, India
3 Department of Virology, Postgraduate Institute of Medical Education & Research, Chandigarh, India
4 ICMR-National Institute of Virology, Kerala Unit, Alappuzha, Kerala, India
5 Department of Microbiology, Jawaharlal Institute of Postgraduate Medical Education & Research, Puducherry, India
6 Regional Medical Research Centre, Dibrugarh, Assam, India
7 ICMR-National Institute of Virology, Bangalore Unit, Bengaluru, Karnataka, India
8 ICMR-Rajendra Memorial Research Institute of Medical Sciences, Patna, Bihar, India
9 Department of Microbiology, All India Institute of Medical Sciences, Bhopal, Madhya Pradesh, India
10 Department of Microbiology, Sri Venkateswara Institute of Medical Sciences, Tirupati, Andhra Pradesh, India
11 ICMR-Regional Medical Research Centre, Bhubaneswar, Odisha, India
12 Department of Health Research, Ministry of Health & Family Welfare, New Delhi, India
|Date of Submission||31-May-2020|
|Date of Web Publication||17-Sep-2020|
Division of Epidemiology & Communicable Diseases, Indian Council of Medical Research, Ansari Nagar, New Delhi 110 029
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Background & objectives: Public health and diagnostic laboratories are facing huge sample loads for COVID-19 diagnosis by real-time reverse transcription-polymerase chain reaction (RT-PCR). High sensitivity of optimized real-time RT-PCR assays makes pooled testing a potentially efficient strategy for resource utilization when positivity rates for particular regions or groups of individuals are low. We report here a comparative analysis of pooled testing for 5- and 10-sample pools by real-time RT-PCR across 10 COVID-19 testing laboratories in India.
Methods: Ten virus research and diagnostic laboratories (VRDLs) testing for COVID-19 by real-time RT-PCR participated in this evaluation. At each laboratory, 100 nasopharyngeal swab samples including 10 positive samples were used to create 5- and 10-sample pools with one positive sample in each pool. RNA extraction and real-time RT-PCR for SARS-CoV-2-specific E gene target were performed for individual positive samples as well as pooled samples. Concordance between individual sample testing and testing in the 5- or 10-sample pools was calculated, and the variation across sites and by sample cycle threshold (Ct) values was analyzed.
Results: A total of 110 each of 5- and 10-sample pools were evaluated. Concordance between the 5-sample pool and individual sample testing was 100 per cent in the Ct value ≤30 cycles and 95.5 per cent for Ctvalues ≤33 cycles. Overall concordance between the 5-sample pooled and individual sample testing was 88 per cent while that between 10-sample pool and individual sample testing was 66 per cent. Although the concordance rates for both the 5- and 10-sample pooled testing varied across laboratories, yet for samples with Ct values ≤33 cycles, the concordance was ≥90 per cent across all laboratories for the 5-sample pools.
Interpretation & conclusions: Results from this multi-site assessment suggest that pooling five samples for SARS-CoV-2 detection by real-time RT-PCR may be an acceptable strategy without much loss of sensitivity even for low viral loads, while with 10-sample pools, there may be considerably higher numbers of false negatives. However, testing laboratories should perform validations with the specific RNA extraction and RT-PCR kits in use at their centres before initiating pooled testing.
Keywords: Concordance - COVID-19 - E gene - pooling - real-time RT-PCR - SARS-CoV-2 - sensitivity
|How to cite this article:|
Praharaj I, Jain A, Singh M, Balakrishnan A, Dhodapkar R, Borkakoty B, Ashok M, Das P, Biswas D, Kalawat U, Turuk J, Sugunan A P, Prakash S, Singh AK, Barathidasan R, Subhadra S, Sabat J, Manjunath M J, Kanta P, Mudhigeti N, Hazarika R, Mishra H, Abhishek K, Santhalembi C, Dikhit MR, Vijay N, Narayan J, Kaur H, Giri S, Gupta N. Pooled testing for COVID-19 diagnosis by real-time RT-PCR: A multi-site comparative evaluation of 5- & 10-sample pooling. Indian J Med Res 2020;152:88-94
|How to cite this URL:|
Praharaj I, Jain A, Singh M, Balakrishnan A, Dhodapkar R, Borkakoty B, Ashok M, Das P, Biswas D, Kalawat U, Turuk J, Sugunan A P, Prakash S, Singh AK, Barathidasan R, Subhadra S, Sabat J, Manjunath M J, Kanta P, Mudhigeti N, Hazarika R, Mishra H, Abhishek K, Santhalembi C, Dikhit MR, Vijay N, Narayan J, Kaur H, Giri S, Gupta N. Pooled testing for COVID-19 diagnosis by real-time RT-PCR: A multi-site comparative evaluation of 5- & 10-sample pooling. Indian J Med Res [serial online] 2020 [cited 2021 Feb 28];152:88-94. Available from: https://www.ijmr.org.in/text.asp?2020/152/1/88/294376
Extensive testing for SARS-CoV-2 is one of the most important components of COVID-19 control strategy at present. Timely and accurate reporting can lead to proper contact tracing and effective containment measures. Real-time reverse transcription-polymerase chain reaction (RT-PCR)-based molecular assays for various SARS-CoV-2 gene targets are the mainstay of diagnosis for COVID-19 at present,. Given the evolving strategies for testing worldwide which now also include testing asymptomatic individuals with pertinent contact history, the load of sample testing has grown manifold in laboratories testing for SARS-CoV-2. In this scenario, many countries face shortage of resources and testing kits for detection of SARS-CoV-2. This situation is especially pronounced for low- and middle-income country settings. Shortage in critical reagents required for real-time RT-PCR has led to the emphasis on various strategies for efficient use of resources required for testing. Among the different strategies, pooling of respiratory samples, specifically nasopharyngeal samples, has received attention, given the simplicity of the approach and the fact that there are no additional requirements in terms of equipment or reagents for this approach.
During a pandemic, a high load of samples requires to be tested, especially for containment measures, but the positivity rates are low or show a wide variation from place to place. In such a scenario, pooling of samples can be considered a viable option to conserve resources and time for testing a large number of samples. While pooling of respiratory samples for the detection of RNA viruses such as influenza viruses has been evaluated, it has not been widely used for diagnostic sample testing.
With the high sensitivity of real-time RT-PCR-based tests and the low prevalence of COVID-19 infection in many areas and regions of India, pooled testing of respiratory samples has the potential of increasing the testing capacity considerably. Mathematical models and epidemiological projections have suggested different pooling sizes, which might be feasible and effective for handling testing needs in regions with different positivity rates. While deciding on the appropriate pool size, biological and experimental feasibility is very important and should be evaluated. It is necessary to strike a balance between the resources that are saved because of pooled sample testing and the potential loss of sensitivity of the real-time RT-PCR assay that such testing might entail.
The objective of the present study was to do a comparative analysis of pooled testing using 5- and 10-sample pools by real-time RT-PCR performed in 10 different COVID-19 testing laboratories across India.
| Material & Methods|| |
All the 10 laboratories involved in this evaluation were virus research and diagnostic laboratories (VRDLs) supported under the Department of Health Research-Indian Council of Medical Research (DHR-ICMR) scheme and were designated real-time RT-PCR testing laboratories for COVID-19. These 10 laboratories were: ICMR-National Institute of Virology (ICMR-NIV), Bangalore Unit, Bengaluru; Jawaharlal Institute of Postgraduate Medical Education & Research (JIPMER), Puducherry; King George's Medical University (KGMU), Lucknow; ICMR-NIV, Kerala Unit, Alappuzha; Postgraduate Institute of Medical Education & Research (PGIMER), Chandigarh; All India Institute of Medical Sciences (AIIMS), Bhopal; ICMR-Regional Medical Research Centre (ICMR-RMRC), Bhubaneswar; ICMR-RMRC, Dibrugarh; ICMR-Rajendra Memorial Research Institute of Medical Sciences (ICMR-RMRIMS), Patna; and Sri Venkateswara Institute of Medical Sciences (SVIMS), Tirupati. These described experiments were carried out during May 8-20, 2020, using samples already tested for COVID-19 diagnosis as part of the national COVID-19 strategy.
Nasopharyngeal swab samples in the viral transport medium (VTM) previously tested positive and negative for SARS-CoV-2, and appropriately stored at −80°C, were used. For the set of experiments described below, all the samples used were anonymized and used for evaluating a pooling process for increasing testing capacity and efficiency. No age, gender or any other personal identifiers corresponding to samples were accessed or used during testing or analysis. A standard template for pooling of samples was shared with each of the participating laboratories. A volume of 200 μl of VTM from each of the individual samples was used for pooling. Each pool of five samples included one positive and four negatives. Each pool of 10 samples included one positive and nine negatives. Therefore, the total volume of a 5-sample pool was 1 ml and that of a 10-sample pool was 2 ml. The participating laboratories were instructed to include positive samples with a range of cycle threshold (Ct) values, with a majority in the range of Ct value 30 and above. In addition, each laboratory also included one 5-sample pool and one 10-sample pool comprising negative tested samples.
RNA extraction from individual and pooled samples: RNA was extracted from both 5-sample and 10-sample pools, as well as the individual samples using the same RNA extraction kit. A volume of 200 μl of the pooled sample was used for RNA extraction. Participating laboratories were instructed to use the same extraction kits for individual samples, 5-sample pools, as well as 10-sample pools. The individual samples, as well as the pools, were included in the same extraction batch, and the same aliquot of sample was used for individual sample testing as well as creating 5- and 10-sample pools for RNA extraction. Each laboratory also included two negative pools of samples, one with five negative samples and another with 10 negative samples.
RNA extraction kits used by the different laboratories included QiaAmp Mini Viral RNA Kit (Qiagen, Germany) used by six laboratories, MGIEasy Nucleic Acid Extraction Kit (MGI Tech Co., Ltd., China) by two laboratories and HiPura Viral RNA Extraction Kit (HiMedia, Mumbai) used by a single laboratory.
Real-time RT-PCR for SARS-CoV E gene: Single-step real-time RT-PCR for SARS-CoV-2 targeting the E gene was performed on the extracted RNA from individual samples as well as the sample pools. Participating laboratories used the same RT-PCR kit for E gene detection as was being used on a regular basis for COVID-19 diagnosis at the centre. Six of the laboratories used the E gene screening assay as per the protocol described earlier. Two laboratories used the TIB Molbiol 2019 nCoV Kit (TIB Molbiol, Germany). One laboratory each used Standard M nCoV Real-Time Detection Kit (SD Biosensor Inc., Republic of Korea) and PathoDetect COVID-19 Detection Kit (Mylab Discovery Solutions, Maharashtra). RNA extracted from individual samples as well as the 5- and 10-sample pools were included in the same real-time RT-PCR assay batch to avoid inter-assay variation. Concordance between individual sample testing and pooled sample testing was calculated and expressed in percentages.
| Results|| |
A total of 110 5-sample pools and an equal number of 10-sample pools were evaluated across the 10 laboratories. This included a total of 1000 nasopharyngeal/oropharyngeal swab samples which had already been tested for SARS-CoV-2 using established methods. Of these, 100 samples were confirmed positive for SARS-CoV-2 and were included for the individual sample as well as 5- and 10-sample pools testing.
Positive samples included in creating pools ranged from a Ct value of 23 cycles to a maximum of 35.9 cycles. For a majority of the 5- and 10-sample pools (77 of the 110), the positive samples included in the positive pools had Ct values more than 30 cycles [Figure 1].
|Figure 1: Ctvalue distribution for individual sample testing compared to 5-sample and 10-sample pooled testing. Note: For samples where no amplification was seen in the real-time RT-PCR assay, a Ctvalue of 40 cycles was assigned and used for plotting purposes. RT-PCR, reverse transcription-polymerase chain reaction.|
Click here to view
Concordance between individual sample testing and the pooled testing with five and 10 samples was calculated. With 5-sample pooling, the overall concordance was calculated to be 88 per cent. In 10-sample pools, positive samples could be detected in only 66 of 100 (66%) of pools evaluated. The concordance varied considerably with the viral load [Table 1]. For positive samples with Ct values less than or equal to 30 cycles, the concordance rates with pooled sample testing were high (100% for 5-sample pools and 95.6% for 10-sample pools).
Concordance rates also varied across testing laboratories. For 5-sample pools, concordance rate varied from a minimum of 70 to 100 per cent [Table 2]. Four of the 10 laboratories had a 100 per cent concordance between the 5-sample pools and the individual positive samples. The concordance rates between 5-sample pools and individual sample testing for samples with Ct values less than or equal to 33 cycles were 90 per cent or more across all testing laboratories. For the 10-sample pools, the concordance rate varied from a minimum of 50 per cent to a maximum of 90 per cent across laboratories [Table 2].
|Table 2: Laboratory-wise concordance between positive samples included for evaluation and detection in 5- and 10-sample pools|
Click here to view
On an average, Ct values obtained with the 5-sample pooled testing exceeded individual sample testing by 2.18±1.86 cycles while Ct values obtained with the 10-sample pooling exceeded individual sample testing by 3.81±2.26 cycles. In a real-time RT-PCR assay with 100 per cent efficiency, a difference of approximately 3.3 cycles was expected between samples with a 10-fold difference in viral load. The average Ct value differences between individual and pooled sample testing were consistent with this.
| Discussion|| |
Pooled sample testing has been considered as a simple and practical approach for improving the testing output while minimizing the resources being utilized for real-time RT-PCR. Several studies from different countries have reported different pooling strategies,,,,,, and are included in [Table 3].
|Table 3: Strategy for pooled real-time RT-PCR testing reported from different countries|
Click here to view
Based on the comparative analysis of the 5- and 10-sample pooling in the present study, 5-sample pooling was better than 10-sample pooling as the concordance rates with individual sample testing were high and false-negativity rates were low. This was especially true for samples with Ct values less than 33 cycles. Concordance rates for samples with Ct values greater than 33 cycles were considerably less. With 10-sample pools, the concordance rates with individual sample testing were low and false-negativity rates were high at Ct values more than 30 cycles. Recent reports from the USA, Spain and Chile had similar results with the 5-sample pooling strategy,,.
While 5-sample pooling gave consistently better results compared to 10-sample pooling across the all testing sites, there was variation in the false-negativity rates. Though this could have been a function of the different RNA extraction and RT-PCR kits used across the different sites, it will be difficult to make any conclusions with the available data. It is recommended that before initiating pooled sample testing, laboratories perform validation experiments with the RNA extraction and RT-PCR kits being used. Further, the practical efficiency of sample pooling is a function of the positivity rate for a particular country, State or region or even in the specific group of individuals being tested. Therefore, batch sizes for pooled testing or even the decision to follow pooled testing should be taken at the laboratory or regional levels, taking into consideration the positivity rates, the specific groups and categories being tested. Individual groups for whom there is a higher pre-test probability and those with serious manifestations should not be included in pooled testing but should be tested individually. Mathematical models have suggested that sample pooling strategy will work best in settings with low prevalence and individual subgroups with low clinical suspicion such as asymptomatic individuals.
In this analysis, pooling of nasopharyngeal swab samples in VTM was done before RNA extraction. Some recent studies and pre-prints have reported successful pooling of extracted RNA for up to 32 different samples,. Such an approach of performing RNA extraction and then pooling only saves resources at the RT-PCR step and not at the RNA extraction step. The RNA extraction step remains one of the most rate-limiting steps for SARS-CoV-2 RT-PCR in terms of usage of reagents as well as time required. Besides, for the RNA extraction quality control step, separate runs for RNase P or other internal control need to be performed for each extracted RNA, and this nullifies to some extent the advantages of the pooling of RNA extracts.
The major limitation of our study was that not all the 10 participating laboratories used the same RNA extraction kit or RT-PCR kit for this exercise. While using the same RNA extraction kits as well as RT-PCR kits across the 10 different participating laboratories would have made this evaluation more rigorous, the decision to allow each laboratory to proceed with the current kits they were using for diagnostic testing for COVID-19 was based on the fact that given the current constraints in the availability of testing kits, in many instances, laboratories may not be able to use their preferred kits at this point of time.
In conclusion, the results from this multi-site comparison of the 5- and 10-sample pooling suggest that pooling five samples for SARS-CoV-2 detection by real-time RT-PCR may be an acceptable strategy without much loss of sensitivity for low viral loads. However, the results obtained highlight the need for each laboratory to perform validation runs at their centres and when using different RNA extraction and RT-PCR kits. It is also emphasized that pooling sizes will differ by the populations and group of individuals being tested as well as the positivity rates. These will continue to evolve during a pandemic, and therefore, guidelines for pooling samples must be revisited from time to time to ensure that they continue to be relevant and useful in a given context.
Acknowledgment: Authors thank Shri Akash Dey from Clinton Health Access Initiative, New Delhi, for helpful discussions.
Financial support & sponsorship: All the VRDLs participating in this evaluation were funded through the Department of Health Research scheme “Setting up a network of nation-wide network of laboratories for managing epidemics and national calamities”.
Conflicts of Interest: None.
| References|| |
Corman VM, Landt O, Kaiser M, Molenkamp R, Meijer A, Chu DK, et al
. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Euro Surveill
Tang YW, Schmitz JE, Persing DH, Stratton CW. Laboratory diagnosis of COVID-19: Current issues and challenges. J Clin Microbiol
Van TT, Miller J, Warshauer DM, Reisdorf E, Jernigan D, Humes R, et al
. Pooling nasopharyngeal/throat swab specimens to increase testing capacity for influenza viruses by PCR. J Clin Microbiol
Gupta N, Potdar V, Praharaj I, Giri S, Sapkal G, Yadav P, et al.
Laboratory preparedness for SARS-CoV-2 testing in India: Harnessing a network of virus research & diagnostic laboratories. Indian J Med Res
Lohse S, Pfuhl T, Berkó-Göttel B, Rissland J, Geißler T, Gärtner B, et al
. Pooling of samples for testing for SARS-CoV-2 in asymptomatic people. Lancet Infect Dis
Yelin I, Aharony N, Shaer Tamar E, Argoetti A, Messer E, Berenbaum D, et al
. Evaluation of COVID-19 RT-qPCR test in multi-sample pools. Clin Infect Dis
Farfan MJ, Torres JP, O´Ryan M, Olivares M, Gallardo P, Salas C. Optimizing RT-PCR detection of SARS-CoV-2 for developing countries using pool testing. medRxiv
2020. doi: 10.1101/2020.04.15.20067199.
Abdalhamid B, Bilder CR, McCutchen EL, Hinrichs SH, Koepsell SA, Iwen PC. Assessment of specimen pooling to conserve SARS-CoV-2 testing resources. Am J Clin Pathol
Shenta N, Levy S, Wuvshet V. Efficient high throughput SARS-CoV-2 testing to detect asymptomatic carrier. medRxiv
2020. doi: 10.1101/2020.04.14.20064618.
Torres I, Albert E, Navarro D. Pooling of nasopharyngeal swab specimens for SARS-CoV-2 detection by RT-PCR. J Med Virol
Aragón-Caqueo D, Fernández-Salinas J, Laroze D. Optimization of group size in pool testing strategy for SARS-CoV-2: A simple mathematical model. J Med Virol
Grant PR, Turner MA, Yen Shin G, Nastouli E, Levett LJ. Extraction-free COVID-19 (SARS-CoV-2) diagnosis by RTPCR to increase capacity for national testing programmes during a pandemic. bioRxiv
2020. doi: 10.1101/2020.04.06.028316.
[Table 1], [Table 2], [Table 3]