Evaluation of the MAScIR SARS-CoV-2 M Kit 2.0 on the SARS-CoV-2 Infection

SARS-CoV-2 is a major public health problem worldwide. Since its emergence, several diagnostic kits have been developed to ensure rapid patient management. The aim of our study is to check the performance of the new Moroccan SARS-CoV-2 detection kit: MAScIR SARS-CoV-2 M 2.0. The following parameters were studied: repeatability, reproducibility, analytical specificity, analytical sensitivity, and comparison with the GeneFinder™ COVID-19 Plus RealAmp Kit. In addition, an external quality evaluation comprising five specimens was carried out as part of an international program for the external quality evaluation of sublaboratories of the WHO and the Laboratory Office of the National Institute of Hygiene of Morocco. The results of all parameters studied showed an analytical performance that complied with the requirements of the method verification/validation protocol adopted by the Central Laboratory of Virology and met the recommendations of COFRAC (French Accreditation Committee). During the current study, the sequencing of some randomly selected positive samples was performed, among which the carriers of the Alpha variant, the Delta variant, and the Omicron variant were detected. These results allowed us to deduce that this kit was valid for detecting these three variants.

It is an enveloped, nonsegmented, positive-sense singlestranded RNA virus belonging to the Coronaviridae family and the order Nidovirals [3]. Te coding part of its genome consists essentially of two regions: the frst region, which represents two-thirds of the genome, codes for the nonstructural proteins of the replication/transcription complex (ORF1a and ORF1b), and the second region, which represents the third of the genome, codes for the structural proteins of the virus (spike, envelope, membrane, and nucleocapsid) [3][4][5].
Te diagnosis of SARS-CoV-2 is essentially based on molecular methods and qualitative RT-PCR, which allow the simultaneous detection of at least one SARS-CoV-2 target and internal control (https://www.sfm-microbiologie.org/ wp-content/uploads/2021/02/LISTE-RAPPORTS-TESTS-M OLECULAIRES_130121.pdf ). Many kits are available, and the most commonly used viral targets are located in the genes S (spike), E (envelope), N (nucleocapsid), and RdRp (ORF1a-dependent RNA polymerase) [4,6]. Te main objective of this study was to evaluate the performance of the new Moroccan MAScIR SARS-CoV-2 M 2.0 kit.

Specimens.
Tis study uses the method verifcation/ validation procedure of the Central Laboratory of Virology (LCV) of the University Hospital Ibn Sina, Rabat, which meets the recommendations of the French Committee for Accreditation (COFRAC), and uses qualitative tests similar to quantitative tests on the basis of Ct. Specimens were taken from patients by nasopharyngeal or oropharyngeal swabs, which were then sent to the LCV in a viral transport medium for qualitative detection of the SARS-CoV-2 genome. Te retrospective portion of the study was performed on specimens held at −80°C. Te stability of the specimens was verifed by the results of their cellular internal control (IC) that met the supplier's recommendations with a value of cycle threshold (Ct) less than 35.

Nucleic Acid Extraction.
Automated nucleic acid extraction was performed on preflled plates (from 16 wells) with the BIOER extractor. In an extraction plate, 10 μL of proteinase K was deposited and 300 μL of the patient sample was deposited. Te number of patients treated in each extraction series was 32 (simultaneous extraction of two columns) with a total time of 35 min.

Nucleic Acid Amplifcation
It is a qualitative triplex in vitro amplifcation test, based on one-step reverse transcription polymerase chain reaction (RT-qPCR) and whose targets were two viral genes of SARS-CoV-2 (RdRp and S) and an internal control of human cell origin. All three targets were treated in the same reaction well. Each reaction mixture contains 2.5 μL of the enzyme mix (enzyme cocktail, dNTP, and reaction bufer), 1 μL of the primer and probe mix, and 6.5 μL of viral extract from patient samples (eluate). Positive control, negative control, and negative extraction control were used in each series of samples.
Te amplifcation was performed on three thermal cyclers, ABI 7500 Applied Biosystems, QuantStudio ™ 5 (QS5) Applied Biosystems, and Exicycler ™ 96 Bioneer. Te amplifcation program was as follows: a reverse transcription step at 50°C for 5 minutes, then an activation step at 95°C for 20 seconds, followed by a succession of 40 cycles of denaturation-hybridization-elongation (denaturation occurs at 95°C for 3 seconds and hybridization and elongation at 60°C for 30 seconds). Te fuorophores of the probes used in this kit were FAM for RdRp, Cy5 for S, and VIC for CI [7]. Te total duration of the PCR on the QS5 was 56 minutes.

GeneFinder ™ COVID-19 Plus RealAmp Reference Kit
Analytical Procedure. Te GeneFinder ™ COVID-19 Plus RealAmp Kit was an in vitro amplifcation test based on realtime polymerase chain reaction (RT-qPCR). It allows the detection of three viral targets (RdRp, N, and E) and internal cellular control. In each reaction well, 5 μL of the patient sample eluate was mixed with 15 μL of the master mix. Positive and negative controls were also used in each series of samples. Te amplifcation, performed on the three aforementioned thermal cyclers, includes the following steps: a reverse transcription step at 50°C for 20 minutes and then an activation step at 95°C for 5 minutes, followed by a succession of 45 denaturation-hybridization-elongation cycles (denaturing occurs at 95°C for 15 seconds and hybridization and elongation occur at 60°C for 60 seconds) [8]. Te total duration of the PCR on the QS5 thermal cycler is 120 minutes.
Over an eight-month period, 171,548 tests were conducted with the GeneFinder ™ COVID-19 Plus Real Amp Kit in our laboratory.

Validation
Step of the Results of the MAScIR SARS-CoV-2 M 2.0 Kit. Te validation step was divided into three parts. Te frst step involved the validation of the negative control, the negative extraction control, and the positive control. For negative checks, all targets have been negative, while for positive controls, all targets have been positive with a Ct value of 22 ± 2 for the RdRp, 19 ± 2 for S, and 24 ± 2 for the CI, according to the data in the manual of the MAScIR SARS-CoV-2 M 2.0. Te second step was the validation of each patient's internal control. Tis control, which was of cellular origin, allows controlling the quality of the sample since its collection, as well as the proper functioning of the extraction and amplifcation steps and the absence of inhibition. Te CI of the samples has been positive, with a Ct< 35.
After the validation of the controls, the patients' results were read. According to the recommendations of the kit leafet and the recommendations of the SFM [9], a sample was considered positive if one or both targets (RdRp and S) had a Ct less than 30, low positive if the Ct value was between 31 and 36, and negative if the Ct value is >37. All control and patient results were collected in a reading sheet and validated on the Laboratory Information System (SIL) (e-Labs, ENOVA Research and Technology). Te outcome report provided to the patient and/or attending physician mentions the presence or absence of SARS-CoV-2 RNA.

Protocol of the Study.
Te repeatability study was carried out on three pools of samples of diferent concentrations on the basis of Ct (one pool of high concentration, one pool of medium concentration, and one pool of low concentration). It was performed on the QuantStudio ™ 5 Applied Biosystems thermal cycler. Each sample had fve runs on the same day, in the same series, with the same working conditions and operators, the same procedure, and the same batch of reagents. Te analytical objective of the repeatability test recommended by the supplier was a CV < 5%.
Te intermediate precision test was studied on positive controls. Te results of the positive checks of the same batch, carried out in each series and over several days on two diferent thermal cyclers by diferent operators, were collected on a sheet and then processed on the EVM. Te limit CV value was 6.66% (calculated according to the formula CV repeatability = CV reproducibility × 0.75).
Moreover, to evaluate the analytical specifcity of the test, 19 positive samples for a respiratory virus diferent from SARS-CoV-2, whose diagnosis was made by PCR in realtime using GeneXpert (retrospective samples from 2019) or All results of this method validation were processed using the Middleware EVM Byg Informatique (EVM). Data processing was based on the calculation of the Ct mean, standard deviation, and coefcient of variation for each parameter. Te results were later converted into a graph of the distribution of values around the mean and into a Levey-Jenning curve. Te precision of each calculation was expressed as a function of statistical measures of imprecision (standard deviation and coefcient of variation). Data from the comparison between the two kits were processed using the Bland-Altman concordance method on EVM.

Analytical Performance
3.1.1. Repeatability. Te average Ct of the RdRp target is 33.24 for the low-concentration pool, 27.61 for the mediumconcentration pool, and 14.52 for the high-concentration pool. Te CVs of the three concentration levels are, respectively, 2.20%, 2.29%, and 2.69%. For target S, the Ct average is 34.63 for the low-concentration pool, 28.69 for the medium-concentration pool, and 16.02 for the highconcentration pool, while the CV values are 3.06%, 1.76%, and 5.44%, respectively. Only the CV value of the S target at the high concentration level is limited to the value recommended by the supplier (Table 1).

Intermediate Precision.
On the QS5 thermocycler, the Ct mean value of the targets (out of a total of 26 values) is 19.56 for the RdRp and 20.64 for the S gene, while on the EXICYCLER thermocycler, the Ct mean of the targets (out of 13 values) is 21.62 for the RdRp and 21.04 for the S gene. All CV values in our series are higher than those of our supplier but remain below the recommended target CV value. For the overall reproducibility of the 2 thermocyclers, the average Ct of the targets is 20.25 for RdRp and 20.78 for S. Te RdRp CV is limited to the target recommended by the supplier (Table 1, Figure 1).  (2), Rhinovirus/Enterovirus (6), and Adenovirus (1). All of these samples were nonreactive for SARS-CoV-2 (Table 2).

Analytical Specifcity and
For analytical sensitivity, the Ct results of the fve dilutions of the positive control were as follows: for RdRp, the values were 18, 22, 26, 30, and 37, respectively, while for S, the results were 20, 24, 28, 32, and 38, respectively. Te resulting lower detection limit, defned as the highest detectable Ct value, was a Ct of 37 for RdRp and 38 for S ( Figure 2).

Interlaboratory Accuracy/Comparison.
Te fve EQA results were compliant. However, the Ct comparison and measurement accuracy calculation were not possible as the results provided to us did not specify the Ct values of the targets (Table 3).

Comparison between SARS-CoV-2 M 2.0 MAScIR Kit and COVID-19 Plus RealAmp GeneFinder ™ Reference Kit.
Te qualitative results of this comparison were broadly consistent. No discrepancies with clinical impact were detected (Table 4). For the quantitative results, based solely on the Ct value of the RdRp (the only common target between the two kits), the application of the Bland-Altman concordance method objectifed a single value greater than the upper concordance limit (and this on the three thermal cyclers used), which was the sample No. 11 (Figure 3, Table 5). Te sensitivity and specifcity of the MAScIR SARS-CoV-2 M 2.0 kit were estimated at 100%, using the Gen-eFinder ™ COVID-19 Plus test as a reference.

Detection of SARS-CoV-2 Variants Present in Morocco.
Te sequencing of positive samples allowed the detection of cases carrying one of the variants of SARS-CoV-2 with identical Ct for S and RdRp (the Alpha variant, the Delta variant, or the Omicron variant). Te results of some cases are given in Table 6, and all data are available on GISAID.

Discussion
After SARS-CoV-1 (which was responsible for an outbreak in China in 2002-2003) and MERS-CoV (which spread to 27 countries between 2012 and 2018), the new SARS-CoV-2 was responsible for the global pandemic that started in December 2019 in Wuhan, China, Hubei Province, following the appearance of several contacts with similar symptoms [3,10]. Until May 19, 2022, this pandemic was responsible for more than 520 million cases worldwide, including 6.27 million deaths. In Morocco, the number of cumulative cases over the same period was up to 1.16 million, including 16.075 million cases of death [11].
To address this emergency, many measures have been put in place to limit the spread of SARS-CoV-2, including diagnostic tools to identify people with SARS-CoV-2, ensure their clinical and therapeutic follow-up, and prevent the transmission of the virus.
In this context, the Moroccan Foundation for Advanced Science Innovation and Research (MAScIR) was able to develop a new Moroccan kit for the qualitative detection of RNA of the SARS-CoV-2, based on RT-qPCR technology [7,12]. Te frst version of this kit, MAScIR SARS-CoV-2 kit 1.0, was evaluated by the Institute Pasteur in Paris, French National Reference Centre for Respiratory Infections. It was a test that allowed the  Advances in Virology detection of three viral targets of SARS-CoV-2 (RdRp, S, and E) and cell CI, which required the treatment of each sample in two diferent wells with the use of two reaction mixes [12]. Tis version has been optimized by the introduction of the second version, MAScIR SARS-CoV-2 kit M 2.0, CE-IVD, the subject of the present work, which detects two viral targets (RdRp and S) and the CI with the advantage of treating each sample in a single reaction well. Te accuracy study of this kit was consistent with that of the supplier. Te repeatability test as well as the intermediate fdelity test have coefcients of variation higher than the supplier's results but remain below the recommended CV value [7].
Regarding the evaluation of analytical specifcity, the results were excellent, with 100% specifcity. All samples included, positive for one or more respiratory viruses, including viruses belonging to the Coronaviridae family, were negative for SARS-CoV-2 with the MAScIR SARS-CoV-2 kit M 2.0. No cross-reaction was detected. According to our literature review, the RdRp and S genes (which are the targets in our kit), along with the N genes of SARS-CoV-2, are known for their higher specifcity [13].
Comparison of the results with the reference kit (Gen-eFinder ™ COVID-19 Plus RealAmp Kit) was compliant. All negative samples using the reference kit were negative using the MAScIR SARS-CoV-2 M 2.0 kit, and all positive samples were positive. However, some highly positive samples using    [7,8].
In addition, the analysis of RdRp results using the Bland and Altman method shows a good correlation between the two methods except for a sample that gives an out-of-bounds result (Ct from RdRp: 38 using the reference kit vs Ct from RdRp being between 20 and 21 using the evaluated kit) ( Table 5). In general, these results have no clinical impact, as the test under study is qualitative. Moreover, the external evaluation by the EEQ confrmed the reliability of the results.
On the other hand, for the GeneFinder ™ COVID-19 Plus Real Amp Kit, the most sensitive target was the N gene. Out of the 52 positive samples included in the comparison test, RdRp and E targets were not detected in 2/52 and 4/52 samples, respectively, unlike the N target that was detected in all of these samples. Tis could be explained by the higher expression of ARNm transcripts of the N gene compared to the other genes, which provides a higher starting amount of template. Tis was discussed by Karen Yanson et al. in their article [14]. However, other articles have demonstrated that kits targeting the E gene are considered the most sensitive [13]. For the MAScIR SARS-CoV-2 M 2.0 kit, the most sensitive target is the S gene that was detected in all samples regardless of the thermal cycler used. However, the detection of the RdRp gene varies depending on the thermal cycler: with the QS5, the target was detected in all samples, while with the ABI and Exicycler, the target was not detected in 1/ 52 and 7/52 samples, respectively. Moreover, the S target of the MAScIR SARS-CoV-2 M 2.0 kit is not afected by the mutation of the Alpha, Delta, or Omicron variant since the Ct of the RdRp and S genes were identical, which was confrmed by the sequencing of our samples (Tables 5 and 6) [15,16]. Our entire dataset has been published on the Mendeley Data Repository [17].
To date, a single retrospective study, recently published and carried out in our laboratory, evaluated the FilmArray BioFire RP2.1 (Respiratory 2.1 Panel) kit using our MAScIR SARS-CoV-2 M 2.0 kit as a reference kit [18]. In this study, there were no discordant results between MAScIR and FilmArray BioFire RP2.1 with regards to negative samples. However, 21 of the 80 positive SARS-CoV-2 samples on FilmArray had discordant results on MAScIR SARS-CoV-2 M 2.0. Eleven of these were tested with another kit, revealing positive results in six cases [18]. Tis has been    Advances in Virology 9  Advances in Virology explained by the diference in the limit of detection (LoD) between the two kits: 160 copies/mL for FilmArray and 500 copies/mL for MAScIR [7,18,19]. Moreover, the sensitivity of the frst MAScIR SARS-CoV-2 kit 1.0 has been validated by the National Respiratory Infections Reference Centre, as mentioned above. It is to be noted that three studies provided data for the GeneFinder ™ COVID-19 Plus RealAmp [20][21][22].

Conclusion
Since the beginning of this pandemic, many SARS-CoV-2 detection PCR kits have been developed. In this context, the MOLDIAG company, created by the MAScIR Foundation, developed the frst qualitative PCR kit designed and manufactured in Morocco for the detection of SARS-CoV-2. Tis study, carried out by the LCV team, has made it possible to verify the performance of this new MAScIR SARS-CoV-2 M 2.0 kit. Te results of the parameters studied are consistent with the supplier's recommendations and are consistent with those of the reference method. Tis kit also has certain advantages: the price, the manufacture, and the availability in Morocco, as well as the amplifcation time (56 min), which is reduced compared to the GeneFinder ™ COVID-19 Plus RealAmp Kit, which allowed to adopt it as a test for detection of the routine SARS-CoV-2 in high-throughput labs.

Data Availability
Te data used to support the fndings of this study are included within the article.

Disclosure
Te supplier of this donation had no infuence on this work.

Conflicts of Interest
Te authors declare that they have no conficts of interest.