Computational and Mathematical Methods in Medicine
Volume 2020 (2020), Article ID 1560250, 8 pages
https://doi.org/10.1155/2020/1560250

Research Article

Capacity Evaluation of Diagnostic Tests For COVID-19 Using Multicriteria Decision-Making Techniques

Murat Sayan,1,2 Figen Sarigul Yildirim,³ Tamer Sanlidag,2,4 Berna Uzun,2,5 Dilber Uzun Ozsahin,2,6 and Ilker Ozsahin2,6

¹Faculty of Medicine, Clinical Laboratory, PCR Unit, Kocaeli University, Kocaeli, Turkey
²DESAM Institute, Near East University, Nicosia/TRNC, Mersin-10, 99138, Turkey
³Health Science University, Antalya Education and Research Hospital, Department of Infectious Diseases and Clinical Microbiology, Antalya 07050, Turkey
⁴Department of Medical Microbiology, Manisa Celal Bayar University, Manisa, Turkey
⁵Department of Mathematics, Near East University, Nicosia/TRNC, Mersin-10, 99138, Turkey
⁶Department of Biomedical Engineering, Faculty of Engineering, Near East University, Nicosia/TRNC, Mersin-10, 99138, Turkey

Correspondence should be addressed to Ilker Ozsahin; ilker.ozsahin@neu.edu.tr

Received 11 May 2020; Revised 22 June 2020; Accepted 7 July 2020; Published 6 August 2020

Guest Editor: Plácido R. Pinheiro

Copyright © 2020 Murat Sayan et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

In December 2019, cases of pneumonia were detected in Wuhan, China, which were caused by the highly contagious coronavirus. This study is aimed at comparing the confusion regarding the selection of effective diagnostic methods to make a mutual comparison among existing SARS-CoV-2 diagnostic tests and at determining the most effective one. Based on available published evidence and clinical practice, diagnostic tests of coronavirus disease (COVID-19) were evaluated by multi-criteria decision-making (MCDM) methods, namely, fuzzy preference ranking organization method for enrichment evaluation (fuzzy PROMETHEE) and fuzzy technique for order of preference by similarity to ideal solution (fuzzy TOPSIS). Computerized tomography of chest (chest CT), the detection of viral nucleic acid by polymerase chain reaction, cell culture, CoV-19 antigen detection, CoV-19 antibody IgM, CoV-19 antibody IgG, and chest X-ray were evaluated by linguistic fuzzy scale to compare among the diagnostic tests. This scale consists of selected parameters that possessed different weights which were determined by the experts’ opinions of the field. The results of our study with both proposed MCDM methods indicated that the most effective diagnosis method of COVID-19 was chest CT. It is interesting to note that the methods that are consistently used in the diagnosis of viral diseases were ranked in second place for the diagnosis of COVID-19. However, each country should use appropriate diagnostic solutions according to its own resources. Our findings also show which diagnostic systems can be used in combination.

1. Introduction

After cases of pneumonia of unknown cause were detected in Wuhan, China, in December 2019, a new coronavirus was isolated from human airway epithelial cells and was named severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), which is responsible for coronavirus disease (COVID-19) [1]. SARS-CoV-2 is also a member of the coronavirus family that includes Middle East Respiratory Syndrome- (MERS-) CoV and SARS-CoV, which infect humans [1, 2]. Wild animals are the source of the infection.

According to phylogenetic analysis of full genome sequencing, the coronavirus that causes COVID-19 is a betacoronavirus in the same subgenus clade as SARS-CoV-2. The structure of the receptor binding site for cell entry is similar and uses the angiotensin-converting enzyme 2 receptor found in the epithelial cells of the alveoli used by SARS-CoV-2 [3]. The International Committee on Taxonomy of Viruses has proposed that this virus be designated as SARS-CoV-2 [3, 4].

The main mode of transmission is via person-to-person spread. When an infected person coughs, sneezes, or speaks, the virus released in respiratory secretions can infect another person if it comes into direct contact with the mucous membranes through droplet delivery. Also, infection can occur if a person touches an infected surface and then their eyes, nose, or mouth [5]. Infected but asymptomatic people can transmit the virus to others [6].

The most common serious sign of infection is pneumonia: it is characterized by fever, cough, shortness of breath, and bilateral infiltrates in chest imaging [7–9]. In severe cases, patients can quickly experience acute respiratory syndrome, septic shock, metabolic acidosis, and coagulopathy [10, 11]. The mortality rate is 1-2%, but this rate may increase up to 14%, especially in elderly patients with comorbidities such as hypertension, diabetes mellitus, or cardiovascular diseases [10]. Due to the strong infectivity of SARS-CoV-2, it is necessary to identify, isolate, and treat patients as soon as possible, which can reduce mortality rates while reducing the risk of public contamination. In order to be able to treat patients, it is imperative that the disease is diagnosed quickly and accurately. The diagnosis is based on real-time reverse transcription-polymerase chain reaction (rRT-PCR) positivity for the presence of coronavirus [12]. With nucleic acid isolation processing, rRT-PCR results usually require 5 to 6 hours. In addition, it remains unclear whether rRT-PCR is the gold standard and whether false-positive or false-negative results are common. The Centers for Disease Control and Prevention recommends that nasopharyngeal and oropharyngeal swab specimens should be collected to test for SARS-CoV-2 [13]. Although false-positive tests are generally possible, a positive test for SARS-CoV-2 confirms the diagnosis of COVID-19. False-negative results can be obtained from the upper respiratory samples, so if the first test is negative and the patient continues to suspect COVID-19, it is recommended that the test be repeated [14]. Serological tests, on the other hand, can be accessed and evaluated more easily and can identify patients with existing or previous infections but who have negative rRT-PCR tests [15]. These tests can also be used because they are easier to access in places that do not have access to the rRT-PCR test. The technique of the test is quite simple. It gives results in a short time [16]. Although samples taken from the patient are not evaluated for viral culture, they do have diagnostic value [17].

The other methods that are used in the diagnosis of COVID-19 are imaging methods. The diagnostic sensitivity of viral pneumonia by chest radiography is relatively low [18], whereas computerized tomography (CT) has high sensitivity for diagnosis of COVID-19 which makes it a primary tool for COVID-19 detection in epidemic areas [19]. In COVID-19 patients, the sensitivity of chest CT scan is 97% but its specificity is 25% with rRT-PCR results as reference, which is why it is not used as a primary screening test [19].

Chest CT scan abnormalities have also been identified in patients prior to the development of symptoms and even prior to the detection of viral RNA from upper respiratory specimens [20, 21]. In the article published by Huang et al. in the Lancet, it was stated that it is necessary to have signs of infection and/or a positive nucleic acid test for chest CT scan to be used in diagnosis; otherwise, CT should not be recommended for screening or early diagnosis [22]. They said that CT should not be recommended for screening or early diagnosis. However, when the rRT-PCR results of patients were considered to be clinically and epidemiologically negative for COVID-19, chest CT scan became more valuable than rRT-PCR in the early stage of the disease. Shi et al. showed that combining the evaluation of chest CT scan imaging features with clinical and laboratory findings may facilitate the early diagnosis of COVID-19 pneumonia [20, 23].

Thus far, seven different diagnostic tests have been used for COVID-19: rRT- PCR, cell culture, CoV-19 antigen detection, serological tests (CoV-19 antibody IgM, CoV-19 antibody IgG), chest X-ray, and chest CT. From the onset of the pandemic, real-life experience has shown that rRT-PCR and chest CT are the most preferred methods for the diagnosis of COVID-19. The suitability of SARS-CoV-2 diagnostic tests can be prioritized with the parameters of high sensitivity, high specificity, low false positivity, low false negativity, high usability, low cost, etc. In this study, we used the fuzzy preference ranking organization method for enrichment evaluation (fuzzy PROMETHEE) and fuzzy technique for order of preference by similarity to ideal solution (fuzzy TOPSIS) techniques to compare the confusion regarding the selection of effective diagnostic methods to make a mutual comparison between the aforementioned seven SARS-CoV-2 diagnostic tests and hence determine the best one. We have decided to use fuzzy PROMETHEE because fuzzy part can handle fuzzy data very well, and PROMETHEE part can handle the data when there are too many parameters to be set properly. One other advantage of using PROMETHEE is that it is a user-friendly outranking method and successfully adapted to real-life problems. Fuzzy TOPSIS, on the other hand, is simple, rational, and comprehensive, as well as able to measure relative performance of alternatives.

2. Materials and Methods

Fuzzy PROMETHEE and fuzzy TOPSIS techniques, which are widely used by researchers as MCDM methods, were applied for the evaluation of the SARS-CoV-2 diagnostic tests in order to provide the best alternatives. The fuzzy PROMETHEE technique is a hybrid model that provides decision analysis for nonnumerical data and also enables decision-makers to define vague conditions mathematically [24]. The PROMETHEE technique was developed by Brans et al. [25, 26], and it is aimed at giving a comprehensive ranking for a finite set of alternatives corresponding to their criteria and the importance level of each criterion. By providing various preference functions, including V-shaped function, level function, Gaussian function, U-shaped function, and linear function, to the criteria for the comparison of the alternatives, the PROMETHEE technique differs from the other MCDM methods and can provide more sensitive results. The PROMETHEE and TOPSIS methods are unable to analyze fuzzy data (linguistic or vague data) in the actual decision-making environment. Thus, we have applied the fuzzy-based PROMETHEE and TOPSIS techniques, which are the hybrid methods that use a fuzzy scale. The fuzzy scale supports the decision-maker in decision analysis if the data is within a range, vague, or qualitative.

In this study, a linguistic fuzzy scale has been used to define the parameters of the SARS-CoV-2 diagnostic tests. These values were converted to triangular fuzzy numbers, and then the Yager index was applied for defuzzification of the data. Then, the PROMETHEE decision lab program with a Gaussian preference function was applied for the determination of the net ranking result.

The PROMETHEE method comprises 5 steps that are applied for the MCDM analysis and to rank the alternatives as follows [25–28]:

(i)The preference function of each criterion should be defined(ii)Importance weights of each criterion , where should be defined as

where is the number of criteria.(iii)For each of the alternative pairs , , the outranking relation should be determined by

where denotes the value of the th criterion of the alternative and denotes the preference indices, which show the preference intensity for an alternative in comparison to an alternative while counting all criteria simultaneously.(iv)The positive outranking flow and negative outranking flow should be determined as follows:

(a)A positive outranking flow of the alternative :

(b)A negative outranking flow of the alternative :

denotes the number of alternatives. The defines the strength of alternative , while the negative outranking flow defines the weakness of alternative .

PROMETHEE I determines a partial preorder of the alternatives based on the positive and negative outranking flows, and PROMETHEE II determines a complete preorder of the alternatives based on a net flow. The partial preorder of the options can be determined based on the following statements:

Via PROMETHEE I, alternative is selected to alternative if it satisfies either of the statements given below as

is indifferent to alternative if

And is incomparable to if

The net outranking flow can be calculated for each alternative by using the following:

Via PROMETHEE II, the complete order with net flow can be determined as

The higher value provides the better alternative.

In this study, triangular fuzzy scale was used for defining the linguistic data of the criteria of SARS-CoV-2 diagnostic tests as shown in Table 1. Zadeh [29] has defined the fuzzy sets in order to define the linguistic or vague data mathematically based on the membership degree. Triangular fuzzy sets can be represented with 3 specific points (, , and ) where is the initial point (left bound), is the peak point of the triangle which contain the maximum membership degree, and is the right bound of the triangle. The linguistic fuzzy scale indicates the linguistic terms of very high, high, medium, and low with their associated fuzzy sets. Furthermore, the importance level of each has been defined with the triangular fuzzy scale by the experts for analyzing the effectiveness criteria of SARS-CoV-2 diagnostic tests. The criteria selected for the analysis include cost, accessibility, sensitivity, and specificity.

Table 1: Linguistic fuzzy scale.

Linguistic scale for evaluation
Triangular fuzzy scale
Importance ratings of criteria

VH
(0.75, 1, 1)
No symptom-window period, early stage of infection, active phase of infection, late of recurrent stage of infection, cost, accessibility, false positivity, false negativity

H
(0.50, 0.75, 1)
Sensitivity, specificity

M
(0.25, 0.50, 0.75)
Past infection, usability, equipment, education

L
(0, 0.25, 0.50)
Recovery stage of infection

VL
(0, 0, 0.25)

VH: very high; H: high; M: medium; L: low; VL: very low.

For the validation of the fuzzy-based PROMETHEE output, fuzzy TOPSIS, a different type of MCDM technique, has been used for the same dataset. TOPSIS method was first proposed by Yoon and Hwang [30] and commonly applied for the decision-making problems of the conflicting criteria [31, 32] in wide disciplines. It compares a set of alternatives by identifying weights for each criterion, normalizing scores for each criterion and calculating the geometric distance between each alternative and the ideal alternative, which is the best score in each criterion. It based on the concept that the chosen alternative should have the shortest geometric distance from the positive ideal solution (PIS) and the longest geometric distance from the negative ideal solution (NIS).

There are 6 steps of the TOPSIS method to be applied for the MCDM analysis and rank the alternatives as follows [31].

(1)The decision matrix which includes the parameters (criteria) of the alternatives and the importance weight of the criteria, , should be defined as

where is the number of criteria.(2)The normalized decision matrix should be calculated by one of the equations below:

where is the value of the th alternative and th criterion.(3)The values of the weighted normalized matrix should be calculated by applying the following:

(4)And positive ideal solution and negative ideal solution should be determined by using Equation (13) and Equation (14), respectively

where and are associated with benefit criteria and cost criteria, for     Positive ideal solution is the set of the values that maximizes the benefit criteria while minimizing the cost criteria. Negative ideal solution can be considered an opposite of the positive ideal solution. In the negative ideal solution, the benefit criterion is minimized while the cost criterion is maximized. According to the TOPSIS method, the most suitable option is the one which is closer to the positive ideal solution and further to the negative ideal solution [33].(5)Then, the separation measures between alternatives and the positive ideal solution should be calculated by using Equation (15) and the separation measures between alternatives and the negative ideal solution should be calculated by using Equation (16) in order to obtain the distance between the th alternative and the positive ideal solution and the distance between the th alternative and the negative ideal solution as shown below:

where .(6)Then, the relative closeness to the positive ideal solution should be calculated for every alternative by using Equation (17) as seen below:

where , .

Positive and negative ideal solution sets of the SARS-CoV-2 diagnostic tests have been obtained as shown in Table 2 below.

Table 2: Positive and negative ideal solution sets.

Criteria
Positive ideal solution
Negative ideal solution

No symptom-window period
0.473
0.158

Early stage of infection
0.473
0.158

Active phase of infection
0.473
0.158

Late of recurrent stage of infection
0.473
0.158

Past infection
0.257
0.086

Recovery stage of infection
0.129
0.043

Cost
0.086
0.257

Accessibility
0.473
0.158

Usability
0.257
0.086

Equipment
0.257
0.086

Education
0.257
0.086

Sensitivity
0.386
0.129

Specificity
0.386
0.129

False positivity
0.158
0.473

False negativity
0.158
0.473

In TOPSIS technique, relative closeness to the positive ideal solution determines the ranking results of the alternatives. The higher is a more preferred option. The weighted normalized dataset of the SARS-CoV-2 diagnostic tests can be seen in Table 3.

Table 3: Weighted normalized data of the SARS-CoV-2 diagnostic tests.

Criteria
Importance weight
Max/Min
Naso/oropharyngeal swab PCR
Cell culture
CoV-19 antigen detection
CoV-19 antibody IgM
CoV-19 antibody IgG
Chest X-ray
Chest CT

No symptom-window period
VH
Max
0.47
0.47
0.47
0.16
0.16
0.16
0.32

Early stage
VH
Max
0.47
0.47
0.47
0.47
0.16
0.16
0.47

Active phase
VH
Max
0.47
0.47
0.47
0.47
0.47
0.16
0.47

Recurrent stage
VH
Max
0.16
0.16
0.16
0.16
0.47
0.32
0.47

Past infection
M
Max
0.09
0.09
0.09
0.09
0.26
0.17
0.26

Recovery stage
L
Max
0.04
0.04
0.04
0.09
0.13
0.04
0.13

Cost
M
Min
0.09
0.09
0.26
0.09
0.09
0.09
0.09

Accessibility
VH
Max
0.47
0.16
0.16
0.47
0.47
0.47
0.47

Usability
M
Max
0.26
0.09
0.26
0.26
0.26
0.26
0.26

Equipment
M
Max
0.17
0.09
0.26
0.09
0.09
0.09
0.26

Education
M
Max
0.17
0.09
0.09
0.26
0.26
0.17
0.26

Sensitivity
H
Max
0.13
0.39
0.13
0.13
0.13
0.26
0.39

Specificity
H
Max
0.39
0.39
0.13
0.26
0.26
0.26
0.39

False positivity
VH
Min
0.16
0.16
0.47
0.47
0.47
0.47
0.47

False negativity
VH
Min
0.47
0.16
0.47
0.47
0.47
0.47
0.47

VH: very high; H: high; M: medium; L: low.

3. Results and Discussion

Table 4 indicates the results of the complete ranking for the SARS-CoV-2 diagnostic tests, where each alternative pair is compared numerically based on each criterion and their importance weights. The power of each alternative can be thought numerically as the positive outranking flow, while the weakness of the alternatives can be thought as the negative outranking flow. However, the net flow gives the net ranking results. The most effective alternative is the one with the higher net flow. With the maximum positive outranking flow and minimum negative outranking flow, the chest CT is the best available SARS-CoV-2 diagnostic test, followed by naso/oropharyngeal swab rRT-PCR. Even if naso/oropharyngeal swab rRT-PCR has a lower positive flow than cell culture, it also has lower negative flow than the cell culture. Therefore, the second-best option is naso/oropharyngeal swab rRT-PCR with 0.0258 net flow, and the third one is the cell culture with the 0.0098 net flow. The last two options are CoV-19 antigen detection and chest X-ray as seen in Table 4.

Table 4: Complete ranking of SARS-CoV-2 diagnostic tests with fuzzy PROMETHEE.

Complete ranking
Diagnostic tests
Positive outranking flow ()
Negative outranking flow ()
Net flow ()

1
Chest CT
0.0666
0.0109
0.0557

2
Naso/oropharyngeal swab PCR
0.0478
0.0220
0.0258

3
Cell culture
0.0635
0.0537
0.0098

4
CoV-19 antibody IgG
0.0384
0.0429
-0.0045

5
CoV-19 antibody IgM
0.0228
0.0391
-0.0163

6
CoV-19 antigen detection
0.0277
0.0543
-0.0267

7
Chest X-ray
0.0176
0.0615
-0.0439

The strength and the weakness of the available SARS-CoV-2 diagnostic tests are shown in Figure 1. The criteria for each SARS-CoV-2 diagnostic tests are listed above or below the zero-threshold level based on their effect on the performance of the alternatives. If the criteria are in advantage of the technique, they are listed above, and if the criteria are in disadvantage of the technique, they are listed below the zero-threshold level. As represented, the most preferred technique is the chest CT, with almost all the criteria listed above the threshold level, while the last effective technique for the SARS-CoV-2 diagnosis is the chest X-ray, with most of the criteria listed above the threshold level. These results can be useful for hospitals, doctors, governments, and patients or anyone involved in the decision-making processes of the SARS-CoV-2 diagnosis.

Figure 1: Positive and negative aspects of each technique obtained by fuzzy PROMETHEE.

The SARS-CoV-2 diagnostic tests ranking results obtained with fuzzy TOPSIS have been presented in Table 5. With the 0.6403 value of the closeness to the ideal solution , chest CT is the best alternative, naso/oropharyngeal swab rRT-PCR is the second best alternative with 0.5865 , and the cell culture with 0.5718 is the third best option between the alternatives. The CoV-19 antigen detection and chest X-ray were found as the least effective options.

Table 5: The relative closeness to positive ideal solution with the ranking of the SARS-CoV-2 diagnostic tests.

Ranking
Alternatives

1
Chest CT
0.6403

2
Naso/oropharyngeal swab PCR
0.5865

3
Cell culture
0.5718

4
CoV-19 antibody IgG
0.4815

5
CoV-19 antibody IgM
0.4638

6
CoV-19 antigen detection
0.4460

7
Chest X-ray
0.3815

These results are consistently similar with the fuzzy-based PROMETHEE outputs. Hence, the results from both techniques could give evidence to the decision-makers about the effectiveness of the available SARS-CoV-2 diagnostic tests.

According to the findings of a study conducted with more than 1,000 patients by Ai et al. [19], CT should be the primary diagnosis tool used to screen for COVID-19. However, their finding of 97% sensitivity for the chest CT was based on positive rRT-PCR test results. Chest CT scan for COVID-19 diagnosis can be a good complement to rRT-PCR [34]. According to the study of Fang et al. [34], the sensitivity of CT for COVID-19 was higher compared to rRT-PCR (98% vs. 71%, respectively). Similarly, we also showed mathematically that CT should be the first preferred diagnostic test. Furthermore, differentiating COVID-19 from non-COVID-19 pneumonia on chest CT, which is a relatively harder task, was studied in [35], and the authors reported that the findings of CT are considered nonspecific despite its high sensitivity. In addition, one of the greatest issues faced is the need for an expert radiologist to interpret the radiography images. This procedure is even more difficult when attempting to differentiate COVID-19 from other types of pneumonia since the visual indicators can be subtle [35].

Therefore, the main limitation of our study is the lack of analysis of the combination of different diagnostic tests. Hence, in future studies, once the available techniques for diagnosing COVID-19 are more robust, we will apply the MCDM methods to the combination of different diagnostic tests. In addition, it is sensible to apply the MCDM methods for specific countries, regions, or even hospitals considering specific conditions such as their available diagnostic toolkits, scanners, and experts.

4. Conclusions

This study analyzed the seven selected available COVID-19 diagnostic tests using the fuzzy-based MCDM methods. The evaluations of the effectiveness of the alternatives were made based on the selected criteria, and their corresponding weights were determined by the experts. As a result of the evaluation, chest CT was found to be the most effective diagnostic test. Moreover, the results indicated that the top three most effective COVID-19 diagnostic tests are chest CT, rRT-PCR, and cell culture. On the other hand, chest X-ray is the last effective diagnostic test. It is interesting to note that the methods that are always used in the diagnosis of viral diseases were ranked second for the diagnosis of COVID-19.

In this study, during the process of evaluating the effectiveness of the given COVID-19 diagnostic tests, each technique was considered and compared based on their general properties collected from the latest available guidelines. The use of fuzzy-based MCDM methods can be also adapted based on the patient’s specific condition.

Data Availability

The data used to support the findings of this study are included within the article.

Conflicts of Interest

The authors declare that there is no conflict of interest regarding the publication of this paper.

References

Coronaviridae Study Group of the International Committee on Taxonomy of Viruses, “The species severe acute respiratory syndrome-related coronavirus: classifying 2019-nCoV and naming it SARS-CoV-2,” Nature Microbiology, vol. 5, no. 4, pp. 536–544, 2020.

N. Zhu, D. Zhang, W. Wang et al., “A novel coronavirus from patients with pneumonia in China, 2019,” The New England Journal of Medicine, vol. 382, no. 8, pp. 727–733, 2020.

F. A. Rabi, M. S. Al Zoubi, G. A. Kasasbeh, D. M. Salameh, and A. D. Al-Nasser, “SARS-CoV-2 and coronavirus disease 2019: what we know so far,” Pathogens, vol. 9, no. 3, p. 231, 2020.

A. E. Gorbalenya, S. C. Baker, R. S. Baric et al., Severe acute respiratory syndrome-related coronavirus: the species and its viruses – a statement of the Coronavirus Study Group, bioRxiv, 2020.

World Health Organization, Novel coronavirus situation reports -2, 2020, March 2020, https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200122-sitrep-2-2019-ncov.pdf.

D. Chang, M. Lin, L. Wei et al., “Epidemiologic and clinical characteristics of novel coronavirus infections involving 13 patients outside Wuhan, China,” JAMA, vol. 323, no. 11, article 1092, 2020.

W. J. Guan, Z. Y. Ni, Y. Hu et al., “Clinical characteristics of coronavirus disease 2019 in China,” New England Journal of Medicine, vol. 382, no. 18, pp. 1708–1720, 2020.

C. Huang, Y. Wang, X. Li et al., “Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China,” The Lancet, vol. 395, no. 10223, pp. 497–506, 2020.

N. Chen, M. Zhou, X. Dong et al., “Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive study,” The Lancet, vol. 395, no. 10223, pp. 507–513, 2020.

Y. Yi, P. N. P. Lagniton, S. Ye, E. Li, and R. H. Xu, “COVID-19: what has been learned and to be learned about the novel coronavirus disease,” International Journal of Biological Sciences, vol. 16, no. 10, pp. 1753–1766, 2020.

L. L. Ren, Y. M. Wang, Z. Q. Wu et al., “Identification of a novel coronavirus causing severe pneumonia in human: a descriptive study,” Chinese Medical Journal, vol. 133, no. 9, pp. 1015–1024, 2020.

V. M. Corman, O. Landt, M. Kaiser et al., “Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR,” Eurosurveillance, vol. 25, no. 3, 2020.

A. Patel, D. B. Jernigan, 2019-nCoV CDC Response Team et al., “Initial Public Health Response and Interim Clinical Guidance for the 2019 Novel Coronavirus Outbreak — United States, December 31, 2019–February 4, 2020,” Morbidity and Mortality Weekly Report, vol. 69, no. 5, pp. 140–146, 2020.

World Health Organization, “Coronavirus disease (COVID-19) technical guidance: surveillance and case definitions,” March 2020, https://www.who.int/emergencies/diseases/novel-coronavirus-2019/technical-guidance/surveillance-and-case-definitions.

L. Guo, L. Ren, S. Yang et al., “Profiling early humoral response to diagnose novel coronavirus disease (COVID-19),” Clinical Infectious Diseases, 2020.

I. Cassaniti, F. Novazzi, F. Giardina et al., “Performance of VivaDiag COVID-19 IgM/IgG rapid test is inadequate for diagnosis of COVID-19 in acute patients referring to emergency room department,” Journal of Medical Virology, 2020.

W. B. Park, N. J. Kwon, S. J. Choi et al., “Virus isolation from the first patient with SARS-CoV-2 in Korea,” Journal of Korean Medical Science, vol. 35, no. 7, article e84, 2020.

T. Franquet, “Imaging of pulmonary viral pneumonia,” Radiology, vol. 260, no. 1, pp. 18–39, 2011.

T. Ai, Z. Yang, H. Hou et al., “Correlation of chest CT and RT-PCR testing in coronavirus disease 2019 (COVID-19) in China: a report of 1014 cases,” Radiology, 2020.

H. Shi, X. Han, N. Jiang et al., “Radiological findings from 81 patients with COVID-19 pneumonia in Wuhan, China: a descriptive study,” The Lancet Infectious Diseases, vol. 20, no. 4, pp. 425–434, 2020.

X. Xie, Z. Zhong, W. Zhao, C. Zheng, F. Wang, and J. Liu, “Chest CT for typical 2019-nCoV pneumonia: relationship to negative RT-PCR testing,” Radiology, 2020.

Y. Huang, W. Cheng, N. Zhao, H. Qu, and J. Tian, “CT screening for early diagnosis of SARS-CoV-2 infection,” The Lancet Infectious Diseases, 2020.

C. Long, H. Xu, Q. Shen et al., “Diagnosis of the coronavirus disease (COVID-19): rRT-PCR or CT?” European Journal of Radiology, vol. 126, article 108961, 2020.

D. Uzun Ozsahin and I. Ozsahin, “A fuzzy PROMETHEE approach for breast Cancer treatment techniques,” International Journal of Medical Research & Health Sciences, vol. 7, no. 5, pp. 29–32, 2018.

J. P. Brans, B. Mareschal, and P. Vincke, “PROMETHEE: a new family of outranking methods in MCDM,” Oper Res IFORS 84, pp. 477–490, 1984.

J. P. Brans and P. Vincke, “Note—a preference ranking organisation method,” Management Science, vol. 31, no. 6, pp. 647–656, 1985.

J. P. Brans, P. Vincke, and B. Mareschal, “How to select and how to rank projects: the PROMETHEE method,” European Journal of Operational Research, vol. 24, no. 2, pp. 228–238, 1986.

J. Geldermann, T. Spengler, and O. Rentz, “Fuzzy outranking for environmental assessment. Case study: iron and steel making industry,” Fuzzy Sets and Systems, vol. 115, no. 1, pp. 45–65, 2000.

L. A. Zadeh, “Fuzzy sets,” Information and Control, vol. 8, no. 3, pp. 338–353, 1965.

C. L. Yoon and K. Hwang, Multiple Attribute Decision Making: Methods and Applications, Springer-Verlag, New York, NY, USA, 1981.

J. Huang, “Combining entropy weight and TOPSIS method for information system selection,” in 2008 IEEE International Conference on Automation and Logistics, pp. 1281–1284, Qingdao, China, September 2008.

F. Ye and Y. Li, “An extended TOPSIS model based on the possibility theory under fuzzy environment,” Knowledge-Based Systems., vol. 67, pp. 263–269, 2014.

C.-R. Wu, C. T. Lin, and P. H. Tsai, “Financial service of wealth management banking: balanced scorecard approach,” Journal of Social Sciences, vol. 4, no. 4, pp. 255–263, 2008.

Y. Fang, H. Zhang, J. Xie et al., “Sensitivity of chest CT for COVID-19: comparison to RT-PCR,” Radiology, 2020.

H. X. Bai, B. Hsieh, Z. Xiong et al., “Performance of radiologists in differentiating COVID-19 from viral pneumonia on chest CT,” Radiology, 2020.