A Model for Sorting Activities to Be Outsourced in Civil Construction Based on ROR-UTADIS

The subcontractor’s selection problem is currently treated as a supply chain problem with a prequalification procedure to balance the main objectives of the client: cost, quality, and time. Unfortunately, most of the selection processes are analysed under the same methodology without considering that variations in project, type of activity, and other attributes should affect the chosen method. To provide a novel form of treating subcontractor’s selection, we proposed an additive sorting method to categorize activities to be outsourced in civil construction based on ROR-UTADIS method, which is a modification of the UTADIS method that includes new forms of supplying preference information. It was applied in the construction of a brewery in Brazil. It was perceived that the method is applicable and intuitive for decision makers, even though there are quite a few points to be taken, analysed to avoid misclassification.


Introduction
The choice of contractors and subcontractors is problematic studied by several authors over the years due to the clients' difficulty to achieve the best value for invested money since the construction industry has several construction companies with different credibility, sizes, and quality.Reference [1] made a literature review on contractor selection practice in the United Kingdom and realized that the main criteria evaluated by the clients are time, cost, and quality, which vary in priority relation for each client through a trade-off process.The main problem is that some of these criteria are usually subjective and probabilistic, driving the process to a multicriteria decision analysis (MCDA) approach.Therefore, the client plays the role of the decision maker (DM) and needs to analyse his final objectives to have his criteria weighted and reach the best decision.
To solve the contractor selection problem [2] proposed some prequalification criteria, such as contractors' organization, financial considerations, management resources, past experience, and past performance, which are analysed using Multiattribute Analysis.Later the selection is made based on tenderer evaluation by applying Multiattribute Utility Theory (MAUT) [3] in more specific criteria.These criteria were built hierarchically, and each of them had subcriteria to achieve the analysis.Sönmez et al. [4] also advocated for the prequalification of contractors along with evidential reasoning to solve the multicriteria decision-making (MCDM) problem of selection when there are uncertainty and imprecision in the decision process.Lam et al. [5] also proposed a prequalification of contractors for selection based on Support Vector Machine to classify the companies into two classes based on agreed criteria.If the client decides to apply a prequalification analysis, he still needs to carry out a proper selection, which can be driven in the same way of supplier selection's methodologies.In literature, one can find several methodologies.
There are models in which one can find the combination of TOPSIS with other tools, such as fuzzy decision-making approach, [6] proposed a model to calculate the fuzzy positive solutions and fuzzy negative solutions simultaneously, and [7] proposed a framework for supplier selection that includes linear programming.Also, [8] combines FAHP with FTOPSIS, [9] combined a fuzzy DEMANTEL model to 2 Mathematical Problems in Engineering evaluate the criteria for cause or effect, and [10] used the tools to propose a group decision model.Finally, [11] evaluated green suppliers by using linguistic preferences, [12] used hierarchical fuzzy TOPSIS, and [13] built a model to select green suppliers in Brazil.There are models that combine Minkowski distance and grey number operations [14] and interval data [15].
Models based on FAHP can also be found, such that a Fuzzy hierarchical TOPSIS model is proposed with parametric considerations to avoid violations of the TOPSIS method [16].Still on this consideration, [17] proposed a model to incorporate the method considerations of benefits, opportunities, costs, and risks, [18] combines FAHP with MAUT, [19] applies the FAHP to assess contractor selection criteria in the group environment, and [20] extended the method to  numbers.Still on fuzzy sets, it can be found along with goal programming for a single DM [21] and to group decision [22] or with ELECTRE III for group decision [23] or green supplier selection [24].
There are combinations of ELECTRE with fuzzy approach [25] and Atanassov interval-valued intuitionistic fuzzy sets [26].There is analysis combining multiattribute decisionmaking with intuitionistic fuzzy sets [27].One can also find in literature models combining MAUT with linear programming (LP) for group decision-making [28], models to aggregate crisp values into interval-valued intuitionistic fuzzy sets for group decision-making [29], or the development of new fuzzy aggregation operators for intuitionistic fuzzy in the supplier selection context [30].In the context of supplier selection, one can find an approach with fuzzy inhomogeneous multiattribute for group decision-making [31] and the combination of VIKOR method with fuzzy sets for group decision-making and applying linear programming for choosing the best supplier [32].Reference [33] proposed a group decision-making method based on entropy measure with VIKOR method and [34] proposed a compromise solution method for group decision considering both conflicting qualitative and quantitative criteria.Reference [35] proposed an integration of evaluation of criteria under MAUT, but with the use of the ELECTRE method to avoid the rigid axioms of the prior method.
The propositions found in literature are either to prequalify the subcontractors or to select them, but none of them considered that, during the whole cycle of the project, several selections will occur and they may involve different sums of money, risks, qualities, and necessities.If all selections are analysed through the same procedure, it is likely to adopt a methodology that could be either too strict or too loose.Gonc ¸alo and Alencar [36] presented a model in which they apply PROMSORT to sort the activities and materials to be hired or bought into classes, by analysing its strategic impact on the company's goals.Similar to this last article, we propose to apply a sorting procedure, but our goal is to allow the DM to apply different methodologies to subcontractors' selection that will be more appropriate to each class of assignment, since all activities will be hired at some stage of the project.Thus, we propose a model to categorize the activities based on ROR-UTADIS [37] and allow the DM to apply different subcontractors' selection methodologies.
The sorting procedures can be either case-based or elicited.ROR-UTADIS is one of the case-based methods.These methods can consider an underlying additive function, as is the case of UTADIS [38,39] and its modifications or decision rules to classify the alternatives, as is the case of Dominance-Based Rough Sets Approach (DBSA) [40].The original Rough Sets Theory could not consider DM's preference information; it was based on "if. ..then. .." rules, that the DM could build, applying them to actions/objects to obtain preference relations.One could achieve a recommendation through the exploitation of these relations.The original rough sets approach required the binary relations defined on it to have some properties, such as being reflexive, transitive, and symmetric, making it difficult to apply to obtain preference information of a DM, but the DBSA relaxed the properties requiring them to be reflexive and transitive.It was also proved that Sugeno Integral cannot be used in DBSA because it requires the set to be single-graded and the sorting problem using DBSA needs more than one grade on the evaluation scale [40].The DBSA is not directly used in any of the additive sorting methods, but the lower and upper thresholds approximations used for classification in this method resemble the necessary and possible assignments found in the case-based methods with underlying additive function UTADIS GMS [41] and ROR-UTADIS [37].Then, this study uses ROR-UTADIS to make the classification of civil construction (CC) activities in different categories of analysis.
This paper is structured into six sections; in the next section, we introduce the current scenario of additive sorting methods, explaining their developments and drawbacks.In Section 3 we present a brief review of the methodology applied in this paper.Section 4 is devoted to explaining the proposed model and its importance to the civil construction (CC).Section 5 presents the selected context of the application and the information required to run the analysis, as well as the results.In Section 6 we discuss the results presented in the previous section.Finally, in Section 7 we conclude with final remarks.

Additive Sorting Methods
Sorting is problematic, where the DM needs to assign alternatives to predefined classes, which are defined in an ordinal way; classification, on the other hand, is problematic to assign alternatives to predefined nominal classes, that is, nonordered classes.Then, in this study, we propose an application of a sorting method.The researchers in this area show that these methods are important to solve real-world problems, such as performing medical diagnosis through classification of patients into disease groups, assigning personnel to appropriate occupation groups based on their qualifications, credit risk assessment, failure prediction, and so forth.The development of MCDA techniques started with discriminant analysis and recently is based on operations research and artificial intelligence techniques [42].Sorting models for group decision-making have been also developed [43].
In [42] there is a description of the two aspects that involves sorting methodology: the form of criteria aggregation and the method applied to define preferential information.Regarding aggregation, one can find three types: outranking, as in ELECTRE TRI; the utility function, as in UTADIS ( [38,39]); and the simple discriminant functions, which differ from the MAUT methodology because it cannot be considered a preference model.One can elicit preference information directly or indirectly.
An example of direct elicitation is the methodology proposed by [44].The method consists of defining classes that are not ordered and their criteria.The classification is dichotomous and built through the application of SMARTS method.The name of the method is Multiple Criteria Classification (MCC), once the classes may consider different criteria for its classification.It provides four types of classification: (a) alternatives do not override each other and are all classified; (b) one or more alternatives override each other and are all classified; (c) alternatives do not override each other, and the classification is incomplete, and (d) alternatives override each other and the classification is incomplete.
Case-based sorting methods are indirect forms of definition of preference information that require the presentation of a set of hypothetical or real cases, and the DM is supposed to assign each of them to one predefined class, with such information possible to calibrate the parameters to reflect the DM's preferences.Examples of case-based sorting methods are UTADIS and its variations, DBSA and casebased distance model.The drawback of this approach is that only a few judgments produce the DM's preference and therefore can be consistent with several sets of parameters.To calculate errors and minimize misclassification most of those methods apply linear programing to calculate holistically the parameters.The authors in [45] state that there are three possible outcomes in the solution of this error identification: (i) The minimization problem has a unique solution with value larger than zero, showing inconsistencies in the preference information.
(ii) The solution is unique and equal to zero; thus there is only one possible solution.
(iii) There are several solutions equal to zero, showing that there are several profiles compatible with the information provided by the DM.
Chen et al. [46] present a proposal of a case-based distance model to solve sorting problematic.It was designed based on an ABC analysis of stock-keeping units in an enterprise.Instead of analysing it based only on annual dollar usage, other criteria were included.It uses Euclidean distances to do the calculations, once the DM can easily understand it.At the beginning of the process, the DM has to define if the criteria increase in preference or decrease and the variability of each criterion, with the information of each alternative on each criterion, is possible to formulate the problem that will be solved using linear programming.
The UTADIS method is a sorting and interactive method, in which the global utility model or additive utility function and class thresholds are calculated through linear programming.Thus, as a result, all parameters of the DM's preference information are calculated, such as the difference between the marginal utilities of two successive values of subintervals and the threshold to ensure the classification and the errors of misclassification.Furthermore, [47] built software known as PREFDIS (PREFerence DIScrimination).It incorporates the original UTADIS method and its variations: UTADIS I, to incorporate distances of correctly classified alternatives from the utility thresholds; UTADIS II, based on mixed integer programming formulation to minimize misclassifications; and UTADIS III that combines the two other variants.The system allows the DM to model nonmonotone preference and includes a postoptimality phase to verify other optimal and suboptimal solutions.Authors of [48] carried out an extensive experimental investigation on UTADIS to shed light on some critical issues regarding the stability of the sorting model developed through preference disaggregation analysis.To correct these problems, they proposed a heuristic (HEUR2), which was tested using Monte Carlo simulation and subjected to an ANOVA.
Köksalan and Özpeynirci [49] presented a modification on UTADIS to diminish the misclassification problems that occurs even when considerable information is available.This methodology does not try to estimate the parameters of an additive utility function.Instead, they impose some restrictions in the linear programming to show if a selected alternative may be assigned to a class.It assumes an additive utility function and takes into account the restrictions created by the DM's assignments to try to place alternatives into categories.
Cai et al. [50] proposed other modification called PUTADIS.It is a progressive approach to assigning alternatives to ordered categories, considering two types of imprecise information and allowing the DM to provide preference information in an interactive form.The global utility function of the DM is built and updated using a heuristic algorithm and later a mixed integer linear programming model is applied in order to identify inconsistencies on preference information.If there is any inconsistency, it is presented to the DM in order to review his assignments.When it is consistent, then three mixed integer linear programs provide the fittest category and a range of possible categories.
Greco et al. [41] modified UTADIS into UTADIS GMS bringing to the original method two kinds of assignment to classes: the necessary and the possible assignment.These assignments are computed through linear programming and are based on reference examples.The necessary assignments are the ones that for sure belong to the assigned class and the possible ones are those that could be assigned to two or more classes.The proposition allows the DM to provide imprecise assignment examples (interval assignments) considering the confidence levels of information; in such a case the method expresses the results as ranges of classes that correspond to different confidence levels.It allows the use of nondecreasing marginal value functions, instead of piecewise linear marginal value functions, and when the set of assignments is inconsistent, then the DM is required to analyse more reference alternatives.Reference [51] extended the methods UTA GMS and UTADIS GMS to group decision, calling them UTA GMS -GROUP and UTADIS GMS -GROUP, respectively.The concepts of necessary and possible assignments are extended to the DMs and the space investigated is the consensus and disagreement among DMs.
Greco et al. [52] extended UTADIS GMS introducing the concept of the representative value function in robust ordinal regression with the aim of considering complete sets of instances of a preference model compatible with the information provided by the DM; it means that the representativeness of a selected value function is understood in the sense of robustness preoccupation.This method was also extended to group decision in [53] with the same considerations of the method proposed by [50], but considering the representative value function in robust ordinal regression.
Kadziński and Tervonen [54] presented a new approach for multiple criteria sorting problems considering a set of preference model instances compatible with the disaggregation of preferences.The analysis was made using PREFDIS [47], and the possible and necessary assignments were made using robust ordinal regression (ROR).The analysis was enriched with class acceptability indices adapted from Stochastic Multicriteria Acceptability Analysis (SMAA), to analyse the alternatives that were classified as possible, to decide to which class it should be assigned.The ROR approach is the notion of assignment-based weak preference relations and, analogously to the assignments, new necessary and possible assignment-based relations were established, as well as an estimative of assignment based on pairwise outranking indices.Later on the ROR-UTADIS model presented in [37] introduced an assignment-based pairwise comparison to the disaggregation process in which the information provided by the DM comes in the form of imprecise statements referring to the desired assignments for pairs of alternatives, but without assigning the reference alternatives to any concrete class.
Since the ROR-UTADIS method is a holistic additive method that allows the DM to provide more imprecise information, it was selected for this application.It is important for the method to be additive because the DM treats the problem in a compensatory rationality.This method also allows the DM to provide imprecise information when he is not confident about his preference information.Finally, we believe that the extra preference information will decrease number of preference profiles, requiring fewer iterations to reach a recommendation.

Review on ROR-UTADIS
Kadziński et al. [37] developed a method called ROR-UTADIS, which holistically calculates all parameters using disaggregation of preferences.The objective is to calculate value functions that are compatible with the reference alternatives.The information provided is incomplete, indirect, and imprecise, guaranteeing, thus, the interactivity and flexibility of the procedure.The information provided may be in the form of assignment examples, assignment-based pairwise comparisons, or desired class cardinalities.The first two options are related to the reference alternatives, and the last is related to the whole set of alternatives.The following mathematical models were built to reproduce preference of the DMs, which can specify information for all types of preference information or provide only the pieces of information he feels comfortable with.
The notation used is as follows.
(i)  = { The preferences of the DMs are presented using an additive value function: The basic sets of constraints are constructed to guarantee the marginal value functions   and they are monotone, nondecreasing and occur in the interval [0, 1].There are two sets of constraints: one for the threshold-based procedure (TH) and another to the example-based procedure (EX).This paper only presents the threshold-based procedure equations, except for the base equations, once this was the selected procedure.Consider Due to the limitations on holistic judgment caused by general monotonic marginal value functions, they should be substituted for piecewise linear functions.Thus for each   = 1, . . ., , a number of characteristic points (  ) have to be defined; to divide the intervals [ , * ;  to adapt to the piecewise linear equations, the set of constraints is as follows: The representation of the preference of the DM regarding the threshold-based procedure is through a vector (, ), where  represents the utility and  the threshold vector  = { 1 , . . .,  −1 } that separates the  ordered classes, defined in such a way that  ℎ−1 and  ℎ are the lower and upper threshold of class  ℎ .The basic set of constraints under this configuration is The threshold-based sorting model is defined by (, t) ∈ (, t)  and  →  ℎ if and only if In the assignment examples the reference alternatives ( * ∈   ⊆ ) are assigned to a range of classes; hence, the desired assignment is where [  DM ( * ) ,   DM ( * ) ] is an interval of contiguous classes; if  DM ( * ) =  DM ( * ) = ℎ for some ℎ ∈ , then the assignment is said to be precise and imprecise otherwise: To guarantee that the assignment example  * , which is assigned by the DM to a class range [  DM ( * ) ,   DM ( * ) ], is neither worse than the lower threshold of class   DM ( * ) nor worse than the upper threshold of class   DM ( * ) , the problem is submitted to constraints (7) as follows: * : for ℎ = 1, . . .,  − : for ℎ = 0, . . .,  −  − 1: It is also possible for the DM to impose requirements concerning class cardinalities, which is common in realworld sorting problems, such as classification of journals or graduation courses.As a solution, one may include the following constraints, requiring that  ℎ has at least  min ℎ,DM and at most  max ℎ,DM alternatives, with  min ℎ,DM ≤  max ℎ,DM : The DM can use constraint [] or [] to model the class cardinality of class  ℎ and the information can be either some alternatives or a frequency.Also, it is necessary also to apply the set of constraints   TH : To verify if the set of preference model instances (pairs ((, )  or the value functions   )) compatible with the information provided by the DM is not empty, the following problem is considered: where The problem is solved applying mixed integer linear programming and if the solution is not empty, then  SORT is feasible and  * > 0, where  * is the solution of the former equation.If this occurs, it means that the pieces of preference information could be reproduced; if it cannot happen, then the assumed preference model needs to be reviewed.To apply corrections in the model a binary variable should be added in each piece of preference information, especially the ones where the DM could not provide confident information.
Since the model works with a recommendation rather than a solution and the compatible recommendations depend on which piece of preference information is selected, it is important to submit the information to robustness and sensitivity analysis.Thus, the DMs are obliged to confront their value systems, providing insights into the process.
The sets of possible assignments are the ones in which at least one compatible model instance exists that assigns alternative  to class  ℎ and the necessary assignments are the ones where all model instances assign alternative  to class  ℎ .The possible assignment of  ∈  to class  ℎ , ℎ ∈ , can be verified through the set of constraints  TH (→   ℎ ) and the necessary assignment through the set of constraints  TH (→   ℎ ): The sets of possible assignment-based preference relations  ≳ →,  are true if  is assigned to a class at least as good as the class of  for at least one compatible model instance, and the necessary assignment-based preference relation  ≳ →,  holds if  is assigned to a class at least as good as the class of  for all compatible model instances.These constraints allow direct comparisons between alternatives concerning their sorting recommendations.The relation  ≳ →,  is verified through the set of constraints  TH ℎ ( ≳ →, ) and relation  ≳ →,  through the set of constraints  TH ℎ ( ≳ →, ): To consider  min

Sorting Model for Categorizing Activities in Civil Construction
In the CC context, outsourcing activities is common practice.
During the project cycle, several hiring processes are open and closed, and they have different sizes and schedules.They have to be wisely managed to avoid losses and liabilities, and the selection must have a structured methodology, considering that there are a great variety of types of activities, risks, and contract size during this cycle.There will be contracts that will require more attention during its conduction, and others will not, due to their simplicity.The application in this paper consists of a sorting problematic: categorizing all activities with ROR-UTADIS to allow the DM to apply different methods to select subcontractors, improving his administration over the subcontractors.In this kind of project, it is possible to have more than one DM, but this model does not evaluate the aggregation of DM's preferences.Thus, only one DM in the contractor atmosphere will manage the project, which is the director, and he has total autonomy to make all the decisions in the project he manages.His objectives are aligned with the ones of the company he works for that has a decentralized structure, requiring its president to be completely absent from the projects.Besides being legally and technically responsible for the project, the director has to conquer the project, satisfy the client and manage the relationship between the two companies.Moreover, he is involved in all parts of the process and has to take responsibility for the consequences achieved, so he will be willing to keep the corporate image, reach the best profitability possible in the project, and satisfy and win the client for a long-term relationship.
Other actors will be directly or indirectly involved in the process, such as the analyst, stakeholders, and specialists.There is one actor present in the literature [55], which is not part of this process: the client, as the one that works as an intermediate in the process between the DM and the analyst, when the DM is an actor usually absent from the decision process for any reason.However, in this situation the DM will be involved full-time in the decision process, resulting in the exclusion of this actor.The analyst will work on structuring the problems, the bidding procedures, hiring the subcontractors, and managing the relationship between them and the contractor.The stakeholders will be the Ministry of Labour, the Federal Government, the City Hall, the state, the population, environmental agencies, and the client, which can be either public or private.In this problem it is private, therefore present in all steps of the project.There may be specialists hired during the project but will not be involved in the sorting procedure.
Figure 1 shows the flow of the proposed model to categorize subcontractors in civil construction.The analyst has to structure the alternatives, by verifying which civil construction activities will be outsourced.After that he might help the DM to verify his objectives, to relate them to attributes, and evaluate the alternatives.Both actors build the classes' profiles.After this process, the analyst has to create an evaluation matrix of the alternatives and finally, with the help of a Decision Support System (DSS) built in MATLAB, the DM provides his preference information.He will keep providing information until the model converges to one unique solution.In the following section a problem context and its description, as well as the descriptions of the stages of the presented model, are presented.

Sorting Model Application
The problem context is the CC of a brewery in Pernambuco State, Brazil, in a cost plus contract.Therefore, there is only an estimation of how much it will cost, which is expected to be US$ 70,000,000.00 (seventy million dollars).Once it is a cost plus contract, several activities have to be outsourced, instead of being carried out by the contractor itself.Thus, many subcontractors might be hired.The objectives of the director, who plays the role of DM, are to preserve the company's image, by avoiding liabilities, problems with population and Ministry of Labour and guaranteeing the safety of the workers related to the project.Those can be achieved by hiring reliable companies, verifying if they are financially healthy and if they work according to the safety laws.The other two objectives are to reach the best profitability that will only be possible enlarging the contract's objective, which can be reached with the third objective of winning the client, attained by delivering quality, low cost and finishing the project in the time agreed between contractor and client.The application

Alternatives Description
Air conditioning Activity includes the supply of air conditioning system and installation

Concrete
Concrete supply according to mix informed by the contractor and including installation of the concrete batching plant inside the project area and availability of concrete mixer truck and concrete pump in the quantity required Containers Activity includes the supply of containers for the building site and installation (electricity and logic) Heavy equipment Activity includes the supply of heavy equipment as planned by the contractor and preventive and corrective maintenance Molds, shoring, and scaffolding The activity includes the supply of molds, shoring, and scaffolding, as well as shoring and scaffolding projects for the activities and projects presented by the contractor Gypsum liner and partition The activity includes the supply and installation of gypsum liners and partitions Continuous Flight Auger Stake (CFA Stake) The activity includes equipment supply, activity, and dynamic and static load reports

Hydroseeding
The activity includes material and equipment necessary to the hydroseeding growth Waterproofing The activity includes material, equipment, and tests to prove the waterproofing Asphalt paving The activity includes equipment and materials necessary for the asphalt pavement of the designated area

Concrete paving
The activity includes equipment and guarantee for the concrete paving activity; the material is on behalf of the contractor

Precast concrete
The activity includes precast concrete adaptation project, material, equipment, transportation, and installation of concrete elements

Food supply
The activity includes food supply for the personnel designated by the contractor in the building site's dining hall Property security The activity includes 24 h of armed property security and patrol Vegetal suppression The activity includes equipment and licenses to do the vegetal suppression

Earthwork
The activity includes equipment and personnel for the earthwork according to the project provided by the contractor Transportation of personnel The activity includes equipment to transport personnel from and to their residencies in the beginning and by the end of each business's hours according to the routes provided by the contractor was analysed using the threshold-based procedure and, to calculate the results and create an interactive environment, the whole procedure was performed using MATLAB.

Definition of Alternatives (Activities Included in the Brewery Construction
).There were several activities to be outsourced for the construction; some were known to be low risk and low cost activities but required a long-term relation; others were short-term relations but involved high costs or high risks or both.Thus, it was important to list all the alternatives.Table 1 presents all the activities of the project to be hired through a bidding procedure.

Evaluation of DM's Criteria.
The DM expressed his objectives to formulate the sorting procedure based on his preferences; this information was used to define seven criteria to evaluate the alternatives.Table 2 presents these criteria.Three of them are cardinal, and the others are presented in qualitative scale, which are ordered in direction of preference and coded in numbers that were later converted to cardinal scale.

Profiles.
The sorting problematic consists of evaluating several alternatives to sort them into classes; for this purpose it is necessary to analyse which classes are considered.In this problem, the main reason to sort the alternatives into classes is to avoid liabilities by managing carefully the contracts more likely to present those questions.There are three predefined classes to classify the alternatives: high impact (C3), medium impact (C2), and low impact (C1) activities.
The high impact activities are the ones that represent high costs in the project and directly affect the schedule of the project and the client's perception of the activities carried out and their quality.These activities influence the histogram of personnel and guarantee of the project.The contractor has to accompany the subcontractors' personnel due to the long permanence in the building site and interaction with other companies and contractor's labour.It may be a specialized activity and have only a few suppliers or even be a monopoly, so these selection processes have to be carefully accompanied.
The medium impact activities, even though they may consist of a long-term relation, have many available suppliers, and if a delay comes up, it can be recovered by contracting another company to work on the activity simultaneously.It strongly affects the client's satisfaction with the project's accomplishment.There are also some preoccupations with liabilities, once they usually consist of long-term relations.The low impact activities do not have to be hired with the same rigor as the high impact and medium impact contracts,

Application of ROR-UTADIS.
The sorting model proposed was applied in the data presented in the previous items.
As explained in Section 4, we chose to use the ROR-UTADIS method [37], which is a modification of the UTADIS method [38,39].This method was selected due to its compensatory nature, allowing criteria to trade-off.As a holistic procedure, there is no need to do a profile characterization, once the restrictions imposed by the preference information supplied by the DM are used to calculate the parameters.The evaluation matrix is presented in Table 3.
In order to apply the first set of restrictions that plays the role of calculating the utility of each alternative, the alternatives must be previously standardized.The marginal value functions were then calculated with the first set of restrictions ( BASE TH ) that uses the boundaries and piecewise linear information to do the calculations.Table 4 presents the standardized values but in this table the alternatives are ordered by the value of marginal utility function in a descending order.The DM provided the system with different types of preference information.In Table 5 it is possible to verify three assignment examples in the first iteration, such as Continuous Flight Auger (CFA) Stake for class 3. Table 6 presents the assignment-based pairwise comparisons; in the first iteration four examples were provided; for example, hydroseeding is considered better than gypsum liner by at least one class.Moreover, in Table 7 it is possible to verify the class cardinalities, which were kept equal in all iterations.The set of compatible instances of the preference model is not empty; therefore, the presented preference statements are consistent.As presented in the third section, once the mixed linear programming converges to a solution, the model can recommend possible and necessary assignments.Table 8 presents the possible assignments for each iteration.In the first iteration four alternatives were assigned to class three that deserves more attention; only one alternative was assigned to the second class, and it was the exemplary assignment, six alternatives were assigned directly to class one, and six alternatives had imprecise assignments, requiring the process to be powered with more information.
In Table 8 the iterations are based on the first recommendation, to diminish the impreciseness of the process.In the second iteration, only two more exemplary alternatives were supplied both to the second class since this was the class with more vagueness on its information.The last iteration was made considering one more exemplary assignment and an assignment-based pairwise comparison.It is important to notice that the assignment-based pairwise comparison is not used to rank alternatives but to create relations among them, to calibrate the model.
Once the DM provided all information, it was possible to reach a final solution, with all alternatives necessarily assigned to one class.Thus, we found a complete preorder, where the alternatives concrete, concrete paving, CFA Stake, hydroseeding, and earthwork were indifferent to each other and strictly preferable to the ones assigned to classes one and two.Alternatives transport of personnel, precast concrete, form system, shoring and scaffolding, heavy equipment, food supply, and gypsum liner were indifferent among them and strictly preferable to alternatives asphalt paving, property security, vegetal suppression, containers, waterproofing, and air conditioning, which created the last set of indifferences.

Discussion of Results
In the application of this model, the results presented were mostly coherent with the expectations of the DM, except for three alternatives, one in each class.The hydroseeding was assigned to class three due to its performances in criteria available resources, risk exposition, and necessity of maintenance.However, usually the DM would considered class one or two because the cost is too low, and it does not affect the schedule of the project strongly; besides it is a very quick activity that can be carried out at any time of the project.The precast concrete was sorted as class two, due to its performance in the criteria number of suppliers, available resources, and necessity of maintenance.However, as critical activity that influences the whole schedule of the project, the cost and its operations involve many risks the DM, usually, would handle as class three activity, to avoid future liabilities.The last one was property security that was sorted as class one due to the influence of the criteria cost, number of suppliers, available resources, and necessity of maintenance; the DM expected to have it categorized as class three.The model is important to enrich the DM's vision of each activity.The fact that the DM did not agree with the result in some issues shows that the categorization is important to avoid the wrong management in each contract, giving a perspective of aspects he usually would not perceive and spending time in the analysis of an activity that would not bring greater problems.The model proposed is applicable and important to verify the output data.Among the holistic models, this one has a very important feature of allowing the DM to provide imprecise information and pairwise comparison through the relative position in the classification whenever he/she feels safe about the information, which greatly improves the generation of preference information.It is easy for the DM to understand the process, even when he is unable to understand the calculations.
However, some issues should be considered in the data analysis.Usually, the sorting process is not compensatory once the categorization of alternatives usually has some acceptability threshold in each criterion that sometimes is called veto and sometimes is called a discordance index.When applying a holistic method, it is not possible to elicit those limits and it is even more impossible to apply them, because the sorting is made considering a class threshold and ignoring criterion thresholds.Also, in the method applied, the marginal utilities are calculated based on the boundaries and piecewise linear information; it is not possible to include in the procedure the elicitation of constant scales the tradeoff among criteria.Thus, some preference information is unavoidably lost during this process.To take into account this consideration it would be necessary to elicit the constant scales before the standardization and include it in the standardization process that could be rather difficult for the DM to understand and apply properly.
The behaviour verified in the first two cases presented could be caused by the lack of preference information on scales constants.That would balance the differences among the criteria and reflect the subtleness of the information provided, once marginal utility values of these alternatives are placed in the threshold limits of the classes they were assigned to.In the last alternative, maybe if the criteria threshold had been elicited, the classification proposed was more similar to the expectations of the DM.

Conclusion
In this paper, we presented an application of the ROR-UTADIS method [37] to the context of subcontractor's selection in the construction industry, where, instead of proposing a new methodology to run the selection, we propose to categorize the services prior to the definition of the selection methodology.The model presented results that were coherent with the ones expected, based on previous experience, becoming clear that it can be applied to contexts different than the one presented by the authors.The main motivation to apply this model and not the others is due to its robustness and compatibility with fewer profiles, allowing the information to converge in only a few iterations.This process is easy for the DM to provide information, due to the disaggregation of preference, but have some limitations, since it is harder to elicit scale constants and include them in the analysis.
The inclusion of additional preference information, apart from helping to create stronger restrictions to the problem, even if it allows the DM to consider imprecise assignments, such as assigning one single alternative to more than one class, also gives the DM more confidence in the analysis.Because sometimes he may not be sure about which class to assign a reference alternative but needs to limit the class cardinalities or can compare alternatives, enriching the process with information that usually he would not be able to provide.
Future works may focus on developing an additive method considering direct elicitation of preference information, to include in the analysis constant scale elicitation and

)
Different from the assignment examples, which consist in holistic judgments calculated through recommendations provided by the DM, the assignment-based pairwise comparison is composed of two reference alternatives, ( * ,  * ) ∈   ×   , and pairwise comparison between them with imprecise judgment.It is represented as  * > → ≥,DM  * , meaning that  * and  * are separated by at least  classes and  * > → ≤,DM  * meaning that  * and  * are separated by at most  classes.To guarantee these restrictions, the problem is submitted to the following constraints   TH and   TH :

ℎ
and the  max ℎ as minimal and maximal cardinality of class  ℎ , the mixed integer linear programming problems need to be solved:Minimize/Maximize: ∑ ∈ V ℎ () , subject to  SORT ,where V ℎ () ∈ {0, 1} .

Figure 1 :
Figure 1: Flow of the sorting model for categorizing subcontractors' activities based on ROR-UTADIS.

Table 1 :
Alternatives analysed in the brewery project.

Table 2 :
Criteria used to analyse the brewery project.