Mathematical Problems in Engineering

Volume 2013 (2013), Article ID 461363, 13 pages

http://dx.doi.org/10.1155/2013/461363

Research Article

Parametric Rough Sets with Application to Granular Association Rule Mining

Xu He,¹ Fan Min,1,2 and William Zhu¹

¹Lab of Granular Computing, Minnan Normal University, Zhangzhou 363000, China

²School of Computer Science, Southwest Petroleum University, Chengdu 610500, China

Received 2 August 2013; Accepted 12 October 2013

Academic Editor: Gerhard-Wilhelm Weber

Copyright © 2013 Xu He et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

Granular association rules reveal patterns hidden in many-to-many relationships which are common in relational databases. In recommender systems, these rules are appropriate for cold-start recommendation, where a customer or a product has just entered the system. An example of such rules might be “40% men like at least 30% kinds of alcohol; 45% customers are men and 6% products are alcohol.” Mining such rules is a challenging problem due to pattern explosion. In this paper, we build a new type of parametric rough sets on two universes and propose an efficient rule mining algorithm based on the new model. Specifically, the model is deliberately defined such that the parameter corresponds to one threshold of rules. The algorithm benefits from the lower approximation operator in the new model. Experiments on two real-world data sets show that the new algorithm is significantly faster than an existing algorithm, and the performance of recommender systems is stable.

1. Introduction

Relational data mining approaches [1–4] look for patterns that include multiple tables in the database. These works generate rules through two measures, namely, support and confidence. Granular association rule mining [5, 6], combined with the granules [7–14], is a new approach to look for patterns hidden in many-to-many relationships. This approach generates rules with four measures to reveal connections between granules in two universes. A complete example of granular association rules might be “40% men like at least 30% kinds of alcohol; 45% customers are men and 6% products are alcohol.’’ Here 45%, 6%, 40%, and 30% are the source coverage, the target coverage, the source confidence, and the target confidence, respectively. With these four measures, the strength of the rule is well defined. Therefore, granular association rules are semantically richer than other relational association rules.

Granular association rules [5, 6] are appropriate to solve the cold-start problem for recommender systems [15, 16]. Recommender systems [17–20] suggest products of interest to customers; therefore, they have gained much success in E-commerce and similar applications. The cold-start problem [15, 16] is difficult in recommender systems. Recently, researchers have addressed the cold-start problem where either the customer or the product is new. Naturally, content-based filtering approaches [17, 21] are used for these problems. However, the situation with both new customer and new product has seldom been considered. A cold-start recommendation approach has been proposed based on granular association rules for the new situation. First, both customers and products are described through a number of attributes, thus forming different granules [8, 10, 22–24]. Then we generate rules between customers and products through satisfying four measures of granular association rules. Examples of granular association rules include “men like alcohol" and “Chinese men like France alcohol." They are proposed at different degrees of granularity. Finally, we match the suitable rules to recommend products to customers.

A granular association rule mining problem is defined as finding all granular association rules given thresholds on four measures [5]. Similar to other relational association rule mining problems (see, e.g., [25–27]), this problem is challenging due to pattern explosion. A straightforward sandwich algorithm has been proposed in [5]. It starts from both entities and proceeds to the relation. Unfortunately, the time complexity is rather high and the performance is not satisfactory.

In this paper, we propose a new type of parametric rough sets on two universes to study the granular association rule mining problem. We borrow some ideas from variable precision rough sets [28] and rough sets on two universes [29–31] to build the new model. The model is deliberately adjusted such that the parameter coincides with the target confidence threshold of rules. In this way, the parameter is semantic and can be specified by the user directly. We compare our definitions with alternative ones and point out that they should be employed in different applications. Naturally, our definition is appropriate for cold-start recommendation. We also study some properties, especially the monotonicity of the lower approximation, of our new model.

With the lower approximation of the proposed parametric rough sets, we design a backward algorithm for rule mining. This algorithm starts from the second universe and proceeds to the first one; hence it is called a backward algorithm. Compared with an existing sandwich algorithm [5], the backward algorithm avoids some redundant computation. Consequently, it has a lower time complexity.

Experiments are undertaken on two real-world data sets. One is the course selection data from Minnan Normal University during the semester between 2011 and 2012. The other is the publicly available MovieLens data set. Results show that the backward algorithm is more than 2 times faster than the sandwich algorithm; the run time is linear with respect to the data set size; sampling might be a good choice to decrease the run time; and the performance of recommendation is stable.

The rest of the paper is organized as follows. Section 2 reviews granular association rules through some examples. The rule mining problem is also defined. Section 3 presents a new model of parametric rough sets on two universes. The model is defined to cope with the formalization of granular association rules. Then Section 4 presents a backward algorithm for the problem. Experiments on two real-world data sets are discussed in Section 5. Finally, Section 6 presents some concluding remarks and further research directions.

2. Preliminaries

In this section, we revisit granular association rules [6]. We discuss the data model, the definition, and four measures of such rules. A rule mining problem will also be represented.

2.1. The Data Model

The data model is based on information systems and binary relations.

Definition 1. is an information system, where is the set of all objects, is the set of all attributes, and is the value of on attribute for and .

An example of information system is given by Table 1(a), where and Age, Gender, Married, Country, Income, NumCars}. Another example is given by Table 1(b).

Table 1: A many-to-many entity-relationship system.

(a) Customer

CID
Name
Age
Gender
Married
Country
Income
NumCars

Ron
20–29
Male
No
USA
60 k–69 k
0-1

Michelle
20–29
Female
Yes
USA
80 k–89 k
0-1

Shun
20–29
Male
No
China
40 k–49 k
0-1

Yamago
30–39
Female
Yes
Japan
80 k–89 k
2

Wang
30–39
Male
Yes
China
90 k–99 k
2

(b) Product

PID
Name
Country
Category
Color
Price

Bread
Australia
Staple
Black
1–9

Diaper
China
Daily
White
1–9

Pork
China
Meat
Red
1–9

Beef
Australia
Meat
Red
10–19

Beer
France
Alcohol
Black
10–19

Wine
France
Alcohol
White
10–19

(c) Buys

1
1
0
1
1
0

1
0
0
1
0
1

0
1
0
0
1
1

0
1
0
1
1
0

1
0
0
1
1
1

In an information system, any induces an equivalence relation [32, 33]

and partitions into a number of disjoint subsets called blocks or granules. The block containing is

The following definition was employed by Yao and Deng [23].

Definition 2. A granule is a triple [23]

where is the name assigned to the granule, is a representation of the granule, and is a set of objects that are instances of the granule.

is a natural name to the granule. The representation of is

The set of objects that are instances of is

The support of the granule is the size of divided by the size of the universe, namely,

Definition 3. Let and be two sets of objects. Any is a binary relation from to . The neighborhood of is

When and is an equivalence relation, is the equivalence class containing . From this definition we know immediately that, for ,

A binary relation is more often stored in the database as a table with two foreign keys. In this way the storage is saved. For the convenience of illustration, here we represented it with an Boolean matrix. An example is given in Table 1(c), where is the set of customers as indicated in Table 1(a) and is the set of products as indicated in Table 1(b).

With Definitions 1 and 3, we propose the following definition.

Definition 4. A many-to-many entity-relationship system (MMER) is a 5-tuple , where and are two information systems and is a binary relation from to .

An example of MMER is given in Tables 1(a), 1(b), and 1(c).

2.2. Granular Association Rules with Four Measures

Now we come to the central definition of granular association rules.

Definition 5. A granular association rule is an implication of the form

where and .

According to (6), the set of objects meeting the left-hand side of the granular association rule is

while the set of objects meeting the right-hand side of the granular association rule is

From the MMER given in Tables 1(a), 1(b), and 1(c), we may obtain the following rule.

Rule 1. One has

Rule 1 can be read as “men like alcohol.” There are some issues concerning the strength of the rule. For example, we may ask the following questions on Rule 1.

(1)How many customers are men?(2)How many products are alcohol?(3)Do all men like alcohol?(4)Do all kinds of alcohol favor men?

An example of complete granular association rules with measures specified is “40% men like at least 30% kinds of alcohol; 45% customers are men and 6% products are alcohol." Here 45%, 6%, 40%, and 30% are the source coverage, the target coverage, the source confidence, and the target confidence, respectively. These measures are defined as follows.

The source coverage of a granular association rule is

The target coverage of is

There is a tradeoff between the source confidence and the target confidence of a rule. Consequently, neither value can be obtained directly from the rule. To compute any one of them, we should specify the threshold of the other. Let be the target confidence threshold. The source confidence of the rule is

Let be the source confidence threshold, and

This equation means that elements in have connections with at least elements in , but less than elements in have connections with at least elements in . The target confidence of the rule is

In fact, the computation of is nontrivial. First, for any , we need to compute and obtain an array of integers. Second, we sort the array in a descending order. Third, let ; is the kth element in the array.

The relationships between rules are interesting to us. As an example, let us consider the following rule.

Rule 2. One has

Rule 2 can be read as “Chinese men like France alcohol.” One may say that we can infer Rule 2 from Rule 1 since the former one has a finer granule. However, with the four measures we know that the relationships between these two rules are not so simple. A detailed explanation of Rule 2 might be “60% Chinese men like at least 50% kinds of France alcohol; 15% customers are Chinese men and 2% products are France alcohol.” Comparing Rules 1 and 2 is stronger in terms of source/target confidence; however it is weaker in terms of source/target coverage. Therefore if we need rules covering more people and products, we prefer Rule 1; if we need more confidence on the rules, we prefer Rule 2. For example, if the source confidence threshold is 55%, Rule 2 might be valid while Rule 1 is not; if the source coverage is 20%, Rule 1 might be valid while Rule 2 is not.

2.3. The Granular Association Rule Mining Problem

A straightforward rule mining problem is as follows.

Input. An , a minimal source coverage threshold , a minimal target coverage threshold , a minimal source confidence threshold , and a minimal target confidence threshold .

Output. All granular association rules satisfying , , , and .

Since both and are specified, we can choose either (15) or (17) to decide whether or not a rule satisfies these thresholds. Equation (15) is a better choice.

3. Parametric Rough Sets on Two Universes

In this section, we first review rough approximations [32] on one universe. Then we present rough approximations on two universes. Finally we present parametric rough approximations on two universes. Some concepts are dedicated to granular association rules. We will explain in detail the way they are defined from semantic point of view.

3.1. Classical Rough Sets

The classical rough sets [32, 34] are built upon lower and upper approximations on one universe. We adopt the ideas and notions introduced in [35] and define these concepts as follows.

Definition 6. Let be a universe and an indiscernibility relation. The lower and upper approximations of with respect to are

respectively.

These concepts can be employed for set approximation or classification analysis. For set approximation, the interval is called rough set of , which provides an approximate characterization of by the objects that share the same description of its members [35]. For classification analysis, the lower approximation operator helps finding certain rules, while the upper approximation helps finding possible rules.

3.2. Existing Parametric Rough Sets

Ziarko [28] pointed out that the classical rough sets cannot handle classification with a controlled degree of uncertainty or a misclassification error. Consequently, he proposed variable precision rough sets [28] with a parameter to indicate the admissible classification error.

Let and be nonempty subsets of a finite universe , and . The measure of the relative degree of misclassification of the set with respect to set is defined as

where denotes set cardinality.

The equivalence relation corresponds to a partitioning of into a collection of equivalence classes or elementary sets . The -lower and -upper approximation of the set are defined as

where .

For the convenience of discussion, we rewrite his definition as follows.

Definition 7. Let be a universe and an indiscernibility relation. The lower and upper approximations of with respect to under precision are

respectively. is the equivalence class containing .

Note that indicate the classification accuracy (precision) threshold rather than the misclassification error threshold as employed in [28]. Wong et al. [31] extended the definition to an arbitrary binary relation which is at least serial.

Ziarko [28] introduced variable precision rough sets with a parameter. The model had seldom explanation about the parameter. Yao and Wong [36] studied the condition of parameter and introduced the decision theoretic rough set (DTRS) model. DTRS model is a probabilistic rough sets in the framework of Bayesian decision theory. It requires a pair of thresholds instead of only one in variable precision rough sets. Its main advantage is the solid foundation based on Bayesian decision theory. can be systematically computed by minimizing overall ternary classification cost [36]. Therefore this theory has drawn much research interests in both theory (see, e.g., [37, 38]) and application (see, e.g., [39–41]).

Gong and Sun [42] firstly defined the concept of the probabilistic rough set over two universes. Ma and Sun [43] presented the parameter dependence or the continuous of lower and upper approximations about two parameters and for every type probabilistic rough set model over two universes in detail. Moreover, a new model of probabilistic fuzzy rough set over two universes [44] is proposed. These theories have broad and wide application prospects.

3.3. Rough Sets on Two Universes for Granular Association Rules

Since our data model is concerned with two universes, we should consider computation models for this type of data. Rough sets on two universes have been defined in [31]. Some later works adopt the same definitions (see, e.g., [29, 30]). We will present our definitions which cope with granular association rules. Then we discuss why they are different from existing ones.

Definition 8. Let and be two universes and a binary relation. The lower and upper approximations of with respect to are

respectively.

From this definition we know immediately that, for ,

Now we explain these notions through our example. contains products that favor all people in , contains people who like all products in , contains products that favor at least one person in , and contains people who like at least one product in .

We have the following property concerning the monotonicity of these approximations.

Property 1. Let :

That is, with the increase of the object subset, the lower approximation decreases while the upper approximation increases. It is somehow ad hoc to people in the rough set society that the lower approximation decreases in this case. In fact, according to Wong et al. [31], Liu [30], and Sun et al. [44], (24) should be rewritten as

where the prim is employed to distinguish between two definitions. In this way, . Moreover, it would coincide with (19) when .

We argue that different definitions of the lower approximation are appropriate for different applications. Suppose that there is a clinic system where is the set of all symptoms and is the set of all diseases [31]. is a set of symptoms. According to (29), contains diseases that induced by symptoms only in . That is, if a patient has no symptom in , she never has any diseases in . This type of rules is natural and useful.

In our example presented in Section 2, is a group of people. contains products that favor people only in . That is, if a person does not belong to , she never likes products in . Unfortunately, this type of rules is not interesting to us. This is why we employ equation (24) for lower approximation.

We are looking for very strong rules through the lower approximation indicated in Definition 8. For example, “all men like all alcohol.” This kind of rules are called complete match rules [6]. However, they seldom exist in applications. On the other hand, we are looking for very weak rules through the upper approximation. For example, “at least one man like at least one kind of alcohol.” Another extreme example is “all people like at least one kind of product,” which hold for any data set. Therefore this type of rules is useless. These issues will be addressed through a more general model in the next section.

3.4. Parametric Rough Sets on Two Universes for Granular Association Rules

Given a group of people, the number of products that favor all of them is often quite small. On the other hand, the number of products that favor at least one of them is not quite meaningful. Similar to probabilistic rough sets, we need to introduce one or more parameters to the model.

To cope with the source confidence measure introduced in Section 2.2, we propose the following definition.

Definition 9. Let and be two universes, a binary relation, and a user-specified threshold. The lower approximation of with respect to for threshold is

We do not discuss the upper approximation in the new context due to lack of semantic.

From this definition we know immediately that the lower approximation of with respect to is

Here corresponds with the target confidence instead. In our example, are products that favor at least people in , and are people who like at least products in .

The following property indicates that is a generalization of both and .

Property 2. Let and be two universes and a binary relation:

where is a small positive number.

Proof. One has

The following property shows the monotonicity of .

Property 3. Let :

However, given , we obtain neither nor . The relationships between and depend on . Generally, if is big, tends to be bigger; otherwise tends to be smaller. Equation (27) indicates the extreme case for , and (28) indicates the other extreme case for .

is the coverage of (or ) to (or ). It does not mean precision of an approximation. This is why we call this model parametric rough sets instead of variable precision rough sets [28] or probabilistic rough sets [45].

Similar to the discussion in Section 3.3, in some cases, we would like to employ the following definition:

It coincides with defined in Definition 7 if . Take the clinic system again as the example. is the set of diseases that are caused mainly (with a probability no less than ) by symptoms in .

4. A Backward Algorithm to Granular Association Rule Mining

In our previous work [5], we have proposed an algorithm according to (15). The algorithm starts from both sides and checks the validity of all candidate rules. Therefore it was named a sandwich algorithm.

To make use of the concept proposed in the Section 3, we should rewrite (15) as follows:

With this equation, we propose an algorithm to deal with Problem 1. The algorithm is listed in Algorithm 1. It essentially has four steps.

Input: , , , , , , .

Output: All complete match granular association rules satisfying given constraints.

Method: complete-match-rules-backward

(1)  ; //Candidate source granules

(2)  ; //Candidate target granules

(3)  for each   do

(4)      ;

(5)      ;

(6)      for each   do

(7)          if  ()  then

(8)              output rule ;

(9)          end if

(10)     end for

(11) end for

Algorithm 1: A backward algorithm.

Step 1. Search in all granules meeting the minimal source coverage threshold . This step corresponds to Line 1 of the algorithm, where stands for source granule.

Step 2. Search in all granules meeting the minimal target coverage threshold . This step corresponds to Line 2 of the algorithm, where stands for target granule.

Step 3. For each granule obtained in Step 1, construct a block in according to . This step corresponds to Line 4 of the algorithm. The function has been defined in (5). According to Definition 9, in our example, are people who like at least products in .

Step 4. Check possible rules regarding and , and output all rules. This step corresponds to Lines 6 through 10 of the algorithm. In Line 7, since and could be stored in sorted arrays, the complexity of checking is

where denotes the cardinality of a set.

Because the algorithm starts from the right-hand side of the rule and proceeds to the left-hand side, it is called a backward algorithm. It is necessary to compare the time complexities of the existing sandwich algorithm and our new backward algorithm. Both algorithms share Steps 1 and 2, which do not incur the pattern explosion problem. Therefore we will focus on the remaining steps. The time complexity of the sandwich algorithm is [5]

where denotes the cardinality of a set.

According to the loops, the time complexity of Algorithm 1 is

which is lower than the sandwich algorithm.

Intuitively, the backward algorithm avoids computing for different rules with the same right-hand side. Hence it should be less time consuming than the sandwich algorithm. We will compare the run time of these algorithms in the next section through experimentation.

The space complexities of these two algorithms are also important. To store the relation , a Boolean matrix is needed.

5. Experiments on Two Real-World Data Sets

The main purpose of our experiments is to answer the following questions.

(1)Does the backward algorithm outperform the sandwich algorithm?(2)How does the number of rules change for different number of objects?(3)How does the algorithm run time change for different number of objects?(4)How does the number of rules vary for different thresholds?(5)How does the performance of cold-start recommendation vary for the training and testing sets?

5.1. Data Sets

We collected two real-world data sets for experimentation. One is course selection, and the other is movie rating. These data sets are quite representative for applications.

5.1.1. A Course Selection Data Set

The course selection system often serves as an example in textbooks to explain the concept of many-to-many entity-relationship diagrams. Hence it is appropriate to produce meaningful granular association rules and test the performance of our algorithm. We obtained a data set from the course selection system of Minnan Normal University. (The authors would like to thank Mrs. Chunmei Zhou for her help in the data collection.) Specifically, we collected data during the semester between 2011 and 2012. There are 145 general education courses in the university. 9,654 students took part in course selection. The database schema is as follows.

(i)Student (student ID, name, gender, birth-year, politics-status, grade, department, nationality, and length of schooling).(ii)Course (course ID, credit, class-hours, availability, and department).(iii)Selects (student ID, course ID).

Our algorithm supports only nominal data at this time. For this data set, all data are viewed nominally and directly. In this way, no discretization approach is employed to convert numeric ones into nominal ones. Also we removed student names and course names from the original data since they are useless in generating meaningful rules.

5.1.2. A Movie Rating Data Set

The MovieLens data set assembled by the GroupLens project is widely used in recommender systems (see, e.g., [15, 16] (GroupLens is a research lab in the Department of Computer Science and Engineering at the University of Minnesota. (http://www.grouplens.org/))). We downloaded the data set from the Internet Movie Database (http://www.movielens.org/). Originally, the data set contains 100,000 ratings (1–5) from 943 users on 1,682 movies, with each user rating at least 20 movies [15]. Currently, the available data set contains 1,000,209 anonymous ratings of 3,952 movies made by 6,040 MovieLens users who joined MovieLens in 2000. In order to run our algorithm, we preprocessed the data set as follows.

(1)Remove movie names. They are not useful in generating meaningful granular association rules.(2)Use release year instead of release date. In this way the granule is more reasonable.(3)Select the movie genre. In the original data, the movie genre is multivalued since one movie may fall in more than one genre. For example, a movie can be both animation and children's. Unfortunately, granular association rules do not support this type of data at this time. Since the main objective of this work is to compare the performances of algorithms, we use a simple approach to deal with this issue, that is, to sort movie genres according to the number of users they attract and only keep the highest priority genre for the current movie. We adopt the following priority (from high to low): comedy, action, thriller, romance, adventure, children, crime, sci-Fi, horror, war, mystery, musical, documentary, animation, western, filmnoir, fantasy, and unknown.

Our database schema is as follows.

(i)User (user ID, age, gender, and occupation),(ii)Movie (movie ID, release year, and genre),(iii)Rates (user ID, movie ID).

There are 8 user age intervals, 21 occupations, and 71 release years. Similar to the course selection data set, all these data are viewed nominally and processed directly. We employ neither discretization nor symbolic value partition [46, 47] approaches to produce coarser granules. The genre is a multivalued attribute. Therefore we scale it to 18 Boolean attributes and deal with it using the approach proposed in [48].

5.2. Results

We undertake five sets of experiments to answer the questions proposed at the beginning of this section.

5.2.1. Efficiency Comparison

We compare the efficiencies of the backward and the sandwich algorithms. We look at only the run time of Lines 3 through 11, since these codes are the difference between two algorithms.

For the course selection data set, when , , and , we obtain only 40 rules. For higher thresholds, no rule can be obtained. Therefore we use the following settings: , , , and . Figure 1(a) shows the actual run time in miniseconds. Figure 2(a) shows the number of basic operations, including addition and comparison of numbers. Here we observe that, for different settings, the backward algorithm is more than 2 times faster than the sandwich algorithm; it only takes less than 1/3 operations than the sandwich algorithm.

(a)

(b)

Figure 1: Run time information: (a) course selection, (b) MovieLens (3,800 users).

(a)

(b)

Figure 2: Basic operations information: (a) course selection, (b) MovieLens (3,800 users).

For the MovieLens data set, we employ the data set with 3,800 users and 3,952 movies. We use the following settings: , , , and . Figure 1(b) shows the actual run time in miniseconds. Figure 2(b) shows the number of basic operations, including addition and comparison of numbers. Here we observe that, for different settings, the backward algorithm is more than 3 times faster than the sandwich algorithm; it only takes less than 1/4 operations than the sandwich algorithm.

5.2.2. Change of Number of Rules for Different Data Set Sizes

Now we study how the number of rules changes with the increase of the data set size. The experiments are undertaken only on the MovieLens data set. We use the following settings: , , , and . The number of movies is always 3,952. While selecting users, we always select from the first user to the th user.

First we look at the number of concepts satisfying the source confidence threshold . According to Figure 3(a), the number of source concepts decreases with the increase of the number of users. However, Figure 3(b) indicates that this trend may not hold. In fact, from Figure 3, the most important observation is that the number of source concepts does not vary much with the change of the number of objects. When the number of users is more than 1,500, this variation is no more than 3, which is less than 5% of the total number of concepts.

(a)

(b)

Figure 3: Number of concepts on users for MovieLens: (a) , (b) .

Second we look at the number of granular association rules satisfying all four thresholds. Figure 4 indicates that the number of rules varies more than the number of source concepts. However, this variation is less than 20% when there are more than 1,500 users or less than 10% when there are more than 2,500 users.

(a)

(b)

Figure 4: Number of granular association rules for MovieLens: (a) , (b) .

5.2.3. Change of Run Time for Different Data Set Sizes

We look at the run time change with the increase of the number of users. The time complexity of the algorithm is given by (40). Since the number of movies is not changed, is fixed. Moreover, according to our earlier discussion, does not vary much for different number of users. Therefore the time complexity is nearly linear with respect to the number of users. Figure 5 validates this analysis.

(a)

(b)

Figure 5: Run time on MovieLens: (a) , (b) .

5.2.4. Number of Rules for Different Thresholds

Figure 6(a) shows the number of rules decreases dramatically with the increase of and . For the course selection data set, the number of rules would be 0 when . For the MovieLens data set, the number of rules would be 0 when .

(a)

(b)

Figure 6: Number of granular association rules: (a) course selection, (b) MovieLens.

5.2.5. Performance of Cold-Start Recommendation

Now we study how the performance of cold-start recommendation varies for the training and testing sets The experiments are undertaken only on the MovieLens data set. Here we employ two data sets. One is with 1,000 users and 3,952 movies, and the other is with 3,000 users and 3,952 movies. We divide user into two parts as the training and testing set. The other settings are as follows: the training set percentage is 60%, , and . Each experiment is repeated 30 times with different sampling of training and testing sets, and the average accuracy is computed.

Figure 7 shows that with the variation of and , the recommendation performs different. Now we observe some especially interesting phenomena from this figure as follows.

(1)Figures 7(a) and 7(b) are similar in general. As the user number increases, the accuracy of recommender also increases. The reason is that we get more information from the training sets to generate much better rules for the recommendation.(2)When and are suitably set (0.03), the recommender of both data sets has the maximal accuracy. With the increase or decrease of these thresholds, the performance of the recommendation increases or decreases rapidly.(3)The performance of the recommendation does not change much on the training and the testing sets. This phenomenon figures out that the recommender is stable.

(a)

(b)

Figure 7: Accuracy of cold-start recommendation on MovieLens: (a) 1,000 users and 3,952 movies, (b) 3,000 users and 3,952 movies.

5.3. Discussions

Now we can answer the questions proposed at the beginning of this section.

(1)The backward algorithm outperforms the sandwich algorithm. The backward algorithm is more than 2 times and 3 times faster than the sandwich algorithm on the course selection and MovieLens data sets, respectively. Therefore our parametric rough sets on two universes are useful in applications.(2)The number of rules does not change much for different number of objects. Therefore it is not necessary to collect too many data to obtain meaningful granular association rules. For example, for the MovieLens data set, 3,000 users are pretty enough.(3)The run time is nearly linear with respect to the number of objects. Therefore the algorithm is scalable from the viewpoint of time complexity. However, we observe that the relation table might be rather big; therefore this would be a bottleneck of the algorithm.(4)The number of rules decreases dramatically with the increase of thresholds and . It is important to specify appropriate thresholds to obtain useful rules.(5)The performance of cold-start recommendation is stable on the training and the testing sets with the increase of thresholds and .

6. Conclusions

In this paper, we have proposed a new type of parametric rough sets on two universes to deal with the granular association rule mining problem. The lower approximation operator has been defined, and its monotonicity has been analyzed. With the help of the new model, a backward algorithm for the granular association rule mining problem has been proposed. Experimental results on two real-world data sets indicate that the new algorithm is significantly faster than the existing sandwich algorithm. The performance of recommender systems is stable on the training and the testing sets. To sum up, this work applies rough set theory to recommender systems and is one step toward the application of rough set theory and granular computing. In the future, we will improve our approach and compare the performance with other recommendation approaches.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work is in part supported by the National Science Foundation of China under Grant nos. 61379089, 61379049, and 61170128, the Fujian Province Foundation of Higher Education under Grant no. JK2012028, the Key Project of Education Department of Fujian Province under Grant No. JA13192, and the Postgraduate Education Innovation Base for Computer Application Technology, Signal and Information Processing of Fujian Province (no. [2008]114, High Education of Fujian).

References

L. Dehaspe, H. Toivonen, and R. D. King, “Finding frequent substructures in chemical compounds,” in Proceedings of the 4th International Conference on Knowledge Discovery and Data Mining, pp. 30–36, 1998.

B. Goethals, W. Le Page, and M. Mampaey, “Mining interesting sets and rules in relational databases,” in Proceedings of the 25th Annual ACM Symposium on Applied Computing (SAC '10), pp. 997–1001, March 2010.

S. Džeroski, “Multi-relational data mining: an introduction,” in SIGKDD Explorations, vol. 5, pp. 1–16, 2003.

V. C. Jensen and N. Soparkar, “Frequent item set counting across multiple tables,” in Proceedings of the 4th Pacific-Asia Conference on Knowledge Discovery and Data Mining, Current Issues and New Application, vol. 1805 of Lecture Notes in Computer Science, pp. 49–61, 2000.

F. Min, Q. H. Hu, and W. Zhu, “Granular association rules on two universes with four measures,” 2012, http://arxiv.org/abs/1209.5598

F. Min, Q. H. Hu, and W. Zhu, “Granular association rules with four subtypes,” in Proceedings of the IEEE International Conference on Granular Computing, pp. 432–437, 2012.

J. Hu and C. Guan, “An emotional agent model based on granular computing,” Mathematical Problems in Engineering, vol. 2012, Article ID 601295, 10 pages, 2012.

T. Y. Lin, “Granular computing on binary relations I: data mining and neighborhoodsystems,” Rough Sets in Knowledge Discovery, vol. 1, pp. 107–121, 1998.

J. T. Yao and Y. Y. Yao, “Information granulation for web based information retrieval support systems,” in Proceedings of SPIE, vol. 5098, pp. 138–146, April 2003.

Y. Y. Yao, “Granular Computing: Basic issues and possible solutions,” in Proceedings of the 5th Joint Conference on Information Sciences (JCIS '00), vol. 1, pp. 186–189, March 2000.

W. Zhu and F.-Y. Wang, “Reduction and axiomization of covering generalized rough sets,” Information Sciences, vol. 152, pp. 217–230, 2003.

W. Zhu, “Generalized rough sets based on relations,” Information Sciences, vol. 177, no. 22, pp. 4997–5011, 2007.

F. Min, H. He, Y. Qian, and W. Zhu, “Test-cost-sensitive attribute reduction,” Information Sciences, vol. 181, no. 22, pp. 4928–4942, 2011.

F. Min, Q. Hu, and W. Zhu, “Feature selection with test cost constraint,” International Journal of Approximate Reasoning, vol. 55, no. 1, pp. 167–179, 2014.

A. I. Schein, A. Popescul, L. H. Ungar, and D. M. Pennock, “Methods and metrics for cold-start recommendations,” SIGIR Forum, pp. 253–260, 2002.

H. Guo, “Soap: live recommendations through social agents,” in Proceedings of the 5th DELOS Workshop on Filtering and Collaborative Filtering, pp. 1–17, 1997.

M. Balabanović and Y. Shoham, “Content-based, collaborative recommendation,” Communications of the ACM, vol. 40, no. 3, pp. 66–72, 1997.

G. Adomavicius and A. Tuzhilin, “Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions,” IEEE Transactions on Knowledge and Data Engineering, vol. 17, no. 6, pp. 734–749, 2005.

R. Burke, “Hybrid recommender systems: survey and experiments,” User Modelling and User-Adapted Interaction, vol. 12, no. 4, pp. 331–370, 2002.

A. H. Dong, D. Shan, Z. Ruan, L. Y. Zhou, and F. Zuo, “The design and implementationof an intelligent apparel recommend expert system,” Mathematical Problemsin Engineering, vol. 2013, Article ID 343171, 8 pages, 2013.

M. Pazzani and D. Billsus, “Content-based recommendation systems,” in The Adaptive Web, vol. 4321, pp. 325–341, Springer, 2007.

W. Zhu, “Relationship among basic concepts in covering-based rough sets,” Information Sciences, vol. 179, no. 14, pp. 2478–2486, 2009.

Y. Y. Yao and X. F. Deng, “A granular computing paradigm for concept learning,” in Emerging Paradigms in Machine Learning, vol. 13, pp. 307–326, Springer, Berlin, Germany, 2013.

J. Yao, “Recent developments in granular computing: a bibliometrics study,” in Proceedings of the IEEE International Conference on Granular Computing (GRC '08), pp. 74–79, August 2008.

F. Aftrati, G. Das, A. Gionis, H. Mannila, T. Mielikäinen, and P. Tsaparas, “Mining chains of relations,” in Data Mining: Foundations and Intelligent Paradigms, vol. 24, pp. 217–246, Springer, 2012.

L. Dehaspe and H. Toivonen, “Discovery of frequent datalog patterns,” Expert Systems with Applications, vol. 3, no. 1, pp. 7–36, 1999.

B. Goethals, W. Le Page, and H. Mannila, “Mining association rules of simple conjunctive queries,” in Proceedings of the 8th SIAM International Conference on Data Mining, pp. 96–107, April 2008.

W. Ziarko, “Variable precision rough set model,” Journal of Computer and System Sciences, vol. 46, no. 1, pp. 39–59, 1993.

T. J. Li and W. X. Zhang, “Rough fuzzy approximations on two universes of discourse,” Information Sciences, vol. 178, no. 3, pp. 892–906, 2008.

G. Liu, “Rough set theory based on two universal sets and its applications,” Knowledge-Based Systems, vol. 23, no. 2, pp. 110–115, 2010.

S. Wong, L. Wang, and Y. Y. Yao, “Interval structure: a framework for representinguncertain information,” in Uncertainty in Artificial Intelligence, pp. 336–343, 1993.

Z. Pawlak, “Rough sets,” International Journal of Computer & Information Sciences, vol. 11, no. 5, pp. 341–356, 1982.

A. Skowron and J. Stepaniuk, “Approximation of relations,” in Proceedings of the Rough Sets, Fuzzy Sets and Knowledge Discovery, W. Ziarko, Ed., pp. 161–166, 1994.

Z. Pawlak, Rough Sets: Theoretical Aspects of Reasoning about Data, Kluwer Academic, Boston, Mass, USA, 1991.

S. K. M. Wong, L. S. Wang, and Y. Y. Yao, “On modelling uncertainty with interval structures,” Computational Intelligence, vol. 12, no. 2, pp. 406–426, 1995.

Y. Y. Yao and S. K. M. Wong, “A decision theoretic framework for approximating concepts,” International Journal of Man-Machine Studies, vol. 37, no. 6, pp. 793–809, 1992.

H. X. Li, X. Z. Zhou, J. B. Zhao, and D. Liu, “Attribute reduction in decision-theoreticrough set model: a further investigation,” in Proceedings of the Rough Sets and KnowledgeTechnology, vol. 6954 of Lecture Notes in Computer Science, pp. 466–475, 2011.

D. Liu, T. Li, and D. Ruan, “Probabilistic model criteria with decision-theoretic rough sets,” Information Sciences, vol. 181, no. 17, pp. 3709–3722, 2011.

X. Y. Jia, W. H. Liao, Z. M. Tang, and L. Shang, “Minimum cost attribute reductionin decision-theoretic rough set models,” Information Sciences, vol. 219, pp. 151–167, 2013.

D. Liu, Y. Yao, and T. Li, “Three-way investment decisions with decision-theoretic rough sets,” International Journal of Computational Intelligence Systems, vol. 4, no. 1, pp. 66–74, 2011.

Y. Yao and Y. Zhao, “Attribute reduction in decision-theoretic rough set models,” Information Sciences, vol. 178, no. 17, pp. 3356–3373, 2008.

Z. T. Gong and B. Z. Sun, “Probability rough sets model between different universes and its applications,” in Proceedings of the 7th International Conference on Machine Learning and Cybernetics (ICMLC '08), pp. 561–565, July 2008.

W. Ma and B. Sun, “Probabilistic rough set over two universes and rough entropy,” International Journal of Approximate Reasoning, vol. 53, no. 4, pp. 608–619, 2012.

B. Sun, W. Ma, H. Zhao, and X. Wang, “Probabilistic fuzzy rough set model overtwo universes,” in Rough Sets and Current Trends in Computing, pp. 83–93, Springer, 2012.

Y. Y. Yao and T. Y. Lin, “Generalization of rough sets using modal logic,” Intelligent Automation and Soft Computing, vol. 2, pp. 103–120, 1996.

X. He, F. Min, and W. Zhu, “A comparative study of discretization approaches for granular association rule mining,” in Proceedings of the Canadian Conference on Electrical and Computer Engineering, pp. 725–729, 2013.

F. Min, Q. Liu, and C. Fang, “Rough sets approach to symbolic value partition,” International Journal of Approximate Reasoning, vol. 49, no. 3, pp. 689–700, 2008.

F. Min and W. Zhu, “Granular association rules for multi-valued data,” in Proceedings of the Canadian Conference on Electrical and Computer Engineering, pp. 799–803, 2013.