Evidence-Based Complementary and Alternative Medicine
Volume 2015 (2015), Article ID 435085, 14 pages
http://dx.doi.org/10.1155/2015/435085

Research Article

Mining Symptom-Herb Patterns from Patient Records Using Tripartite Graph

Jinpeng Chen,¹ Josiah Poon,² Simon K. Poon,² Ling Xu,³ and Daniel M. Y. Sze⁴

¹School of Computer Science and Engineering, BeiHang University, Beijing, China
²School of Information and Technologies, University of Sydney, Sydney, NSW, Australia
³Shanghai University of Traditional Chinese Medicine, Shanghai, China
⁴RMIT University, Melbourne, VIC, Australia

Received 30 October 2014; Revised 26 January 2015; Accepted 27 January 2015

Academic Editor: Kenji Watanabe

Copyright © 2015 Jinpeng Chen et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

Unlike the western medical approach where a drug is prescribed against specific symptoms of patients, traditional Chinese medicine (TCM) treatment has a unique step, which is called syndrome differentiation (SD). It is argued that SD is considered as patient classification because prior to the selection of the most appropriate formula from a set of relevant formulae for personalization, a practitioner has to label a patient belonging to a particular class (syndrome) first. Hence, to detect the patterns between herbs and symptoms via syndrome is a challenging problem; finding these patterns can help prepare a prescription that contributes to the efficacy of a treatment. In order to highlight this unique triangular relationship of symptom, syndrome, and herb, we propose a novel three-step mining approach. It first starts with the construction of a heterogeneous tripartite information network, which carries richer information. The second step is to systematically extract path-based topological features from this tripartite network. Finally, an unsupervised method is used to learn the best parameters associated with different features in deciding the symptom-herb relationships. Experiments have been carried out on four real-world patient records (Insomnia, Diabetes, Infertility, and Tourette syndrome) with comprehensive measurements. Interesting and insightful experimental results are noted and discussed.

1. Introduction

Traditional Chinese medicine (TCM) has a long history and has been accepted as one of the main medical approaches in China [1]. Many of the herbal medicines used in today’s clinical practice and some of the traditional Chinese medicine preparation has been used in human patients for thousands of years, which has been successfully applied to the treatment of many diseases, such as insomnia, diabetes, infertility, and Tourette syndrome. Unlike the western medical approach where a drug is prescribed against specific symptoms of patients, TCM treatment has a unique step, which is called syndrome differentiation (SD). It is argued that SD is, in fact, patient classification because, prior to the personalization of the most appropriate formula, a practitioner has to label a patient belonging to a particular class (syndrome) for a set of relevant formulae. Hence, to detect the patterns between herbs and symptoms via syndrome is a challenging problem; finding these patterns can help prepare a prescription that contributes to the efficacy of a treatment.

In recent years, interest in TCM has increased globally and the application of data mining to TCM [2–4] is also getting more attention. However, most of the previous research was related to the extraction of core herbs or to mine herb-herb relationships [1, 5, 6] from a network of herbs. We term this kind of network as a homogeneous information network, that is, network consisting of only one type of objects (herb in this example). When a network contains different types of objects (such as herbs, symptoms, and syndromes), we refer to them as heterogeneous information networks. Since heterogeneous information networks are not well studied, this has become the motivation of our work.

In general, a homogeneous information network can be derived from a heterogeneous information network, for example, an herb-herb network can be derived from a symptom-syndrome-herb network by a projection on herbs only. A heterogeneous information network is different from a homogeneous information network because it carries richer information than its corresponding projected homogeneous information networks. Therefore, it aimed to discover herb-symptom patterns, via syndromes, from a heterogeneous information network, which contains different types of attribute values associated with objects. To the best of our knowledge, this is the first attempt towards mining herb-symptom patterns in TCM utilizing heterogeneous information networks.

In this research, we construct the heterogeneous information network leveraging the tripartite graph. Our heterogeneous information network contains multiple types of objects, such as herb, symptom, syndrome, and multiple types of links defining different relations among these objects, such as links existing between herbs and syndromes, between syndromes and symptoms, and between symptoms and herbs. Thus, the number of different types of objects there are in the network can be found out, as well as the identification of the possible links existing among objects. Furthermore, we can detect the patterns between herbs and symptoms.

The major contributions of this paper are summarized.

(1)We construct the TCM heterogeneous information network utilizing the tripartite graph.(2)We study the problem of the symptom-herb relationship prediction in TCM heterogeneous information network.(3)We propose a novel three-step prediction approach based on the TCM heterogeneous information network to discover symptom-herb patterns.(4)Experiments on real TCM patient records indicate that our proposed method can mine symptom-herb relationships with high accuracy.(5)Treatments are proven to be more effective than a direct symptom-herb relationship; that is, classifying patients into different syndromes is a crucial step in TCM treatment.

The remaining of the paper is organized as follows. We first introduce the background and preliminaries on TCM heterogeneous information networks and denote the task of symptom-herb pattern prediction in Section 2. In Section 3, we obtain some interesting observations based on TCM heterogeneous information network. We next present a novel three-step mining approach to discover the symptom-herb patterns in Section 4. We report our experiments and results in Section 5, discuss related work in Section 6, and conclude the study in Section 7.

2. Preliminaries and Problem Definition

2.1. Notations Definitions

In this work, we need to consider three types of entities: a set of herbs , a set of syndromes , and a set of symptoms . We assume that there are herbs, syndromes, and symptoms. Here, symptoms refer to something that can be observed and measured, such as fever, nausea, coughing, and weight loss. Syndrome is a special phenomenon in TCM. A TCM doctor will base upon the patient’s symptoms and classify them into one or two syndromes. After that, formulas will be prescribed according to the syndrome.

2.2. Heterogeneous Information Network

We first introduce the definitions of heterogeneous information network [7, 8], tripartite graph [9], and tritype information network, so as to study the characteristic of TCM and discuss how to find or predict symptom-herb patterns in TCM information network.

Definition 1 (heterogeneous information network). A heterogeneous information network is denoted as a directed graph with an entity type mapping function and a link type mapping function , where each entity belongs to one particular entity type , each link belongs to a particular relation type , and is a weight mapping from an edge to a real number . Notice that, when the types of entities and also the types of relations , the network is called heterogeneous information network.

Definition 2 (tripartite graph). A graph can be called as tripartite, if a set of graph nodes decomposed into three disjoint sets such that no two graph nodes within the same set are adjacent; that is, .

Definition 3 (tritype information network). Given three types of objects sets , , and , where , , and , graph is called a tritype information network on types , , and , if and , where .

Let (or or ) be the adjacency matrix of links, where equals the weight of link , which is the observation number of the link, and we thus use to define this tritype information network with weight. In the following, we use , , and denoting the object set and their type name. For convenience, we decompose the link matrix into four blocks: , , , and (or , , , and or , , , and ), each denoting a subnetwork of objects between types of the subscripts. can be denoted as

This tritype information network, one of the heterogeneous information networks, denotes the rules of how entities exist and how links should be created. And, through analyzing this tritype information network, we can know how many types of objects there are in the network and where the possible links exist. In the following, we give an example of tritype information network, which is showed in Figure 1. Here, as an abbreviation, we utilize the special letters to define these entity types, namely, representing herbs, representing symptoms, and representing syndromes. Notations and similarity relations used in definitions as well as the rest part of the paper can be found in Notation section.

Figure 1: Tripartite graph structure of TCM. Here, instances of different objects are represented by different colour nodes and links among different objects are represented by different line styles. , , and represent the number of symptom, the number of syndrome, and the number of herb, respectively.

2.3. Target Relationship Prediction

Based on the previous definitions, our goal of this work can be summarized as follows: given a tritype network , the target type , and a set of herbs , our goal is to find or predict the most reasonable herbs for each symptom , that is, how to predict the target relationship , where .

Different from symptom-syndrome patterns and syndrome-herb patterns, which are directed relationships (because patients’ syndromes are derived from a set of patients symptoms and herbs are configured by doctors according to the patients’ syndromes, symptom-syndrome patterns and syndrome-herb patterns are directed relationships.), symptom-herb patterns are undirected relationships. Intuitively, the herb-symptom relationship detection is an implicit relationship mining, which is more difficult to detect than an explicit relationship mining. However, if new herb-symptom relationships can be discovered, they are beneficial for doctors configuring the prescriptions.

2.4. Dataset

In this work, our experiments were performed on four real TCM datasets: Insomnia, Infertility, Diabetes, Tourette. These four datasets were provided by Guang’anmen Hospital, China Academy of Chinese Medical Sciences. These four datasets include the symptoms, the syndromes, and prescription information of outpatients. Here, edges are formed among objects belonging to the same prescription. Properties of these four datasets are shown in Table 1.

Table 1: Properties of four TCM data sets. Here, “—” represents that this attribute can not be included in this data set.

Insomnia
Infertility
Diabetes
Tourette

Number of prescriptions
460
852
1674
670

Number of herbs
111
251
204
189

Number of symptoms
155
389
186
—

Number of syndromes
—
106
178
98

Symptoms per herb
82.58
71.64
84.72
—

Syndromes per herb
—
24.34
29.56
20.56

Herbs per symptom
59.14
46.4
33.89
—

Herbs per syndrome
—
57.41
92.91
71.13

3. Observation

In this section, we conduct following observations based on the four TCM datasets in order to get a better understanding on the symptom-syndrome-herb patterns and structural properties of TCM tripartite network.

3.1. Entity Distribution

We first study the distribution of each entity frequency. Figure 2 plots the distribution in a log-log scale based on the Infertility dataset. In Figure 2(a), the -axis represents the 251 unique herbs, ordered by descending herb frequency. The -axis refers to the herb frequency. As reported by other authors [5, 10], we find the herb frequency to follow a power law distribution with few herbs being responsible for a high number of prescriptions. Here, the probability of a kind of herb having herb frequency is proportional to . It indicates that most herbs are rarely used, while only a small number of the herbs are frequently used. In other words, the head of the power law contains herbs that would be used more frequently and the very tail of the power law contains the infrequent herbs. The most frequent herbs were used more than 530 times by different prescriptions altogether. Similarly, same distributions can be found in Figures 2(b) and 2(c).

(a) Herb-frequency

(b) Symptom-frequency

(c) Syndrome-frequency

Figure 2: Distribution of the entity frequency in Infertility Dataset. Here, in (a), the -axis represents the 251 unique herbs, ordered by descending herb frequency. The -axis refers to the herb frequency. In (b), the -axis represents the 389 unique symptoms, ordered by descending symptom frequency. The -axis refers to the symptom frequency. In (c), the -axis represents the 106 unique syndromes, ordered by descending syndrome frequency. The -axis refers to the syndrome frequency.

In addition to the infertility dataset, we carried on similar statistical analysis with other three datasets, and the same pattern is observed in the vast majority of cases.

3.2. Link Distribution

So far, there is some existing work that explicitly addresses herb-herb patterns [5, 6]. They indicated that there are common herb pairs frequently used in the regular TCM herb prescriptions. However, few works focus on studying symptom-herb, symptom-syndrome, and syndrome-herb patterns. In this work, we extract these patterns and analyze what distribution they obey.

Figure 3 shows that the distribution of these patterns (symptom-herb, symptom-syndrome, and syndrome-herb patterns) also follows a power law distribution. In Figure 3(a), the -axis represents the 17,910 symptom-herb patterns, ordered by their cooccurrence frequency (descending). The -axis refers to the symptom-herb frequency. Furthermore, we find that 80% of all symptom-herb patterns appear only 1–3 times in the infertility dataset. Here, the probability of a kind of symptom-herb pattern having symptom-herb pattern frequency is proportional to . This indicates that there are common herb-symptom pairs frequently used in the regular TCM herb prescriptions. If we can predict these common herb-symptom pairs, it is very useful for a doctor configuring a formulae. Again, the same law distributions can be found in Figures 3(b) and 3(c).

(a) Symptom-herb distribution

(b) Syndrome-herb distribution

(c) Symptom-syndrome distribution

Figure 3: Distribution of the link frequency in Infertility Dataset. Here, in (a), the -axis represents the 17,910 symptom-herb patterns, ordered by descending symptom-herb frequency. The -axis refers to the symptom-herb frequency. In (b), the -axis represents the 6,085 syndrome-herb patterns, ordered by descending syndrome-herb frequency. The -axis refers to the syndrome-herb frequency. In (c), the -axis represents the 7,897 symptom-syndrome patterns, ordered by descending symptom-syndrome frequency. The -axis refers to the symptom-syndrome frequency.

3.3. Relationship Distribution

Furthermore, we study the relationship among symptom, syndrome, and herb. Here, the relationship also exists among symptom, syndrome, and herb. It is a one-to-many relationship, that is, the number of herbs each symptom is associated with, the number of syndromes each herb is associated with, and so forth. Figure 4 shows that the distribution of the number of herbs per symptom (syndromes per herb or syndromes per symptom) also follows a power law distribution. In Figure 4(a), the -axis represents the 389 unique symptoms, ordered by the number of herbs per symptom (descending). The -axis refers to the number of herbs per symptom. The probability of having herbs per symptom is proportional to . We can find each symptom to be labeled with 46.4 herbs on average. Also, it can be found for the occurrence frequencies of herbs per symptom where 23.2% of all herbs link to the Top 1% of symptoms. Similarly, the same law distributions can be found in Figures 4(b) and 4(c).

(a) Herbs per symptom

(b) Syndromes per herb

(c) Syndromes per symptom

Figure 4: Distribution of relationship of objects in Infertility Dataset. Here, in (a), the -axis represents the 389 unique symptoms, ordered by the descending number of herbs per symptom. The -axis refers to the number of herbs per symptom. In (b), the -axis represents 251 unique herbs, ordered by descending number of syndromes per herb. The -axis refers to the number of syndromes per herb. In (c), the -axis represents the 389 unique symptoms, ordered by the descending number of syndromes per symptom. The -axis refers to the number of syndromes per symptom.

4. Prediction Method Based on Tripartite Graph

In this section, we will introduce a novel three-step prediction approach based on the tripartite graph (-). First, we extract two types of paths, which carry different semantic meanings. In terms of these two paths, we draw three matrices, which represent different cooccurrence relationship. And then, we propose an unsupervised prediction method in order to discover symptom-herb patterns.

4.1. Extracting Paths

In a tripartite network, two entities can be connected by different paths, which carry different semantic meanings. In this work, we choose two kinds of paths in order to find the reasonable symptom-herb patterns. These two kinds of paths are taken as follows:

Path extracts the direct target relationship; it looks like the way western medicine often adopts. In western medicine, medical doctors and other healthcare professionals (such as nurses, pharmacists, and therapists) treat diseases using drugs, radiation, or surgery according to symptoms [11]. Path extracts the indirect target relationship, it is a common way TCM often adopts. In TCM, doctors first choose a series of syndromes in terms of patients’ symptoms, and, then, configure herbs on the basis of syndromes.

4.2. Constructing Matrix

After extracting paths from the tripartite graph, we can further construct matrices describing the relationship among different entities, such as symptom-herb, symptom-syndrome, and syndrome-herb. In this work, we build the three matrices, namely, symptom-herb matrix based on the path , symptom-syndrome matrix, and syndrome-herb matrix based on the path .

In addition, we also build matrices depicting the relationship among same entities, such as herb-herb, symptom-symptom, and syndrome-syndrome, in order to promote the similarity measure and find some useful symptom-herb patterns. These three matrices can be extracted based on the homogeneous information networks (here, if two herbs (or symptoms, syndromes) belong to the same prescription and they produce the positive effect when used together, we can connect these two herbs. According to this rule, the homogeneous information networks can be constructed), including herb, symptom, and syndrome homogeneous information networks.

In order to build aforementioned matrices, we define and implement multiple measurement strategies in this work. These strategies can be introduced as follows.

 (i) Frequency (). Frequency is a basic strategy, which is an observation number of cooccurrence of two entities ( and ), such as symptom-herb, symptom-syndrome, and syndrome-herb. It can be defined as :

 (ii) Jaccard Coefficient (). According to the Jaccard coefficient [12], we can normalise the cooccurrence of two entities and by calculating

 The coefficient takes the number of intersections between the two entities, divided by the union of the two entities. The Jaccard coefficient is known to be useful to measure the relevance between two objects or sets. In general, we can use symmetric measures, like Jaccard, to induce whether two entities have a related meaning. (iii) Asymmetric Measure (). The cooccurrence of two entities and can be normalised leveraging the frequency of one of the entities [13–15], for instance, using equation

  captures how often the entity cooccurs with entity normalised by the total frequency of entity . We can interpret this as the probability of a patient being diagnosed with entity given entity occuring. (iv). It is often used as a weighting factor in information retrieval and text mining [16]. In this work, we denote , which is the frequency of two entities ( and ) cooccurrence and define , which measures the importance of - patterns for the entity (or ). Thus, can be denoted as follows:

 where is the frequency of   (or ).

4.3. Symptom-Herb Patterns Prediction Method

In this subsection, we first show two similarity measures. And then, we introduce a relevance function. Finally, we proposed an unsupervised prediction method.

4.3.1. Similarity Measures

A similarity measure is a real-valued function that quantifies the similarity between two objects. In this work, taking the symptom as an example, if two symptoms are similar, they are likely to have similar frequency of symptom-herb patterns. Given symptom , , and herb , if is similar to , and there exists the - pattern, we can infer that there exists the pattern -.

As mentioned previously, we have extracted two kinds of paths and built three matrices. Also, we have built other three homogeneous matrices. Based on them, we proposed two strategies measuring the similarity of entities of the same type.

 (i) based similarity: On basis of the symptom-herb matrix and symptom-symptom matrix, we use cosine similarity and to compute symptoms similarity, respectively. By combining and , we can get based similarity. It can be denoted as

 where and . reflects the frequency similarity of symptom-herb patterns. In other words, if two symptoms are similar, they are likely to have similar frequency of symptom-herb patterns. reflects the frequency similarity of symptom-symptom patterns. In other words, if two symptoms belong to the same prescription, they are likely to be similar. (ii) based on similarity: In terms of the symptom-syndrome matrix, syndrome-herb matrix, and syndrome-syndrome matrix, we can obtain two syncretic syndrome similarities, and . Furthermore, through combining these two syncretic syndrome similarities, based on similarity can be formalized as

 where the definition of and is simlar to , but their only difference is that and are based on the symptom-syndrome matrix, syndrome-herb matrix, and syndrome-syndrome matrix. Here, = + and = + . Note that, and and , .

4.3.2. Relevance Function

In our datasets, the outcomes of all the prescriptions are classified into two categories: good and bad. When a treatment was effective, which means that if the patient recovered completely or partly from diseases in the next encounter, then the prescription of the current encounter would be categorized as “good”; otherwise, the prescription would be categorized as “bad.” In other words, when the outcome of a prescription is good, the patterns in this prescription, such as symptom-herb, symptom-syndrome, herb-herb, and others, make the positive role; otherwise, the patterns make a negative role.

In this work, relevance function is used to filter out the patterns with bad outcome. Here, the relevance function is parameterized with “relevance threshold” to provide a range of tolerance to bad outcomes. In particular, given a relevance function , the relevance threshold is used for creating the parameterized version of this relevance function, , that is formalized as

where changes over different datasets. and . Here, refers to the total number of this pattern working effectively, and is the total number of this pattern having no effect on patients. In the next section, patterns of symptom-herb that are predicted above relevance threshold (i.e., ) are sorted according to predicted rating, while patterns of symptom-herb that are below (i.e., ) are ignored.

4.3.3. Proposed Method

Up to now, we have given a systematic way to extract and build the topological features in the tripartite networks. In this subsection, we will introduce our prediction algorithm (-). Our prediction method is as follows: first, we discover nearest entities according to the similarity measures, or ; then, we predict rating for each potential entity pair; subsequently, we get Top- predicted patterns by ranking prediction rating; lastly, we get Top- list by filtering the patterns of bad outcome using relevance function. The pseudocode of - is shown in Algorithm 1.

Input: Weight Matrix

Output: Top- List

(1) Define Tri-TSPA()

(2) Begin

(3) queue ← Discover nearest entities using the similarity measures

(4) Case  1. for do

(5) +

(6)             

(7)             End for

(8) Case  2. for do

(9) = +

(10)             

(11)             End for

(12) Top- list ← Get the predicted patterns list in the term of

(13) or

(14) Top- list ← Filter the Top- list using relevance function

(15) Return Top- list

(16) End

Algorithm 1: Tri-TSPA.

In Algorithm 1, we only show the measurement strategy to calculate the rating. Actually, we can replace with , , and , respectively. In addition, based on symptom-herb patterns mining is shown in Line 4–line 7, and based on symptom-herb patterns mining is shown in Line 8–Line 11.

5. Experiments

In this section, we conduct many experiments to evaluate the effectiveness of the proposed algorithm. We show that our proposed three step prediction approach can mine a reasonable set for each symptom on the TCM networks.

5.1. Experiment Setup

We first convert these datasets into heterogeneous tripartite information networks. We construct four TCM networks from TCM datasets, which consist of three types of objects: symptoms, syndromes, and herbs. Links exist between symptoms and syndromes, syndromes and herbs, and herbs and symptoms.

In order to effectively mine symptoms-herbs patterns, we adopt two kinds of strategies: based strategy and based strategy. For each strategy, we apply four different measurement methods to set each term of each matrix related to this (or ). By combining these two kinds of strategies and four measurement methods together, we get total 8 different predicted methods. In the following section, a series of experiments will be carried on in order to find which predicted method can get the best performance.

In this work, we adopt twofold cross-validation (i.e., half training and half testing) to evaluate the performance of the prediction for each TCM network. In the training stage, we first extract two kinds of paths, symptom-herb path and symptom-syndrome-herb path. In terms of these two paths, we further build five matrices (in Section 4) according to the measurement method aforementioned (, , , and ). After collecting all associated features, a training model is then built to learn the best coefficients associated with different features in deciding the symptom-herb patterns by performing multiple experiments. In the test stage, we utilize the learned coefficients to predict the potential patterns between symptoms and herbs and record whether this pattern is to appear in the test dataset.

In addition, the Insomnia and Tourette dataset lacks the object of syndrome and symptom, respectively. In this case, we assume some virtual objects (representing syndromes or symptoms) which can be constructed according to the next method. Here, we take the Insomnia dataset as an example to explain how to construct the virtual objects, namely, syndromes. First, we can get the existing patterns based on the from Infertility and Diabetes datasets, such as ,   ; meanwhile, we can obtain the existing patterns based on the from Insomnia dataset, such as , . Second, we can further check whether the patterns based on the from Insomnia dataset exist in the dataset Insomnia or Tourette. If they exist (i.e., , ), we can assume a virtual syndrome and construct the edge between and and the edge between and (or the edge between and ). Otherwise, we only assume a virtual syndrome and produce the edges between and other symptoms (or the edges between and other herbs). Similarly, we can construct the tripartite graph based on the Tourette dataset.

5.2. Evaluation Metrics

Our proposed algorithm computes a ranking score for each candidate herb and returns the top- highest ranked herbs as the predicted list for a target symptom. To evaluate the prediction accuracy, we focus on how many symptoms-herbs patterns previously removed in the preprocessing step reappear in the predicted results. Therefore, we apply two popular performance metrics, namely, and [17–20], to capture the performance of our proposed algorithm.

is the ratio of recovered symptoms-herbs patterns to the predicted symptoms-herbs patterns. is the ratio of recovered symptoms-herbs patterns to the set of symptoms-herbs patterns deleted in preprocessing. We divide the symptoms-herbs patterns into two sets: the test set and the Top- set . Symptoms-herbs patterns that appear in both sets are members of the hit set. and are defined as follows:

5.3. Parameter Tuning

In our experiments, we divide each dataset into two parts: training set and test set. We further split the training data to validation data to optimize the parameters , , , , , , , , , and . We have varied the neighborhood size from 10 to 50 by an interval of 10 and the other nine parameters from 0 to 1 by an interval of 0.1. Using the validation data (in Infertility dataset), we have found the best to be 0.8, to be 0.2, to be 0.7, to be 0.8, to be 0.2, to be 0.3, to be 0.8, to be 0.2, to be 0.5, and to be 30. In addition, we have different values for these parameters in the other three datasets, but we get the similar experimental results. Here, we do not list all the values for these parameters because of the limitation of space.

In Figure 5, we take the neighborhood size as an example to explain how to install optimal value for each parameter. From Figure 5(a), we can see that for each Top- list the changes over the neighborhood size . We can further observe that when the neighborhood size equals 30, our proposed method gets the best performance. Also, from Figure 5(b), we have the similar results. Therefore, we set the neighborhood size as 30.

(a) Precision

(b) Recall

Figure 5: Selecting the optimal neighborhood size in Infertility Dataset. Here, in (a), the -axis represents Top- prediction. The -axis refers to Precision. In (b), the -axis represents Top- prediction. The -axis refers to Recall. These two figures can be obtained by using based strategy, which applies the measurement method . In this experiment, we set , , and as 0.8, 0.2, and 0.5, respectively.

5.4. Result and Analysis

In this section, we first evaluate the performance of four different measurement methods for two kinds of paths. And then, we compare the performance of based strategy and based strategy by using the optimal measurement method.

5.4.1. The Optimal Measurement Method

It is worth noting that a comprehensive set of experiments was conducted using every measurement method in conjunction with every evaluation metric on every dataset, and the results are very consistent across all experiments. Because of the space limitations, we show the results based on the Infertility dataset in the Figures 6 and 7. From Figure 6(a), we can see that the measurement method apparently beats all the other three measures and produces the best prediction performance in terms of . Specifically speaking, has its average , , and better than , , and , respectively. From Figure 6(b), according to , also significantly outperforms other three measures. , respectively, achieves a , a , and a improvement over , , and . Here, an interesting result is observed that JC gets the worst performance. Contrary to being known to be more useful to measure the similarity between two same type of objects, it may be due to the existence of different type of objects. Similarly, from Figure 7, we can also observe that is the best measurement method. Therefore, we should use to help choose the best value for each term in each matrix so that the mining of symptoms-herbs patterns can produce the best results.

(a) Precision

(b) Recall

Figure 6: Selecting the optimal measurement method in Infertility Dataset. Here, in (a), the -axis represents Top- prediction. The -axis refers to Precision. In (b), the -axis represents Top- prediction. The -axis refers to Recall. These two figures can be obtained by using based strategy.

(a) Precision

(b) Recall

Figure 7: Selecting the optimal measurement method in Infertility Dataset. Here, in (a), the -axis represents Top- prediction. The -axis refers to Precision. In (b), the -axis represents Top- prediction. The -axis refers to Recall. These two figures can be obtained by using based strategy.

5.4.2. The Performance of Proposed Method

In this section, we will estimate the performance of our presented - based on two kinds of paths.

First, we illustrate how our - can serve as a powerful model for predicting potential symptom-herb relationships. The prediction processing performance results can be found in Figures 8(a) and 8(b). We use two prediction processing measures to evaluate the performance of each method on four TCM datasets, which are Precision at top 30 prediction results and Recall at top 30 prediction results, denoted as and , respectively. In terms of these two measurements, one can observe that our proposed - based on can find more symptom-herb relations than the one based on , in general.

(a) Precision

(b) Recall

Figure 8: Prediction performance of our proposed method -. Here, in (a), the -axis represents Top- prediction. The -axis refers to Precision. In (b), the -axis represents Top- prediction. The -axis refers to recall. - adopts to install the reasonable value to each term for each matrix.

From Figure 8(a), we notice that our proposed method - based on improves @30 by compared with the one based on . In addition, from Figure 8(b), we also see that our proposed method - based on improves @30 by when compared with . Therefore, we can conclude that based prediction method gives a good performance overall. Here, we can see that when reaches 30, the precision of both algorithms is optimal. Meanwhile, although @50 of both algorithms reaches optimal value, the gap between @30 of both algorithms and @50 of both algorithms is very small. So we take as an optimal value to achieve optimal prediction power for the Infertility dataset.

In addition to the Infertility dataset, we tested the proposed algorithm with other three datasets, and the same pattern is observed in the vast majority of cases.

5.4.3. Discussion

The symptoms in TCM are related to the body as a whole. A certain subset of symptoms belongs to a certain syndrome, and the typical treatment of a syndrome usually follows a therapeutic principle, which refers to the use of a certain combination of herbs [21].

So far, we have mined a Top- list of herbs for each symptom (see Table 2). However, our aim is to discover an effective combination of interacting herbs for each symptom, which is useful for healing the sick. In this section, we will introduce a matching function () in order to achieve our aim.

Table 2: An Example of Top-30 List. This table can be obtained by using based strategy. Here, the third column represents symptom-herb ranking rating produced by Algorithm 1.

Symptom
Herb
Rating

Stomachache
Chiretta
7.567

Radix Paeoniae Rubra
6.765

Bupleurum
6.70

Ligustrum Japonium
6.43

Epimedium Herb
6.397

Paeonia sterniana Fletcher in Journ
6.396

Radix Polygoni Multiflori
6.167

Rhizoma Atractylodis Macrocephalae
6.0

Salvia
5.989

Astragali Radix
5.973

Tuckahoe
5.915

Licorice Roots Northwest Origin
5.899

Dioscoreae
5.659

Homo sapiens
5.549

Rehmannia root
5.438

Motherwort Fruit
5.357

Tortoise Shell
5.347

Himalayan Teasel Root
5.327

Tangerine Peel
5.209

Nutgrass Galingale Rhizome
5.176

Palmleaf Raspberry Fruit
5.165

Diverse Wormwood Herb
4.97

Plantain Seed
4.934

Bitter Orange
4.92

Safflower
4.905

Hyacinth Bean
4.876

Finger Citron
4.844

Towel Gourd Vegetable Sponge
4.819

Common Macrocarpium Fruit
4.736

Zedoary
4.736

Our matching function is as follows: first, we find all the patterns of good outcome in the dataset and then, we match the Top- list with each existed pattern, and find a longest chain, namely, a maximum effective set of interacting herbs. Our matching function is described in Algorithm 2. Here, the differences between the relevant function and the matching function are as follows: the relevant function is used for filtering the bad patterns (i.e., symptom-herb); the matching function is used for finding a maximum effective set of interacting herbs for each symptom. By using , we get an effective combination of interacting herbs for each symptom (see Table 3). Stomachache is a manifestation of various syndromes according to Chinese medicine diagnosis. The aim of Chinese medicine is to address the root cause of disease that is a syndrome rather than a single symptom; as a result, multiple herbs are used to treat a particular syndrome. According to the assessment from a TCM practitioner, the herbs in Table 3 are appropriate to stomachache and they have the properties of relieving pain or stomach-related problems. Each of these herbs has different functions, including Regulate Qi (Nutgrass Galingale Rhizome, Tangerine Peel, Dioscoreae, Rhizoma Atractylodis Macrocephalae, Bupleurum), Regulate fluid (Plantain Seed, Tuckahoe), Clear heat (Radix Paeoniae Rubra, Chiretta), Regulate blood (Motherwort Fruit, Salvia), and Nourish Yin (Himalayan Teasel Root). Here, we think our approach works in view of TCM, because when we check the original Infertility dataset, we find that most of the combinations of our Top- list of herbs exist in the original dataset.

Table 3: An effective combination of interacting herbs for symptom . Based on Table 2, this table can be obtained by using Algorithm 2.

Symptom
Herb
Rating

Stomachache
Chiretta
7.567

Radix Paeoniae Rubra
6.765

Bupleurum
6.70

Ligustrum Japonium
6.43

Epimedium Herb
6.397

Paeonia sterniana Fletcher in Journ
6.396

Rhizoma Atractylodis Macrocephalae
6.0

Salvia
5.989

Tuckahoe
5.915

Licorice Roots Northwest Origin
5.899

Dioscoreae
5.659

Motherwort Fruit
5.357

Himalayan Teasel Root
5.327

Tangerine Peel
5.209

Nutgrass Galingale Rhizome
5.176

Palmleaf Raspberry Fruit
5.165

Plantain Seed
4.934

Hyacinth Bean
4.876

Common Macrocarpium Fruit
4.736

Input: Dataset (D) and Top- List (L)

Output: A set of herbs (S)

(1) Define MF(D, L)

(2) Begin

(3)  ← Discover the existed patterns of good outcome in D

(4) S ← Match L with each one of , and delete patterns of bad

(5)         outcome in L.

(6) Return S

(7) End

Algorithm 2: MF.

6. Related Work

TCM network and its properties are researched in many fields. One of these fields is how to explore the complex relationships amongst different components of TCM clinical prescriptions. So far, there are some attempts that explicitly address this aspect.

In [22], authors proposed a new methodology of clinical decision of pulmonary tuberculosis, which can adapt the features of TCM and can be applied to other contagious diseases. This method increased the possibility and accuracy of online diagnosis and treatment especially on contagious diseases. In [23], they presented a new approach to systematically generate combinations of interacting herbs that might lead to good outcome. Their approach was tested on a dataset of prescriptions for diabetic patients to verify the effectiveness of detected combinations of herbs. Their approach is able to detect effective higher orders of herb-herb interactions with statistical validation. In this work, we also consider the factor of good outcome, but we focus on how to improve the algorithm accuracy using good outcome. In [24], they introduced a framework to explore the complex relationships amongst herbs in TCM clinical prescriptions using Boolean logic. In [25], authors put forward a framework which can be used to extract synergistic herbal combinations in a variety of clinical situations. They found that not only the herbs (present herbs) necessary for a positive outcome, but the choice of some other herbs (absent herbs) may have a negative impact on the outcome. In [5], they introduced a two-stage analytical approach. This method first uses hierarchical core subnetwork analysis to preselect the subset of herbs that have high probability in participating in herb-herb interactions and, then, detects strong attribute interactions in the preselected subset by applying MDR. In [26], a new parameter-free algorithm was designed to systematically generate a set of combinations of interacting herbs that leads to good outcome. So far, most of these researches were related to how to extract core herbs or mine herb-herb relationships, which focused on the homogeneous information networks consisting of only one type of objects. In this work, we try to extract the symptom-herb relationships based on the heterogeneous information network.

Another line similar to our research problem is the relationship mining task in heterogeneous information network [27, 28], which involves different types of objects and relations. However, these studies have a different focus compared with our work. In [27], they constructed a heterogeneous biological information network by combining multiple different databases and interaction information in order to find multidrug prescriptions that are effective and safe. In [28], they proposed MedRank, a new network-based algorithm that ranks heterogeneous objects in a medical information network. In this work, we aim at mining symptom-herb patterns in the TCM heterogeneous information network.

7. Conclusion

In this work, we put forward a novel three-step prediction approach to mine symptom-herb relationships effectively and efficiently. Experiments on the TCM network show that our method can find symptom-herb relationships with much higher accuracy using heterogeneous topological features. The results have shown that the performance is indeed superior when the symptoms are mapped to herbs via syndromes, rather than a direct mapping between symptoms and herbs. In other words, syndrome differentiation (patient classification) is a crucial step to a successful treatment in TCM. In the future, we intend to extend our work in the following three directions. Firstly, a new measure to estimate the performance in the proposed method should be explored. Secondly, another novel similarity measure method should be studied to capture the rich topological features. Thirdly, a new matching function to improve the predictive performance should be sought.

Notations

: | Symptom
: | Syndrome
: | Herb
: | The path of symptom-herb
: | The path of symptom-syndrome-herb
: | The similarity based on _Path
: | The similarity based on - matrix
: | The similarity based on - matrix
: | The similarity based on _Path
: | The similarity based on - matrix
: | The similarity based on - matrix
: | The similarity based on - matrix.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work was done when the first author was a visiting student in the University of Sydney. This work is supported by the project of National Natural Science Fund (no. 81173226), National Natural Science Foundation of China under Grant no. 61202238, the Graduate School of Beihang University Scholarship Fund, and the award from the China Scholarship Council (student no. is 201406020044). The assessment of the effective set of herbs was also contributed by Dr. Diana Jun.

References

J.-L. Tang, B.-Y. Liu, and K.-W. Ma, “Traditional Chinese medicine,” The Lancet, vol. 372, no. 9654, pp. 1938–1940, 2008.

J. Zhu, S. Ju, and Y. Xin, “Data mining based approach to preprocessing TCM data set,” Computer Engineering, vol. 15, article 98, 2006.

H. Yang, J. Chen, S. Tang et al., “New drug R&D of traditional chinese medicine: role of data mining approaches,” Journal of Biological Systems, vol. 17, no. 3, pp. 329–347, 2009.

X. W. Wang, H. B. Qu, and J. Wang, “A quantitative diagnostic method based on data-mining approach in TCM,” Journal of Beijing University of Traditional Chinese Medicine, vol. 28, no. 1, pp. 4–7, 2005.

X. Zhou, P. Josiah, P. Kwan et al., “Novel two-stage analytic approach in extraction of strong herb-herb interactions in TCM clinical treatment of insomnia,” in Medical Biometrics, pp. 258–267, Springer, Berlin, Germany, 2010.

J. Poon, S. Poon, D. Yin et al., “Studying herb-herb interaction for insomnia through the theory of complementarities,” in Proceedings of the IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW '10), pp. 722–726, IEEE, December 2010.

Y. Sun, R. Barber, M. Gupta, C. C. Aggarwal, and J. Han, “Co-author relationship prediction in heterogeneous bibliographic networks,” in Proceedings of the International Conference on Advances in Social Networks Analysis and Mining (ASONAM '11), pp. 121–128, IEEE, July 2011.

Y. Sun, J. Han, X. Yan, P. S. Yu, and T. Wu, “Pathsim: meta path-based top-k similarity search in heterogeneous information networks,” PVLDB, vol. 4, no. 11, pp. 992–1003, 2011.

A. Sani, P. Coussy, C. Chavet, and E. Martin, “An approach based on edge coloring of tripartite graph for designing parallel LDPC interleaver architecture,” in Proceedings of the IEEE International Symposium of Circuits and Systems (ISCAS '11), pp. 1720–1723, IEEE, May 2011.

A.-L. Barabási and R. Albert, “Emergence of scaling in random networks,” Science, vol. 286, no. 5439, pp. 509–512, 1999.

http://www.cancer.gov/dictionary?cdrid=454743

C. E. Thormann, M. E. Ferreira, L. E. A. Camargo, J. G. Tivang, and T. C. Osborn, “Comparison of RFLP and RAPD markers to estimating genetic relationships within and among cruciferous species,” Theoretical and Applied Genetics, vol. 88, no. 8, pp. 973–980, 1994.

P. Mika, “Ontologies are us: a unified model of social networks and semantics,” in The Semantic Web—ISWC 2005: 4th International Semantic Web Conference, ISWC 2005, Galway, Ireland, November 6–10, 2005, vol. 3729 of Lecture Notes in Computer Science, pp. 522–536, Springer, Berlin, Germany, 2005.

M. Sanderson and B. Croft, “Deriving concept hierarchies from text,” in Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '99), pp. 206–213, ACM Press, 1999.

P. Schmitz, “Inducing ontology from Flickr tags,” in Proceedings of the Collaborative Web Tagging Workshop (WWW '06), 2006.

http://www.tfidf.com/

U. Shardanand and P. Maes, “Social information filtering: algorithms for automating ‘word of mouth’,” in Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 210–217, ACM Press, Denver, Colo, USA, May 1995.

J. Chen, H. Gao, Z. Wu, and D. Li, “Tag co-occurrence relationship prediction in heterogeneous information networks,” in Proceedings of the 19th IEEE International Conference on Parallel and Distributed Systems (ICPADS '13), pp. 528–533, IEEE, December 2013.

J. Chen, Y. Liu, Z. Wu, M. Zou, and D. Li, “Recommending interesting landmarks in photo sharing sites,” Neural Network World, vol. 24, no. 3, pp. 285–308, 2014.

J. Chen, Y. Liu, J. Hu, W. He, and D. Li, “A novel framework for improving recommender diversity,” in International Workshop on Behavior and Social Informatics (BSI '13), Conjunction with Pacific-Asia Conference on Data Mining and Knowledge Discovery (PAKDD '13), Brisbane , Australia, April 2013.

J. Poon, Z. Luo, and R.-S. Zhang, “Feature representation in the biclustering of symptom-herb relationship in Chinese medicine,” Chinese Journal of Integrative Medicine, vol. 17, no. 9, pp. 663–668, 2011.

Y. Yang, “Data mining on prescription, herbal pairs, and pattern identification of pulmonary tuberculosis cases,” in Proceedings of the IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW '12), pp. 332–335, IEEE, October 2012.

S. K. Poon, J. Poon, M. McGrane et al., “A novel approach in discovering significant interactions from TCM patient prescription data,” International Journal of Data Mining and Bioinformatics, vol. 5, no. 4, pp. 353–368, 2011.

A. Su, S. K. Poon, and J. Poon, “Discovering causal patterns in TCM clinical prescription data using set-theoretic approach,” in Proceedings of the IEEE International Conference on Bioinformatics and Biomedicine (BIBM '13), pp. 242–247, Shanghai, China, December 2013.

S. K. Poon, K. Fan, J. Poon et al., “Analysis of herbal formulation in TCM: infertility as a case study,” in Proceedings of the IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW '11), pp. 868–872, IEEE, Atlanta, Ga, USA, 2011.

J. Poon, S. Poon, D. Yin et al., “Studying herb-herb interaction for insomnia through the theory of complementarities,” in Proceedings of the IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW '10), pp. 722–726, IEEE, December 2010.

K. Lee, S. Lee, M. Jeon, J. Choi, and J. Kang, “Drug-drug interaction analysis using heterogeneous biological information network,” in Proceedings of the IEEE International Conference on Bioinformatics and Biomedicine (BIBM '12), pp. 1–5, October 2012.

L. Chen, X. Li, and H. Han, “MedRank: discovering influential medical treatments from literature by information network analysis,” in Proceedings of the Australasian Database Conference (ADC '13), 2013.