Mathematical Problems in EngineeringVolume 2011 (2011), Article ID 745257, 21 pagesdoi:10.1155/2011/745257

Research Article

Analysis of the Emergence in Swarm Model Based on Largest Lyapunov Exponent

Yu Wu,¹ Jie Su,¹ Hong Tang,¹ and Huaglory Tianfield²

¹Network and Computation Research Center, Chongqing University of Posts and Telecommunications, Chongqing 400065, China²School of Engineering and Computing, Glasgow Caledonian University, Cowcaddens Road, Glasgow G4 0BA, UK

Received 6 January 2011; Accepted 20 June 2011

Academic Editor: Mohammad Younis

Copyright © 2011 Yu Wu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

Emergent behaviors of collective intelligence systems, exemplified by swarm model, have attracted broad interests in recent years. However, current research mostly stops at observational interpretations and qualitative descriptions of emergent phenomena and is essentially short of quantitative analysis and evaluation. In this paper, we conduct a quantitative study on the emergence of swarm model by using chaos analysis of complex dynamic systems. This helps to achieve a more exact understanding of emergent phenomena. In particular, we evaluate the emergent behaviors of swarm model quantitatively by using the chaos and stability analysis of swarm model based on largest Lyapunov exponent. It is concluded that swarm model is at the edge of chaos when emergence occurs, and whether chaotic or stable at the beginning, swarm model will converge to stability with the elapse of time along with interactions among agents.

1. Introduction

Collective intelligence brings up a bottom-up approach, which is essentially different from the top-down one as in conventional systems. The bottom-up approach incites complex global behaviors through local interactions among agents [1]. Collective intelligence provides an effective approach to solving complex problems including adaptation to dynamic environments.

Prediction and control are two main concerns with emergent behaviors. In order to predict emergent behaviors, the first thing is analysis and evaluation of dynamic behaviors of systems. Wolf et al. presented an “equation-free” method to analyze and evaluate the trends of systems [2]. Zhu presented a formal theory, called Scenario Calculus, to reason about the emergent behaviors of multiagent systems [3]. Gazi and Passino simulated and observed the characteristics of behaviors under different conditions to analyze the stability of social foraging swarm [4]. Pedrami and Gordon used an additional controllable variable to study the changes of interior energy of swarm system [5].

On the control of emergent behaviors, chaos analysis was employed to study the behaviors of swarming. Qu et al. utilized nonlinear chaos time series to control emergent behaviors [6]. Ishiguro et al. presented an immunological approach to controlling the behavior of self-organized robots [7, 8]. Meng et al. presented an algorithm integrating ant colony optimization and particle swarm optimization to build distributed multiagent systems [9]. Waltman and Kaymak studied multiagent Q-learning for deciding how to behave in an unknown environment [10].

Generally speaking, current research mainly uses theoretical analysis or simulation method to study the emergent behaviors of swarm model and mostly stops at observational interpretations and qualitative descriptions of emergent phenomena. The main limitation of observational approach lies in that it is hard to cover all scenarios and operating conditions possible of swarm model, including critical phenomena. Moreover, gaps often exist unavoidably between practical situations, which are very complicated, and theoretical analysis. Therefore, identifying appropriate system characteristics is very important for quantitative study on the emergence of swarm model. Given that the emergence of swarm model is nonlinear, it is our belief that it is relevant and necessary to look at the potential relationships between the emergence of swarm model and the fundamental system characteristics as we would normally do to complex dynamic systems, particularly, chaos, stability, and so forth.

As to emergent behaviors of swarm model, our earlier work simulated the swarm model on Matlab and used a rough-set-based data mining method to select its kinetic parameters. The results show that the kinetic parameters do affect the shapes of swarm model [11]. Built upon that, in this paper, we will present a quantitative study on the emergent behaviors under different shapes of swarm model.

There are various system characteristics usable to evaluate complex dynamic systems. Lyapunov exponent plays an important role relating to chaos. The largest Lyapunov exponent (LLE) of a dynamic system can be obtained from the time series of any observable variable through phase space reconstruction. A system is chaotic when it has a positive LLE, while a system is stable when it has a negative LLE [12].

The purpose of this paper is to study the causes for and governing laws of the emergent behaviors in general collective intelligence systems, but not to be confined to specific algorithms. For this purpose, we need to adopt a representative and universal model for our study. We find that swarm model is of natural affinity to social insects and animal colonies and is subject to least subjective effects from designers. Therefore, we adopt swarm model for our theoretical study on the emergence of collective intelligence systems. We envisage that once proper theoretic methods can be formed for the emergent behaviors of swarm model, it is then possible to expand such generic methods to specific algorithms and application models, such as particle swarm optimization, granular swarm, vicsek fractal, and so forth.

This paper will present a quantitative study on the emergence of swarm model, which will help achieve a more exact understanding of emergent phenomena. For this purpose, we will reconstruct phase space, and calculate best time delay, embedding dimension and average period for the time series of agents in swarm model. Then, LLE of swarm model is calculated using small data set algorithm, and the relationships between chaos and stability and the emergence of swarm model are analyzed based on LLE. Finally, a quantitative evaluation will be conducted on the emergence of swarm model through calculating LLE at the emergent time and the evolution of LLE over time.

2. Swarm Model and Emergence Analysis Methods

2.1. Swarm Model

A typical model for studying emergence in swarm [13, 14] is inspired from flocks of flying birds. An individual in a swarm is called an agent. Agents interact according to specified interaction rules. Through interactions among agents, the whole system is getting self-organized, which is adaptable to the environment. The relationship from local interactions to global behaviors is intrinsically nonlinear and emergent.

The swarm model used here was proposed by Spector and Klein [13] based on Craig Reynolds’ classic “boids” model [14]. The local environments and each agent’s parameters determine the directions and speeds of their flights. At each time step of the simulation, an agent’s instant acceleration vector is calculated as follows: where is the weight of vector , which is determined by the state of the simulated world; is the desired distance that an agent tries to maintain with its neighbors; is a vector that points to the neighbors within a distance of d; is a vector describing the center of the simulated world; is the average of the neighbors’ velocities; is a vector toward the center of gravity of the neighbors; is a random unit-length vector; is the summation of behavioral tendencies with weights; is an agent’s instant acceleration vector at each time step (), and is the maximum acceleration of an agent.

2.2. Emergence Analysis Methods

2.2.1. Reconstruction of Phase Space

In 1980, Package alleged that it was possible to rebuild the dynamic law of a system by reconstructing an “equivalent” space with a one-dimension observable variable. Takens established a mathematical basis for this theory. The basic idea is that the trajectory of the reconstructed phase space reflects the dynamic law of the system. Although this method builds the phase space by only using the data of one variable over time, the couplings of this variable with the other variables manifest that the evolution of this variable over time could represent the dynamic law of the global system [15]. An m-dimension phase space can be reconstructed from the time series of one observable variable in system to obtain a set of vectors:

2.2.2. Best Delay Time and Embedding Dimension

To reconstruct the phase space from time series, appropriate interval of sampling () should be given in addition to embedding dimension (m). can be arbitrary theoretically. However, in practice, should be determined by fail and trial method [16]. In 1986, Fraser and Swinney pointed out that the autocorrelation function only considered the linear relationship of variables. In order to consider the general interdependency between two variables, the best delay time to reconstruct the phase space should be the delay time by which the mutual information function between the two reconstructed variables reaches its first minimum [17]. We will use the C-C algorithm [18] to calculate the best delay time and the embedding dimension. After the reconstruction of phase space by (2.2), the correlative integral of each time series can be computed from a cumulative distribution function which describes the probability by which the distance between any two points is within radius : where is Heaviside function, which equals to zero if is positive, and 1 if is negative.

Then, , the maximum deviation of over all radius ’s, can be calculated as below. When →∞,

The best delay time is the first local minimum of , which can be obtained as below For a time series with a period of , at , where is an integer, both and should be zero. The value of time window results from the global minimum of , Then, the embedding dimension can be obtained as below

2.2.3. Small Data Set Method

There are two main approaches to calculating LLE, including Wolf method and Jocobian method [19]. Wolf method is suitable for the circumstance where the time series is with no noise and the small vectors in the cut space are highly nonlinear. Jocobian method fits to the circumstance where the time series is with heavy noise and the small vectors in the cut space are nearly linear. In 1993, Rosenstein et al. proposed a small data set-based approach to calculating LLE [20].

A chaotic system is described by the strange attractors on the irregular trajectories in the phase space. One of the major characteristics of strange attractors is that exponents of nearby points are isolated. This means that a system whose initial state is entirely certain could inevitably change away. Such a behavior reflects that the system is sensitive to initial conditions. Lyapunov exponent quantitatively describes the dynamic property of strange attractors [19].

Lyapunov exponent represents the divergence rate () or convergence rate () on average. LLE () determines the speed of trajectories surrounding a strange attractor. The small data set method proposed by Rosenstein for calculating LLE is better than Wolf method. Rosenstein method does not need to be standardized. It reduces the subjective effects and has improved efficiency and precision of prediction. Rosenstein small data set algorithm can be outlined as follows [20].

Firstly, for each point , find the nearest neighbor under a confined transient separation for phase space reconstruction where p is the average period of the time series.

Then, for each point at time , calculate the distance among neighbors

For every , at each , the average of can be calculated as below where q is the number of positive ’s. The regressed line be fitted, the slope is then the desired LLE.

3. Calculation of the Largest Lyapunov Exponent (LLE) of Swarm Model

3.1. Overall Scheme

The scheme for calculating LLE is based on the chaos analysis of complex dynamic systems. The best delay time and embedding dimension are computed first, and then the phase space is reconstructed to obtain the LLE of swarm model. The process is depicted in Figure 1. The experiment data are used to evaluate chaos and stability of the system quantitatively. Since the time series of each variable represents the global evolution of the whole system, it is possible to study the chaotic behaviors of the system according to the time series of a single variable.

Figure 1: The process of calculating LLE from small data sets.

The time series in our study are the positions of the 20 agents during 3000 seconds. The initial parameters are the thirteen groups of model parameters from Kwong and Jacob [21], and the additional seventeen groups of model parameters were derived from them [11]. In summary, 15 model parameter groups will bring forth emergent phenomena, referred to as cluster shape, circle shape, and line shape, five groups each, respectively, and the other 15 groups will not, referred to as scatter shape. The corresponding LLEs are calculated to analyze the chaos and stability of swarm model, which will be used to evaluate the emergence of swarm model quantitatively. The model parameter groups are shown in Table 1.

Table 1: Model parameter groups.

Shape

Cluster 1
7.00
10.00
8.00
7.00
8.00
8.00
38.00
0.46

Cluster 2
5.00
7.00
2.00
5.00
6.00
6.00
40.00
0.23

Cluster 3
12.00
13.00
6.00
8.00
4.00
13.00
39.00
0.35

Cluster 4
15.00
8.00
4.00
6.00
3.00
9.00
43.00
0.28

Cluster 5
8.00
9.00
5.00
7.00
5.00
12.00
35.00
0.36

Circle 1
2.00
5.00
1.00
7.00
3.00
5.00
38.00
0.43

Circle 2
1.00
2.00
3.00
10.00
2.00
6.00
38.00
0.01

Circle 3
2.00
10.00
4.00
6.00
1.00
7.00
41.00
0.23

Circle 4
1.50
6.00
2.50
8.00
2.00
9.00
39.00
0.20

Circle 5
1.50
9.00
3.00
7.00
2.00
9.00
36.00
0.25

Line 1
4.00
10.00
8.00
7.00
4.00
9.00
40.00
0.01

Line 2
5.00
8.00
7.00
8.00
5.00
13.00
38.00
0.14

Line 3
9.00
9.00
5.00
7.00
4.00
8.00
37.00
0.25

Line 4
7.00
7.00
6.00
6.00
3.00
10.00
39.00
0.5

Line 5
5.00
8.00
7.00
5.00
3.00
7.00
36.00
0.34

Scatter 1
6.00
9.00
1.00
5.00
8.00
36.00
11.00
0.59

Scatter 2
8.00
17.00
6.00
7.00
10.00
20.00
6.00
0.40

Scatter 3
2.00
4.00
5.90
10.00
3.00
8.10
11.30
0.85

Scatter 4
8.00
8.90
6.20
10.30
5.00
12.00
13.50
0.56

Scatter 5
3.00
4.10
2.10
7.10
6.50
12.00
11.60
0.01

Scatter 6
5.00
3.70
6.00
7.60
1.80
9.30
11.40
0.40

Scatter 7
2.00
6.70
3.00
5.40
3.00
11.10
12.00
0.47

Scatter 8
6.00
5.90
3.50
5.10
1.50
14.00
12.60
0.22

Scatter 9
3.00
9.00
5.50
7.80
2.00
12.60
11.00
0.49

Scatter 10
7.00
12.30
4.60
6.10
1.90
13.20
13.20
0.08

Scatter 11
7.00
10.70
5.30
8.00
2.50
12.60
11.00
0.17

Scatter 12
5.00
10.10
3.10
7.00
3.50
10.00
12.30
0.23

Scatter 13
1.00
3.90
1.60
6.90
2.80
11.00
13.80
0.20

Scatter 14
2.00
8.00
5.60
8.60
3.20
9.00
9.80
0.53

Scatter 15
9.00
6.50
5.50
9.00
5.00
13.00
10.00
0.44

3.2. Reconstruction of Phase Space

Reconstruction of phase space is the key step for phase map analysis, fractal dimension, and Lyapunov exponent calculation. For each shape of swarm model, the phase space is reconstructed according to the method as presented in Section 2. Figure 2 shows the results of reconstruction of phase space for each shape of swarm model.

(a) Scatter

(b) Cluster

(c) Circle

(d) Line

Figure 2: Reconstruction of phase space in 3-dimention for each shape of swarm model.

Figure 2(a) shows that there is no attractor in scatter shape. Figures 2(b), 2(c), and 2(d) show that the attractors do occur during the processes. Here only 3-dimension phase maps are provided. In practice, the actual dimensions for reconstruction of phase space will depend upon the delay time and the embedding dimension.

3.3. Best Delay Time and Embedding Dimension

According to the methods as presented in Section 2, particularly (2.3)–(2.8), best delay time and embedding dimension are calculated by C-C method for each shape of swarm model, as shown in Table 2.

Table 2: Best delay time and embedding dimension calculated by C-C method.

Cluster
Circle
Line

1
2
3
4
5
1
2
3
4
5
1
2
3
4
5

11.0
20.0
20.0
3.0
8.0
12.0
8.0
13.0
33.0
20.0
10
6
25
22
14

16
2
2
40
2
18
25
11
7
9
13
28
8
5
15

Scatter

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15

21.0
24.0
11.0
17.0
8.0
16.0
11.0
11.0
37.0
19.0
11
26
27
18
20

11
2
2
12
2
2
2
2
2
2
2
9
2
2
6

Figure 3 illustrates, for one case in each shape of swarm model, how best delay time and embedding dimension are obtained by C-C method. Illustrations in Figure 3 are detailed in Table 3. Full results for all other shapes should refer back to Table 2.

Table 3: Illustration of C-C method.

Shape
Best delay time : time at the first local minimum of
Time window : time at the global minimum of
Embedding dimension :

Figure 3(a)
Scatter
21
195
11

Figure 3(b)
Cluster
11
158
16

Figure 3(c)
Circle
13
128
11

Figure 3(d)
Line
10
117
13

(a) Scatter

(b) Cluster

(c) Circle

(d) Line

Figure 3: Illustration of C-C method for best delay time and embedding dimension for one case in each shape of swarm model.

3.4. Average Period

The average period of time series can be calculated by Fast Fourier Transform (FFT). Firstly, FFT is applied to the time series of swarm model

Then, the power spectrum (power) and frequency are obtained as below

Finally, the average period () is readily the inverse of the frequency

Swarm is a typical model in which emergence occurs. The time series (i.e., agent’s positions) of swarm model show that the system is not necessarily periodic depending on the initial parameters. The results are shown in Table 4, where the simulation span is . Scatter shapes of swarm model with different initial parameters, which bring forth no emergence, all have their average periods of 3000 s. This means that the system is not periodic. The other shapes of swarm model, which bring forth emergence, are aperiodic, or their average periods approximate to the whole simulation time. All of these are consistent with the emergent property of swarm model.

Table 4: Average periods for shapes of swarm model on different initial parameters.

Cluster
Circle
Line

1
2
3
4
5
1
2
3
4
5
1
2
3
4
5

Period

Scatter

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15

Period

Figure 4 illustrates time series, power spectrum, and periodogram for one case in each shape of swarm model. The average period corresponds to the peak spectrum in periodogram.

(a) Scatter

(b) Cluster

(c) Circle

(d) Line

Figure 4: Illustration of time series, power spectrum and periodogram for one case in each shape of swarm model.

3.5. Calculation of Largest Lyapunov Exponent (LLE)

LLE of swarm model can be calculated using the small data set algorithm as described in Section 2, which integrates together the algorithms described above for reconstruction of phase space, best delay time and embedding dimension, and average period.

Algorithm 3.1. Small Data Set Algorithm.Inputs:Time series , embedding dimension , delay time , and average period .Output:LLE of swarm model.Step 1. Reconstruct phase space by (2.2): Step 2. After reconstruction of phase space, find the nearest neighbor for each point on the trajectory. The nearest neighbor can be found by searching for the point that minimizes the distance to point . This can be formulated as follows: where is the initial distance from the th point to its nearest neighbor, and denotes the Euclidean norm. The additional constraint imposed is that the nearest neighbor should have a transient separation greater than the average period of the time series. This allows considering each pair of neighbors as nearby initial conditions for different trajectories.Step 3. LLE can be estimated as the mean divergence rate of the nearest neighbors [22]: where is a constant, the sampling period of the time series, and the distance between the th pair of nearest neighbors after discrete-time steps, that is, seconds. In terms of geometric meaning, LLE is a factor that quantifies the exponential divergence at which the initial trajectory evolves. A random vector of initial conditions may evolve to a most unstable manifold, because exponential growth in this direction quickly dominates the growths (or contractions) along the other Lyapunov directions. Thus, LLE can be defined by the following formula: where is the mean divergence at time , and is a constant that normalizes the initial divergence. The discrete form is where is the initial divergence. By taking logarithm to both sides of (3.8), we have Step 4. Equation (3.9) represents a set of approximately parallel lines (for ), each with a slope roughly proportional to . LLE can be obtained using the “average” line of least-square fitting as below. where is the number of nonzero .

The system is chaotic when LLE is positive. Otherwise, when LLE is negative, the system is stable or convergent. It is observed that the line fittings in the scatter and cluster shapes of swarm model are poor because they are not chaotic or stable distinctly. The systems in circle and line shapes are chaotic. They have greater LLEs than the scatter and cluster shapes, and the line fittings are better. Table 5 presents LLE calculated for each shape of swarm model with different initial parameters. Figure 5 illustrates, for one case in each shape of swarm model, how the lines are least square fitted for LLE. The slope of the fitted line is LLE.

Table 5: LLEs with different initial parameters.

Cluster
Circle
Line

1
2
3
4
5
1
2
3
4
5
1
2
3
4
5

LLE
0.0095
−0.029
−0.054
0.0373
0.034
0.0082
0.0087
0.071
0.032
0.0052
0.0672
0.057
0.105
0.018
−0.039

Scatter

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15

LLE
0.0097
−0.05
0.0008
0.0148
−0.02
−0.091
0.017
0.0165
−0.018
0.003
−0.005
0.019
−0.024
0.0006
0.016

(a) Scatter

(b) Cluster

(c) Circle

(d) Line

Figure 5: Illustration on LLE as slope of least-square fitted line for one case in each shape of swarm model.

4. Emergence Analysis Based on Largest Lyapunov Exponent (LLE)

LLE is the key factor to characterize whether the time series is chaotic or stable. The chaotic system is sensitive to initial parameters. For a chaotic system with fixed model parameters, LLE is invariant. However, different initial parameters determine different shapes of swarm model. So, LLEs for different shapes of swarm model will vary. How LLEs at the emergent time vary can be used to study the relationships between chaos and stability and the emergence of swarm model quantitatively.

4.1. Emergent Time: The Time When Emergence Occurs in Swarm Model

Emergence describes the evolving process from local interactions among agents to global behaviors. Once this process goes beyond a critical point, new global properties and structures will emerge. This phenomenon is called emergence, and the time is called emergent time. As to cluster shape, the emergent time is when agents fly very closely to one another. As to circle shape, when agents locally form a circle or the trajectories of agents overall cluster and form a circle, it is emergent time. As to line shape, the emergent time is when agents arrange themselves into a line. From the trajectories of agents in swarm model as illustrated in Figure 3, the emergent time is about 200 or 400. Table 6 shows the results.

Table 6: Emergent time for each shape of swarm model.

3000
Emergent time (200/400)

Trajectory
Position
Trajectory
Position

Cluster

Circle

Line

Scatter

With the parameters for cluster shape, the emergence occurs within 3000 s experiments. The positions of agents change from random positions to some cluster situation at the critical point. Then, agents continue flying on cluster shape within 3000 s. After about 200 s, agents begin to cluster from different directions and positions. The trajectories of agents begin to converge to the same direction at about 200 s. This is the emergent time of cluster shape.

With the parameters for circle shape, the emergence occurs within 3000 s experiments. It is different from cluster shape. Agents in circle shape cluster first, and then begin to form a circle locally or “8”-shape overall. It can be seen that contrasting to the trajectories of 3000 s, agents begin to circle at about 400 s. This is the emergent time of circle shape.

With the parameters for line shape, the emergence occurs within 3000 s experiments, and the system is scattered at the beginning. At the critical point, it forms a line and agents fly in the shape of line. At about 200 s, the trajectories of agents start to coincide and line shape occurs. This is the emergent time of line shape.

With the parameters for scatter shape, agents are still at a scattered state after 3000 s. So, it is believed that emergence will not occur in scatter shape.

4.2. Chaos Analysis of Swarm Model at the Emergent Time

LLE of swarm model at the emergent time is very important for the state of swarm model. Is the system stable or is there chaotic phenomenon at the emergent time? According to the definition of critical points as stated above, LLEs of swarm model at the emergent time with different initial parameters can be calculated using the methods as described in Section 3. The results are shown in Table 7.

Table 7: LLEs of swarm model.

Group number
Shape
(3000 s)
(200 s)
(400 s)

1
Cluster 1
0.0095
0.0869
0.0334

2
Cluster 2
−0.0286
0.0503
0.0872

3
Cluster 3
−0.0539
0.1419
−0.6736

4
Cluster 4
0.0373
0.0362
0.2653

5
Cluster 5
0.0433
−0.0860
−0.0861

6
Circle 1
0.0082
1.3863
0.4454

7
Circle 2
0.0087
−0.3193
0.1329

8
Circle 3
0.0709
1.4580
0.3903

9
Circle 4
0.0322
−0.0100
0.1900

10
Circle 5
0.0052
0.0031
0.2427

11
Line 1
0.0597
0.2769
0.0188

12
Line 2
0.0574
0.0537
0.0987

13
Line 3
0.1049
0.2252
−0.1421

14
Line 4
0.0179
0.2198
−0.5999

15
Line 5
−0.0387
0.2113
−0.1791

16
Scatter 1
0.0097
0.0224
−0.0055

17
Scatter 2
−0.0518
−0.0749
−0.0528

18
Scatter 3
0.0008
0.0539
0.0368

19
Scatter 4
0.0147
−0.0516
−0.0189

20
Scatter 5
−0.0204
−0.0741
−0.2575

21
Scatter 6
−0.0909
−0.0516
−0.3070

22
Scatter 7
0.0168
−0.0774
0.0066

23
Scatter 8
0.0165
−0.0949
−0.1714

24
Scatter 9
−0.0181
−0.0868
−0.0577

25
Scatter 10
0.0028
−0.0316
−0.0283

26
Scatter 11
−0.0048
0.0404
0.0009

27
Scatter 12
0.0189
−0.1528
−0.6711

28
Scatter 13
−0.0237
0.0689
−0.1177

29
Scatter 14
0.0006
0.0066
−0.0424

30
Scatter 15
0.0159
−0.1248
−0.0917

In Table 7, the bold and italic numbers are LLEs at the emergent times, which are all positive except Group 5 (loose cluster). This means that chaos occurs when emergence occurs. However, at the points same as the emergent times, LLE of the scatter shape, which has no emergence, is almost near to zero.

Figure 6 depicts LLEs of swarm model after 3000 (s) and at the emergent time, respectively. In Figure 6(a), the graph depicts that the swarm model with the parameters for circle, cluster, or line shapes, which will bring forth emergence, is more chaotic, while the scatter shape, which will bring forth no emergence, is more stable. Figure 6(b) depicts LLE of each model parameter group at the emergent time. The shapes of swarm model which will bring forth emergence, including cluster, circle, and line, are virtually at the state of chaos (Lyapunov > 0), while the scatter shapes of swarm model, which bring forth no emergence, are stable (Lyapunov < 0).

(a) LLEs of each group

(b) LLEs at the emergent time

Figure 6: LLEs of swarm model with different initial parameters.

Figure 7 shows the states of model parameter group 5 (loose cluster) at given times, whose LLE is negative at the emergent time. By contrasting to the state of cluster shape in Table 6 with parameter group 5 (loose cluster), it can be seen that the agents in Figure 7(a) cluster less closely. Its emergent phenomenon is not obvious. This may be because the choice of emergent time is improper. Therefore, LLE at the emergent time may not be conclusive. However, in Figure 6(a), LLE of parameter group 5 (loose cluster) is a positive number, which means that there is obvious chaotic phenomenon.

(a) The state of parameter group 5 (loose cluster) after 3000(s)

(b) The state of parameter group 5 (loose cluster) after 200(s)

(c) The state of parameter group 5 (loose cluster) after 400(s)

Figure 7: The states of model parameter group 5 (loose cluster) at given times.

Generally speaking, by analyzing the chaos and LLEs of swarm model at the emergent time, the following conclusions can be drawn. For shapes of swarm model which bring forth emergence, that is, when model parameter settings are within the ranges for cluster, circle, and line shapes, around the critical time for emergence to occur, its LLEs are positive when emergence occurs, which manifests that the system is at the state of weak chaos (the LLEs are all under 0.1). If emergence is unapparent, the emergent time may be misjudged, which may lead to erroneous calculation of LLE. However, the LLE at a longer time is still positive, which manifests that chaos exists.

For shapes of swarm model which bring forth no emergence, that is, when model parameter settings are within the range for scatter shape, during the time of sampling, it is weakly stable. After the emergence has occurred, it may well be that the system gradually forms a certain structure in which the chaos disappears and instead a temporary stability appears, with LLE smaller than 0. This is illustrated by parameter Groups 5 and 15 in Table 7.

4.3. Evaluation of the Emergence of Swarm Model

In order to better reveal how LLEs of swarm model at different durations evolve, the time series is divided into 15 fractions in a time increment of 200. LLEs of each fraction of time series can be calculated and their trends on cluster, circle, line, and scatter shapes can be contrasted. LLEs in different initial parameters are shown in Figure 8.

Figure 8: Evolution of LLEs of swarm model with different initial parameters.

In Figure 8, it can be seen that at the beginning, LLEs are apparently positive or negative, which show that the swarm model with different initial parameters is chaotic or stable. However, with elapse of time along with the interactions among agents, LLEs converge to zero or near zero under some rules. With these results, conclusions can be drawn as follows.

Firstly, there are weakly chaotic phenomena in swarm model at the emergent time, except that there are weakly stable phenomena in swarm model with initial parameters for scatter shape. With elapse of time along with the interactions among agents, the weakly chaotic phenomena will wear off, and emergence will get more and more apparent. In the swarm model with the parameters for cluster, circle, and line shapes, agents continue flying in the formed shapes. The system will converge to a globally stable state.

Secondly, Figure 9 contrasts evolution of LLEs of swarm model with emergence to that of the swarm model in scatter shape. Evolution of LLEs of swarm model with emergence is different from that of swarm model in scatter shape. Figure 9(a) shows the swarm model with emergent phenomenon. LLEs evolve apparently with elapse of time along with the interactions among agents. Moreover, the swarm model, which is chaotic but with no emergence before the emergent time (LLEs are positive), gradually converges to stability with emergence. One of the best examples is Line 2. In Figure 9(b), the scatter shape with no emergence is shown. LLEs evolve the same way as Figure 9(a) at the beginning. The difference is that LLE evolves more quickly. In this case, swarm model arrives at the stable state more quickly as a whole, and while agents are at a scattered state, they as a whole remain within a relatively stable zone.

(a) Evolution of LLEs of swarm model with emergence

(b) Evolution of LLEs of swarm model with no emergence

Figure 9: Evolution of LLEs.

Thirdly, LLEs are generally very small. This means that the chaos is not quite strong and the systems are not far from stability so that no organization can be formed, or organization, if any, is inclined to dissolve at any time but are not too near any equilibrium, either, so to lose diversity and run into quiescent stability. This is the so called “critical state of self-organization” [23] and “at the edge of chaos” [24].

As the key factor to determining whether the time series of a nonlinear system is a chaotic one, LLE reflects the chaos and stability of swarm model with different initial parameters. By using LLE, relationships between chaos and stability and the emergence of swarm model can be established to evaluate the emergence quantitatively. Agents in swarm model interact locally in simple rules to induce global self-organization. Swarm model may be chaotic or stable at the beginning. However, along with the interactions among agents, which lead the systems to stability gradually, LLEs converge to zero or negative fluctuations. When emergent phenomenon grows stronger, the chaotic phenomenon gets weaker. With elapse of time, the swarm model evolves to a stable state.

5. Conclusions

According to the chaos analysis of complex dynamic systems, through integrating methods for best delay time and embedding dimension, reconstruction of phase space, and average periods, this paper has presented a small data set scheme for calculating the largest Lyapunov exponents (LLEs) of swarm model in different initial parameters. By this way, we have analyzed the relationships between chaos and stability and the emergence of swarm model at the emergent time and evaluate the emergence of swarm quantitatively in terms of evolution of LLEs of swarm model. We have reached two conclusions. Firstly, the swarm model is at the edge of chaos. Secondly, the chaos in swarm model becomes weaker while the emergence becomes stronger and with elapse of time along the interactions among agents, the swarm model will converge to stability.

We see future works mainly in the following aspects.

About system characteristics for quantitative study on the emergence of swarm model, this paper only uses Lyapunov exponent to analyze the emergence of swarm model. In the future, (i) other system characteristics may be covered, for example, correlation dimension, Kolmogorov entropy, Poincare section, and so forth; (ii) the effects of these system characteristics upon emergent behaviors need to be established, and data mining method may be employed to explore the relationships between these system characteristics and the emergent behaviors of swarm model.

In the future, relationships between these system characteristics and the emergence of swarm model will be explored via data mining. In particular, the relevant system characteristics will be analyzed via data mining to obtain the rules that affect the emergent phenomenon of swarm model. Furthermore, quantitative evaluations and interpretations on why, how, and when emergence occurs need to be established.

Observability and controllability of emergent behaviors are most challenging for swarm model. Questions may include, for example, how to analyze the system characteristics of time series in certain duration and explain its observability. On controllability, relevant system characteristics need to be defined for analysis of emergent behaviors; for example, how to formulate the system characteristics as the parameters of emergent behaviors of swarm model and establish the relevant rules via data mining to study the effect of each parameter and the controllability of emergent behaviors.

Acknowledgments

This work was supported by National Basic Research Program (“973 Program”) of China (no. 2008CB317111), National Natural Science Foundation of China (no. 60703010, no. 61040044), Program for New Century Excellent Talents in University (NCET), and (Key) Natural Science Foundation of Chongqing (2008BB2241, 2009BA2089).

References

I. Nakahori, “Management for emergent properties in the research and development process,” in Proceedings of the IEEE Conference on Engineering Management Society, pp. 491–496, Albuquerque, NM, USA, August 2000.

T. D. Wolf, G. Samaey, T. Holvoet, and D. Roose, “Decentralized autonomic computing: analyzing self-organizing emergent behaviour using advanced numerical methods,” in Proceedings of the 2nd International Conference on Autonomic Computing, (ICAC '05), pp. 52–63, Seattle, Wash, USA, June 2005.

H. Zhu, “Formal reasoning about emergent behaviors of multi-agent systems,” in Proceedings of the 17th International Conference on Software Engineering and Knowledge Engineering, pp. 280–285, San Francisco Bay, Calif, USA, July 2010.

V. Gazi and K. M. Passino, “Stability analysis of social foraging swarms,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 34, no. 1, pp. 539–557, 2004.

R. Pedrami and B. W. Gordon, “Control and analysis of energetic swarm systems,” in Proceedings of the American Control Conference, (ACC '07), pp. 1894–1899, New York, NY, USA, July 2007.

D. C. Qu, H. Qu, and Y. S. Liu, “Emergence in swarming pervasive computing and chaos analysis,” in Proceedings of the 1st International Symposium on Pervasive Computing and Applications, (SPCA '06), pp. 83–89, Urumchi, China, August 2006.

A. Ishiguro, Y. Watanabe, and Y. Uchikawa, “Immunological approach to dynamic behavior control for autonomous mobile robots,” in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '95), pp. 495–500, Pittsburgh, Pa, USA, August 1995.

A. Ishiguro, T. Kondo, Y. Watanabe, and Y. Uchikawa, “Dynamic behavior arbitration of autonomous mobile robots using immune networks,” in Proceedings of the IEEE International Conference on Evolutionary Computation, pp. 722–727, Perth, Australia, December 1995.

Y. Meng, O. Kazeem, and J. C. Muller, “A Swarm intelligence based coordination algorithm for distributed multi-agent systems,” in Proceedings of the International Conference on Integration of Knowledge Intensive Multi-Agent Systems, (KIMAS '07), pp. 294–299, Waltham, Mass, USA, May 2007.

L. Waltman and U. Kaymak, “A theoretical analysis of cooperative behavior in multi-agent Q-learning,” in Proceedings of the IEEE Symposium on Approximate Dynamic Programming and Reinforcement Learning, (ADPRL '07), pp. 84–91, Honolulu, Hawaii, USA, April 2007.

Y. Wu, K. Zhou, J. Su, and H. Tang, “Kinetic parameter mining of swarm behavior based on rough set,” Communications of SIWN, vol. 4, pp. 64–69, 2008.

D. J. Reiss, The analysis of chaotic time series, Ph.D. thesis, Georigia Institute of Technology, Thesis of Doctor of Philosophy in Physics, 2001.

L. Spector and J. Klein, “Evolutionary dynamics discovered via visualization in the breve simulation environment,” in Bilotta et al. (eds), Workshop Proceedings of Artificial Life VIII, UNSW Press, pp. 163–170, Sydney, Australia, December 2002.

C. Reynolds, “Flocks, herds, and schools: a distributed behavioral model,” Computer Graphics, vol. 21, no. 1, pp. 25–34, 1987.

F. Takens, “Detecting strange attractors in turbulence,” in Dynamical Systems and Turbulence, Lecture Notes in Mathematics, vol. 898, pp. 366–381, Springer, Berlin, Germany, 1981.

M. Otani and A. Jones, “Automated embedding and creep phenomenon in chaotic time series,” http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.23.4473&rep=rep1&type=pdf

A. M. Fraser and H. L. Swinney, “Independent coordinates for strange attractors from mutual information,” Physical Review A, vol. 33, no. 2, pp. 1134–1140, 1986.

H. S. Kim, R. Eykholt, and J. D. Salas, “Nonlinear dynamics, delay times, and embedding windows,” Physica D, vol. 127, no. 1-2, pp. 48–60, 1999.

A. Wolf, J. B. Swift, H. L. Swinney, and J. A. Vastano, “Determining Lyapunov exponents from a time series,” Physica D, vol. 16, no. 3, pp. 285–317, 1985.

M. T. Rosenstein, J. J. Collins, and C. J. De Luca, “A practical method for calculating largest Lyapunov exponents from small data sets,” Physica D, vol. 65, no. 1-2, pp. 117–134, 1993.

H. Kwong and C. Jacob, “Evolutionary exploration of dynamic swarm behaviour,” in Proceedings of the IEEE Congress on Evolutionary Computation, (CEC '03), vol. 1, pp. 367–374, Canberra, Australia, December 2003.

S. Sato, M. Sano, and Y. Sawada, “Practical methods of measuring the generalized dimension and the largest Lyapunov exponent in high dimensional chaotic systems,” Progress of Theoretical Physics, vol. 77, no. 1, pp. 1–5, 1987.

P. Bak, How Nature Works: The Science of Self-Organized Criticality, Copernicus Press, New York, NY, USA, 1996.

C. G. Langton, “Life at the edge of chaos,” in Artificial Life II, C. G. Langton, et al., Ed., Santa Fe Institute studies in the sciences of complexity, vol. 10, p. 854, Addison-Wesley, 1992.