Journal of Complex Systems

Volume 2013 (2013), Article ID 675818, 7 pages

http://dx.doi.org/10.1155/2013/675818

Research Article

A Small Morris-Lecar Neuron Network Gets Close to Critical Only in the Small-World Regimen

Juan Luis Cabrera,¹ Johans Hoenicka,1,2 and Daniel Macedo¹

¹Laboratorio de Dinámica Estocástica, Centro de Física, Instituto Venezolano de Investigaciones Científicas, Caracas 1020-A, Venezuela

²Instituto de Física de Líquidos y Sistemas Biológicos, CCT-CONICET La Plata, UNLP, 789 Calle 59, 1900 La Plata, Argentina

Received 29 March 2013; Revised 11 September 2013; Accepted 16 September 2013

Academic Editor: Julián Candia

Copyright © 2013 Juan Luis Cabrera et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

Spontaneous emergence of neuronal activity avalanches characterized by power-law distributions is known to occur in different types of nervous tissues suggesting that nervous systems may operate at a critical regime. Here, we explore the possible relation of this dynamical state with the underlying topology in a small-size network of interconnected Morris-Lecar neurons. Studying numerically different topological configurations, we find that, very close to the efficient small-world situation, the system self-organizes near to a critical branching process with observable distributions in the proximity of a power law with exponents similar to those reported in the experimental literature. Therefore, we conclude that the observed scaling is intimately related only with the small-world topology.

1. Introduction

The spontaneous emergence of neuronal activity avalanches showing power-law distributions has been found in superficial layers of cortex, both in vitro [1–3] and in vivo [4, 5], in the spike activity of dissociated cortex cultures [6, 7], across the sleep-wake cycle [8] and in several other cases. Although the network architecture causing this behavior is not currently known, avalanches have been found in simulations of networks with scale-free [7, 9, 10], fully connected [11], random [12], and nearest-neighbors [10, 13] topologies. In this work, we show that, even in a small neural network composed of 64 neurons, activity close to a power law results from a small-world (SW) network topology working also close to critical branching dynamics. This is achieved considering the effect of long-range connections (shortcuts) on the spontaneous activity of a network of Morris-Lecar neurons. Simulations show that, for a certain amount of added shortcuts, the system is able to reach an SW regime where close-to-power-law avalanches of activity are observed without requiring tuning of parameters. In the SW regime, numerically calculated avalanche size and lifetime probability distributions are quite close to the experimentally observed power laws, [1, 2, 6, 7] with exponents −3⁄2 and −2, respectively.

2. Materials and Methods

Consider a set of coupled Morris-Lecar neurons forming a ring through weighted synaptic interactions. We use the version of the Morris-Lecar (ML) model [14] proposed by Rinzel and Ermentrout [15] in particular. The ML model results from the dimensional reduction of the original Hodgkin and Huxley model (HH) [16] of membrane conductivity. In the ML model, two kind of channels, voltage gated Ca⁺⁺ channels and voltage, gated delayed rectifier K⁺ channels, are present. The calcium current plays the role of Na⁺ current in the original HH system. Thus, the membrane potential equation, under the action of an input , has the following form:

The functions , , and are

In these equations, is the fraction of open channels; acts as an instantaneous activation of channels; is a relaxation constant for each given value of membrane potential ; is the membrane capacitance; , , and are constants with conductance dimension; , , and are the resting potentials for the two different kinds of ions and for the leakage current; , , , , and are constants.

The system described by (1)-(2) is known to be a sufficiently exact model for biologically plausible spiking activity of neurons. In particular, the ML model is able to reproduce quite correctly the all-or-none signal emission, oscillations associated with a Hopf bifurcation leading to spike trains, bistability behavior given by the coexistence of a stable steady-state and a stable oscillation and bursting with a slowly varying injected current. Figure 1 shows the temporal evolution of a neuron’s membrane potential. In the following, for a set of neurons, each neuron is submitted to synaptic stimulation from the rest of the neurons in the network via the term .

Figure 1: Time evolution of the membrane potential obtained with the Morris-Lecar model.

The synaptic interaction is described as

The network is built under the assumption that each neuron is connected to the remaining neurons. The connection strength depends on the synaptic weights chosen to obey a Gaussian dependence on the distance, , separating neuron and the reference neuron ; that is, . The parameter controls the range of interactions between cells. We use such that the mutual interaction vanishes for separations . represents an amplitude factor setting the efficiency of the synaptic contact with respect to the size of the network. In (3), the term is associated with the saturation level of the presynaptic neuron that is represented as a sigmoid; the voltage difference represents whether the synapses are inhibitory or excitatory. In this setup, there is not a fixed number of inhibitory (or excitatory) neurons but the effect of a presynaptic neuron will depend on the sign of this term. However, from the snapshots of the activity of a neuron, it is known that inhibition occurs approximately during 10% of the time course. Therefore, the network evolves with a dynamically changing inhibition with this approximate proportion. The network is mainly excitatory: we tuned it to produce self-sustained oscillations such that its activity does not turns off indefinitely; that is, if the activity is turned off later it will turn on autonomously without external intervention. has been chosen such that single neurons are in a limit cycle oscillation driven by ; neurons can be on or off depending on this value. We simulate neurons with periodic boundary conditions. The interaction, at a first neighbors level, depicts a ring as in the starting configuration of [17]. To avoid isolated groups, long-range interaction is achieved by randomly adding, rather that rewiring, a fixed number of shortcuts, [18]. The effective distance between two neurons is reduced when a shortcut is included. Such a long-range connection increases the synaptic interaction because of the unit separation distance, . In our simulations, there is no noise present; our goal is to isolate the effect of the long-range connectivity and its effect on the appearance of critical behavior or a behavior close to it.

3. Results and Discussion

Temporal evolution starts from a set of initial conditions selected randomly from a uniform distribution on mV. After a transient time, the system reaches a bistable behavior characterized by the alternance of on states, where at least one neuron is firing, and off states, where no neurons fire. It is known that, for excitatory integrate and fire neurons, self-sustained activity depends on the proportion of shortcuts [19]. In our case, for the parameters selected, and for networks with less than , bistability was not observed; the system dynamics describe a state of perpetual firing without almost no silent episodes. We focused on larger values of that were able to generate persistent alternation between avalanches of activity and silent episodes. Hereby, avalanche is understood as the dynamical state where at least one neuron is on. An avalanche starts when all neurons are off and at least one neuron turns on. An avalanche stops when at least one neuron is on and, in the next step, all neurons are off, starting a silent period or interavalanche interval. In Figure 2, a raster plot showing a temporal segment of a long avalanche is shown.

Figure 2: Raster plot showing the network’s temporal evolution during an avalanche for the case .

For each shortcuts’ proportion, we calculated the avalanche size—measured as the number of on neurons per avalanche—and the avalanche lifetime. The evolution of the avalanche size with the number of avalanche is plotted in Figure 3. Many avalanches were simulated during a long-time span for each . Given a fixed value of , the avalanche size distribution was calculated averaging very long realizations. As an illustrative case for , three realizations of 1373, 3968, and 5367 avalanches were averaged. Similar values were used for other ’s. The avalanche size distribution reveals a strong dependence on the number of shortcuts. This fact is deduced from the left column of Figure 4. For low values of —but high enough to have persistent avalanche dynamics—the distribution shows a decaying behavior. This decaying is softened around where the distribution of avalanche size gets closer to a power law with exponent −3⁄2. Note, we are not affirming that the calculated distribution is a power law but instead of that, for a particular amount of added long-range links, the distribution approaches the power law characterizing the critical behavior in experimental studies [1, 2, 6, 7]. Increasing reduces the probability of small sizes compared with large-size avalanches at the analyzed limit case with (top left Figure 4). Notoriously, the avalanche sizes obtained were very big, with quite different sizes from those reported in experimental cases [1]. To understand this, let’s consider the following: in our simulations, at each integration step (), the number of on neurons is determined. It means that, if a peak last in the on state around 6.25 msec (Figure 1), in a second, we are counting 6250 points. Lets say the avalanche includes 16 neurons, then an avalanche size of neurons will be measured. This exemplifies how a huge size can be obtained for an avalanche lasting only one second and composed only of one quarter of the network size.

Figure 3: Temporal evolution of the avalanche size plotted versus the avalanche number for .

(a)

(b)

Figure 4: Normalized probability distribution of the activity avalanches sizes (a) and branching rate (b). From top to bottom, networks with , 19 (30%), 13 (20%), 9 (15%), and 4 (7%) added shortcuts. Red line is a power law with exponent . Morris-Lecar simulation parameters are  1/(Ωcm²),  1/(Ωcm²),  1/(Ωcm²),  ,  ,  ,  mV,  mV,  mV,  mV, , ,  mA/(cm²), , , , and .

Lifetime distribution behaves in a quite remarkable similar fashion as shown in Figure 5. It can be seen that, in the case , the distribution approaches a power law but now with exponent close to as observed experimentally [1]. The inclusion of long-range connections modifies the network topology and the system dynamics which, accordingly with our results, is “driven” to a regime close to one characterized by power laws, that is, a candidate critical operating regime.

(a)

(b)

(c)

(d)

(e)

Figure 5: Normalized probability distribution of the activity avalanches lifetimes. From top to bottom, networks with 64 (100%), 19 (30%), 13 (20%), 9 (15%), and 4 (7%) added shortcuts. Red line is a power law with exponent −2. Morris-Lecar simulation parameters are the same as in Figure 4.

Next, we characterize the topology of the weighted network for different values of . For weighted nets, typical measures of the clustering, , and mean path length, , are not available as in the case for nonweighted networks. However, recent works have developed adequate metrics for weighted networks. This is the case of the global efficiency of information transmission which is inversely proportional to the average minimum path length, , and the local efficiency or fault tolerance which is proportional to the clustering coefficient, [20]. An additional and useful measure is the cost, that is, the cost involved in adding further links to a network, defined simply as the sum of edges between the regions in the graph [21]. A costly network has many edges. In terms of the information flow the small-world networks have high and : They are very efficient in global and local communication [20]. Many small-world networks in biology and sociology have been shown to have the economic property of delivering high global and local efficiency at relatively low cost [21] and have been called efficient SW networks. Details about the calculation of the efficiencies and cost can be found in [20, 21]. In our system, adding shortcuts affects both local and global efficiencies as shown Figure 6(a). Adding shortcuts increases monotonously reaching a maximum value at the larger value of . Meanwhile, adding shortcuts reduces until it reaches a minimum value after which it starts increasing for larger values of ; there are so many added links compared to the size of the network where local information flow is improved. Adding links represents almost no relative additional cost for a range of values smaller than the network size however over this range, cost increases almost exponentially. From these curves, the identification of a small-world regime is not clear. What criterion should be used to consider that both , and are high? This problem can be solved defining a simple new measure that summarizes the characteristics of an efficient SW. We propose the quantity

which is expected to peak with high global and local efficiencies and low cost. For the type of networks considered in this study, this measure behaves as depicted Figure 6(b). Surprisingly, shows a clear maximum value located around ; the case where size and lifetime distributions showed a behavior closer to the power law. Accordingly, we identify this configuration as an economic small-world [21] that shows both high global and local efficiencies and low cost.

(a)

(b)

Figure 6: (a) Global and local efficiencies and cost. (b) Behavior of normalized mean . Each different point, corresponding to a value of added shortcuts, was obtained averaging over different networks configurations with the same number of shortcuts. Red circle at the bottom plot marks the position of the maximum value at .

Further insights can be obtained studying the system branching parameter, , defined as the average number of descendants from one ancestor [22]. Given   on neurons at a given time step and , in the following time step, it is calculated as . Monitoring of for each avalanche was done continuously. shows a considerable variability and dependence on as shown in the right column of Figure 4. Most of the values obtained are over but close to the critical value , while most of the cases showed a most probable values located around . Notoriously, in the case the distribution gets closer than any other, to the critical value , while being still weakly supercritical. This result reinforces the idea that in the SW regime the behavior of this network gets closer to the critical state. The network is self-organized at a mean branching parameter indicating the weaker supercritical state in the SW regime.

4. Conclusions

It seems surprising for us that this small network may produce such differences for the distribution of sizes and lifetimes. It is revealing that, for the case identified as an efficient SW, the branching parameter approaches the value expected for the critical state. Indeed it is remarkable that, our approach not being a realistic one, results close to those experimentally obtained can be mimicked. This is particularly true considering the inclusion of the nonrealistic factor suggesting that sustained avalanche activity existing close to power law behavior does not require the consideration of realistic neuronal connectivity terms. An interesting fact is evoking that one of the underlying dynamical origins of critical avalanche dynamics in neuronal systems may not be the nature of the interconnectivity but the underlying SW network topology. There is an increasing body of evidence showing that nervous systems are connected as small-world networks at macro- and micro-scales [23]. Some works have formally identified the SW characteristics of the neural network of Caenorhabditis elegans [17], the macaque, and the cat cortical connectivity [24], in macaque brain functional networks [25, 26], in functional networks of cats’ cortical neurons [27], human brain functional networks [28–31], or compared the neural case with the behavior of other complex systems [32]. Existing approaches trying to explain the emergence of power laws in the spontaneous activity of neural networks present different limitations as the necessity of an a priori definition of a branching process and its consequent fine tuning to obtain power laws [1, 10, 12], the assumption of a topology not supported by the neurological evidence [9, 11, 13] or the absence of inhibitory neurons [13].

Our work with this tiny network (when compared with a real nervous system) suggests that there is no need to define an a priori branching process to be tuned but that the neural network itself spontaneously self-organizes in a weakly critical branching process. While topologically driven phase transitions with power-law-distributed avalanches at criticality have been reported in non SW networks [33, 34] we think results from this work may be revealing that self-organized criticality in neuronal systems could be caused by the SW topology. An aspect is already implicit in previous works [35].

Acknowledgments

Juan Luis Cabrera gratefully thanks R. Kuske for her hospitality during a sabbatical leave in the Mathematics Department of the University of British Columbia where this work was initially written. The authors thanks H. de Nobrega for his contribution to the software’s initial versions. Juan Luis Cabrera acknowledges the research support from IVIC-141 grant; Johans Hoenicka acknowledges the support from IVIC’s undergraduate fellowships. Correspondence and requests for materials should be addressed to Juan Luis Cabrera.

References

J. M. Beggs and D. Plenz, “Neuronal avalanches in neocortical circuits,” Journal of Neuroscience, vol. 23, no. 35, pp. 11167–11177, 2003.

J. M. Beggs and D. Plenz, “Neuronal avalanches are diverse and precise activity patterns that are stable for many hours in cortical slice cultures,” Journal of Neuroscience, vol. 24, no. 22, pp. 5216–5229, 2004.

C. V. Stewart and D. Plenz, “Inverted-U profile of dopamine-NMDA-mediated spontaneous avalanche recurrence in superficial layers of rat prefrontal cortex,” Journal of Neuroscience, vol. 26, no. 31, pp. 8148–8159, 2006.

E. D. Gireesh and D. Plenz, “Neuronal avalanches organize as nested theta- and beta/gamma-oscillations during development of cortical layer 2/3,” Proceedings of the National Academy of Sciences of the United States of America, vol. 105, no. 21, pp. 7576–7581, 2008.

G. Hahn, T. Petermann, M. N. Havenith et al., “Neuronal avalanches in spontaneous activity in vivo,” Journal of Neurophysiology, vol. 104, no. 6, pp. 3312–3322, 2010.

A. Mazzoni, F. D. Broccard, E. Garcia-Perez, P. Bonifazi, M. E. Ruaro, and V. Torre, “On the dynamics of the spontaneous activity in neuronal networks,” PLoS ONE, vol. 2, no. 5, article e439, 2007.

V. Pasquale, P. Massobrio, L. L. Bologna, M. Chiappalone, and S. Martinoia, “Self-organization and neuronal avalanches in networks of dissociated cortical neurons,” Neuroscience, vol. 153, no. 4, pp. 1354–1369, 2008.

T. L. Ribeiro, M. Copelli, F. Caixeta et al., “Spike avalanches exhibit universal dynamics across the sleep-wake cycle,” PLoS ONE, vol. 5, no. 11, Article ID e14129, 2010.

G. L. Pellegrini, L. de Arcangelis, H. J. Herrmann, and C. Perrone-Capano, “Activity-dependent neural network model on scale-free networks,” Physical Review E, vol. 76, no. 1, part 2, Article ID 016107, 2007.

L. de Arcangelis, C. Perrone-Capano, and H. J. Herrmann, “Self-organized criticality model for brain plasticity,” Physical Review Letters, vol. 96, no. 2, Article ID 028107, 2006.

A. Levina, J. M. Herrmann, and T. Geisel, “Dynamical synapses causing self-organized criticality in neural networks,” Nature Physics, vol. 3, no. 12, pp. 857–860, 2007.

J.-N. Teramae and T. Fukai, “Local cortical circuit model inferred from power-law distributed neuronal avalanches,” Journal of Computational Neuroscience, vol. 22, no. 3, pp. 301–312, 2007.

L. F. Abbott and R. Rohrkemper, “A simple growth model constructs critical avalanche networks,” Progress in Brain Research, vol. 165, pp. 13–19, 2007.

C. Morris and H. Lecar, “Voltage oscillations in the barnacle giant muscle fiber,” Biophysical Journal, vol. 35, no. 1, pp. 193–213, 1981.

J. Rinzel and G. B. Ermentrout, “Analysis of neural excitability and oscillations,” in Methods in Neural Modeling: From Synapses to Networks, C. Koch and I. Segev, Eds., pp. 135–169, MIT Press, Cambridge, Mass, USA, 1989.

A. L. Hodgkin and A. F. Huxley, “A quantitative description of membrane current and its application to conduction and excitation in nerve,” The Journal of physiology, vol. 117, no. 4, pp. 500–544, 1952.

D. J. Watts and S. H. Strogatz, “Collective dynamics of 'small-world9 networks,” Nature, vol. 393, no. 6684, pp. 440–442, 1998.

M. Newman, A. L. Barabasi, and D. J. Watts, The Structure and Dynamics of Networks, Princeton University Press, 2006.

A. Roxin, H. Riecke, and S. A. Solla, “Self-sustained activity in a small-world network of excitable neurons,” Physical Review Letters, vol. 92, no. 19, article 198101, 4 pages, 2004.

V. Latora and M. Marchiori, “Efficient behavior of small-world networks,” Physical Review Letters, vol. 87, no. 19, Article ID 198701, 2001.

V. Latora and M. Marchiori, “Economic small-world behavior in weighted networks,” European Physical Journal B, vol. 32, no. 2, pp. 249–263, 2003.

J. X. de Carvalho and C. P. C. Prado, “Self-organized criticality in the olami-feder-christensen model,” Physical Review Letters, vol. 84, no. 17, pp. 4006–4009, 2000.

D. S. Bassett and E. Bullmore, “Small-world brain networks,” Neuroscientist, vol. 12, no. 6, pp. 512–523, 2006.

C. C. Hilgetag, G. A. P. C. Burns, M. A. O'Neill, J. W. Scannell, and M. P. Young, “Anatomical connectivity defines the organization of clusters of cortical areas in the macaque monkey and the cat,” Philosophical Transactions of the Royal Society B, vol. 355, no. 1393, pp. 91–110, 2000.

R. K. Kötter and F. T. Sommer, “Global relationship between anatomical connectivity and activity propagation in the cerebral cortex,” Philosophical Transactions of the Royal Society B, vol. 355, no. 1393, pp. 127–134, 2000.

K. Stephan, C. C. Hilgetag, G. A. P. C. Burns, M. A. O'Neill, M. P. Young, and R. K. Kötter, “Computational analysis of functional connectivity between areas of primate cerebral cortex,” Philosophical Transactions of the Royal Society B, vol. 355, no. 1393, pp. 111–126, 2000.

S. Yu, D. Huang, W. Singer, and D. Nikolic, “A small world of neuronal synchrony,” Cereb Cortex, vol. 18, pp. 2891–2901, 2008.

C. J. Stam, “Functional connectivity patterns of human magnetoencephalographic recordings: a 'small-world' network?” Neuroscience Letters, vol. 355, no. 1-2, pp. 25–28, 2004.

S. Micheloyannis, E. Pachou, C. J. Stam, M. Vourkas, S. Erimaki, and V. Tsirka, “Using graph theoretical analysis of multi channel EEG to evaluate the neural efficiency hypothesis,” Neuroscience Letters, vol. 402, no. 3, pp. 273–277, 2006.

R. Salvador, J. Suckling, M. R. Coleman, J. D. Pickard, D. Menon, and E. Bullmore, “Neurophysiological architecture of functional magnetic resonance images of human brain,” Cerebral Cortex, vol. 15, no. 9, pp. 1332–2342, 2005.

P. Hagmann, L. Cammoun, X. Gigandet et al., “Mapping the structural core of human cerebral cortex,” PLoS Biology, vol. 6, no. 7, p. e159, 2008.

S. Pajevic and D. Plenz, “The organization of strong links in complex networks,” Nature Physics, vol. 8, pp. 429–436, 2012.

J. G. Restrepo, E. Ott, and B. R. Hunt, “Weighted percolation on directed networks,” Physical Review Letters, vol. 100, no. 5, Article ID 058701, 4 pages, 2008.

D. B. Larremore, W. L. Shew, and J. G. Restrepo, “Predicting criticality and dynamic range in complex networks: effects of topology,” Physical Review Letters, vol. 106, no. 5, Article ID 058101, 4 pages, 2011.

M. G. Kitzbichler, M. L. Smith, S. R. Christensen, and E. Bullmore, “Broadband criticality of human brain network synchronization,” PLOS Computational Biology, vol. 5, no. 3, Article ID e1000314, 2009.