1:
2: \documentclass[preprint,showpacs,preprintnumbers,amsmath,amssymb]{revtex4}
3: %\documentclass[seceq]{ptptex}
4:
5:
6: \usepackage{graphicx}% Include figure files
7: \usepackage{amsmath}
8: \usepackage{subfigure}
9:
10: %\nofiles
11: \newcommand {\syninput} {\mathrm {input}}
12: \newcommand {\selfex }{\mathrm {selfex}}
13: \newcommand {\inh } {\mathrm {inh}}
14: \newcommand {\ext } {\mathrm {ext}}
15: \newcommand {\spike } {\mathrm {spike}}
16: \newcommand {\synasyn}{\mathrm {syn-asyn}}
17: \newcommand {\m }{\mathrm {m}}
18: \newcommand {\threshold}{\mathrm {th}}
19: \newcommand {\rest }{\mathrm {rest}}
20: \newcommand {\connect }{\mathrm {asm}}
21: \newcommand {\rmth }{\mathrm {th}}
22: \newcommand {\rmmax }{\mathrm {max}}
23: \newcommand {\winners }{\mathrm {winners}}
24: \newcommand {\SYNCASYNC}{Syn-Asyn }
25: \newcommand {\pattern}{\mathrm{pattern}}
26: \newcommand {\noise}{\mathrm{noise}}
27: \newcommand {\patternfirst}{'$\times$' }
28: \newcommand {\patternsecond}{'$\star$' }
29:
30: % commands
31: \newcommand {\defeq}{ \stackrel{\mathrm{def}}{=}}
32: %\newcommand{\rem}[1]{{\scriptsize\bf \textcolor{red}{$\clubsuit$ #1 }}}
33: %\newcommand{\revise}[1]{\textbf{#1} }
34: %\newcommand{\revise}[1]{#1}
35: %\newcommand{\checkstart}{\color{blue}}
36: %\newcommand{\checkend}{\color{black}}
37:
38:
39: % margin
40: %\setlength\abovecaptionskip{0pt}
41: %\setlength\textfloatsep{5pt}
42:
43: \begin{document}
44:
45: \preprint{}
46: %<<<<<<< paper.tex
47: \title{
48: %Synchrony-Induced Switching Behavior in a Network of Spiking Neurons
49: Effect of Synchronous Incoming Spikes on Activity Pattern in A Network of Spiking Neurons
50: }% Force line breaks with \\
51: %A Possible Functional Role of Synchronized Incoming Spikes in Controlling the Firing Pattern of Neural Networks
52:
53: \author{Takaaki Aoki}
54: \affiliation{Department of Physics, Graduate School of Science, Kyoto University, Kyoto 606-8502, Japan }%Lines break automatically or can be forced with \\
55: \author{Toshio Aoyagi}%
56: \affiliation{Department of Applied Analysis and Complex Dynamical Systems, Graduate School of Infomatics, Kyoto University, Kyoto 606-8501, Japan}%Lines break automatically or can be forced with \\
57: % \email{Second.Author@institution.edu}
58:
59:
60: \date{\today}% It is always \today, today,
61: % but any date may be explicitly specified
62:
63: %\author{Takaaki \textsc{Aoki}${}^1,$\footnote{E-mail:aoki@scphys.kyoto-u.ac.jp} and Toshio \textsc{Aoyagi}${}^2$}
64: % \inst{
65: % ${}^1$Department of Physics, Graduate School of Science, Kyoto University, Kyoto 606-8502, Japan \\
66: % ${}^2$Department of Applied Analysis and Complex Dynamical Systems, Graduate School of Infomatics, Kyoto University, Kyoto 606-8501, Japan
67: % }
68:
69:
70: \begin{abstract}
71: Although recent neurophysiological experiments suggest that synchronous neural activity is involved in some perceptual and cognitive processes, the functional role of such coherent neuronal behavior is not well understood. As a first step in clarifying this role, we investigate how the temporal coherence of certain neuronal activity affects the activity pattern in a neural network. Using a simple network of leaky integrate-and-fire neurons, we study the effects of synchronized incoming spikes on the functioning of two mechanisms typically used in model neural systems, winner-take-all competition and associative memory. We demonstrate that a pair of switches undergone by the incoming spikes, from asynchronous to synchronous and then back to asynchronous, triggers a transition of the network from one state to another state. In the case of associative memory, for example, this switching controls the timing of the next recalling, whereas the firing rate pattern in the asynchronous state prepares the network for the next retrieval pattern.
72: \end{abstract}
73:
74: \pacs{87.19.La, 05.45.Xt, 87.18.Hf, 87.18.Sn}% PACS, the Physics and Astronomy
75:
76: \maketitle
77:
78:
79: \section{Introduction}
80:
81: Synchronous neural activity, that is, coherent spiking behavior, is widely observed in various cortical areas, and is often stimulus-specific and task-specific \cite{Riehle1997,Gray89}. These observations suggest that synchronous neural activity may play a significant functional role in cognitive and perceptual processes \cite{Francisco2001,Engel01}. One proposed possibility is that such a coherent spiking is the signal for the binding of different attributes of an object into a single percept.
82: To this hypothesis, we have to first clarify the neural mechanism underlying this coherent activity. Over the last decade, a considerable number of studies have been focused on determining the dynamical mechanisms underlying synchronous firing in neural systems\cite{hansel95,Ermentrout96,vreeswijk94,Wang96,kopell00,Izhikevich00,Aoyagi02} , for example, elucidating the neural mechanisms that enable cortical neurons to synchronize and how the neural network controls the degree of synchrony in a stimulus-dependent manner.\cite{takekawa2003,Tiesinga2004}
83: The next important issue is to clarify how such coherent activity contributes to information processing. However, there have been relatively few studies addressing this issue.\cite{Hopfield2003, Scarpetta2002} Considering the above situation, in this paper, we explore the possible functional role of synchronized neural activity.
84:
85: Many electrophysiological experiments have shown that cortical neurons do not always synchronize and that the degree of synchrony is dynamically modulated by a number of factors, such as external stimuli and the internal state. In fact, recent experiments show that the degree of coherence among spikes is modulated by attentional shifts.\cite{Riehle1997,fries2001} Typically, it is observed that such coherent activity transiently lasts for a few hundred msec. These facts indicate that the switching between asynchrony and synchrony provides a crucial signal for information processes in the brain. In developing a theory of information processing in the brain, it is necessary to understand how modulation of the level of synchrony influences the function of the neural network. In particular, we study the influence of synchrony-asynchrony switching in incoming spikes on the activity pattern on a neural network, resulting from two mechanisms typically employed in model neural networks, winner-take-all competition and associative memory. % [revise] correct type mistake
86:
87: \section{Winner-take-all Competition Model}
88: Let us begin our analysis by considering winner-take-all(WTA) competition, which is commonly used as a computational model to determine the best choice among different possible outputs of the network. Is is believed that this competition mechanism provides a fundamental mechanism used in the brain. For example, various models using this mechanism have successfully reproduced columnar structures found in the visual cortex \cite{amari1980,kohonen,Malsburg1973,winner-share-all}. Through WTA competition, the only neuron receiving the largest input in a network becomes active as the `winner'. Recent simulations have revealed that such competition is extremely sensitive to the coherence among neuronal action potentials \cite{lumer}. We study this phenomenon theoretically and explore the possible role of synchronization in the functioning of neural networks.
89:
90: \begin{figure}
91: \begin{center}
92: \includegraphics[width=7.5cm]{fig1.eps}
93: \end{center}
94: \caption{(a)
95: Schematic illustration of the winner-take-all(WTA) competition model. Each neuron receives two external inputs, one from the asynchronous/synchronous input layer always uniformly inputs and one from the pattern input layer neuron-specific inputs. (b) WTA competition suppressed by synchronized incoming spikes. The upper two graphs display a firing pattern and a rastergram of the output layer. The firing pattern of the output layer is shown as a 10x10-dot image, in which the gray level of a dot indicates the averaged firing rate over 200 ms (black under-bar), normalized by dividing by the maximum firing rate. In the lower two graphs, the presentation of the pattern input layer and rastergram of the synchronous/asynchronous input layer are shown. Pattern input is presented as a 10x10-dot image in which a black dot indicates active state and a white dot indicates silent state, see detail right images. For an asynchronous input, the network exhibits typical behavior in the case of WTA competition. The winner pattern A is maintained even if a new pattern B is presented in the pattern input layer. However, a brief synchronous input causes the WTA competition to reset, leading to a transition to a new winner pattern B.
96: }
97: \label{fig:wta_sim}
98: \end{figure}
99:
100: A schematic of our WTA model is displayed in Figure \ref{fig:wta_sim}(a). As the single neuron model, we adopt the leaky integrate-and-fire neuron model, in which the basic equation determining the membrane potential $V_i$ of the $i$-th neuron is given by
101: \begin{align}
102: C_{\m} \frac{dV_i}{dt} &= - \frac{(V_i -V_{\rest})}{R_{\m}}+ I_{i}(t) \\
103: \tau_{\m} \frac{dV_i}{dt} &= - (V_i -V_{\rest})+ R_{\m}I_{i}(t) \label{eq:ifmodel},
104: \end{align}
105: where $R_{\m} = 100M\Omega$ and $\tau_{\m}= R_{\m}C_{\m} = 20ms$ are the membrane input resistance and the membrane time constant, respectively.
106: Whenever $V_{i}(t) $ reaches the threshold voltage $V_{\threshold} = -50mV$, a spike is generated, and $V_{i}(t) $ is instantaneously reset to the resting potential, $V_{\rest} = -65mV$. The total current $ I_{i}(t)$ consists of the sum of all inputs to the neuron, given by
107: \begin{align}
108: I_{i}(t) &= I_{i}^{\inh}(t) + I_{i}^{\selfex}(t) + I^{\synasyn}(t) + I_{i}^{\ext}(t), \\
109: \text{with} \quad I_{i}^{\inh}(t)&= - \frac{g_{\inh}}{N} \sum_{j \not = i } \sum_{\spike}J( t - t_j -\Delta), \notag \\
110: I_{i}^{\selfex}&= g_{\selfex} \sum_{\spike}J( t - t_i -\Delta), \notag
111: \end{align}
112: where $N$ is the total number of neurons, $t_i$ is the time at which the $i$-th neuron generates a spike, and $\Delta$ is the synaptic transmission delay. The postsynaptic potential is expressed simply as the alpha function $J(t)$, which is given by
113: \begin{align}
114: J(t) & = \frac{t}{\tau^2} \exp(\frac{-t}{\tau}) \Theta(t), \notag
115: \end{align}
116: where $\tau$ is the time constant of a synapse, and $\Theta(t)$ is the step function, given by
117: \begin{align*}
118: \Theta(t) & = \begin{cases}
119: 1 \qquad t \geq 0 \\
120: 0 \qquad t < 0 .
121: \end{cases}
122: \end{align*}
123: The current $I_{i}^{\inh}(t)$ represents the effect of all-to-all uniform inhibitory couplings, which is responsible for the WTA behavior of the network. We also assume that each neuron is self-connected by an excitatory synapse, $I_{i}^{\selfex}(t)$. This single neuron in our model can be regarded as representing a population of the real neurons comprising a single columnar structure. Therefore, it is quite natural that such excitatory self-connections are introduced, corresponding to the mutual excitatory synaptic connections existing within an actual column of this kind.
124:
125: We assume that each neuron in the network receives input from two types of external sources. One is the synchronous/asynchronous (Syn-Asyn) input layer, in which the level of coherence among the input spikes can be controlled to examine the effect of the synchrony-asynchrony switching of incoming spikes on the activity pattern in a neural network. This uniformly applied current is generated according to
126: \begin{align*}
127: I^{\synasyn}(t) = \frac{g_{\syninput}}{N_{\syninput}}\sum_{\spike}J( t - t^{\synasyn} ),
128: \end{align*}
129: where $t^{\synasyn}$ is the time at which neurons receive a spike from a neuron in the \SYNCASYNC input layer and $N_{\syninput}$ is the total number of neurons in this input layer.
130: We consider the situation in which this input layer possesses two modes, an asynchronous mode and a synchronous mode. In the asynchronous mode, each spike is generated by a Poisson process. In the synchronous mode, 45 percent of the neurons in this layer fire periodically and synchronously with spike timings distributed in a Gaussian distribution of variance $\sigma = 4ms$. In both modes, we assume that the average firing rate is 25Hz.
131:
132: The other external source is the pattern input layer, which is the neuron-specific current, given by
133: \begin{align*}
134: I_{i}^{\ext}(t) &= I_i = \begin{cases}
135: \Delta I & \text{active state },\\
136: 0 &\text{silent state}.
137: \end{cases}
138: \end{align*}
139: % where $t_i^{\pattern}$ is the time at which $i$-th neuron receive a spike from a neuron in the pattern input layer and $N_{\pattern}$ is the total number of neurons in this input layer.
140: % By setting the pattern of the input currents from this pattern input layer to a given pattern, we can control the firing pattern in the network of the output layer, that is, the `winner neurons'.
141: %Each subgroup in this layer projects to a specific subgroup of the output layer.
142: Each neuron in this layer projects to one neuron in the output layer in a one-to-one correspondence.
143: By controlling the activity of neurons in this layer, the biased current for each neuron in the output layer is determined, which affects the firing pattern selected through the WTA competition.
144: %When a neuron in this layer is active, the spikes are generated by Poisson Process with 25Hz.
145:
146: For these synaptic connections and external inputs, we use the parameter values $ \Delta = 1ms$, $\tau=4ms$, $g_{\inh} = 4.8 nS,g_{\selfex} = 3.0 nS$, $ g_{\syninput} = 7.14 nS$, $N_{\syninput} = 1000$ and $\Delta I = 7.5 pA$.
147:
148: Figure \ref{fig:wta_sim}(b) depicts a typical effect of synchronized incoming spikes on the properties of the WTA competition. Here the simulation was performed with a network of 100 neurons. The system was started with the condition that the \SYNCASYNC input layer is set in asynchronous mode, and in the pattern input layer, the currents $I_{i}^{\ext}(t)$ in the 1st through 40th neurons are active ( Pattern `A').
149: Owing to the nature of the WTA competition, only those neurons that receive a larger input are active (as seen during the first 200 ms in Fig.\ref{fig:wta_sim}(b)).
150: After these currents in the pattern input layer turn off, the firing of the winners(Pattern `A') is maintained. Next, even though another current pattern `B' applying to some loser neurons(60-100th) is presented in the input layer, the firing pattern of winners remains stable (time steps 400ms - 600ms). This result is typical behavior of WTA competition models.
151:
152: %This is due to the fact that, as a result of the nature of the winner-take-all competition, the selection of some firing pattern as the winner of this competition causes it to become stable.
153:
154: With the situation as described above, let us consider a transient synchronized spike inputs with temporal switching modes in the \SYNCASYNC input layer. In this case, as shown in Figure \ref{fig:wta_sim}(b), the synchronized incoming spikes cause the old firing pattern to become unstable. Although the old firing pattern `A' is maintained at first, the network eventually exhibits a collective synchronized oscillatory state. When the asynchronous mode in the \SYNCASYNC input layer is recovered, a second firing pattern `B' is realized through WTA competition, as determined by the activity of the pattern input layer.
155: The other neurons(40-60th) that receive no pattern input do not fire even in a synchronous input period. It depends on the parameters whether or not these neurons fire without pattern input during synchronous input period. However, even if these neuron fire, the next pattern `B' always is realized in the following asynchronous input period.
156: Therefore, it should be noted that a transition of the firing pattern in the output layer is induced by synchrony-asynchrony switching in incoming spikes.
157: %, whereas the switching pattern input A to B is not sufficient for the transition.
158: This result means that the synchronized incoming spikes nullify the effect of the function of WTA competition, erasing the current pattern realized in the WTA competition, and thereby allowing it to make a transition to a new pattern prepared by the pattern input layer.
159:
160:
161: \section{analysis}
162: In order to understand the result of the numerical simulations described above, we now analyze the stability of the state selected through the WTA competition. %
163:
164: For the convenience of analysis, first we rescale equation (\ref{eq:ifmodel}). Using a transformation given by
165: \begin{align*}
166: s &= t / \tau_{\m} \\
167: v_i &= \frac{V_i - V_{\rest}}{V_{\threshold} - V_{\rest}} ,
168: \end{align*}
169: equation \ref{eq:ifmodel} is rewritten as
170: \begin{align}
171: \frac{dv_i}{ds} = -v_i +I_i (s), \label{eq:ifanalysis}
172: \end{align}
173: where parameters are rescaled as
174: \begin{align*}
175: \Delta &= \Delta / \tau_{\m}, \quad \tau = \tau /\tau_{\m} , \quad \Delta I = \frac{\Delta I R_{\m}}{V_{\threshold} - V_{\rest}},
176: \quad \text{and } g_{x} = \frac{g_{x} R_{\m}}{ (V_{\threshold} - V_{\rest}) \tau_{\m}}.
177: \end{align*}
178: %
179: %or%
180: %
181: %equation \ref{eq:ifmodel} is rewritten as
182: %\begin{align*}
183: % \frac{dv_i}{ds} &= -v_i + \frac{R_{\m}I_i (s)}{V_{\threshold} - V_{\rest}}, \label{eq:ifanalysis}\\
184: % J(s) &= \tau_{\m} \frac{s}{\tau^2} \exp(\frac{-s}{\tau}) \Theta(s).
185: %\end{align*}
186: Next, assuming that the total number of neurons in these layers is sufficiently large and the variance of the synchronous spike timing $\sigma = 0$, the form of the input currents can be simplified as
187: \begin{align*}
188: \qquad I_{i}^{\synasyn}(s) &= \begin{cases}
189: g_{\syninput} /T_{0} \quad &\text{asynchronous}, \\
190: g_{\syninput} ( \rho \sum_{n}J(s - nT_{0} ) + (1-\rho) /T_{0}) \quad &\text{synchronous,}
191: \end{cases}
192: \end{align*}
193: where $T_{0}$ is the period of the input spikes from \SYNCASYNC input layer. $\rho$ is the ratio of synchronized neurons.
194:
195: From the results of simulations, we know that typically, winner neurons fire periodically and synchronously at the times $s_i = nT (n=1,2,...)$ for the asynchronous mode in the \SYNCASYNC input layer and $s_i = n(T_{0} - \theta)$ for the synchronous mode.
196: Consequently, we consider only these solutions in this analysis and do not deal with other more complicated solutions. To analyze these solutions, the unknown parameters $T$ and $\theta$ should be determined in a self-consistent way.
197: In the asynchronous mode, integrating equation \ref{eq:ifanalysis} between $nT$ and $(n+1)T$, we get a self-consistent equation for the period $T$,
198: \begin{align}
199: 1 & = (I_i + \frac{ g_{\syninput}}{T_{0}}) (1 - e^{-T})+ (g_{\selfex} - g'_{\inh} ) K_{T}(-\Delta) \\
200: &K_T(s) = e^{-T} \int_{0}^{T} e^{u} \sum_{m \in Z} J(s + u + mT) du,\quad g'_{inh} = g_{\inh} \frac{(N_{p} -1)}{N}
201: \end{align}
202: where $N_{p}$ is the number of the winner neurons.
203: Solving this equation, $T$ is determined and the spike trains of winner neurons are determined.
204: %In addition, we can evaluated linear stability of this solution.
205:
206: Similarly, in synchronous mode, we also derive a self-consistent equation for $\theta$,
207: \begin{align}
208: 1 = (I_i +\frac{ (1-\rho)g_{\syninput}}{T_{0}} )(1 - e^{-T_{0}}) + (g_{\selfex} - g'_{\inh} )K_{ T_{0}}(- \Delta) + \rho g_{\syninput} K_{T_{0}}( \theta T_{0}),
209: \end{align}
210: and determine the spike trains of winner neurons.
211:
212: Given the spike trains of the winner neurons, the time evolution of the loser neurons can be calculated.
213: Let $v_{i}^{n}(\phi)$ denote the membrane potential of $i$-th neuron at the time $s = T(n + \phi) $, in which $\phi$ goes from $0$ to $1$. The return map from $v_{i}^{n}$ to $v_{i}^{n+1}$ is given by
214: \begin{multline}
215: v_{i}^{n+1}=\begin{cases}
216: e^{-T} v_{\phi}^n + (I_i + \frac{ g_{\syninput}}{T_{0}})( 1 - e^{-T}) - g'_{\inh} K_T( \phi T - \Delta) & \text{asynchronous,}\\
217: e^{-T_{0}} v_{\phi}^n + (I_i + \frac{ (1-\rho)g_{\syninput}}{T_{0}})( 1 - e^{-T_{0}})
218: \\ \qquad - g'_{\inh} K_{T_{0}}( (\phi - \theta )T_{0} - \Delta )
219: + \rho g_{\syninput} K_{T_{0}} ( \phi T_{0}) &\text{synchronous.}
220: \end{cases}
221: \end{multline}
222: $v_{i}^{n}(\phi)$ converges to the limit $v_{i}^{\infty}(\phi)$,
223: \begin{align}
224: v_{i}^{\infty}(\phi)& = \begin{cases}
225: \frac{ (I_i + \frac{ g_{\syninput}}{T_{0}})( 1 - e^{-T}) - g'_{\inh} K_T( \phi T - \Delta) }{1 - e^{-T}} & \text{asynchronous}\\
226: \frac{ (I_i + \frac{(1-\rho ) g_{\syninput}}{T_{0}}( 1 - e^{-T_{0}}) - g'_{\inh} K_{T_{0}}( (\phi - \theta )T_{0} - \Delta ) + \rho g_{\syninput} K_{T_{0}} ( \phi T_{0}) }{ 1 - e^{-T_{0}} }&\text{synchronous}
227: \end{cases}
228: \end{align}
229: The stability of the WTA state is ensured by the condition that none of the loser neurons fire, therefore,
230: \begin{align}
231: v_{i}^{\infty}(\phi)< 1 \quad \text{$\phi$ in $[0,1)$} \quad \text{for all loser neurons $i$ } \label{eq:wta}.
232: \end{align}
233:
234:
235:
236:
237: \begin{figure}
238:
239: \begin{center}
240: \subfigure{
241: \includegraphics[width=4cm]{fig2a.eps}
242: \label{fig:phase_diagram_inh}
243: }
244: \subfigure{
245: \includegraphics[width=4cm]{fig2b.eps}
246: \label{fig:phase_diagram_selfex}
247: }
248: \end{center}
249: \caption{
250: Two-parameter phase diagrams concerning the stability of the state selected through the winner-take-all competition. This state is stable if the parameter value is located below the solid line (dashed line) for the case of asynchronous (synchronous) incoming spikes. In the shaded regions, destabilization of the WTA state occurs in response to the switching from asynchronous to synchronous incoming spikes. The data points indicate simulation results. (a) Dependence of the stability on the synaptic transmission delay, $\Delta$, and the biased current from pattern input layer, $\Delta I$. (b) Same as (a), except that the horizontal axis corresponds to the synaptic time constant, $\tau$. The parameter values used in Figure \ref{fig:wta_sim} is indicated by the $+$.
251: }
252: \label{fig:wta_phase_diagram}
253: \end{figure}
254: As depicted in Figure \ref{fig:wta_sim}(b) corresponding to $t = 400 - 600$ ms, we consider the situation in which the selected neurons remain active without a biased input and some loser neurons receive a biased current ($\Delta I$) from the pattern input layer. Using Eq.\ref{eq:wta}, in the situation described above, we determine the condition under which the firing state of the selected neurons remains stable and the neurons receiving the biased input still cannot fire. The stable parameter regions obtained in this manner for the cases of the synchronous and asynchronous modes are displayed in Figure \ref{fig:wta_phase_diagram}.
255:
256: In the shaded regions, destabilization of the WTA state occurs in response to the switching of the mode of the \SYNCASYNC input layer from asynchronous to synchronous incoming spikes. This destabilization leads to a transition of the neuronal state into the next firing pattern, as determined by the pattern input layer.
257: Thus, if the parameter within the shaded region is used, the WTA network exhibits synchrony-induced switching behavior.
258: The validity of this analysis is shown by the numerical simulation data in Fig.\ref{fig:wta_phase_diagram}.
259: %A detailed analysis and discussions of this process will be published elsewhere in the near future.
260: In addition, it also shows that the result is not too sensitive to both the synaptic delay$\Delta$ and the synaptic time constant $\tau$.
261: %This behavior is insensitive to the parameters, $g_{\inh} $ and $g_{\selfex}$ as shown in Figure \ref{fig:wta_phase_diagram} (the shaded region). With regard to the three time parameters, $\Delta$, $\tau$, and $T_{0}$, the theoretical analysis indicates that such a change in stability occurs over a comparatively wide range of values of these as well.}
262:
263:
264: \section{Associative Memory}
265: We next consider the case of the associative memory model \cite{hopfield1982,Gerstner1992}, in which information is stored in the synaptic weight matrix, $W_{ij}$. For the learning rule of the synaptic matrix, we adopt the Willshaw-type learning rule \cite{willshaw1969}, defined by
266: \begin{align}
267: W_{ij} = \Theta \left( \sum_{\mu = 1}^{P} \zeta_i^{(\mu)} \zeta_j^{(\mu)} \right), \label{eq:willshaw}
268: \end{align}
269: where $P$ is the total number of the stored patterns, $\zeta_i^{(\mu)}$ represents the state in the $i$-th neuron in the $\mu$-th pattern and takes only two values 1 (firing) and 0 (quiescent).
270: %Figure \ref{fig:assoiative_memory_sim}~(a) depicts the network architecture, which is an extended version of that for our winner-take-all model to the case of a system with associative memory. The most important difference between these models is that the self-excitatory coupling in the winner-take-all competition model is replaced with the synaptic matrix Eq.~\eqref{eq:willshaw}.
271: Replacing the self-excitatory coupling in the WTA model with the synaptic matrix Eq.~\eqref{eq:willshaw}, the resultant dynamics for the $i$-th neuron are described by
272: \begin{align}
273: \tau_{\m} \frac{dV_i}{dt} &= - (V_i -V_{\rest})+ I_{i}^{\inh}(t) + I_{i}^{\connect}(t) +I^{\synasyn} + I_{i}^{\ext}(t) , \label{eq:asm}\\
274: I_{i}^{\connect} &= \frac{g_{\selfex}}{\bar{N}}\sum_{j \not = i} \sum_{\spike}W_{ij}J( t - t_{\spike}^j -\Delta) \notag
275: \end{align}
276: where the factor $\bar{N} = \langle \sum_{j} W_{ij} \rangle_i$ is the average connections of synaptic matrix $W_{ij}$.
277:
278: %The addtionnal term $I_{i}^{\noise}(t)$ is in a white Gaussian noise current ,
279: Figure \ref{fig:assoiative_memory_sim} depicts typical behavior of the associative memory model found in our numerical simulations, in which 10 patterns (\patternfirst, \patternsecond and 8 randomly generated patterns) are stored in the network of 1600 neurons. The `key' pattern is presented as the activity in the pattern input layer, displayed as a 40x40-dot image. The `retrieval' pattern is displayed as a 40x40-dot image, in which the gray level of a dot indicates the averaged firing rate over 100 ms, normalized by dividing by the maximum firing rate. As shown in Figure \ref{fig:assoiative_memory_sim}, when a slightly distorted version of the pattern \patternfirst, consisting of \patternfirst plus some noise, is presented as a key pattern, the network correctly realizes the pattern \patternfirst as the outcome of the associative memory functioning (0 - 200ms).
280: % This retrieval pattern remains stable while no key pattern is presented. What is interesting in the present case, however, is that this retrieval pattern remains stable even if another key pattern B is presented.
281: %As in the case considered above, this stability is due to the nature of the winner-take-all competition and is acquired as a result of this retrieval pattern being selected as the `winner' of the competition.
282: It is interesting that, if the spike trains in the \SYNCASYNC input layer synchronize, the existing retrieval pattern \patternfirst becomes unstable(600 - 900ms), leading eventually to the synchronous oscillatory state as in the case of the WTA model. Then, when the input spike trains become uncorrelated again, the network comes to exhibit the new retrieval pattern \patternsecond in response to the key pattern presented by the pattern input layer(900 - 1200ms). Hence, the synchrony-asynchrony switching of the incoming spikes plays a crucial role in triggering a change of the retrieval pattern, whereas the biased input from the pattern input layer prepares the network for the next retrieval pattern.
283:
284: \begin{figure}
285: \begin{center}
286: \includegraphics[width=8cm]{fig3.eps}
287: \end{center}
288: \caption{
289: A possible role of synchronized incoming spikes in controlling the timing of the next retrieval in associative memory. The transition of the retrieval pattern is induced by the synchrony-asynchrony switching of the incoming spikes in the associative memory model. The upper two graphs display the pattern of the normalized firing rate presented as 40x40-dot images and a rastergram of the output layer. The lower two graphs display the presentation of the pattern input layer (key pattern) and the rastergram of sync/async input layer.
290: }
291: \label{fig:assoiative_memory_sim}
292: \end{figure}
293:
294: %
295:
296: \section{discussions}
297: In the present paper, we have studied the manner in which the spike synchrony in the input layer can affect the activity pattern in a neural network. We find that the synchrony-asynchrony switching undergone by the incoming spikes plays a key role in triggering a transition from one state to another state, even if the firing rate of incoming spikes is kept constant. For example, in the case of the associative memory model, the timing of the next retrieval can be controlled by such a synchrony-asynchrony switching of the external uniform input spikes, whereas the averaged rate pattern in the pattern input layer allows for the selection of the set of firing neurons for the next retrieval pattern.
298: %This synchrony-asynchrony switching of the incoming spikes provides a novel alternative mechanism to control the neuronal activity in a neural network.
299:
300: We will comment on a conventional way to reset activity patterns in WTA network. Because of the well-known multi-stability in a WTA network, the transition in the output layer can also be achieved by changing the biased current from the pattern input layer.
301: Therefore in Figure \ref{fig:wta_sim}(b), if the input current from the pattern input layer for pattern B is sufficiently large, a switching from A to B occurs.
302: This increase in the biased current corresponds to an increasing $\Delta I$ in Figure \ref{fig:wta_phase_diagram}, which makes the WTA state unstable.
303: By contrast with this conventional way, the important point of our model is that the firing rate of incoming spikes does not change during a transition in the output layer.
304: The purpose of the present paper is to propose an alternative mechanism to control the neuronal activity in a neural network by altering incoming spike synchrony only.
305:
306: Some multi-recording experiments suggest that spike synchronization preferentially occurs in relation to a purely cognitive event, where firing rate modulations were absent \cite{Riehle1997,Lee2003}.
307: For example, it is shown that before the onset of voluntary movement, cortical neurons in the motor area transiently synchronize without changing the firing rate of each neuron.
308: In addition, many studies in the recording of local field potential or electro-encephalographic activities also show that $\gamma$ frequency oscillation is observed in association with upcoming movements.
309: Therefore, some have suggested that these synchronous neural activities can be regarded as the representation of an anticipation or a preparation of an upcoming movement.
310: In our understanding, such a synchronization in neural activity seems to play a role in triggering a transition to the next firing state for the upcoming movement.
311: %In our understanding, the outcomes of these anticipation or preparation of upcoming movement would be represented as a transition of firing pattern in neural network level.
312: Hence, we believe that some of the observed synchronous activities are essentially relevant to our result in the present paper.
313:
314: %On the other hand, we will comment on another type of transitions in output layer achieved by firing rate modulations in input layers.
315: % todo
316: %First, we consider a rate modulation in pattern input layer.
317:
318: Next, we will comment on the fact that the same transition can be achieved by uniform rate modulation in the \SYNCASYNC input layer. From a dynamical point of view, synchrony-asynchrony switching constitutes a kind of perturbation leading to a transition from one attractor to another. It can be imagined that the same effect could be achieved through some other kinds of perturbations that do not involve synchrony among spikes, such as uniform modulation of the firing rate. To clarify this point, we investigated the effectiveness of such rate-modulated spikes numerically. In this case, instead of the synchronized incoming spikes, we used an abrupt change in the firing rate from 25Hz to 75Hz or 100Hz, but the timing of the change in firing rate is distributed according to a Gaussian distribution with variance $\sigma$(Figure \ref{fig:burst_input}a).
319: Figure \ref{fig:burst_input}b displays the probability of a successful transition induced by such a modulation of the firing rate as a function of the width of the variance $\sigma$.
320: We see that a change to 75Hz is insufficient to achieve a high probability of transition, even when the changes in firing rates are completely synchronous (i.e. $\sigma$=0). In the case that the firing rate is increased to 100Hz and $\sigma$ is sufficiently small, the probability for a transition is comparable to the case of synchronized spikes (see Sync.25Hz in Fig.\ref{fig:burst_input}b). Therefore, we conclude that a large and simultaneous increase in firing rate is required to realize a high probability for a transition. This implies that this modulation can practically be regarded as a kind of temporal coding.
321:
322: Finally, we will point out that the synchrony-induced transition has different properties from the rate-modulation-induced one as mentioned above.
323: As shown in Fig.\ref{fig:burst_input}(c), the WTA state is still stable even with a high firing rate.
324: %, which corresponds to decrease of the $g_{\syninput/ T_{0}}$.
325: This analysis is based on the assumption that the incoming spike rate is constant.
326: %Therefore if there is a sudden increase in the firing rate, then
327: Therefore, a sudden increase in the firing rate may cause a transition to another firing pattern.
328: % under unequilibrium conditions that the firing rate varies in time.
329: In fact, the numerical simulations show that a large and almost simultaneous increase in firing rate over all neurons can trigger a transition in the output layer.
330: %
331: % the increase of firing rate, the WTA state remains stationary stable. Because of this stability, is required for jumping out of stable state.
332: On the other hand, by switching to a synchronous spike input, the WTA state becomes unstable. Therefore, the old firing pattern of the WTA state is eventually broken for the several synchronous spikes, whereas the old pattern is still maintained for the first synchronous spike (Fig.\ref{fig:wta_sim}(b)). This result indicate that synchrony-induced transition mechanism is different from the rate-modulation-induced method.
333: We believe that instead of rate-modulated type of perturbations, synchrony-asynchrony switching in incoming spikes may provide another sophisticated way to cause a transition of the firing pattern.
334:
335: %However, the type of perturbation between a increase in firing rate and a change in degree of incoming spike synchrony is essentially different.
336:
337: %\checkend
338: %Finally, we believe that the use of synchronized firing provides more sophisticated method to lead the system from one attractor to another than the above rate-modulated method, because the synchronized firing can be realized without the rate-modulation in each neuron.
339: % We should remark that a change to 75Hz is insufficient to make a transition successfully, even when the changes in firing rate occur in the perfect synchronous manner, i.e. $\sigma=0$. The larger modulation to 100Hz can achieve the acceptable probability comparable to the case of synchronized spikes(See Sync.25Hz in Fig.\ref{fig:burst_input}).
340: %We should remark that the timing of rate changing must be synchronized to some extent for the successful transition of the firing pattern, otherwise WTA competition is not reseted even in a high firing rate (See Async.100Hz in Fig.\ref{fig:burst_input}b).
341: %When the timing of rate changing is synchronized, that is, $\sigma$ is small, the firing rate in input layer varies very rapidly.
342: %This means that when the firing rate varies very rapidly, the transition occurs successfully. Thus, this modulation in firing rate can be regard as a kind of temporal coding inputs essentially, rather than rate coding.
343:
344: %
345: \begin{figure}
346: \begin{center}
347: \includegraphics[width=11cm]{fig4.eps}
348: \end{center}
349: \caption{(a) Instead of synchronized spikes, a rate-modulated perturbation is applied to the neural network by changing the firing rate from 25Hz to 75 or 100Hz. The timing of the rate switching is distributed in a Gaussian distribution with variance $\sigma$. (b) The probability of a transition of the firing pattern as a function of the fluctuation associated with the rate switching (solid curves). The dashed curves corresponds to the case of synchronized spikes. (c) Dependence of the stability of the state selected through the winner-take-all competition on the input spike rate in \SYNCASYNC input layer and the pattern input current $\Delta I$. Note that the constant rate for input is assumed.}
350: \label{fig:burst_input}
351: \end{figure}
352:
353:
354:
355: \section*{Acknowledgments}
356: We thank T.Fukai for preliminary discussions and introducing us to this topic.
357: We are supported by the Japanese Grant-in-Aid for Science Research Fund from the Ministry of Education, Science and Culture.
358:
359: \newpage %Just because of unusual number of tables stacked at end
360:
361: %\bibliography{mybib}% Produces the bibliography via BibTeX.
362: \begin{thebibliography}{25}
363: \expandafter\ifx\csname natexlab\endcsname\relax\def\natexlab#1{#1}\fi
364: \expandafter\ifx\csname bibnamefont\endcsname\relax
365: \def\bibnamefont#1{#1}\fi
366: \expandafter\ifx\csname bibfnamefont\endcsname\relax
367: \def\bibfnamefont#1{#1}\fi
368: \expandafter\ifx\csname citenamefont\endcsname\relax
369: \def\citenamefont#1{#1}\fi
370: \expandafter\ifx\csname url\endcsname\relax
371: \def\url#1{\texttt{#1}}\fi
372: \expandafter\ifx\csname urlprefix\endcsname\relax\def\urlprefix{URL }\fi
373: \providecommand{\bibinfo}[2]{#2}
374: \providecommand{\eprint}[2][]{\url{#2}}
375:
376: \bibitem[{\citenamefont{Riehle et~al.}(1997)\citenamefont{Riehle, Gruen,
377: Diesmann, and Aertsen}}]{Riehle1997}
378: \bibinfo{author}{\bibfnamefont{A.}~\bibnamefont{Riehle}},
379: \bibinfo{author}{\bibfnamefont{S.}~\bibnamefont{Gruen}},
380: \bibinfo{author}{\bibfnamefont{M.}~\bibnamefont{Diesmann}}, \bibnamefont{and}
381: \bibinfo{author}{\bibfnamefont{A.}~\bibnamefont{Aertsen}},
382: \bibinfo{journal}{Science} \textbf{\bibinfo{volume}{278}},
383: \bibinfo{pages}{1950} (\bibinfo{year}{1997}).
384:
385: \bibitem[{\citenamefont{Gray et~al.}(1989)\citenamefont{Gray, Konig, Engel, and
386: Singer}}]{Gray89}
387: \bibinfo{author}{\bibfnamefont{C.}~\bibnamefont{Gray}},
388: \bibinfo{author}{\bibfnamefont{P.}~\bibnamefont{Konig}},
389: \bibinfo{author}{\bibfnamefont{A.}~\bibnamefont{Engel}}, \bibnamefont{and}
390: \bibinfo{author}{\bibfnamefont{W.}~\bibnamefont{Singer}},
391: \bibinfo{journal}{Nature} \textbf{\bibinfo{volume}{338}},
392: \bibinfo{pages}{334} (\bibinfo{year}{1989}).
393:
394: \bibitem[{\citenamefont{Varela et~al.}(2001)\citenamefont{Varela, Lachaux,
395: Rodriguez, and Martinerie}}]{Francisco2001}
396: \bibinfo{author}{\bibfnamefont{F.}~\bibnamefont{Varela}},
397: \bibinfo{author}{\bibfnamefont{J.}~\bibnamefont{Lachaux}},
398: \bibinfo{author}{\bibfnamefont{E.}~\bibnamefont{Rodriguez}},
399: \bibnamefont{and}
400: \bibinfo{author}{\bibfnamefont{J.}~\bibnamefont{Martinerie}},
401: \bibinfo{journal}{Nat. Rev. Neurosci.} \textbf{\bibinfo{volume}{2}},
402: \bibinfo{pages}{229} (\bibinfo{year}{2001}).
403:
404: \bibitem[{\citenamefont{Engel et~al.}(2001)\citenamefont{Engel, Fries, and
405: Singer}}]{Engel01}
406: \bibinfo{author}{\bibfnamefont{A.}~\bibnamefont{Engel}},
407: \bibinfo{author}{\bibfnamefont{P.}~\bibnamefont{Fries}}, \bibnamefont{and}
408: \bibinfo{author}{\bibfnamefont{W.}~\bibnamefont{Singer}},
409: \bibinfo{journal}{Nat. Rev. Neurosci.} \textbf{\bibinfo{volume}{2}},
410: \bibinfo{pages}{704} (\bibinfo{year}{2001}).
411:
412: \bibitem[{\citenamefont{Wang and Buzsaki}(1996)}]{Wang96}
413: \bibinfo{author}{\bibfnamefont{X.}~\bibnamefont{Wang}} \bibnamefont{and}
414: \bibinfo{author}{\bibfnamefont{G.}~\bibnamefont{Buzsaki}},
415: \bibinfo{journal}{J. Neurosci.} \textbf{\bibinfo{volume}{16}},
416: \bibinfo{pages}{6402} (\bibinfo{year}{1996}).
417:
418: \bibitem[{\citenamefont{Aoyagi et~al.}(2002)\citenamefont{Aoyagi, Kang, Terada,
419: Kaneko, and Fukai}}]{Aoyagi02}
420: \bibinfo{author}{\bibfnamefont{T.}~\bibnamefont{Aoyagi}},
421: \bibinfo{author}{\bibfnamefont{Y.}~\bibnamefont{Kang}},
422: \bibinfo{author}{\bibfnamefont{N.}~\bibnamefont{Terada}},
423: \bibinfo{author}{\bibfnamefont{T.}~\bibnamefont{Kaneko}}, \bibnamefont{and}
424: \bibinfo{author}{\bibfnamefont{T.}~\bibnamefont{Fukai}},
425: \bibinfo{journal}{Neuroscience} p. \bibinfo{pages}{in press}
426: (\bibinfo{year}{2002}).
427:
428: \bibitem[{\citenamefont{Hansel et~al.}(1995)\citenamefont{Hansel, Mato, and
429: Meunier}}]{hansel95}
430: \bibinfo{author}{\bibfnamefont{D.}~\bibnamefont{Hansel}},
431: \bibinfo{author}{\bibfnamefont{G.}~\bibnamefont{Mato}}, \bibnamefont{and}
432: \bibinfo{author}{\bibfnamefont{C.}~\bibnamefont{Meunier}},
433: \bibinfo{journal}{Neural Comp.} \textbf{\bibinfo{volume}{7}},
434: \bibinfo{pages}{307} (\bibinfo{year}{1995}).
435:
436: \bibitem[{\citenamefont{Ermentrout}(1996)}]{Ermentrout96}
437: \bibinfo{author}{\bibfnamefont{G.~B.} \bibnamefont{Ermentrout}},
438: \bibinfo{journal}{Neural Computation} \textbf{\bibinfo{volume}{8}},
439: \bibinfo{pages}{979} (\bibinfo{year}{1996}).
440:
441: \bibitem[{\citenamefont{{van Vreeswijk} et~al.}(1994)\citenamefont{{van
442: Vreeswijk}, Abbott, and Ermentrout}}]{vreeswijk94}
443: \bibinfo{author}{\bibfnamefont{C.}~\bibnamefont{{van Vreeswijk}}},
444: \bibinfo{author}{\bibfnamefont{L.~F.} \bibnamefont{Abbott}},
445: \bibnamefont{and} \bibinfo{author}{\bibfnamefont{G.~B.}
446: \bibnamefont{Ermentrout}}, \bibinfo{journal}{J. Comput. Neurosci.}
447: \textbf{\bibinfo{volume}{1}}, \bibinfo{pages}{313} (\bibinfo{year}{1994}).
448:
449: \bibitem[{\citenamefont{Kopell et~al.}(2000)\citenamefont{Kopell, Ermentrout,
450: Whittington, and Traub}}]{kopell00}
451: \bibinfo{author}{\bibfnamefont{N.}~\bibnamefont{Kopell}},
452: \bibinfo{author}{\bibfnamefont{B.}~\bibnamefont{Ermentrout}},
453: \bibinfo{author}{\bibfnamefont{M.~A.} \bibnamefont{Whittington}},
454: \bibnamefont{and} \bibinfo{author}{\bibfnamefont{R.~D.} \bibnamefont{Traub}},
455: \bibinfo{journal}{Proc. Nat. Acad. Sci. USA} \textbf{\bibinfo{volume}{97}},
456: \bibinfo{pages}{1867} (\bibinfo{year}{2000}).
457:
458: \bibitem[{\citenamefont{Izhikevich}(2000)}]{Izhikevich00}
459: \bibinfo{author}{\bibfnamefont{E.~M.} \bibnamefont{Izhikevich}},
460: \bibinfo{journal}{Int. J. Bifurcation and chaos}
461: \textbf{\bibinfo{volume}{10}}, \bibinfo{pages}{1171} (\bibinfo{year}{2000}).
462:
463: \bibitem[{\citenamefont{Aoyagi et~al.}(2003)\citenamefont{Aoyagi, Takekawa, and
464: Fukai}}]{takekawa2003}
465: \bibinfo{author}{\bibfnamefont{T.}~\bibnamefont{Aoyagi}},
466: \bibinfo{author}{\bibfnamefont{T.}~\bibnamefont{Takekawa}}, \bibnamefont{and}
467: \bibinfo{author}{\bibfnamefont{T.}~\bibnamefont{Fukai}},
468: \bibinfo{journal}{Neural Comput.} \textbf{\bibinfo{volume}{15}},
469: \bibinfo{pages}{1035} (\bibinfo{year}{2003}).
470:
471: \bibitem[{\citenamefont{Tiesinga and Sejnowski}(2004)}]{Tiesinga2004}
472: \bibinfo{author}{\bibfnamefont{P.~H.~E.} \bibnamefont{Tiesinga}}
473: \bibnamefont{and} \bibinfo{author}{\bibfnamefont{T.~J.}
474: \bibnamefont{Sejnowski}}, \bibinfo{journal}{Neural Comput.}
475: \textbf{\bibinfo{volume}{16}}, \bibinfo{pages}{251 } (\bibinfo{year}{2004}).
476:
477: \bibitem[{\citenamefont{Brody and Hopfield}(2003)}]{Hopfield2003}
478: \bibinfo{author}{\bibfnamefont{C.~D.} \bibnamefont{Brody}} \bibnamefont{and}
479: \bibinfo{author}{\bibfnamefont{J.~J.} \bibnamefont{Hopfield}},
480: \bibinfo{journal}{Neuron} \textbf{\bibinfo{volume}{37}}, \bibinfo{pages}{843}
481: (\bibinfo{year}{2003}).
482:
483: \bibitem[{\citenamefont{Scarpetta et~al.}(2002)\citenamefont{Scarpetta,
484: Zhaoping, and Hertz}}]{Scarpetta2002}
485: \bibinfo{author}{\bibfnamefont{S.}~\bibnamefont{Scarpetta}},
486: \bibinfo{author}{\bibfnamefont{L.}~\bibnamefont{Zhaoping}}, \bibnamefont{and}
487: \bibinfo{author}{\bibfnamefont{J.}~\bibnamefont{Hertz}},
488: \bibinfo{journal}{Neural Comput.} \textbf{\bibinfo{volume}{14}},
489: \bibinfo{pages}{2371} (\bibinfo{year}{2002}).
490:
491: \bibitem[{\citenamefont{Fries et~al.}(2001)\citenamefont{Fries, Reynolds,
492: Rorie, and Desimone}}]{fries2001}
493: \bibinfo{author}{\bibfnamefont{P.}~\bibnamefont{Fries}},
494: \bibinfo{author}{\bibfnamefont{J.~H.} \bibnamefont{Reynolds}},
495: \bibinfo{author}{\bibfnamefont{A.~E.} \bibnamefont{Rorie}}, \bibnamefont{and}
496: \bibinfo{author}{\bibfnamefont{R.}~\bibnamefont{Desimone}},
497: \bibinfo{journal}{Science} \textbf{\bibinfo{volume}{291}},
498: \bibinfo{pages}{1560} (\bibinfo{year}{2001}).
499:
500: \bibitem[{\citenamefont{Amari}(1980)}]{amari1980}
501: \bibinfo{author}{\bibfnamefont{S.}~\bibnamefont{Amari}},
502: \bibinfo{journal}{Bull. Math. Biol.} \textbf{\bibinfo{volume}{42}},
503: \bibinfo{pages}{339} (\bibinfo{year}{1980}).
504:
505: \bibitem[{\citenamefont{Kohonen}(1982)}]{kohonen}
506: \bibinfo{author}{\bibfnamefont{T.}~\bibnamefont{Kohonen}},
507: \bibinfo{journal}{Biol. Cybern.} \textbf{\bibinfo{volume}{43}},
508: \bibinfo{pages}{59} (\bibinfo{year}{1982}).
509:
510: \bibitem[{\citenamefont{{von der Malsburg}}(1973)}]{Malsburg1973}
511: \bibinfo{author}{\bibfnamefont{C.}~\bibnamefont{{von der Malsburg}}},
512: \bibinfo{journal}{Kybernetik} \textbf{\bibinfo{volume}{14}},
513: \bibinfo{pages}{85} (\bibinfo{year}{1973}).
514:
515: \bibitem[{\citenamefont{Fukai and Tanaka}(1997)}]{winner-share-all}
516: \bibinfo{author}{\bibfnamefont{T.}~\bibnamefont{Fukai}} \bibnamefont{and}
517: \bibinfo{author}{\bibfnamefont{S.}~\bibnamefont{Tanaka}},
518: \bibinfo{journal}{Neural Comput.} \textbf{\bibinfo{volume}{9}},
519: \bibinfo{pages}{77} (\bibinfo{year}{1997}).
520:
521: \bibitem[{\citenamefont{Lumer}(2000)}]{lumer}
522: \bibinfo{author}{\bibfnamefont{E.~D.} \bibnamefont{Lumer}},
523: \bibinfo{journal}{Neural Comput.} \textbf{\bibinfo{volume}{12}},
524: \bibinfo{pages}{181} (\bibinfo{year}{2000}).
525:
526: \bibitem[{\citenamefont{Hopfield}(1982)}]{hopfield1982}
527: \bibinfo{author}{\bibfnamefont{J.~J.} \bibnamefont{Hopfield}},
528: \bibinfo{journal}{Proc. Natl. Acad. Sci. USA} \textbf{\bibinfo{volume}{79}},
529: \bibinfo{pages}{2554} (\bibinfo{year}{1982}).
530:
531: \bibitem[{\citenamefont{Gerstner and {L. van Hemmen}}(1992)}]{Gerstner1992}
532: \bibinfo{author}{\bibfnamefont{W.}~\bibnamefont{Gerstner}} \bibnamefont{and}
533: \bibinfo{author}{\bibfnamefont{J.}~\bibnamefont{{L. van Hemmen}}},
534: \bibinfo{journal}{Network: Comput. Neural Syst.}
535: \textbf{\bibinfo{volume}{3}}, \bibinfo{pages}{139} (\bibinfo{year}{1992}).
536:
537: \bibitem[{\citenamefont{Willshaw et~al.}(1969)\citenamefont{Willshaw, Buneman,
538: and Longuet-Higgins}}]{willshaw1969}
539: \bibinfo{author}{\bibfnamefont{D.~J.} \bibnamefont{Willshaw}},
540: \bibinfo{author}{\bibfnamefont{O.~P.} \bibnamefont{Buneman}},
541: \bibnamefont{and} \bibinfo{author}{\bibfnamefont{H.~C.}
542: \bibnamefont{Longuet-Higgins}}, \bibinfo{journal}{Nature}
543: \textbf{\bibinfo{volume}{222}}, \bibinfo{pages}{960} (\bibinfo{year}{1969}).
544:
545: \bibitem[{\citenamefont{Lee}(2003)}]{Lee2003}
546: \bibinfo{author}{\bibfnamefont{D.}~\bibnamefont{Lee}}, \bibinfo{journal}{J.
547: Neurosci.} \textbf{\bibinfo{volume}{23}}, \bibinfo{pages}{6798}
548: (\bibinfo{year}{2003}).
549:
550: \end{thebibliography}
551:
552: \end{document}
553: %
554: % ****** End of file apssamp.tex ******
555:
556: % LocalWords: apssamp tex APS REVTeX README TeX'ing BibTeX bibtex QED Takaaki
557: % LocalWords: Aoki Toshio Aoyagi Hebbian Fukai Infomatics neurophysiological
558: % LocalWords: PACS showkeys stimulusspecfic taskspecific electrophysiological
559: % LocalWords: msec rastergram eq ifmodel ds grp sync async asynchronized ij dV
560: % LocalWords: Willshaw willshaw dt nT LG eps rastergrams neurophysiologically
561: % LocalWords: ASYN SYN mT du inh addtioning destabilization addtionnal Syn url
562: % LocalWords: Asyn natexlab bibnamefont bibfnamefont citenamefont urlprefix dv
563: % LocalWords: Riehle Gruen Diesmann Aertsen riehle Konig Engel Varela Lachaux
564: % LocalWords: Martinerie Neurosci Buzsaki Terada Kang Kaneko Neurocomputing
565: % LocalWords: Takekawa takekawa Comput Rorie Desimone Tanaka amari Biol Cybern
566: % LocalWords: kohonen Malsburg von der Kybernetik lumer hopfield Proc Natl Sci
567: % LocalWords: Acad Buneman Longuet WTA todo Astrophys Nuovo Cim Phys Nucl Lett
568: % LocalWords: Commun Int Prog Theor Soc Jpn Suppl Brody Scarpetta Zhaoping
569: % LocalWords: postsynaptic rescale Neuroscience unequilibrium
570: