1: % file Tadic:adrw.tex
2: %\documentstyle[aps,preprint,epsf]{revtex}
3: \documentstyle[aps,prl,multicol,epsf]{revtex}
4: %\tighten
5:
6: \begin{document}
7:
8: \title{Adaptive Random Walks on the Class of Web Graphs}
9:
10: \author{Bosiljka Tadi\'c$^*$}
11:
12: \address{Jo\v{z}ef Stefan Institute,
13: P.O. Box 3000, 1001 Ljubljana, Slovenia }
14:
15: %\date\today
16:
17: \maketitle
18: \begin{abstract}
19: We study random walk with adaptive move strategies on a class of
20: directed graphs with variable wiring diagram. The graphs are grown from
21: the evolution rules compatible with the dynamics of the world-wide Web
22: [Tadi\'c, Physica A {\bf 293}, 273 (2001)], and are characterized by a
23: pair of power-law distributions of out- and in-degree for each value
24: of the parameter $\beta$, which measures the degree of rewiring in the graph.
25: The walker adapts its move strategy according to locally available information
26: both on out-degree of the visited node and in-degree of target node.
27: A standard random walk, on the other hand, uses the out-degree only.
28: We compute the distribution of connected subgraphs visited by an ensemble of
29: walkers, the average access time and survival probability of the walks.
30: We discuss these properties of the walk dynamics relative to the changes
31: in the global graph structure when the control parameter $\beta $ is varied.
32: For $\beta \geq 3$, corresponding to the world-wide Web,
33: the access time of the walk to a given level of hierarchy on the
34: graph is much shorter compared to the standard random walk on the same graph.
35: By reducing the amount of rewiring towards rigidity limit $\beta \to \beta_c
36: \lesssim 0.1$, corresponding to the range of naturally occurring biochemical
37: networks,
38: the survival probability of adaptive and standard random walk
39: become increasingly similar. The adaptive random walk can be used as an
40: efficient message-passing algorithm on this class of graphs for large
41: degree of rewiring.
42: \end{abstract}
43: \pacs{PACS numbers: 05.40.Fb, 89.20.Hh, 89.75.Da}
44:
45:
46: %\newline
47: \begin{multicols}{2}
48:
49: \section{Introduction}
50: It has been recognized recently that the key role in
51: the dynamics of complex systems is played by the
52: evolving networks of various structures \cite{Strogatz,Reka}.
53: Evolution of complex networks representing catalytic reactions,
54: cell metabolic processes, relaxation
55: in disordered systems, protein folding, and realistic
56: ecological, social, and information
57: networks \cite{Strogatz,Reka,metabolic,folding,ecology,Mark,SCN,WWW}
58: are guided by variety of principles inherent to each particular network.
59: Technically, the study of the evolving networks includes
60: theory of graphs, as opposed to regular lattices, which are appropriate
61: mathematical objects in the study of driven cellular automata with
62: diffusive dynamics \cite{DD}. Both, the
63: dynamics of {\it nodes} and {\it arcs} (links) contribute to the evolution
64: of the network. Thus, network growth implies that a complex
65: architecture of links emerges, which is peculiar to the network, as an
66: effect of the individual microscopic rules at work.
67:
68:
69: Many complex networks self-organize into a scale-free structures of
70: links (for a recent review see \cite{Reka}).
71: The appearance of a scale-free
72: structure is not accidental, having that networks grow from stochastic
73: rules, that assumes certain degree of disorder on the microscopic scale.
74: This rules result in the occurrence of dynamic fractal structures
75: on the growth time-scale \cite{BT1}, which is then manifested in the
76: emergent hierarchical organization of node degrees at large evolution times.
77: In growing networks the {\it preference} attachment such as in socially
78: motivated linking, e.g., in science citation network \cite{SCN}, was
79: shown to be one of dominant mechanisms \cite{other_mech} leading to the
80: scale-free structure of links \cite{Reka,BJA}.
81: However, in many other growing networks the preference attachment
82: alone has no capacity to take into account the intimate relationship
83: between structural complexity of the networks and their evolution.
84: This implies dynamically changing wiring diagram, in sharp contrast to
85: the rigid link structure in the science citation network, for example.
86: Here we concentrate on this type of networks with the world-wide Web
87: as a prominent example, in which constantly updated links yield rapidly
88: changing wiring diagram \cite{Strogatz,BT1}.
89:
90: On the other hand, the occurrence of various {\it universality
91: classes}---characterized by the same scaling exponents---suggests that
92: only certain details of the microscopic dynamics are relevant for the
93: universal scaling behavior of complex networks, in
94: analogy to critical behavior in physical systems in equilibrium
95: \cite{critical}. Although the theoretical background of the
96: {\it universality} in complex dynamic systems and networks is still
97: missing, numerical simulations on specific models \cite{BT1} and
98: master equation calculations \cite{DMS,DM,Rodgers1,Rodgers2}
99: suggest that the following local properties (alone or in the appropriate
100: combinations) of the dynamics are relevant for the emergent universal
101: behavior:
102: (a) Directed vs symmetric links (looked from a node in the network);
103: (b) Fixed vs variable wiring diagram and time scale of its variations
104: compared to the growth time scale;
105: (c) Type of preference linking; and (d) Presence of constraints in the
106: microscopic growth rules \cite{constraints}.
107:
108: Recently we have introduced a model of growing directed graph with
109: bias updates and biased attachment of links, motivated by the conduct
110: of agents in the real world-wide Web \cite{BT1}. It was shown that the
111: model captures minimum relevant
112: properties for the dynamics of the Web, leading to a satisfactory
113: quantitative comparison of the universal scaling quantities with the
114: ones measured in the real Web \cite{WWW}.
115: The relevant control parameter of the
116: model $\beta $, defined as the average ratio of updated and added links
117: per time step (thus measuring the degree of rewiring in the graph)
118: can vary in the range $(0,\infty )$.
119:
120: The dynamic processes such as random walk specifically designed to the
121: Web graphs reveal important information on network's
122: relaxation upon triggering and suggest how these networks can be
123: efficiently explored. In Ref.\ \cite{BT2} we introduced a random walk
124: with adaptive walk strategy, that utilizes the locally available information
125: on the underlying graph structure.
126: In previous works \cite{BT1,BT2} we have discussed the structure
127: and dynamics of the world-wide Web, representing a directed graph in this
128: class with rapidly changing wiring diagram: Estimated
129: \cite{BT1} value of $\beta \sim 3-4$ from the scaling agreement with
130: the observed behavior \cite{WWW}.
131:
132: In this work we extend the study to the entire class of graphs generated
133: by varying the control parameter $\beta $ in the physical range $(0,\infty )$.
134: In the limit of extreme rewiring ($\beta \to \infty$) some of the scaling
135: features of the class disappear. On the other end, for $\beta \to \beta _c(N)
136: \lesssim 0.1$ the graph undergoes a rigidity transition, where majority
137: of links in the graph remains fixed in time.
138: Among the networks between these two limits are the world-wide Web and
139: networks representing a potential range of naturally occurring metabolic
140: networks and catalytic reactions in open environment \cite{DNA}.
141: Specifically, we study (1) how the global graph structure varies with
142: the control parameter $\beta $ in the entire range before the rigidity
143: transition, and
144: (2) how these structural properties influence the relaxation of the
145: network and the dynamics of the random walk with variable walk strategies.
146: In addition, study of the random-walk dynamics reveal how the local
147: clusters participate in the global behavior of the graph. We briefly discuss
148: the potential application of the random-walk path in communication processes
149: on these class of graphs.
150:
151: The organization of the paper is as follows: In Sec.\ II we present the
152: growth rules of the class of Web graphs. We grow large networks of
153: $5\times 10^6$ nodes to determine the distributions of out- and in-degree
154: for the range of values of the control parameter $\beta $. In Sec.\ III we
155: define the adaptive random walk on this class of graphs and study
156: the structure of connected subgraphs scanned by an ensemble of such walkers,
157: which we then compare with the statistics of a standard random walk on
158: the same graphs. In Sec.\ IV we determine the survival probability
159: distribution of these two types of random walk and their access time to a
160: given hierarchy level.
161: Sec.\ V is devoted to a short summary and conclusions.
162:
163:
164: \section{Growth and Structure of the Web Graph}
165:
166:
167: A directed Web graph is grown from the dynamic rules proposed in Ref.\
168: \cite{BT1}, which are based on the criteria (a)--(c) listed above.
169: (Potential effects of aging and other constraints
170: on the microscopic dynamic rules are left out of this work).
171: A growth step is defined by adding a node and subsequently creating and/or
172: removing links in the entire network,
173: that results in total increment $M(t)$ links at time step $t=i$. Naturally,
174: we take $M \equiv {\overline{M(t)}} > 0$, suggesting that, in the average,
175: the number of links increase at each time step. The links are updated in the
176: following way. An outgoing link originates from a node $n < i$ with the
177: probability
178:
179: \begin{equation}
180: p_1(n,i) = {{\alpha M + q_{out}(n,i)}\over{(1+\alpha)M*i}} \ ,
181: \label{out_linking}
182: \end{equation}
183: which is determined by the number of outgoing links $q_{out}(n,i)$
184: previously created at that node.
185: The link points towards the node $k < i$ with the probability
186: \begin{equation}
187: p_2(k,i) = {{\alpha M + q_{in}(k,i)}\over{(1+\alpha)M*i}} \ ,
188: \label{in_linking}
189: \end{equation}
190: where $q_{in}(k,i)$ is the current number of
191: incoming links collected at target node up to the step $i$. It is
192: assumed that at the time of addition of a node $i$ to the network
193: $q_{out}(i,i)=q_{in}(i,i)= 0$. In addition a fraction
194: $f_0(t)\equiv \alpha M(t)$ of new links are outgoing links
195: from the new added node $i=t$. Whereas the remaining
196: $f_1(t)\equiv (1-\alpha )M(t)$ links are the updated links at preexisting
197: nodes in the network. Hence, the relevant parameter in the model
198: is the ratio of updated and added links at
199: each time step, i.e., $\beta \equiv f_1(t)/f_0(t) =(1-\alpha )/\alpha$,
200: (independent of the actual increment $M(t)$), which measures the degree
201: of rewiring (or flexibility) of the graph.
202: The Eqs.\ (\ref{out_linking})-(\ref{in_linking})
203: are motivated by the conduct of the agents who create links in the real Web:
204: A new link is is likely to be created by the most active agents in the network,
205: and, similarly, the most probable target node will be the one that
206: already attracted many links. For consistency, we use $M=1$ throughout
207: this work \cite{comment-M}.
208:
209: The numerical simulations in Ref.\ \cite{BT1} demonstrated that the
210: rules in Eqs.\ (\ref{out_linking})-(\ref{in_linking}) are compatible with the
211: observed scaling behavior of the real Web, when the single control parameter
212: $\beta $ is set to a given value $\beta \approx 3$, corresponding to
213: $\alpha \approx 0.2$ within estimated error bars. The dynamically
214: emerging out- and in-degree cumulative distributions are given by the
215: power-law functions
216: \begin{equation}
217: P(q_{out}) \sim q_{out}^{-(\tau _{out} -1)} \ ;~~~~ \
218: P(q_{in}) \sim q_{in}^{-(\tau _{in}-1)} \ ,
219: \label{PP}
220: \end{equation}
221: in the asymptotic region for large number of links (i.e., large networks).
222: The distributions are given in Fig.\ 1 for various values of the control
223: parameter, showing the $\alpha $-dependent scaling exponents
224: $\tau _{out}$ and $\tau _{in}$.
225:
226: The asymptotic scaling behavior of the in-degree distribution that is
227: generated by the shifted-linear preference rule in Eq.\ (\ref{in_linking})
228: with $\tau _{in} = 2+\alpha $ was proved exactly in Ref.\ \cite{DMS},
229: that agrees completely with our results in Fig.\ 1.
230: Recently, a similar analysis using rate equation approach was done in Ref.\
231: \cite{Rodgers1} for a directed graph in which in addition the probability
232: of creating a link $C(n,k)$
233: from the preexisting node $n$ to node $k$ depends on the out-degree of
234: the node $n$ and in-degree of the target node $k$. It was demonstrated that
235: when $C(n,k)$ is given by a product of two shifted-linear functions of the
236: corresponding degrees, the emergent distributions of in- and out-degree
237: are power-law type and statistically correlated \cite{Rodgers1}.
238: According to the above rules in Eqs.\ (\ref{out_linking})-(\ref{in_linking}),
239: the probability for link creation $C(n,k)$
240: in our model is $C(n,k)= p_1(n,i)\times p_2(k,i)$, which is exactly the type
241: of function compatible with a double-power law distributions for
242: out- and in-degrees, in agreement with numerical results in Fig.\ 1.
243: Emergence of statistical correlations between in- and out-degree
244: distributions is discussed in Ref.\ \cite{BT1}.
245: The model of Ref.\ \cite{Rodgers1} is slightly different from ours, involving
246: three parameters that can not be reduced to a single control parameter,
247: making it difficult to extract an exact value of the exponent $\tau _{out}$
248: in terms of our control parameter $\beta $ (or $\alpha$). The observed
249: behavior shown in Fig.\ 1 suggests that $\tau _{out}$ increases
250: approximately linearly with $\alpha $ for $0.1 < \alpha \leq 0.5$ (i.e.,
251: $9> \beta \geq 1$).
252: However, $\tau _{out}$ increases rapidly in the region below
253: $\beta \lesssim 1/2$,
254: suggesting that the distribution of out-degree becomes exponential when
255: the rigidity of the graph increases towards a finite critical value. Note that
256: in the ideally rigid graph $\beta \equiv 0$ the out-degree distribution is
257: trivial: each node has exactly $M$ links that remain fixed in time.
258:
259:
260: Study of the distribution of connected components done in Ref.\ \cite{BT1}
261: suggests that for $\beta$ larger than some critical value $\beta > \beta _c(N)$
262: a giant connected component occurs, similar to the real Web \cite{WWW}.
263: By decreasing the control parameter $\beta $ the network structure
264: changes gradually, eventually
265: undergoing the phase transition into a structure without a giant component
266: \cite{BT1}. The critical value of $\beta $ depends on the network size $N$
267: and in the cases studied here it is close to $\beta _c
268: \approx 1/12$.
269: Loss of scaling in the out-degree distribution at $ 1/3>\beta > \beta_c(N)$,
270: while the in-degree still exhibits scaling behavior,
271: demonstrates the power of cooperation in
272: the network: Although the rules (\ref{out_linking}) and (\ref{in_linking})
273: formally look alike, the dynamical variations in $q_{out}(n,i)$ are
274: due to local force, whereas the increase of $q_{in}(k,i)$ with time is
275: made by a collective effect. Consequently, certain dynamical processes
276: which are related to the out-degree structure might change their character
277: before the network becomes rigid. Next we study random walk processes
278: on this class of graphs.
279:
280:
281:
282:
283:
284:
285:
286: \section{Random Walks with Variable Strategy}
287:
288:
289: We define two types of the random walks: a standard random walk,
290: and a walk that learns its strategies from the information stored
291: at a visited node on the graph, as defined below.
292: First we grow the graph of $N$ nodes
293: using the rules in Eqs.\ (\ref{out_linking})-(\ref{in_linking}), and then
294: start a walk from a randomly selected node, say node $n$.
295: In the simple case, here called a naive random walk (NRW) for the
296: reason to be clear soon, the walker moves along one of the $q_{out}(n,N)$
297: outgoing links of that node, selecting the link with equal probability
298: \begin{equation}
299: w(n) = 1/q_{out}(n) \ ,
300: \label{wNRW}
301: \end{equation}
302: where we write $q_{out}(n) \equiv q_{out}(n,N)$, assuming for simplicity
303: that the network does not grow during the walk time. In this way the
304: walker selects a target node, say $k$, and moves there making one time
305: step of the walk.
306: Note that this standard random walk on the graph of the structure given in
307: Eq.\ (\ref{PP}) is more complex compared to the case of hierarchical graphs
308: with a constant branching ratio, in that it moves in an environment with
309: variable structure of the relevant out-degree.
310: An adaptive random walk (ARW), on the other hand, makes move selections
311: with the statistical weight, which is correlated with the linking strategies
312: of the visited node. In this case we assume that a link $\ell $ from
313: node $n$ to node $k$ has a weight defined by
314:
315: \begin{equation}
316: w_\ell(n) \sim p_2(k,N) \ , ~~~\Sigma _{\ell =1}^{q_{out}(n)}
317: w_\ell (n) =1 \ ,
318: \label{pw}
319: \end{equation}
320: where $p_2(k,i=N)$ is given in Eq.\ (\ref{in_linking}) with the normalization
321: indicated in Eq.\ (\ref{pw}). Hence, the adaptive random walker uses the same
322: type of strategy that was used earlier by the visited node, thus moving
323: preferably along ``hot'' links of the visited node. Note that the
324: probability $w_\ell (n)$ is not identical to $p_2(k,i)$ both because it is
325: evaluated at a later time and it is normalized. In this way, the adaptive
326: walker exploits full information about local graph structure, which is
327: done by the out-degree of the visited node and in-degrees of all with that node
328: connected target nodes \cite{comment-q}. The naive random walker,
329: on the contrary, uses only the first part of information. As a
330: quantitative measure of different move strategies it is useful to consider
331: the first-step statistics \cite{VP-privat}.
332: We show in Fig.\ 2 the comparative statistics of the {\it first jump} of
333: an ensemble of $N_a$ walkers with the naive and adaptive strategies,
334: respectively, simulated
335: on the same graph and using the same set of random numbers.
336: It is shown in Fig.\ 2 that an adaptive search of the direction by
337: the first jump is guided by the graph structure: the slope of the
338: distribution of the first-jump distances (measured in node ranks)
339: resembles the in-degree distribution.
340: For the ensemble of this size the out-degree distances made in the
341: first jump are correlated with the in-degree distances in view of Eq.\
342: (\ref{pw}). In the random search the distribution is still a power-law,
343: however, the graphs structure is
344: much less recognized (slope of the distribution of the first jumps
345: is by one lower than the in-degree distribution of the graphs). Also
346: much weaker, if any, correlations between in- and out-degree distances
347: are observed.
348: The walker continues
349: as long as it is visiting nodes with nonzero number of out-links $q_{out} >0$.
350:
351:
352:
353: \subsection{Structure of connected subgraphs}
354:
355:
356: A non-interrupted walk scans a set of {\it connected} nodes on the graph.
357: The set of visited nodes is thus a connected subgraph smaller than
358: a connected component that is usually searched
359: by the Web crawl \cite{WWW,BT1}. An ensemble of random walkers thus can be
360: used to scan the {\it local structure} of connected subgraphs, which in
361: principle differs from the global graph structure.
362:
363: The ``distance'' traversed by the walker on the graph is best measured
364: in the node-rank differences, i.e., distance in the levels of hierarchy,
365: in which the graph structure is nontrivial.
366: Spatial distribution of nodes is, in principle, random, whereas the
367: temporal fractal structure \cite{BT1} occurs on the growing time scale.
368: In Fig.\ 3 we show the time-integrated probability distributions of
369: the node-rank distances for adaptive random walk on the graph with $N=10^4$
370: nodes and varying the control parameter $\beta $. An ensemble of
371: $N=20\times 10^4$ walkers was employed. In Fig.\ 4 the corresponding
372: distributions obtained by the ensemble of naive random walkers are shown
373: that are simulated in the same conditions as the adaptive random walkers
374: in Fig.\ 3.
375:
376:
377:
378: The distributions of connected subgraphs found both by the ensemble of
379: adaptive, $W(\Delta q)$, and the ensemble of naive, $R(\Delta q)$, random
380: walkers are power-law type ($\kappa =out,in$):
381: \begin{equation}
382: W(\Delta q _{\kappa}) \sim (\Delta q _{\kappa})^{-\delta _{\kappa}} \ ; ~~~
383: R(\Delta q _{\kappa}) \sim (\Delta q _{\kappa})^{-\rho _{\kappa}} \ .
384: \label{Wq}
385: \end{equation}
386:
387: Distinction between the respective distributions for in- and out-degree
388: distances are resembling the underlying graphs structure. On the other hand,
389: the difference in the scaling exponents, for instance in $\delta _{out}$ and
390: $\rho _{out}$ and similarly with $\delta _{in}$ and
391: $\rho _{in}$ suggest that ARW and NRW are two qualitatively distinct
392: types of processes. Namely, both $\delta _{out} >2 $ and $\delta _{in}>2$,
393: whereas $\rho _{out}< 2$ and $\rho _{in} < 2$
394: indicating that the average distance in the case of the naive random walk
395: diverges \cite{comment-qmax} with $\Delta q \to \infty$ at $N\to \infty$,
396: whereas the adaptive random walk remains in the confined areas-distances,
397: $<\Delta q> < \infty$ when $N\to \infty$. These properties have
398: important consequences, for instance for the disease spreading \cite{Romu}
399: {\it along the random walk path} on the graph.
400:
401: In the case of ARW the similarity between the $W(\Delta q_{out})$ and
402: $W(\Delta q_{in})$ and the corresponding distributions in Fig.\ 1
403: in the scaling region is striking.
404: By increasing the probability $\alpha $ of a link outcoming from the
405: new-added node, fast
406: decrease of the distribution $W(\Delta q_{out})$ in Fig.\ 3 makes the
407: exponent $\delta _{out}$ difficult to measure for
408: $\alpha >0.6$ . At a crossover value close to $\beta \sim 1/3$ the
409: distribution approaches the exponential form.
410: At $\alpha =1$ all nodes have exactly one out-link, rendering this
411: distribution trivial.
412:
413:
414:
415:
416: \section{Survival and Access Time of the Walk}
417:
418: Next we study the survival probability of a walk and the average access
419: time of a walker to a given level of hierarchy. These properties
420: are relevant for
421: the relaxation of the graph and message passing to a given distance
422: in hierarchy on the graph, respectively.
423:
424: The access time is defined as a number of steps necessary for a walker
425: to make a given distance here measured in the difference of the hierarchy
426: levels of the departing and accessed node.
427: In Fig.\ 5 the average access time normalized to the size of the ensemble
428: $N_a$ is plotted against the difference in the hierarchy levels between
429: departing and visited nodes for two values of the parameter $\beta $ and
430: distances measured both by in- and out-degree. A remarkable feature is the
431: power-law behavior of the access time \cite{BT2}. In general, the scaling form
432: \begin{equation}
433: <t_{acccess}> \sim (\Delta q_\kappa )^{-\theta _\kappa }f(t/\Delta q_\kappa )
434: \label{tacc-q}
435: \end{equation}
436: applies both for adaptive and naive random walks when $\beta $ is large.
437: However, the exponents $\theta _\kappa $ ($\kappa$ stands for
438: ``in,A'' and ``out,A'' for the adaptive and similarly ``in,R'' and
439: ``out,R'' for random walk) are both larger than 2 in the case of
440: the adaptive search of the destination, whereas $1<\theta _\kappa <2$
441: for the naive random walk. Hence, apart from the small distances, the
442: average access time of the adaptive random walk is much shorter compared to
443: the standard random walk.
444: This makes the adaptive random walk a
445: good basis for its potential application as an efficient algorithm
446: \cite{search} for message-passing to a given level of hierarchy.
447: In the case of catalytic reactions, this
448: property of the adaptive random walk suggests that in the average fewer
449: number of reactions occur along the path before a targeted reaction at
450: a given hierarchy level is reached.
451: Accordingly, the survival probability, $P_s(t)$ shown in Fig.\ 6,
452: represents two different types of relaxation processes for large graph
453: flexibility (large $\beta $): a nearly
454: exponential relaxation in the case of ARW, and stretch-exponential
455: for the NRW, respectively.
456:
457:
458:
459:
460:
461:
462: The difference between adaptive and random search for the target
463: gradually diminishes with increasing rigidity of the graph (i.e., decreasing
464: the degree of rewiring $\beta $),
465: making the wandering on the graphs similar in both cases when the critical
466: point is approached $\beta \approx \beta_c(N)$. In Fig.\ 6
467: we show the probability $P_s(t)$ that a walk survives for $t$ steps
468: on the graph, when the control parameter $\beta $ is varied.
469: At the critical value ($\beta _c\sim 0.081 $ for the graph sizes used in this
470: simulations), the survival probabilities
471: of the two types of walks almost coincide statistically.
472: In the limit $\beta =0$, i.e., when $\alpha = 1$ in Eqs. \
473: (\ref{out_linking})-(\ref{in_linking}), each node has exactly one out-link,
474: rendering the
475: both walk strategies redundant. As we already pointed out, this limit
476: corresponds to the graph with fixed links, belonging to another
477: universality class compared to the Web graph that we discuss here.
478:
479:
480:
481:
482:
483: \section{Discussion and Conclusions}
484:
485:
486: We have studied a class of directed graphs with variable wiring diagram
487: caused, for instance, by frequent updates of the out-links in the world-wide
488: Web while the graph evolves. The relevant control parameter that defines
489: the class is the average ratio of updated vs. fixed links, $\beta \equiv
490: (1-\alpha )/\alpha $. In the case of the Web $\beta $
491: is estimated \cite{BT1} in the range 3--4, i.e., to each added link in the
492: Web comes in the average 3 to 4 links that connect preexisting nodes at
493: each time step of the evolution.
494: Other members of this class of graphs can be sought in the catalytic
495: biochemical reactions, in which nodes are substrates (such as ATP,
496: ${\mathrm{CO_2,
497: H_2O}}$, etc.) and links are reactions among these substrates
498: \cite{Strogatz,Reka,BT2}. Since the backward reactions, although
499: present, are usually driven by much smaller rates than forward reactions
500: \cite{Bimath_book}, the biochemical reactions are
501: represented by directed hierarchical graphs, with ATP as a top connected
502: node. The presence of catalysts or enzymes selects appropriate reaction
503: with a high accuracy. Investigations and potential
504: applications of catalytic reactions among complex molecules is a great
505: challenge of sciences in the future \cite{DNA}. The control parameter
506: in this case can be roughly identified as the concentration of the
507: catalyst, that can vary depending on the type of the reactants and/or
508: catalyst.
509:
510: Here we investigated within the growth model of Ref.\ \cite{BT1} how the
511: structure of the out- and in-connections of the graph
512: vary with the control parameter and how that structure influences the
513: relaxation processes on the graph.
514: We summarize the properties that appear as direct
515: consequences of the flexibility of the graph:
516:
517: (1) In addition to in-degree, the out-degree distribution appears to
518: be a power-law distribution with a new scaling exponent; Correlations
519: between out- and in-degree spontaneously develop;
520:
521: (2) These structural properties of the graphs determine the properties
522: of the random walks on these graphs. Richness of the doubly-hierarchical
523: connections allows us to define various types of the random walk
524: strategies. Specifically, the adaptive random walker fully utilizes
525: local information on both in- and out-connectivity of a visited node and
526: adapts its moves to follow the node linking preferences. On the other hand,
527: a standard random walker makes use of
528: the out-degree of a visited node searching only the possible ways out.
529: For large graph flexibility the adaptive strategy proves effective in the
530: search of connected subgraphs and in reducing the access time to a given
531: hierarchy level. Quick relaxation of the graph represented by the ARW path
532: in this range of parameter indicates a short list of reactions before a
533: targeted reaction occur.
534:
535: The dynamic processes on this class of graphs reflect the underlying
536: graph structure, leading to a variety of scale-free properties with
537: distinct functional dependences on the in- and out- node degrees.
538: Summary of all scaling exponents for varying flexibility (or rigidity)
539: of the graph is shown in Fig.\ 7. To understand the theoretical basis of
540: these dependences an analytical study in terms of rate equations
541: of the random-walk dynamics is necessary.
542:
543:
544: (3) By increasing the graphs rigidity (reducing degree of rewiring $\beta $)
545: the advantage of the strategy ``reading full information on the way'' is lost:
546: Survival of the adaptive random walk becomes statistically closer
547: to the one of the naive walk strategy; Access time gradually approaches
548: the Poisson character; At a critical flexibility $\beta _c \lesssim
549: 0.1$ the graph structure undergoes the rigidity percolation transition
550: to another universality class characterized with predominantly fixed
551: wiring diagram, in which the random walk dynamics becomes trivial.
552:
553: (4)The other limit $\beta \to \infty$, representing the extreme
554: flexibility, is formally interesting as a possible course of the world-wide
555: Web evolution. In this limit the evolving network {\it at each growth
556: stage} shares some similarity with the static random graphs! We detect
557: certain numerical instability in the distributions
558: that can be related to the changes in the linking probabilities
559: Eqs.\ (\ref{out_linking})-(\ref{in_linking}) when $\alpha \to 0$.
560: After a large number $N_1$ nodes are added, these probabilities are
561: $N_1$-dependent as $p_\kappa \sim \alpha /(1+\alpha )N_1 +
562: 1/(1+\alpha )N_1^{(1-1/\tau_{\kappa})}$, where we assumed that
563: maximum degree varies with the network size approximately as $q_\kappa \sim
564: N_1^{1/\tau _\kappa}$, (as before, $\kappa $ stands for ``in'' or ``out'').
565: In the random-graph theory the leading inverse linear term of linking
566: probability is compatible with the occurrence of cycles (i.e., triangles,
567: squares, pentagons, etc.) of all sizes, whereas the additional inverse
568: sublinear term introduces admixture of full graphs \cite{RG_book}. By letting
569: $\alpha \to 0$ the leading linear term disappears, inducing sudden change
570: in the structure of subgraphs---now being only full graphs. Now, having
571: $\tau _{in}\sim 2$ for small $\alpha $ leads to $p_{in} \sim 1/N_1^{1/2}$,
572: that is compatible with the occurrence of fully connected pentagons.
573: Whereas $\tau_{out}\sim $3--2.5, leading to $p_{out}\sim
574: 1/N_1^{2/3}$--$1/N^{3/5}$ allowing appearance of at most fully connected
575: squares. This suggests why the
576: exponent of the out-degree should stay larger than the one of in-degree
577: distribution when $\alpha \to 0$.
578: Numerical simulations suggest (see Fig.\ 7) that $\tau_{out}\to 2.5$,
579: whereas $\tau_{in}\to 2$ in this limit.
580:
581: Random walk path may serve as a communication channel in modeling of
582: packet transport on this class of graphs. In addition to channels,
583: the communication processes depend on the properties of packets to be
584: transported and of driving rate resulting in load at individual nodes.
585: By varying these parameters on a hierarchical tree it was shown in Ref.\
586: \cite{Diaz} that a continuous transition to a congested regime occurs,
587: that exhibits several universal features.
588: Looked in this context, our study concentrates on the properties of the
589: communication channels only, and we do not specify any details on
590: the character of packets. The simulation conditions thus correspond to
591: idealized low driving rate below the transition point.
592: Apart from the occurrence of cycles (closed loops), the Web graph
593: differs from the hierarchical tree in that linked nodes are
594: {\it preferably} at large distances of hierarchy, in contrast to the
595: tree structure where only next hierarchy levels are coupled.
596: We have demonstrated that due to the complex double-hierarchical
597: structure of the Web graph the channel selection can be done using
598: various strategies, each of them resulting in a nontrivial statistical
599: properties of the channels. How these channel properties would influence
600: the communication processes when more realistic packets and driving
601: conditions are considered remains for the future study.
602:
603:
604:
605:
606:
607: In conclusion, we have demonstrated that flexible wiring diagrams in
608: the class of directed graphs induces a number of structural and relaxation
609: properties that are crucial both for evolution of these graphs
610: and for design of dynamic processes for exploring their structure.
611:
612:
613:
614:
615:
616:
617:
618: \acknowledgments
619: This work was supported by the Ministry
620: of Education, Science and Sports of the Republic of Slovenia. I thank
621: to Vyatcheslav Priezzhev for helpful suggestions.
622:
623:
624:
625:
626:
627: \begin{references}
628: \bibitem[]{$^*$}$^*$Electronic address: Bosiljka.Tadic@ijs.si
629:
630: \bibitem{Strogatz} S. H. Strogatz, Nature {\bf 410}, 268 (2001).
631:
632:
633: \bibitem{Reka} R. Albert and A.-L. Barabasi, ``Statistical Mechanics of
634: Complex Networks'', Rev. Mod. Phys. (in press).
635: %\bibitem{catalytic}catalytic
636:
637: \bibitem{metabolic} P. M. Gleiss, P. F. Stadler, A. Wagner, and D. A. Fell,
638: cond-mat/0009124; H. Jeong, B. Tombor, R. Albert, Z. N. Oltvai, and A.
639: Barabasi, Nature {\bf 407}, 651 (2000).
640:
641: \bibitem{folding}A. Scala, L.A.N. Amaral, and M. Barth\'el\'emy,
642: cond-mat/0004380
643:
644: \bibitem{ecology}J.M. Montoya and R.V. Sol\'e, cond-mat/0011195.
645:
646:
647: \bibitem{Mark} M. E. J. Newman, Proc. Natl. Acad. Sci. 98,
648: 404 (2001).
649: \bibitem{SCN} S. Redner, Eur. Phys. J. B {\bf 4}, 131 (1998).
650:
651: \bibitem{WWW} A. Broder, R. Kumar, F. Maghoul, P. Raghavan,
652: R. Sridhar, R. Stata, A. Tomkins, and J. Wiener, Computer Networks
653: {\bf 33}, 209 (2000).
654:
655: \bibitem{DD}D. Dhar, Physica A {\bf 263}, 4 (1999).
656:
657:
658: \bibitem{BT1}B. Tadi\'c, Physica A {\bf 293}, 273 (2001); cond-mat/0011442.
659:
660:
661: \bibitem{other_mech} Other mechanisms, for instance in the Internet growth,
662: may also involve local optimization of supply, see A. Capocci {\it et al.},
663: cond-mat/0106084.
664:
665:
666: \bibitem{BJA}A.-L. Barabasi, R. Albert, and H. Jeong, Physica A
667: {\bf 272}, 173 (1999).
668:
669: \bibitem{critical} H. E. Stanley, {\it Introduction to Phase Transitions and
670: Critical Phenomena}, Oxford Univ. Press, (New York) 1971.
671:
672:
673: \bibitem{DMS} S.N. Dorogovtsev, J.F.F. Mendes, and A.N. Samukhin,
674: Phys. Rev. Lett. {\bf 85}, 4633 (2000).
675: \bibitem{DM} S.N. Dorogovtsev and J.F.F. Mendes, Phys. Rev. E {\bf 62},
676: 1824 (2000).
677:
678:
679: \bibitem{Rodgers1}L.P. Krapivsky, G. J. Rodgers, and S. Redner,
680: cond-mat/0012181.
681:
682: \bibitem{Rodgers2}G. Erg\"un and G. J. Rodgers, cond-mat/0103423.
683:
684:
685: \bibitem{constraints} A special type of aiging, fitness and other constraints
686: on the microscopic dynamic level are shown to affect the emergent behavior in
687: the preference attachment model, see discussion in Ref.\ \cite{Reka}.
688:
689: \bibitem{BT2}B. Tadi\'c, cond-mat/0104029
690:
691:
692: \bibitem{DNA} Such a reaction in which the reactants are added with
693: a given rate and the products constantly removed was proposed recently
694: to study work produced by molecular DNA motors, B. Yurke {\it et al.},
695: Nature, {\bf 406}, 605 (2000).
696:
697:
698:
699:
700:
701: \bibitem{comment-M}The actual number of links in the Web exceeds number
702: of nodes suggesting that a larger $M$ would be more realistic.
703: In the model the {\it universal} properties of the network in the scaling
704: region are not affected when $M$ is varied.
705:
706:
707: \bibitem{comment-q}Technically, in order to simulate large graphs we
708: preserve out- and in-degrees at each node from the growth phase and search
709: links by once again using the rule in Eq.\ (\ref{in_linking}). The potential
710: differences are minimized with increasing size of the ensemble.
711:
712: \bibitem{VP-privat}V. B. Priezzhev, privat communication.
713:
714:
715:
716: \bibitem{comment-qmax}The maximum degree scales with
717: the network size $q_{max} \sim N^D \approx N^{1/\tau }$.
718:
719:
720:
721: \bibitem{Romu} A different mechanism of desease spreading on hierarchical
722: graphs was considered in Ref. R. Pastor-Satorras and A. Vespignani,
723: cond-mat/0102028
724:
725: \bibitem{search}It was shown recntly that search time scales
726: sublinearly with the network size in several other search algorithms that
727: utilize local information in a power-law graph with symmetric links, see
728: L. A. Adamic, R. M. Lukose,
729: A. R. Puniyani, and B. A. Huberman, cs.NI/0103016, .
730:
731:
732:
733:
734:
735:
736: \bibitem{Bimath_book}J. Keener and J. Sneiyd, {\it Mathematical Physiology},
737: Springer, Berlin (1998).
738:
739: \bibitem{RG_book} B. Bollob\'as, {\it Modern Graph Theory}, Springer-Verlag,
740: New York (1998).
741:
742:
743: \bibitem{Diaz} A. Arenas, A. D\'{\i}az-Guilera, and R. Guimer\`a,
744: cond-mat/0009395 .
745:
746: \end{references}
747:
748:
749:
750:
751: \narrowtext
752: \begin{figure}
753: \epsfxsize=82mm\epsffile[58 70 508 714]{beta_fig1.ps}
754: \caption{\label{fig1}Cumulative probability distributions of out-degree
755: (top panel) and in-degree (lower panel) of the Web graphs containing
756: $5\times 10^6$ nodes for varying rigidity of the graph $1/\beta \equiv
757: \alpha/(1-\alpha )$. Top four curves are for $\alpha =$ 0.0125, 0.125, 0.25,
758: and 0.5 (top to bottom in both panels), and additional three curves
759: in lower panel for $\alpha =$1, 3, and 12. Line with filled circles:
760: Exponential distributions corresponding to the case of random selections of
761: source and target nodes. All data are log-binned with base 1.1 . Top
762: three curves are moved upwards for better vision. Lines indicate the
763: scaling region on each curve.
764: Variation of the slopes with the control parameter are discussed in the text.}
765: \end{figure}
766:
767:
768: \begin{figure}
769: \epsfxsize=82mm\epsffile[53 62 513 374]{beta_fig2.ps}
770: %\vskip 8mm
771: \caption{\label{fig2} Distribution $F_1(\Delta q_{\kappa})$ of the distance
772: on hierarchy levels $\Delta q_{\kappa}$ ($\kappa \equiv $out,in) made in the
773: first jump of the adaptive (ARW) and naive random walk (NRW), as indicated,
774: obtained by an ensemble of $N_a = 100\times 10^3$ walkers on the graph
775: of $N=10^4$ nodes. Slopes of in-degree first step distributions are:
776: 2.15 and 1.15 for ARW and NRW, respectively.}
777: \end{figure}
778:
779: \narrowtext
780: \begin{figure}
781: \epsfxsize=82mm\epsffile[58 70 508 714]{beta_fig3.ps}
782: %\vskip 8mm
783: \caption{\label{fig3}Time-integrated probability distribution
784: $W(\Delta q_{\kappa})$ of distance in hierarchy levels $\Delta q_{\kappa }$
785: made by ensemble of $N_a=20\times 10^4$ adaptive random walkers on the Web
786: graphs of $N=10^4$ nodes for ($\kappa \equiv $out) out-degree distances
787: (top panel) and ($\kappa \equiv $in) in-degree distances (lower panel).
788: Different curves correspond to the control parameter values $\beta =$9, 3, 1,
789: and $\beta _c$= 0.081, top to bottom. Solid lines are pawer-law fits
790: with the slopes $\delta _{out} =$2.52, 2.75, 3.83, and $\delta _{in}=$ 2.48,
791: 2.50, 2.64, and 2.90, respectively,
792: within numerical error bars $\leq \pm 0.06$.}
793: \end{figure}
794:
795: \begin{figure}
796: \epsfxsize=82mm\epsffile[58 70 508 714]{beta_fig4.ps}
797: %\vskip 8mm
798: \caption{\label{fig4}Same as Fig.\ 3 but for the ensemble of naive random
799: walkers and for $\beta =$3, 1, and 0.081 (top to bottom lines in both panels).
800: Power-law fits lead to the scaling exponents: $\rho _{out}=$ 1.48 and 2.03,
801: and $\rho _{in}=$ 1.22, 1.53, and 1.95, respectively,
802: within numerical error bars $\leq \pm 0.08$. }
803: \end{figure}
804:
805: \begin{figure}
806: \epsfxsize=82mm\epsffile[46 69 508 336]{beta_fig5.ps}
807: %\vskip 8mm
808: \caption{\label{fig5} Average access time (normalized by number of walkers
809: $N_a$) to a hierachy distance $\Delta q_\kappa$ ($\kappa =$ in, out) of
810: an ensemble of the adaptive (left panel) and naive (right panel) random
811: walkers for two values of the parameter $\alpha \equiv 1/(\beta +1) $,
812: as indicated. Distance measured in terms of in-degree (open symbols) and
813: out-degree (filled symbols). Slopes of the curves top to bottom are: 2.01,
814: 2.41, 2.61, and 3.64 , on left panel, and
815: 1.29, 1.51, 1.47, and 1.82, on right panel, respectively.
816: Estimated error bars within $\leq \pm 0.07$.}
817: \end{figure}
818:
819: \begin{figure}
820: \epsfxsize=82mm\epsffile[45 73 450 336]{beta_fig6.ps}
821: %\vskip 8mm
822: \caption{\label{fig6}Survival probability distribution $P_s(t)$ against
823: time steps $t$ for the adaptive random walk (symbols) and respective
824: naive random walk (solid lines) for varying degree of rewiring $\beta =$ 9,
825: 3, 1, 1/3, and 1/12 (left to right).}
826: \end{figure}
827:
828:
829: \begin{figure}
830: \epsfxsize=82mm\epsffile[70 73 513 336]{beta_fig7.ps}
831: %\vskip 8mm
832: \caption{\label{fig7}Various scaling exponents ploted vs parameter
833: $\alpha \equiv 1/(\beta +1)$. Filled symbols correspond to the out-degree
834: property, and same open symbols---to the corresponding in-degree property,
835: see legend and definitions in the text. Dashed lines: $2+\alpha $ and
836: $1+\alpha $. Dotted lines: nonlinear fit of $\tau _{out}$ and
837: same curve shifted downwards approximately by one. Notice that for the
838: distributions of the naive random walk we have: $\rho _{in}
839: \approx \tau _{in}-1$ and $\rho _{out}
840: \approx \tau _{out}-1$, and for the adaptive walk $\delta _{out} \approx
841: \tau _{out}$ whereas $\delta _{in}$ deviates from $\tau _{in}$ for small
842: $\alpha $ values.}
843: \end{figure}
844:
845:
846:
847: \end{multicols}
848: \end{document}
849: %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
850:
851:
852:
853:
854:
855:
856: #!/bin/csh -f
857: # this uuencoded Z-compressed .tar file created by csh script uufiles
858: # for more information, see e.g. http://xxx.lanl.gov/faq/uufaq.html
859: # if you are on a unix machine this file will unpack itself:
860: # strip off any mail header and call resulting file, e.g., betafgs.uu
861: # (uudecode ignores these header lines and starts at begin line below)
862: # then say csh betafgs.uu
863: # or explicitly execute the commands (generally more secure):
864: # uudecode betafgs.uu ; uncompress betafgs.tar.Z ;
865: # tar -xvf betafgs.tar
866: # on some non-unix (e.g. VAX/VMS), first use an editor to change the
867: # filename in "begin" line below to betafgs.tar_Z , then execute
868: # uudecode betafgs.uu
869: # compress -d betafgs.tar_Z
870: # tar -xvf betafgs.tar
871: #
872: uudecode $0
873: chmod 644 betafgs.tar.Z
874: zcat betafgs.tar.Z | tar -xvf -
875: rm $0 betafgs.tar.Z
876: exit
877:
878: