rhythmic elements are basic building blocks of nature at human scales .
they play particularly important roles in the functioning of biological systems , such as cardiac muscle cells , pacemaker neurons , and animals or plants following circadian or circannual rhythms .
recently , synchronization among non - interacting rhythmic elements induced by common fluctuating external force has attracted much attention in diverse fields .
it has been demonstrated for a wide class of rhythmic elements ranging from lasers and electronic circuits to biological systems  @xcite .
for example , reliable synchronous response of neurons due to common or shared input signals has been actively discussed in neuroscience  @xcite . in ecology , it is known that , due to common climate fluctuations , populations of plants exhibit large - scale synchronized flowering and production of seed crops also fluctuate synchronously from year to year  @xcite , and such phenomena are generally termed the `` moran effect ''  @xcite .    we often characterize a rhythmic element as a limit - cycle oscillator .
populations of coupled limit - cycle oscillators show a variety of interesting collective behavior , including mutual synchronization , wave propagation , and chaos  @xcite .
it is also well known that uncoupled limit - cycle oscillators can mutually synchronize when they are driven by common impulses  @xcite .
the simplest classical situation is , of course , synchronization due to phase locking of an oscillator to common periodic impulses  @xcite .
another interesting situation is noise - induced synchronization as mentioned above , caused e.g. by common random poisson impulses  @xcite .
the oscillators can also synchronize when the driving impulses have intermediate statistics between the periodic and the poisson impulses , as shown by yamanobe _
et al . _
@xcite for a model of pacemaker neurons driven by gamma - distributed impulses .
this prompts the question , what is the difference between the synchronization due to phase locking and noise - induced synchronization ? though drive - response configuration of the impulse source and the oscillators is the same for both cases ,
it is expected that there should be some difference in their synchronization dynamics , reflecting different characteristics of the driving impulses . in this paper
, we address this issue by considering uncoupled limit - cycle oscillators driven by gamma impulses , which can be smoothly interpolated between regular periodic and random poisson impulses .
we examine the transition from phase locking to noise - induced synchronization as the statistics of the gamma impulses is varied , and quantify their difference using phase distributions , lyapunov exponents , and information - theoretic measures .
effect of common gamma impulses on limit - cycle oscillators was previously treated in the paper by yamanobe _
et al . _
@xcite , but its main focus was not on the transition between the two types of synchronization but rather on physiologically realistic characterization of pacemaker neurons .
we here conduct a systematic , quantitative analysis of the transition between the two different synchronization dynamics .
we will reveal that the two types of synchronization dynamics are clearly different in many aspects , e.g. their stability , fluctuations , and statistical dependence on the driving impulses .
this paper is organized as follows . in sec .
ii , we introduce a model of uncoupled oscillators subject to common gamma impulses and demonstrate its synchronization dynamics for different types of driving impulses . in sec .
iii , we analyze phase distributions of the oscillators using frobenius - perron - type equations . in sec .
iv , we focus on frequency detuning of the oscillators due to impulsive driving . in sec .
v , we examine lyapunov exponents and their fluctuations in the synchronized states . in sec .
vi , we characterize mutual relationships among the impulse source and the driven oscillators by utilizing information - theoretic measures .
section  vii summarizes the results .
in this section , we introduce phase oscillators driven by common gamma impulses and demonstrate their synchronization dynamics .      based on the standard phase reduction theory of limit cycles  @xcite
, we can describe a limit - cycle oscillator using only its phase variable , @xmath0 , defined along its stable limit cycle provided that the intervals between the impulses are sufficiently longer than the amplitude relaxation time of the oscillator state to the limit - cycle orbit .
the key quantity for this description is the phase response curve ( prc ) @xmath1 of the oscillator  @xcite , which encapsulates its dynamical properties .
@xmath1 is a periodic function on @xmath2 that gives asymptotic response of the oscillator phase to an impulsive perturbation given at phase @xmath3 .
it has been measured experimentally , e.g. , for repetitively firing neurons  @xcite .
when the limit - cycle oscillator is kicked by an impulse at phase @xmath3 , the phase is mapped to a new value @xmath4 .
this function @xmath5 is sometimes called the `` phase transition curve '' in the literature .
the dynamics of the oscillator between two successive impulses consists of a jump caused by the first impulse and subsequent free rotation until the arrival of the second impulse  @xcite .
the oscillator is also subject to small temporal fluctuations of various origins .
we assume that each oscillator receives common driving impulses at times @xmath6 , and denote the phase of the oscillator just before the @xmath7th impulse by @xmath8 .
the effect of the @xmath7th impulse is to map the oscillator phase @xmath9 to @xmath10 . to incorporate the effect of small fluctuations
, we also apply a weak additive independent noise @xmath11 before the mapping . the phase @xmath12 just after the @xmath7th impulse is thus given by @xmath13 . after receiving the @xmath7th impulse
, the oscillator rotates with a constant frequency until @xmath14 at which the @xmath15th impulse arrives .
therefore , the phase @xmath16 just before the @xmath15th impulse is given by @xmath17 where @xmath18 is the inter - impulse interval , @xmath19 is the frequency of the oscillator , and we have taken modulo @xmath20 of the phase to confine it in @xmath2 . since @xmath21 and @xmath11 are random variables , this equation gives a random map , which we will call a `` random phase map '' hereafter .
when we consider multiple oscillators , @xmath22 is common to all oscillators , whereas @xmath23 is different from oscillator to oscillator .
note that @xmath11 represents small temporal fluctuations of the dynamics of oscillators , but not static heterogeneities in their natural frequencies .
mean frequency of the driven oscillator exhibits qualitatively different dependence on the driving impulse between phase locking and noise - induced synchronization , as we show in sec .
iv .    as the simplest and typical example
, we assume that the prc is given by a sinusoidal function @xmath24 in the following numerical analysis , so that the phase map is given by @xmath25 the parameter @xmath26 controls the magnitude of the nonlinearity , which may also be regarded as the intensity of the impulse . such a prc with both positive and negative lobes
are called type - ii  @xcite , which generally arises near the hopf bifurcation of limit - cycle oscillators  @xcite .
another typical example is the type - i prc with a single positive lobe , e.g. @xmath27 , which generally arises near the snic ( saddle - node on invariant circle ) bifurcation of oscillators  @xcite .
however , difference between these two prcs can roughly be eliminated by simply shifting the frequency @xmath19 and the origin of the phase @xmath3 in the present setup , and qualitatively similar results are expected for both prcs .
actually , the two types of prcs yielded almost the same results in our numerical analysis .
thus , the type - ii prc , eq .
( [ pm ] ) , gives us general insights and we only present the results for this case hereafter .     for ( a ) @xmath28 , ( b ) @xmath29 , and ( c ) @xmath30 .
the mean value is fixed at @xmath31 . ]
we consider driving impulses that have `` intermediate '' statistics between regular periodic impulses and random poisson impulses . as such impulses ,
we adopt the gamma impulses  @xcite , whose inter - impulse interval @xmath32 obeys the gamma distribution  @xcite , @xmath33 where @xmath34 and @xmath35 are real positive parameters .
the mean interval is given by @xmath36 .
the gamma distribution has the following properties .
firstly , when @xmath37 , @xmath38 gives an exponential distribution , @xmath39 which means that the impulses obey the standard poisson random process .
secondly , by taking the limit @xmath40 and @xmath41 with @xmath42 fixed , the gamma distribution approaches the delta function , @xmath43 in this limit , the inter - impulse interval is always @xmath44 , so that the impulses become periodic .
thus , the parameter @xmath34 , which we call a shape parameter , determines the property of the gamma impulses as shown in fig .
[ fig.1 ] . by varying the value of @xmath34 between @xmath20 and @xmath45 with
@xmath46 fixed , the gamma impulses can exhibit intermediate properties between random poisson and regular periodic impulses while keeping the same mean inter - impulse interval .
we examine uncoupled oscillators driven by gamma impulses and see how synchronization dynamics of the oscillators depends on the shape parameter @xmath34 in the following .
the gamma distribution has several nice mathematical properties and naturally arises under a few simple assumptions when the mean and the irregularity of impulse sequences , which respectively correspond to the mean interval @xmath47 and the shape parameter @xmath34  @xcite , are given .
we thus use the gamma impulses in the present paper , though alternative approaches for varying the regularity of the driving signal should also be possible , e.g. , by using chaotic dynamical systems  @xcite .
we here demonstrate synchronization of uncoupled oscillators induced by common impulses for the periodic , poisson , and intermediate cases by direct numerical simulations .
we fix the magnitude of nonlinearity ( or the intensity of impulses ) of eq .
( [ pm ] ) at @xmath48 throughout our numerical simulations , which is sufficiently small and therefore the map is not chaotic even for strictly periodic impulses .
this is because we are focusing on the synchronization dynamics of limit cycles ( note that the sinusoidal type ii phase map with periodic impulses is nothing but the well - known circle map  @xcite ) .
strong poisson impulses may also yield positive lyapunov exponents and lead to desynchronization of oscillators as shown in ref .
@xcite , but we do not consider such a situation in the present paper .    figure [ fig.2 ] shows typical synchronization dynamics of uncoupled oscillators induced by three types of common impulses , where zero - crossing points of @xmath49 oscillators are shown in raster plots .
the mean interval of the impulses is set at @xmath50 .
the period of the oscillator is also taken as @xmath51 and is thus equals to the mean interval .
\(i ) phase locking to periodic impulses [ fig .
[ fig.2].(a ) ] .
if the impulses are periodic and their intervals are nearly equal to ( or more generally rational multiples of ) the intrinsic rotation period of the oscillators , namely , if they are resonant , each oscillator becomes phase locked to the impulses . as a consequence ,
uncoupled oscillators driven by common periodic impulses synchronize with each other .
\(ii ) noise - induced synchronization by poisson impulses [ fig .
[ fig.2].(b ) ] .
the oscillators also synchronize when they are driven by common poisson impulses of appropriate intensity .
it has been theoretically and experimentally shown that uncoupled limit - cycle oscillators subject to weak common poisson impulses generally synchronize with each other , irrespective of their details  @xcite .
\(iii ) synchronization induced by gamma impulses [ fig .
[ fig.2].(c ) ] .
uncoupled oscillators subject to the gamma impulses with intermediate statistics between the periodic and poisson impulses can also synchronize mutually  @xcite .
thus , the uncoupled oscillators synchronized with each other by the effect of the common impulses for all values of the shape parameter .
it is however not easy to catch the quantitative differences in their synchronization dynamics just from these figures . in the following sections
, we will characterize the differences for varying types of common impulses using phase distributions , frequency detuning , lyapunov exponents , and information - theoretic measures .    ) .
( b ) noise - induced synchronization ( @xmath37 ) .
( c ) synchronization induced by gamma impulses ( @xmath52 ) . ]
in this section , we introduce frobenius - perron - type equations  @xcite that describe evolution of phase distributions . using them ,
we examine how the relations among the oscillator phases and the inter - impulse intervals depend on the shape parameter , which reveal differences between phase locking and noise - induced synchronization .
let us consider a single - oscillator probability density function ( pdf ) @xmath53 of the phase @xmath54 at time step @xmath7 , just before the @xmath7th impulse arrives . to obtain a frobenius - perron equation describing the dynamics of @xmath55 , it is convenient to consider a pdf @xmath56 of the `` unwrapped '' phase @xmath57 defined in @xmath58 , which obeys the following random phase map without the modulo  @xmath20 , @xmath59 the pdf @xmath60 of @xmath61 is given by the following frobenius - perron equation  @xcite : @xmath62 where @xmath63 is the pdf of the inter - impulse intervals , namely , the gamma distribution given in eq .
( [ eq : gamma ] ) , and @xmath64 is the probability density function of the independent additive noise , which we assume to be zero - mean gaussian of variance @xmath65 . the probability density function of the wrapped phase , @xmath66 , can be calculated as  @xcite @xmath67 thus , from eq .
( [ eq:03 ] ) , the frobenius - perron equation describing @xmath55 is obtained as @xmath68 which describes the single - oscillator pdf @xmath53 of the phase @xmath54 just before the @xmath7th impulse .    stationary solutions of eq .
( [ eq : fp1 ] ) gives the pdf of the oscillator phase driven by gamma impulses and additive noise in statistically steady states . in ref .
@xcite , we have treated a similar frobenius - perron equation perturbatively to obtain the stationary phase pdf of the oscillator under weak poisson impulses and calculated the lyapunov exponents . in ref .
@xcite , doi _ et al .
_ analyzed the spectral properties of a similar frobenius - perron equation ( driven by periodic impulses ) to characterize noisy phase locking of a limit - cycle oscillator .      to investigate phase relationships between a pair of oscillators ( denoted here as @xmath69 and @xmath70 ) subject to common impulses ,
we introduce a joint pdf @xmath71 of their phases @xmath72 and @xmath73 just before the @xmath7th impulse .
the dynamics of the pair is given by @xmath74 where @xmath75 and @xmath76 are independent additive noise terms ( @xmath22 is common to both oscillators ) .
similarly to the single - oscillator case , we can derive a frobenius - perron equation describing the two - oscillator phase pdf @xmath71 as @xmath77 the stationary solution of eq .
( [ eq : fp2 ] ) gives a pdf of the pair of oscillator phases driven by common impulses and independent additive noise in the statistically steady state .    in ref .
@xcite , we have analyzed a similar two - oscillator frobenius - perron equation by averaging out the fast dynamics of the mean phase to obtain an approximate frobenius - perron equation describing only the phase difference of two oscillators driven by common poisson impulses . since we are interested in pair phase distributions , not only in the distribution of phase differences , we directly solve eq .
( [ eq : fp2 ] ) numerically for gamma impulses in the following .     of the phase @xmath3 just before the arrival of each impulse .
blue curves are obtained by numerically solving the frobenius - perron equation and red squares are the results of direct numerical simulations of the random phase map .
( a ) noise - induced synchronization ( @xmath37 ) .
( b ) synchronization induced by gamma impulses ( @xmath52 ) .
( c ) phase locking ( @xmath78 ) . ]     of the phase pair @xmath79 and @xmath80 just before the impulses .
( a ) noise - induces synchronization ( @xmath37 ) .
( b ) synchronization induced by intermediate impulses ( @xmath52 ) .
( c ) phase locking ( @xmath78 ) . ]     of the inter - impulse interval @xmath32 and the phase @xmath3 immediately after this interval .
( a ) noise - induced synchronization ( @xmath37 ) .
( b ) synchronization induced by intermediate impulses ( @xmath52 ) .
( c ) phase locking ( @xmath78 ) . ]
we here present stationary phase pdfs obtained by numerically solving the frobenius - perron equations .
we set the frequency of each oscillator at @xmath81 .
the period of the oscillator is @xmath82 and is equal to the mean period of impulses @xmath83 .
thus , when the shape parameter @xmath34 is sufficiently large and the impulses are nearly periodic , phase locking should occur . in the numerical analysis
, each variable is discretized using @xmath84-@xmath85 grid points .
the calculation cost can be drastically reduced by devising numerical algorithms that use fourier representation in calculating convolutions of the frobenius - perron equations ( see appendix for details ) .
figures [ fig.3](a)-(c ) show the stationary pdf @xmath86 of a single oscillator phase @xmath3 just before each impulse for nearly periodic ( @xmath78 ) , intermediate ( @xmath52 ) , and poisson ( @xmath37 ) cases .
numerical solutions of the frobenius - perron equation  ( [ eq : fp1 ] ) and the results of direct numerical simulations of the random phase map  ( [ eqrpm ] ) agree nicely .
the intensity of the weak independent gaussian noise is @xmath87 . in all cases ,
the oscillators synchronize with each other ( to the independent noise level ) .
however , depending on the shape parameter @xmath34 , the phase pdf @xmath86 significantly differs . for nearly periodic impulses
, @xmath86 has a sharp peak , indicating that the oscillator phase is actually entrained to the driving impulse with some fixed phase shift .
in contrast , @xmath86 is roughly uniformly distributed for poisson impulses , which means that the relationship between the oscillator phase and the impulse timing is not fixed and hence not entrained . in the intermediate case
, @xmath86 has a broad but still clear one - humped shape , implying that the phase is not completely entrained to the impulses but still possesses a certain level of coherence with respect to the driving impulses .
figures [ fig.4](a)-(c ) show the stationary joint phase pdf @xmath88 of a pair of oscillators for nearly periodic ( @xmath78 ) , intermediate ( @xmath52 ) , and poisson ( @xmath37 ) impulses obtained by numerically solving the frobenius - perron equation  ( [ eq : fp2 ] ) .
in all cases , the oscillators synchronize with each other , so that their phases are distributed along the diagonal line , @xmath89 . however , their distribution strongly depends on the shape parameter @xmath34 . for nearly periodic impulses ( @xmath78 ) ,
the oscillator is almost phase - locked to the impulses and thus the pdf has a sharp peak near the center , indicating that the oscillators are not only mutually synchronized but both of them are entrained to the impulses .
as the parameter @xmath34 decreases , the distribution becomes broader , and for poisson impulses ( @xmath37 ) , the phases @xmath90 and @xmath91 are broadly distributed along the diagonal line , indicating that they are synchronized but not entrained by the impulses anymore .      to analyze how the driving impulses affect the oscillator phase , we also calculate the joint pdf of the inter - impulse interval and the oscillator phase just after this interval in the statistically steady states .
the stationary joint pdfs @xmath92 of the impulse interval @xmath32 and the phase @xmath3 observed immediately after this interval are calculated from the frobenius - perron equation .
figures [ fig.5](a)-(c ) show stationary joint pdfs @xmath93 for nearly periodic ( @xmath78 ) , intermediate ( @xmath52 ) , and poisson ( @xmath37 ) cases . the distribution has a sharp peak in the nearly phase - locked case ( @xmath78 ) , indicating that the inter - impulse interval and the oscillator phase just after this interval have almost a one - to - one correspondence , namely , the oscillator phase is almost entrained by the impulses . as we decrease the shape parameter @xmath34 , the distribution gradually elongates , and in the poisson limit ( @xmath37 ) , such clear correspondence is lost ( but they still retain a certain degree of correlation ) .
thus , all phase distributions clearly capture the essential difference between the phase locking and the noise - induced synchronization . the relation among the oscillator phases and the inter - impulse intervals significantly differs depending on the shape parameter @xmath34 , even though the oscillators themselves are always mutually synchronized .
as @xmath34 is increased , the oscillators tend to be more strictly phase locked to the driving impulses , whereas for smaller @xmath34 , their dependence becomes weaker .
this observation will be quantified by information - theoretic measures in sec .
in this section , we consider how the dynamics of the oscillator is modulated by the driving impulses .
specifically , we examine the frequency detuning  @xcite , i.e. , the difference between the mean frequency of the driven oscillator and that of the driving impulses , for varying values of the shape parameter .
this analysis will reveal another clear difference between the two types of synchronization scenarios .      from the phase pdf @xmath86 and the prc @xmath1 , we can estimate the mean frequency of the impulse - driven oscillator as follows . using the random phase map for unwrapped phase @xmath57 , eq .
( [ eq : rpm2 ] ) , the oscillator phase just before the @xmath94th impulse is given by @xmath95 therefore , long - time mean frequency @xmath96 of the driven oscillator can be calculated from this equation as @xmath97 where we have replaced the long - time average by a statistical average and used the periodicity of the prc @xmath1 and the normalization condition @xmath98 .
thus , the mean frequency detuning between the oscillator and the impulses is given by @xmath99 where @xmath100 is the mean frequency of the driving impulses .
we fix the mean frequency of the driving impulses at @xmath101 and vary the shape parameter @xmath34 and the natural frequency @xmath19 of the oscillator in the numerical simulations .
figure  [ fig.6](a ) plots the frequency detuning @xmath102 on the @xmath103 plane . for large @xmath34 and nearly resonant natural frequency , @xmath104 ,
the conditions for phase locking are satisfied and therefore the mean frequency @xmath96 of the oscillator is locked to that of the driving impulses @xmath105 , yielding a plateau in the figure .
in contrast , for small @xmath34 , the mean frequency @xmath96 never locks to @xmath105 .
figure  [ fig.6](b ) plots @xmath102 as a function of @xmath19 at @xmath78 , i.e. , for approximately periodic impulses .
results of direct numerical simulations agree well with the theoretical estimate , eq .
( [ eq : freqdet ] ) , with the pdf @xmath86 obtained numerically from the frobenius - perron equation .
a plateau satisfying @xmath106 can clearly be seen near @xmath107 . in the intermediate case ( @xmath52 ) shown in fig .
[ fig.6](c ) , clear phase - locking region no longer exist , however , the frequency of the oscillator is modulated by the driving impulses . in the poisson case ( @xmath37 ) , the mean frequency of the driven oscillator
is not affected by the driving impulse as shown in fig .
[ fig.6](d ) .
this observation provides us with further evidence on the difference between the two synchronization scenarios . actually , as pointed out by yoshimura _
_ in ref .
@xcite , absence of frequency locking between the oscillators is characteristic to common - noise - induced synchronization , in sharp contrast to ordinary phase locking due to mutual coupling ( though they considered weak gaussian noise instead of random impulses in their work ) .     on the shape parameter @xmath34 and on the natural frequency @xmath19 of the driven oscillator , measured by direct numerical simulations of the random phase map .
( b)-(d ) dependence of the frequency detuning on the natural frequency @xmath19 of oscillators for several values of the shape parameter @xmath34 .
blue solid lines are the results of the integral calculation , eq.([eq : freqdet ] ) , and red squares are obtained by direct numerical simulations of the random phase map .
( b ) phase locking ( @xmath78 ) .
( c ) synchronization induced by gamma impulses ( @xmath52 ) .
( d ) noise - induced synchronization ( @xmath37 ) . ]
in this section , to characterize the synchronization dynamics , we focus on lyapunov exponents and their fluctuations in the synchronized states .
as we will see , differences between synchronization scenarios are well characterized by the fluctuations of the lyapunov exponent .      to quantify statistical linear stability of the synchronized states , we calculate the lyapunov exponent and its variance .
let us consider a pair of oscillators and denote their phases at time @xmath7 as @xmath54 and @xmath108 , respectively .
linearized evolution of a small phase difference @xmath109 is given by @xmath110 where @xmath111 is the instantaneous linear growth rate of the phase difference .
the deviation @xmath112 at large time step @xmath94 is thus given by @xmath113,\end{aligned}\ ] ] where we have introduced the lyapunov exponent @xmath114 , defined by a long - time average of the linear growth rates as @xmath115 in the last expression , we have replaced the long - time average by a statistical average over the stationary phase pdf @xmath86 and the pdf @xmath116 of the independent noise .
the synchronized state is stable if @xmath117 is negative .
similarly , variance of the linear growth rates , @xmath118 , can be calculated as @xmath119 as we will see , even if the lyapunov exponent @xmath114 takes the same value , its variance @xmath120 can significantly differ depending on the shape parameter @xmath34 .     on the shape parameter @xmath34 and on the frequency @xmath19 of oscillators .
( a ) mean lyapunov exponent @xmath117 .
( b ) variance of lyapunov exponent @xmath120 .
( c ) ratio of the mean to the variance , @xmath121 . ]     on the parameter @xmath34 .
the curves are calculated from the frobenius - perron equation and the symbols are the results of direct numerical simulations of the random phase map . (
a ) mean @xmath117 .
( b ) variance @xmath120 . ]
figure  [ fig.7](a ) plots the lyapunov exponent @xmath114 on the @xmath103 plane , showing its dependence on the shape parameter @xmath34 and on the natural frequency of the oscillator @xmath19
. the mean period of the impulses is fixed at @xmath122 . for sufficiently large @xmath34 , there exists bell - shaped regions near the resonant frequencies ( i.e. , @xmath81 and @xmath123 ) , where the lyapunov exponent takes large negative values .
these regions correspond to nearly phase - locked states and may be seen as a kind of arnold tongues .
the lyapunov exponent also takes small negative values outside this region , which corresponds to the noise - induced synchronized states .
note that phase locking occurs only when the oscillator frequency is approximately resonant to the impulses , whereas the noise - induced synchronization occurs almost everywhere .
dependence of the lyapunov exponent @xmath124 on the shape parameter @xmath34 for several values of @xmath19 is plotted in fig .
[ fig.8](a ) .
when the natural frequency is resonant to the mean inter - impulse interval ( @xmath125 ) , @xmath117 smoothly decreases as we move from the noise - induced synchronization ( @xmath37 ) to the phase - locking ( @xmath78 ) , indicating that the phase locking is more stable than the noise - induced synchronization .
however , for oscillator frequencies near the edges of the phase - locking region ( @xmath126 and @xmath127 ) , @xmath117 differs only little between @xmath37 and @xmath78 , so that the noise - induced synchronization can be nearly stable as the phase locking .
thus , though the lyapunov exponent @xmath117 reflects the synchronization dynamics , difference between the two types of synchronization can not be fully characterized just by looking at @xmath117 .
figure  [ fig.7](b ) shows dependence of the variance of the lyapunov exponent exponent @xmath120 on the shape parameter @xmath34 and on the oscillator frequency @xmath19 , and figure  [ fig.8](b ) shows the dependence on the shape parameter @xmath34 for @xmath128 , and @xmath127 .
in contrast to the lyapunov exponent itself , the variance @xmath120 always decreases considerably as @xmath34 is increased from the noise - induced synchronization ( @xmath37 ) to the phase - locking ( @xmath78 ) , because the phase pdf becomes much broader for smaller @xmath34 as we have seen in fig .
[ fig.3 ] .
thus , the difference between the phase locking and the noise - induced synchronization can be captured more clearly by the fluctuations in the lyapunov exponent , rather than by its long - time average .
the difference can also be clearly visualized by plotting the ratio of the lyapunov exponent and its variance @xmath121 as in fig .
[ fig.7](c ) and fig .
[ fig.8](c ) . actually , this ratio characterizes the intermittent dynamics of the phase differences between the oscillators as we explain below .
fluctuations of the lyapunov exponent manifests itself in the dynamics of the phase difference . in fig .
[ fig.9 ] , typical time sequences of the phase difference @xmath129 between the two oscillators in the synchronized states are shown .
three different shape parameters ( @xmath130 ) yielding nearly the same lyapunov exponent @xmath117 are chosen ( with @xmath126 fixed ) . in noise - induced synchronization ( fig .
[ fig.9](a ) ) with small @xmath34 , the phase difference often exhibits big bursts , because the growth rate fluctuates strongly ( large @xmath120 ) . as the parameter @xmath34 increases ,
variation of the phase difference becomes smaller ( fig .
[ fig.9](b ) ) and , in the phase - locked state , the phase difference stays small and rarely exhibits large bursts ( fig .
[ fig.9](c ) ) , because fluctuations of @xmath131 are very weak ( small @xmath120 ) .
the peculiar dynamics shown in fig .  [ fig.9](a ) is a direct consequence of the fluctuations of the linear growth rates and intimately related to the well - known on - off ( or modulational ) intermittency  @xcite .
figure  [ fig.10 ] shows the stationary pdfs of phase differences between the oscillators for differing values of the shape parameter @xmath34 in normal scales ( a ) and in log - log scales ( b ) . reflecting the degree of the fluctuations of @xmath131 ,
the width of the pdfs varies widely .
the tail part of the distribution exhibits power - law decay , which is broader for smaller @xmath34 , indicating that the phase differences exhibit big bursts ( phase differences ) much more frequently . as shown in ref .
@xcite , the exponent of the power - law tail is approximately given by the ratio @xmath132 that we plotted fig .
[ fig.7](c ) .
thus , degree of intermittency in the synchronization dynamics also characterizes the difference in noise - induced synchronization and phase locking clearly .     at three different values of the shape parameter @xmath34 . ( a ) noise - induced synchronization ( @xmath37 ) .
( b ) synchronization induced by intermediate impulses ( @xmath52 ) .
( c ) phase locking ( @xmath78 ) . ]     of the phase difference @xmath133 of two oscillator calculated by direct numerical simulations of the random phase map .
black solid line , blue dashed line and red dotted line plot the results for @xmath134 and @xmath135 , respectively .
( a)@xmath136 .
( b)@xmath136 using logarithmic scaling on the vertical axis . ]
we have observed that the joint pdfs of the oscillator phases and the impulse intervals exhibit distinct characteristics depending on the shape parameter . in this section , to quantify correlations between the oscillator phases and the impulse intervals for different types of synchronization dynamics , we introduce information measures . in particular , we focus on the mutual dependence or `` causality '' of a pair of phase oscillators driven by a common impulse source .
this leads us to physically distinct interpretations of the two synchronization scenarios .
the mutual information @xmath137  @xcite is a nonnegative measure that quantifies mutual dependence of two random variables @xmath138 and @xmath139  @xcite .
it is defined as @xmath140 where @xmath141 is a joint probability distribution of @xmath138 and @xmath139 , and @xmath142 and @xmath143 are probability distributions of @xmath138 and @xmath139 , respectively .
we often normalize @xmath144 by its upper limit as @xmath145 where @xmath146 and @xmath147 are entropies of @xmath138 and @xmath139 , respectively .
the normalized mutual information satisfies @xmath148 . assuming , for example , that @xmath138 represents the inter - impulse interval @xmath32 and @xmath139 the oscillator phase @xmath3 just after this interval , @xmath137 or @xmath149 quantifies how much the oscillator phase tells us about the impulses .
the interaction information @xmath150  @xcite is a generalization of the mutual information @xmath137 to three random variables @xmath138 , @xmath139 , and @xmath151 , and quantifies mutual dependence among them .
it is defined as @xmath152 where @xmath153 is a joint probability distribution function of @xmath138 , @xmath139 , and @xmath151 .
@xmath150 is symmetric with respect to permutations of @xmath138 , @xmath139 , and @xmath151 .
the first term is simply the mutual information @xmath137 between @xmath138 and @xmath139 , and the second term on the right hand side gives conditional mutual information @xmath154 between @xmath138 and @xmath139 given @xmath151 .
thus , @xmath150 can be expressed as @xmath155 which provides us with some intuitive meaning of @xmath150 .
namely , it measures the effect of knowing @xmath151 in guessing the mutual dependence of @xmath138 and @xmath139 .    unlike @xmath137
, @xmath150 can take both positive and negative values .
the sign of @xmath150 tells us about how the three random variables @xmath138 , @xmath139 , and @xmath151 depend on each other , as illustrated in fig .
[ fig.11 ] .
\(i ) if @xmath156 , at least one of the three random variables is independent of the others . for example , knowing @xmath151 has no effect in guessing the mutual information between @xmath138 and @xmath139 , @xmath157 .
all variables are mutually dependent if @xmath158 .
\(ii ) if @xmath159 , one of the three variables tends to determine the other two variables . for example , knowing @xmath151 lowers the information on @xmath138 gained by observing @xmath139 ( or vice versa ) , i.e. , @xmath160 . in particular
, the maximum value of @xmath150 , given by @xmath161 , is attained when one of the three variables dominates the other two , for example , as @xmath162 and @xmath163 where @xmath164 and @xmath165 are some maps .
\(iii ) if @xmath166 , knowing e.g. @xmath151 helps in gaining information on @xmath138 by observing @xmath139 , so that @xmath167 . in particular
, @xmath150 takes its maximum value when two of the random variables dominate the remaining one , for example , when @xmath168 with some map @xmath169 and moreover @xmath170 ( @xmath139 and @xmath151 are independent ) .
the maximum value is equal to the negative conditional entropy @xmath171 of the dominated variable @xmath151 given the dominating variable @xmath138 .
we normalize the interaction information @xmath150 by its maximum as @xmath172 so that @xmath173 is satisfied .
in addition to the above normalization , @xmath150 may also be normalized by the mutual information @xmath137 as @xmath174 the quantity @xmath175 satisfies @xmath176 ( because @xmath177 in the present case as shown below ) , quantifies how much information @xmath151 conveys about the relationship between @xmath138 and @xmath139 .
we use these normalized @xmath178 and @xmath175 to quantify mutual dependence among @xmath32 , @xmath179 , and @xmath180 .    .
each arrow indicates the dependence between the variables . ]      the mutual information and the interaction information are calculated from the pdfs obtained by numerically solving the frobenius - perron equations ( [ eq : fp1 ] ) and ( [ eq : fp2 ] ) .
we discretize the inter - impulse intervals and the two oscillator phases using @xmath84 grid points and use the resulting coarse - grained discrete probability distributions in the calculation .
note that we need the joint probability distribution @xmath181 to calculate the interaction information , which corresponds to @xmath182 grid points .
such a calculation is only feasible by the frobenius - perron approach .
figure  [ fig.12](a ) shows the mutual information @xmath183 of the inter - impulse interval @xmath32 and the phase @xmath3 just after this interval , as well as its upper limit @xmath184 ( entropy of the inter - impulse intervals ) as functions of the shape parameter @xmath34 for the resonant situation , @xmath185 .
@xmath184 takes its maximum value in the poisson limit ( @xmath37 ) , monotonously decreases as the shape parameter @xmath34 is increased , and almost vanishes for nearly periodic impulses ( @xmath186 ) .
the raw mutual information @xmath183 takes a small value for poisson impulses ( @xmath37 ) and gradually increases with the shape parameter @xmath34 .
@xmath183 takes its maximum value at @xmath187 , then decreases again , and almost vanishes when the impulses become nearly periodic ( @xmath186 ) .
figure  [ fig.12](b ) shows the normalized mutual information @xmath188 .
it increases smoothly from a small value ( nearly @xmath189 ) to @xmath20 as the shape parameter @xmath34 is increased from @xmath37 ( poisson ) to @xmath186 ( nearly periodic ) .
this indicates that the oscillator phase has only little dependence on the inter - impulse interval just before it is measured in the poisson case , whereas the oscillator phase possesses almost complete information about the interval in the periodic case .
these results are consistent with the shape of the single - oscillator phase pdf shown in fig .
[ fig.3 ] .
it is interesting to note that the raw mutual information @xmath183 has a peak at the intermediate shape parameter @xmath34 .
if we regard our model as an information channel , the output oscillator phase conveys information about the input impulse interval most efficiently at this value .
this can be interpreted as follows . for periodic impulses , even though @xmath3 is locked to @xmath32 , the interval @xmath32 has no information because @xmath190 and therefore @xmath191 . for poisson impulses , though @xmath184 is relatively large , @xmath3 does not faithfully represent @xmath32 . as a compromise ,
@xmath183 is maximized at the intermediate value of @xmath34 .
( black solid line ) and @xmath184 ( red dashed line ) .
( b ) normalized mutual information @xmath192 . ]
more interesting insight can be attained by examining the interaction information @xmath193 among the inter - impulse interval and the phases of the two driven oscillators .
figure  [ fig.13](a ) shows the interaction information @xmath194 , its upper limit @xmath184 , and mutual informations @xmath195 and @xmath196 as functions of the shape parameter @xmath34 for @xmath81 ( resonant ) .
the intermediate peak of the raw interaction information arises due to the same reason as in the previous case of the raw mutual information .
interaction informations normalized in three ways , @xmath197 , @xmath198 , and @xmath199 , are plotted against @xmath34 in fig .
[ fig.13](b ) .
the normalized interaction information @xmath200 decreases as the shape parameter is decreased from @xmath201 ( nearly periodic ) to @xmath37 ( poisson ) . for nearly periodic impulses ,
@xmath202 is nearly @xmath20 , implying that @xmath32 , @xmath79 , and @xmath80 are significantly dependent on each other in the phase - locking regime .
as @xmath34 is decreased , @xmath202 gradually decreases and , for poisson impulses , @xmath202 almost vanishes , indicating that at least one of the @xmath79 , @xmath80 , and @xmath32 is almost independent of the others .
the normalized interaction information @xmath203 also decreases as the shape parameter is decreased from @xmath201 ( nearly periodic ) to @xmath37 ( poisson ) . for nearly periodic impulses ( @xmath201 ) , @xmath204 is nearly @xmath20 , which implies that the inter - impulse interval @xmath32 dominates the oscillator phases @xmath79 and @xmath80 .
as @xmath34 is decreased , @xmath204 decreases gradually , and for poisson impulses , it becomes very close to @xmath189 , namely , @xmath32 is almost independent of @xmath79 and @xmath80 and thus @xmath32 tells very little about @xmath79 and @xmath80 .
the last normalized interaction information @xmath205 also decreases as the shape parameter is decreased from @xmath201 ( nearly periodic ) to @xmath37 ( poisson ) . for nearly periodic impulses ( @xmath201 ) , @xmath206 is nearly @xmath20 , which indicates that the phase @xmath80 has almost complete information about @xmath32 and @xmath79 .
it means that all @xmath32 , @xmath79 and @xmath80 depend on each other strongly . unlike @xmath204
, @xmath206 takes relatively large values around @xmath207 even in the poisson limit , which implies that we can get nearly @xmath208 of the information about @xmath32 and @xmath79 just by looking at @xmath80 .
this is because the oscillators are synchronized even if they are driven by poisson impulses , and we can learn much about @xmath79 by knowing @xmath80 .
though the interaction information itself is symmetric with respect to its three arguments , we can obtain further insight by taking into account the drive - response configuration of our model , namely , the fact that the inter - impulse interval @xmath32 has a distinct meaning from the other two phase variables @xmath79 and @xmath80 . therefore , for the phase - locked situation with @xmath209 , we may consider that the phases @xmath79 and @xmath80 are predominantly controlled by the driving impulse @xmath32 , as implied from the condition giving the maximum value of @xmath194 . on the other hand , in the poisson case with @xmath202 close to @xmath189 , we may conclude that @xmath32 is nearly independent of @xmath79 and @xmath80 .
this indicates that the phases have very little information about the driving impulse in the noise - induced synchronized state .
the above results lead us to two distinct interpretations of the two synchronization scenarios , as schematically summarized in fig .
[ fig.14 ] ; in the phase locking , the two oscillators are simply oscillators dominated by the impulses , whereas they are almost free from the impulses but still behave synchronously in the noise - induced synchronization .
( black solid line ) and normalization factors @xmath184 ( red dashed curve ) , @xmath195 ( blue dot - dashed curve ) and @xmath196 ( green dotted curve ) plotted against the shape parameter @xmath34 .
( b ) normalized interaction information .
@xmath210 ( red dashed curve ) , @xmath211 ( blue dot - dashed curve ) , and @xmath212 ( green dotted curve ) ]
in the present study , we analyzed uncoupled oscillators driven by gamma impulses that smoothly interpolate between periodic and poisson inter - impulse intervals to quantify the difference in synchronization dynamics between these two limiting cases . by examining the dependence of various quantities on the shape parameter of the gamma impulses ,
we have revealed a clear difference between the two types of synchronization . using phase distributions , frequency detuning , statistics of lyapunov exponents , and information - theoretic measures ,
we have quantitatively confirmed our original intuition , namely , that the oscillators are principally dominated by the impulses and mutually synchronized as its consequence for the periodic driving , whereas the oscillators are not entrained by the impulses ( at least not strongly influenced by the inter - impulse interval just before the phase is measured ) but they still attain coherence in the case of poisson driving .
generalization of our results for uncoupled oscillators to mutually interacting oscillators , in particular with delay , under common or correlated gamma impulses is an interesting future subject , where not only synchronization but qualitatively different behaviors  @xcite can be expected .
more detailed quantification of the input - output and the output - output relations of the impulse - driven oscillators from the viewpoint of information transfer would also be interesting , where effect of the functional shape of the phase response curve and its optimization would be important issues . as we found in the measurement of mutual and interaction information , the transition between the phase locking and the noise - induced synchronization may not be simply monotonic from such a viewpoint , implying the importance of intermediate randomness of the input impulses .
we plan to push forward in these directions in our future studies .
we thank h. suetani and h. hata ( kagoshima ) , and y. tsubo and j. teramae ( riken ) for illuminating comments .
this work is supported by mext ( grant no .
22684020 ) and by the gcoe program `` the next generation of physics , spun from universality and emergence '' from mext , japan
.    99    r. roy and k.s .
thornburg , jr .
lett . * 72 * , 2009 ( 1994 ) ; a. uchida , r. mcallister , and r. roy , phys .
lett . * 93 * , 244102 ( 2004 ) ; a. uchida , k. yoshimura , p. davis , s. yoshimori , and r. roy , phys .
e * 78 * , 036203 ( 2008 ) .
k. yoshida , k. sato , a. sugamaga , j. sound and vibration * 290 * , 34 ( 2006 ) .
k. arai and h. nakao , phys .
e * 77 * , 036218 ( 2008 ) .
k. nagai and h. nakao phys .
e * 79 * , 036205 ( 2009 ) .    z. f. mainen and t. j. sejnowski , science * 268 * , 1503 ( 1995 ) .    m. d. binder and r. k. powers , journal of neurophysiology * 86 * , 2266 ( 2001 ) .
r. f. galn , n. f. trocme , g. b. ermentrout , and n. n. urban , j. neurosci * 26(14 ) * , 3646 ( 2006 ) .
p. danzl , r. hansen , g. bonnet , and j. moehlis , journal of computational neuroscience , * 25 * , 141 ( 2008 ) .
g. b. ermentrout , r. f. galn , and n. n. urban , trends neurosci . * 31 * , 428 ( 2008 ) .
t. royama , _ analytical population dynamics _
( chapman and hall , london , uk , 1992 ) .
e. ranta , v. kaitala and e. helle , oikos * 78 * , 136 ( 1997 ) .
w. d. koenig and j. m. h. knops , nature * 396 * , 225 ( 1998 ) .
p. a. p. moran , aust .
* 1 * , 291 ( 1953 )
.    a. t. winfree , _ the geometry of biological time _
( springer - verlag , new york , 2001 ) .
y. kuramoto , _ chemical oscillation , waves , and turbulence _
( springer - verlag , tokyo , 1984 ) ( republished by dover , new york , 2003 ) .
a. pikovsky , m. rosenblum , and j. kurths , _ synchronization _
( cambridge university press , england , 2001 ) .
l. glass and m. c. mackey , _ from clocks to chaos : the rhythms of life _
( princeton university press , usa , 1988 ) .
t. yamanobe and k. pakdaman , biol . cybern . * 86 * , 155 ( 2002 ) .
h. nakao , k. arai , k. nagai , y. tsubo , and y. kuramoto , phys .
e * 72 * , 026220 ( 2005 ) .
r. f. galn , g. b. ermentrout and n. n. urban , phys .
lett . * 94 * , 158101 ( 2005 ) .
t. tateno and h. p. c. robinson , biophysical journal * 92 * , 683 ( 2007 ) .    k. arai and h. nakao , phys .
e * 78 * , 066220 ( 2008 ) .
d. hansel , g. mato , and c. meunier , neural computation * 7 * , 307 ( 1995 ) .
a. abouzeid and g. b. ermentrout , phys .
e * 80 * , 011911 ( 2009 ) .
s. marella and g. b. ermentrout , phys .
e * 77 * , 041918 ( 2008 ) .
e. brown , j. moehlis , and p. holmes , neural computation * 16 * , 673 ( 2004 ) .
e. izhikevich , _ dynamical systems in neuroscience .
the geometry of excitability and bursting .
_ the mit press , 2007 .
g. b. ermentrout , neural computation * 8 * , 979 ( 1996 ) .
t. shimokawa , s. koyama and s. shinomoto , j. comp .
doi : 10.1007/s10827 - 009 - 0194-y ( 2010 ) .
g. j. escalera santos and p. parmananda , phys .
e , * 65 * , 067203 ( 2002 ) .
s. doi , j. inoue and s. kumagai , j. stat .
phys . * 90 * , 1107 ( 1998 ) .
a. lasota and m. c. mackey , _ probabilistic properties of deterministic systems _ ( cambridge university press , cambridge , 1985 ) .
e. ott , _ chaos in dynamical systems _
( cambridge university press , cambridge , 2002 ) .
g. b. ermentrout and d. saunders , j. comput . neurosci .
* 20 * , 179 ( 2006 ) .
k. yoshimura , p. davis , and a. uchida , in proceedings of the 2007 international symposium on nonlinear theory and its applications , vancouver , canada ( ieice , vancouver , 2007 ) , p. 104 - 107 .
h. fujisaka and t. yamada , prog .
. phys . * 69 * , 32 ( 1983 ) ; h. fujisaka , prog .
. phys . * 70 * , 1264 ( 1983 ) ; h. fujisaka and t. yamada , prog . of theor
. phys . * 74 * , 918 ( 1985 ) .
a. s. pikovsky , phys .
a * 165 * , 33 ( 1992 ) .
y. kuramoto and h. nakao , phys .
lett . * 78 * , 4039 ( 1997 ) .
t. a. cover and j. a. thomas , _ elements of information theory _ ( wiley , 1991 ) .
w. j. mcgill , psychometrika , * 19 * , 97 ( 1954 ) .
t. tsujishita , advances in applied mathematics * 16 * , 269 ( 1995 ) .    k. k. lin , e. shea - brown , and l .- s .
young , journal of nonlinear science * 19 * , 1432 ( 2009 ) .
here we introduce fourier representation of the frobenius - perron equations ( [ eq : fp1 ] ) and ( [ eq : fp2 ] ) . based on this representation
, we can use the fast fourier transform ( fft ) algorithm to numerically calculate convolution integrals included in the equations and drastically reduce calculation costs .
firstly , to numerically convolute @xmath213 and @xmath214 , we transform the dirac delta function in the frobenius - perron equation , in such a way that it becomes an explicit function of the variable of integration @xmath215 rather than the original phase variable @xmath3 .
@xmath216 where we have defined an inverse function of the phase map , @xmath217 since @xmath218 is a phase map , @xmath219 holds for @xmath220 , where @xmath221 is an integer . using this , we obtain @xmath222}{d\theta } r\left ( \mathcal{f}(\theta-\omega\tau)+d - k-\theta ' \right)\\    = & \int_0 ^ 1 d\theta ' \int_0^\infty d\tau w(\tau)p_{n}(\theta ' ) \frac{d\mathcal{f}(\theta-\omega\tau)}{d\theta } \sum_{k=-\infty}^{\infty } r\left ( \mathcal{f}(\theta-\omega\tau)-k-\theta ' \right)\\    = & \int_0 ^ 1d\theta ' \int_0^\infty d\tau w(\tau)p_{n}(\theta ' )    \frac{d\mathcal{f}(\theta-\omega\tau)}{d\theta } s\left (      \mathcal{f}(\theta-\omega\tau)-\theta ' \right),\end{aligned}\ ] ] where @xmath223 now , using the discrete fourier transformation , we can convolute @xmath213 and @xmath214 as @xmath224 where @xmath225 and @xmath226 are @xmath227th fourier coefficients of @xmath213 and @xmath214 , respectively : @xmath228 and @xmath229    next
, we need to convolute the functions @xmath230 and @xmath231 . from the definition of the gamma distribution , eq .
( [ eq : gamma ] ) , @xmath232 holds . using this , we obtain @xmath233 where @xmath234 and @xmath235 are @xmath236th fourier coefficients of @xmath237 and @xmath238 , respectively : @xmath239 therefore
, we can write the evolution of fourier coefficient of @xmath55 as @xmath240 which can easily be calculated numerically .    similarly , we can write the evolution of @xmath241 , which is the @xmath242th fourier coefficient of the joint probability density function @xmath243,as @xmath244 which is also easy to calculate numerically .