with the progress in short
 pulse laser technology @xcite high intensity electromagnetic fields are becoming broadly available .
in particular , they make it possible to create strongly correlated quantum plasmas under extreme nonequilibrium conditions which opens a broad range of applications , e.g. @xcite . at the same time , optical techniques for time  resolved
diagnostics are improving remarkably @xcite .
these developments create the need for a quantum kinetic theory of dense nonideal plasmas in intense laser fields .
nonequilibrium properties of dense plasmas in which collisions are important are usually studied on the basis of kinetic equations of the boltzmann type
. however , in spite of their fundamental character , boltzmann  like kinetic equations have a number of shortcomings , in particular in view of their application to dense plasmas in intense laser fields :    i ) : :    they are valid only for times larger than the correlation ( or    collision ) time @xmath0 , ii ) : :    they conserve only the mean kinetic energy instead of the sum of    kinetic and potential energy , iii ) : :    they are valid only in the weak field limit since the corresponding    collision integrals are independent of the electromagnetic field , iv ) : :    they are not applicable to high  frequency processes ( fields ) , where    @xmath1 , cf .
i ) .    obviously , in the case of strong correlations , high  frequency electromagnetic fields and/or short  time phenomena generalizations are necessary .
_ generalized kinetic equations for correlated plasmas _ have been derived already in the 60ies by prigogine @xcite , zwanzig @xcite , kadanoff and baym @xcite , balescu @xcite , silin @xcite , klimontovich @xcite and others . in recent years
, the increasing interest in ultrafast processes has revived the theoretical activities , e.g. @xcite , acompanied by progress in numerical solutions , e.g. @xcite ; for textbook overviews , see @xcite .
furthermore , kinetic equations for classical plasmas in _ high  frequency fields _ have been derived for the first time in papers of silin @xcite . among other problems , he computed the high  frequency conductivity of a plasma .
we mention that , for the weak  field limit , this problem has been studied by many authors , including oberman et al .
@xcite and dubois et al .
an essential further development of the theory has been given by klimontovich and co
workers @xcite .
klimontovich used his powerful technique of second quantization in phase space @xcite to investigate the density  density and microfield fluctuations in low and high  frequency fields .
this allowed him to derive collision integrals for classical plasmas in strong fields which take into account dynamical screening and to derive a complete theory of transport processes @xcite .
a result of central importance is an expression for the collisional heating rate and the electron
ion collision frequency in strong fields in terms of the imaginary part of the inverse dielectric function @xmath2 @xcite .
recently , expressions of the same form were derived again @xcite .
for a recent overview on the collision frequency in laser plasmas , we refer to mulser et al .
@xcite .
the above kinetic theories for plasmas in electromagnetic fields were limited to classical plasmas . a first extension to quantum plasmas
was given by silin and uryupin @xcite .
more recently , a kinetic equation for dense quantum plasmas in strong static fields has been derived @xcite , whereas a systematic quantum kinetic theory for plasmas in strong fields of arbitrary time dependence was presented in ref .
@xcite . there
, electron  electron and electron  ion quantum collision integrals were derived within the static born approximation ( landau collision integrals ) .    in this paper , we extend this theory to the case of full dynamical screening for dense quantum plasmas under arbitrary nonequilibrium conditions by using the random phase approximation ( polarization approximation ) for the particle  particle scattering processes . our approach is based on the nonequilibrium green s functions formalism which allows for the most straightforward derivation and for an explicit solution of the gauge problem .
we derive a kinetic equation which is a generalization of klimontovich s classical result @xcite and , on the other hand , generalizes previous quantum results for the case of zero field @xcite and static field @xcite .
furthermore , we derive results for the polarization and screening properties and longitudinal field fluctuations in a strong field of arbitrary time  dependence .
we consider the time evolution of a dense charged particle system under the influence of a strong time
dependent electromagnetic field and inter  particle correlations .
it is instructive to recall first the motion of classical free charges in an external field . from integrating newton s equation , @xmath3
, we obtain the velocity change of a particle with charge @xmath4 and mass @xmath5 in the field @xmath6 during a time interval @xmath7 $ ] , @xmath8 and the field induced displacement @xmath9 in the equations above , we have dropped contributions from the acceleration and velocity at the initial moment @xmath10 since they are not related to the field .
a further important quantity is the average kinetic energy @xmath11 where , in case of a periodic field , @xmath12 is the oscillation period . below we will also need the change of the relative velocity of a particle pair @xmath13 gained in the field @xmath14 @xmath15 and the change of the inter
particle distance @xmath16 @xmath17    the most important special case is that of a _ harmonic time dependence _
@xmath18 which leads to the following explicit results for the quantities introduced above @xmath19 , \label{va - h } \\
\delta{\bf r}_a(t , t ' ) & = & { \bf r}_a^0 \left[\omega ( t - t')\sin \omega t + \cos \omega t - \cos \omega t'\right ] .
\label{va - ra - h}\end{aligned}\ ] ] here , we introduced two important quantities , the `` quiver '' velocity @xmath20 and the so  called excursion amplitude @xmath21 furthermore , the cycle averaged ( @xmath22 ) kinetic energy gain of a charged particle ( [ e - kin - av ] ) is the so  called ponderomotive energy @xmath23    obviously , the above results may be extended to electromagnetic fields with arbitrary time dependence , for example by expanding the field in terms of harmonic components .
nevertheless , it is useful to explicitly consider a second situation frequently encountered in modern applications : pulsed fields , e.g. those produced by femtosecond lasers . we will consider pulses of the following form @xmath24 and @xmath25 otherwise .
typically , @xmath26 , although modern femtosecond laser pulses may be as short as a few periods of the main frequency @xmath27 . for the field ( [ e - pulse ] ) , we obtain the velocity change and displacement @xmath28 , \quad { \bf v}_a^{0\pm } \equiv \frac{e_a { \bf e}_0}{m_a \omega^{\pm } } , \quad \omega^{\pm } \equiv \omega_p \pm \omega , \\
\delta{\bf r}_a(t , t ' ) & = &   \sum_{s=\pm}{\bf r}_a^{0s } \left[-\omega^s ( t - t')\cos \omega^s t + \sin \omega^s t - \sin \omega^s t'\right ] , \ ] ] with @xmath29 , whereas the change of relative velocity and two  particle distance , @xmath30 and @xmath31 follow from @xmath32 and @xmath33 by replacing @xmath34 by @xmath35 and @xmath36 by @xmath37 , respectively .
the above results trivially include the case of a time - independent electric field which is recovered by letting in eq .
( [ efeld ] ) @xmath38 .
the corresponding results are @xmath39    it is instructive to consider a number of parameters which characterize the state of the plasma , field strength , quantum properties etc :    1 .
the field strength can be characterized by the ratio @xmath40 of the amplitude of the oscillation velocity ( quiver velocity ) @xmath41 , eq .
( [ va - h ] ) , to the thermal velocity @xmath42 .
the relative importance of the field and of particle  particle interaction is characterized by @xmath43 , where @xmath44 is the amplitude of the field induced displacement ( [ va - ra - h ] ) , and @xmath45 is the debye radius ( interaction range ) .
3 .   the frequency of the field has to be compared to the eigenfrequencies of the plasma , most importrantly , the electron langmuir ( plasma ) frequency , @xmath46 , which reflects competition between field frequency and plasma density effects .
the relevance of collisional processes depends on the ratio @xmath47 , where @xmath48 is the total collision frequency of electrons in the plasma .
the photon energy is characterized by its ratio to the thermal energy , @xmath49 .
modern lasers easily produce strong fields which satisfy the inequalities @xmath50 and @xmath51 . in high  frequency fields and/or plasmas of moderate density , @xmath52 , which allows to treat collisions perturbatively ,
see below .
coulomb interaction between the charged carriers as well as quantum effects , obviously , may drastically modify the free particle behavior .
scattering of two particles with charges @xmath53 in quantum states @xmath54 and @xmath55 on the coulomb potential @xmath56 leads to a transfer of momentum @xmath57 between them , so after the collision time @xmath58 the particles are in momentum states @xmath59 and @xmath60 .
while conventional kinetic approaches treat collision as instantaneous , @xmath61 , this is not appropriate for correlated plasmas as well as in the presence of rapidly varying fields with @xmath62 not being small . in this case , during the collision time , the scattering partners will be accelerated by the external field which is called _ intra  collisional field effect _ , which essentially modifies the scattering process .
using a quantum language , during the collision time , the particles may absorb photons of the electromagnetic field which is the familiar _ inverse bremsstrahlung _ , or re  emit them ( bremsstrahlung ) .    the kinetic treatment of two  particle scattering on the coulomb potential ( [ coulomb ] ) leads to the well  known divergencies at short and long wavelengths .
while the first is naturally cured by a quantum theoretical approach , the origin of the latter is the long range of the coulomb interaction .
the familiar solution lies in the replacement of the bare coulomb potential ( [ coulomb ] ) by a screened one @xmath63 where @xmath64 is the retarded dielectric function .
this is not only of fundamental interest but has also practical relevance .
the dielectric function includes collective plasma oscillations and instabilities which , especially in nonequilibrium situations , may strongly enhance scattering , transport and energy exchange with the electromagnetic field ( anomalous transport ) .
the simplest approximation for the dielectric function is the random phase approximation ( rpa ) being the quantum generalization of the vlasov dielectric function @xmath65 where @xmath66 denotes the single  particle energy .
interestingly , this result was derived by klimontovich and silin @xcite two years before lindhard @xcite . while this approximation is applicable to nonequilibrium situations in which the wigner distributions @xmath67 are weakly time
dependent ( when the time scale @xmath68 is much longer than @xmath69 ) , on short times or for fast processes , such as in high frequency fields , generalizations are necessary .
such generalizations avoid the assumption of separation of the two time scales and lead to an explicit dependence of the functions @xmath70 and @xmath71 on two times .
moreover , the presence of an electromagnetic field may be expected to modify the dielectric and screening properties , leading to a very complex problem of coupled particle , screening and field dynamics .
the appropriate theoretical concept to tackle this problem is provided by quantum field theory .
numerous concepts have been developed to describe the mentioned above dynamics of particles and fields . among them , the most systematic and powerful is the theory of nonequilibrium green s functions .
it is based on the method of relativistic quantum field theory , where charged particles and the longitudinal and transverse electromagnetic field are described on equal footing by field operators @xcite . from the equations of motion for the field operators - the dirac equation and maxwell s equations , one can derive equations of motion for all quantities of interest . among them ,
the most important are two  time correlation functions ( green s functions ) which allow for systematic and far  reaching generalizations of traditional kinetic theory . in this paper
, we focus on nonrelativistic particle dynamics and start our derivations from the familiar equations of motion for the particle correlation functions @xmath72 and @xmath73 while the electromagnetic field is treated classically .      the field theoretical description of plasmas is based on the creation and annihilation operators @xmath74 and @xmath75 @xcite which are defined to guarantee the spin statistics theorem , @xmath76 where @xmath77 has been assumed .
the upper ( lower ) sign refers to bosons ( fermions ) , @xmath78 , and @xmath79 labels the particle species .
below , we will drop the spin index and assume fermions .
the nonequilibrium state of a correlated plasma is described by the two  time correlation functions which are statistical averages ( with the initial density operator of the system ) of field operator products @xmath80 where @xmath81 and @xmath82 are , in nonequilibrium , independent from one another .
they contain the complete dynamical and statistical information .
the latter follows from their elements _ along the time diagonal _ : the one - particle density matrix is immediately obtained from the function @xmath73 according to @xmath83 whereas the dynamical information ( e.g. the single  particle spectrum and the correlations ) follows from the function values _ across the diagonal _ in the @xmath84plane , in particular , from the _ spectral function _
@xmath85 , @xmath86 where @xmath87 are the retarded and advanced green s functions , defined below in eq .
( [ gra - def ] ) . in the following
, it will often be convenient to use microscopic and macroscopic time and space variables being defined as @xmath88 in particular , in cases where the microscopic variables vary on much smaller scales than the macroscopic ones , it is advantageous to perform a fourier transformation with respect to @xmath89 and/or @xmath90 which leads to the frequency and momentum variables @xmath91 and @xmath92 , respectively . in particular , eq . ( [ f - def ] ) then yields the familiar wigner distribution function @xmath93    the time evolution of the correlation functions in an electromagnetic field is determined by the kadanoff
baym equations @xcite @xmath94g_a^{\gtrless}(1 , 1 ' ) - \int d{\bar { \bf r}}_1 \ , \sigma_a^{\rm hf}(1,{\bar { \bf r}}_1t_1 ) g_a^{\gtrless}({\bar{\bf r}}_1t_1,1 ' ) \nonumber\\ & & = \int_{t_0}^{t_1 } d{\bar 1 } \ , \left[\sigma_a^>(1,{\bar 1})-\sigma_a^<(1,{\bar 1})\right ] \ , g_a^{\gtrless}({\bar 1 } , 1 ' ) - \int_{t_0}^{t'_1 } d{\bar 1 } \ , \sigma_a^{\gtrless } ( 1,{\bar 1})\,\left[g_a^>({\bar 1 } , 1')- g_a^<({\bar 1 } , 1')\right ] , \label{kb_eq}\end{aligned}\ ] ] which have to be fulfilled together with the adjoint equations . here
, @xmath95 denotes the initial time where the system is assumed to be uncorrelated ( otherwise , the equations have to be supplemented with an initial correlation contribution to @xmath96 , cf .
@xmath97 is the hartree
fock selfenergy ( mean  field energy with exchange ) , @xmath98 and @xmath99 are the correlation selfenergies which will be discussed below .    for the following derivations ,
it is useful to introduce , in addition , the retarded and advanced green s functions @xmath100\left\{g_a^>(1,1')-g_a^<(1,1')\right\ } , \label{gra - def}\ ] ] which obey the simpler equations @xmath101 g_a^{r / a}(1,1 ' ) \nonumber\\ & & -\int d2 \,\sigma_a^{r / a}(1,2)g_a^{r / a}(2,1')\,\ , = \,\ , \delta(1 - 1 ' ) .
\label{gra_eq}\end{aligned}\ ] ] in equations ( [ kb_eq ] ) and ( [ gra_eq ] ) , the electromagnetic field is given by the vector and scalar potentials @xmath102 and @xmath103 and will be treated classically .
@xmath102 is the full vector potential ( external plus induced ) which obeys maxwell s equations , whereas @xmath103 is understood as to be due to external sources only , the induced longitudinal field is fully accounted for in the screened coulomb potential @xmath71 which enters the selfenergies @xmath104 and @xmath105 , see below .    although one can directly analyze and solve the two  time kadanoff
baym equations ( [ kb_eq ] ) , e.g. @xcite , for an overview , see @xcite , it is easier to consider the kinetic equation for the wigner distribution function ( [ f - def2 ] ) , which we will be concerned with here .
this equation is immediately obtained from the equal time limit , @xmath106 , of eq .
( [ kb_eq ] ) plus its adjoint . introducing further the variables @xmath107 and @xmath90 , eqs .
( [ r - r - def ] ) and ( [ t - tau - def ] ) , we obtain , after fourier transformation with respect to @xmath90 , for the spatially homogeneous case , @xmath108 this is an exact equation and , therefore , well suited for deriving generalized kinetic equations .
however , this equation is not closed yet since it contains under the collision integral functions depending on two times . therefore , to obtain explicit expressions for the collision integral , one has :    1 .
to find appropriate approximations for the self energy .
for this , the green s functions approach provides powerful approximation schemes based on feynman diagrams which allow for a very systematic development of the theory . here
, we are interested in the plasma dynamics with screening effects properly included . therefore , the appropriate choice for the selfenergy will be the random phase approximation ( rpa ) ; 2 .   to express the correlation functions @xmath109 as functionals of the wigner functions @xmath67 ( reconstruction problem ) .
this problem can be solved approximately on the basis of the generalized kadanoff
baym ansatz ( gkba ) of lipavsk et al .
@xcite , see sec .
[ gkba_ss ] .
it is well known that the electromagnetic field can be introduced in various ways ( gauges ) which may lead to essentially different explicit forms of the resulting kinetic equations .
although alternative derivations are successfully applied too , gauge invariance becomes a particular problem if the resulting kinetic equations are treated by means of approximations , such as retardation or gradient expansions .
a critical issue is that the result of these approximations maybe essentially different in different gauges , see e.g. @xcite for examples . to avoid these difficulties
, we will formulate the theory in terms of correlation functions which are made explicitly gauge  invariant . while the main results have been presented in ref .
@xcite , here we provide some additional details .    in this section , we use a co - variant 4-vector notation as it makes the following transformations more compact and symmetric .
the corresponding definitions are @xmath110 and the convention @xmath111 is being used .
one readily proofs that the kadanoff  baym equations ( [ kb_eq ] ) remain covariant under gauge transformations , i.e. , under the following transformations of the potentials and field operators @xmath112 the corresponding gauge transform of the green s functions leads to @xmath113 } g_a(x , x)\ , . \ ] ] following an idea of fujita @xcite , we now introduce a gauge  invariant green s function @xmath114 which is given by the modified fourier transform @xmath115\right\ } g_a(x , x ) , \label{gauge - ft}\end{aligned}\ ] ] where use has been made of the identity @xmath116 indeed , one readily confirms that under any gauge transform ( [ gauge - a ] ) , the phase factors cancel , and @xmath117 , @xcite .    in the following , we focus on spatially homogeneous electric fields and use the vector potential gauge @xmath118 in this case , relation ( [ gauge - ft ] ) simplifies to    @xmath119 g_a({\bf r},\tau;{\bf r},t ) , \label{gauge - ftv}\end{aligned}\ ] ]    what means that the gauge  invariant green s function @xmath120 follows from the wigner transformed function @xmath121 by replacing the canonical momentum @xmath92 by the gauge  invariant kinematic momentum @xmath122 according to @xmath123 let us illustrate this for the examples studied in sec .
[ sec_bas ] . for a _ harmonic electric field _ given by eq .
( [ efeld ] ) , the vector potential and the momentum relation become , according to eq .  ( [ v - gauge ] ) , @xmath124 similarly , for a _ pulsed field _ of the form eq .
( [ e - pulse ] ) , the result for the vector potential and the momenta is @xmath125 finally , for a _ static field _
we obtain , @xmath126    for the derivations below , we will need the gauge invariant fourier transform of the convolution of two functions which , in the homogeneous case , is given by @xmath127 after straightforward manipulations which involve the back transform of ( [ gauge - ftv ] ) , we arrive at @xmath128 \nonumber \\ & & \qquad \times\,\ , c \left[{\bf k}+ \frac{e_a}{c}\int_{t'_1}^{t_1 } dt''\ , \frac{{\bf a } ( t'')}{t_1-t'_1 } - \frac{e_a}{c } \int^{\bar{t}}_{t'_1 } dt''\ , \frac{{\bf a}(t '' ) } { \bar{t}-t'_1};\,\bar{t},t'_1\right ] . \quad \label{conv - ft}\end{aligned}\ ] ] in particular , the derivation of the collision integral in the kinetic equation for the wigner function , requires the equal  time limit of this expression , @xmath106 , @xmath129 \nonumber \\ & & \qquad \times\,\ , c \left[{\bf
k}+\frac{e_a}{c}{\bf a}(t ) - \frac{e_a}{c}\int_{\bar t}^{t } dt '' \ , \frac{{\bf a}(t'')}{t-{\bar t } } ; \,\bar{t},t\right ] , \quad \label{conv - ftt}\end{aligned}\ ] ] where @xmath130 and @xmath131 will be replaced by @xmath132 and @xmath133 .
notice that in this case the momentum arguments of @xmath130 and @xmath131 are equal . to simplify the notation below , we introduce the field induced momentum shift @xmath134 which has the important property @xmath135 where @xmath136 is nothing but minus the momentum gain of a free particle in the field , @xmath137 , cf .
( [ va ] ) .
another important relation follows from multiplication by the time interval : @xmath138 where @xmath139 is just the field induced displacement of a free particle , eq .
( [ ra ] ) , i.e. @xmath140 .    definition ( [ ka ] ) allows us to rewrite eq .
( [ conv - ftt ] ) as @xmath141 \ , c \left[{\bf k}+{\bf k}^a_a(t,{\bar t});\ , t,{\bar t}\right ] .
\label{conv - ftt2}\end{aligned}\ ] ]      as noted in sec
.  [ kbe_ss ] , for the derivation of the collision integral in the kinetic equation , we need to express the functions @xmath72 and @xmath73 in terms of the wigner function .
in addition , such a reconstruction ansatz involves the retarded and advanced green s functions @xmath142 for which suitable expressions have to be found .
we first determine these quantities for free particles in an electromagnetic field which allows to simplify eq .
( [ gra_eq ] ) to @xmath143 g_{a}^{r / a}({\bf p};t_1,t'_1)=\delta ( t_1-t'_1),\ ] ] which is solved immediately by @xmath144 ^ 2/2m_a\right ] , \label{gra_free}\end{aligned}\ ] ] and @xmath145 is obtained from the symmetry relation @xmath146^*$ ] . from this result
, we can calculate the spectral function @xmath147 , eq .
( [ a - def ] ) , @xmath148 ^ 2/2m_a\right ] .
\label{a_free}\end{aligned}\ ] ] obviously , the results ( [ gra_free ] ) and ( [ a_free ] ) are gauge - dependent since @xmath149 and @xmath150 are functions of the canonic momentum @xmath92 .
but one can easily obtain the corresponding gauge
invariant results by applying the transform ( [ gauge - ft ] ) , with the result @xmath151 } , \label{gra_fg } \\
\nonumber\\ \mbox{where}\quad s_a({\bf a};\tau , t ) & = & \frac{e_a^2}{2 m_a c^2 } \left [ \int_{t-\frac{\tau}{2}}^{t+\frac{\tau}{2 } } dt ' a^2(t ' ) + \frac{1}{\tau } \left(\int_{t-\frac{\tau}{2}}^{t+\frac{\tau}{2 } } dt ' { \bf a}(t')\right)^2\right]\,.\end{aligned}\ ] ] this result has a simple physical interpretation . for a free particle without field ,
the spectral function shows free undamped oscillations along @xmath89 ( i.e. perpendicular to the time diagonal ) with the one  particle energy @xmath152 , and its fourier transform is @xmath153 .
\label{afree}\ ] ] this clearly underlines the meaning of the functions @xmath87 and , in particular , the spectral function @xmath79  they contain the full information on the single  particle energy spectrum .
furthermore , in a correlated system , the single  particle spectrum is affected by interactions with other particles .
this leads to a shift of the oscillation frequency and to damping of the oscillations , i.e. to finite life time effects , and it is reasonable to call the corresponding single
particle excitations _ quasi
particles_. on the other hand , the result ( [ gra_fg ] ) reflects the influence of an electromagnetic field on the particle spectrum , while correlation effects have been neglected .
( [ gra_fg ] ) shows that the field causes a time
dependent shift of the single  particle energy which , obviously , reflects the well  known fact that the proper eigenstates of the system contain the electromagnetic field and are given by volkov states @xcite . the spectrum may even contain additional peaks which becomes particularly transparent in the limiting case of a harmonic time dependence : for the field ( [ efeld ] ) , the time integrations in @xmath154 can be performed , and simple trigonometric relations lead to @xcite @xmath155 , \label{gra_fgh}\end{aligned}\ ] ] where @xmath156 is the ponderomotive potential which was introduced in eq .
( [ e - pond - h ] ) .
the first term in the brackets leads to a shift of the single - particle energy , the average kinetic energy of the particles increased by @xmath156 .
the remaining terms modify the spectrum qualitatively giving rise to additional peaks which are related to _
photon sidebands _ @xcite .
now we turn to the solution of the reconstruction problem .
the simplest solution is the common _ kadanoff  baym ansatz _ , @xmath157 where @xmath158 and @xmath159 , and the upper ( lower ) sign refers to @xmath72 ( @xmath73 ) .
indeed , the two  time functions @xmath160 and @xmath161 are now expressed in terms of one  time wigner distribution functions and a known spectral function . however , due to the expected retardation effects , this ansatz is not applicable here . as mentioned above
, a more general solution which properly takes into account retardation ( memory ) effects is the _
generalized kadanoff
baym ansatz _ proposed by lipavsk et al .
@xcite which reads @xmath162 where for the functions on the time diagonal @xmath163 , cf .
( [ f - def2 ] ) . within the quasiparticle approximation and with static selfenergies , eq .  ( [ gkba ] )
is exact . in more complex situations ,
it is an approximation to the exact reconstruction solution , which has prooved extremely successful in many applications . in particular ,
it has been used for more general selfenergies and also with more general propagators @xmath164 , e.g. @xcite .
we , therefore will use this ansatz below .
( [ gkba ] ) is written in terms of the momentum @xmath92 and is , therefore , gauge  dependent . to transform this relation into a gauge  invariant form
, we use its coordinate representation , @xmath165 and apply the gauge  invariant fourier transform ( [ gauge - ftv ] ) together with the back transforms of @xmath164 and @xmath166 which leads to the _ gauge  invariant generalization of the gkba _ @xmath167 - f_a^{\gtrless}\left[{\bf k}-{\bf k}^a_a(t , t ' ) ; t_1\right ] \ , g_a^a({\bf k};t_1,t'_1 ) , \label{gkba_gi}\end{aligned}\ ] ] where the definition ( [ ka ] ) for @xmath168 has been used . as in the field
free case , the first term is nonzero only for @xmath169 and the second in the opposite case . notice the difference of the time arguments in the two distribution functions .
we now come back to the time  diagonal limit of the kadanoff  baym equations , cf .
( [ kb_eq ] ) and ( [ f_eq ] ) , and derive the quantum kinetic equation for a plasma in a laser field thereby fully taking into account dynamical screening .
again , it is advantageous to derive this equation for the gauge  invariant wigner distribution . to this end
, we take the fourier transform ( [ gauge - ftv ] ) of the time  diagonal kadanoff  baym equation @xmath170 where the full arguments are , according to the convolution relation ( [ conv - ftt2 ] ) , given by @xmath171 \ , g_a^{\lessgtr}\left[{\bf k}_a+{\bf k}_a^a(t,{\bar t});{\bar t},t\right ] .
\nonumber\end{aligned}\ ] ] this expression is valid for arbitrary approximations for the selfenergies @xmath172 and @xmath173 . in our previous paper @xcite
, we used the simple static born approximation . here , we are interested in a fully selfconsistent _ inclusion of dynamical screening _ , so the appropriate choice is the random phase approximation ( rpa ) .      starting from the familiar expression in coordinate representation , application of the gauge  invariant fourier transform ( [ gauge - ftv ] ) straightforwardly leads to the following gauge
invariant result @xmath174 which transforms the collision integral of eq.([f_eqgi ] ) into @xmath175 \nonumber\\ & \times & i\hbar v_{aa}^{s\,>}({\bf q};t,{\bar t})\ ,
g_a^<\left[{\bf k}_a+{\bf k}_a^a(t,{\bar t});{\bar t},t\right]\ , \quad - \quad [ \;>\ ; \longleftrightarrow \;<\ ; ] \bigg\}\end{aligned}\ ] ]    in eq .
( [ sigma - rpa ] ) we introduced the correlation functions of the screened potential ( plasmon correlation functions ) @xmath176 which contain the whole screening problem and are directly related to the correlation function of the _ longitudinal field fluctuations _
( microfield fluctuations ) @xcite @xmath177 . \label{dede}\end{aligned}\ ] ] while in the classical case , the contributions from @xmath178 and @xmath179 are equal , in the quantum case a symmetrization is useful which is indicated by the bar over the fluctuation term . @xmath180 and @xmath181 can be related to the retarded and advanced screened potentials via the optical theorem @xmath182 where @xmath183 and @xmath184 obey the following equation of motion ( dyson equation ) @xmath185 and @xmath186 are related to the nonequilibrium inverse dielectric function according to @xmath187^{-1}. \label{idf}\end{aligned}\ ] ] in the above equations , @xmath188 is the bare coulomb potential ( [ coulomb ] ) and @xmath189 the retarded and advanced longitudinal polarization functions ( plasmon selfenergies ) . to close this system of equations , the polarization functions have to be expressed in terms of the particle correlation functions for which the simplest approximation is provided by the rpa , @xmath190 and @xmath191 follows from the relation @xmath192^*$ ] .
this set of equations completely defines the non  markovian polarization approximation ( rpa ) for a quantum plasma in a strong transverse field .
what is left to obtain a closed expression for the collision integral in equation ( [ f_eqgi ] ) is to apply the gauge  invariant gkba ( [ gkba_gi ] ) together with the free  particle approximation ( [ gra_fg ] ) to all two  time functions .
this leads to the following results for the optical theorem : @xmath193 } \nonumber\\ & & \times f_b^{\gtrless}\left[{\bf
k}+{\bf q}+{\bf q}_b(t_3,t_4);t_4\right]\ , f_b^{\lessgtr}\left[{\bf k}+{\bf q}_b(t_3,t_4);t_4\right ] \nonumber\\ & & + \theta(t_4-t_3)\,e^{-\frac{i}{\hbar}\left [ \left(\epsilon^b_{{\bf k}+{\bf q}}-\epsilon^b_{{\bf k}}\right)(t_3-t_4 ) + { \bf q}{\bf r}_b(t_4,t_3 ) \right ] } \nonumber\\ & & \times f_b^{\gtrless}\left[{\bf k}+{\bf q}+{\bf q}_b(t_4,t_3);t_3\right]\ , f_b^{\lessgtr}\left[{\bf k}+{\bf q}_b(t_4,t_3);t_3\right ] \bigg\}. \label{vs - gkba}\end{aligned}\ ] ] similarly , the result for @xmath194 can be transformed to @xmath195- f_a\left[{\bf k+q}+{\bf q}_a(t , t');t'\right ] \right\ } , \label{pira - gkba}\end{aligned}\ ] ] where the momentum shift @xmath136 and field  induced displacement @xmath139 were defined above in eqs .
( [ ka - dif ] ) and eqs .
( [ ka - dt ] ) , respectively . in the absence of the electromagnetic field , ( @xmath196 ) , eq .
( [ pira - gkba ] ) reduces to the well  known nonequilibrium rpa  polarization function .
the effect of the field is two  fold : first , it introduces an additional retardation @xmath136 in the distributions ( intra  collisional field effect ) and second , it leads to a modification of the one  particle energies in the exponent given by @xmath139 which we discussed in detail in ref .
@xcite .
we now can transform the collision integral eq .
( [ coli1 ] ) by applying the gkba ( [ gkba_gi ] ) to @xmath197 , and using the result for @xmath198 and @xmath199 , eq .
( [ vs - gkba ] ) . after straightforward calculations
, we obtain the final result @xmath200}\ , f_a^>\left[{\bar { \bf k}}_a+{\bf q}_a(t,{\bar t});{\bar t}\right ] f_a^<\left[{\bf k}_a+{\bf q}_a(t,{\bar t});{\bar t}\right]\ , \nonumber\\ & \times&\int_{t_0}^t d t_3 \;\int_{t_0}^{\bar t } d t_4 v^{s\,r}({\bf k}_a-{\bar { \bf k}}_a;t_1,t_3)\ , v^{s\,a}({\bf k}_a-{\bar { \bf k}}_a;t_4,t_2)\,\times \nonumber\\ & & \bigg [ \theta(t_3-t_4)\,e^{-\frac{i}{\hbar}\left [ \left({\bar \epsilon}_b-\epsilon_b\right)(t_3-t_4 ) + ( { \bf k}_b-{\bar { \bf k}}_b){\bf r}_b(t_3,t_4 ) \right ] } \nonumber\\ & & \times f_b^>\left[{\bar { \bf k}}_b+{\bf q}_b(t_3,t_4);t_4\right]\ , f_b^<\left[{\bf k}_b+{\bf q}_b(t_3,t_4);t_4\right ] \nonumber\\ & & + \theta(t_4-t_3)\,e^{-\frac{i}{\hbar}\left [ \left({\bar \epsilon}_b-\epsilon_b\right)(t_3-t_4 ) -({\bf k}_b-{\bar { \bf k}}_b){\bf r}_b(t_4,t_3 ) \right ] } \nonumber\\ & & \times f_b^>\left[{\bar { \bf k}}_b+{\bf q}_b(t_4,t_3);t_3\right]\ , f_b^<\left[{\bf k}_b+{\bf q}_b(t_4,t_3);t_3\right ] \bigg ] \quad - \quad [ \;>\ ; \longleftrightarrow \;<\ ; ] \bigg\}.\end{aligned}\ ] ] this is the general non
markovian collision integral for a homogeneous weakly coupled _ dynamically screened plasma in an electromagnetic field_. it is a generalization of numerous results which were previously obtained by various authors , including our static screening result for strong time
dependent fields @xcite and the result of silin and uryupin @xcite , the rpa result for a static field of morawetz @xcite and the field - free rpa results of kuznetsov @xcite and haug and ell @xcite .
furthermore , it generalizes previous results obtained for classical plasmas by silin , oberman et al . ,
klimontovich and others @xcite .
in particular , as we will see below , the classical dynamical screening result of klimontovich and puchkov @xcite is straightforwardly recovered from the collision integral ( [ coli3 ] ) .
this collision integral is the basis for computing electron
ion collision frequencies , plasma heating inverse bremsstrahlung effects etc .
, thereby fully taking into account dynamical screening , plasma instabilities and anomalous transport    despite the complicated structure of the integral ( [ coli3 ] ) , a direct numerical integration of the kinetic equation ( [ f_eqgi ] ) appears to be within reach , as recently solutions of non  markovian rpa - type equations ( without longitudinal field ) for semiconductors have been reported @xcite . on the other hand , to gain deeper insight in the physical processes contained in the collision term ( [ coli3 ] ) , it is useful to consider analytical simplifications .
if the collision frequency is low compared to the oscillation frequency of the field , i.e. if the parameter @xmath52 , one may follow an idea of silin @xcite and solve the kinetic equation ( [ f_eqgi ] ) with a perturbation ansatz @xmath201 where @xmath202 obeys the collisionless equation @xmath203 , \label{silin_an}\end{aligned}\ ] ] where @xmath204 is an arbitrary function depending on the initial conditions .
the equation for @xmath205 reads @xmath206 \right\}. \label{silin_an1}\end{aligned}\ ] ] with this scheme , there follow essential simplifications of the above results because it effectively eliminates the time retardation of the distribution functions in the collision integrals @xcite .
indeed , one easily verifies that the arguments of the distributions which appear in the formulas above , now become @xmath207 \longrightarrow f_{a0}\left[{\bf k}+\frac{e_a}{c}{\bf a}(t)\right ] , \label{farg - silin}\end{aligned}\ ] ] and do not depend on the time @xmath10 anymore .
this simplification allows to compute the transport , screening and fluctuation properties quite efficiently .
we first consider the modification of the longitudinal polarization @xmath208 .
straightforward transformations of eq .
( [ pira - gkba ] ) including a change of the momentum integration variable lead to @xmath209 using this result and the adiabatic approximation ( neglecting the ion contribution to the polarization ) , we obtain from the dyson equation , eq .  ( [ vdyson ] ) , for the retarded screened potential @xmath210 where again , @xmath211 denotes the screened potential in the zero field limit and without retardation in the distribution functions .
simplifications are possible also for the collision integrals . in particular , we obtain for the electron  ion scattering term , @xmath212\tau } \nonumber\\ & & \ ; \times \int_{0}^{\infty}d\tau_1\int_{-\infty}^{0}d\tau_2\frac{1 } { \epsilon_{0}^{r}({\bf q},\tau_1)}\frac{1}{\epsilon_{0}^{a}({\bf q},\tau_2 ) } \ , e^{-\frac{i}{\hbar}\frac{e_e}{m_e c}{\bf q } \int\limits_{t-\tau-\tau_2}^{t-\tau_1 } d{\bar t}\,{\bf a}({\bar t } ) } \left\{f_{e0}({\bf k - q})-f_{e0}({\bf k } ) \right\ } , \quad \label{iei - silin}\end{aligned}\ ] ] where @xmath213 are the field  free inverse dielectric functions .
( [ iei - silin ] ) is the generalization of klimontovich s result @xcite to quantum plasmas and .
finally , we consider the simplifications introduced by the ansatz ( [ silin_an1 ] ) to the field fluctuations . the quantity of central importance is the correlation function of the temporal and spatial microfield fluctuations @xmath214 , eq .
( [ dede ] ) .
a lengthy but straightforward calculation leads to the following result @xmath215(t_1-t_2 ) } } { |\epsilon_{0}({\bf q},\epsilon^{e}_{{\bf k+q}}-\epsilon^{e}_{{\bf k}})|^2 } \left\{f_{e0}({\bf k+q})[1-f_{e0}({\bf k})]+ f_{e0}({\bf k})[1-f_{e0}({\bf k+q})]\right\ } \nonumber\\ & & \qquad + \;e_i^2 \ , e^{-\frac{i}{\hbar}[\epsilon^{i}_{{\bf k+q}}-\epsilon^{i}_{{\bf k}}](t_1-t_2 ) } \int_{0}^{\infty } d\tau_1 \ , \frac{e^{-\frac{i}{\hbar } [ \epsilon^{i}_{{\bf k+q}}-\epsilon^{i}_{{\bf k}}]\tau_1 } } { \epsilon_{0}^{r}({\bf q},\tau_1 ) } \nonumber\\ & & \qquad\quad\times \int^{0}_{-\infty } d\tau_2 \ , \frac{e^{\frac{i}{\hbar } [ \epsilon^{i}_{{\bf k+q}}-\epsilon^{i}_{{\bf k}}]\tau_2 } } { \epsilon_{0}^{a}({\bf q},\tau_2 ) } \ ; e^{-\frac{i}{\hbar}\left(\frac{e_e}{m_e}-\frac{e_i}{m_i}\right){\bf q } \int\limits_{t_2-\tau_2}^{t_1-\tau_1 } d{\bar
t}\,\frac{{\bf a}}{c}({\bar t } ) } \left[f_{i0}({\bf k+q})+f_{i0}({\bf k})\right ] \bigg\ } , \nonumber \label{de - silin}\end{aligned}\ ] ] where the first term in parantheses ( second line ) is the electron contribution , and the second ( third and fourth line ) results from the ions . again , this is a generalization of klimontovich s remarkable result @xcite who considered the classical limit and the equal time fluctuations , @xmath77 .
our result fully includes the two  time fluctuations which are directly measurable quantities . from the above fluctuation spectrum , all major observables of dense quantum plasmas in a strong laser field
can be computed .
the corresponding analysis will be presented in a forthcoming paper .
in this paper , we have presented a gauge  invariant derivation of the quantum kinetic equation for dense plasmas in a laser field . our main result , eq .
( [ coli3 ] ) , generalizes previous work to quantum systems . this equation can be used to calculate the transport properties of a dense plasma in a laser field on arbitrary time scales , i.e. , over the whole frequency range .
the use of the random phase approximation allows for a highly consistent treatment of the combined effect of internal longitudinal fields ( dynamical screening ) and transverse electromagnetic fields , including intense laser pulses .
in particular , it allows to investigate the influence of the electromagnetic field on the two  particle scattering process and the screening properties of the plasma and on the screening buildup in the presence of a strong field .    besides , the presented gauge
invariant approach is completely general and can be extended straightforwardly to more complex situations , including strong coupling effects , bound states , impact and field ionization .
moreover , it can be directly generalized to relativistic systems und ultra  intense fields .
it is a great pleasure to dedicate this paper to yuri lvovich klimontovich on his seventyfith birthday .
all of us have , at different times , come in contact with the remarkable papers and monographs of klimontovich .
we have very much enjoyed countless discussions with him as well as rewarding scientific collaborations on problems of kinetic theory of nonideal gases and plasmas in general , in particular on dielectric properties @xcite , kinetic equations with bound states @xcite , foundation of reaction  diffusion equations for nonideal plasmas @xcite , selforganization and structure formation @xcite and many others .
the authors acknowledge stimulating discussions with g. kalman , p. mulser and r. sauerbrey .
this work is supported by the deutsche forschungsgemeinschaft ( schwerpunkt `` wechselwirkung intensiver laserfelder mit materie '' ) , and by the european commission through the tmr network silasi .
it is interesting to note that klimontovich s phase space densities @xmath216 @xcite are essentially the classical limit of the field operators .
therefore , his kinetic theory is of similar generality as modern field theory , cf .
his text books @xcite .


the storage and retrieval properties , as well as the dynamics , of large attractor neural networks have been studied over some time and numerous results are now available .
the presence of an exponentially large number of unwanted spin - glass - like states in fully connected networks may limit severely the storage capacity , the information content and the performance , in particular the retrieval quality of previously stored patterns which act as attractors in the dynamics of the network .
also , the size of the corresponding basins of attraction may be considerably reduced .
other tasks , as the categorization or generalization ability of a network , are also impaired due to the presence of such states and , except for a low storage ratio , that is for a reduced level of stochastic noise , a performing network is very likely to be trapped in one of those states preventing the occurence of finite overlaps with the patterns of interest .
the study of the equilibrium behavior of the hopfield model with binary neurons and extremely low _ symmetric _ connectivity @xmath3 suggested that @xcite , except for zero storage ratio @xmath4 or in the absence of synaptic noise @xmath5 , the properties of the model may be quite different from those of the extremely diluted network with asymmetric synapses , which has a trivial dynamics @xcite .
in particular , the equations for the order parameters are equivalent to those of the sherrington and kirkpatrick ( sk ) spin - glass ( sg ) model @xcite .
it has been shown , nevertheless , that strong symmetric dilution of synapses in the hopfield model @xcite may considerably reduce the stability of spin - glass states . indeed , in the limit @xmath6 , the retrieval states are globally stable in their whole domain of existence of the @xmath7 phase diagram , thus leaving only locally stable sg states @xcite , in contrast to the situation in the fully connected hopfield model @xcite .
it has also been shown that already a gradual dilution reduces the stability of the sg states in the region where they compete with the retrieval states and that the storage capacity of the network is increased @xcite .
these are important results on the performance of a network which also suggest that the basins of attraction of the memory ( retrieval ) states should be increased in symmetrically diluted networks .
networks of q - ising neurons in various architectures have been studied over some time , in particular , fully connected , layered feed - forward and extremely dilute networks with asymmetric connectivity @xmath8 $ ] .
they are of interest for possible hardware applications and an eventual biological modeling , because of the increased flexibility of the states of the network to account for complex neural behavior .
it has been suggested that an attractor neural network model with multi - state neurons may describe the short term memorization performance of the @xmath9 region of the hyppocampus in both the brain of primates and in the human brain , and results of numerical simulations for the selective performance of a network with asymmetric synapses and small connectivity ( @xmath10 ) are now available @xcite .
however , complete phase diagrams that give a global picture of the performance of a network and a physical explanation of why biological networks seem to prefer a low connectivity are still missing .
attractor network models with a hebbian type of learning rule may also serve to account for long - term memory in the brain @xcite .    both the parallel dynamics and the equilibrium properties of extremely diluted networks with symmetric connectivity between multi - state q - ising neurons
have been studied in recent works @xcite .
the symmetry of the synaptic connections allows for a detailed balance assumption in the dynamics and enables one to perform full analytic calculations of the equilibrium properties of a network .
this is particularly convenient in the search for phase diagrams .
so far , there are no results , to our knowledge , concerning the memorization performance of symmetrically diluted q - ising networks with small but finite connectivity and low - activity patterns , which characterize a biological network .
the purpose of the present work is to consider the retrieval performance of an attractor neural network modeled on some of the features of a biological network .
we study here the equilibrium behavior of a symmetrically diluted hopfield model with finite connectivity and low - activity units in q - ising states .
multi - state networks are known to have complex properties and our main aim here is to find out how that behavior is changed by a finite dilution of the synapses and the low activity of the embedded patterns .
we consider explicitly a @xmath0 , @xmath1 and a continuous @xmath2-state network .
the outline of the paper is the following . in sec .
ii we present the model and show how the hamiltonian becomes the sum of an effective hopfield - model hamiltonian and that of a sherrington - kirkpatrick - like spin - glass model . the replica - symmetric mean - field theory for the model and the relevant order parameters are derived in sec .
iii and explicit expressions are presented in the appendix .
the results for the phase diagrams and the retrieval performance are discussed in sec .
iv , and our conclusions with a summary of the results can be found in sec . v.
attractor neural networks are dynamical systems . consider a network of @xmath11 neurons , @xmath12 . at the time step @xmath13
, the state of neuron @xmath14 is described by the variable @xmath15 , that can be in any one of the @xmath16 ising states @xmath17 in the interval [ -1,1 ] , for @xmath18 . a macroscopic set of @xmath19 independent and identically distributed random patterns @xmath20 , with @xmath21
, is embedded in the network by means of a hebbian - like learning rule , specified below . here , @xmath22 is the storage ratio per connected site and @xmath3 is the connectivity of the network
. every bit of each pattern can be in any one of @xmath16 equally spaced states , also in the interval [ -1,1 ] , which are assumed to have zero mean and variance @xmath23 this is a measure of the size of the patterns , describing their mean activity , that accounts for bits that either are turned off or depressed .
the first task to be performed by the network is to attain a finite storage ratio @xmath4 and this ratio can be optimized for patterns of a given size by means of an appropriate tuning of the states of the network , discussed below .
the second aim is to reach a sufficiently small hamming distance @xmath24 between the network state @xmath25 and a given pattern @xmath26 , as a measure of the retrieval performance of the network .
this depends on both the overlap @xmath27 and the dynamical activity of the network , @xmath28 .
we consider next the dynamics of the partially connected model . for a given configuration @xmath29 of the network ,
the local field acting on neuron @xmath14 is given by @xmath30 where @xmath31 is the synaptic coupling between neurons @xmath14 and @xmath32 .
we assume that the synapses of the network are symmetrically diluted being left with a _ finite _
connectivity @xmath3 ( the fraction of connected neurons ) which , eventually , may become vanishingly small .
specifically , the synapses are of the hebbian - like form , @xmath33 for our non - sparse network , in which @xmath34 . here
, @xmath35 is a set of independent identically distributed random variables , such that @xmath36 with probability @xmath3 and zero with probability @xmath37 , while @xmath38 .
thus , the symmetric dilution introduces an additional randomness both into the dynamics of the network , which becomes non - trivial even in the extremely diluted case due to feedback loops @xcite , as well as in the thermodynamics .
we are interested , in the following , in the case of a large connected network , in which @xmath39 is very large .
the state of each neuron is updated asynchronously according to a glauber ( single spin - flip ) dynamics @xcite in which the transition probabilities are given by @xmath40 }      { \sum_{l=1}^q\exp[\beta\epsilon_j(\sigma_l|h_j(\{s_i(t)\}))]}\ ; , \label{7}\ ] ] where @xmath41 is the inverse synaptic noise ( temperature ) and the single site energy , @xmath42 , is given by @xmath43 here , @xmath44 is a tuning parameter favoring local states of small dynamical activity . in the absence of stochastic noise
, the deterministic evolution of the system follows the updating rule @xmath45 where @xmath46 is the non - decreasing step function , for finite @xmath16 , @xmath47 \label{10}\ ] ] with @xmath48 and @xmath49 , in which @xmath50 , if @xmath51 , and zero otherwise .
clearly , @xmath44 is a threshold parameter since the state of neuron @xmath32 assumes the value @xmath52 given by eq .
( [ 1 ] ) if the local field @xmath53 is bound by @xmath54 .
the width of the intermediate states with constant @xmath52 for @xmath55 ( that is , excluding the limiting values of @xmath56 ) , is given by @xmath57 .
thus , the width of the zero state for the three - state network studied below is @xmath58 . in the limit @xmath59 ,
the input - output function becomes the piecewise linear function @xmath60 where @xmath61 means the minimum between @xmath62 and @xmath63 .
the slope of the linear part , @xmath64 , is the gain parameter of the continuous network .
both , the locally stable states of the dynamics , as well as the globally stable states that characterize the equilibrium thermodynamic properties of the diluted network , that follow from the above dynamics , are described by the hamiltonian @xmath65 where the first sum is over all distinct pairs of neurons @xmath66 .
eventually , a field - dependent term , @xmath67 , may be added to generate the overlap with a specific pattern , and this will be implicitly assumed below .
we adapt next the procedure of viana and bray @xcite for diluted spin glasses in order to deal with the random dilution . in distinction to their case , which is that of a strongly interacting spin glass , we have here a diluted network with randomness in the patterns and weak interactions between units .
the latter allows for an exact truncation to the relevant order in @xmath68 that is sufficient for the mean - field calculation of the following section .
consider the disorder dependent part of the hamiltonian in the exponentiated form @xmath69 given a fixed set @xmath70 of patterns embedded in the network , we first have to build up a finite connectivity between units .
that is to say , we have to find a network such that the mean of @xmath71 is precisely @xmath3 and , to this end , we have to perform first an average over these random variables .
the average over the random patterns , that is necessary to evaluate the performance of the network , comes at a later stage .
the configurational average over the set @xmath72 of the @xmath73 times replicated function @xmath74 becomes @xmath75 where @xmath76 denotes the value of @xmath77 for @xmath36 .
we are interested in dense networks , that is , @xmath78 and large @xmath39 , letting eventually @xmath79 after the thermodynamic limit . for finite @xmath80 , the weak @xmath81 may be used to expand the logarithm to next - to - leading order in @xmath76 . using the law of large numbers to deal with @xmath82
we obtain @xmath83 in which the effective coupling @xmath84 is given by @xmath85 the first term is the hebbian synapsis of the fully connected network with multi - state patterns of activity @xmath86 and @xmath87 is a gaussian random variable with zero mean and a pattern - independent variance @xmath88 ; the brackets on the right - hand side of eq.(15 ) denote an average over this random variable .
this generalizes an earlier result by sompolinsky @xcite showing that dilution appears as a synaptic noise .
thus , the symmetric dilution introduces an effective hamiltonian , in the large @xmath39 limit , @xmath89 where the first term is a sum of a hopfield - model hamiltonian and a kind of sk - model term .
this is used in the following section to derive the mean - field theory for the model .
we consider now the mean - field theory for finite @xmath4 and for any connectivity @xmath78 .
the averaged free energy per connected site is given by @xmath90 with the averages first over the gaussian noise in the synaptic interactions and then over the pattern distribution .
the effective partition function is then given by @xmath91 and this is used in the replica method to perform the random averages by means of @xmath92 the essential point is then the calculation of the averaged replicated partition function .
assuming , as usual , that a finite number of patterns @xmath93 is condensed , with finite overlaps with the state of the network , we perform the random noise average and sum over the uncondensed patterns to obtain @xmath94\ }          \right\rangle_{\{\xi^{\mu}_i\}}\ , . \label{21}\end{aligned}\ ] ] where , the sum over @xmath95 counts the configurations for all possible replicas @xmath4 .
the dilution appears only in the first factor and @xmath96 is the average over the uncondensed patterns .    for both , the calculation of the function @xmath97 and the linearization of the quadratic form in the dilution term
, we introduce the replica matrix elements @xmath98 of the sg order parameter and @xmath99 which is the dynamical activity @xmath100 of the network .
the latter is one only in the case of binary units and , in general , @xmath101 . in the thermodynamic limit @xmath102
, we obtain @xcite @xmath103 where @xmath104 is the matrix of elements @xmath105 and @xmath106 .
introducing as usual the overlap parameter @xmath107 associated to the correlation between the overlaps of the patterns that do not condense , we restrict ourselves to replica symmetry , in which @xmath108 the free - energy per connected site , in the thermodynamic @xmath102 limit , then follows as @xmath109\nonumber\\ & + & \alpha(1-c)(\frac{\chi^2}{4\beta}+\frac{q\chi}{2 } ) -\frac{1}{\beta}\left\langle \int{\cal d}z\,\ln\sum_{\{s\}}\exp(\beta{\cal h}_{eff})\right\rangle_{\{\xi^{\nu}\}}\ ; , \label{27}\end{aligned}\ ] ] where @xmath110 is a gaussian measure , and @xmath111 , given by @xmath112 , is the susceptibility of the network .
the new , site independent effective hamiltonian @xmath113 , is given by @xmath114 in terms of which the thermal averages are defined as @xmath115 note , incidentally , that the explicit term in @xmath116 in the free energy comes from the variance of the gaussian random noise due to the dilution .    the order parameters that describe the performance of the network are given by the saddle - point equations @xmath117 @xmath118 and the susceptibility becomes @xmath119 in which @xmath120 , for a given gaussian noise @xmath121 is given by eq.(32 ) . noting that the effective hamiltonian @xmath113 is formally the same as either that of the fully connected or the extremely diluted network , with a different stochastic gaussian noise and different effective threshold @xmath122 , for each connectivity @xmath3 , our equations for @xmath123 , @xmath124 and @xmath125 will be formally similar to the equations for both these networks , and explicit expressions are given in the appendix .
the parameter @xmath126 follows from the algebraic saddle - point equation @xmath127 and @xmath128 is the effective width of the intermediate states .
eventually , depending on the state of the network specified by the dynamical activity @xmath100 and the sg order parameter @xmath124 , @xmath129 may become negative , favoring an order with large absolute values for @xmath130 .
whenever this is the case the network acts , at zero temperature , as a binary network with zero threshold , as will be seen below .
the combination @xmath131 , in which the second term is the gaussian noise due to the macroscopic number of uncondensed patterns , can be viewed as an effective random field that will influence the network performance through a competition with the effective threshold @xmath129 .
having performed the thermodynamic limit , one may now allow _ any _ value for the connectivity within @xmath132 , including the limit @xmath6 .
it can easily be seen that one recovers for @xmath133 both the mean - field free energy for the fully connected network when @xmath134 @xcite and that for the extremely dilute case , when @xmath79 @xcite . in this limit , @xmath135 and @xmath136 , whereas for @xmath134 we have , @xmath137 and @xmath138 , also in agreement with the known results .
these relations are valid for any temperature parameter @xmath139 .
thus , we have the complete form for the replica - symmetric free energy for arbitrary connectivity .    note , incidentally , that @xmath135 not only in the above limit but also for @xmath140 , in the @xmath141 limit , for any connectivity @xmath3 , ( that is , for any architecture ) and for all @xmath16 , and this is based on @xmath142 in that limit . otherwise , the susceptibility remains finite , even at zero temperature , since @xmath143 , when @xmath144 , while at finite temperature we have , in general , @xmath145 .
the limit of stability of the replica - symmetric solution comes from the study of quadratic fluctuations of the free - energy in the vicinity of the symmetric saddle - point . following the de almeida and thouless ( at ) analysis @xcite
, we obtain @xmath146 ^ 2      \right\rangle_{\{\xi^{\nu}\ } }          \leq 1\ , , \label{35}\ ] ] as the stability condition for the replica - symmetric solution .
this equation is to be solved together with the saddle - point equations for the order parameters .
the formal results obtained so far are valid for any finite number of condensed patterns with finite overlaps with the state of the network .
we are mainly interested in this work in the retrieval performance with a single condensed pattern , and this will be discussed in the following section .
for the retrieval of a single condensed pattern , say @xmath147 , we have @xmath148 , and omit the index @xmath149 from now on . we consider separately the results for @xmath0 , @xmath1 and @xmath2 that follow by solving the saddle - point equations and
restrict ourselves to the simplest case of uniformly distributed patterns .
in the @xmath0 case , the patterns take the values @xmath150 with probability @xmath151 and @xmath152 with probability @xmath153 , in which @xmath154 in the case of uniformly distributed patterns .
the effective transfer function @xmath155 that follows from the average in eq.(32 ) is given by @xmath156 which becomes @xmath157 in the zero temperature limit . clearly , when @xmath158 , the network acts as a binary network at @xmath159 .
in the cases of the fully connected @xcite or the extreme symmetrically diluted network @xcite , explicit closed form expressions that signal the appearance of either a retrieval or a spin - glass phase , at zero temperature , have been obtained in the @xmath160 limit when @xmath161 .
these are particularly useful to understand the low - threshold behavior of the phase diagrams . in the present case , of a network with finite and less than complete connectivity , closed form expressions for the onset of the ordered phases
can not be obtained and one has to resort fully to numerical solutions .    nevertheless , the zero - temperature behavior of the thermodynamic transition can easily be analyzed as in previous works , to demonstrate that the retrieval state corresponds to the most stable phase , despite the presence of a spin - glass and a paramagnetic phase ( which is a frozen zero - spin state ) .
indeed , the physical free energy , @xmath162 at zero temperature becomes @xmath163 since the susceptibility vanishes in the @xmath164 limit when @xmath159 for any of the three phases , and at the same time @xmath165 , the retrieval free energy is the minimum whenever @xmath166 .
note that the susceptibility of the paramagnetic phase , @xmath167 also vanishes in the zero temperature limit for finite @xmath4 and @xmath122 converging to @xmath44 , ensuring a minimum retrieval free energy for small @xmath4 .
although much emphasis is often made on the thermodynamic transition to globally stable retrieval states , which have the lowest free energy , it is worth keeping in mind that neural networks are dynamical systems with accessible _ locally _ stable retrieval states , in particular in the presence of some amount of noise . as far as the performance of the network is concerned , these are the most interesting states and they usually appear for higher values of @xmath4 @xcite .
we are interested here in the characteristic features of the phase diagrams and the specific performance of the network . to see the effects of a gradual change in the connectivity , we show in fig .
1 the @xmath168 phase diagrams for @xmath159 . the full lines represent the phase boundaries where the locally stable retrieval states appear at the critical storage ratio @xmath169 , whereas the long - dashed lines indicate the thermodynamic transitions to the globally stable retrieval phase .
the sg phase appears to the left of the short - dashed lines representing the boundary to the paramagnetic state . to distinguish in what follows the transitions involving locally stable states from the thermodynamic transitions , we refer to the former simply as retrieval transitions .
as long as the connectivity remains finite , all the transitions are discontinuous and , as usual in connected networks , the sg state is globally stable only above the thermodynamic transition @xcite .
consider first the case of the fully connected network , with @xmath134 , which has been redone and completed here for the purpose of comparison .
there are two retrieval regions , i and ii for small @xmath4 , separated by a sharp phase boundary , and this is the case both below and above the thermodynamic transition .
the first is a region of non - optimal performance characterized by a moderately large hamming distance which decreases with increasing @xmath44 , whereas in region ii the hamming distance is small , dropping discontinuously at the phase boundary between the two regions with optimal network performance along the dotted line .
the situation should change with decreasing connectivity , even at zero temperature . due to the synaptic noise produced by the dilution , given by the variance @xmath88
, one now expects an end to the discontinuous transition between the retrieval regions i and ii at a @xmath3-dependent critical point for finite @xmath4 , below @xmath169 .
this starts to appear for @xmath170 , with @xmath171 and @xmath172 , as shown in the inset of the figure for the retrieval transition .
a critical point also appears at the thermodynamic transition and in fig .
1 we show the results for @xmath173 and @xmath174 . there can be now a continuous transition with increasing @xmath44 induced by stochastic noise between the non - optimal and optimal performance retrieval states above the critical point suggesting the presence of increasingly larger regions of continuous changes .
the interesting point is that this is a feature that already starts to appear for finite and _ intermediate _ connectivity , between that of the fully connected network and the @xmath6 limit .    to understand the role of the threshold one may use as a guide the case of vanishing stochastic noise , with @xmath164 .
when @xmath44 is small , the state of a unit will be essentially @xmath175 , with an overlap @xmath176 in region i for uniformly distributed three - state patterns @xmath177 , that take the values @xmath178 , @xmath152 and @xmath179 . since @xmath180 , the hamming distance in this region will be @xmath181 . on the other hand ,
as @xmath44 becomes larger , the state @xmath182 becomes increasingly important and , despite the fact that @xmath183 also yields an overlap @xmath184 , the sg order parameter @xmath124 is now reduced to the activity @xmath185 .
thus , the resulting hamming distance @xmath186 will be vanishingly small .
note that these results do not depend on the connectivity and they are , therefore , independent of the architecture of the network .
this also follows from the zero - temperature saddle - point equations as can easily be checked with the appendix . in the case of a finite non - zero stochastic noise , instead , the performance of the network becomes explicitly dependent on the connectivity , but the overall qualitative dependence on @xmath44 below the critical phase boundaries is expected to follow that at @xmath140 .
the critical storage capacity now increases with decreasing connectivity and the presence of two comparable maxima for @xmath169 is only a feature of intermediate @xmath3 .
indeed , as the synapses are further diluted a single maximum is left , albeit with a shift to higher values of @xmath44 . finally , it is also worth noting that , in the @xmath6 limit , the retrieval state is the globally stable phase everywhere below the critical @xmath169 line and to the left of the globally stable paramagnetic phase , despite the relatively large stochastic noise due to the presence of spin - glass states in most of this region .
the zero - temperature results presented so far are not stable to replica - symmetry breaking perturbations but it is expected that most of the features described here will be present at already a small but finite temperature above the at line , shown as dash - dotted in fig .
2 , for @xmath187 .
the full lines again represent the transitions to the locally stable retrieval states and the thermodynamic transitions are not shown .
note that , even for small connectivity , there is only a low synaptic - noise region in which the network is not stable to replica - symmetry breaking perturbations . for a larger @xmath188
we expect a similar behavior for the transition to the locally stable retrieval state with decreasing connectivity as that found before for the fully connected network , but still quite different from the behavior for lower @xmath44 @xcite .      in the case of @xmath1
the phase diagrams are more involved .
the patterns are assumed to take the values @xmath150 with probability @xmath189 and @xmath190 with probability @xmath191 , in which @xmath192 , where @xmath193 for uniformly distributed patterns .
we consider in the following the zero - temperature behavior of the network and begin with the fully connected case as a guide .
we recover precisely the retrieval phase boundaries found before @xcite .
similar results with exclusively sharp phase boundaries , between now enlarged ordered regions , are found for somewhat lower connectivity , as shown in fig .
3(a ) for @xmath173 . for low @xmath4 ,
we find three different ordered retrieval ferromagnetic phases @xmath194 , @xmath195 and @xmath196 , in a previous notation @xcite and characterized below , separated by discontinuous phase boundaries and in which @xmath197 for uniformly distributed patterns .
as @xmath4 increases , these phases disappear discontinuously at the critical phase boundaries @xmath169 into the @xmath198 phase .
the three phases correspond to possible locally stable states which become globally stable at the thermodynamic transition for lower @xmath4 , not shown in the figure for simplicity .
which of the locally stable states is actually reached in the dynamic evolution of the network will depend , as usual , on their basins of attraction and the choice of the initial state .
one may consider four regimes in the @xmath199 limit .
first , when @xmath44 is small , that is within the phase @xmath194 , mainly the high activity states are favored with @xmath200 with an overemphasized overlap @xmath201 ; the spin - glass order parameter and the hamming distance become @xmath180 and @xmath202 , respectively . for larger and intermediate @xmath44
, there should be a phase , called @xmath195 , characterized by states of the network that follow essentially the patterns , with @xmath203 and an overlap given by @xmath204 , the spin - glass order parameter @xmath205 and a vanishing hamming distance . between the small and the intermediate @xmath44 regimes
there could be a coexistence region of the phase @xmath194 with the phase @xmath195 where the states of the network start to recognize the full structure of the patterns .
finally , there should be a phase characteristic of the large @xmath44 regime in which mainly the intermediate states with @xmath206 are activated leading to a performance with @xmath207 , @xmath208 and again @xmath202 .
this is the phase @xmath196 , which should have an overlap with the phase @xmath195 at intermediate @xmath44 .
these expectations have been confirmed by means of the solutions to the saddle - point equations in the @xmath199 limit and some of the results can be found in earlier work @xcite .
the four regimes are given by @xmath209 , @xmath210 , @xmath211 and @xmath212 .
they do not depend on the connectivity and are therefore independent of the architecture of the network , in accordance with earlier results either on the fully connected or the extreme symmetrically dilute network @xcite .    on the other hand
, we confirm the symmetry of the limiting @xmath169 for @xmath213 and for @xmath214 , in accordance with earlier results @xcite .
we also find that the optimal performance line appears within the @xmath195 phase and that the network has a relatively high performance with a small hamming distance in that phase , with an overlap at the critical phase boundary that is @xmath215 of that at @xmath140 .
when the connectivity is reduced to @xmath216 , the distinction between the phases @xmath194 and @xmath195 starts to disappear , as shown by the enlarged gap in fig .
3(b ) , allowing for a continuous change into the high performance phase for intermediate @xmath4 . note that there is still a discontinuous phase boundary between the phases @xmath194 and @xmath196 and that the presence of this phase boundary is important in order to inhibit the transition to the low performance phase @xmath196 .
furthermore , we still find four regimes for low @xmath4 and that the three main retrieval phases , @xmath194 , @xmath195 and @xmath196 , end discontinuously at the critical phase boundary @xmath169 .
the optimal performance line is still purely within the @xmath195 phase , as in the previous case , and the network has a high performance up to @xmath169 , with an overlap close to one on the phase boundary , for @xmath44 around @xmath217 .    as the connectivity is further decreased to @xmath218
we find the phase diagram shown in fig .
3(c ) with the three main retrieval phases that disappear discontinuously at @xmath169 and the four low-@xmath4 regimes discussed above .
the distinction between the phases @xmath194 and @xmath195 disappears now at lower @xmath4 and the optimal network performance in the central phase @xmath195 can be reached continuously within a considerable range of @xmath4 from the @xmath194 phase . as in the previous cases ,
there is a coexistence region between the phases @xmath194 and @xmath195 , now only for small @xmath4 .
moreover , there is no need now for a specific choice of threshold parameter @xmath44 in order to access most of the high performance domain of the network .
incidentally , note that the continuous retrieval phase boundary for the common phase @xmath194 and @xmath195 is similar to that found for the fully connected network with pattern activity @xmath219 @xcite .
we have no further insight , at present , of this feature .    finally , in order to check the overall simplification of the phase diagrams that appears with decreasing connectivity , we also present results for @xmath220 that are shown in fig .
the phase boundaries are still lines of discontinuous transitions and the distinction between the four regimes is restricted to even lower values of @xmath4 .
there is now a considerably larger region of continuous changeover from the phase @xmath194 to the phase @xmath195 , with access to optimal performance , without the need of a fine adjustment in @xmath44 .      in the case of
@xmath2 we again consider uniformly distributed patterns between @xmath178 and @xmath149 , implying that @xmath221 , and restrict the results to the zero temperature case .
the discontinuous transitions to the ordered phase are shown in full lines in the @xmath222 phase diagram for decreasing connectivity in fig .
4 , where we omit again the thermodynamic transitions and the long - dashed lines indicate now the onset of the binary - network behavior .
note that the disappearance of the ordered phase takes place at @xmath223 for any finite connectivity , as in the case of the fully connected network and in networks of different architecture , like the extremely asymmetric diluted and the @xmath16-ising layered network @xcite . in the case of the extremely diluted networks ,
the retrieval phase boundaries have a reentrance for @xmath224 @xcite .
this seems to be a feature of the @xmath6 limit , as one can see from our further results for the connectivity dependence of the maximum storage capacity @xmath225 and the corresponding @xmath226 , both shown in fig .
5 .    as in the case of both the
fully connected and the symmetrical extremely diluted network , and in contrast with the @xmath0 state network , we find that even at zero temperature most of the retrieval regions for different @xmath3 are stable to replica - symmetry - breaking perturbations , that is for @xmath44 above the at lines .
this includes the maximum storage capacity and it follows from a positive replicon eigenvalue for this case obtained from eq.(38 ) , @xmath227 where @xmath125 is the susceptibility for the continuous network presented in the appendix .
the at line is given by @xmath228 and , again , in both the @xmath134 and the @xmath6 limit , in which @xmath135 , this result coincides with that for the fully connected and the symmetrical extremely diluted network @xcite .
we derived in this work the replica symmetric mean - field theory for @xmath16-ising attractor networks with low - activity patterns and arbitrary symmetric dilution of the synaptic connections .
we extended earlier studies on the retrieval behavior and thermodynamic properties of either fully connected or symmetrical extremely diluted @xmath16-ising neural networks with low activity patterns , in order to study the effects of a gradual dilution of the synaptic connections guided by the motivation that neurons in biological networks of associative memory are neither fully connected nor very sparsely linked to other neurons .
we are mainly interested in the nature of the phase transitions to locally stable retrieval states and in the role that synaptic dilution has in either reducing or destroying sharp transitions motivated by the plasticity of biological networks . in the context of the networks studied here , we focus mainly on the dependence of the retrieval properties on the threshold or
gain parameter @xmath44 for decreasing connectivity @xmath3 and ask to which extent can a network go from a given locally stable retrieval state to a nearby high - performance state without crossing phase boundaries of discontinuous transitions .    in order to answer that question , one has to look for appropriate phase diagrams that were obtained here in replica - symmetric mean - field theory .
since deviations from that theory are very small and appear only in a small region near @xmath159 , we may still draw relevant conclusions from those diagrams .
the explicit phase diagrams obtained in this work apply to uniformly distributed patterns and to networks with arbitrary symmetric dilution .
the behavior of both the fully connected and the extremely diluted network are recovered when @xmath134 and @xmath6 , respectively , in that our general saddle - point equations become identical to those for either case that have been obtained before @xcite .
we find that common features of the @xmath199 limiting behavior in either fully connected or symmetrical extremely diluted networks also appear for arbitrary finite connectivity @xmath3 .
this confirms the expectations of earlier works that pointed out the architecture independent nature of some properties @xcite . among these
is the particular @xmath188 where the thermodynamic transition ends in the @xmath0 state network and where the optimal performance takes place for low @xmath4 , both for @xmath159 .
the common limiting @xmath5 in the @xmath229 phase diagram for varying @xmath3 is a further property of this kind , as well as the four distinct domains in the @xmath1 state network and the @xmath188 limiting threshold for the @xmath2 network at @xmath140 .    the main dependence of the behavior of the network on the connectivity arises for finite @xmath4 .
for both odd and even @xmath16 , we find that a common feature that appears with an increase in the dilution of the synaptic connections is to suppress selected sharp phase boundaries of discontinuous transitions that make the optimal performance domain readily accessible to a wide region of low - threshold locally stable retrieval states . note that , on the other hand , the sharp boundary for the @xmath1 state network between the low performance phases @xmath194 and @xmath196 survives synaptic dilution , at least to quite an extent .
these features of the network for small but finite connectivity appear long before the extremely diluted limit and they should be of considerable interest .    concentrating , for simplicity , on the @xmath0 state network we also found that the boundaries between thermodynamic transitions are suppressed by an increase of the synaptic dilution , and expect a similar behavior for the @xmath1 state network .
the results of our work may be used to infer the behavior of other networks . since the fully connected network is strongly sensitive to pattern activity
, one may consider other than uniformly distributed patterns @xcite .
there are , essentially , two kinds of phase diagrams in that case about which we can make definite predictions .
one is the type of phase diagram for patterns of relatively large activity that has mostly a decreasing phase boundary with increasing @xmath44 and an optimal performance line that appears only at small @xmath44 .
the other type , that appears for medium or small pattern activity , has an optimal performance only at intermediate @xmath44 , like the cases shown in fig . 3 , and both types appear for @xmath0 and @xmath1 , while only the first type seems to appear for @xmath2 .
we expect that the main effect of a finite synaptic dilution on the first type of phase diagram is simply to shift the retrieval phase boundaries upwards towards a larger @xmath169 . in the second type of phase diagrams ,
however , we expect also a disappearance of the discontinuous phase boundary between the @xmath194 and @xmath195 phases , in essentially the same way we found in the present work , allowing for a smooth changeover from states of non - optimal to those of optimal performance
.    the main result of this work , that partially connected multi - state hebbian networks can attain near - optimal performance without a fine tuning of neuron activity may be a simplified statistical mechanics explanation of why biological memory networks seem to prefer low - activity patterns between partially connected neurons .
of course , biological networks have asymmetric synaptic connections which may lead through a dynamic evolution to different stationary states , the search of which is certainly an interesting issue that deserves a separate investigation , currently in progress .
the study of the effects of symmetric synaptic dilution may be extended to other problems that deal with associative memory , like the categorization problem as a classification task in @xmath16-ising networks @xcite .
this has been done recently for @xmath230 @xcite and there is work in progress for general @xmath16 @xcite .    *
acknowledgments *    we thank d. boll and g. m. shim for clarifying a point on a previous version of the manuscript .
this work was financially supported in part by cnpq ( conselho nacional de desenvolvimento cientfico e tecnolgico ) brazil .
we present here , for completeness , the explicit expressions for the saddle - point equations obtained for the symmetrically diluted network with arbitrary connectivity @xmath3 and uniformly distributed patterns , for @xmath0 , @xmath1 and @xmath2 .    for @xmath0 taking patterns
@xmath150 with probability @xmath151 and @xmath152 with probability @xmath153 we have @xmath231 @xmath232\ , , \label{a.2}\ ] ] @xmath233\ , , \label{a.3}\ ] ] with @xmath234 given by eq.(39 ) .
these equations reduce to the equations for the extreme symmetrically diluted network , as well as for the fully connected network , in the @xmath6 limit and @xmath134 , respectively .
the same applies for the cases of @xmath1 and @xmath2 , presented below .    in the zero - temperature limit ( @xmath144 )
, the integrations over the gaussian variable @xmath121 can be done explicitly . in the @xmath0 case
we obtain , for @xmath235 , @xmath236\ , , \label{a.4}\ ] ] @xmath237\ , , \label{a.5}\ ] ] @xmath238\ , , \label{a.6}\ ] ] with the relation between @xmath126 , @xmath124 and @xmath125 given by eq.(36 ) .    for the @xmath1 state model with states and
uniformly distributed patterns that take the values @xmath178 , @xmath239 , @xmath240 and @xmath179 , @xmath193 and we obtain @xmath241\ , , \label{a.7}\ ] ] @xmath242\ , , \label{a.8}\ ] ] @xmath243\ , .
\label{a.9}\ ] ] where @xmath244 in the zero - temperature limit @xmath245\ , , \label{a.11}\ ] ] and the above equations yield , for positive @xmath122 , @xmath246\nonumber\\       & + & \frac{1}{10}\left[{\rm erf}(\frac{m+4\tilde\theta }       { 3\sqrt{2\alpha rc } } )                                    + { \rm erf}(\frac{m-4\tilde\theta}{3\sqrt{2\alpha rc } } )       + { \rm erf}(\frac{m}{3\sqrt{2\alpha rc}})\right]\ , , \label{a.12}\end{aligned}\ ] ] @xmath247\ , , \label{a.13}\ ] ] @xmath248\ , .
\label{a.14}\end{aligned}\ ] ] finally , in the zero - temperature limit for @xmath2 and uniformly distributed patterns between @xmath178 and @xmath149 , implying @xmath221 , we obtain for @xmath235 , @xmath249\ , , \label{a.11}\ ] ] @xmath250\ , , \label{a.12}\end{aligned}\ ] ] @xmath251 where @xmath252 and this integrations can be performed directly .
watkin and d. sherrington , europhys . lett .
* 14 * , 791 ( 1991 ) .
b. derrida , e. gardner and a. zippelius , europhys .
lett . * 4 * , 167 ( 1987 ) .
d. sherrington and s. kirkpatrick , phys .
lett . * 35 * , 1792 ( 1975 ) .
hopfield , proc .
usa * 79 * , 2554 ( 1982 ) .
j. hertz , a. krogh and r. palmer , _ introduction to the theory of neural computation _
( reading , ma .
addison - wesley , 1991 ) .
a. canning and j .- p .
naef , j. phys .
i * 2 * , 1791 ( 1992 ) .
amit , h. gutfreund and h. sompolinsky , ann .
( ny ) * 173 * , 30 ( 1987 ) .
yedidia , j. phys .
a * 22 * , 2265 ( 1989 ) .
h. rieger , j. phys .
a * 23 * , l1273 ( 1990 ) . c. meunier , d. hansel and a. verga , j. stat
. phys . * 55 * , 859 ( 1989 ) .
d. boll , p. dupont and b. vinck , j. phys .
a. * 25 * , 2859 ( 1992 ) .
d. boll , b. vinck and v.a .
zagrebnov , j. stat . phys . * 70 * , 1099 , ( 1993 ) .
d. boll , g.m .
shim , b. vinck and v.a .
zagrebnov , j. stat . phys . * 74 * , 565 ( 1994 ) .
d. boll , g.m .
shim and b. vinck , j. stat . phys .
* 74 * , 583 ( 1994 ) .
d. boll , h. rieger and g.m .
shim , j. phys .
a * 27 * , 3411 ( 1994 )
rolls , a. treves , d. foster and c. perez - vicente , neural networks * 10 * , 1559 ( 1995 ) .
arbib , editor ( m.i.t . press , 1995 ) .
d. boll , g. jongen and g.m .
shim , j. stat . phys . * 96 * , 861 ( 1999 ) .
d. boll , d. m. carlucci and g.m .
shim , j. phys .
a * 33 * , 6481 ( 2000 ) .
l. viana and a.j .
bray , j. phys .
c * 18 * , 3037 ( 1985 ) .
h. sompolinsky , phys . rev . * 34 * , 2571 ( 1986 ) . m.a .
p. idiart and a. theumann , j. phys .
a * 25 * , 779 ( 1992 ) .
j.r . almeida and d. thouless ,
a * 11 * , 983 ( 1978 ) .
r. erichsen jr . , w.k .
theumann and d.r.c .
dominguez , phys rev .
e * 60 * , 7321 ( 1999 ) .
p.r . krebs and w.k .
theumann , phys .
e * 60 * , 4580 ( 1999 ) .
r. erichsen jr . and w.k .
theumann , unpublished .
+    * figure captions * + fig .
phase diagram @xmath168 for the @xmath0 state network with uniformly distributed patterns and connectivity @xmath3 as shown , at @xmath159 .
the full and the long - dashed lines represent the retrieval and the thermodynamic transition , respectively . the latter ends on the right at the ( dotted ) optimal performance line and the spin - glass phase appears at the left of the paramagnetic phase boundary indicated by the short - dashed lines .
the two retrieval regions i and ii are discussed in the text and the inset corresponds to @xmath253 where the distinction betweeen these phases starts to disappear .
stable phase diagram to the right of the de almeida - thouless ( dot - dashed ) line in the @xmath229 plane for the @xmath0 state network with uniformly distributed patterns , @xmath187 and connectivity @xmath3 as shown .
the full lines represent the retrieval transition .
phase diagram @xmath168 for the @xmath1 state network with uniformly distributed patterns and connectivity ( a)@xmath173 , ( b)@xmath254 , ( c)@xmath218 and ( d)@xmath220 , at @xmath159 .
the full lines represent retrieval transitions and the optimal performance is indicated in dotted lines .
the central region is the best performance phase @xmath195 and there is a low-@xmath4 coexistence region between phases @xmath194 and @xmath195 .
phase diagram @xmath168 for the @xmath2 state network with uniformly distributed patterns and connectivity @xmath3 as shown , at @xmath159 .
the full lines represent retrieval transitions , the optimal performance is indicated in dotted lines and the onset of the binary network is shown by long - dashed lines .
the phases are stable to the right of the de almeida - thouless line ( dot - dashed ) . fig . 5 : connectivity dependence for the maximum storage capacity @xmath225 and the corresponding @xmath226 in the @xmath2 state network with uniformly distributed patterns at @xmath159 .