our understanding of stellar structure and stability has been built upon classical analytical studies of equilibrium configurations of incompressible self - gravitating systems by maclaurin , jacobi , dedekind , darwin , riemann , and especially @xcite . with the help of modern computers and numerical methods , such as the self - consistent - field ( scf ) technique @xcite and hydrodynamics techniques ,
these studies have been extended to compressible configurations by a variety of researchers @xcite .
however , most three - dimensional ( 3d ) hydrodynamical studies have been confined to a limited parameter space , i.e. , starting from two - dimensional ( 2d ) axisymmetric equilibrium models ( compressible analogues of maclaurin spheroids ) because we have not been able to build 3d compressible equilibrium models with complicated flows . to the author s knowledge
, techniques have only been developed to build compressible equilibrium models of nonaxisymmetric configurations for a few systems with simplified rotational profiles , e.g. , rigidly rotating systems @xcite , irrotational systems @xcite , and configurations that are stationary in the inertial frame @xcite .
our aim is to find a method by which a much wider class of nonaxisymmetric configurations can be readily constructed .
this will permit us to more clearly understand the viability of evolutionary sequences of triaxial configurations and will provide models whose stability properties can be readily analyzed .
previous linear stability analyses @xcite have revealed a number of hydrodynamical instabilities that might arise in incompressible riemann ellipsoids , but no corresponding numerical work using state - of - the - art 3d hydrodynamic techniques has been carried out . in particular ,
riemann s - type ellipsoids have been found to be subject to a hydrodynamic strain instability associated with elliptical stream lines @xcite , which raises concerns about the stability of certain types of geophysical flows and leads to suspicions about the evolutionary path of stars that are driven by gravitational - radiation - reaction ( grr ) forces toward the dedekind - sequence . in a recent nonlinear study of the secular bar - mode instability induced by grr @xcite , a uniformly rotating , axisymmetric neutron star , which was secularly unstable and driven by artifically enhanced grr , evolved into a bar - like configuration with a very slow pattern speed .
however , this special bar configuration became unstable to some kind of turbulence - like instability while evolving toward the dedekind - sequence , that is , toward a stationary ellipsoidal structure in the inertial frame maintained purely by the internal motion of the fluid .
it is suspected that this turbulence - like instability may be the elliptical strain instability identified in the earlier linear stability analyses . but
no definite conclusion can be drawn because the stability of only one dedekind - like configuration was studied .
following @xcite , one might consider generating additional ellipsoidal structures hydrodynamically , but the generation of each additional ellipsoidal model would be expensive in the sense that one has to evolve an initially axisymmetric model for a very long time , even with artificially enhanced grr @xcite .
this approach would make it impractical to undertake a full stability investigation through the entire parameter space of ellipsoidal models .
here we present a new 3d scf technique that is capable of building the full range of incompressible riemann s - type ellipsoids with nontrivial internal flows ( i.e. , not just the uniformly rotating jacobi configurations , which are thought to be the end point of secularly unstable stars driven by viscosity , and stationary dedekind configurations ) as well as compressible triaxial models that share the same divergence - free velocity field as riemann s - type ellipsoids .
our compressible models satisfy the steady - state euler s equation exactly , but only satisfy the steady - state continuity equation approximately , hence they are only in quasi - equilibrium . however , the violation of the steady - state continuity equation is very small for nearly incompressible models , hence these models can be used effectively as initial configurations for a hydrodynamical study of the stability of compressible analogues of riemann s - type ellipsoids .
we note that , to date , hydrodynamical techniques have not been used to examine the stability of riemann ellipsoids because the sound speed is formally infinite for incompressible models , while the time step in hydrodynamic codes is usually inversely proportional to the sound speed . on the other hand , since the elliptical strain instability associated with elliptical stream lines would set in on a dynamical time scale , we believe that our new `` quasi - equilibrium '' models will prove to be good starting points for hydrodynamical studies of this instability .
our numerical method inherits one central idea of the traditional scf method in that it makes use of the properties of the velocity field of riemann s - type ellipsoids to turn the vector form of the steady - state euler s equation into a scalar form , thus yielding a uniform bernoulli s function .
this enables us to follow the procedures of the traditional scf method to use several boundary conditions to determine quantities elsewhere . to be concise
, we will refer readers to @xcite and references therein for details of the traditional scf technique , and focus on the new aspects of our new method .
figure [ triaxial ] reproduces key elements of a plot that ( * ? ? ?
* see his chapter 7 , figure 15 ) used to discuss sequences of riemann s - type ellipsoids .
in this ( @xmath0,@xmath1 ) parameter plot , @xmath2 , @xmath3 , and @xmath4 are the three principal semiaxes of an ellipsoid , and each riemann s - type ellipsoid with angular velocity @xmath5 and uniform vorticity @xmath6 in the rotating frame resides between the two self - adjoint sequences ( curves lp and lk ) with @xmath7 , where @xmath8 the velocity field of a riemann s - type ellipsoid as viewed from a frame rotating with angular velocity @xmath5 takes the following form : @xmath9 where @xmath10 is a constant that determines the magnitude of the internal motion of the fluid , and the origin of the x - y coordinate system is at the center of the ellipsoid .
this velocity field @xmath11 is designed so that velocity vectors everywhere are always aligned with elliptical stream lines by demanding that they be tangent to the equipotential contours , which are concentric ellipses .
now , let s turn to a general self - gravitating system with some compressibility . if we adopt a polytropic equation of state , @xmath12 ( @xmath13 is pressure , @xmath14 is the polytropic constant and @xmath15 is the polytropic index ) , euler s equation for steady - state flows in the rotating frame is , @xmath16          - 2 \vec{\omega } \times \vec{v } \ , ,   \label{euler}\ ] ] where h is enthalpy , and @xmath17 is the gravitational potential . with the velocity field specified by eq .
( [ vel ] ) , one can show that eq .
( [ euler ] ) is equivalent to the following equation , @xmath18 =       -\nabla [ h+\phi-\frac{1}{2}\omega^2 ( x^2+y^2 ) ]
\nonumber\\       -\nabla [ \omega \lambda(\frac{b}{a}x^2 + \frac{a}{b}y^2 ) ] \,.\end{aligned}\ ] ] hence , within the configuration the following bernoulli s function must be uniform in space : @xmath19 where @xmath20 is a constant .
it should be mentioned that in this bernoulli s function , @xmath5 and @xmath10 are interchangeable .
this reflects the fact that , for any direct configuration ( @xmath21 ) in which fluid motion is dominated by figure rotation , the adjoint configuration ( @xmath22 ) in which fluid motion is dominated by internal motions can be obtained by simply interchanging @xmath5 and @xmath10 .
we find it is useful to define an effective potential @xmath23 as : @xmath24 hence , the bernoulli s function can also be written as : @xmath25 in our later discussion of equi - potential ( iso - density ) surfaces , we will often use the phrase `` equi - potential '' referring to @xmath23 .    on the other hand ,
the steady - state continuity equation in the rotating frame requires , @xmath26 this is trivially satisfied for incompressible riemann s - type ellipsoids because @xmath27 is zero everywhere , and the velocity vectors in the rotating frame are always tangent to the concentric equi - potential contours and perpendicular to the unit vector that is normal to the ellipsoidal surface . in our compressible models , the divergence - free velocity field given by eq .
( [ vel ] ) will continue to be adopted , so if the equi - potential ( and iso - density ) contours continue to be concentric ellipses ( as assumed by * ? ? ?
* ) , the velocity vectors will always be orthogonal to the density gradient everywhere ; this would satisfy the steady - state continuity equation exactly .
however , as we demand that euler s equation be satisfied via the solution of eq .
( [ bernoulli ] ) , the iso - density contours for our compressible models are not guaranteed to be self - similar ellipses . therefore , in our current numerical method
, the extent to which the steady - state continuity equation is satisfied will depend on how far the density shells deviate from self - similar ellipses .
for the remainder of this paper , we will only focus on obtaining a solution of bernoulli s function given by eq .
( [ bernoulli ] ) .
we will return to issues related to the steady - state continuity equation in section [ discussion ] .    for a given choice of axes ( @xmath2 , @xmath3 , @xmath4 ) and a mass distribution @xmath28 ( hence @xmath29 is determined by poisson s equation ) , there are three unknown constants in eq .
( [ bernoulli ] ) : @xmath20 , @xmath5 and @xmath10 . on the other hand
, we have three boundary conditions on the three axes at the surface of the star , i.e. , points a , b and c as illustrated in figure [ boundary ] , where @xmath30 drops to zero .
( note that points a , b and c are located on @xmath31 , @xmath32 , and @xmath33 axes at @xmath34 , @xmath35 , and @xmath36 , respectively . )
these boundary conditions give the following equations : @xmath37 subtracting equation ( [ bc2 ] ) from ( [ bc1 ] ) , we obtain @xmath38 adding equation ( [ bc2 ] ) and ( [ bc1 ] ) together , we obtain @xmath39 \label{ch2 } \,.\ ] ] since the right - hand - side of this last expression is non - negative , it follows that @xmath40 .
it can be shown that equations ( [ ch1 ] ) and ( [ ch2 ] ) are equivalent to equations ( 29 ) and ( 30 ) in chapter 7 of @xcite .
the solutions of equations ( [ ch1 ] ) and ( [ ch2 ] ) for a direct configuration are : @xmath41 where @xmath42 for adjoint configurations , we only need to interchange @xmath43 and @xmath44
. the signs of @xmath5 and @xmath10 are determined by the sign of @xmath45 ( which is predetermined by the specified axis ratios ) , through eq .
( [ eqn : f ] ) and the relationship , @xmath46 with these constants and the bernoulli s function in hand , we can solve for @xmath30 throughout the interior of the configuration .    in the incompressible case ( @xmath47 ) , we know from the classical analytical results that the adopted velocity field generates equilibrium structures that are uniform density ellipsoids .
hence , we can obtain riemann s - type ellipsoids directly by setting up a mass distribution that is confined by the ellipsoidal surface defined by three axes @xmath2 , @xmath3 and @xmath4 ; then we solve poisson s equation to get the potential everywhere ; finally , @xmath5 and @xmath10 can be determined by equations ( [ omega ] ) and ( [ lambda ] ) .
compressible polytropic models ( @xmath48 ) having the same flow pattern as that of riemann ellipsoids ( given by eq .
[ vel ] ) , can also be constructed by an iterative procedure that is very similar to hachisu s scf method @xcite .
the main steps of this method include : ( i ) set up a trial ellipsoidal mass distribution defined by the choice of @xmath2 , @xmath3 , and @xmath4 , then solve poisson s equation to obtain the gravitational potential everywhere ( the details of our poisson solver are discussed in * ? ? ?
* ) ; ( ii ) calculate @xmath20 , @xmath5 and @xmath10 using the three boundary conditions as discussed above ; ( iii ) calculate the enthalpy everywhere inside the configuration using eq .
( [ bernoulli ] ) ; ( iv ) calculate the new  trial " density distribution according to the relationship between the density and enthalpy for a polytrope .
these steps are repeated until the model converges .
in this section , we show our results for incompressible riemann s - type ellipsoids and their quasi - equilibrium , compressible counterparts .
since the available parameter space occupies a large portion of figure [ triaxial ] , we choose to build models only along the vertical dashed lines , which largely represent most of the configurations .
our models are constructed on a cylindrical grid with a resolution of @xmath49 in the @xmath50 ( cylindrical radius ) , @xmath51 ( vertical ) , and @xmath52 ( azimuthal ) directions , respectively .
following @xcite , we adopt a set of polytropic units in which the gravitational constant @xmath53 , the radius of the entire grid @xmath54 , and maximum density @xmath55 are all set to 1 . for all of our models
, we set the semiaxis @xmath2 to @xmath56 .
we choose to present our results in such a way that readers can readily normalize our data to any unit system they are familiar with for the purpose of comparison .
table [ n0 ] shows the results for direct configurations of incompressible ( @xmath47 ) riemann s - type ellipsoids .
tables [ n05 ] , [ n10 ] , and [ n15 ] show the same results but for compressible counterparts of riemann ellipsoids with @xmath57 , @xmath58 , and @xmath59 , respectively .
tables [ n0a ] , [ n05a ] , and [ n10a ] show results for adjoint configurations with @xmath60 , @xmath57 and @xmath58 , respectively .    in these tables , @xmath61 is the rotational energy of the system , @xmath62 is the total mass , @xmath63 is the total angular momentum
, @xmath64 is the mean density , @xmath65 is the gravitational potential energy , and @xmath66 is the thermal energy .
the quantity @xmath67 measures how well our models are in virial equilibrium ; ideally , this ratio should have a value of 0.5 .
all of our models have values that are very close to 0.5 , especially for compressible configurations . in table
[ n0 ] , the parameters @xmath68 and @xmath69 are analytically computed results for @xmath5 and @xmath10 , respectively .
several properties of our models are worth discussing .
first , for direct configurations with a fixed value of @xmath0 , as one proceeds from larger values of @xmath1 to smaller values , @xmath10 starts from a positive value , then continuously decreases ; it reaches zero when the rigidly rotating jacobi sequence is hit , and then becomes negative after passing the jacobi sequence .
the parameter @xmath45 also switches sign when crossing the jacobi / dedekind sequences . for adjoint configurations ,
a similar behavior is observed for @xmath5 , while @xmath45 approaches @xmath70 around the dedekind sequence because @xmath71 .
second , in the parameter space above the jacobi / dedekind sequence where @xmath72 , @xmath5 is positive for direct configurations , and negative for adjoint configurations , which reflects the fact that the jacobi mode in maclaurin spheroids is the `` forward moving '' wave but the dedekind mode is the `` backward moving '' wave .
this also implies that in the adjoint configurations with @xmath72 , the ellipsoidal pattern is moving in a direction that is opposite to the overall rotation !
furthermore , when the critical jacobi / dedekind sequence is passed , @xmath45 switches sign ; so does @xmath10 in direct configurations and @xmath5 in adjoint configurations . in maclaurin spheroids ,
this is where the frequency of the backward moving wave becomes positive in the inertial frame ; hence , it is where the secular bar - mode instability sets in through gravitational radiation ( chandrasekhar - friedman - schutz instability ) or viscosity @xcite .
finally , for softer equations of state , the scf technique failed to converge to models with relatively small values of @xmath1 because , in these cases , the centrifugal force at the boundary point a ( see figure [ boundary ] ) would exceed the gravitational force .
in fact , for @xmath73 and @xmath59 , even the jacobi sequence is not reached .
this is consistent with previous studies that have indicated that the jacobi sequence can not exist for @xmath74 @xcite .
furthermore , as was pointed out by @xcite in their analysis of uniformly rotating polytropes , the mass - shedding limit never extends much beyond the bifurcation point ( where the jacobi / dedekind sequence branches off the maclaurin spheriod sequence ) even for very small @xmath75 : for @xmath76 , this mass - shedding limit corresponds to @xmath77 .
our @xmath78 models are consistent with their results .
therefore , the available parameter space for compressible counterparts of riemann ellipsoids becomes smaller as the equation of state becomes softer .
figures [ direct05 ] and [ adjoint05 ] show equatorial - plane iso - density contours and velocity fields for direct and adjoint configurations of our @xmath57 model with @xmath79 and @xmath80 .
both the rotating frame velocity field @xmath11 and inertial frame velocity field @xmath81 are plotted for comparison .
the flow patterns in these two models are different from each other although they have identical geometrical shapes .
it is also clear that the fluid motion in the adjoint configuration is dominated by internal motion rather than rotation . as another illustration ,
figures [ direct ] and [ adjoint ] illustrate the structure of our @xmath73 model with @xmath79 and @xmath82 .
notice that @xmath5 , which is also the pattern speed of the ellipsoid , is negative in both fig .
[ adjoint05 ] and fig .
[ adjoint ] , so the ellipsoidal figures in both plots are spinning retrograde ( clockwise ) relative to the overall fluid rotation .
comparisons between previous published results and our models yield very good agreement .
for example , from table iv in chapter 6 of @xcite , a jacobi ellipsoid with @xmath83 and @xmath0=0.60 , @xmath84 , has @xmath85 and @xmath86 , where @xmath87 . the closest match among our models shown in table [ n0 ] , with @xmath79 , @xmath88 , has @xmath89 , @xmath90 , and an almost vanishing @xmath91 , which shows that this model from our table is very close to the jacobi sequence .
it should be noticed that , due to the discrete nature of our grid , we can not construct models with axis ratios that will place the models precisely on the jacobi / dedekind sequence , but we can construct models that are very close to this sequence ( with very small values of @xmath10 or @xmath5 ) . as another comparison ,
the last four columns in table [ n0 ] give analytically computed results of @xmath92 and @xmath93 for riemann s - type ellipsoids having the specified axes ratios @xmath0 and @xmath1 , as well as the ratio between numerical and analytical results ( only models with @xmath94 have been computed ) . to obtain these analytical results
, we used standard incomplete elliptic integrals to evaluate the potential field of a homogeneous ellipsoid ( * ? ? ?
* see their table 2 - 2 ) . in virtually all cases ,
the error in @xmath5 is @xmath95 a few percent . on the other hand , for the direct configurations the fractional error in @xmath10
can be as large as 50% ; the error is largest for models whose @xmath10 almost vanishes .
this is understandable because a small variation in the magnitude of @xmath10 will result in a large percentage difference when @xmath10 is approaching zero .
also some mismatch between numerical and analytical results may arise because the discrete nature of our grids makes it difficult for us to define an exact axis ratio for our models .    for compressible equations of state
, we can compare our results with those presented by @xcite , who used an energy variational method to determine approximate equilibrium configurations for ellipsoidal self - gravitating systems .
@xcite assumed that the iso - density contours of each configuration are self - similar concentric ellipses , which as we have already emphasized is not the case . in their table 4 , for compressible analogues of jacobi ellipsoids , a configuration with @xmath96 and @xmath97 has @xmath98 ; the closest match among our @xmath57 models ( see table [ n05 ] ) with @xmath99 and @xmath100 has @xmath101 .
other quantities also match well , after a proper normalization is applied as prescribed by their equation ( 3.27 ) .
we omit more comparisons here and leave the rest to interested readers .
other models that are of interest are the @xmath102 irrotational sequence @xcite .
it turns out that the @xmath45 parameter is very sensitive to the axis ratios , so we could not build models that are very close to the irrotational sequence due to the discrete nature of our computational grids . our model that comes closest has @xmath103 ; it is a direct configuration with @xmath57 and its other parameters are listed in table [ n05 ] .
we have presented a new method to construct 3d models for riemann s - type ellipsoids ( @xmath47 ) , and the method has been extended to construct compressible counterparts that share the same velocity field as that of riemann s - type ellipsoids . with this method
, we have been able to build 3d models that cover almost the entire parameter space of riemann s - type ellipsoids .
our results are in good agreement with previous studies .
we expect that this method can also be straightforwardly extended to the construction of roche - riemann ellipsoids .    by design ,
our compressible models satisfy the steady - state euler s equation .
however , it is not guaranteed that they simultaneously satisfy the steady - state continuity equation exactly , because this additional constraint was not built into our method . because the adopted velocity flow - field @xmath11 in our models is divergence - free
, the violations of the steady - state continuity equation will only arise to the extent that the iso - density contours deviate from concentric ellipses . as we can see from figures [ direct05 ] - [ adjoint ] ,
the outer low - density shell in compressible models becomes somewhat pointed along the major axis .
however , the deviation from concentric ellipses is small and almost negligible in the inner , high - density regions .
furthermore , a comparison between fig .
[ direct05 ] and fig .
[ direct ] shows that this deviation becomes smaller in less compressible models . in order to quantitatively
measure the violation of the steady - state continuity equation , we calculated @xmath104 for the models shown in figs [ direct05 ] , [ adjoint05 ] , and [ direct ] .
as long as @xmath105 for a given configuration , we can consider that the model has a reasonablly good quasi - equilibrium structure . in figure [ divrhov ]
, we have plotted @xmath106 in the equatorial plane as a function of cylindrical radius @xmath50 along different azimuthal angles , @xmath107 and @xmath108 . in fact , this quantity remains small ( @xmath109 for @xmath57 and @xmath110 for @xmath58 ) throughout the majority of the configuration , but not surprisingly near the surface it asymptotically approaches infinity because @xmath111 goes to zero . as the figure illustrates , @xmath106 is smaller for the stiffer equation of state .
we also note that @xmath106 is nearly zero along the x and y axes because the velocity vectors in the rotating frame along the x ( y ) axis only have a nonzero y ( x ) component and are therefore perpendicular to the density gradient there .
thus , we expect our compressible models to represent fairly good quasi - equilibrium configurations , especially in nearly incompressible cases .
on the other hand , this point was brought to our attention by an anonymous referee : the relatively large violation of the steady - state continuity equation on the very surface layer can potentially change the shape of the surface in hydrodynamical evolutions . to understand how the shape of the surface might be changed by the flow field ,
it is important to know the sign of @xmath112 along the surface .
since we are adopting a divergence free velocity field , the sign of @xmath112 is determined by the sign of @xmath113 , which also measures to what degree the velocity vectors are orthogonal to density gradient .
if the velocity vector points slightly outward ( inward ) from the surface , @xmath113 will be negative ( positive ) , because the density gradient is negative outward .
[ divrhov2 ] and [ divrhov3 ] show contour maps of @xmath112 in the equatorial planes of the direct and adjoint models shown in figs .
[ direct05 ] and [ adjoint05 ] , respectively .
( we note that the contour pattern for direct configurations will switch from fig .
[ divrhov2 ] to fig .
[ divrhov3 ] if @xmath10 flips sign . )
a @xmath114 symmetry is observed for both patterns .
we also note that , in each quadrant , @xmath112 flips sign , which implies that the direction of velocity vectors will change from inward ( outward ) to outward ( inward ) from the surface within one single quadrant .
accordingly , fig . [ shape ] shows a combined schematic drawing of how the velocity vectors in the rotating frames are aligned with the surface for these two patterns ( the panel on the left is for the adjoint figure shown in fig .
[ adjoint05 ] , the panel on the right is for the direct figure shown in fig . [ direct05 ] ) . in this figure
, the black ellipse denotes the actual surface ( which should not be a perfect ellipse ) , red arrows denote velocity vectors on the surface , purple arrows denote density gradient vectors , which are drawn pointing inward because of their negative sign . for direct configurations ,
in which the figure rotation is larger than the internal motion , these mismatches ( nonvanishing @xmath113 ) on top of a large rotation are likely to generate spiral arms ; whereas , for adjoint configurations , the internal motion is larger than figure rotation , so these mismatches tend to generate waves along the surface .    using the 3d hydrodynamics code developed by the lsu group @xcite , we have carried out nonlinear 3d hydrodynamical evolutions for a subset of the nearly incompressible models discussed here in table [ n05 ] . despite the fact that the models do not fully satisfy the steady - state continuity equation , they are in very good force - balance initially and , as predicted by the above discussion , the models are fairly long - lived , holding their initial ellipsoidal shapes over the time that is followed by our simulations ( @xmath115 15 - 20 dynamical times ) .
we also observed the formation of narrow spiral arms ( low amplitude surface waves ) containing low density materials in direct ( adjoint ) configurations .
the results of these hydrodynamical evolutions will be presented in a separate paper in the context of our ongoing study of the stability of riemann s - type ellipsoids . since our ellipsoidal models are fairly long - lived and have exactly the same elliptical flow field as riemann s - type ellipsoids , they should provide good initial states for a nonlinear , hydrodynamical study of dynamical instabilities in riemann s - type ellipsoids .
we especially have in mind the elliptical strain instability that is associated with elliptical stream lines , which should set in on a dynamical time scale .
through such a study , we hope to provide insight into the stability of ellipsoidal configurations that will complement the work of @xcite .
this should also help answer whether the evolutionary path of a grr - driven star toward the dedekind sequence is viable .
i would like to thank joel tohline for valuable suggestions , discussions and carefully reading through this paper .
i also thank juhan frank and patrick motl for helpful comments .
it is a pleasure to thank norman lebovitz for drawing our attention to the particular analytical expression of the velocity field of riemann s - type ellipsoids used in this study .
i would also thank howard cohl for developing the poisson solver that was an important ingredient in this work .
i thank the anonymous referee for insightful suggestions to analysis our models .
this work was partially supported by nsf grants ast-0407070 and phy-0326311 , and by the center for computation & technology at lsu .
binney , j. , & tremaine , s. , 1987 , galactic dynamics , new york : academic press cazes , j. e. , & tohline , j. e. 2000 , , 532 , 1051 chandrasekhar , s. 1969 , equilibrium figures of equilibrium , new haven , ct : yale univ . press    cohl , h. s. , & tohline , j. e. 1999 , , 527 , 86 friedman , j. , & schutz , b. f. 1978 , , 222 , 281 hachisu , i. 1986 , , 61 , 479 hachisu , i. 1986 , , 62 , 461 hachisu , i. , eriguchi , y. , 1982 , prog .
theor.phys . , 68 , 206 hachisu , i. , eriguchi , y. , 1984 , , 36 , 239 james , r. a. , 1964 , , 140 , 552      lebovitz , n. r. , & lifschitz , a. 1996 , , 458 , 699 lebovitz , n. r. , & saldanha , k. i. 1999 , physics of fluids , 11 , 3374 lifschitz , a. , & lebovitz , n. 1993 , , 408 , 603 motl , p. m. , tohline , j. e. , & frank , j. 2002 , , 138 , 121                    0.90 & 0.923 & 1.030 & 0.7550 & 6.6e-3 & 0.03183 & 0.8232 & -0.6989 & 0.4989 & -1.5 & & + 0.90 & 0.795 & 1.144 & 0.4310 & 0.046 & 0.07018 & 0.7086 & -0.5429 & 0.4992 & -0.76 & 1.14704 & 0.997 & 0.43181 & 0.998 + 0.90 & 0.641 & 1.119 & 0.1394 & 0.101 & 0.07764 & 0.5720 & -0.3759 & 0.4988 & -0.25 & 1.13137 & 0.989&0.15077 & 0.925 + 0.90 & 0.590 & 1.099 & 0.0569 & 0.122 & 0.07589 & 0.5261 & -0.3249 & 0.4987 & -0.10 & 1.10661 & 0.993 & 0.06406 & 0.888 + 0.90 & 0.564 & 1.090 & 0.0210 & 0.132 & 0.07452 & 0.5033 & -0.3007 & 0.4989 & -0.04 & 1.09034 & 0.999&0.02033&1.033 + 0.90 & 0.538 & 1.069 & -0.0250 & 0.144 & 0.07268 & 0.4801 & -0.2768 & 0.4991 & 0.05 & 1.07148 & 0.998&-0.02324 & 1.075 + 0.90 & 0.487 & 1.015 & -0.1205 & 0.167 & 0.06814 & 0.4341 & -0.2316 & 0.4992 & 0.24 & 1.02639&0.989 & -0.10880 & 1.108 + 0.90 & 0.333 & 0.797 & -0.3885 & 0.246 & 0.04860 & 0.2970 & -0.1167 & 0.4983 & 0.98 & 0.79257 & 1.006&-0.39224&0.990 + 0.74 & 0.769 & 1.099 & 0.5604 & 0.030 & 0.03807 & 0.5682 & -0.3744 & 0.4982 & -1.1 & & + 0.74 & 0.692 & 1.133 & 0.3840 & 0.058 & 0.04678 & 0.5116 & -0.3134 & 0.4986 & -0.71 & 1.13215 & 1.001&0.38599&0.995 + 0.74 & 0.538 & 1.094 & 0.0774 & 0.121 & 0.04836 & 0.3982 & -0.2034 & 0.4990 & -0.15 & 1.09508 & 0.999&0.08149 & 0.950 + 0.74 & 0.513 & 1.078 & 0.0303 & 0.133 & 0.04734 & 0.3791 & -0.1857 & 0.4991 & -0.06 & 1.07883 & 0.999&0.03474&0.872 + 0.74 & 0.487 & 1.054 & -0.0208 & 0.145 & 0.04594 & 0.3560 & -0.1700 & 0.4988 & 0.04 & 1.05883 & 0.995 & -0.01363 & 1.526 + 0.74 & 0.436 & 1.003 & -0.1184 & 0.171 & 0.04284 & 0.3223 & -0.1400 & 0.4987 & 0.25 & 1.00963 & 0.993&-0.10852 & 1.091 + 0.74 & 0.333 & 0.847 & -0.3230 & 0.228 & 0.03389 & 0.2463 & -0.0863 & 0.4983 & 0.80 & 0.85686 & 0.988&-0.31006&1.042 + 0.74 & 0.282 & 0.715 & -0.4523 & 0.259 & 0.02842 & 0.2081 & -0.0634 & 0.4968 & 1.3 & 0.72756 & 0.983&-0.43781 & 1.033 +    0.59 & 0.718 & 0.948 & 0.7677 & 0.014 & 0.01197 & 0.4208 & -0.2243 & 0.4924 & -1.9 & & + 0.59 & 0.538 & 1.087 & 0.2338 & 0.093 & 0.02876 & 0.3157 & -0.1374 & 0.4982 & -0.49 & 1.08732 & 0.999 & 0.23529 & 0.994 + 0.59 & 0.436 & 1.029 & 0.0108 & 0.145 & 0.02691 & 0.2554 & -0.0949 & 0.4985 & -0.02 & 1.03198&0.997 & 0.01472&0.734 + 0.59 & 0.410 & 1.008 & -0.0417 & 0.159 & 0.02592 & 0.2404 & -0.0853 & 0.4991 & 0.09 & 1.00774&1.000&-0.04012&1.039 + 0.59 & 0.359 & 0.943 & -0.1534 & 0.188 & 0.02342 & 0.2104 & -0.0673 & 0.4989 & 0.37 & 0.94638 & 0.996 & -0.14830&1.034 + 0.59 & 0.231 & 0.584 & -0.5426 & 0.267 & 0.01475 & 0.1351 & -0.0300 & 0.4910 & 2.1 & 0.60698 & 0.962&-0.51563&1.013 +    0.41 & 0.385 & 0.971 & 0.1369 & 0.132 & 0.01220 & 0.1563 & -0.0407 & 0.4978 & -0.40 & 0.97108 & 1.000&0.14159&0.967 + 0.41 & 0.333 & 0.930 & 0.0016 & 0.165 & 0.01112 & 0.1347 & -0.0313 & 0.4998 & -0.005 & 0.92963 & 1.000 & 0.00331&0.483 + 0.41 & 0.308 & 0.900 & -0.0685 & 0.183 & 0.01061 & 0.1254 & -0.0275 & 0.4991 & 0.22 & 0.89982&1.000 & -0.06224&1.101 + 0.41 & 0.256 & 0.808 & -0.2074 & 0.217 & 0.00896 & 0.1046 & -0.0199 & 0.4937 & 0.73 & 0.81275&0.994 & -0.20138&1.030 + 0.28 & 0.256 & 0.809 & 0.0246 & 0.183 & 0.00472 & 0.0717 & -0.0103 & 0.4982&-0.12 & 0.80944&0.999 & 0.03668&0.671 + 0.28 & 0.231 & 0.780 & -0.0572 & 0.204 & 0.00431 & 0.0646 & -0.0086 & 0.4988&0.28 & 0.77651&1.004&-0.04714&1.213 + 0.28 & 0.205 & 0.726 & -0.1505 & 0.224 & 0.00382 & 0.0575 & -0.0069 & 0.4967&0.80 & 0.72853&0.996&-0.13511&1.114 +      0.90 & 0.795 & 0.970 & 0.3660 & 0.045 & 0.0258 & 0.3812 & 0.5398 & -0.1751 & 0.5000 & -0.76 + 0.90 & 0.744 & 0.975 & 0.2831 & 0.061 & 0.0273 & 0.3541 & 0.5371 & -0.1544 & 0.5000 & -0.58 + 0.90 & 0.692 & 0.970 & 0.2050 & 0.079 & 0.0276 & 0.3266 & 0.5344 & -0.1344 & 0.5001&-0.43 + 0.90 & 0.641 & 0.958 & 0.1312 & 0.097 & 0.0227 & 0.2987 & 0.5309 & -0.1150 & 0.5001 & -0.28 + 0.90 & 0.590 & 0.940 & 0.0617 & 0.117 & 0.0256 & 0.2695 & 0.5263 & -0.0964 & 0.5001 & -0.13 + 0.90 & 0.564 & 0.929 & 0.0287 & 0.127 & 0.0246 & 0.2546 & 0.5240 & -0.0873 & 0.5001 & -0.06 + * 0.90 & 0.538 & 0.920 & 0.0001 & 0.137 & 0.0233 & 0.2391 & 0.5198 & -0.0783 & 0.5001 & -0.0002 + 0.90 & 0.513 & 0.908 & -0.0281 & 0.147 & 0.0218 & 0.2234 & 0.5169 & -0.0695 & 0.5001 & 0.06 + 0.90 & 0.487 & 0.898 & -0.0513 & 0.157 & 0.0201 & 0.2066 & 0.5115 & -0.0607 & 0.5001 & 0.12 + 0.74 & 0.692 & 0.958 & 0.3232 & 0.055 & 0.0166 & 0.2719 & 0.5380 & -0.0991 & 0.4997 & -0.71 + 0.74 & 0.641 & 0.959 & 0.2343 & 0.074 & 0.0171 & 0.2489 & 0.5345 & -0.0852 & 0.4999 & -0.51 + 0.74 & 0.590 & 0.949 & 0.1514 & 0.094 & 0.0167 & 0.2252 & 0.5314 & -0.0717 & 0.5001 & -0.33 + 0.74 & 0.538 & 0.932 & 0.0750 & 0.114 & 0.0156 & 0.2005 & 0.5263 & -0.0587 & 0.5001&-0.17 + * 0.74 & 0.487 & 0.911 & 0.0081 & 0.135 & 0.0137 & 0.1737 & 0.5192 & -0.0458 & 0.5002 & -0.02 + 0.74 & 0.462 & 0.904 & -0.0171 & 0.144 & 0.0123 & 0.1588 & 0.5156 & -0.0393 & 0.5002 & 0.04 + 0.59 & 0.718 & 0.792 & 0.6631 & 0.012 & 0.0037 & 0.2241 & 0.5418 & -0.0713 & 0.4943 & -1.9 + 0.59 & 0.538 & 0.922 & 0.2021 & 0.085 & 0.0090 & 0.1587 & 0.5304 & -0.0397 & 0.4997 & -0.50 + 0.59 & 0.487 & 0.911 & 0.1137 & 0.105 & 0.0081 & 0.1373 & 0.5256 & -0.0313 & 0.5001 & -0.29 + 0.59 & 0.462 & 0.905 & 0.0754 & 0.114 & 0.0073 & 0.1250 & 0.5230 & -0.0265 & 0.5002 & -0.19 + 0.59 & 0.436 & 0.871 & -0.0337 & 0.153 & 0.0105 & 0.1382 & 0.5453 & -0.0031 & 0.5088 & 0.09 +      0.90 & 0.795 & 0.803 & 0.3029 & 0.039 & 0.00893 & 0.2053 & 0.2921 & -0.0577 & 0.5001 & -0.76 + 0.90 & 0.744 & 0.804 & 0.2329 & 0.053 & 0.00910 & 0.1870 & 0.2867 & -0.0492 & 0.5001 & -0.58 + 0.90 & 0.692 & 0.796 & 0.1684 & 0.067 & 0.00872 & 0.1679 & 0.2799 & -0.0409 & 0.5002 & -0.43 + 0.90 & 0.641 & 0.782 & 0.1090 & 0.081 & 0.00788 & 0.1476 & 0.2711 & -0.0328 & 0.5002 & -0.28 + 0.90 & 0.590 & 0.760 & 0.0555 & 0.093 & 0.00657 & 0.1255 & 0.2611 & -0.0249 & 0.5002 & -0.14 + 0.90 & 0.564 & 0.747 & 0.0314 & 0.097 & 0.00572 & 0.1134 & 0.2563 & -0.0210 & 0.5002 & -0.08 + 0.74 & 0.641 & 0.784 & 0.1917 & 0.060 & 0.00513 & 0.1262 & 0.2805 & -0.0254 & 0.5003 & -0.51 + 0.74 & 0.590 & 0.769 & 0.1241 & 0.074 & 0.00450 & 0.1087 & 0.2731 & -0.0197 & 0.5003 & -0.34 + 0.74 & 0.538 & 0.743 & 0.0626 & 0.084 & 0.00349 & 0.0893 & 0.2680 & -0.0143 & 0.5003 & -0.18 + 0.74 & 0.512 & 0.722 & 0.0322 & 0.086 & 0.00289 & 0.0786 & 0.2676 & -0.0115 & 0.5003 & -0.09 + 0.59 & 0.590 & 0.748 & 0.244 & 0.046 & 0.00237 & 0.0870 & 0.2836 & -0.0136 & 0.5007 & -0.75 + 0.59 & 0.564 & 0.743 & 0.2011 & 0.052 & 0.00220 & 0.0797 & 0.2817 & -0.0118 & 0.5009 & -0.62 +      0.90 & 0.795 & 0.631 & 0.2351 & 0.030 & 0.00273 & 0.1068 & 0.1531 & -0.0181 & 0.5002&-0.75 + 0.90 & 0.744 & 0.622 & 0.1752 & 0.040 & 0.00260 & 0.0945 & 0.1467 & -0.0147 & 0.5003&-0.57 + 0.90 & 0.692 & 0.604 & 0.1187 & 0.048 & 0.00229 & 0.0817 & 0.1397 & -0.0115 & 0.5003&-0.40 + 0.90 & 0.641 & 0.574 & 0.0640 & 0.055 & 0.00183 & 0.0683 & 0.1324 & -0.0085 & 0.5003&-0.22 + 0.90 & 0.615 & 0.554 & 0.0365 & 0.057 & 0.00157 & 0.0614 & 0.1292 & -0.00711 & 0.5003&-0.13 + 0.74 & 0.692 & 0.609 & 0.2024 & 0.033 & 0.00148 & 0.0717 & 0.1491 & -0.00931 & 0.5006&-0.70 + 0.74 & 0.641 & 0.592 & 0.1378 & 0.041 & 0.00130 & 0.0612 & 0.1430 & -0.00713 & 0.5005&-0.49 + 0.64 & 0.670 & 0.587 & 0.2503 & 0.023 & 0.00086 & 0.0586 & 0.1524 & -0.00666 & 0.5014&-0.94 + 0.64 & 0.640 & 0.584 & 0.2116 & 0.027 & 0.00084 & 0.0542 & 0.1499 & -0.00584 & 0.5013&-0.80 +      0.90 & 0.923 & -0.755 & -1.030 & 0.0064 & 0.0307 & 0.8232 & 0.99999 & -0.6989 & 0.4987 & -2.744 + 0.90 & 0.641 & -0.139 & -1.119 & 0.100 & 0.0770 & 0.572 & 0.99999 & -0.3758 & 0.4980 & -16.1 + 0.90 & 0.590 & -0.0569 & -1.099 & 0.121 & 0.0754 & 0.5261 & 0.99999 & -0.3249 & 0.4979 & -38.8 + 0.90 & 0.564 & -0.0211 & -1.090 & 0.132 & 0.0741 & 0.5033 & 0.99999 & -0.3007 & 0.4981 & -104.2 + 0.90 & 0.538 & 0.0250 & -1.069 & 0.143 & 0.0723 & 0.4801 & 0.99999 & -0.2768 & 0.4982 & 86.0 + 0.90 & 0.487 & 0.121 & -1.015 & 0.166 & 0.0678 & 0.4342 & 0.99999 & -0.2314 & 0.4983 & 16.9 + 0.90 & 0.436 & 0.219 & -0.945 & 0.191 & 0.0623 & 0.3886 & 0.99999 & -0.1900 & 0.4979 & 8.689 + 0.90 & 0.333 & 0.389 & -0.797 & 0.246 & 0.0485 & 0.2970 & 0.99999 & -0.1167 & 0.4978 & 4.128 + 0.74 & 0.744 & -0.495 & -1.117 & 0.035 & 0.0376 & 0.5496 & 0.99999 & -0.3540 & 0.4943 & -4.7 + 0.74 & 0.590 & -0.171 & -1.116 & 0.093 & 0.0465 & 0.4357 & 0.99999 & -0.2377 & 0.4933 & -13.6 + 0.74 & 0.513 & -0.030 & -1.078 & 0.127 & 0.0452 & 0.3791 & 0.99999 & -0.1866 & 0.4932 & -74.3 + 0.74 & 0.487 & 0.021 & -1.054 & 0.139 & 0.0440 & 0.3595 & 0.99999 & -0.1699 & 0.4928 & 106.8 + 0.74 & 0.436 & 0.118 & -1.002 & 0.165 & 0.0414 & 0.3223 & 0.99999 & -0.1400 & 0.4929 & 17.7 + 0.74 & 0.385 & 0.210 & -0.944 & 0.193 & 0.0376 & 0.2841 & 0.99999 & -0.1117 & 0.4934 & 9.4 + 0.74 & 0.333 & 0.323 & -0.847 & 0.223 & 0.0332 & 0.2463 & 0.99999 & -0.0863 & 0.4940 & 5.5 + 0.74 & 0.282 & 0.453 & -0.714 & 0.257 & 0.0281 & 0.2081 & 0.99999 & -0.0634 & 0.4944 & 3.4 + 0.59 & 0.615 & -0.417 & -1.085 & 0.045 & 0.0199 & 0.3608 & 0.99999 & -0.1729 & 0.4834 & -5.5 + 0.59 & 0.487 & -0.119 & -1.063 & 0.100 & 0.0239 & 0.2853 & 0.99999 & -0.1152 & 0.4807 & -20.4 + 0.59 & 0.436 & -0.011 & -1.029 & 0.126 & 0.0235 & 0.2553 & 0.99999 & -0.0949 & 0.4801 & -217.5 + 0.59 & 0.410 & 0.042 & -1.008 & 0.140 & 0.0229 & 0.2404 & 0.99999 & -0.0853 & 0.4807 & 55.2 + 0.59 & 0.359 & 0.153 & -0.943 & 0.170 & 0.0213 & 0.2104 & 0.99999 & -0.0672 & 0.4811 & 14.1 + 0.59 & 0.282 & 0.271 & -0.856 & 0.204 & 0.0190 & 0.1803 & 0.99999 & -0.0509 & 0.4822 & 7.2 + 0.59 & 0.231 & 0.402 & -0.729 & 0.242 & 0.0161 & 0.1502 & 0.99999 & -0.0365 & 0.4843 & 4.1 +      0.90 & 0.923 & -0.642 & -0.8766 & 0.0063 & 0.0116 & 0.4476 & 0.5442 & -0.2297 & 0.4997 & -2.7 + 0.90 & 0.590 & -0.062 & -0.9401 & 0.116 & 0.0255 & 0.2695 & 0.5263 & -0.0964 & 0.4997 & -30.7 + 0.90 & 0.538 & -1.47e-4&-0.9195 & 0.137 & 0.0232 & 0.2391 & 0.5197 & -0.0782 & 0.4999 & -12606.1 + 0.90 & 0.513 & 0.028 & -0.9080 & 0.147 & 0.0218 & 0.2234 & 0.5169 & -0.0695 & 0.5000 & 65.2 + 0.74 & 0.795 & -0.537 & -0.9101 & 0.018 & 0.0102 & 0.3167 & 0.5421 & -0.1283 & 0.4966 & -3.5 + 0.74 & 0.692 & -0.323 & -0.9584 & 0.052 & 0.0154 & 0.2719 & 0.5379 & -0.0991 & 0.4963 & -6.2 + 0.74 & 0.538 & -0.075 & -0.9317 & 0.112 & 0.0150 & 0.2005 & 0.5263 & -0.0587 & 0.4975 & -25.9 + 0.74 & 0.487 & -8.2e-3 & -0.9114 & 0.134 & 0.0133 & 0.1737 & 0.5192 & -0.0458 & 0.4992 & -233.1 + 0.74 & 0.462 & 0.0171 & -0.9044 & 0.145 & 0.0121 & 0.1587 & 0.5157 & -0.0393 & 0.5009 & 110.2 + 0.59 & 0.615 & -0.355 & -0.9180 & 0.044 & 6.93e-3 & 0.1877 & 0.5368 & -0.0529 & 0.4894 & -5.9 + 0.59 & 0.538 & -0.202 & -0.9222 & 0.076 & 7.66e-3 & 0.1587 & 0.5304 & -0.0397 & 0.4910 & -10.4 + 0.59 & 0.487 & -0.114 & -0.9111 & 0.100 & 7.21e-3 & 0.1373 & 0.5256 & -0.0310 & 0.4948 & -18.3 + 0.59 & 0.462 & -0.075 & -0.9050 & 0.113 & 6.65e-3 & 0.1250 & 0.5230 & -0.0265 & 0.4992 & -27.4 +      0.90 & 0.795 & -0.303 & -0.8030 & 0.039 & 0.00887 & 0.2053 & 0.2921 & -0.0577 & 0.5000 & -5.33 + 0.90 & 0.692 & -0.168 & -0.7963 & 0.067 & 0.00869 & 0.1679 & 0.2799 & -0.0409 & 0.5003 & -9.51 + 0.90 & 0.590 & -0.056 & -0.7605 & 0.094 & 0.00657 & 0.1255 & 0.2611 & -0.0249 & 0.5009 & -27.59 + 0.90 & 0.564 & -0.031 & -0.7469 & 0.099 & 0.00573 & 0.1134 & 0.2563 & -0.0210 & 0.5014 & -47.78 + 0.74 & 0.641 & -0.192 & -0.7842 & 0.061 & 0.00499 & 0.1262 & 0.2805 & -0.0254 & 0.5013 & -8.54 + 0.74 & 0.538 & -0.062 & -0.7429 & 0.091 & 0.00354 & 0.0893 & 0.2680 & -0.0142 & 0.5071 & -24.80 + 0.74 & 0.512 & -0.032 & -0.7220 & 0.096 & 0.00295 & 0.0786 & 0.2676 & -0.0115 & 0.5097 & -46.74 + 0.59 & 0.590 & -0.244 & -0.7480 & 0.050 & 0.00217 & 0.0870 & 0.2836 & -0.0136 & 0.5049 & -7.01 + 0.59 & 0.564 & -0.201 & -0.7433 & 0.059 & 0.00210 & 0.0797 & 0.2817 & -0.0118 & 0.5083 & -8.47 +


the field of ultracold atoms in optical lattices has been a promising new opportunity for studying many - body effects which are important for condensed - matter physics in controlled environments @xcite . in particular
, fermionic atoms such as @xmath2k may provide a direct path towards a `` quantum simulation '' of the hubbard model which itself has a paradigmatic role in condensed matter physics and is a key in understanding phenomena such as high - temperature superconductivity and strongly correlated magnetism . in these experiments ,
some novel possibilities to study physical correlations between constituents of the model are being explored .    in many cases ,
such experiments@xcite drive the systems substantially beyond thermal equilibrium , so that they are inaccessible to methods of conventional equilibrium or linear - response theory . usually , one also encounters spatially inhomogeneous situations , since the atoms in the optical lattice are being held in a trap potential which co - exists with the lattice potential . in one - dimensional systems , many opportunities to provide computational benchmarks for such experiments exist , such as via the density - matrix renormalization group @xcite . however , it is a challenging problem to describe two- and three - dimensional systems out of thermal equilibrium , especially when they are also inhomogeneous .    in this paper
we present a nonequilibrium strong - coupling approach to inhomogeneous systems of ultracold atoms in optical lattices .
the paper is structured as follows .
section [ sec : model ] discusses the hubbard model for an optical lattice in a trap . in section [ sec : formalism ] , we outline the strong - coupling approach which enables us to simulate inhomogeneous higher - dimensional hubbard systems out of equilibrium . in section [ sec : algo ] , we develop the massively parallel algorithm which is used to solve the resulting equations on a supercomputer .
section [ sec : results ] presents results of the algorithm for the example of a modulated lattice depth and validates them by comparing to the previously introduced strong - coupling method for homogeneous systems@xcite within the local - density approximation ( lda ) .
conclusions are given in section [ sec : conclusion ] .
we consider a fermi hubbard model in the presence of a trap potential , i.e. @xmath3 with @xmath4 where the on - site single - particle energy levels @xmath5 are determined by the trap potential @xmath6 and a global chemical potential @xmath7 which characterizes the initial equilibrium state at time @xmath8 . the initial state is assumed to have a temperature @xmath9 .
the time - dependent interaction @xmath10 and the time - dependent hopping @xmath11 are chosen to be results of a tight - binding calculation for maximally localized wannier functions computed from the translationally invariant case . in the future
, we plan to include corrections to the tight - binding parameters which result from generalized wannier functions for the inhomogeneous problem .
we assume the system to be in thermal equilibrium at time @xmath8 and to be driven out of equilibrium subsequently by the time - dependence of the model parameters .
we employ a second - order self - consistent expression for the self - energy @xcite around the atomic limit which is described by @xmath12 .
the self - consistency takes advantage of a resummation of diagrams which yields a better approximation .     for the simulation time .
between the dashed blue lines , the system is driven out of equilibrium by a time - dependent hamiltonian . in the numerical part of the paper
, we refer to the two points in time as @xmath8 and @xmath13 for simplicity .
the real times between the matsubara branch and the point at which the system is driven out of equilibrium can be used to check for numerical convergence , since expectation values of observables have to be constant here .
the time discretization is shown in red  in the implementation itself , the point @xmath8 is identical to the point to which the matsubara branch of the contour is attached .
the total number of time slices is @xmath14 . ]
it can be extended to an inhomogeneous system in the following way : @xmath15 here , @xmath16 is the contour - ordered on - site no - hopping green s function at site @xmath17 with spin @xmath18 ( in the paramagnetic phase , the green s function is independent of the spin @xmath18 ) .
times @xmath19 and @xmath20 are located on the kadanoff - baym - keldysh contour @xmath21 depicted in fig .
[ fig : keldysh ] .
@xmath22 is the second - order cumulant for the on - site no - hopping two - particle propagator @xmath23 at site @xmath24 . in a typical numerical implementation
, one can not store this tensor for a reasonable grid of time slices .
however , it is easy to compute it on the fly in the particle - number basis @xmath25 by inserting the time evolutions @xmath26 for each possible @xmath27 time ordering of the creation and annihilation operators .
note that it is crucial to the applicability of the approach that the expression in eq
.   does not involve any time - ordered products , because @xmath28=0 $ ] for any combination of @xmath29 .
the on - the - fly evaluation of the action of the operators in the basis can be realized by a fast multiplication with and division by tabulated @xmath30 values .
for example , when @xmath31 , @xmath32 with @xmath33 in the calculation , one requires the expressions for all possible time orderings . the relation in eq .
is solved iteratively . at a given step of this procedure ,
the self - energy at site @xmath34 is given by @xmath35 where @xmath36 the local green s function at site @xmath37 , @xmath38 is given by the @xmath37-th block - diagonal element of the lattice green s function @xmath39^{-1}(\vec r_i , t;\vec r_{i'},t ' ) , \end{split } \label{eq : glatt}\ ] ] i.e.   @xmath40 here , the hatted quantities @xmath41 , @xmath42 , and @xmath43 denote the non - interacting green s function , the hopping , and the self - energy as operators acting on both , time and space coordinates .
we comment now on the measurement of some important physical observables within our method .
spin-@xmath18 occupancy _ of site @xmath34 may be evaluated by @xmath44 from the local green s function .
the _ kinetic energy contribution of spin @xmath18 at lattice site @xmath34 _ can be deduced from the lattice green s function @xmath45 it is thus required to measure the equal - time hopping green s functions from site @xmath34 to its nearest neighbors @xmath46 .
a quantity of particular interest is the _
double occupancy @xmath47 _ as a function of time @xmath19 and lattice site @xmath34
. we can derive it from some elements of the lattice green s function and its equal - time derivative , using the following relation ( see appendix [ app : doccformula ] ) : @xmath48
in this section , we outline the massively parallel algorithm required to solve eqs .  , , and iteratively on a supercomputer .     and
@xmath49 are introduced in sec .
[ sec : algo ] and correspond to evaluating eqs .   and
( both @xmath50 ) , and eq .   ( @xmath49 ) . ]
in order to represent the contour - ordered green s function on a computer , the kadanoff - baym - keldysh contour is discretized to @xmath51 time slices , as shown in fig .  [
fig : keldysh ] . in the implementation used here , we chose @xmath14 , where @xmath52 . here , @xmath53 is the number of time steps on each real branch of the kadanoff - baym - keldysh contour and @xmath54 the number of time steps on the imaginary time axis .
furthermore , the system consists of a finite number @xmath55 of lattice sites . assuming that spatial symmetries such as reflection and rotation symmetries are given for not only the hamiltonian but also the quantum - statistical states
, we can reduce the actual number of lattice sites @xmath55 within the algorithm by symmetry maps to the number @xmath56 which is the number of sites in the irreducible wedge of the lattice .
many sites can then be represented by the equivalence class with respect to the symmetry .
note that the full number of lattice sites still plays a role in computational complexity when the propagation of excitations is considered .
since dyson s equation performs an infinite resummation of such processes , it is relevant for the calculation of the green s function .
appendix [ app : symmetries ] describes the exploitation of symmetries in more detail .
computationally , the self - consistency condition in eq .
is solved iteratively using an alternating sequence of self - energy and green s function evaluations .
the self - energy evaluations are performed via eqs .   and and
will be described in detail in sec .
[ subsec : selfenergyeval ] .
the green s functions required for self - consistency and measurements of observables are evaluated via eq .   which will be described in sec .
[ subsec : greensfunctionevaluation ] .    due to the structure of eq .
, the computation of @xmath57 at lattice site @xmath34 requires only the green s functions of neighboring lattice sites .
however , the second step , i.e. the dyson s equation evaluation in eq .   of the lattice green
s requires self - energy information from all lattice sites . from a computational perspective , these demands are quite different in terms of optimal memory arrangement and distribution of tasks over a large set of compute nodes . as a consequence ,
we define two different configurations of the simulation .        the green s function evaluation in eq .
is performed in what we call the @xmath49 configuration of the simulation .
the self - energy computation is done in the @xmath50 configuration .
[ fig : algorithm ] shows a schematic flowchart for the computation .
the two different global machine states are sketched in fig .
[ fig : processorgroups ] .
all processors are thought to be arranged along the direction of the abscissa in fig .
[ fig : processorgroups ] .
each configuration defines groups of processors which share tasks , we call them self - energy units @xmath58 and green s function units @xmath59 . the self - energy unit @xmath58 evaluates self - energies for the @xmath34-th range of representative sites .
the green s function units evaluate relevant information for the @xmath34-th range of symmetry - representative site indices for blocked rows of the lattice green s function .
there is an optimal value for the size of the units which is usually different for @xmath58 and @xmath59 .
the determining factors for the optimal size will be elaborated below .      by a given self - energy unit @xmath58 , the self - energy @xmath60 is computed for a certain range of ( representatives of ) sites
@xmath61 for all @xmath29 using eqs .   and .
the expressions involve an on - the - fly evaluation of the cumulant @xmath62 using the tabulated values of eq .  , as well as local green s functions which do not require any permanent storage on @xmath58 .
memory - wise , the unit is required to have access to the local green s functions of neighboring sites , as well as to the value of the self - energy from the previous iteration .
the latter is necessary , because in our implementation , eq .
is regularized as follows : @xmath63 where @xmath64 is a linear mixing parameter which stabilizes the convergence by averaging between the current and the previous iteration .
convergence is reached once @xmath65 where @xmath66 is the frobenius norm of the self - energy matrix with @xmath67 entries on the block diagonal , and @xmath68 is element - wise maximum norm of the matrix .
a reasonable value for the accuracy of the self - consistency condition is @xmath69 where @xmath70 is some typical value of the interaction strength ( which often serves as the energy unit ) .
convergence is usually reached after approximately ten iterations .    in all relevant cases
we have encountered so far , the self - energy evaluation step is computationally more costly than the green s function evaluation , if the latter has been optimized appropriately .
this is due to the fact , that the contraction of cumulant indices in eq .
scales with the fourth power of @xmath51 .
the evaluation of the cumulant contraction is however massively parallelizable , i.e. no significant communication even within the @xmath58 is required during the computation .
thus , the size of the cumulant units can be chosen rather freely regarding the aspect of communication between cpus within the unit .
a small size is preferable , due to the typically small memory consumption . for convenience ,
when switching between configurations @xmath50 and @xmath49 , the self - energies just remain within the compute nodes of the respective processors of the self - energy units .
however , it is better to ensure that each self - energy unit deals with more than one lattice site , because we encounter the situation that the time to evaluate the self - energy varies substantially from lattice site to lattice site .
if the site indices are assigned randomly , this effect averages out for a sufficient number of sites . as a rule of thumb
, it is reasonable to assign self - energies for sixteen random lattice sites to each @xmath58 .
let us have a closer look at the dyson s equation in eq .  .
it contains a block - diagonal part @xmath71 and a sparse off - diagonal part given by the hopping matrix @xmath42 .
the latter is composed of a contour-@xmath72-function in time and a tight - binding structure in real space . in particular
, @xmath42 is a small quantity , due to the very nature of the strong - coupling expansion .
this fact is exploited algorithmically .
it is insightful to change notation in eq .  .
we can write the lattice green s function in a dirac type notation , as a matrix element @xmath73 where @xmath74 is an orthonormal basis associated with space and time variables .
each @xmath59 computes @xmath75 at the sites @xmath76 assigned to it for all @xmath77 and stores the local and hopping green s functions as required .
determining the lattice green s function corresponds to solving @xmath78 linear equations in @xmath78 variables .
that is , the @xmath79 matrix elements of the green s function are determined by solving such linear equations @xmath80 times . typically , in our application
, @xmath51 is at least 512 or 1024 and @xmath55 is around 10000 .
note that since the simulation discretizes the points on the kadanoff - baym - keldysh contour with @xmath51 time slices , there is a finite size of time slices @xmath81 .
the effect of a finite @xmath81 usually affects the accuracy of the calculations , and thus we perform a quadratic extrapolation of the simulation results from three finite values of @xmath81 to @xmath82 .
cross - checks with linear extrapolations show the quadratic extrapolation is superior in most instances .
the matrix to be inverted in eq .
, @xmath83 , is typically around @xmath84 dimensional .
its block structure can be written as @xmath85 where each block represents an @xmath86 matrix and @xmath87 as given in eq .  .
each row and each column in eq .
contains at most 4 hopping matrices @xmath88 to the nearest neighbors @xmath89 , @xmath90 ( in two dimensions ) .
the hopping matrices @xmath88 are essentially diagonal matrices whose diagonal elements are the time - dependent hopping amplitudes . the matrix in eq .
is extremely sparse , while its inverse @xmath91 is dense .
however , due to the small numerical value of the hopping in the strong - coupling expansion , matrix elements of @xmath91 fall off as a function of spatial distance and eventually become irrelevant ; in other words , the lattice green s function is typically block diagonal dominant .
this fact can be exploited in a numerically controlled way by utilizing an iterative procedure .
we choose the generalized minimal residue ( gmres ) method as a solver @xcite .
the gmres method considers an equation system @xmath92 as well as an `` almost '' correct solution @xmath93 where @xmath94 is the so - called _
preconditioner_. @xmath94 is an arbitrary operator whose action on @xmath95 is cheap to compute but is a good approximation to @xmath96 . in our case ,
due to the small numerical value of the hopping , a natural choice for the preconditioner is the inverse block diagonal matrix @xmath97 where @xmath98 as defined earlier in eqs .   and .
further details of the gmres method as applied to the dyson s equation in the inhomogeneous strong - coupling expansion are discussed in appendix [ app : gmres ] .
we distribute the task of applying gmres to each unit vector @xmath99 of the vector space @xmath100 within the set of green s function units @xmath101 .
each green s function unit must store all blocks of the block diagonal @xmath102 .
memory allocated to each cpu within a unit thus defines a lower bound to the size of a green s function unit through this requirement in the following way : @xmath103 assuming a double precision representation of complex numbers . if one also decides to store the preconditioner , this value doubles .     of the block - diagonal matrix @xmath102 within each unit @xmath59 ( darkly shaded area ) .
if symmetries apply , only the blocks associated with representatives of lattice sites need to be stored , and @xmath55 is then taken as @xmath56 . ]
we store the blocks of @xmath102 as depicted in fig .
[ fig : storageb ] .
practically , within each @xmath59 , an efficient application of @xmath102 and @xmath104 to a given vector @xmath105 has to be achieved .
the performance of these operations crucially relies on the small size of @xmath59 and on a good load - balancing within @xmath59 .
the former is due to an increased number of communication events through relatively slow connections between cpus and also due to its role in the latter . in order to avoid an unnecessarily large number of cpus in @xmath59 , a minimization of memory consumption
plays a key role .
we construct the representation of @xmath102 within a green s function unit by distributing respective self - energies to the cpus dealing with specific parts of @xmath102 .
a practical example is shown in table [ tab : para ] .
.table of typical parallelization parameters on a cray xe6 ( 2 gb memory per cpu ) for the application presented in sec .
[ subsec : numresults ] .
the number @xmath106 denotes the block size in the parallel gmres implementation . [ cols="^,^,^,^,^",options="header " , ]     a further important optimization when applying gmres takes advantage of both cache optimizations in basic linear algebra subprograms ( blas)@xcite level 3 routines and a reduction of network latency effects  rather than letting @xmath59 apply gmres individually to each unit vector @xmath99 of its concern serially , we choose a parallel implementation .
it applies the algorithm to blocks rather than vectors .
thus , highly optimized blas level 3 rather than multiple calls of blas level 2 are used .
in addition , less communication processes between cpus occur .
more specifically , we can write this blockwise procedure as solving the blocked equation system @xmath107 where @xmath108 with appropriately defined unit vectors @xmath99 which belong to a single lattice site in the notation introduced above with eq .
. the blocks @xmath109 are the respective blocks of @xmath110 .
typical block sizes are listed in table [ tab : para ] .    in the gmres procedure , this definition of blocked equations which are solved one after another has the following advantage .
the method operates iteratively , where the start value is the preconditioner solution , which is still localized at some lattice site : @xmath111 ( or @xmath112 ) .
the computation of @xmath104 is done with lapack calls@xcite for the diagonal blocks by the cpus assigned to them according to fig .
[ fig : storageb ] . by means of the spatial structure of this
then iteratively refined approximation to the solution , only the application of @xmath113 introduces further lattice sites to the problem . as a consequence ,
if gmres converges quickly for a given numerical accuracy of the gmres method , non - zero elements only occur within the spatial vicinity associated to the considered @xmath114 block in the blocked representation of the converging gmres solution @xmath115 ( see app .
[ app : gmres ] for details ) .
indeed , the gmres procedure converges very rapidly , because the hopping @xmath42 between adjacent lattice sites is required to be small in the strong - coupling expansion .    for the block representations @xmath116 of iteratively refined gmres solutions , we thus choose to only store non - zero subblocks and distribute them within the @xmath59 units using the storage scheme for @xmath102 ( see above and fig .
[ fig : storageb ] ) . in the case
that @xmath116 contains non - zero contributions for reducible lattice sites ( this happens when @xmath114 is located near the boundary of the range of site representatives , see appendix [ app : symmetries ] ) , the respective block is handled by the cpu associated to its equivalence class .
this minimizes both communication and memory consumption .
the former is because applying the preconditioner is only a local operation and applying @xmath117 requires only communications with units storing neighbors of the respective lattice sites .
the size of the blocks in @xmath116 is to be chosen as large as possible .
however , memory in @xmath59 is usually very limited , so a tradeoff in unit size and block length has to be made .
let us also comment on reasonable values for the gmres convergence parameter .
the gmres method for our matrix inversion runs until a certain accuracy for the result is achieved , i.e. @xmath118 where @xmath119 is the desired numerical precision and @xmath66 is the euclidian norm . for all practical purposes we encountered so far ,
a value @xmath120 has been sufficient .
this surprisingly large value was verified by comparing to simulations with higher accuracy , that is @xmath121 , for the physical systems studied in this paper at several parameter values .
the plots of numerical results of interest are identical to the eye .
similar tests were done for completely homogeneous systems by comparing to a numerically exact implementation in momentum space .
it may be that for different applications than the one presented here a smaller value of @xmath119 is required . in order to understand the meaning of @xmath119 better it may be useful to compare it to the dimension of the vector it constrains . in our case ,
the dimension of @xmath122 is @xmath123 .
thus , if one chooses to normalize the convergence criterion in eqs .
and by the dimension , the constraint reads @xmath124 . in this context
it may also be worthwhile to consider the fact that the gmres procedure only involves transformations with @xmath104 , @xmath102 , and @xmath42 .
that is , it applies only transformations which comply with the causal structure of the green s function and do not introduce artificial discontinuities with respect to the time variables in the end result for the green s function which are in principle part of the vector space which is being searched by the algorithm .
in other words , the physical choice of the preconditioner already constrains the solution space so drastically that even a relatively large value of @xmath119 might be sufficient .    with all these optimizations , the green s function evaluation typically consumes no more than five to ten percent of the time required for the self - energy evaluation on a cray xe6 machine in the application to lattice depth modulation spectroscopy described below .
the optimizations are necessary to speed up the green s function evaluation appropriately , because we encountered increases in speed by a factor of at least 10 and up to 1000 , for each blockwise application of gmres , distributed storage of the gmres vector blocks , and random assignment of site indices . in other applications than lattice depth modulation , with a large value of the hopping applied for a longer period of time , the requirement of computer time for the green s function evaluation may still exceed the time to evaluate the self - energy . however , we find these requirements to be within reasonable bounds .
the only time when global communication and synchronization across all processors is required is when either the self - energy or the green s function evaluations are finished .
then , convergence has to be checked , and the global configurations @xmath50 and @xmath49 have to be replaced by each other .
this requires point - to - point communications of individual processors across the machine and broadcasts within smaller groups of processors which all require the same data .
+    the occuring communication events are displayed in fig .
[ fig : globalconfigswitches ] . during the switch @xmath125 ( fig .
[ subfig : cgtocs ] ) , the green s function contents on the nearest neighbors of the sites assigned to a given @xmath58 have to be sent from the green s function unit which computed them . due to
the possibly random assignment of site indices @xmath24 to spatial coordinates @xmath126 , the input to @xmath58 is collected from various @xmath127 .
the storage scheme used for the results within @xmath127 determines the actual processors which send the data .    when switching from @xmath50 to @xmath49 , spatial ranges tasked to specific parts of each green s function unit have to be sent from the self - energy units which contain this information ( fig .
[ subfig : cstocg ] ) .
the storage pattern for @xmath59 is already the one specified for the block diagonal matrix denominator of the dyson s equation ( fig .
[ fig : storageb ] ) .
to finish the change of configurations , an in - place substitution of the self - energies by the respective blocks @xmath128 is performed by computing the respective atomic green s functions and inserting @xmath129 , as defined in eq .  .
the process @xmath130 is typically more time - consuming than @xmath125 .
however , it can be optimized by using broadcasts between groups of processors with the same data requirements : each @xmath46-th cpu in @xmath59 requires the same data set to operate .
the switching processes cost no more than five percent of the total computation time and are thus negligible .
however , the implementation involves a considerable amount of book - keeping .
let us summarize the algorithm and also provide some implementation details on the way . as the method implements the self - consistent solution of eq .
, the algorithm is split in two steps : the self - energy evaluation ( eqs .   and ) and the green s function evaluation ( eq .  ) . since the computation of the self - energy and the evaluation of the green s function
have different requirements in terms of computational resources on the supercomputer , they use different data structures and collaboration patterns amongst the cpus .
we refer to the data structures of the algorithm in the self - energy evaluation state as the configuration @xmath50 and to the data structures of the algorithm in the green s function evaluation state as the configuration @xmath49 .
the respective configurations are subdivided into mutually independent units @xmath58 and @xmath59 spanning several cpus and the memory associated with them , respectively .
this approach is tailored to a cluster , rather than a shared - memory architecture .
if one chooses to employ the message passing interface ( mpi ) standard in order to implement the algorithm , it is advantageous to use the ` mpi_group ` feature to ensure an efficient communication within the units @xcite .
it turns out to be useful to define internal communicators for the @xmath59 and @xmath58 , respectively , as well as for sets of processors with shared requirements , such as the @xmath61-th processor of each @xmath59 , since they all require the same self - energies . within these shared - interest communicators
, data can be broadcasted efficiently .
it may also be reasonable to use advanced mpi features to perform an optimization with respect to the network topology of the supercomputer , such that communication within the @xmath59 units is optimal and equally fast for all @xmath34 .
in contrast , the communication within @xmath58 is not time - critical , because the main effort , computing the integrals in eq .  ,
is done by each processor in @xmath58 independently .
let us now comment on the implementation of eq .  .
each @xmath58 computes @xmath131 for a certain range of sites . here , the main effort is the contraction of the time indices .
the atomic - limit cumulant green s function @xmath132 is computed on the fly using tabulated values of the exponentials in eq .  .
the computational effort of eq .
scales with @xmath133 and is the computationally most costly operation .
however , it may also be implemented on gpus , due to little memory and bandwidth requirements . after having evaluated eq .
, the units @xmath58 compute the updated self - energy using eqs .   and . then , as described in section [ subsec : confswitch ] , the resulting local self - energies are sent to the @xmath59 units which may or may not overlap with the respective @xmath58 . within each @xmath59 ,
the self - energy for all sites has to be available and is thus equally distributed over the cpus according to the storage pattern depicted in fig .
[ fig : storageb ] .
it is advised to keep the self - energy results in @xmath58 for the next update as described by eq .
, even though the machine changes to configuration @xmath49 in the meantime .
this is because the @xmath134 in eq .
has to be available in the self - energy computation of the next iteration of the self - consistency loop . in order to minimize the memory consumption of the relevant range of @xmath134
, it can be distributed equally within each @xmath58 .    in order to establish the configuration @xmath49 to compute eq .  , the self - energies in @xmath59 are then replaced by the blocks of the matrix @xmath102 according to eq .  .
optionally , the elements of the preconditioner @xmath104 can also be computed and stored at this point in time , also using the previous storage pattern . however , this competes with the requirement to keep @xmath59 small , because the action of the preconditioner can also be computed on the fly from @xmath102 with a smaller memory requirement .
having fully set up the @xmath49 configuration , eq .
is written as the vectorized linear eq .   as described in section [ subsec : greensfunctionevaluation ] .
the key variable is the bundle of gmres vectors @xmath116 whose initial value @xmath135 is the preconditioner @xmath136 applied to a bundle of unit vectors , as in eq .  .
@xmath135 has only non - zero entries at a single site index .
@xmath116 is also stored according to the scheme in fig .
[ fig : storageb ] .
a good optimization here is to store only nonzero components of @xmath116 emerging from @xmath135 due to the application of the hopping matrix . for this purpose ,
each processor in @xmath59 can keep track of the sites with non - zero elements in @xmath116 based on the site index of @xmath135 and the number of hopping events applied to @xmath116 during the gmres procedure elaborated in app .
[ app : gmres ] .
once a hopping occurs due to the application of @xmath137 , a given processor may have contributions to be stored and/or added to a value assigned to another processor within the storage scheme ( compare to the block structure of @xmath138 in eq .  ) .
such transmissions are the major communication events within @xmath59 .
the required communication bandwidth within @xmath59 can only be minimized by assigning connected spatial domains with a minimal surface to single processors within @xmath59 . however , doing so is strongly disadvantageous in the case that the gmres is converging very rapidly , i.e.  if the hopping is small and @xmath139 is small . in this case , all but one of the cpus in @xmath59 will remain idle , because the non - zero elements in @xmath116 do not leave the cpu storing the non - zero elements of @xmath135 .
thus , for a rapidly converging gmres , a random assignment of the site leading to largely scattered domains is more appropriate .
once each @xmath59 has computed the green s functions on the spatial range assigned to it , the different spatial components of @xmath140 are distributed to the @xmath58 units which require them for evaluating the green s function sum in eq .   in order to start the next iteration .
in this section , we present results of the algorithm for trapped atoms in a two - dimensional optical lattice which is subject to a periodic modulation of the lattice depth .
we compare this method to a homogeneous version of the algorithm which was previously successfully applied to a lattice depth modulation experiment within the lda @xcite .
the lda is generally expected to yield good results for systems without mass transport .
this is a well - established observation in equilibrium @xcite .
we show that also in a nonequilibrium scenario without mass transport , the high accuracy of the lda can be explicitly demonstrated . at the same time we validate our direct computational approach .      in lattice - depth
modulation spectroscopy , the atoms are subject to a time - dependent optical lattice potential @xmath141 the trap potential does not depend on time and has the parabolic shape @xmath142 the lattice potential satisfies @xmath143 which contains the time - dependent lattice depth @xmath144 } ( t ) \cdot \delta v \sin \omega t.\ ] ] we assume that the lattice is modulated over a finite time interval @xmath145 $ ] and that the system is in an initial thermal state at time @xmath8 .
numerically , we start the simulation at an earlier point in time , in order to be able to check for convergence , as discussed in fig .  [
fig : keldysh ] . the lattice constant @xmath146 is defined by the laser wavelength @xmath147 .
the single - particle hamiltonian @xmath148 yields the recoil energy @xmath149 as a natural choice for an energy unit . in order to compute the coefficients of the many - body hamiltonian in eq .   from the single - particle hamiltonian
, we insert the constant hoppings @xmath150 and interactions @xmath151 of a translationally invariant lattice .
these can be computed easily with maximally localized wannier functions @xcite .    due to the time - dependence of the lattice depth @xmath152
, we also obtain a time - dependent interaction @xmath153 and hopping @xmath154 .
we write the initial values of the interaction and the hopping as @xmath70 and @xmath155 , respectively . in these units ,
the trap potential can be written as @xmath156 hence , @xmath157 can be interpreted as the length scale on which the trap potential reaches the strength of the initial hopping amplitude .
it is important to keep @xmath157 larger than a couple of lattice spacings , since otherwise the trap potential interferes drastically with the hopping between neighboring sites and the density changes too fast for the lda to be accurate .
+   +   +    as a test system , we set the lattice depth to @xmath158 and modulate it with an amplitude @xmath159 at the resonant frequency @xmath160 . the interaction strength is chosen to be @xmath161 , and we assume an initial temperature @xmath162 .
we choose to study two cycles of the modulation , that is @xmath163 .
for the simulations , we use up to 1024 time slices and a lattice with up to 1024 symmetry - irreducible lattice sites , that is up to 7844 actual lattice sites . the computational effort for a system with 512 symmetry - irreducible sites and
a maximum of 1024 time slices is approximately @xmath164 cpu - hours on a cray xe6 .
for instance , this involves 32768 cpus for approximately 12 hours by the main simulation and some further cpu time for the cheaper simulations at larger @xmath81 which are required for the extrapolation @xmath165 .
figure [ fig : trapresults ] shows simulation results for distribution of the double occupancy in a trapped system with @xmath166 and the global chemical potential @xmath167 . each subfigure displays the distribution at a different point in time . due to the lattice depth modulation , the hopping in units of the interaction @xmath168 drives the system .
the increases in the double occupancy occur as @xmath168 is decreasing .    to provide a better picture of the time dependence , fig .
[ fig : integrateddocc ] shows the fraction of atoms on doubly occupied sites , @xmath169 where @xmath170 as a function of time for several values of the trap curvature . in the cases @xmath166 and @xmath171 , the results lie on top of each other , whereas for @xmath172 a slight deviation occurs .
this agrees with the results found in our previous publication ref .
@xcite for homogeneous systems .          in order to perform the comparison to the lda
, we solve numerous mutually independent homogeneous versions of the problem at several chemical potentials @xmath173 and compare to local observables obtained from the full trap simulation at a position @xmath76 .
we consider a set of test systems with three different trap curvatures , that is different values of the characteristic length @xmath157 of the trap potential , namely @xmath174sites , @xmath175sites , and @xmath176sites . in the simulations ,
the real part of the kadanoff - baym - keldysh contour extends over an interval @xmath177=[-2\hbar / u_0 , 14 \hbar / u_0]$ ] , whereas the modulation acts over the interval @xmath178 $ ] .
figure [ fig : ldacompadocc ] shows a comparison of the double occupancy @xmath179 as a function of the initial chemical potential @xmath7 at times before ( @xmath180 ) and after ( @xmath181 ) it has been driven out of equilibrium by the lattice depth modulation . as we see for both , the equilibrium ( @xmath180 ) and nonequilibrium ( @xmath181 ) situations , the numerical results for the inhomogeneous system agree well with the lda , even for the rather steep trap potential with @xmath174sites .
the slight deviation of the solution for @xmath182sites from the other nonequilibrium curves may still be due to numerical imperfections .
the agreement with the lda indicates that the creation of doubly occupied sites in a mott insulator subject to a modulated lattice depth is caused by strongly local excitation processes .
we presented a computational approach to an inhomogeneous mott - insulating system of ultracold atoms .
a major challenge is to compute a large matrix inverse in the dyson equation .
we show that a gmres - based inversion approach exploiting the small numerical value of the hopping as compared to the many - body interaction yields a feasible implementation on supercomputers .
a comparison to the lda shows that both methods are well - suited for the problem of lattice - depth modulation spectroscopy .
this hints towards mainly local processes being involved in the coherent excitations between lower and upper hubbard bands in this particular setting , as might have been anticipated . in the future
, we will apply the inhomogeneous method to problems with mass transport where the lda is expected to fail .    at present , the computational complexity of the algorithm is proportional to @xmath133 .
it may be worthwhile to investigate the possibility to extend the time range by truncating certain parts of the self - energy at a given threshold for @xmath183 .
this measure could increase the applicability of the algorithm greatly but requires further efforts .
this work was supported by a muri grant from the air force office of scientific research numbered fa9559 - 09 - 1 - 0617 .
supercomputing resources came from a challenge grant of the dod at the engineering research and development center and the air force research and development center .
the collaboration was supported by the indo - us science and technology forum under the joint center numbered jc-18 - 2009 ( ultracold atoms ) .
jkf also acknowledges the mcdevitt bequest at georgetown .
hrk acknowledges support of the department of science and technology in india .
point - group symmetry imposed by the circular trap potential on the 2d lattice .
the circles denote lattice sites .
solid circles are representatives of an equivalence class of lattice sites with respect to the symmetry .
the symmetry partners of the red / gray solid circle are displayed in red / gray . ]
we illustrate the exploitation of symmetries for the example of spherical symmetry on a two - dimensional square lattice with an @xmath184-orbital basis . in this case , a @xmath185 point group symmetry @xcite is imposed on the lattice .
[ fig : symmetry ] displays the lattice sites of a lattice . for the @xmath185 symmetry , all sites
can be represented by the sites in the irreducible wedge @xmath186 .
these representatives of the equivalence classes are denoted by solid black circles . if the green s function and self - energy transform as the identity representation of the point group , the computations only need to be performed for those representatives .
the representative of a given site can be retrieved by reflections with respect to the coordinate axes and the diagonals which are shown as dashed lines in fig .
[ fig : symmetry ] .
we provide a brief derivation of eq .  .
let us start by assuming an equidistant discretization @xmath187 ( @xmath188 ) of the forward part of the kadanoff - baym - keldysh contour .
we obtain @xmath189 with @xmath190.\ ] ] the operator @xmath191 simplifies as follows : @xmath192   + \mathcal{o}(\delta t^2 ) \\   = & -{\ensuremath{\mathrm{i}}}\delta t \cdot \bigg ( \sum_j j_{lj } c^\dagger_{l\sigma}c_{j\sigma } - { \varepsilon}_{l\sigma}(t ) n_{l\sigma } - \\     & \qquad\quad - u_l(t ) n_{l\uparrow } n_{l\downarrow}\bigg ) + \mathcal{o}(\delta t^2 ) .
\end{split}\ ] ] taking the limit @xmath82 results in eq .  .
numerically , this limit must be performed via linear and/or quadratic extrapolation of multiple simulations for different @xmath81 values .
the generalized minimal residue method was introduced by saad and schultz @xcite to solve a linear equation @xmath193 a good introduction to the method can be found in ref .
@xcite , and a useful c++ implementation is provided by the nist iml++ template library @xcite . in order to solve the equation , gmres operates in @xmath194-dimensional krylov subspaces @xmath195 which are successively built up , starting with @xmath196 .
@xmath197 is the residue of the initial guess @xmath198 for the solution .
the gmres method forms a refined approximate solution @xmath199 defined by the minimization requirement @xmath200 where the expression `` @xmath201 '' demands @xmath202 to be minimal .
the krylov space dimension @xmath194 is increased until the convergence criterion is reached or @xmath194 approaches the threshold @xmath203 at which the minimization is considered too expensive . if @xmath204 , gmres is restarted with a krylov space size @xmath196 , where the initial guess @xmath198 is taken to be @xmath205 from the previous gmres iteration before restarting . with a preconditioner @xmath94 ,
one applies gmres to the system @xmath206 rather than eq .  .
if @xmath207 this system is better conditioned than eq .  .
in the case that @xmath117 is a sparse matrix with large entries on the diagonal and some randomly occuring off - diagonal entries , the diagonal matrix @xmath102 defined by the diagonal entries of @xmath117 yields a good preconditioner @xmath104 , because the condition number @xmath208 is not as close to @xmath209 as the regularized @xmath210 here , @xmath211 and @xmath212 represent the respective maximal and minimal singular values . also , the application of the diagonal matrix @xmath102 to a vector is a cheap operation .
the same argument can be made in the case that @xmath117 has large entries on the block diagonal @xmath102 , as it is the case in the nonequilibrium inhomogeneous strong - coupling expansion , where @xmath213 .
the block diagonal @xmath102 is defined in eq .  ,
and the hopping matrix @xmath42 is a sparse matrix with small numerical values ( see also eq .  ) . due to the latter , in fact @xmath214 ,
so the equation system is well - conditioned .      1 .   for the initial
guess @xmath215 compute the preconditioned residue @xmath216 , as well as @xmath217 .
initialize the hessenberg matrix @xmath218 2 .   for @xmath219 do * @xmath220 * for @xmath221 do * * * @xmath222 * * @xmath223
* @xmath224 * if @xmath225 then proceed with step 3 to compute the result .
* otherwise use step 3 to check for convergence , eq .  .
continue if not converged .
* @xmath226 3 .
solve the @xmath194-dimensional linear minimization problem @xmath227 where @xmath228 is the upper left @xmath194-dimensional square of @xmath229 , to obtain the result @xmath230 .
+ then set @xmath231 , with @xmath232 . +    practically , the gmres with preconditioner scans for solutions in the modified affine krylov spaces @xmath233 here , the basis vectors are @xmath234 in the case of the inhomogeneous nonequilibrium strong - coupling expansion , @xmath235 is a unit vector localized at a given lattice site .
the @xmath61-th basis vector @xmath236 of the krylov space @xmath237 corresponds to @xmath61 hopping processes , because @xmath238 , and in @xmath236 , @xmath117 is applied @xmath61 times to @xmath235 .
that is , the gmres method includes exactly @xmath194 iterated hopping processes in iteration @xmath194 until convergence is reached .
if gmres is restarted , the @xmath194th iteration includes @xmath239 iterated hopping processes , where @xmath24 is the number of restarts .
this is crucial for the computational optimizations used in the implementation .
the procedure can be seen as a numerically controlled analogue to a partial summation of the dyson series @xmath240    99 i. bloch , j. dalibard , and w. zwerger , rev .
phys . * 80 * , 885 ( 2008 ) t. esslinger , ann .
rev . condens . mat .
* 1 * , 129 ( 2010 ) th .
stferle , h. moritz , c. schori , m. khl , and t. esslinger , phys .
* 92 * , 130403 ( 2004 ) r. jrdens , n. strohmaier , k. gnter , h. moritz , and t. esslinger , nature * 455 * , 204 ( 2008 ) d. greif , l. tarruell , th .
uehlinger , r. jrdens , and t. esslinger , phys .
lett . * 106 * , 145302 ( 2011 ) s.r .
clark and d. jaksch , phys .
a * 70 * , 043612 ( 2004 ) c.  kollath , u.  schollwck , w.  zwerger , phys .
* 95 * , 176401 ( 2005 ) c.  kollath , a.  iucci , t.  giamarchi , w.  hofstetter , and u.  schollwck , phys .
lett . * 97 * , 050402 ( 2006 ) ; c. kollath , a. iucci , i.p .
mcculloch , and t. giamarchi , phys .
a * 74 * , 041604(r ) ( 2006 ) k.  winkler , g.  thalhammer , f.  lang , r.  grimm , j.  hecker denschlag , a.  j.  daley , a.  kantian , h.  p.bchler , p.  zoller , nature * 441 * , 853 ( 2006 ) a. j. daley , p. zoller , and b. trauzettel , phys .
lett . * 100 * , 110404 ( 2008 ) a. j. daley , j. m. taylor , s. diehl , m. baranov , and p. zoller , phys .
lett . * 102 * , 040402 ( 2009 ) k. mikelsons , j. freericks , and h. r. krishnamurthy , phys .
* 109 * , 260402 ( 2012 ) a. dirks , k. mikelsons , h. r. krishnamurthy , and j. freericks , arxiv:1304.7802 w.  kohn , phys
. rev . * 115 * , 809 ( 1959 ) y. saad and m.h .
schultz , siam j. sci .
. comput . * 7 * , 856 ( 1986 ) e. anderson , z. bai , c. bischof , s. blackford , j. demmel , j. dongarra , j. du croz , a. greenbaum , s. hammarling , a. mckenney , and d. sorensen , _ lapack users guide _ ( society for industrial and applied mathematics , philadelphia 1999 ) e.  assmann , s.  chiesa , g.  g.  batrouni , h.  g.  evertz , and r.  t.  scalettar , phys . rev .
b * 85 * , 014509 ( 2012 ) w. gropp , e. lusk , and a. skjellum , _ using mpi
_ , mpi press , 1999 , isbn 9780262571326 f.a .
cotton , _ chemical applications of group theory _ , wiley and sons ltd . , 1990 ,
isbn 997151267x https://lp.uni-goettingen.de/get/text/2024 and https://lp.uni-goettingen.de/get/text/2025 ( in german , opened on sept .  10 , 2013 )
( sept .  10 , 2013 )