theoretical calculations show that , in the presence of a perpendicular magnetic field , a two - dimensional electron gas ( 2deg ) should crystallize below a filling factor @xmath0@xcite .
several experimental groups have reported transport measurements indicative of this electron crystallization when the filling factor of the lowest landau level is decreased below @xmath1 these measurements include the observation of a strong increase in the diagonal resistivity @xmath2 non - linear @xmath3 characteristics , and broadband noise .
all these observations have been interpreted as the pinning and sliding of a wigner crystal ( wc)reviewexperimentwc . moreover
, microwave absorption experiments@xcite have also detected a resonance in the real part of the longitudinal conductivity , @xmath4 , that has been attributed to the pinning mode of a disordered wigner crystal .
the vanishing of the pinning mode resonance at some critical temperature @xmath5 has been used to derive the phase diagram of the crystal@xcite in the quantum regime where the kinetic energy is frozen by the quantizing magnetic field .
similar microwave absorption experiments also showed a pinning resonance at higher filling factors close to @xmath6 where the formation of a wigner solid is expected in very clean sampleschen1,lewis1,lewis2 .
finally , in landau levels of index @xmath7 , a study of the evolution of the pinning mode with filling factor reveals several transitions of the 2deg ground state from a wigner crystal at low @xmath8 to bubble crystals with increasing number of electrons per lattice site as @xmath8 is increased , and into a modulated stripe state ( or anisotropic wigner crystal ) near half filling@xcite .    in earlier works@xcite ,
some of us have studied several crystalline states of the 2deg using a combination of hartree - fock ( hfa ) and generalized random - phase approximations ( grpa ) . in these works ,
the energy and order parameters of the crystal were calculated in a self - consistent hfa while the collective excitations were derived from the poles of density response functions computed in the grpa . this microscopic approach
( hfa + grpa ) works well at zero temperature but is difficult to generalize to consider finite temperature effects or to include quantum fluctuations beyond the grpa .
finite - temperature or quantum fluctuations effects ( not already included in the grpa ) , are most easily computed by writing down an elastic action for the system . for a crystaline solid , this requires the knowledge of the dynamical matrix ( dm ) or , equivalently , of the elastic coefficients of the solid .
a direct way to obtain these elastic coefficients is to compute the energy required for various static deformations of the crystal .
using elasticity theory , each deformation energy @xmath9 can be written in the form @xmath10 where @xmath11 is a parameter characterizing the amplitude of the deformation and @xmath12 is generally a combination of elastic constants . in the limit @xmath13 , one can obtain the elastic coefficients by computing the deformation energy of one or more static deformations and using the known symmetry relations between the elastic constants .
alternatively , one can obtain a dm from the grpa density response function much more directly without the need to compute the elastic coefficients @xcite .    in this paper
, we compare the dm obtained from these two methods ( deformation energy and grpa ) in order to find the range of validity as well as the limitations of the gpra approach .
we first consider the simple case of an isotropic ( triangular ) wigner crystal before tackling the more complex anisotropic wigner crystal @xcite or stripe phase that occurs near half - filling in the higher landau levels . we show that although the grpa method gives a good description of the qualitative behavior of the dm as a function of filling factor , its quantitative predictions must be used with caution .
as we show below , an averaging procedure must be applied to the method in order to obtain a dm in the grpa that compares favorably with the one obtained by computing the deformation energy .
our paper is organized as follows . in section
ii , we define the elastic constants needed to build an elastic model for the wigner and stripe crystals .
we then explain , in section iii , how these elastic constants can be derived by computing the deformation energy of the crystals in the hfa . in section iv
, we summarize the grpa method of obtaining the dynamical matrix . our numerical results for the wc are discussed in section v and those for the stripe crystal in section vi .
section vi contains our conclusions .
we describe the elastic deformation of a crystal state by a displacement field @xmath14 defined on each lattice site @xmath15 .
the fourier transform of this operator is given by : @xmath16where @xmath17 is the number of lattice sites . in two dimensions ,
the general expression for the deformation energy of a crystal requires the use of @xmath18 elastic coefficients @xmath19 and is given , in the continuum limit , by the following expression@xcite : @xmath20 \label{m4 } \\ & + \frac{1}{2}\int d\mathbf{r}\left [ 2c_{12}e_{x , x}e_{y , y}+4c_{16}e_{x , x}e_{x , y}+c_{22}e_{y , y}^{2}\,\right ] ,   \notag\end{aligned}\ ] ] where @xmath21 is the symmetric strain tensor .
the wigner and bubble crystals have a triangular lattice structure for which the following equation holds : @xmath22 for such a triangular structure , the elastic energy in the long - wavelength limit can be written in a form that contains only two elastic coefficients , namely : @xmath23 .
\label{m6}\end{aligned}\ ] ]    the anisotropic stripe state can be seen either as a centered rectangular lattice with two electrons per unit cell or as a rhombic lattice with one electron per unit cell with reflection symmetry in both @xmath24 and @xmath25 axis .
the deformation energy is given by @xmath26   \notag\\ & + \frac{1}{2}\int d\mathbf{r}\left [ 2c_{12}e_{x , x}e_{y , y}+c_{22}e_{y , y}^{2}\,\right ] .
\end{aligned}\ ] ] in this paper , we assume that the stripes are aligned along the @xmath25 axis .
the above formulation of elasticity theory assumes short - range forces only . for the electronic crystals that we consider , these forces are of coulombic origin
i.e. the hamiltonian of the crystal contains only the coulomb interaction between electrons and the kinetic energy which is frozen by the quantizing magnetic field .
both the direct ( hartree ) and exchange ( fock ) terms are considered by the hartree - fock approximation as we explain in the next section . to take into account in the elasticity theory the long - range part of the coulomb interaction present in a crystal of electrons , it is necessary to add to @xmath27 the deformation energy @xmath28 given by@xmath29 where @xmath30 is the area of the crystal , @xmath31 is the fourier transform of the change in the electronic density and @xmath32 is the dielectric constant of the host semiconductor .
we consider the positive background of ionized donors as homogeneous and inert so that no linear term in @xmath33 is introduced by the coulomb interaction .    to define a dynamical matrix , we assume that the crystal can be viewed as a lattice of electrons with static form factor @xmath34 on each crystal site ( with the normalisation @xmath35 ) . the time - dependent density can then be written as @xmath36and , to first order in the displacement field , we have for a density fluctuation    @xmath37    where @xmath38 is a reciprocal lattice vector and @xmath39 a vector in the first brillouin zone of the crystal .
it follows that we can write the coulomb energy as@xmath40where @xmath41 is the average electronic density .
we pause at this point to remark that the form factor @xmath42 ( with @xmath43 the magnetic length , @xmath44 being the applied magnetic field ) in eq .
( [ defo ] ) renders the summation over the wavectors rapidly convergent .
our hartree - fock calculation of the ground - state energy of the electronic crystals as well as our grpa calculation of the dynamical matrix also involve summations over reciprocal lattice vectors @xmath38 of some functions weighted by @xmath45 .
if the magnetic field is not too strong , we can perform these summations directly .
there is no need to use ewald s summation technique as is the case if one works with a crystal of point electrons . of course , as the filling factor @xmath46 , the magnetic length @xmath47 so the electrons behave more and more like point particles and the convergence is lost . in all cases that we consider ,
the summations involved are rapidly convergent because we restrict ourselves to filling factors @xmath48 where @xmath49 is sufficiently large for @xmath50 to be small ( @xmath51 being the lattice constant ) .
the cutoff in @xmath52 is choosen so that the summations are evaluated with the required degree of accuracy .
the total deformation energy , which we now write as @xmath53 now includes the long - range coulomb interaction and can be written in the form : @xmath54 where we have introduced the dynamical matrix : @xmath55for the triangular lattice , a comparison of eqs .
( [ m18 ] ) and ( [ m6 ] ) gives the dynamical matrix ( to order @xmath56 ) as :    [ m32 ] @xmath57 , \\
d_{x , y}\left ( \mathbf{k}\right ) & = & n_{0}^{-1}\left ( \widetilde{c}_{12}\left ( k\right ) + c_{66}\right ) k_{x}k_{y } , \\
d_{y , y}\left ( \mathbf{k}\right ) & = & n_{0}^{-1}\left [ \left ( \widetilde{c}% _ { 12}\left ( k\right ) + 2c_{66}\right ) k_{y}^{2}+c_{66}k_{x}^{2}\right ] .\end{aligned}\ ] ]    the long - range coulomb interaction renders the elastic coefficient @xmath58 ( but not the shear modulus @xmath59 ) nonlocal , so that @xmath58 contains a diverging term @xmath60
. we shall write : @xmath61 where @xmath58 is the weakly dispersive part of the elastic coefficient , and where the plasmonic ( first ) term on the _ rhs _ is due to the long - range nature of the coulomb interaction .    for the stripe state , eq .
( [ triangulaire ] ) is no longer valid .
in addition , all three elastic coefficients @xmath62 become nonlocal .
we have in this case :    @xmath63 \nonumber\\ & + & n_{0}^{-1}kk_{y}^{4 } , \\ d_{x , y}\left ( \mathbf{k}\right ) & = & n_{0}^{-1}\left ( \widetilde{c}_{12}\left ( k\right ) + c_{66}\right ) k_{x}k_{y } , \\
d_{y , y}\left ( \mathbf{k}\right ) & = & n_{0}^{-1}\left [   \widetilde{c}_{22}\left ( k\right ) k_{y}^{2}+c_{66}k_{x}^{2}\right ] , \end{aligned}\ ] ]    where @xmath64 , with @xmath65 ; and where we added to @xmath66 a term @xmath67 in order to take into account the bending rigidity of the stripes which , due to the small value of the shear modulus @xmath59 in these systems , is quantitatively important over a sizeable region of the brillouin zone@xcite .
using the fact that @xmath68 , we finally obtain : @xmath69 we now want to discuss how one can evaluate the non - dispersive part @xmath19 of the elastic coefficients
. this will be the subject of the follwing section .
in the hartree - fock approximation , a crystalline phase is described by the fourier components @xmath70 of the average electronic density , where @xmath38 is a reciprocal lattice vector . in the strong magnetic field limit where the hilbert space is restricted to one landau level , it is more convenient to work with the guiding - center density  @xmath71 which is related to @xmath70 by : @xmath72  where @xmath73 is the landau - level degeneracy and @xmath74is the form factor of an electron in landau level @xmath75 ( @xmath76 being a generalized laguerre polynomial ) .
the magnetic field @xmath77 is perpendicular to the 2deg .
the hartree - fock energy per electron in the partially filled landau level is given by@xcite : @xmath78 \left\vert \left\langle \rho \left ( \mathbf{g}\right ) \right\rangle
\right\vert ^{2 } ,   \label{energiehf}\]]where the @xmath79 term in this equation accounts for the neutralizing background of the ionized donors .
the parameter @xmath80 is the filling factor of the partially filled level , and we take all filled levels below @xmath75 to be inert .
the hartree and fock interactions in landau level @xmath75 are defined by :    @xmath81 ^{2 } , \\
x\left ( \mathbf{q}\right ) & = & \left ( \frac{e^{2}}{\kappa \ell } \right ) \sqrt{2% } \int_{0}^{\infty } dx\,e^{-x^{2 } } \\ & & \times \left [ l_{n}^{0}\left ( x^{2}\right ) \right ] ^{2}j_{0}\left ( \sqrt{2}% xq\ell \right ) ,   \notag\end{aligned}\ ] ]    where @xmath82 is the bessel function of the first kind .    to compute the @xmath83
, we first write this quantity in second quantization and in the landau gauge @xmath84 as :    @xmath85    the average values @xmath86 are obtained by computing the single - particle green s function ( here and in what follows , @xmath87 denotes the time ordering operator ) : @xmath88whose fourier transform we define as : @xmath89so that : @xmath90    we use an iterative scheme to solve numerically@xcite the hartree - fock equation of motion for @xmath91 for the undeformed lattice , we use the basis vectors :    @xmath92    where @xmath93 is the aspect ratio and @xmath94 is the angle between the two basis vectors . for the triangular lattice , @xmath95 and @xmath96 .
if we apply an elastic deformation @xmath97 to the lattice , the new lattice vectors are given by @xmath98 ( where @xmath99 are integers ) .
we can write this expression as @xmath100 if we define the new basis vectors as :    @xmath101    the parameters @xmath102 and @xmath103 are functions of the original lattice and of the type of deformation considered .
the reciprocal lattice vectors of the deformed lattice are easily computed once these parameters are known .
then , the cohesive energy @xmath104 of the deformed lattice can be calculated using the deformed reciprocal lattice vectors and eq .
( [ m7 ] ) . under these circumstances , we find that the deformation energy per electron is given by : @xmath105to find the elastic coefficients for the wigner and stripe crystals , we need to consider the following deformations ( note that the magnetic field and the number of electrons are kept fixed@xcite ) :    _ ( i ) _ a shear deformation with @xmath106 and @xmath107 : the strain tensors in this case are given by @xmath108 , and @xmath109 .
the area of the system , @xmath30 , is not changed by this deformation and the elastic energy is given by @xmath110 .
it then follows that the shear modulus @xmath59 is given by : @xmath111where @xmath112 is the deformation energy per electron .
the parameters of the distorted lattice for this shear deformation are given by :    @xmath113    _ ( ii ) _ a one - dimensional dilatation along @xmath114 , with @xmath115 and @xmath107 : here , the strain tensors @xmath116 and @xmath117 , and the new area of the system is @xmath118 and @xmath119 .
it then follows that the compression constant @xmath120 is given by : @xmath121 while the parameters of the deformed lattice are given by :    @xmath122    the surface of the deformed lattice is @xmath123 , so that the filling factor is now given by @xmath124 .    _
( iii ) _ a one - dimensional dilatation along @xmath125 with @xmath126 and @xmath127 : now the strain tensors @xmath128 and @xmath117 .
the new area of the system is @xmath118 and @xmath129 the compression constant @xmath130 is therefore given by : @xmath131on the other hand , the parameters of the deformed lattice are given by :    @xmath132    the surface of the deformed lattice is @xmath133 , so that the filling factor @xmath134    _ ( iv ) _ a two - dimensional dilatation with @xmath135 and @xmath127 : now , the strain tensors @xmath136 and @xmath117 .
the new area of the system is @xmath137 and @xmath138 it follows that the combination @xmath139 is given by : @xmath140 for this case , there is no need to actually compute the energy of the deformed lattice since we can extract @xmath139 from the hartree - fock energy @xmath141 given in eq .
( [ energiehf ] ) in the following manner .
the area per electron , @xmath142 , in the deformed lattice is @xmath143 , so that ( @xmath144 here is the area per electron of the undeformed lattice ) : @xmath145 the change in @xmath142 causes a change in the filling factor , which is now given by : @xmath146 writing the hf energy as @xmath147 , we have the relation : @xmath148 .
\label{m9}\ ] ] note that the long - wavelength coulomb term @xmath149 must be added to @xmath150 and @xmath130 that we compute in order to get @xmath151 and @xmath152 .
1 shows the expected quadratic behavior of the deformation energy as a function of @xmath153 , eq .
( [ deformation ] ) , for a shear deformation in the small @xmath154 limit . in the one and two - dimensional compressions ( _ i_)-(_iv _ ) , however , eq . ( [ deformation ] ) leads to the addition of a non physical linear term in the dependence of the energies @xmath155 on @xmath11 as can be seen in fig .
2 . in the absence of deformation ,
the average electronic density is equal to that of the positive background .
this neutrality removes the divergence of @xmath156 at @xmath157 in the hartree - fock energy of eq .
( [ energiehf ] ) .
when the electron lattice is dilated ( but not the positive background ) , the electronic density no longer matches the density of the positive background and there is a restoring force that arises from this density imbalance .
it is easy to show , assuming a density of the form of eq .
( [ m13 ] ) , that no linear term in @xmath11 arises when the interaction with the positive background is properly taken into account , and that the interaction with the background does _ not _ give rise to higher order terms in @xmath11 .
our hartree - fock procedure requires that the electronic and background densities be the same even for @xmath158 , which has the immediate consequence that we can not directly compute the deformation energy using eq .
( [ deformation ] ) . for all but the shear deformation , it is thus necessary for us to substract the linear term in eq .
( [ deformation ] ) and to add by hand the long - wavelength coulomb contribution of eq .
( [ defo ] ) in order to get the correct elastic constants .
2 shows that a quadratic behavior for the deformation energy is recovered when the linear term is substracted .
note that the deformation energy in fig .
2 does not contain the long - wavelength coulomb contribution of eq .
( [ defo ] ) , so that it can be either positive or negative .
our definitions in eqs .
( [ m2 ] , [ m3 ] , [ m4p ] ) of the elastic coefficients are not affected by this procedure of removing the linear term in @xmath11 since they involve the second derivative of the energy with respect to @xmath11 .     for a shear deformation : @xmath159 in a triangular wigner crystal in landau level @xmath160 with filling factor @xmath161 .
the square symbols are the hfa result while the solid line is a polynomial fit of order @xmath162 ( the linear term is negligible ) . ]     for a one - dimensional dilatation of a triangular wigner crystal in landau level @xmath160 with filling factor @xmath163 .
the square symbols are the hfa result ( left axis ) while the solid line is a polynomial fit .
the dashed line ( right axis ) is the deformation energy with the linear term removed . ]
it is instructive at this point to note that , for a triangular wigner crystal of classical electrons , the calculation of bonsall and maradudin@xcite gives the following expression for the quantity @xmath164 : @xmath165 and for the elastic coefficients :    @xmath166    if we use eqs .
( [ m9 ] ) ( with the relation ( [ triangulaire ] ) ) and take @xmath167 as given by eq .
( [ m11 ] ) , we find @xmath168 , which is consistent with eq .
( [ m10 ] ) .
we now turn our attention to the calculation of the dm of electron crystals in the grpa method . in the strong magnetic field limit where the hilbert space is restricted to one landau level only
, the hamiltonian of the system is given by : @xmath169where @xmath170 and @xmath39 is a vector restricted to the first brillouin zone of the crystal .
if we define the matsubara displacement green s function by : @xmath171we find , using @xmath172 $ ] and the commutation relation @xmath173 = i\ell ^{2}\delta _ { \mathbf{k},\mathbf{-k}^{\prime } } , $ ] that this green s function is related to the dynamical matrix by : @xmath174 }   \label{m20 } \\ & \times \left (   \begin{array}{cc } d_{y , y}\left ( \mathbf{k}\right ) & -\frac{\hslash \omega _ { n}}{\ell ^{2}}% -d_{x , y}\left ( \mathbf{k}\right )
\\   \frac{\hslash \omega _ { n}}{\ell ^{2}}-d_{y , x}\left ( \mathbf{k}\right ) &   d_{x , x}\left ( \mathbf{k}\right)% \end{array}% \right ) _ { \alpha \beta } ,   \notag\end{aligned}\]]where @xmath175 is a bosonic matsubara frequency and @xmath176 } \]]is the magnetophonon dispersion relation .
we now define the following density green s function : @xmath177where @xmath178 in the generalised random - phase approximation ( grpa ) , this green s function is found by solving the set of equations@xcite : @xmath179 \chi _ { \mathbf{g}^{\prime \prime } , \mathbf{g}% ^{\prime } } ^{\left ( \rho , \rho \right ) } \left ( \mathbf{k},i\omega_{n}\right )   = b_{\mathbf{g , g}^{\prime } } ( \mathbf{q } ) , \label{m21}\]]with the definitions : @xmath180   \notag \\ & \times \big [ h\left ( \mathbf{g}-\mathbf{g}^{\prime } \right ) -x\left (   \mathbf{g - g}^{\prime } \right )   \nonumber\\ & -h\left ( \mathbf{k}+\mathbf{g}^{\prime } \right ) + x\left ( \mathbf{k}+\mathbf{g}^{\prime } \right ) \big ] , \end{aligned}\ ] ] and : @xmath181 .\end{aligned}\ ] ] diagonalizing the matrix @xmath182 and making the analytic continuation @xmath183 we can write @xmath184 in the form : @xmath185at small @xmath186 the pole @xmath187 with the biggest weight @xmath188 gives the grpa  magnetophon mode .
we define this pole as @xmath189 and the corresponding weigth as @xmath190 .
we now relate the displacement green s function to the density green s function using eq .
( [ m7 ] ) .
this last equation , coupled to eq .
( [ m24 ] ) , gives the following relation between the density and displacement response functions ( here @xmath191 is the function defined in eq .
( [ nphi2 ] ) , where for simplicity we now drop the landau level index @xmath75 ) : @xmath192 in deriving eq .
( [ r26 ] ) , we have assumed that @xmath193 , so that a density fluctuation can be linearly related to the displacement @xmath194 by eq .
( [ m7 ] ) .
this is equivalent to assuming that the crystal can be described in the harmonic approximation so that only a knowledge of the dynamical matrix is necessary . to get eq .
( [ r26 ] ) , we have also assumed that @xmath195 so that @xmath196is real .
we can now use eq .
( [ m20 ] ) and the symmetry relation @xmath197 to relate the density response function to the dynamical matrix : @xmath198 } { \left [ \left ( \omega+i\delta \right ) ^{2}-\omega _ { mp}^{2}\left ( \mathbf{k}\right ) \right ] }   \notag\\ & \times & \frac{h(\mathbf{k+g})h(\mathbf{k+g}^{\prime } ) } { f(\mathbf{k+g})f(% \mathbf{k+g}^{\prime } ) } ,   \end{aligned}\ ] ] where we defined :    @xmath199 \cdot \widehat{\mathbf{z } } , \\ & \gamma _ { 2}\left ( \mathbf{k}\right ) = \widehat{\mathbf{z}}\cdot \left [ \left (   \mathbf{k}+\mathbf{g}\right ) \times \left ( \mathbf{k}+\mathbf{g}^{\prime } \right ) \right ] .\end{aligned}\ ] ]    for @xmath200 close to the magnetophonon resonance , we can write : @xmath201where we defined the quantity : @xmath202then , equating eq .
( [ m26 ] ) with eq .
( [ m25 ] ) for @xmath200 close to @xmath203 , we obtain : @xmath204 because @xmath205 must be equal to @xmath206 , we can finally write@xmath207or , taking the real and imaginary parts of this equation ( we remind the reader that both functions @xmath208 and @xmath191 are real ) :    @xmath209 & = & \frac{\nu } { 2}\left [ \frac{h\left ( \mathbf{k}+\mathbf{g}\right ) h\left ( \mathbf{k}+\mathbf{g}^{\prime } \right ) } { f\left ( \mathbf{k}+\mathbf{g% } \right ) f\left ( \mathbf{k}+\mathbf{g}^{\prime } \right ) } \right ]   \notag \\ & & \times \frac{\gamma _ { 1}\left ( \mathbf{k}\right ) \ell ^{4}}{\hslash \omega _ { mp}\left ( \mathbf{k}\right ) } , \\
\im \left [ w_{\mathbf{g , g}^{\prime } } ^{(grpa)}\left ( \mathbf{k}\right ) % \right ] & = & \frac{\nu } { 2}\left [ \frac{h\left ( \mathbf{k}+\mathbf{g}\right ) h\left ( \mathbf{k}+\mathbf{g}^{\prime } \right ) } { f\left ( \mathbf{k}+\mathbf{g% } \right ) f\left ( \mathbf{k}+\mathbf{g}^{\prime } \right ) } \right ]   \notag \\ & & \times \gamma _ { 2}\left ( \mathbf{k}\right ) \ell ^{2}.\end{aligned}\ ] ]    we can get rid of the unknown form factors @xmath210 if we work with the ratio of the imaginary and real parts of the weights . we thus define :    @xmath211 } { % \im \left [ w_{\mathbf{g , g}^{\prime } } ^{(grpa)}\left ( \mathbf{k}\right ) % \right ] } ,   \label{m27 }   \\ & = & \frac{-\ell ^{2}}{\hslash \omega _ { mp}\left ( \mathbf{k}\right ) } \frac{\left ( \mathbf{k}+\mathbf{g}\right ) \times d\left ( \mathbf{k}\right ) \times \left ( \mathbf{k}+\mathbf{g}^{\prime } \right ) } { \left ( \mathbf{k}+\mathbf{g}% \right ) \times \left ( \mathbf{k}+\mathbf{g}^{\prime } \right ) } .
\notag\end{aligned}\ ] ]    a careful examination shows that , because @xmath212 is given by the determinant of the dynamical matrix @xmath213 , the quantity @xmath214 is unchanged if all the components of the dynamical matrix are multiplied by some constant .
( [ m27 ] ) is thus indeterminate . to avoid this problem
, we replace @xmath215 by @xmath216 in eq .
( [ m27 ] ) .
our final result is thus:@xmath217    because @xmath218 , we need to choose three pairs of vectors @xmath219 to get the components of the dynamical matrix . to be valid , the dynamical matrix obtained in this way must satisfy the equation:@xmath220 } .
\label{m33}\ ] ] eq .
( [ m33 ] ) provides a check on the validity of our calculation .
in this section , we illustrate the application of our method by computing the lam coefficients for the triangular wigner crystal in landau levels @xmath160 and @xmath221 . fig .
[ fig3 ] shows the first two shells of reciprocal lattice vectors of the triangular lattice with @xmath222 we take the vectors @xmath38 and @xmath223 in eq .
( [ m29 ] ) on these first two shells .
not all combinations of vectors satisfy eq .
( [ m33 ] ) . by experimentation
, we found that with a combination of the form @xmath224 $ ] with @xmath225 this equation is satisfied in the irreducible brillouin zone shown in fig . 3 to better than @xmath226 for @xmath227 .
we will thus stick to this type of combination for the rest of this paper .    .
]    in the small - wavevector limit , the dynamical matrix of the wigner crystal with a triangular lattice structure is given by eq .
( [ m32 ] ) . using eq .
( [ m29 ] ) , we can extract the elastic coefficients by fitting @xmath228 along the path @xmath229 where :     of the dynamical matrix along @xmath230 computed for differents couples of vectors @xmath231 .
the numbers in the legend refer to the numerotation of the reciprocal lattice vectors shown in fig .
@xmath232    where @xmath58 and @xmath59 are expressed in units of @xmath233 .    fig .
[ fig4 ] illustrates one limitation of our method : the grpa  dynamical matrix is very much dependent on the choice of the couple ( @xmath234 ) .
different choices give the same dynamical matrices @xmath235 only in the small wavector limit @xmath236 as shown in fig .
4 and , in this limit , the dynamical matrix element @xmath237 is almost entirely dominated by the long - range coulomb term ( the first term in eq .
( [ m35 ] ) ) .
it follows that different choices of ( @xmath238 ) lead to quite different values of the elastic coefficients @xmath58 even though eq .
( m33 ) is satisfied .
the coefficient @xmath59 obtained from @xmath239 , however , is not affected by the long - range coulomb interaction and appears to be independent of the choice of ( @xmath240 ) .
note that the dynamical matrix given by eq .
( m29 ) does not have the correct transformation symmetries of the triangular lattice . in cases where @xmath241 is needed in all the brillouin zone
, it becomes necessary to compute @xmath242 in the irreducible brillouin zone and obtain @xmath243 in the rest of the brillouin zone by symmetry .
to give an idea of the variability of the numerical results with @xmath244 , we show in fig . [ fig5 ] ( for @xmath221 ) and fig .
[ fig6 ] ( for @xmath160 ) the coefficients @xmath58 and @xmath59 extracted from the grpa dynamical matric of the triangular wigner crystal for different couples of vectors @xmath244 . these coefficients are compared with those computed using the hfa described in sec .
we show the hfa results by a full line in figs .
for both @xmath160 and @xmath221 , we find that the hartree - fock results for the coefficient @xmath59 are extremely well reproduced by the grpa  method and , as we said above , do not depend on the choice of ( @xmath238 ) .
this is what we expect since the grpa  is the linear response of the crystal about the hfa ground state so that the coefficients @xmath19 obtained from the two methods should be roughly equal , taking into account the various approximations made in deriving the grpa  dynamical matrix .
the coefficient @xmath59 is easy to obtain , in view of eq .
( [ m37 ] ) , since it is given by a one - parameter fit of the @xmath245 curve .
the elastic coefficient @xmath58 ( which is related to the bulk modulus ) is , on the other hand , much more difficult to obtain from eq .
( [ m35 ] ) . indeed , this elastic coefficient turns out to be very sensitive to how accurately the long - wavelength limit @xmath246 of @xmath237 in eq .
( [ m35 ] ) is obtained by the grpa numerical calculation .
( we here note that the grpa dynamical matrix _ does _ contain the long - range coulomb interaction discussed in sec .
ii . the latter does not have to be added by hand as was the case for the elastic coefficients computed in the hfa . ) as we see in figs .
5(b ) and 6(b ) , @xmath58 is also very sensitive to the choice of the vectors ( @xmath238 ) with one particular choice ( 2,3 ) reproducing the hfa results almost exactly .
the other two choices give very different values for @xmath58 . in the absence of any criteria to choose ( @xmath238 ) a priori , we would say that the grpa  dynamical matrix can not be used to make _ quantitative _ predictions .
the _ qualitative _ behaviour of the grpa  elastic coefficient @xmath58 is consistent with that of @xmath58 computed in the hfa .
if we exclude the domain @xmath247 where our numerical results become noisy , we find that the average of the grpa results for the three couples of ( @xmath238 ) , as shown in figs .
5(b ) and 6(b ) , are in very good agreement with the hf calculation . in the absence of any criteria to choose the best couple ( @xmath238 ) , this averaging procedure must be used to get qualitatively and quantitatively reliable results for the grpa dynamical matrix .
for @xmath247 , the crystal softens and the quantum fluctuations in @xmath248 are important .
there is a transition@xcite into a bubble state with 2 electrons per unit cell at approximately @xmath249 .
we do not expect the assumptions underlying our method to be valid in this region .     and ( b ) @xmath58 of the triangular wigner crystal for landau level @xmath221 computed using the different approximations listed in the legend . for the grpa , the coefficients are computed using @xmath250 differents couples of reciprocal lattice vectors . the numbers in the legend correspond to the numeration of the vectors given in fig .
the empty circles give an average of the 3 grparesults .
for @xmath59 the different symbols are superimposed . ]     and ( b ) @xmath58 of the triangular wigner crystal in landau level @xmath160 computed in the different approximations indicated in the legend . for the grpa ,
the coefficients are computed using @xmath250 differents couples of reciprocal lattice vectors .
the numbers in the legend correspond to the numeration of the vectors given in fig .
the empty circles give the average of the 3 grpa  results .
for @xmath251 the different symbols are superimposed . ]
for the stripe crystal , the dynamical matrix is given by :    @xmath252    [ zz ]    and the elastic coefficients evaluated in the hfa@xcite for landau level @xmath221 are listed in table [ table1 ] .
.elastic coefficients @xmath253 in units of @xmath254 for the stripe crystal at various filling factors and in landau level @xmath221 . [ cols="<,<,<,<,<",options="header " , ]         the first 4 shells of reciprocal lattice vectors of the stripe crystal are represented in fig . 7 . from eq .
( [ m29 ] ) , the vectors ( @xmath255 ) must not be parallel otherwise the denominator in this equation vanishes .
this forces us to use @xmath38 in the second shell and @xmath223 in the fourth shell of reciprocal lattice vectors to evaluate the dm in the grpa .
we show in figs .
8 - 10 the elements @xmath256 and @xmath257 computed at filling factor @xmath258 ( in landau level @xmath221 ) along different directions in @xmath39-space together with the corresponding dm in the hfa element obtained from eqs .
( [ zz ] ) with the coefficients of table [ table1 ] .
similar results are obtained at other filling factors .
notice that the bending coefficient @xmath259does not contribute to any of these curves . for each curve , eq .
( [ m33 ] ) is perfectly satisfied and the coefficient @xmath59 , which can be extracted from the grpa@xmath260function @xmath261 , is in excellent agreement with the hfa results given in table [ table1 ] .     of the grpa and hfa dynamical matrices of the stripe crystal computed along the direction @xmath262 for partial filling factor @xmath263 in landau level @xmath221 , computed using @xmath162 differents couples of reciprocal lattice vectors .
the numbers in the legend refer to numbering of the reciprocal lattice vectors in fig . 7 . ]     of the grpa and hfa dynamical matrices of the stripe crystal computed along the direction @xmath264 for partial filling factor @xmath263 in landau level @xmath265 , computed using @xmath162 differents couples of reciprocal lattice vectors .
the numbers in the legend refer to numbering of the reciprocal lattice vectors in fig .
7 . ]     of the grpa and hfa dynamical matrices of the stripe crystal computed along the direction @xmath266 for partial filling factor @xmath263 in landau level @xmath221 , computed using @xmath162 differents couples of reciprocal lattice vectors .
the numbers in the legend refer to numbering of the reciprocal lattice vectors in fig .
7 . ]    for the grpa , figs .
8 - 10 show results for the couples ( @xmath238 ) that produce the maximum and minimum values of the dm element . in all but the @xmath267 case
, the hfa curve lies between these two results . for @xmath267 , one of the grpa curves almost coincides with the hfa result for @xmath268
this is reassuring for the validity of the grpa method , but it also makes it impossible for us to find what part of the difference between the grpa and hfa is numerical and what part is physical ( i.e. due to anharmonicity for example ) .
we remark that , in the range @xmath269 , the grparesults are not numerically very different from the small @xmath270 expansion of the dynamical matrix given in eqs .
( [ zz ] ) with the hfa coefficients . to the credit of our grpa method
, we add that the evolution of the different @xmath271 s with filling factor is consistent with that of the corresponding elements calculated in the hfa as shown in fig .
we thus see that the evaluation of the elastic coefficients other than @xmath59 from the grpa results seems hazardous for the stripe crystal . the curvature of the functions @xmath256 and @xmath257 in figs .
8,9,10 is proportional to @xmath272 and @xmath130 respectively .
it is clear that the elastic coefficients extracted from these @xmath271 are much bigger than those obtained from the hfa ( the curvature of the hfa  function is barely visible in the figures ) .
these coefficients also show very strong variation with the choice of ( @xmath238 ) .
an averaging of the grpa  results for different couples ( @xmath238 ) would give a result closer to the hfa but the improvement would not be as dramatic as in the triangular lattice case .
in fact , in the case of @xmath257 , we find that averaging over different choices of reciprocal lattice vectors does not bring any improvement to the numerical results .     of the grpa and hfa dynamical matrices of the stripe crystal computed along the direction @xmath273 for different filling factors in landau level @xmath221 .
]    finally , we remark that our grpa results for @xmath274 are dominated by a strong @xmath275 behavior indicating that the bending term @xmath276 is absolutely essential in the elastic description of the stripe crystal in eqs .
( [ zz ] ) .
in conclusion , in this paper we have shown that is it possible to derive an effective dynamical matrix for various crystal states of the 2deg in a strong magnetic field by computing the density response function in the grpa .
we have compared the dynamical matrix obtained in this way with the one obtained from standard elasticity theory with elastic coefficients computed in the hfa .
our comparison was done for crystals with very different elastic properties , namely a triangular wigner crystal and stripe crystal .
our motivation for deriving a dynamical matrix using the grpa response consists in the fact that the latter has the advantage of giving the dynamical matrix directly without having to compute the elastic coefficients separately . our comparison with the hartree - fock results showed , however , that the grpa method must be used with care because of the variability of the results with the choice of the couples @xmath277 .
the shear modulus @xmath59 computed in the grpa agrees very well with the one computed from the hfa , but the values of the other elastic coefficients @xmath19 which are affected by the long range coulomb interaction depend very much on the choice of the couples @xmath277 . in some cases , as for a triangular wigner crystal , an averaging procedure over different couples
@xmath278 improves the numerical accuracy of the method . in the long wavelength @xmath279 limit , however , the grpa dynamical matrix is a good approximation , both qualitatively and quantitatively , and gives reasonable estimates for the elastic constants of the electronic solids that are in agreement with the static hartree - fock calculations .    this work was supported by a research grant ( for r. ct ) from the natural sciences and engineering research council of canada ( nserc ) .
c. b. doiron acknowledges support from nserc , the fonds qubcois de recherche sur la nature et les technologies ( fqrnt ) , the swiss nsf and nccr nanoscience .
computer time was provided by the rseau qubcois de calcul haute performance ( rqchp ) .
99 p. k. lam and s. m. girvin , phys .
b * 30 * , 473 ( 1984 ) ; d. levesque , j. j. weis , and a. h. macdonald , phys . rev .
b * 30 * , 1056 ( 1984 ) ; k. esfarjani and s. t. chui , phys . rev .
b * 42 * , 10758 ( 1990 ) ; k. yang , f. d. m. haldane , and e. h. rezayi , phys . rev .
b * 64 * , 081301(r ) ( 2001 ) ; x. zhu and s. g. louie , phys . rev .
b * 52 * , 5863 ( 1995 ) .    for recent reviews , see physics of the electron solid , edited by s. t. chui ( international press , boston ( 1994 ) and h. fertig and h. shayegan in perspectives in quantum hall effects , edited by s. das sarma and a. pinczuk ( wiley , new york , 1997 ) , chaps . 5 and 9 respectively .
r. m. lewis , p. d. ye , l. w. engel , d. c. tsui , l. n. pfeiffer , and k. w. west , phys .
lett . * 89 * , 136804 ( 2002 ) ; r. m. lewis , y. chen , l. w. engel , d. c. tsui , p. d. ye , l. n. pfeiffer , and k. w. west phys .
93 * , 176808 ( 2004 ) ; r. m. lewis , yong chen , l. w. engel , p. d. ye , d. c. tsui , l. n. pfeiffer , and k. w. west , physica e**22 * * , 119 ( 2004 ) .
r. ct , c. b. doiron , j. bourassa , and h. a. fertig , phys .
b * 68 * , 155327 ( 2003 ) ; m .- r .
li , h. a. fertig , r. ct , and hangmo yi , phys .
lett . *  92 * , 186804 ( 2004 ) ; mei - rong li , h. a. fertig , r. ct , and hangmo yi , phys .
b * 71 * , 155312 ( 2005 ) ; r. ct , mei - rong li , a. faribault , and h. a. fertig , phys . rev .
b * 72 * , 115344 ( 2005 ) .
these coefficients were evaluated previously in refs . .
we remark however that there was an error in the evaluation of the coefficient @xmath58 in ref . that we have corrected in the present paper .
our previous calculation underestimated the value of @xmath58 by a factor of approximately @xmath250 .
note also that in the present paper the stripes are aligned along the @xmath25 axis while they were aligned along @xmath24 in our previous calculation so that @xmath280 .


graphical models are used in many application domains , running the gamut from computer vision and civil engineering to political science and epidemiology . in many applications , estimating the edge structure of an underlying graphical model is of significant interest .
for instance , a graphical model may be used to represent friendships between people in a social network  @xcite or links between organisms with the propensity to spread an infectious disease  @xcite .
it is a classical corollary of the hammersley
clifford theorem  @xcite that zeros in the inverse covariance matrix of a multivariate gaussian distribution indicate absent edges in the corresponding graphical model .
this fact , combined with various types of statistical estimators suited to high dimensions , has been leveraged by many authors to recover the structure of a gaussian graphical model when the edge set is sparse ( see the papers  @xcite and the references therein ) .
recently , liu et al .
@xcite and liu , lafferty and wasserman @xcite introduced the notion of a  nonparanormal distribution , which generalizes the gaussian distribution by allowing for monotonic univariate transformations , and argued that the same structural properties of the inverse covariance matrix carry over to the nonparanormal ; see also the related work of xue and zou  @xcite on copula transformations .
however , for non - gaussian graphical models , the question of whether a general relationship exists between conditional independence and the structure of the inverse covariance matrix remains unresolved . in this paper , we establish a number of interesting links between covariance matrices and the edge structure of an underlying graph in the case of discrete - valued random variables .
( although we specialize our treatment to multinomial random variables due to their widespread applicability , several of our results have straightforward generalizations to other types of exponential families . ) instead of only analyzing the standard covariance matrix , we show that it is often fruitful to augment the usual covariance matrix with higher - order interaction terms .
our main result has an interesting corollary for tree - structured graphs : for such models , the inverse of a generalized covariance matrix is always ( block ) graph - structured . in particular , for binary variables ,
the inverse of the usual covariance matrix may be used to recover the edge structure of the tree .
we also establish more general results that apply to arbitrary ( nontree ) graphs , specified in terms of graph triangulations .
this more general correspondence exploits ideas from the geometry of exponential families  @xcite , as well as the junction tree framework  @xcite .
as we illustrate , these population - level results have a number of corollaries for graph selection methods .
graph selection methods for gaussian data include neighborhood regression  @xcite and the graphical lasso  @xcite , which corresponds to maximizing an @xmath0-regularized version of the gaussian likelihood .
alternative methods for selection of discrete graphical models include the classical chow  liu algorithm for trees  @xcite ; techniques based on conditional entropy or mutual information  @xcite ; and nodewise logistic regression for discrete graphical models with pairwise interactions
our population - level results imply that minor variants of the graphical lasso and neighborhood regression methods , though originally developed for gaussian data , remain consistent for trees and the broader class of graphical models with singleton separator sets .
they also convey a cautionary message , in that these methods will be inconsistent ( generically ) for other types of graphs .
we also describe a new method for neighborhood selection in an arbitrary sparse graph , based on linear regression over subsets of variables .
this method is most useful for bounded - degree graphs with correlation decay , but less computationally tractable for larger graphs .
in addition , we show that our methods for graph selection may be adapted to handle noisy or missing data in a seamless manner . naively applying nodewise logistic regression when
observations are systematically corrupted yields estimates that are biased even in the limit of infinite data .
there are various corrections available , such as multiple imputation  @xcite and the expectation - maximization ( em ) algorithm  @xcite , but , in general , these methods are not guaranteed to be statistically consistent due to local optima . to the best of our knowledge
, our work provides the first method that is provably consistent under high - dimensional scaling for estimating the structure of discrete graphical models with corrupted observations .
further background on corrupted data methods for low - dimensional logistic regression may be found in carroll , ruppert and stefanski @xcite and ibrahim et al .
@xcite .
the remainder of the paper is organized as follows . in section  [ secbackground ] , we provide brief background and notation on graphical models and describe the classes of augmented covariance matrices we will consider . in section  [ secresults ] , we state our main population - level result ( theorem  [ thmfull ] ) on the relationship between the support of generalized inverse covariance matrices and the edge structure of a discrete graphical model , and then develop a number of corollaries
. the proof of theorem  [ thmfull ] is provided in section  [ secproofthmfull ] , with proofs of corollaries and more technical results deferred to the supplementary material @xcite . in section  [ secsample ] , we develop consequences of our population - level results in the context of specific methods for graphical model selection .
we provide simulation results in section  [ secsims ] in order to confirm the accuracy of our theoretically - predicted scaling laws , dictating how many samples are required ( as a function of graph size and maximum degree ) to recover the graph correctly .
in this section , we provide background on graphical models and exponential families .
we then present a simple example illustrating the phenomena and methodology underlying this paper .
an _ undirected graphical model _ or _ markov random field _ ( mrf ) is a family of probability distributions respecting the structure of a fixed graph .
we begin with some basic graph - theoretic terminology .
an undirected graph @xmath1 consists of a collection of vertices @xmath2 and a collection of unordered and the edge @xmath3 . in this paper , we forbid graphs with self - loops , meaning that @xmath4 for all @xmath5 . ] vertex pairs @xmath6 . a  _
vertex cutset _ is a subset  @xmath7 of vertices whose removal breaks the graph into two or more nonempty components [ see figure  [ figgraphprops](a ) ] .
clique _ is a subset @xmath8 such that @xmath9 for all distinct @xmath10 .
the cliques in figure  [ figgraphprops](b ) are all _ maximal _ , meaning they are not properly contained within any other clique . for @xmath11 , we define the neighborhood @xmath12 to be the set of vertices connected to @xmath13 by an edge .    for an undirected graph @xmath14
, we associate to each vertex @xmath15 a random variable  @xmath16 taking values in a space @xmath17 . for any subset @xmath18
, we define @xmath19 , and for three subsets of vertices , @xmath20 , @xmath21 and @xmath7 , we write @xmath22 to mean that the random vector @xmath23 is conditionally independent of @xmath24 given @xmath25 . the notion of a markov random field
may be defined in terms of certain _ markov properties _ indexed by vertex cutsets or in terms of a _ factorization property _
described by the graph cliques .    [ cols="^,^ " , ]
still focusing on the single - cycle graph in panel  ( b ) , suppose that instead of considering the ordinary covariance matrix , we compute the covariance matrix of the _ augmented _ random vector @xmath26 , where the extra term @xmath27 is represented by the dotted edge shown in panel  ( c ) .
the @xmath28 inverse of this generalized covariance matrix takes the form @xmath29.\ ] ] this matrix safely separates nodes @xmath30 and @xmath31 , but the entry corresponding to the nonedge @xmath32 is _ not _ equal to zero .
indeed , we would observe a similar phenomenon if we chose to augment the graph by including the edge @xmath33 rather than @xmath32 .
this example shows that the usual inverse covariance matrix is not always graph - structured , but inverses of augmented matrices involving higher - order interaction terms may reveal graph structure .
now let us consider a more general graphical model that adds the 3-clique interaction terms shown in panel  ( d ) to the usual ising terms .
we compute the covariance matrix of the augmented vector @xmath34 empirically , one may show that the @xmath35 inverse @xmath36)^{-1}$ ] respects aspects of the graph structure : there are zeros in position @xmath37 , corresponding to the associated functions @xmath38 and @xmath39 , whenever @xmath40 and @xmath41 do not lie within the same maximal clique .
[ e.g. , this applies to the pairs @xmath42 and @xmath43 . ]
the goal of this paper is to understand when certain inverse covariances do ( and _ do not _ ) capture the structure of a graphical model . at its root is the principle that the augmented inverse covariance matrix @xmath44 , suitably defined , is _ always _ graph - structured with respect to a graph triangulation . in some cases [ e.g. , the dino graph in figure  [ figgraphs](e ) ]
, we may leverage the block - matrix inversion formula  @xcite , namely , @xmath45 to conclude that the inverse of a sub - block of the augmented matrix ( e.g. , the ordinary covariance matrix ) is still graph - structured .
this relation holds whenever @xmath20  and  @xmath21 are chosen in such a way that the second term in equation  ( [ eqnchai ] ) continues to respect the edge structure of the graph .
these ideas will be made rigorous in theorem  [ thmfull ] and its corollaries in the next section .
we now state our main results on the relationship between the zero pattern of generalized ( augmented ) inverse covariance matrices and graph structure . in section  [ secsample ] to follow , we develop some consequences of these results for data - dependent estimators used in structure estimation .    we begin with some notation for defining generalized covariance matrices , stated in terms of the sufficient statistics previously defined  ( [ eqnsuff ] ) . recall that a  clique @xmath46 is associated with the collection @xmath47 of binary - valued sufficient statistics .
let @xmath48 , and define the random vector @xmath49 consisting of all the sufficient statistics indexed by elements of @xmath50 .
as in the previous section , the set @xmath51 contains both maximal and nonmaximal cliques .    we will often be interested in situations where @xmath50 contains all subsets of a given set . for a subset @xmath18 ,
let @xmath52 denote the collection of all @xmath53 nonempty subsets of @xmath20 .
we extend this notation to @xmath50 by defining @xmath54      our first main result concerns a connection between the inverses of generalized inverse covariance matrices associated with the model  ( [ eqngeneralmultinomial ] ) and any triangulation of the underlying graph @xmath55 .
the notion of a triangulation is defined in terms of chordless cycles , which are sequences of distinct vertices @xmath56 such that :    * @xmath57 for all @xmath58 , and also @xmath59 ; * no other nodes in the cycle are connected by an edge .    as an illustration ,
the @xmath31-cycle in figure  [ figgraphs](b ) is a chordless cycle .
given an undirected graph @xmath1 , a _
triangulation _ is an augmented graph @xmath60 that contains no chordless cycles of length greater than 3 .
note that a tree is trivially triangulated , since it contains no cycles . on the other hand ,
the chordless @xmath31-cycle in figure  [ figgraphs](b ) is the simplest example of a nontriangulated graph . by adding the single edge @xmath32 to form the augmented edge set @xmath61
, we obtain the triangulated graph @xmath62 shown in panel  ( c ) .
one may check that the more complicated graph shown in figure  [ figgraphs](e ) is triangulated as well .
our first result concerns the inverse @xmath63 of the matrix @xmath64 , where @xmath65 is the set of all cliques arising from some triangulation @xmath66 of @xmath55 .
for any two subsets @xmath67 , we write @xmath68 to denote the sub - block of @xmath63 indexed by all indicator statistics on @xmath20 and @xmath21 , respectively .
( note that we are working with respect to the exponential family representation over the triangulated graph @xmath66 . )
given our previously - defined sufficient statistics  ( [ eqnsuff ] ) , the sub - block @xmath68 has dimensions @xmath69 , where @xmath70 for example , when @xmath71 and @xmath72 , the submatrix @xmath68 has dimension @xmath73 . with this notation
, we have the following result :    [ thmfull ] consider an arbitrary discrete graphical model of the form  ( [ eqngeneralmultinomial ] ) , and let @xmath74 be the set of all cliques in any triangulation of @xmath55 .
then the generalized covariance matrix @xmath64 is invertible , and its inverse @xmath63 is _ block graph - structured _ :    a.   for any two subsets @xmath75 that are not subsets of the same maximal clique , the block @xmath76 is identically zero .
b.   for almost all parameters @xmath77 , the entire block @xmath68 is nonzero whenever @xmath20  and  @xmath21 belong to a common maximal clique .    in part ( b ) , `` almost all '' refers to all parameters @xmath77 apart from a set of lebesgue measure zero .
the proof of theorem  [ thmfull ] , which we provide in section  [ secproofthmfull ] , relies on the geometry of exponential families  @xcite and certain aspects of convex analysis  @xcite , involving the log partition function @xmath78 and its fenchel  legendre dual @xmath79 .
although we have stated theorem  [ thmfull ] for discrete variables , it easily generalizes to other classes of random variables .
the only difference is the specific choices of sufficient statistics used to define the generalized covariance matrix .
this generality becomes apparent in the proof .    to provide intuition for theorem  [ thmfull ]
, we consider its consequences for specific graphs .
when the original graph is a tree [ such as the graph in figure  [ figgraphs](a ) ] , it is already triangulated , so the set @xmath80 is equal to the edge set @xmath81 , together with singleton nodes .
hence , theorem  [ thmfull ] implies that the inverse @xmath63 of the matrix of sufficient statistics for vertices and edges is graph - structured , and blocks of nonzeros in @xmath63 correspond to edges in the graph . in particular
, we may apply theorem  [ thmfull](a ) to the subsets @xmath82 and @xmath72 , where @xmath13 and @xmath83 are distinct vertices with @xmath84 , and conclude that the @xmath73 sub - block @xmath68 is equal to zero .
when @xmath14 is not triangulated , however , we may need to invert a larger augmented covariance matrix and include sufficient statistics over pairs @xmath85 as well .
for instance , the augmented graph shown in figure  [ figgraphs](c ) is a triangulation of the chordless @xmath31-cycle in panel  ( b ) .
the associated set of maximal cliques is given by @xmath86 ; among other predictions , our theory guarantees that the generalized inverse covariance @xmath63 will have zeros in the sub - block @xmath87 .
in fact , it is not necessary to take sufficient statistics over _ all _ maximal cliques , and we may consider a slightly smaller augmented covariance matrix .
( this simpler type of augmented covariance matrix explains the calculations given in section  [ secexamples ] . )    by classical graph theory , any triangulation @xmath66 gives rise to a _ junction tree _ representation of @xmath55 .
nodes in the junction tree are subsets of @xmath88 corresponding to maximal cliques of @xmath66 , and the intersection of any two adjacent cliques @xmath89 and @xmath90 is referred to as a _ separator set _ @xmath91 .
furthermore , any junction tree must satisfy the _ running intersection property _ , meaning that for any two nodes of the junction tree
say , corresponding to cliques @xmath92 and @xmath93the intersection @xmath94 must belong to every separator set on the unique path between @xmath92 and @xmath93 .
the following result shows that it suffices to construct generalized covariance matrices augmented by separator sets :    [ corsep ] let @xmath50 be the set of separator sets in any triangulation of @xmath55 , and let @xmath63 be the inverse of @xmath95 .
then @xmath96 whenever @xmath97 .
note that @xmath98 , and the set of sufficient statistics considered in corollary  [ corsep ] is generally much smaller than the set of sufficient statistics considered in theorem  [ thmfull ] .
hence , the generalized covariance matrix of corollary  [ corsep ] has a smaller dimension than the generalized covariance matrix of theorem  [ thmfull ] , which becomes significant when we consider exploiting these population - level results for statistical estimation .
the graph in figure  [ figgraphs](c ) of example  [ exasgraph ] and the associated matrix in equation  ( [ eqnaugmented ] ) provide a concrete example of corollary  [ corsep ] in action . in this case , the single separator set in the triangulation is @xmath99 , so when @xmath100 , augmenting the usual covariance matrix with the additional sufficient statistic @xmath101 and taking the inverse yields a graph - structured matrix . indeed , since @xmath102 , we observe that @xmath103 in equation  ( [ eqnaugmented ] ) , consistent with the result of corollary  [ corsep ] .
although theorem  [ thmfull ] and corollary  [ corsep ] are clean population - level results , however , forming an appropriate augmented covariance matrix requires prior knowledge of the graph , namely , which edges are involved in a suitable triangulation .
this is infeasible in settings where the goal is to recover the edge structure of the graph .
corollary  [ corsep ] is most useful for edge recovery when @xmath14 admits a triangulation with only singleton separator sets , since then @xmath104 .
in particular , this condition holds when @xmath14 is a tree .
the following corollary summarizes our result :    [ cortree ] for any graph with singleton separator sets , the inverse @xmath63 of the covariance matrix @xmath105 of vertex statistics is graph - structured .
( this class includes trees as a special case . )    in the special case of binary variables , we have @xmath106 , so corollary  [ cortree ] implies that the inverse of the ordinary covariance matrix @xmath107 is graph - structured . for @xmath108-ary variables ,
@xmath109 is a matrix of dimensions @xmath110 involving indicator functions for each variable .
again , we may relate this corollary to example  [ exasgraph]the inverse covariance matrices for the tree graph in panel  ( a ) and the dino graph in panel  ( e ) are exactly graph - structured .
although the dino graph is not a tree , it possesses the nice property that the only separator sets in its junction tree are singletons .
corollary  [ corsep ] also guarantees that inverse covariances may be partially graph - structured , in the sense that @xmath111 for any pair of vertices @xmath112 separable by a singleton separator set , where @xmath113 .
this is because for any such pair @xmath112 , we may form a junction tree with two nodes , one containing  @xmath13 and one containing @xmath83 , and apply corollary  [ corsep ] . indeed , the matrix @xmath63 defined over singleton vertices is agnostic to which triangulation we choose for the graph .    in settings where there exists a junction tree representation of the graph with only singleton separator sets , corollary  [ cortree ]
has a number of useful implications for the consistency of methods that have traditionally only been applied for edge recovery in gaussian graphical models : for tree - structured discrete graphs , it suffices to estimate the support of @xmath114 from the data .
we will review methods for gaussian graphical model selection and describe their analogs for discrete tree graphs in sections  [ secglobal ] and  [ secnodewise ] .
theorem  [ thmfull ] also has a corollary , that is , relevant for nodewise neighborhood selection approaches to graph selection  @xcite , which are applicable to graphs with arbitrary topologies .
nodewise methods use the basic observation that recovering the edge structure of @xmath55 is equivalent to recovering the neighborhood set @xmath115 for each vertex @xmath5 . for
a given node @xmath15 and positive integer @xmath116 , consider the collection of subsets @xmath117 the following corollary provides an avenue for recovering @xmath118 based on the inverse of a certain generalized covariance matrix :    [ corneigh ] for any graph and node @xmath119 with @xmath120 , the inverse @xmath63 of the matrix @xmath121 is @xmath13-block graph - structured , that is , @xmath122 whenever @xmath123 .
in particular , @xmath111 for all vertices @xmath124 .
note that @xmath125 is the set of subsets of all candidate neighborhoods of  @xmath13 of size @xmath116 .
this result follows from theorem  [ thmfull ] ( and the related corollary  [ corsep ] ) by constructing a particular junction tree for the graph , in which @xmath13 is separated from the rest of the graph by @xmath118 . due to the well - known relationship between the rows of an inverse covariance matrix and linear regression coefficients  @xcite , corollary  [ corneigh ] motivates the following neighborhood - based approach to graph selection : for a fixed vertex @xmath5 , perform a single _ linear regression _ of @xmath126 on the vector @xmath127 . via elementary algebra and an application of corollary  [ corneigh ]
, the resulting regression vector will expose the neighborhood @xmath118 in an arbitrary discrete graphical model ; that is , the indicators @xmath128 corresponding to @xmath129 will have a nonzero weight only if @xmath130 .
we elaborate on this connection in section  [ secnodewise ] .
we now turn to the proof of theorem  [ thmfull ] , which is based on certain fundamental correspondences arising from the theory of exponential families  @xcite .
recall that our exponential family  ( [ eqngeneralmultinomial ] ) has binary - valued indicator functions  ( [ eqnsuff ] ) as its sufficient statistics .
let @xmath93 denote the cardinality of this set and let @xmath131 denote the multivariate function that maps each configuration @xmath132 to the vector @xmath133 obtained by evaluating the @xmath93 indicator functions on @xmath134 . using this notation ,
our exponential family may be written in the compact form @xmath135 , where @xmath136 since this exponential family is known to be minimal , we are guaranteed  @xcite that @xmath137 \quad\mbox{and}\quad\nabla^2 \phi(\theta ) = { \operatorname{cov}}_\theta \bigl[\mathbb{i}(x ) \bigr],\ ] ] where @xmath138 and @xmath139 denote ( resp . )
the expectation and covariance taken under the density @xmath140  @xcite .
the conjugate dual  @xcite of the cumulant function is given by @xmath141 the function @xmath79 is always convex and takes values in @xmath142 . from known results
@xcite , the dual function @xmath79 is finite only for @xmath143 belonging to the marginal polytope @xmath144 the following lemma , proved in the supplementary material @xcite , provides a  connection between the covariance matrix and the hessian of @xmath79 :    [ lementropy ] consider a regular , minimal exponential family , and define @xmath145 $ ] for any fixed @xmath146 . then @xmath147 \bigr)^{-1 } & = & \nabla^2 \phi^*(\mu).\end{aligned}\ ] ]    note that the minimality and regularity of the family implies that @xmath148 $ ] is strictly positive definite , so the matrix is invertible .
for any @xmath149 , let @xmath150 denote the unique natural parameter @xmath77 such that @xmath151 .
it is known  @xcite that the negative dual function @xmath152 is linked to the shannon entropy via the relation @xmath153 in general , expression  ( [ eqndualentropy ] ) does _ not _ provide a straightforward way to compute @xmath154 , since the mapping @xmath155 may be extremely complicated . however
, when the exponential family is defined with respect to a triangulated graph , @xmath79  has an explicit closed - form representation in terms of the mean parameters @xmath156 . consider a junction tree triangulation of the graph , and let @xmath157 be the collection of maximal cliques and separator sets , respectively . by the junction tree theorem
, we have the factorization @xmath158 where @xmath159 and @xmath160 are the marginal distributions over maximal clique @xmath92 and separator set @xmath161 .
consequently , the entropy may be decomposed into the sum @xmath162 where we have introduced the clique- and separator - based entropies @xmath163 and @xmath164    given our choice of sufficient statistics  ( [ eqnsuff ] ) , we show that @xmath159 and @xmath160 may be written explicitly as `` local '' functions of mean parameters associated with @xmath92  and  @xmath161 . for each subset @xmath165 ,
let @xmath166 be the associated collection of mean parameters , and let @xmath167 be the set of mean parameters associated with all nonempty subsets of @xmath20 .
note that @xmath168 contains a total of @xmath169 parameters , corresponding to the number of degrees of freedom involved in specifying a marginal distribution over the random vector @xmath170 .
moreover , @xmath168 uniquely determines the marginal distribution @xmath171 :    [ lemmapping ] for any marginal distribution @xmath171 in the @xmath172-dimensional probability simplex , there is a unique mean parameter vector @xmath168 and matrix @xmath173 such that @xmath174 .    for the proof , see the supplementary material @xcite .
we now combine the dual representation  ( [ eqndualentropy ] ) with the decomposition  ( [ eqnplainentropy ] ) , along with the matrices @xmath175 from lemma  [ lemmapping ] , to conclude that @xmath176 now consider two subsets @xmath75 that are not contained in the same maximal clique .
suppose @xmath20 is contained within maximal clique @xmath92 .
differentiating expression  ( [ eqnentropyexp ] ) with respect to @xmath177 preserves only terms involving @xmath159 and @xmath160 , where @xmath161  is any separator set such that @xmath178 . since @xmath179 , we clearly can not have @xmath180 .
consequently , all cross - terms arising from the clique @xmath92 and its associated separator sets vanish when we take a second derivative with respect to @xmath181 . repeating this argument for any other maximal clique @xmath182 containing @xmath20 but
not @xmath21 , we have @xmath183 .
this proves part ( a ) .    turning to part ( b ) ,
note that if @xmath20 and @xmath21 are in the same maximal clique , the expression obtained by taking second derivatives of the entropy results in an algebraic expression with only finitely many solutions in the parameters @xmath156 ( consequently , also @xmath77 ) . hence , assuming the @xmath77 s are drawn from a continuous distribution , the corresponding values of the block @xmath68 are a.s . nonzero .
moving beyond the population level , we now state and prove several results concerning the statistical consistency of different methods  both known and some novel  for graph selection in discrete graphical models , based on i.i.d
. draws from a discrete graph . for sparse gaussian models ,
existing methods that exploit sparsity of the inverse covariance matrix fall into two main categories : global graph selection methods ( e.g. ,  @xcite ) and local ( nodewise ) neighborhood selection methods  @xcite .
we divide our discussion accordingly .
we begin by describing how a combination of our population - level results and some concentration inequalities may be leveraged to analyze the statistical behavior of log - determinant methods for discrete graphical models with singleton separator sets , and suggest extensions of these methods when observations are systematically corrupted by noise or missing data . given a @xmath184-dimensional random vector @xmath185 with covariance @xmath186 , consider the estimator @xmath187 where @xmath188 is an estimator for @xmath186 . for multivariate gaussian data ,
this program is an @xmath0-regularized maximum likelihood estimate known as the _ graphical lasso _ and is a well - studied method for recovering the edge structure in a gaussian graphical model  @xcite .
although the program  ( [ eqnlogdet ] ) has no relation to the mle in the case of a discrete graphical model , it may still be useful for estimating @xmath189 .
indeed , as shown in ravikumar et al .
@xcite , existing analyses of the estimator  ( [ eqnlogdet ] ) require only tail conditions such as sub - gaussianity in order to guarantee that the sample minimizer is close to the population minimizer .
the analysis of this paper completes the missing link by guaranteeing that the population - level inverse covariance is in fact graph - structured .
consequently , we obtain the interesting result that the program  ( [ eqnlogdet])even though it is ostensibly derived from gaussian considerations  is a consistent method for recovering the structure of any binary graphical model with singleton separator sets .    in order to state our conclusion precisely ,
we introduce additional notation .
consider a general estimate @xmath188 of the covariance matrix @xmath190 such that @xmath191 & \leq & c \exp \bigl(- \psi(n , p ) \bigr)\end{aligned}\ ] ] for functions @xmath192 and @xmath193 , where @xmath194 denotes the elementwise @xmath195-norm . in the case of fully - observed i.i.d .
data with sub - gaussian parameter @xmath196 , where @xmath197 is the usual sample covariance , this bound holds with @xmath198 and @xmath199 .    as in past analysis of the graphical lasso  @xcite , we require a certain _ mutual incoherence _ condition on the true covariance matrix @xmath186 to control the correlation of nonedge variables with edge variables in the graph .
let @xmath200 , where @xmath201 denotes the kronecker product .
then @xmath202 is a @xmath203 matrix indexed by vertex pairs .
the incoherence condition is given by @xmath204,\ ] ] where @xmath205 is the set of vertex pairs corresponding to nonzero entries of the precision matrix @xmath206 , equivalently , the edge set of the graph , by our theory on tree - structured discrete graphs .
for more intuition on the mutual incoherence condition , see ravikumar et al .
@xcite .    with this notation , our global edge recovery algorithm proceeds as follows :    [ alggraphlasso ]    1 .
form a suitable estimate @xmath188 of the true covariance matrix @xmath190 .
2 .   optimize the graphical lasso program  ( [ eqnlogdet ] ) with parameter @xmath207 , and denote the solution by @xmath208 .
3 .   threshold the entries of @xmath209 at level @xmath210 to obtain an estimate of @xmath206 .
it remains to choose the parameters @xmath211 . in the following corollary
, we will establish statistical consistency of @xmath209 under the following settings : @xmath212 where @xmath40 is the incoherence parameter in inequality  ( [ eqnmatincoherence ] ) and @xmath213 are universal positive constants .
the following result applies to algorithm  [ alggraphlasso ] when @xmath188 is the sample covariance matrix and @xmath211 are chosen as in equations  ( [ eqnlambdatau ] ) :    [ corglobising ] consider an ising model  ( [ eqnising ] ) defined by an undirected graph with singleton separator sets and with degree at most @xmath116 , and suppose that the mutual incoherence condition  ( [ eqnmatincoherence ] ) holds . with @xmath214 samples , there are universal constants @xmath215 such that with probability at least @xmath216 , algorithm  [ alggraphlasso ] recovers all edges @xmath112 with @xmath217 .
the proof is contained in the supplementary material @xcite ; it is a relatively straightforward consequence of corollary  [ corsep ] and known concentration properties of @xmath188 as an estimate of the population covariance matrix .
hence , if @xmath217 for all edges @xmath218 , corollary  [ corglobising ] guarantees that the log - determinant method plus thresholding recovers the full graph exactly .    in the case of the standard sample covariance matrix ,
a variant of the graphical lasso has been implemented by banerjee , el ghaoui and daspremont @xcite .
our analysis establishes consistency of the graphical lasso for ising models on single separator graphs using @xmath219 samples .
this lower bound on the sample size is unavoidable , as shown by information - theoretic analysis  @xcite , and also appears in other past work on ising models  @xcite .
our analysis also has a _ cautionary message _ :
the proof of corollary  [ corglobising ] relies heavily on the population - level result in corollary  [ cortree ] , which ensures that @xmath206 is graph - structured when @xmath14 has only singleton separators . for a general graph
, we have no guarantees that @xmath206 will be graph - structured [ e.g. , see panel  ( b ) in figure  [ figgraphs ] ] , so the graphical lasso  ( [ eqnlogdet ] ) is _ inconsistent in general_.    on the positive side , if we restrict ourselves to tree - structured graphs , the estimator  ( [ eqnlogdet ] ) is attractive , since it relies only on an estimate @xmath188 of the population covariance @xmath186 that satisfies the deviation condition  ( [ eqnlogdettreecond ] ) .
in particular , even when the samples @xmath220 are contaminated by noise or missing data , we may form a good estimate @xmath188 of @xmath186 . furthermore
, the program  ( [ eqnlogdet ] ) is always convex regardless of whether @xmath188 is positive semidefinite .    as a concrete example of
how we may correct the program  ( [ eqnlogdet ] ) to handle corrupted data , consider the case when each entry of @xmath221 is missing independently with probability @xmath222 , and the corresponding observations @xmath223 are zero - filled for missing entries .
a natural estimator is @xmath224 where @xmath225 denotes elementwise division by the matrix @xmath226 with diagonal entries @xmath227 and off - diagonal entries @xmath228 , correcting for the bias in both the mean and second moment terms . the deviation condition  ( [ eqnlogdettreecond ] ) may be shown to hold w.h.p . , where @xmath229 scales with @xmath227 ( cf .
loh and wainwright  @xcite ) .
similarly , we may derive an appropriate estimator @xmath188 for other forms of additive or multiplicative corruption .
generalizing to the case of @xmath108-ary discrete graphical models with @xmath230 , we may easily modify the program  ( [ eqnlogdet ] ) by replacing the elementwise @xmath0-penalty by the corresponding group @xmath0-penalty , where the groups are the indicator variables for a given vertex .
precise theoretical guarantees follow from results on the group graphical lasso  @xcite .      turning to local neighborhood selection methods ,
recall the neighborhood - based method due to meinshausen and bhlmann  @xcite . in a gaussian graphical model ,
the column corresponding to node @xmath13 in the inverse covariance matrix @xmath231 is a scalar multiple of @xmath232 , the limit of the linear regression vector for @xmath16 upon  @xmath233 .
based on @xmath234 i.i.d .
samples from a @xmath184-dimensional multivariate gaussian distribution , the support of the graph may then be estimated consistently under the usual lasso scaling @xmath235 , where @xmath236 .    motivated by our population - level results on the graph structure of the inverse covariance matrix ( corollary  [ cortree ] ) ,
we now propose a method for neighborhood selection in a tree - structured graph .
although the method works for arbitrary @xmath108-ary trees , we state explicit results only in the case of the binary ising model to avoid cluttering our presentation .
the method is based on the following steps . for each node @xmath11
, we first perform @xmath0-regularized linear regression of @xmath16 against @xmath233 by solving the modified lasso program @xmath237 where @xmath238 is a constant , @xmath239 are suitable estimators for @xmath240 , and @xmath207 is an appropriate parameter .
we then combine the neighborhood estimates over all nodes via an and operation [ edge @xmath112 is present if both @xmath13 and @xmath83 are inferred to be neighbors of each other ] or an or operation ( at least one of @xmath13 or @xmath83 is inferred to be a neighbor of the other ) .    note that the program  ( [ eqnnoisylasso ] ) differs from the standard lasso in the form of the constraint .
indeed , the normal setting of the lasso assumes a linear model where the predictor and response variables are linked by independent sub - gaussian noise , but this is not the case for @xmath16 and @xmath233 in a discrete graphical model .
furthermore , the generality of the program  ( [ eqnnoisylasso ] ) allows it to be easily modified to handle corrupted variables via an appropriate choice of @xmath241 , as in loh and wainwright  @xcite .
the following algorithm summarizes our nodewise regression procedure for recovering the neighborhood set @xmath118 of a given node @xmath13 :    [ algnodewise ]    1 .
form a suitable pair of estimators @xmath242 for covariance submatrices ( @xmath243 , @xmath244 ) .
2 .   optimize the modified lasso program  ( [ eqnnoisylasso ] ) with parameter @xmath207 , and denote the solution by @xmath245 .
3 .   threshold the entries of @xmath245 at level @xmath210 , and define the estimated neighborhood set @xmath246 as the support of the thresholded vector .    in the case of fully observed i.i.d .
observations , we choose @xmath247 to be the recentered estimators @xmath248 and assign the parameters @xmath211 according to the scaling @xmath249 where @xmath250 and @xmath192 is some parameter such that @xmath251 is sub - gaussian with parameter @xmath252 for any @xmath116-sparse vector @xmath253 , and @xmath192 is independent of @xmath253 . the following result applies to algorithm  [ algnodewise ] using the pairs @xmath247 and @xmath254 defined as in equations  ( [ eqnlassopair ] ) and  ( [ eqnlambdatau2 ] ) , respectively .
[ propising ] suppose we have i.i.d .
observations @xmath220 from an ising model and that @xmath255 . then there are universal constants @xmath256 such that with probability greater than @xmath216 , for any node @xmath257 , algorithm  [ algnodewise ] recovers all neighbors @xmath130 for which @xmath258 .
we prove this proposition in the supplementary material @xcite , as a corollary of a more general theorem on the @xmath195-consistency of the program  ( [ eqnnoisylasso ] ) for estimating  @xmath259 , allowing for corrupted observations .
the theorem builds upon the analysis of loh and wainwright  @xcite , introducing techniques for @xmath195-bounds and departing from the framework of a linear model with independent sub - gaussian noise .    regarding the sub - gaussian parameter @xmath192 appearing in proposition  [ propising ] , note that we may always take @xmath260 , since @xmath261 when @xmath253 is @xmath116-sparse and @xmath221 is a binary vector .
this leads to a sample complexity requirement of @xmath262 .
we suspect that a tighter analysis , possibly combined with assumptions about the correlation decay of the graph , would reduce the sample complexity to the scaling @xmath263 , as required by other methods with fully observed data  @xcite .
see the simulations in section  [ secsims ] for further discussion .
for corrupted observations , the strength and type of corruption enters into the factors @xmath264 appearing in the deviation bounds  ( c.2a ) and  ( c.2b ) below , and proposition  [ propising ] has natural extensions to the corrupted case .
we emphasize that although analogs of proposition  [ propising ] exist for other methods of graph selection based on logistic regression and/or mutual information , the theoretical analysis of those methods does not handle corrupted data , whereas our results extend easily with the appropriate scaling .    in the case of @xmath108-ary tree - structured graphical models with @xmath265
, we may perform multivariate regression with the multivariate group lasso  @xcite for neighborhood selection , where groups are defined ( as in the log - determinant method ) as sets of indicators for each node .
the general relationship between the best linear predictor and the block structure of the inverse covariance matrix follows from block matrix inversion , and from a population - level perspective , it suffices to perform multivariate linear regression of all indicators corresponding to a given node against all indicators corresponding to other nodes in the graph .
the resulting vector of regression coefficients has nonzero blocks corresponding to edges in the graph .
we may also combine these ideas with the group lasso for multivariate regression  @xcite to reduce the complexity of the algorithm .      moving on from tree - structured graphical models ,
our method suggests a graph recovery method based on nodewise linear regression for general discrete graphs .
note that by corollary  [ corneigh ] , the inverse of @xmath266 is @xmath13-block graph - structured , where @xmath116 is such that @xmath267 .
it suffices to perform a single multivariate regression of the indicators @xmath268 corresponding to node @xmath13 upon the other indicators in @xmath269 .
we again make precise statements for the binary ising model ( @xmath270 ) . in this case , the indicators @xmath271 corresponding to a subset of vertices @xmath7 of size @xmath272 are all @xmath273 distinct products of variables @xmath274 , for @xmath275 . hence , to recover the @xmath116 neighbors of node @xmath13 , we use the following algorithm . note that knowledge of an upper bound @xmath116 is necessary for applying the algorithm .
[ algnontreenodecay ]    1 .
use the modified lasso program  ( [ eqnnoisylasso ] ) with a suitable choice of @xmath247 and regularization parameter @xmath207 to perform a linear regression of @xmath16 upon all products of subsets of variables of @xmath233 of size at most @xmath116 .
denote the solution by @xmath245 .
threshold the entries of @xmath245 at level @xmath210 , and define the estimated neighborhood set @xmath246 as the support of the thresholded vector .
our theory states that at the population level , nonzeros in the regression vector correspond exactly to subsets of @xmath118 .
hence , the statistical consistency result of proposition  [ propising ] carries over with minor modifications . since algorithm  [ algnontreenodecay ] is essentially a version of algorithm  [ algnontree ] with the first two steps omitted , we refer the reader to the statement and proof of corollary  [ cornontree ] below for precise mathematical statements .
note here that since the regression vector has @xmath276 components , of which are nonzero , the sample complexity of lasso regression in step  ( 1 ) of algorithm  [ algnontreenodecay ] is @xmath277 .    for graphs exhibiting correlation decay  @xcite
, we may reduce the computational complexity of the nodewise selection algorithm by prescreening the nodes of @xmath278 before performing a lasso - based linear regression .
we define the nodewise correlation according to @xmath279 and say that the graph exhibits _ correlation decay _ if there exist constants @xmath280 such that @xmath281 for all @xmath282 , where @xmath283 is the length of the shortest path between @xmath13 and @xmath83 . with this notation , we then have the following algorithm for neighborhood recovery of a fixed node @xmath13 in a graph with correlation decay :    [ algnontree ]    1 .
compute the empirical correlations @xmath284 between @xmath13 and all other nodes @xmath285 , where @xmath286 denotes the empirical distribution .
2 .   let @xmath287 be the candidate set of nodes with sufficiently high correlation .
( note that @xmath51 is a function of both @xmath13 and @xmath288 and , by convention , @xmath289 . )
use the modified lasso program  ( [ eqnnoisylasso ] ) with parameter @xmath207 to perform a linear regression of @xmath16 against @xmath290 , the set of all products of subsets of variables @xmath291 of size at most @xmath116 , together with singleton variables .
denote the solution by @xmath245 .
4 .   threshold the entries of @xmath245 at level @xmath210 , and define the estimated neighborhood set @xmath246 as the support of the thresholded vector .
note that algorithm  [ algnontreenodecay ] is a version of algorithm  [ algnontree ] with @xmath292 , indicating the absence of a prescreening step .
hence , the statistical consistency result below applies easily to algorithm  [ algnontreenodecay ] for graphs with no correlation decay .    for fully observed i.i.d .
observations , we choose @xmath241 according to @xmath293 and parameters @xmath211 as follows : for a candidate set @xmath51 , let @xmath294 denote the augmented vector corresponding to the observation @xmath221 , and define @xmath295 .
let @xmath296 .
then set @xmath297 where @xmath192 is some function such that @xmath298 is sub - gaussian with parameter @xmath299 for any @xmath300-sparse vector @xmath253 , and @xmath192 does not depend on @xmath253 .
we have the following consistency result , the analog of proposition  [ propising ] for the augmented set of vectors .
it applies to algorithm  [ algnontree ] with the pairs @xmath239 and @xmath211 chosen as in equations  ( [ eqngamparam ] ) and  ( [ eqnlambdatau3 ] ) .
[ cornontree ] consider i.i.d .
observations @xmath220 generated from an ising model satisfying the correlation decay condition  ( [ eqncorrdecay ] ) , and suppose @xmath301 then there are universal constants @xmath256 such that with probability at least @xmath302 , and for any @xmath257 :    the set @xmath51 from step ( 2 ) of algorithm  [ algnontree ] satisfies @xmath303 .
algorithm  [ algnontree ] recovers all neighbors @xmath304 such that @xmath305    the proof of corollary  [ cornontree ] is contained in the supplementary material @xcite . due to the exponential factor
@xmath306 appearing in the lower bound  ( [ eqnham ] ) on the sample size , this method is suitable only for bounded - degree graphs .
however , for reasonable sizes of @xmath116 , the dimension of the linear regression problem decreases from @xmath276 to @xmath307 , which has a significant impact on the runtime of the algorithm .
we explore two classes of bounded - degree graphs with correlation decay in the simulations of section  [ secsims ] , where we generate erds  renyi graphs with edge probability @xmath308 and square grid graphs in order to test the behavior of our recovery algorithm on nontrees .
when @xmath265 , corresponding to nonbinary states , we may combine these ideas with the overlapping group lasso  @xcite to obtain similar algorithms for nodewise recovery of nontree graphs .
however , the details are more complicated , and we do not include them here .
note that our method for nodewise recovery in nontree graphical models is again easily adapted to handle noisy and missing data , which is a clear advantage over other existing methods .
in this section we report the results of various simulations we performed to illustrate the sharpness of our theoretical claims . in all cases , we generated data from binary ising models .
we first applied the nodewise linear regression method ( algorithm [ algnodewise ] for trees ; algorithm [ algnontreenodecay ] in the general case ) to the method of @xmath0-regularized logistic regression , analyzed in past work for ising model selection by ravikumar , wainwright and lafferty @xcite .
their main result was to establish that , under certain incoherence conditions of the fisher information matrix , performing regularized logistic regression with a sample size @xmath309 is guaranteed to select the correct graph w.h.p .
thus , for any bounded - degree graph , the sample size @xmath234 need grow only logarithmically in the number of nodes @xmath184 . under this
scaling , our theory also guarantees that nodewise _ linear regression _ with @xmath0-regularization will succeed in recovering the true graph w.h.p .
@c@c@    -regularized logistic vs. linear regression methods for graph recovery .
each panel plots of the probability of correct graph recovery vs. the rescaled sample size @xmath310 ; solid curves correspond to linear regression ( method in this paper ) , whereas dotted curves correspond to logistic regression  @xcite .
curves are based on average performance over 500 trials .
simulation results for two - dimensional grids with @xmath311 neighbors , and number of nodes @xmath184 varying over @xmath312 .
consistent with theory , when plotted vs. the rescaled sample size @xmath313 , all three curves ( red , blue , green ) are well aligned with one another . both linear and logistic regression transition from failure to success at a similar point .
analogous results for an erds
renyi graph with edge probability @xmath314 .
analogous results for a chain - structured graph with maximum degree @xmath315.,title="fig : " ] & -regularized logistic vs. linear regression methods for graph recovery .
each panel plots of the probability of correct graph recovery vs. the rescaled sample size @xmath310 ; solid curves correspond to linear regression ( method in this paper ) , whereas dotted curves correspond to logistic regression  @xcite .
curves are based on average performance over 500 trials .
simulation results for two - dimensional grids with @xmath311 neighbors , and number of nodes @xmath184 varying over @xmath312 .
consistent with theory , when plotted vs. the rescaled sample size @xmath313 , all three curves ( red , blue , green ) are well aligned with one another . both linear and logistic regression transition from failure to success at a similar point .
analogous results for an erds
renyi graph with edge probability @xmath314 .
analogous results for a chain - structured graph with maximum degree @xmath315.,title="fig : " ] + & +   +    in figure  [ figsimsone ] we present the results of simulations with two goals : ( i ) to test the @xmath316 scaling of the required sample size ; and ( ii ) to compare @xmath0-regularized nodewise linear regression ( algorithms [ algnontreenodecay ] and [ algnontree ] ) to @xmath0-regularized nodewise logistic regression  @xcite .
we ran simulations for the two methods on both tree - structured and nontree graphs with data generated from a binary ising model , with node weights @xmath317 and edge weights @xmath318 . to save on computation , we employed the neighborhood screening method described in section  [ secnontree ] to prune the candidate neighborhood set before performing linear regression .
we selected a  candidate neighborhood set of size @xmath319 with highest empirical correlations , then performed a single regression against all singleton nodes and products of subsets of the candidate neighborhood set of size at most @xmath116 , via the modified lasso program  ( [ eqnnoisylasso ] ) .
the size of the candidate neighborhood set was tuned through repeated runs of the algorithm . for both methods , the optimal choice of regularization parameter @xmath207 scales as @xmath320 , and we used the same value of @xmath207 in comparing logistic to linear regression . in each panel
we plot the probability of successful graph recovery versus the rescaled sample size @xmath321 , with curves of different colors corresponding to graphs ( from the same family ) of different sizes .
solid lines correspond to linear regression , whereas dotted lines correspond to logistic regression ; panels ( a ) , ( b ) and ( c ) correspond to grid graphs , erds
renyi random graphs and chain graphs , respectively .
for all these graphs , the three solid / dotted curves for different problem sizes are well aligned , showing that the method undergoes a transition from failure to success as a function of the ratio @xmath321 .
in addition , both linear and logistic regression are comparable in terms of statistical efficiency ( the number of samples @xmath234 required for correct graph selection to be achieved ) .
@cc@     of missing data varying in @xmath322 .
panel shows simulation results for nodewise regression applied to chain graphs for varying @xmath184 and @xmath222 .
panel shows simulation results for nodewise regression applied to star graphs with maximal node degree @xmath323 and varying @xmath222.,title="fig : " ] &   of missing data varying in @xmath322 .
panel shows simulation results for nodewise regression applied to chain graphs for varying @xmath184 and @xmath222 .
panel shows simulation results for nodewise regression applied to star graphs with maximal node degree @xmath323 and varying @xmath222.,title="fig : " ] + & +   +    the main advantage of nodewise linear regression and the graphical lasso over nodewise logistic regression is that they are straightforward to correct for corrupted or missing data .
figure  [ figsimstwo ] shows the results of simulations designed to test the behavior of these corrected estimators in the presence of missing data .
panel  ( a ) shows the results of applying the graphical lasso method , as described in section  [ secglobal ] , to the dino graph of figure  [ figgraphs](e ) .
we again generated data from an ising model with node weights @xmath324 and edge weights @xmath325 .
the curves show the probability of success in recovering the 15 edges of the graph , as a function of the rescaled sample size @xmath321 for @xmath326 .
in addition , we performed simulations for different levels of missing data , specified by the parameter @xmath327 , using the corrected estimator  ( [ eqnmissdata ] ) .
note that all five runs display a transition from success probability 0 to success probability 1 in roughly the same range , as predicted by our theory .
indeed , since the dinosaur graph has only singleton , corollary  [ cortree ] ensures that the inverse covariance matrix is exactly graph - structured , so our global recovery method is consistent at the population level .
further note that the curves shift right as the fraction @xmath222 of missing data increases , since the recovery problem becomes incrementally harder .
panels ( b ) and ( c ) of figure  [ figsimstwo ] show the results of the nodewise regression method of section  [ secnodewise ] applied to chain and star graphs , with increasing numbers of nodes @xmath328 and @xmath329 , respectively . for the chain graphs in panel
( b ) , we set node weights of the ising model equal to @xmath324 and edge weights equal to @xmath325 .
for the varying - degree star graph in panel ( c ) , we set node weights equal to @xmath324 and edge weights equal to @xmath330 , where the degree @xmath116 of the central hub grows with the size of the graph as @xmath331 .
again , we show curves for different levels of missing data , @xmath332 .
the modified lasso program  ( [ eqnnoisylasso ] ) was optimized using a form of composite gradient descent due to agarwal , negahban and wainwright @xcite , guaranteed to converge to a small neighborhood of the optimum even when the problem is nonconvex  @xcite . in both the chain and star graphs , the three curves corresponding to different problem sizes @xmath184 at each value of the missing data parameter @xmath222 stack up when plotted against the rescaled sample size .
note that the curves for the star graph stack up nicely with the scaling @xmath333 , rather than the worst - case scaling @xmath334 , corroborating the remark following proposition  [ propising ] .
since @xmath335 is fixed for the chain graph , we use the rescaled sample size @xmath321 in our plots , as in the plots in figure  [ figsimsone ] . once again
, these simulations corroborate our theoretical predictions : the corrected linear regression estimator remains consistent even in the presence of missing data , although the sample size required for consistency grows as the fraction of missing data @xmath222 increases .
the correspondence between the inverse covariance matrix and graph structure of a gauss  markov random field is a classical fact with numerous consequences for estimation of gaussian graphical models .
it has been an open question as to whether similar properties extend to a broader class of graphical models . in this paper , we have provided a partial affirmative answer to this question and developed theoretical results extending such relationships to discrete undirected graphical models .    as shown by our results ,
the inverse of the ordinary covariance matrix is graph - structured for special subclasses of graphs with singleton separator sets .
more generally , we have considered inverses of _ generalized covariance matrices _ , formed by introducing indicator functions for larger subsets of variables . when these subsets are chosen to reflect the structure of an underlying junction tree , the edge structure is reflected in the inverse covariance matrix .
our population - level results have a number of statistical consequences for graphical model selection .
we have shown that our results may be used to establish consistency ( or inconsistency ) of standard methods for discrete graph selection , and have proposed new methods for neighborhood recovery which , unlike existing methods , may be applied even when observations are systematically corrupted by mechanisms such as additive noise and missing data
. furthermore , our methods are attractive in their simplicity , in that they only involve simple optimization problems .
thanks to the associate editor and anonymous reviewers for helpful feedback .