the primordial cosmic microwave background ( cmb ) was generated when photons first decoupled from the baryonic fluid when the universe was only 400,000 years old .
the vast majority of these photons travel unperturbed to the present day , and features of their angular power spectrum such as acoustic peaks and the damping tail @xcite record valuable information about cosmological parameters @xcite .
baryons and dark matter evolve from small inhomogeneities at decoupling into increasingly complicated large - scale structure which can subtly perturb the observed pattern of cmb anisotropies . assuming that the primordial cmb is gaussian , non - gaussian correlations in the observed map can be used to reconstruct the intervening large - scale structure @xcite .
in addition to the importance of learning about the large - scale structure itself , reconstruction of the weak - lensing potential generated by structure is essential to constraining tensor perturbations .
weak lensing converts a fraction of the e - mode polarization generated by scalar perturbations at the last - scattering surface into b - mode polarization in the observed map . only by subtracting this b - mode polarization
can one conclusively detect the primordial b - modes which serve as a model - independent signal of tensor perturbations @xcite .
understanding lensing reconstruction requires a more detailed discussion of how weak lensing affects the cmb .
weak gravitational lensing deflects the paths of cmb photons as they travel from the last - scattering surface to the observer .
this deflection is accomplished by a projected lensing potential which is a weighted line - of - sight integral of the gravitational potential between the observer and the surface of last - scattering . at each point on the sky , lensing remaps the temperature and polarization to that of a nearby point at the last - scattering surface , the deflection angle being the gradient of the aforementioned projected lensing potential . assuming that this deflection angle is small
, the temperature at any point can be expanded in a taylor series in the gradient of the lensing potential . in fourier space
, this expansion appears as a series of convolutions of individual temperature and projected potential modes .
the observed temperature - squared map in fourier space also appears as a convolution of individual fourier modes .
subject to an overall normalization dependent on the scale of the fourier mode , these convolutions cancel in such a manner that each fourier mode of the temperature - squared map acts as an estimator for the _ same _ fourier mode of the projected lensing potential .
lensing reconstruction as outlined above has been considered previously @xcite . in these works ,
two sources of noise were identified , and a filter of the temperature - squared map in fourier space was chosen to minimize the variance associated with lensing reconstruction subject to these noise sources .
the first source is intrinsic signal variance ; the observed large - scale structure is one arbitrary member of an ensemble of realizations allowed by theory .
the second source of noise , endemic to this method of lensing reconstruction , is a consequence of the nature of the primordial cmb . like the large - scale structure itself ,
the pattern of cmb anisotropies at the last - scattering surface is only one of many possible realizations allowed by theory .
we do not know _ a priori _ which of these realizations nature has provided us , and this uncertainty hinders our ability to deconvolve the effects of lensing from true anisotropies at the last - scattering surface .
even if the true pattern of anisotropies at the last - scattering surface was known , the finite amount of power in the cmb at small scales would still constrain lensing reconstruction .
silk damping at the last - scattering surface suppresses cmb power at small scales , while the finite resolution of any real experiment would limit the detection of any signal that is present at small scales .
lensing reconstruction fails below scales at which there is sufficient power , for the same reason that any remapping is indistinguishable given a uniform background .    here
, we consider a third source of noise neglected in previous studies .
the filtered temperature - squared map is an unbiased estimator for the lensing potential in the approximation that a correlation between two given temperature modes is induced only by the single lensing mode whose wavevector is the sum of that of the two temperature modes .
in actuality , any combination of two or more lensing modes whose wavevectors sum to this total induce correlations between the two temperature modes .
there are many such combinations , but since these correlations add incoherently we do not expect a systematic bias . nonetheless , for estimators of each individual lensing mode we must use our knowledge of other lensing modes to subtract off this unwanted bias .
this is an iterative process , and since our knowledge of the lensing map is imperfect it induces noise in lensing reconstruction .
we calculate this additional variance for various estimators constructed from cmb temperature and polarization maps , and show how it compares to the dominant noise sources for an all - sky cmb experiment with a noise - equivalent temperature of 1 @xmath1k @xmath2 . since the lensing - potential power spectrum is a measure of the theoretical uncertainty with which we can predict the value of a given lensing mode , this noise associated with lensing reconstruction causes a systematic overestimation of the lensing - potential power spectrum .
this systematic bias must be accounted for in order to compare observations with theoretical predictions .
this paper is organized as follows . in
[ s : lensing ] , we define the formalism we will use to explore the effects of weak lensing on the cmb .
the taylor expansion of the lensed cmb map in gradients of the lensing potential is given in both real and fourier space , and the power spectra and trispectra of various components of the cmb temperature map are listed for later use . in
[ s : estimators ] , we show that the fourier modes of the temperature - squared map when properly filtered can serve as estimators for the fourier modes of the displacement map with the same wave vector . using the power spectrum and trispectrum given in the preceding section , we calculate the variance associated with this estimator including a new component neglected in previous studies .
this variance is evaluated numerically using the currently favored @xmath0cdm cosmological model with baryon density @xmath3 , matter density @xmath4 , cosmological constant density @xmath5 , hubble parameter @xmath6=0.65 , and power - spectrum amplitude @xmath7 .
we then use the displacement estimator for individual fourier modes to construct an unbiased estimator for the lensing - potential power spectrum in   [ s : power ] , and calculate the variance and covariance associated with this estimator .
a few concluding remarks about the implications of our work for future studies are given in
[ s : disc ] .
the appendix contains useful formulae related to additional estimators of lensing based on polarization and a combination of temperature and polarization .
we consider weak lensing under the flat - sky approximation following refs .
@xcite . as discussed before @xcite
, weak lensing deflects the path of cmb photons resulting in a remapping of the observed temperature pattern on the sky , @xmath8 \nonumber\\          & \approx & { \theta}({\hat{\bf n } } ) + \nabla_i { \phi}({\hat{\bf n } } ) \nabla^i { \theta}({\hat{\bf n } } ) + \frac{1}{2 } \nabla_i { \phi}({\hat{\bf n } } ) \nabla_j { \phi}({\hat{\bf n } } ) \nabla^{i}\nabla^{j } { \theta}({\hat{\bf n } } ) + \ldots\end{aligned}\ ] ] where @xmath9 is the unlensed primary component of the cmb in a direction @xmath10 at the last scattering surface .
the observed , gravitationally - lensed temperature map @xmath11 in direction @xmath10 is that of the unlensed map in direction @xmath12 where @xmath13 represents the lensing deflection angle or displacement map .
although a real cmb map will include secondary contributions such as the sz effect @xcite , we assume that such effects can be distinguished by their frequency dependence @xcite .
they will not be further considered in this paper . a noise component denoted by @xmath14 due to finite experimental sensitivity
must be included as well .
thus the total observed cmb anisotropy will be @xmath15 .
taking the fourier transform of the lensed map @xmath11 under the flat - sky approximation , we write @xmath16 where @xmath17 + \frac{1}{2 } { \int \frac{d^2 { \bf l''}}{(2\pi)^2}}{\phi}({{\mathbf{l^{\prime\prime } } } } ) \\ & & \quad \times { \phi}({{\mathbf{l}}}- { { \mathbf{l^{\prime}}}}- { { \mathbf{l^{\prime\prime } } } } ) \ , ( { { \mathbf{l^{\prime\prime}}}}\cdot { { \mathbf{l^{\prime } } } } )                  \left [ ( { { \mathbf{l^{\prime\prime}}}}+ { { \mathbf{l^{\prime}}}}- { { \mathbf{l}}})\cdot                               { { \mathbf{l^{\prime}}}}\right ] + \ldots \ , .   \nonumber\end{aligned}\ ] ]    cmb correlations in fourier space can be described in terms of a power spectrum and trispectrum as defined in the usual manner , @xmath18 where the angle brackets denote ensemble averages over possible realizations of the primordial cmb , large - scale structure between the observer and the surface of last - scattering , and instrumental noise .
the subscript @xmath19 denotes the connected part of the four - point function and the superscript @xmath20 denotes the temperature map being considered ( @xmath21 or @xmath22 ) .
the lensing - potential power spectrum can be defined analogously , @xmath23 where here the angle brackets denote an average over all realizations of the large - scale structure .
we make the assumption that primordial fluctuations at the last - scattering surface are gaussian .
gaussian statistics are fully described by a power spectrum ; the gaussian four - point correlator , @xmath24 is zero .
the instrumental noise @xmath22 is also assumed to be gaussian , as is the lensing potential @xmath25 .
this second assumption is justified because the dominant contributions to the lensing potential come from intermediate redshifts @xmath26 at which linear theory holds .
using these definitions , we can calculate the anticipated power spectrum and trispectrum of the observed cmb map .
because the instrumental noise is uncorrelated with the signal , the power spectrum of the observed map is the sum of signal and noise power spectra , @xmath27 the power spectrum of the noise component is given by : @xmath28 where @xmath29 is the fraction of the sky surveyed , @xmath30 is the variance per unit area on the sky , and @xmath31 is the effective beamwidth of the instrument expressed in terms of its full - width half - maximum resolution @xmath32 . a cmb experiment that spends a time @xmath33 examining each of @xmath34 pixels with detectors of sensitivity @xmath35 will have a variance per unit area @xmath36 @xcite .
the power spectrum of the lensed cmb can be determined by inserting eq .
( [ e : thetal ] ) into eq .
( [ e : specdef ] ) as discussed in @xcite , @xmath37    \ ,                               c_l^{{\theta}{\theta } }          + { \int \frac{d^2 { \bf l}_1}{(2\pi)^2 } } c_{| { { \bf l}}- { { \bf l}}_1|}^{{\theta}{\theta } } c^{\phi\phi}_{l_1 }                  [ ( { { \bf l}}- { { \bf l}}_1)\cdot { { \bf l}}_1]^2   \ , .
\label{e : lenpow}\end{aligned}\ ] ] this result is given to linear order in the lensing - potential power spectrum @xmath38 .
lensing neither creates nor destroys power in the cmb , but merely shifts the scales on which it occurs as seen by the fact that @xmath39 the observed cmb trispectrum can be calculated in a similar manner ; under our assumptions of gaussian instrumental noise and no secondary anisotropies the trispectrum of the lensed component @xmath40 is the sole contribution to the total observed trispectrum , @xmath41 [ ( { { { \bf l}_1}}+ { { { \bf l}_3 } } ) \cdot { { { \bf l}_4 } } ]     + c^{{\phi\phi}}_{|{{\bf l}}_2+{{\bf l}}_3| } [ ( { { { \bf l}_2}}+{{{\bf l}_3 } } ) \cdot { { { \bf l}_3 } } ] [ ( { { { \bf l}_2}}+{{{\bf l}_3 } } ) \cdot { { { \bf l}_4 } } ] \big ] + \ , { \rm perm . } \ , .
\nonumber \\
\label{e : trilens}\end{aligned}\ ] ] the term shown above is manifestly symmetric under the interchange @xmath42 , while the `` + perm . ''
represents five additional terms identical in form but with the replacement of @xmath43 and @xmath44 with the other five combinations of pairs .
the total trispectrum is symmetric under the interchange of any given pair as one would expect .
having established a formalism within which to analyze weak lensing , we now consider the problem of reconstructing the lensing potential from an observed cmb temperature map .
in this section , we examine lensing reconstruction following the approach of ref .
@xcite , largely adopting their notation as well .
the only important difference in notation is that we use @xmath40 to denote the lensed temperature field and @xmath45 for the unlensed field following ref .
@xcite and most recent papers . ref .
@xcite uses the opposite convention . for @xmath46 and to linear order in @xmath25 , @xmath47 where @xmath48 and @xmath49 .
note that @xmath50 differs from the unmarked @xmath51 that first appeared in eq .
( [ e : specdef ] ) in that it denotes an ensemble average only over different gaussian realizations of the primordial cmb and instrument noise ; a fixed realization of the large - scale structure is assumed .
for the purposes of estimating the large - scale structure actually realized in our observable universe , this is the appropriate average to take to ensure that our estimators are truly unbiased for a typical realization of the primordial cmb . when calculating the noise associated with lensing - potential estimators and again for power spectrum estimation in   [ s : power ] , we will return to the full unmarked ensemble average .
( [ e : ea ] ) , an immediate consquence of eq .
( [ e : thetal ] ) , suggests that a temperature - squared map appropriately filtered in fourier space can serve as an estimator for the deflection field @xmath52 .
hu and okamoto define five different estimators for the deflection field constructed from various combinations of the temperature and polarization ; we discuss the temperature - squared estimator in this section and relegate the analogous formulae for polarization estimators to the appendix .
the minimum - variance temperature - squared estimator derived in ref .
@xcite is @xmath53 where @xmath54 @xmath55^{-1 } \
, , \ ] ] and @xmath56 .
substitution of eqs .
( [ e : ea ] ) , ( [ e : bias ] ) , ( [ e : filt ] ) , and ( [ e : norm ] ) into eq .
( [ e : est ] ) shows the desired result , @xmath57 namely that @xmath58 is indeed an unbiased estimator for the deflection field in fourier space .
we now proceed to calculate the variance of this estimator . at first
, we assume a complete knowledge of all lensing modes not examined by this estimator . in that case
, we find @xmath59 where @xmath60 . evaluating the four - point function in the integrand of eq .
( [ e : estvar , cmb ] ) to second order in the lensing field , we obtain @xmath61 \nonumber \\ & & \quad \times \bigl [ { { \mathbf{l^{\prime}}}}\cdot ( { { { \bf l}_2}}- { { \mathbf{l^{\prime } } } } ) \bigr ] - \frac{1}{2 } { \int \frac{d^2 { \bf l'}}{(2\pi)^2}}{\phi}({{\mathbf{l^{\prime } } } } ) { \phi}(-{{\mathbf{l}}}- { { \mathbf{l^{\prime } } } } )   \bigl\ { c_{l_1}^{{\theta}{\theta } } ( { { { \bf l}_1}}\cdot { { \mathbf{l^{\prime } } } } ) \bigl [ { { { \bf l}_1}}\cdot ( { { \mathbf{l}}}+ { { \mathbf{l^{\prime } } } } ) \bigr ] + c_{l_2}^{{\theta}{\theta } } ( { { { \bf l}_2}}\cdot { { \mathbf{l^{\prime } } } } ) \bigl [ { { { \bf l}_2}}\cdot ( { { \mathbf{l}}}+ { { \mathbf{l^{\prime } } } } ) \bigr ] \bigr\ } \biggr ] \nonumber \\ & & \quad \times \biggl [ \bigl ( c_{l_{1}^{\prime}}^{{\theta}{\theta } } + c_{l_{1}^{\prime}}^{{\theta}{\theta}{{\rm n } } } \bigr ) ( 2 \pi)^2 \delta_{{\rm d}}({{\mathbf{l^{\prime } } } } ) + { \phi}({{\mathbf{l^{\prime } } } } ) { f_{\theta\theta}}({{{\bf l}_1 } } ' , { { { \bf l}_2 } } ' ) - { \int \frac{d^2 { \bf l'}}{(2\pi)^2}}c_{l^{\prime}}^{{\theta}{\theta } } { \phi}({{{\bf l}_1 } } ' - { { \mathbf{l^{\prime } } } } ) { \phi}({{{\bf l}_2 } } ' + { { \mathbf{l^{\prime } } } } ) \bigl [ { { \mathbf{l^{\prime}}}}\cdot ( { { { \bf l}_1 } } ' - { { \mathbf{l^{\prime } } } } ) \bigr ] \nonumber \\ & & \quad \times \bigl [ { { \mathbf{l^{\prime}}}}\cdot ( { { { \bf l}_2 } } ' + { { \mathbf{l^{\prime } } } } ) \bigr ] + \frac{1}{2 } { \int \frac{d^2 { \bf l'}}{(2\pi)^2}}{\phi}({{\mathbf{l^{\prime } } } } ) { \phi}({{\mathbf{l^{\prime}}}}- { { \mathbf{l^{\prime } } } } ) \bigl\ { c_{l_{1}^{\prime}}^{{\theta}{\theta } } ( { { { \bf l}_1 } } ' \cdot { { \mathbf{l^{\prime } } } } ) \bigl [ { { { \bf l}_1 } } ' \cdot ( { { \mathbf{l^{\prime}}}}- { { \mathbf{l^{\prime } } } } ) \bigr ] + c_{l_{2}^{\prime}}^{{\theta}{\theta } } ( { { { \bf l}_2 } } ' \cdot { { \mathbf{l^{\prime } } } } ) \bigl [ { { { \bf l}_2 } } ' \cdot ( { { \mathbf{l^{\prime}}}}- { { \mathbf{l^{\prime } } } } ) \bigr ] \bigr\ } \biggr ] { \rm + perm . } \nonumber \\\end{aligned}\ ] ] the terms given explicitly in eq .
( [ e:4pt , cmb ] ) correspond to the correlations between @xmath62 and @xmath63 and those between @xmath64 and @xmath65 .
the `` + perm . '' stands for two additional terms , identical in form , arising from the pairings @xmath66 and @xmath67 .
this expression indicates how uncertainty in the cmb at the last - scattering surface propagates into uncertainty in lensing reconstruction for a particular realization @xmath68 of the large - scale structure .
to linear order in eq .
( [ e:4pt , cmb ] ) , correlations between the modes @xmath69 and @xmath64 are induced by those lensing modes whose wavevectors are the sums of any pair of wavevectors of these four modes .
these lensing modes are precisely those forming the diagonals of the quadrilaterals depicted in fig .
[ f:2quad ] .    in practice
, we do not know the large - scale structure between us and the last - scattering surface , so we assume a variance given by eq .
( [ e : lenpowdef ] ) with a model - dependent power spectrum @xmath70 .
we must average eq .
( [ e : estvar , cmb ] ) over different realizations of the large - scale structure ( denoted by @xmath71 ) to obtain the total expected variance of our estimator , @xmath72 where @xmath73 the assumption that the lensing potential is gaussian imposes the constraint @xmath74 which closes the quadrilaterals of fig
.  [ f:2quad ] . the average of the four - point correlation function in eq .
( [ e : estvar ] ) can be calculated by further averaging eq .
( [ e:4pt , cmb ] ) over the large - scale structure .
terms linear in the lensing field vanish when averaged over different realizations of the large - scale structure .
quadratic terms in the lensing field arise as products either of two linear terms or of a zeroth and second - order term .
averages over the product of two linear terms produce the connected part of the four - point correlation function , the trispectrum defined in eq .
( [ e : specdef ] ) .
averages over the product of a zeroth and second - order term have no connected portion , but instead furnish an implicit dependence on @xmath70 in the total observed power spectrum of eq .
( [ e : temptot ] )
. the final result of averaging over the large - scale structure can be expressed in terms of the observed power spectrum and trispectrum , @xmath75 \ , , \nonumber \\\end{aligned}\ ] ] where the trispectrum can written in terms of @xmath76 as @xmath77 this form of the trispectrum is consistent with that of eq .
( [ e : trilens ] ) given directly in terms of power spectra . since @xmath78 , @xmath79 and the first term of eq .
( [ e:4pt ] ) vanishes .
the remaining two terms containing pairs of delta functions , inserted into eq .
( [ e : estvar ] ) , yield the dominant contribution to the variance , @xmath80 \ , , \ ] ] where @xmath81 .
notice that @xmath82 is zeroth order in the lensing potential @xmath25 ; it depends on the lensing potential power spectrum @xmath83 only implicitly though the total observed power spectrum @xmath84 .
the ellipsis represents terms of higher order in @xmath83 that we now proceed to calculate .
these terms arise from the trispectrum term of eq .
( [ e:4pt ] ) after @xmath85 is removed . substituting these results into eq .
( [ e : estvar ] ) , we find that to first order in @xmath83 , @xmath86 \ , , \ ] ] where @xmath87 is given by , @xmath88 the first - order contribution to the noise @xmath87 involves integrals over the lensing - potential power spectrum , and thus probes lensing modes with wave vectors different from that of the estimator @xmath58 .
it can be interpreted physically as interference from these other modes in the determination of the mode @xmath89 being estimated .
the filter @xmath90 was chosen to optimize the signal - to - noise ratio in the absence of the first - order contribution @xmath87 ; it is no longer an optimal filter once this additional noise is taken into account . as long as @xmath91 ,
the noise reduction that can be attained by re - optimizing our filter will not be significant .
formulas analagous to those presented here relevant to the construction of estimators using polarization data are given in the appendix .
the significance of @xmath87 for two different experiments is shown in fig .
[ f : plrec ] using the currently favored @xmath0cdm cosmological model with baryon density @xmath3 , matter density @xmath4 , cosmological constant density @xmath5 , hubble parameter @xmath6=0.65 , and power - spectrum amplitude @xmath7 .
the planck experiment is equivalent to a one - year , full - sky survey with temperature and polarization sensitivities of 12.42 and 26.02 @xmath92 respectively and resolution @xmath93 arcminutes as described in   [ s : lensing ] .
the reference experiment has the same resolution but superior sensitivities of 0.46 and 0.65 @xmath94 for temperature and polarization .
these estimates of experimental parameters are identical to those given for the planck and reference experiments of ref .
the @xmath95 and @xmath96 estimators have noise power spectra intermediate to those of the @xmath97 and @xmath98 estimators , while the @xmath99 estimator has substantially higher noise because the primordial cmb lacks true b - modes in the absence of inflationary gravitational waves .
we see that for planck , with its comparatively inferior polarization sensitivity , the @xmath97 estimator will be best although it will be unable to detect individual fourier modes of the deflection field at the @xmath100 level .
the reference experiment , and further experiments with similar sensitivity and even higher resolution , should be able to push @xmath100 detection of individual @xmath89 modes to @xmath101 by primarily relying on the @xmath98 estimator . in these cases
the secondary noise @xmath102 is only smaller than the dominant noise @xmath103 by a factor of a few , whereas for higher sensitivity ( noisier ) experiments like planck it is smaller by at least an order - of - magnitude .
this illustrates an interesting point , apparent from fig .
[ f : plrec ] , that the zeroth - order noise @xmath82 declines dramatically with decreasing sensitivity until it becomes dominated by cosmic variance while the @xmath87 is largely unaffected by instrument sensitivity .
the reasons for this trend are that instrument noise appears in @xmath81 through its contribution to the denominator of @xmath104 as shown by eqs .
( [ e : filt ] ) and ( [ e : norm ] ) .
decreasing instrument noise raises the value of @xmath104 thereby lowering @xmath82 .
by contrast instrument noise is reflected in @xmath87 through its effects on both @xmath105 and @xmath104 as shown in eq .
( [ e:1st ] ) .
smaller instrument noise raises @xmath104 as before , driving @xmath87 up in this case , but this is compensated by a decrease in @xmath105 which appears as a prefactor outside the integrals .
these two effects largely cancel each other out , rendering @xmath87 remarkably insensitive to instrument noise .
although complete reconstruction of the deflection field @xmath89 can be an enormously powerful tool , such as for b - mode subtraction @xcite , for some purposes estimates of the lensing - potential power spectrum @xmath106 are sufficient .
this power spectrum is a model - dependent prediction of theories of large - scale structure formation , and therefore estimates of the power spectrum from real data could be used to test these theories as well as the consistency of other determinations of cosmological parameters .
furthermore , since estimates of all the modes @xmath89 with @xmath107 can be combined to estimate @xmath106 , @xmath100 detection of the power spectrum can be pushed to much higher @xmath108 than can that of individual modes .
the deflection - field estimator @xmath58 derived in the preceding section can be used to construct an estimator for @xmath106 .
our first guess for an appropriate lensing - potential power spectrum estimator is @xmath109 where @xmath110 is the area of the sky surveyed and @xmath111 is an annulus of radius @xmath108 and width @xmath112 .
we ensemble average our estimator over different realizations of the cmb and large - scale structure using eq .
( [ e : prodave ] ) by bringing @xmath113 from the left to the right - hand side .
this yields @xmath114 \ , .\ ] ] the definition of the dirac delta function , @xmath115 implies that @xmath116 . furthermore , in the limit that @xmath112 is small compared to the scales
on which @xmath117 is varying , we can evaluate the integrand of eq .
( [ e : naive2 ] ) at its central value @xmath118 and extract it from the integral .
the integral over the annulus @xmath111 cancels the factor @xmath119 in the denominator , reducing eq .
( [ e : naive2 ] ) to @xmath120 \ , .\ ] ] @xmath121 is indeed an estimator for the lensing - potential power spectrum @xmath106 , albeit a biaed one .
note that the _ bias _ in the power - spectrum estimator @xmath121 is precisely the same as the _ variance _ shown in eq .
( [ e : prodave ] ) with which we were able to determine each individual lensing mode .
this is no coincidence ; it reflects the fact that there are no grounds _ a priori _ on which to differentiate the variance with which we can reconstruct individual modes @xmath89 from the intrinsic variance @xmath122 of the underlying distribution from which they are drawn . to obtain an unbiased estimator to compare with theoretical predictions , we subtract off this unwanted reconstruction variance , @xmath123 \ , .\ ] ] since @xmath87 as defined in eq .
( [ e:1st ] ) itself depends on @xmath106 , this subtraction and evaluation must be performed iteratively until a self - consistent solution is obtained .
the variance of our estimator @xmath124 can be calculated in the usual manner , @xmath125 evaluating this expression requires us to calculate @xmath126 \left [ { { \mathbf{d}}_{\theta\theta}}({{{\bf l}_2 } } ' ) \cdot { { \mathbf{d}}_{\theta\theta}}(-{{{\bf l}_2 } } ' ) \right ] \rangle \ , .\ ] ] since @xmath58 is a quadratic estimator in the temperature map , eq .
( [ e : dl2 ] ) includes the following integral over the eight - point correlation function in fourier space , @xmath127 \left [ { { \mathbf{d}}_{\theta\theta}}({{{\bf l}_2 } } ' ) \cdot { { \mathbf{d}}_{\theta\theta}}(-{{{\bf l}_2 } } ' ) \right ] \rangle = \frac{{a_{\theta\theta}}^2(l_{1}^{\prime } ) { a_{\theta\theta}}^2(l_{2}^{\prime})}{(l_{1}^{\prime})^2 ( l_{2}^{\prime})^2 } { \int \frac{d^2 { \bf k}_1}{(2\pi)^2 } } { \int \frac{d^2 { \bf k}_3}{(2\pi)^2 } } { \int \frac{d^2 { \bf k}_5}{(2\pi)^2 } } { \int \frac{d^2 { \bf k}_7}{(2\pi)^2 } } \nonumber \\ & & \quad \times \big\ { { f_{\theta\theta}}({{{\bf k}_1 } } , { { { \bf k}_2 } } ) { f_{\theta\theta}}({{{\bf k}_3 } } , { { { \bf k}_4 } } ) { f_{\theta\theta}}({{{\bf k}_5 } } , { { { \bf k}_6 } } ) { f_{\theta\theta}}({{{\bf k}_7 } } , { { { \bf k}_8 } } ) \langle { \theta}^{{\rm t}}({{{\bf k}_1 } } ) { \theta}^{{\rm t}}({{{\bf k}_2 } } ) { \theta}^{{\rm t}}({{{\bf k}_3 } } ) { \theta}^{{\rm t}}({{{\bf k}_4 } } ) { \theta}^{{\rm t}}({{{\bf k}_5 } } ) { \theta}^{{\rm t}}({{{\bf k}_6 } } ) { \theta}^{{\rm t}}({{{\bf k}_7 } } ) { \theta}^{{\rm t}}({{{\bf k}_8 } } ) \rangle \big\ } \
, , \nonumber \\\end{aligned}\ ] ] where @xmath128 , @xmath129 , @xmath130 , and @xmath131 .
a fully general eight - point correlation function consists of a connected part , as well as terms proportional to the product of lower - order correlation functions . under the assumption that both the primordial cmb and the lensing potential are governed by gaussian statistics , all correlation functions higher than the four - point have vanishing connected parts @xcite .
the temperature eight - point correlation function will therefore be composed of three groups of terms ; membership in a group being determined by whether the term contains zero , one , or two factors of the trispectrum . since the trispectrum given in eq .
( [ e : trilens ] ) is first order in the lensing - potential power spectrum @xmath106 , terms of these three groups are zeroth , first , and second order respectively in @xmath106 .
combinatorics determines the number of terms in each group .
there are : @xmath132 different ways of dividing @xmath133 into four pairs , and hence there will be 105 terms in the group containing no trispectra .
similar calculations reveal that there are @xmath134 terms in the second group and @xmath135 terms in the third group .
many terms in all three groups will vanish for the same reason that the first term vanished in the four - point correlation function of eq .
( [ e:4pt ] ) ; these terms are proportional to a dirac delta function evaluated at nonzero argument .
consider now the first group of terms , those that are zeroth order in @xmath106 .
the 60 nonvanishing terms in this group each contain four dirac delta functions ; they can be further segregated into the 12 terms that allow two of the integrals over @xmath136 appearing in eq .
( [ e:8pt ] ) to be immediately evaluated via dirac delta functions , and the 48 terms that allow evaluation of three @xmath136 integrals .
the first 12 terms , inserted into eq .
( [ e:8pt ] ) and appropriately evaluated using the normalization of eq .
( [ e : norm ] ) , yield @xmath137 + \ldots \ , , \ ] ] while the remaining 48 terms give the final result to zeroth order in @xmath106 , @xmath138   \nonumber \\ & & \quad \quad \quad \quad \quad \quad + \frac{(2 \pi)^2}{a l^4 } \frac{2}{(2 \pi l \delta l)^2 } \int_{a_l } \frac{d^2 { { { \bf l}_1}}'}{(2 \pi)^2 } \ , \int_{a_l } \frac{d^2 { { { \bf l}_2}}'}{(2 \pi)^2 } \ , \frac{{a_{\theta\theta}}^2(l_{1}^{\prime } ) { a_{\theta\theta}}^2(l_{2}^{\prime})}{(l_{1}^{\prime})^2 ( l_{2}^{\prime})^2 } { \int \frac{d^2 { \bf k}_1}{(2\pi)^2 } } f_{{\theta}{\theta}}({{{\bf k}_1 } } , { { { \bf k}_2 } } ) p({{{\bf k}_1 } } , { { { \bf k}_2 } } , { { { \bf l}_1 } } ' , { { { \bf l}_2 } } ' ) \ , , \nonumber \\\end{aligned}\ ] ] where @xmath139 when @xmath140 is subtracted from @xmath141 in eq .
( [ e : sigpv ] ) , the first term in the square brackets of eq .
( [ e : zeropv ] ) will be eliminated . minimizing the variance associated with this estimator then consists of making an optimal choice of @xmath142 .
the first noise term is proportional to @xmath143 . for a survey of area @xmath110
, @xmath144 is the specific area of an individual mode in @xmath145 space and @xmath146 is the area in @xmath145 space over which the power - spectrum estimator takes an average .
this ratio is therefore the inverse of the number of individual @xmath58 modes whose inverse variances are added to determine the inverse variance of @xmath124 .
it is obviously minimized by choosing @xmath147 . the second term , that involving @xmath148 , differs from the first noise term in that a dirac delta function has been used to evaluate an additional @xmath136 integral rather than an annulus integral .
since the integrands are of the same order , we expect the second noise term to be suppressed relative to the first by a factor @xmath149 where @xmath150 is set by the resolution @xmath32 of the survey . under the conservative assumption @xmath151 , namely that we are probing scales well above our resolution , this term is assured to be small .
we neglect such terms for the remainder of this paper . if we insert the portions of the eight - point correlation function that are first and second order in @xmath106 into eq .
( [ e:8pt ] ) and evaluate using eq .
( [ e:1st ] ) , we find @xmath152 \ , , \ ] ] and @xmath153 this result agrees with that given in ref .
@xcite after subtracting our newly derived term @xmath87 .
the term @xmath87 and corresponding terms for polarization - based estimators have two principal effects on power spectrum estimation . as shown in eq .
( [ e : finvar ] ) , they provide a fractional contribution to the variance of roughly @xmath154 when @xmath122 dominates the variance as in the reference experiment in the right - hand panel of fig .
[ f : plrec ] . for the @xmath0cdm cosmological model considered here
this represents an increase of @xmath155 in the variance of the @xmath98 estimator for @xmath156 .
more importantly , @xmath87 acts as a bias for the naive estimator @xmath121 as shown by eq .
( [ e : naive3 ] ) . if this bias is not calculated and subtracted iteratively to form the unbiased estimator @xmath124 as in eq .
( [ e : pestsub ] ) , @xmath122 will be _ systematically _ overestimated by @xmath157 at low @xmath108 and by increasingly larger amounts at @xmath158 as the signal @xmath159 begins to plummet while @xmath87 remains comparatively flat .
having evaluated the variance of our estimator @xmath124 , we consider whether this estimator has a substantial covariance @xmath160 the estimator @xmath121 as defined in eq .
( [ e : naive ] ) implies that : @xmath161 \left [ { { \mathbf{d}}_{\theta\theta}}({{{\bf l}_2 } } ' ) \cdot { { \mathbf{d}}_{\theta\theta}}(-{{{\bf l}_2 } } ' ) \right ] \rangle \ , , \ ] ] which can be evaluated using the same integral over the eight - point correlation function described in eq .
( [ e:8pt ] ) . whereas 60 of the 105 zeroth - order terms in @xmath106 coming from this equation were nonvanishing for the variance , for the covariance only 52 terms are nonzero provided that the widths @xmath112 and @xmath162 are chosen so that the annuli @xmath111 and @xmath163 do not overlap .
this leads to a result analogous to eq .
( [ e : zeropv ] ) , @xmath164 note that the eight terms missing from the covariance when compared to the variance have altered the first term of eq .
( [ e : zerocv ] ) , and that it was precisely these terms that provided the dominant contribution to the variance of eq .
( [ e : finvar ] ) when @xmath142 was chosen appropriately .
we therefore find that to zeroth order in @xmath106 , the covariance is given by @xmath165 where we have extracted the @xmath166 from the annular integrals since they are slowly varying over the widths @xmath112 and @xmath162 . for the same reasons that terms of this form were a subdominant contribution to the variance as discussed previously , we expect the covariance to be suppressed as well . if we define the ratio @xmath167 we can quantify this suppression .
the triple integral of eq .
( [ e : fincov ] ) , appearing in the numerator of @xmath168 , involves integration over annuli with radii @xmath108 and @xmath169 and one integration over all fourier space .
the triple integrals in the variances @xmath170 and @xmath171 appearing in the denominator of @xmath168 each consist of a single integration over an annulus of radius @xmath108 and @xmath169 respectively and two integrations over all fourier space .
if we make the crude assumption that the integrand is constant , the ratio @xmath168 will simply be the ratio of these areas , @xmath172    the ratio @xmath168 is evaluated numerically for planck in fig .
[ f : cov ] as a function of @xmath108 for various fixed values of @xmath169 .
the estimators @xmath124 and @xmath173 were chosen such that @xmath174 , while integrals over fourier space were cut off at @xmath175 . substituting these values into eq .
( [ e : rcovest ] ) , we expect @xmath176 .
this crude estimate is surprisingly close to the numerically obtained results of fig .
[ f : cov ] ; in particular the slope of the curves is approximately 1/2 on this log - log plot . even at @xmath101 , @xmath177 suggesting that covariance in power - spectrum estimation
can safely be neglected for planck .
the estimate of eq .
( [ e : rcovest ] ) implicitly depends on the experimental resolution @xmath32 because the integrand appearing in expressions for the variance and covariance decreases rapidly for @xmath178 . for future experiments with better resolution than planck
, @xmath179 will be higher implying by eq .
( [ e : rcovest ] ) that covariance will be even more negligible .
weak gravitational lensing induces non - gaussian correlations between modes of the observed cmb temperature map as shown in eq .
( [ e : ea ] ) . these correlations , and assumptions about the gaussian nature of the primordial cmb , can be used to construct several temperature and polarization - based estimators of the fourier modes @xmath89 of the deflection field .
this procedure was outlined in ref .
@xcite , however in calculating the noise associated with this reconstruction , an assumption was made that the observed temperature map was gaussian . in the presence of lensing this assumption
is invalid ; when calculating the variance of quadratic estimators all permutations of the observed trispectrum must be taken into account .
one such permutation reflects the desired correlation making our estimator sensitive to @xmath89 , but the remaining two permutations induce additional variance proportional to the lensing - potential power spectrum @xmath106 . while subdominant , this variance will become increasing significant for future experiments as shown in the right - hand panel of fig .
[ f : plrec ] .
since the power spectrum @xmath106 is itself a measure of uncertainty in the deflection field , this additional variance in lensing reconstruction acts as a bias during power - spectrum estimation because there is no _ a priori _ way to distinguish it from the intrinsic variance of the underlying distribution .
our calculation of the dependence of this variance on @xmath106 allows it in principle to be subtracted iteratively , which will prevent a systematic @xmath157 overestimate of @xmath106 at low @xmath108 .
we close by considering several possible observational obstacles to the scheme for lensing reconstruction and power - spectrum estimation presented above .
one hindrance is secondary contributions to the cmb such as the sz and isw effects .
these effects increase the total temperature power spectrum appearing in the denominator of the optimum filter @xmath104 of eq .
( [ e : filt ] ) as would additional instrumental noise .
they also correlate with the large - scale structure at low redshifts inducing further non - gaussian couplings and additional variance to lensing reconstruction .
fortunately for our purposes the frequency dependence of the thermal sz effect differs from that of a blackbody .
it can therefore be separated in principle from the lensed primordial cmb by an experiment with several frequency channels @xcite .
the isw effect can not be removed in this manner , but is too small to significantly inhibit lensing reconstruction .
polarization - dependent secondary effects are expected to appear at higher orders in the density contrast @xcite , and we therefore anticipate that they will not make a contribution at the levels considered here . a
potentially more serious problem is that of galactic foregrounds , which though uncorrelated with the lensing signal may be substantial at certain frequencies .
significant polarization has also been observed in some of these sources @xcite .
we hope to understand and minimize the effects of galactic foregrounds in future work , and to pursue further refinements of lensing reconstruction .
we thank wayne hu for useful discussions .
this work was supported in part by nasa nag5 - 11985 and doe de - fg03 - 92-er40701 .
kesden acknowledges the support of an nsf graduate fellowship and ac acknowledges support from the sherman fairchild foundation .
here we provide the appropriate formulas for deriving the variance associated with polarization - based estimators of the deflection field @xmath89 .
the cmb polarization can be decomposed into e and b - modes @xcite .
these modes are mixed by weak lensing such that to linear order in @xmath68 , @xmath180 \phi({{\bf l}}-{{\bf l}}_1 ) \left [ ( { { \bf l}}-{{\bf l}}_1 ) \cdot { { \bf l}}_1 \right ] \
, , \nonumber \\
\tilde b({{\bf l } } ) & = & b({{\bf
l } } ) - { \int \frac{d^2 { \bf l}_1}{(2\pi)^2 } } \left[e({{\bf l}}_1 ) \sin 2 ( \varphi_{{{\bf l}}_1 } -\varphi_{{\bf l } } ) + b({{\bf l}}_1 ) \cos 2 ( \varphi_{{{\bf l}}_1 } -\varphi_{{\bf l}})\right ] \phi({{\bf l}}-{{\bf
l}}_1 ) \left [ ( { { \bf l}}-{{\bf l}}_1 ) \cdot { { \bf l}}_1 \right ] \ , .\end{aligned}\ ] ] we can exploit the sensitivity of the polarization modes to the lensing potential to construct lensing estimators from quadratic combinations of polarization modes .
we generalize eq .
( [ e : ea ] ) to arbitrary combinations @xmath181 of @xmath45 , e , and b - modes as first derived in ref .
@xcite , @xmath182 where @xmath183   \cos 2 ( \varphi_{{{\mathbf{l } } } } -\varphi_{{\mathbf{l^{\prime } } } } ) \ , , \nonumber \\
f_{eb}({{\mathbf{l } } } , { { \mathbf{l^{\prime } } } } ) & = & \left [ c_{l}^{ee } ( { { \mathbf{l}}}\cdot { { \mathbf{l } } } ) + c_{l^{\prime}}^{bb } ( { { \mathbf{l}}}\cdot { { \mathbf{l^{\prime } } } } ) \right ]   \sin 2 ( \varphi_{{{\mathbf{l } } } } -\varphi_{{\mathbf{l^{\prime } } } } ) = f_{be}({{\mathbf{l^{\prime } } } } , { { \mathbf{l } } } ) \ , , \nonumber \\ f_{bb}({{\mathbf{l } } } , { { \mathbf{l^{\prime } } } } ) & = & \left [ c_{l}^{bb } ( { { \mathbf{l}}}\cdot { { \mathbf{l } } } ) + c_{l^{\prime}}^{bb } ( { { \mathbf{l}}}\cdot { { \mathbf{l^{\prime } } } } ) \right ]   \cos 2 ( \varphi_{{{\mathbf{l } } } } -\varphi_{{\mathbf{l^{\prime } } } } ) \ , . \nonumber \\\end{aligned}\ ] ] in deriving these results we used parity considerations to demand @xmath184 . using these relations
, we follow the approach of ref .
@xcite to derive symmetric lensing estimators @xmath185 and @xmath186 { f_{xx'}}({{{\bf l}_1 } } , { { { \bf l}_2 } } ) \ , .\ ] ] we have explicitly symmetrized our estimators for @xmath187 to simplify the form of the optimal filter .
the normalization bias of the estimators is removed by choosing @xmath188^{-1 } \
, , \ ] ] and @xmath189 { f_{xx'}}({{{\bf l}_1 } } , { { { \bf l}_2 } } ) \right]^{-1 } \ , .\ ] ] the minimum - variance filters @xmath190 for the various cases @xmath181 are given by @xmath191 using these optimal filters for the estimators defined in eqs .
( [ e : estxx ] ) and ( [ e : estxx ] ) , we can calculate the variances for these estimators in a fashion entirely analogoug to eq .
( [ e : estvar ] ) , @xmath192 @xmath193 \left [ x^{{\rm t}}({{{\bf l}_1 } } ' ) x'^{{\rm t}}({{{\bf l}_2 } } ' ) + x'^{{\rm t}}({{{\bf l}_1 } } ' ) x^{{\rm t}}({{{\bf l}_2 } } ' ) \right ] \rangle { f_{xx'}}({{{\bf l}_1 } } , { { { \bf l}_2 } } ) { f_{xx'}}({{{\bf l}_1 } } ' , { { { \bf l}_2 } } ' ) \nonumber \\ & & \quad \quad - ( 2 \pi)^2 \delta_{{\rm d}}({{\mathbf{l}}}- { { \mathbf{l^{\prime } } } } ) c_{l}^{dd } \ , . \nonumber \\\end{aligned}\ ] ] as for that of the temperature estimator , these variance will consist of zeroth - order terms in @xmath106 , @xmath194 and @xmath195 , and first - order terms , @xmath196 @xmath197 \nonumber \\ & & \quad \quad \quad + c_{|{{{\bf l}_1}}-{{{\bf l}_2}}'|}^{\phi\phi }   \bigl [ f_{xx'}(-{{{\bf l}_1 } } , { { { \bf l}_2 } } ' ) f_{x'x}(-{{{\bf l}_2 } } , { { { \bf l}_1 } } ' ) + f_{xx}(-{{{\bf l}_1 } } , { { { \bf l}_2 } } ' ) f_{x'x'}(-{{{\bf l}_2 } } , { { { \bf l}_1 } } ' ) \nonumber \\ & & \quad \quad \quad
\quad + f_{x'x'}(-{{{\bf l}_1 } } , { { { \bf l}_2 } } ' ) f_{xx}(-{{{\bf l}_2 } } , { { { \bf l}_1 } } ' ) + f_{x'x}(-{{{\bf l}_1 } } , { { { \bf l}_2 } } ' ) f_{xx'}(-{{{\bf l}_2 } } , { { { \bf l}_1 } } ' ) \bigl ] \big\ } \ , , \nonumber \\\end{aligned}\ ] ] the filters given in eq .  (
[ e : filtxx ] ) are no longer optimal in the presence of this additional noise , but the difference between these filters and the optimal filters should be negligible provided that @xmath198 , @xmath199 . for the purposes of power - spectrum estimation , the terms @xmath200 and @xmath201 are not only an additional contribution to the variance , but are also a systematic bias if not subtracted iteratively following eq .
( [ e : naive3 ] ) .
a final point to consider is that the six different estimators @xmath202 defined in this paper are not independent , as they are constructed from only three distinct maps .
the covariance matrix for the six estimators will therefore not be diagonal , and this needs to be taken into account if the estimators are to be linearly combined to produce a single minimum - variance estimator .
the off - diagonal elements of the covariance matrix can be evaluated in a straightforward manner involving pairs of double integrals similar to those of eqs .
( [ e : xxvar ] ) and ( [ e : xxvar ] ) .      p. j. e. peebles and j. t. yu , astrophys . j.  * 162 * , 815 ( 1970 ) ; r. a. sunyaev and ya . b. zeldovich , astrophys .
space sci .
* 7 * , 3 ( 1970 ) ; j. silk , astrophys .
j.  * 151 * , 459 ( 1968 ) ; w. hu and s. dodelson , ann .
astrophys .  * 40 * , 171 ( 2002 ) .
g. jungman _
et al . _ ,
d  * 54 * , 1332 ( 1995 ) ; j. r. bond , g. efstathiou , and m. tegmark , mon . not .
r. astron .
soc .  * 291 * , l33 ( 1997 ) ; m. zaldarriaga and d. n. spergel , astrophys . j.  * 488 * , 1 ( 1997 ) ; d. j. eisenstein , w. hu , and m. tegmark , astrophys . j.  * 518 * , 2 ( 1999 ) .
d. n. spergel and d. m. goldberg , phys .
d  * 59 * , 103001 ( 1999 ) ; d. m. goldberg and d. n. spergel , phys . rev . d  * 59 * , 103002 ( 1999 ) ; a. cooray and w. hu , astrophys .
j.  * 534 * , 533 ( 2000 ) ; m. zaldarriaga and u. seljak , phys .
rev . d  * 59 * , 123507 ( 1999 ) ; h. v. peiris and d. n. spergel , astrophys . j.  * 540 * , 605 ( 2000 ) .
g. giardino _
et al . _ ,
astrophys .
* 387 * , 82 ( 2002 ) ; f. r. bouchet , s. prunet , and s. k. sethi , mon . not .
r. astron .
302 * , 663 ( 1999 ) ; s. prunet , s. k. sethi , and f. r. bouchet , mon . not .
r. astron .
314 * , 348 ( 2000 ) .


diffractive scattering through strong interactions without any large momentum transfer has historically been described in terms of the exchange of a pomeron , a virtual hadron - like object with vacuum quantum numbers .
the regge approach  @xcite of the pre - qcd era provides a working phenomenology to describe such processes in a hadron basis since no parton structure is resolved .
the idea @xcite to introduce a hard scale in a diffractive process opened the possibility to examine these processes at the level of quarks and gluons in the modern framework of qcd .
the discovery of such _ diffractive hard scattering _ was made by the ua8 experiment @xcite by observing high-@xmath3 jets in single diffractive events in @xmath4 collisions at cern .
many other hard processes in diffractive events have been observed later on , for a review see e.g.@xcite .
of special importance are the measurements of diffractive deep inelastic scattering ( ddis ) at the electron - proton collider hera @xcite , where the well understood point - like electromagnetic interaction probes the parton structure in the diffractive reaction mechanism .
this has resulted in theoretical descriptions of data based on essentially two different approaches , one being pomeron exchange in regge phenomenology and the other colour screening via soft gluon exchange in qcd .
the pomeron approach starts with the initial proton state fluctuating in a soft non - perturbative process into a proton and a pomeron .
the latter is assumed to have a partonic structure which is probed by the momentum transfer @xmath5 of the deep inelastic photon exchange to produce the hadronic final state , well separated in rapidity from the final state proton carrying most of the longitudinal momentum of the beam proton .
hera data on ddis can then be described @xcite as a product of an effective pomeron flux factor from regge phenomenology and deep inelastic scattering on the pomeron having parametrised parton density functions ( pdf ) @xcite .
alternatively , one may parametrise diffractive structure functions without an explicit pomeron flux but instead being conditionally dependent on the momentum of the final proton .    however , this approach is not universal in the sense that such parametrisations do not reproduce diffractive hard scattering data in hadron - hadron collisions .
for example , such pomeron pdfs overestimate substantially the cross - sections for diffractive hard scattering processes , such as production of jets or @xmath6 , at the tevatron @xcite .
this has called for introducing a gap survival suppression factor @xmath7 , which can be given a qualitative theoretical motivation but which is difficult to calculate quantitatively .
the colour exchange approach starts instead with the hard scattering process and then adds softer gluon exchanges to achieve the effective colour singlet exchange in diffractive processes .
thus , the underlying hard process is assumed to be the same as in the corresponding non - diffractive process and its momenta naturally not affected by other exchanges at much lower momentum transfer scales .
however , the formation of confining colour fields may well be affected by the softer gluon exchanges and thereby the hadronisation process such that a different distribution of the final state hadrons emerges .
for example , when different colour singlet string - fields emerge separated in rapidity they will hadronise into two hadron systems separated by a rapidity gap with no hadrons .
a simple , but phenomenologically rather successful model of this kind is the soft colour interaction ( sci ) model  @xcite added to the lepto @xcite and pythia @xcite monte - carlo event generators . a large variety of diffractive data
could then be reproduced with essentially the same value of a single new parameter , introduced to give the probability for exchange a soft colour octet gluon between any pair of partons .
this colour exchange alter the formation of the colour string - fields and hence the application of the conventional lund string hadronisation model results in a different topology of the hadronic final state .
the model gives an essentially correct description of diffractive dis @xmath8 scattering at hera @xcite as well as diffractive events at the tevatron having jets or quarkonia @xcite or gauge bosons @xcite .
it has therefore been applied for predictions , e.g. of diffractive higgs production in double gap processes at lhc @xcite .
the gap survival factor @xmath7 often used in other kinds of models , is not necessary here since the full event simulation accounts for such effects resulting in correct rates for the investigated diffractive processes in @xmath8 and @xmath9 and @xmath10 collisions .
other models of a similar nature , with different forms of colour exchange , have been developed .
the gal model @xcite for example considers soft colour exchanges between strings with a probability that favours minimization of the strings area in energy - momentum coordinates .
a recent development of such colour string reconnection models makes a more elaborate account for @xmath11 colour statistics @xcite .
a theoretical qcd basis for basic colour exchanges has been proposed in @xcite and , in a more elaborated form , in @xcite .
the basic hard scattering process is treated by conventional perturbative qcd ( pqcd ) .
its large momentum scale implies that it occurs on a small space - time scale compared to the bound state proton and is thus embedded in the proton .
therefore , the emerging hard - scattered partons propagate through the proton s colour field and may interact with it .
the amplitude for such multiple gluon exchanges is calculated in the eikonal approximation to all orders in perturbation theory resulting in an analytic expression for such a colour screening effect .
the theoretical approach @xcite used here to resum multigluon exchange has similarities with the one in @xcite giving a similar eikonal factor @xmath12 in the amplitude , but there are also differences as will be discussed below .
it is this amplitude that we here develop into a probabilistic model . we implement it for two different monte carlo event generators : lepto for general deep inelastic lepton - nucleon scattering including first order qcd matrix elements and parton showers based on conventional @xmath13 evolution from the dglap equations @xcite , and as well for cascade @xcite specialised on small-@xmath0 electron - proton scattering based on the off - shell @xmath14 first order matrix element and @xmath2 factorisation with ccfm evolution @xcite and unintegrated gluon density of the proton .
the paper is organized as follows . in section [ sec : dynamic - rescattering ] we describe the basic process with the colour screening . section [ sec : ddis - via - dcs ] discusses the resulting cross - section for diffractive deep inelastic scattering and its monte carlo implementation .
section [ sec : res ] shows our results in comparison to hera data .
finally , section [ sec : conclusions ] presents our conclusions .
in the virtue of the sci model , the skeleton of both inclusive and diffractive ( with rapidity gaps and/or leading proton ) dis process is provided by the same perturbative qcd diagram illustrated in fig .
[ fig : ddis ] .
a parton with longitudinal momentum fraction @xmath15 in the initial proton at the starting scale @xmath16 for pqcd is evolved to smaller momentum fractions , but higher transverse momenta and virtualities up to a hard scale @xmath17 . here , a virtual photon @xmath18 with momentum @xmath19 and virtuality @xmath20 resolves a quark at bjorken @xmath0 @xmath21 at small @xmath0 the process will dominantly be initiated by a gluon , which can radiate and splits into a @xmath22 pair .
the total momentum fraction taken from the proton is @xmath23 , and the total mass @xmath24 of the parton system denoted as @xmath25 in fig .
[ fig : ddis ] is @xmath26 for a @xmath27 pair ( without additional gluons ) having with quark transverse momentum @xmath2 and longitudinal momentum fraction @xmath28 , the corresponding invariant mass is @xmath29     with a subsequent rescattering of the @xmath30 dipole off the target colour field ( left panel ) .
schematic diagram of the diffractive dis process @xmath31 accounting for final state rescattering by multiple gluon exchange at @xmath32 and perturbative parton shower off initial state parton which builds up the diffractive system @xmath25 ( right panel ) .
the latter can be separated from the leading proton ( or small - mass system @xmath33 ) by a rapidity gap .
the final state radiation is not shown as it does not affect the overall kinematics of the @xmath25 system.,title="fig:",scaledwidth=50.0% ]   with a subsequent rescattering of the @xmath30 dipole off the target colour field ( left panel ) .
schematic diagram of the diffractive dis process @xmath31 accounting for final state rescattering by multiple gluon exchange at @xmath32 and perturbative parton shower off initial state parton which builds up the diffractive system @xmath25 ( right panel ) .
the latter can be separated from the leading proton ( or small - mass system @xmath33 ) by a rapidity gap .
the final state radiation is not shown as it does not affect the overall kinematics of the @xmath25 system.,title="fig:",scaledwidth=35.0% ]    at large @xmath34 , the parton distribution functions ( pdfs ) of the incident proton are dominated by valence quarks leaving practically no chance for the proton to survive such an interaction , and hence resulting in a non - diffractive event . at small @xmath34 , however , the pdfs are dominated by gluons , and the partonic system @xmath25 is created in photon - gluon fusion @xmath35 as depicted in fig .
[ fig : ddis ] . in this case , the momentum exchange via multiple soft gluons with a small net fraction @xmath36 between the proton and the perturbative @xmath25 systems does not significantly change the momenta of partons emerging from the hard scattering .
however , they do change the colour structure of the resulting @xmath25 and @xmath33 systems .
the original sci model captures the main effects in many processes as ddis at hera and diffractive hard scattering at the tevatron . despite this success ,
it is not derived from a perturbative qcd amplitude . for the case of ddis ,
a derivation of the amplitude for the colour screened process has been done based on perturbative qcd in the large @xmath37 limit @xcite and provides a theoretical basis for the ddis process in terms of colour exchanges .
it improves on the previous description by introducing a dependence on the kinematical details of the event which also leads to colour transparency .
we start with the outline of the resummed colour screening amplitude and the derivation of probability for an event - by - event treatment in an event generator .    consider the ddis amplitude in impact parameter representation in the target rest frame which corresponds to the colour dipole picture of the process .
the lowest fock component of the virtual photon @xmath38 corresponds to its fluctuation to a @xmath30 dipole with transverse separation @xmath39 in the colour background field of the traget proton at impact distance @xmath40 from its centre .
the prepared fock component then propagates through the field in the proton and softly interacts with it such that it can , in principle , change its colour but not kinematics ( the dipole size is frozen at the time scale of its propagation through the colour medium ) .
we consider the forward limit where the total transverse momentum @xmath41 of gluon exchanges in the @xmath42-channel is small , @xmath43 . in this limit , as a straightforward consequence of the optical theorem in the limit of large @xmath44 c.m .
energy , the ddis amplitude @xmath45 can be written with the ordinary gluon - initiated inclusive dis amplitude @xmath46 and the dynamical colour screening ( dcs ) amplitude @xmath47 as @xmath48 where @xmath49 is the relative quark transverse momentum in the @xmath30 dipole in the lowest order subprocess @xmath50 .    the screening amplitude @xmath51 accounts for the soft gluon exchanges between the proton remnant @xmath33 and the rest of the final state commonly denoted as @xmath25 , with @xmath52 at the lowest order .
these exchanges carry a small longitudinal fraction @xmath53 and the transverse momentum transfer @xmath54 is at a soft scale @xmath55 .
@xmath51 is resummed to all orders in the large-@xmath56 limit where it acquires a simple eikonal form @xcite .
@xmath57 here , @xmath58 is the colour factor for the single gluon exchange amplitude and @xmath59 is the effective coupling constant at the soft hadronic scale @xmath55 .
the effective qcd coupling is not small in this case .
several approaches dealing with the landau singularities at low momentum transfers were proposed in the literature , e.g.  @xcite . in practice
, we use the infrared - stable analytic perturbation theory ( apt ) approach  @xcite .    for our study
we use similarly the inclusive amplitude @xmath60 in impact parameter space the fraction of the cross section with colour screening between the systems @xmath25 and @xmath33 is obtained from the ratio @xmath61 which defines the probability function for the overall colour singlet exchange . with @xmath62 , this leads to @xmath63 to apply this as the probability in a monte - carlo generated event at the parton level , we will associate @xmath64 and @xmath65 , and approximate by taking the average over the relative angle @xmath66 @xmath67 which is motivated by the fact that @xmath66 will be uniformly distributed in a sample of many collisions .     for different values of @xmath68 ( upper to lower curve ) ]
the resulting colour screening probability is shown in fig .
[ fig : rescatter - prob - for - angles ] , for different choices of @xmath59 which enters as a normalisation factor .
two important characteristic properties can here be observed .
first , infrared safety with the probability levelling off at large @xmath69 , which resembles the saturation feature of the dipole scattering amplitude .
second , vanishing colour screening probability for small dipoles @xmath70 , which is compatible with the colour transparency property .
our basic theoretical approach @xcite for resumming multiple gluon exchanges has similarities with the theory developed in @xcite and resulting in an amplitude with an eikonal factor of the form @xmath12 in similarity with eq .
( [ eik - formula ] ) above .
that approach can also be applied to both inclusive and diffractive dis starting from the same hard matrix element and employing factorization and resummation of soft @xmath42-channel gluons . despite these similarities ,
there are significant differences . in @xcite
all exchanged gluons are treated on the same footing via a wilson line resumming them into a color singlet exchange .
our approach separates one `` leading '' gluon , carrying the largest @xmath0-fraction , from the rest of the exchanged gluons which are much softer , carrying @xmath71 .
these softer gluons are resummed to all orders and are required to be in a color octet state that matches the leading gluon to an overall color singlet exchange that provide the mechanism for rapidity gap formation .
our leading gluon is treated via conventional @xmath2-factorisation in terms of the unintegrated gluon distribution in the proton , thus providing a model which is explicitly the same for diffractive and inclusive scattering without introducing any new kind of parton distribution functions , cf eq .
( [ sigmad ] ) below .
this is in contrast with the formalism in @xcite which introduces diffractive parton distribution functions ( pdf ) containing non - perturbative dynamics and interpreted as the probability to find a parton with a momentum fraction @xmath72 in the proton , provided the proton emerges intact with momentum fraction @xmath73 .
such diffractive pdfs can be analyzed theoretically @xcite which may introduce model parameters to be determined from data .    naturally , one should study these , and other , theoretical approaches and via data find the optimal description of data to understand the rather complex diffractive processes in terms of basic theory and few free parameters .
our approach has only two new parameters , which both have physical meanings that constrain their values to a rather narrow range .
the following sections specify the monte carlo implementation of the model and show detailed numerical comparisons to data .
the ddis cross section is then obtained using the inclusive cross section and standard inclusive parton densities together with the probability @xmath74 in eq .
( [ eq : prob - from - rb ] ) for dynamic colour screening resulting in @xmath75 where @xmath76 are the standard inclusive parton distributions .
@xmath77 represents the differential distribution of the standard dis cross section in @xmath78 which is obtained from the parton evolution event - by - event in the monte carlo . since @xmath78 represents the transverse size of the @xmath22 together with the pqcd radiation and the amplitude for colour screening
is dominated by a rescattering off large dipoles , we use the smallest @xmath2 difference within the partonic @xmath25-system and let @xmath79 .
although this @xmath80 is typically related to the pqcd cutoff , the monte carlo simulation can give very small such relative @xmath2 due to random angular orientations of the momentum vectors .
we therefore introduce a cut - off @xmath81 to avoid a spurious divergence and transverse sizes @xmath78 that are not perturbatively small .
thus , we let @xmath82 .
the impact parameter @xmath83 is related to the soft transverse momentum of the screening multiple gluon exchange , which is expected to be well below the factorisation scale for the pqcd processes . on the other hand @xmath84
is expected to be somewhat larger than the confining energy - momentum scale @xmath85{mev}$ ] in order for the screening process to occur fast enough that the proton state can stay quantum mechanically coherent into the final state .
the colour screening probability therefore depends on the ratio @xmath69 given by @xmath86 where @xmath81 , as mentioned , regulates the divergence .
the values of @xmath84 and @xmath81 constitute the two free parameters of the model and are to be determined from a comparison with experimental data . from the construction , we expect their values to be approximately between @xmath87 and the perturbative cutoff @xmath88 in the gluon pdf .
using eq .
( [ eq : def - rb - ratio ] ) in eq .
( [ eq : prob - from - rb ] ) results in a probability @xmath89 for the effective colour screening that depends on the internal kinematics of the system @xmath25 .
we calculate the diffractive reduced cross section @xmath90 within the same kinematic limits as applied by the experiment @xcite .
in addition , we adopt two different notions of the diffractive cross section . the first definition @xmath91 is based on a forward remnant system with a mass @xmath92{gev}$ ] and proton quantum numbers .
the other definition @xmath93 requires a large rapidity gap ( lrg ) of two units in pseudorapidity .
this choice is potentially sensitive to the inner radiation structure of the system @xmath25 because the lrg is defined in terms of pseudorapidity .
the emissions in the ccfm evolution @xcite are not strongly ordered in virtuality as they are by assumption in the dglap evolution @xcite .
therefore , the parton in the hard interaction can no longer be approximated as on - shell and instead an off - shell matrix element is used for the hard interaction .
likewise , the branching gluons in the ccfm evolution are described by an unintegrated gluon density function ( ugdf ) .    in the ccfm evolution ,
one effectively resums the leading logarithms in the energy splitting @xmath94 and @xmath95 , as well as the leading logarithms in @xmath5 .
experimental data on the ddis cross section @xmath96 covers a wide kinematic range where , in particular , one can have @xmath97 . because of such potentially very different hard scales , we expect corrections from large logarithms to become important in certain parts of the phase space . because of eq .
( [ mxdef ] ) we expect the ccfm evolution to be better suited for the ddis observables , at least , in the case of @xmath98 when the large leading logs @xmath99 are properly treated .
because of the soft divergence in the first order qcd matrix element , the hard process @xmath100 will favour an uneven splitting of the energy between the quarks
. specifically , if we define the fraction of energy taken by the quark as @xmath28 , then the matrix elements have soft divergences as @xmath94 and @xmath95 for @xmath101 or @xmath102 , respectively .
one aspect of the soft divergence is that it favors a rather large ratio between @xmath0 and the energy fraction @xmath103 of the parton entering the matrix element .
specifically , in the matrix element @xmath100 one can have a large ratio @xmath104 without any additional radiation from the quark propagator .
such a large @xmath105 is not accounted for in the initial state parton evolution . in the case of the matrix elements
@xmath106 and @xmath107 plus dglap evolution this phase space is in part taken into account , but the dglap evolution does not resum potentially large @xmath108 .
another aspect of the uneven splitting is that one of the quarks will be very forward in pseudorapidity in the lab frame when @xmath28 is close to the divergence . in this case
, the quark can have a large enough forward momentum @xmath109 to populate the gap region and the event therefore does not contribute to the diffractive cross section as defined in terms of a lrg in spite of having a leading proton .
the divergent behaviour is unphysical and is usually avoided with a cutoff .
still , an inclusion of higher order effects may be important for the cross section and also for the inner structure within the @xmath25 system .
in particular , the energy of the @xmath22 system may be shared by additional gluons and therefore significantly reduce the rapidity range of the final @xmath25-system and therefore can have an influence on the lrg observable .     in comparison with the h1 data @xcite .
the model prediction uses dynamic colour screening with the parameters and and the cascade event generator with ccfm evolution .
@xmath89 for the fitted parameters is shown in the upper - left corner .
diffractive events in the model are defined as having a remnant system @xmath33 with proton quantum numbers and invariant mass @xmath92{gev}$ ] .
rows for different values of @xmath110 are offset by a factor @xmath111 as indicated on the figure . ]      in order to study the dynamic colour screening in more detail , we interface the model with different monte carlo event generators . in particular , we employ the program lepto @xcite which offers first order qed and first order qcd matrix elements combined with dglap @xcite parton showering and collinear pdfs . as a second program we use cascade
@xcite which offers @xmath112 with @xmath2-factorised off - shell matrix elements and ccfm evolution @xcite which is intended to account for potentially large logarithms of incident momentum fractions of radiated partons .
the photon - gluon fusion matrix element @xmath113 illustrated also in fig .
[ fig : ddis ] is the dominant contribution to the diffractive dis cross section at small @xmath0 .
lepto includes this process as a first order qcd matrix element , as well as via a combination of the qed hard process @xmath114 augmented by a @xmath115 dglap splitting .
cascade provides this process as an off - shell first order qcd matrix element , but not as a first order qed matrix element with parton splitting .    after generating events on parton level using matrix elements augmented with initial and final state parton showers ,
we apply the colour screening model before any special treatment of the remnant .
in particular , we do not allow any cluster fragmentation of systems with a small invariant mass because the dynamic screening will potentially change the colour topology of the event before the scale of hadronization is reached and therefore change the possible outcomes of the fragmentation .
this is understood as colour rescattering to happen on the scale between the perturbative cutoff at @xmath116{gev}$ ] and @xmath87 of hadronisation .
the remnant system is in a monte carlo program treated by a non - perturbative model . for the case
that the perturbative interaction resolves a gluon , which is the class of events which potentially leads to diffraction , the remnant is usually split into a @xmath117 pair with a certain sharing of momenta .
this splitting typically introduces a relative transverse momentum representing the fermi motion in the bound state proton which is given by a gaussian distribution with a width @xmath118 .
this relative @xmath2 affects the later hadronisation which introduces an uncertainty for the prediction of a forward proton spectrum . in this work ,
we are interested in diffraction defined by a forward small - mass system with proton quantum numbers or a large rapidity gap , which is insensitive to whether the hadronisation model maps the small - mass forward remnant state to a proton state or a resonance .
all plots for the diffractive cross section in this paper show the reduced cross section @xmath119 which is related to the cross section via @xmath120 with @xmath121 given as @xmath122 with the negligible nucleon mass @xmath123 .    , @xmath124 and for different values of @xmath5 . as the hard scale increases
, there is more phase space for initial state radiation available and we see more gluon branchings . as the number of gluon branchings increases , a larger part of the full perturbative event and specifically its @xmath110-value is described using ccfm evolution which leads to a more accurate differential cross section . ]     as in fig .
[ fig : cascade_cutsnone_m01alphas70 ] but model results using the lepto event generator based on matrix elements for all hard processes to order @xmath125 and parton showers based on dglap @xmath1 evolution .
the parameters for the dynamic colour screening model obtained from the fit against data @xcite are and . ]     but with a constant probability of @xmath126 fitted from this data .
we observe that especially at small @xmath110 the resulting diffractive cross section has a significantly different slope with respect to @xmath5 and the description of data is not as good as in the case of the dynamic rescattering model . ]
[ fig : cascade_cutsnone_m01alphas70 ] shows the diffractive cross section @xmath127 obtained with dynamic colour screening and the process @xmath128 from the cascade event generator with ccfm evolution .
events are selected according to the forward small - mass system prescription which requires a remnant system @xmath33 with proton quantum numbers and invariant mass @xmath92{gev}$ ] .
the two parameters of the rescattering model are fitted and we obtain and .
these values are physically reasonable in the sense that both are between @xmath87 and @xmath88 , and that the typical transverse momentum scale @xmath84 of the proton background is smaller than the minimal transverse momentum scale @xmath81 of the partonic @xmath25 system .
we note that there is an overall good agreement with experimental data over a very wide region of the kinematical space .
this agreement is remarkable because the model does not introduce specialised diffractive parton distributions , but uses standard proton ugdfs as input and introduces only two new physically motivated parameters .
nevertheless , we note that one specific kinematic region is not very well described , namely , where @xmath110 and @xmath5 are both small and @xmath34 is large .
the discrepancy develops for @xmath129 and increases for decreasing @xmath5 in the range of a few @xmath130 .
a qualitative understanding of the problem can here be obtained from the principles of parton evolution via gluon radiation . at small @xmath110 , meaning large @xmath131 compared to @xmath5 , large logarithms of @xmath132 become important . on the other hand , at small @xmath5 scales ,
the event is mainly described by the matrix element , whereas the shower activity is low , which leads to a relative damping of the cross section with respect to the data .
this lower radiative activity is illustrated in fig .
[ fig : branchings-3em2 - 17em3 ] in terms of the number of branchings in the parton evolution for different @xmath5 at a representative value of @xmath124 .    at very small @xmath133
there is a very long evolution path from the initial gluon with momentum fraction @xmath34 to a much smaller bjorken-@xmath0 at the quark - photon vertex .
the cascade event generator has the advantage to resum both @xmath1 and @xmath134 contributions in its ccfm - based treatment of initial - state gluon radiation off the incoming gluon .
however , gluon emissions from the quark propagator between the @xmath115 vertex and the quark - photon vertex ( _ cf .
[ fig : ddis]b ) can also generate large @xmath134 contributions , in particular for the longest total evolution paths at very small @xmath110 .
this radiation from the quark propagator can not be generated in cascade since the ccfm equation only includes gluon radiation from gluons and not from quarks .
the simulation process starts by using the hard matrix element for @xmath135 , and then the initial gluon is evolved down to the starting scale of the proton state .
thus , at very small @xmath110 in particular , there can be a substantial phase space available for gluon radiation off the quark propagator connecting to the virtual photon , which is not taken into account .
gluon emission from the quark propagator can be taken into account by instead using the lepto monte carlo generator .
it includes not only the hard matrix element for @xmath136 but also the other first order qcd process @xmath137 , where the gluon can be emitted from the incoming or outgoing quark , as well as the zeroth - order process @xmath114 . for both these processes ,
additional gluon radiation from the initial quark may occur through the initial - state parton showering , which in lepto is generated through conventional dglap evolution in @xmath1 , but without a resummation of @xmath134 contributions .
[ fig : lepto_cutsnone ] shows the results of using lepto with the same dynamic colour screening model , with fitted parameter values and of expected magnitudes .
the description of data is good in the inner region of the covered kinematic space , but with substantial discrepancies at small @xmath34 and very large @xmath110 . in the discussed problematic region , however , the agreement with data is better than that for cascade at large @xmath34 , small @xmath5 and small @xmath110 around 0.01 , although not at the very smallest @xmath138 .
this indicates that , as discussed , emissions from the quark propagator is of some importance , but accounting for large @xmath134 contributions is also needed .
no presently available event generator include all the mentioned effects that seems necessary in order to describe the diffractive cross - section over the entire kinematic region .
the indication is , however , that combining all available theoretical formalisms in perturbative qcd , i.e. matrix elements and parton showers including @xmath1 and @xmath134 resummations , with the dynamical colour screening model presented here should provide a working description of the observed diffractive deep inelastic scattering process .
constrained only by the requirement to be in the physically sensible range @xmath139 $ ] and to be fairly smooth .
solid line : the probability from the fit of the colour screening model as used in fig .
[ fig : cascade_cutsnone_m01alphas70 ] ( upper left corner ) .
we note that both methods result in very similar functions for @xmath89 . ]
it is interesting to compare the dynamic colour screening model with the results from having a fixed colour screening probability while keeping all other parameters equal .
[ fig : cascade_cutsnone_const ] shows the diffractive cross section with @xmath126 , obtained by a fit to data .
we note that the constant probability results in a significantly worse description of the data .
the overall normalisation as well as the shape of @xmath96 with respect to @xmath5 is better described by the dynamic screening model .    in the results from the dynamic model of fig .
[ fig : cascade_cutsnone_m01alphas70 ] , we have fitted the two parameters @xmath81 and @xmath84 of the dynamic screening model to data .
the parameters determine the overall normalisation and essentially the position of the slope where the screening probability @xmath89 falls off to zero .
on the other hand , the general shape of this probability is given by the underlying model itself .
it is interesting though to investigate what form of @xmath89 would result in a good fit without assuming an underlying model . to this end
, we fit a mapping @xmath140 which is only constrained by the fact that it should lie in the physically sensible range @xmath141 $ ] and that it should be reasonably smooth .
the result of such a fit is shown in fig .
[ fig : prob - casc - m01-alphas70 ] .
we observe that even though we did not place any particular constraint on the functional form , one obtains essentially the same result as in the dynamic screening model and therefore support to its qcd - basis .       at the scales 1 , 4 and @xmath142{gev}$ ] for the solid , dashed and dotted lines , respectively , is shown in the left panel .
the gluon density a1 for the same scales is shown in the right panel .
the distribution starts out with a steeper slope at small scales and influences the observable as shown in fig .
[ fig : cascade_gdf1013_cutsnone_m01alphas70 ] . ]     at the scales 1 , 4 and @xmath142{gev}$ ] for the solid , dashed and dotted lines , respectively , is shown in the left panel .
the gluon density a1 for the same scales is shown in the right panel .
the distribution starts out with a steeper slope at small scales and influences the observable as shown in fig .
[ fig : cascade_gdf1013_cutsnone_m01alphas70 ] . ]
[ fig : gdf - plot-1013 ]     but using a gluon density @xmath143 that increases stronger towards low-@xmath0 already at the starting scale ( a0 in @xcite ) .
only the interesting subset of the kinematic plane is shown . by comparison with fig .
[ fig : cascade_cutsnone_m01alphas70 ] it is seen that @xmath96 is at large @xmath110 and large @xmath34 sensitive to the shape of the gluon density at the starting scale . ]
the result in fig .
[ fig : cascade_cutsnone_m01alphas70 ] is obtained using the unintegrated gluon density @xmath144 illustrated in fig .
[ fig : gdf - plot-1010 ] ( left ) .
this density starts out flat at a low scale @xmath145 which can be compared with the @xmath146 behavior of the pomeron flux in regge - based models .
the diffractive cross section in our model is sensitive to the slope especially in the kinematic region where @xmath110 is large . we can compare the main result in fig .
[ fig : cascade_cutsnone_m01alphas70 ] with the result obtained by using a parton density which has a stronger increase towards small @xmath0 already at low scales , shown in fig .
[ fig : gdf - plot-1010 ] ( right ) .
the corresponding @xmath127 is shown in fig .
[ fig : cascade_gdf1013_cutsnone_m01alphas70 ] .
we note that especially the dependence of the cross section on @xmath5 is sensitive to the gluon density @xmath144 at small scales @xmath145 . by including diffractive data into the fit of a gluon density
, this dependence could be used to further constrain the shape of the gluon distribution at low scales .
but showing @xmath147 where the diffractive cross section is defined in terms of a large rapidity gap between @xmath148 and @xmath149 in pseudorapidity . ]     range available in the experimental data is indicated by a horizontal thinner line for each row in @xmath110 .
the fraction of events with a gluon in the lrg region is shown in the two rightmost plots . ]
range available in the experimental data is indicated by a horizontal thinner line for each row in @xmath110 .
the fraction of events with a gluon in the lrg region is shown in the two rightmost plots . ]
[ fig : cascade_lrg40t60_m01alphas70 ] shows the diffractive cross section @xmath150 as defined by the presence of a large rapidity gap in the range @xmath151 in pseudorapidity .
we note the close similarity to fig .
[ fig : cascade_cutsnone_m01alphas70 ] .
when requiring a minimum gap size @xmath152 in the event , the non - diffractive cross - section is exponentially suppressed by @xmath152 . while the presence of a lrg of size @xmath152 in the final state is a clear indication of diffraction , the exact location of the gap is sensitive to the description of the kinematics of the central system @xmath25 , and @xmath150 depends therefore additionally on the treatment of dynamics within the @xmath25-system .
the dynamic colour screening model describes the probability of a colour screened interaction , but the additional soft exchanges do not change the kinematics of final state partons .
we know on the other hand that our description in terms of matrix elements plus showering does not cover the full phase space .
especially , the lack of additional gluon radiation from the quark propagator in the matrix element @xmath112 could be the reason why this @xmath22-system extends up to too high rapidity and can hadronize into the gap region .
we therefore keep the gap size @xmath153 as in the data , but shift its starting value from 3.3 in data to 4 .
this modification is irrelevant for our result at @xmath154 , but noticeable at @xmath155 where it causes at most a correction of @xmath156 at small @xmath110 and small @xmath5 , but becomes important at @xmath157 .
we expect @xmath150 to be sensitive to higher order corrections especially close to the soft divergence @xmath94 where partons from the matrix element cause activity in the lrg region .
this is illustrated in fig .
[ fig : lrg - parton - veto ] where the fraction of events having a @xmath19 or @xmath158 with momentum vector into the lrg is shown .
we note that the fraction of quarks in the lrg increases towards low @xmath5 which can be understood from the correlation between @xmath5 and the transverse momentum . on the other hand
, the fraction of gluons in the lrg depends more strongly on @xmath34 and weaker on @xmath5 .
this can be understood from the fact that gluons arise from the parton shower in contrast to the quarks which are defined by the matrix element .    at the leading order of our computation
, we note that the result is only mildly sensitive to the cuts employed to regulate the @xmath94 divergence .
also , a comparison with massive matrix elements at leading order suggests that typical quark masses lead effectively to the same cuts on the energy sharing variable @xmath28 as used in our results . on the other hand , higher order corrections
could significantly alter the internal event structure , especially in the region of the phase space where it is likely to have a large step @xmath28 between @xmath0 and @xmath103 .
there , an additional final state gluon could modify the extension of the @xmath25 system in rapidity . an improved parton evolution based on ccfm with additional splittings @xmath159 and @xmath160
could therefore in principle improve the description further because the diffractive process at a low scale could be described with a qed matrix element and low @xmath0 resummed parton evolution .
similarly , @xmath150 is also sensitive to the distribution of the transverse momenta and energy splitting in the parton shower .
we have developed the probability for dynamic colour screening in dis in a way that can be used in monte carlo event generators and applied it with cascade and lepto .
the resulting model predicts the diffractive dis cross section based on perturbative qcd matrix elements and standard inclusive parton densities in both collinear and @xmath2-factorisation approaches .
this facilitates practical applications of previously obtained theoretical derivations of the amplitude for colour screening through semi - soft multiple gluon exchanges calculated in the eikonal approximation to all orders in perturbative qcd .
the basic formalism gives a theoretical understanding why the soft colour interaction ( sci ) model has been phenomenologically successful , but goes beyond that model by leading to a colour screening probability that depends on the dynamics of the perturbative qcd parton dynamics .
this dynamical screening probability exhibits a saturated behaviour at small transverse momenta of the emerging parton system as well as colour transparency at large transverse momentum .
the monte carlo model has only two , physically motivated parameters .
their values are obtained by fitting the hera diffractive cross section and found to be of the expected magnitude .
the model successfully describes the data over a large kinematic range , significantly better than with a constant screening probability .
interestingly , a fit of a free - form probability function results in the same shape as in our model , and hence gives support for our account of the basic qcd dynamics of relevance .
it is noteworthy that we have not introduced any diffractive parton distribution functions to describe soft dynamics through unknown functions fitted to data .
this explicitly demonstrates that diffractive and inclusive scattering can be described by the same basic qcd processes when explicit account is taken of color degrees of freedom in gluon exchanges at scales below normal cut - offs of @xmath161 gev of hard , perturbative qcd processes and @xmath162 of the hadronisation phase transition .    in some kinematic regions
there are two very different scales present , namely the invariant mass of the diffractive system @xmath131 and the photon virtuality @xmath5 .
this calls for a resummation of large logarithms @xmath163 , or equivalently @xmath164 . to address this issue ,
we take the cross section in the @xmath2-factorisation approach from off - shell matrix elements and unintegrated gluon densities together with the ccfm evolution which provides a resummation of leading logarithms in @xmath165 .
we show that this significantly improves the description of the diffractive hera data at @xmath166 corresponding to @xmath97 .
nevertheless , there are residual deviations in the region where both @xmath110 and @xmath5 are at their lowest values .
this may be attributed to the extreme region of very small @xmath110 when the quark propagator connected to the virtual photon have a significant phase space available for gluon radiation , which is not accounted for ; neither in the leading order matrix element for @xmath167 nor in the ccfm evolution that does not include the @xmath160 splitting .
the dglap evolution does include this and also shows a slightly better result in this case , but is still not sufficient since here the effects of large @xmath168 is not included .    to conclude and connect to the discussion in the introduction
, our study has shown that the phenomenon of diffractive deep inelastic scattering can be described using a basic qcd - framework .
the hard subprocess is treated in the same way as for non - diffractive events but a colour screening process occurs as a result of multiple gluon exchanges that are resummed to all orders .
significant deviations from data occur in a special kinematic region , where potentially large logarithmic corrections are not yet fully included in available evolution equations for gluon radiation .
still , the overall results show that gluonic colour screening in qcd is a viable approach to understand diffraction .        j.  r.  forshaw and d.  a.  ross , cambridge lect
.  notes phys .
* 9 * , 1 ( 1997 ) .
g.  ingelman and p.  e.  schlein , phys .
b * 152 * , 256 ( 1985 ) .
r.  bonino _ et al . _
[ ua8 collaboration ] , phys .
b * 211 * , 239 ( 1988 ) .
g.  ingelman , int .
j.  mod .
a * 21 * , 1805 ( 2006 ) [ hep - ph/0512146 ] .
s.  chekanov _ et al . _
[ zeus collaboration ] , nucl .
b * 816 * , 1 ( 2009 ) ; t.  ahmed _ et al .
_ , nucl .
b * 429 * , 477 ( 1994 ) ; nucl .
b * 435 * , 3 ( 1995 ) .
f.  d.  aaron _ et al . _ [ h1 and zeus collaborations ] , eur .
j.  c * 72 * , 2175 ( 2012 ) [ arxiv:1207.4864 [ hep - ex ] ] .
g.  ingelman and k.  prytz , z.  phys .
c * 58 * , 285 ( 1993 ) .
t.  affolder _ et al . _
[ cdf collaboration ] , phys .
lett .   *
84 * , 5043 ( 2000 ) .
a.  edin , g.  ingelman and j.  rathsman , phys .
b * 366 * , 371 ( 1996 ) ; z.  phys .
c * 75 * , 57 ( 1997 ) .
g.  ingelman , a.  edin and j.  rathsman , comput .
commun .
* 101 * , 108 ( 1997 ) .
t.  sjstrand , s.  mrenna and p.  z.  skands , jhep * 0605 * , 026 ( 2006 ) [ hep - ph/0603175 ] .
a.  edin , g.  ingelman and j.  rathsman , phys .
d * 56 * , 7317 ( 1997 ) .
r.  enberg , g.  ingelman and n.  timneanu , phys .
d * 64 * , 114015 ( 2001 ) .
g.  ingelman , r.  pasechnik , j.  rathsman and d.  werder , phys .
d * 87 * , no .
9 , 094017 ( 2013 ) [ arxiv:1210.5976 [ hep - ph ] ] .
r.  enberg , g.  ingelman , a.  kissavos and n.  timneanu , phys .
lett .   * 89 * , 081801 ( 2002 ) .
j.  rathsman , phys .
b * 452 * , 364 ( 1999 ) [ hep - ph/9812423 ] .
s.  j.  brodsky , r.  enberg , p.  hoyer and g.  ingelman , phys .
d * 71 * , 074020 ( 2005 ) .
r.  pasechnik , r.  enberg and g.  ingelman , phys .
d * 82 * , 054036 ( 2010 ) ; phys .
b * 695 * , 189 ( 2011 ) .
f.  hautmann , z.  kunszt and d.  e.  soper , phys .
lett .   * 81 * , 3333 ( 1998 ) ; nucl .
b * 563 * , 153 ( 1999 ) .
f.  hautmann and d.  e.  soper , phys .
d * 63 * , 011501 ( 2001 ) ; phys .
d * 75 * , 074020 ( 2007 ) . v.  n.  gribov and l.  n.  lipatov , sov .
j.  nucl .
* 15 * , 438 ( 1972 ) [ yad
.  fiz .   * 15 * , 781 ( 1972 ) ] ; + g.  altarelli and g.  parisi , nucl .
b * 126 * , 298 ( 1977 ) ; + y.  l.  dokshitzer , sov .
jetp * 46 * , 641 ( 1977 ) [ zh .
fiz .   * 73 * , 1216 ( 1977 ) ] .
h.  jung _ et al .
_ , eur .
j.  c * 70 * , 1237 ( 2010 ) .
s.  catani , f.  fiorani and g.  marchesini , nucl .
b * 336 * , 18 ( 1990 ) ; + s.  catani , f.  fiorani and g.  marchesini , phys .
b * 234 * , 339 ( 1990 ) ; + s.  catani , m.  ciafaloni and f.  hautmann , nucl .
b * 366 * , 135 ( 1991 ) ; + g.  marchesini , nucl .
b * 445 * , 49 ( 1995 ) [ hep - ph/9412327 ] .
b.  andersson , g.  gustafson , g.  ingelman and t.  sjstrand , phys .
rept .   * 97 * , 31 ( 1983 ) .
s.  j.  brodsky , g.  f.  de teramond and a.  deur , phys .
d * 81 * , 096010 ( 2010 ) .
d.  v.  shirkov and i.  l.  solovtsov , phys .
* 79 * , 1209 ( 1997 ) .
f.  d.  aaron _ et al .
_ [ h1 collaboration ] , eur .
j.  c * 72 * ( 2012 ) 2074 [ arxiv:1203.4495 [ hep - ex ] ] .