recent developments involving imaging atmospheric cherenkov telescopes ( iacts ) have revolutionised the field of very high energy ( vhe ) @xmath1-ray  astronomy .
indeed , observational data obtained using the current generation of stereoscopic arrays have contributed over 100 new sources to the catalogue of confirmed gev - tev emitters .
notwithstanding these impressive achievements , the motivation for astronomers to continue identifying and categorising additional @xmath1-ray  sources and source populations remains undiminished .
the initial source detections are likely to be dominated by luminous or nearby @xmath1-ray  emitters , implying a requirement for subsequent observations to target progressively fainter source populations .
accordingly , the development of analytical techniques which enable maximal exploitation of the available instrumental sensitivity will become increasingly important as the life - cycles of the various iact arrays unfold .
this emerging philosophy is exemplified by the recent work of @xcite which employs accurate knowledge of the instrumental response to enhance the performance and reliability of an established technique for source detection originally developed by @xcite .    until recently
, the inherent faintness of astrophysical vhe @xmath1-ray  fluxes has resulted in statistically limited signal measurements with uncertainties that are dominated by poissonian shot noise . accordingly
, many traditional iact analyses have justifiably neglected the existence of previously sub - dominant systematic effects .
in contrast , successful source detection at the limits of instrumental sensitivity requires deep observations and the accumulation of rich data sets with abundant event statistics . in this new regime , the relative contribution of statistical fluctuations to the overall error budget is suppressed with measurement accuracy ultimately becoming systematically limited .
this work investigates methods for the appropriate statistical treatment of systematic uncertainties affecting iact observational data and their subsequent analysis . in cherenkov astronomy ,
the synthesis of large data sets typically involves aggregation of temporally sparse event statistics which correspond to distinct values of various observational parameters , each of which can introduce distinct , observation - specific systematic biases .
accordingly , analyses that are designed to ameliorate the impact of irreducible systematic effects must incorporate sufficient flexibility to successfully model this inter - observational variability .    in the subsequent discussion , the relevant statistical issues and the techniques designed to address them are illustrated using the specific example of _ stacking _ analysis .
in such analyses , measurement data that correspond to multiple , independent but similar experiments are combined to enhance their scientific utility . in the context of @xmath1-ray  astronomy ,
stacking analyses are commonly applied in situations when a target population comprises a large number of individually undetectable source candidates that are theoretically expected to exhibit at least one identical signal characteristic . in the absence of genuine @xmath1-ray  emission
, the superimposed observational data will be consistent with random poisson fluctuations about the mean background level .
conversely , multiple faint signals produced by a genuine sample of faint @xmath1-ray  sources will reinforce upon combination , yielding a significant overall excess with respect to the measured background . accordingly , stacking analyses often facilitate the derivation of average source properties for the target population as a whole , even when detection of individual @xmath1-ray  signals is rendered impossible by inadequate instrumental sensitivity . the specific consideration of stacking is instructive because combined source analysis inherently segregates subsets of observational data which are likely to incorporate distinct systematic biases .
moreover , stacking analyses provide a more intuitive distinction between systematic effects that undergo temporal variation , such as telescope elevation or optical efficiency , and those that vary on a target - wise basis , such as the ambient night - sky brightness of the number of @xmath1-ray  sources within the telescope field - of - view .
compelling and theoretically well motivated target populations for combined source analyses include x - ray binary systems @xcite , combined pulsar populations within globular clusters and the self - annihilating dark matter components of dwarf spheroidal galaxies ( e.g. * ? ? ?
the atmosphere of the earth is almost completely opaque to multi - gev and tev radiation and accordingly , the operational mode of iact arrays relies upon indirect detection of astrophysical @xmath1-rays .
indeed , the majority of incident vhe photons undergo electron - positron pair production interactions within the coulomb fields of stratospheric nuclei .
frequently , these interactions initiate electromagnetic cascades of charged particles , which radiate cherenkov light as they descend superluminally through the dielectric medium of the atmosphere .
iact arrays are designed to image the resultant distribution of cherenkov photons at ground - level , using the encoded information to reconstruct the properties of the progenitor @xmath1-ray .
the set of reconstructed @xmath1-ray  properties define a multi - dimensional parameter space , with suitable sub - spaces that define the event populations that are required for specific astrophysical analyses .
the situation is complicated somewhat by the fact that iact arrays operate in a strongly background dominated regime and must successfully distinguish a comparatively weak @xmath1-ray  signal from an almost overwhelming background of air - showers initiated by hadronic cosmic rays .
fortunately , the properties of hadron- and @xmath1-ray - initiated air - showers are sufficiently disparate that an effective segregation is possible based on the characteristics of the captured cherenkov images .
traditionally , a simplified elliptical parameterisation of the cherenkov light distribution was used in conjunction with lookup tables of simulated air - shower properties to separate the signal and background event populations @xcite .
modern computational resources permit utilisation of the complete cherenkov images ( e.g * ? ? ?
* ; * ? ? ?
* ) and the application of advanced machine - learning algorithms ( e.g * ? ? ?
* ) to further enhance the background rejection efficiency .
despite these sophisticated filtering techniques , the sheer number of air - showers that trigger an iact array during a given observation inevitably results in a subset of hadron - originated cherenkov images which are sufficiently @xmath1-ray - like in appearance to survive the event selection procedure .
quantitatively , the probability that a @xmath1-ray - like event having specific reconstructed parameters will pass background rejection is described by a multi - dimensional _ acceptance _ function .
the reconstructed @xmath1-ray  signal ( @xmath2 ) within a suitably defined sampling region of the event property parameter space is a superposition of the true @xmath1-ray  signal ( @xmath3 ) on an irreducible background ( @xmath4 ) of spuriously classified events . @xmath5
the magnitude of the background component is typically estimated using the number of @xmath1-ray - like events ( @xmath6 ) that are reconstructed within one or more nominally off - source regions . adopting this convention ,
is normally re - expressed as @xmath7 where @xmath0 is a normalisation factor which compensates for any disparities in the instrumental response among the various sampling regions .
fundamentally , the precise value of @xmath0 is dependent upon specific characteristics of the individual observations that contribute to the overall data set .
numerous variable factors such as the target zenith and azimuthal angles , the configuration and functionality of individual telescopes within a larger array , or the ambient atmospheric conditions may modify the nominal system performance .
the functional dependency of @xmath0 on the various observational and instrumental parameters is complicated and is must typically be resolved for each observation using a multi - dimensional model estimate of the prevailing system acceptance .
candidate models may be synthesised by interpolating the distributions of representative @xmath1-ray - like background data sets , assembled from multiple independent observations of empty fields - of - view .
accurate replication of the true system acceptance using this technique requires an extensive database of suitable observations with characteristics that sample the entire space of observational parameters with adequate resolution . for certain well - understood parameters it may be possible to derive semi - analytic parameterisations of the corresponding systematic distortions , which can improve the interpolation accuracy and reduce the required sampling density
nonetheless , for complicated instruments with a large number of possible configurations , the observation time required to populate the reference database may be prohibitive .
alternatively , response models which inherently incorporate the appropriate systematic offsets can be constructed on an observation - wise basis using the subset of @xmath1-ray - like background events that fall outside of the fiducial sampling regions . however , this approach is susceptible to contamination by imperfectly excluded @xmath1-ray  sources and is ultimately limited by the availability of event statistics within a single field - of - view .    for the current generation of iacts ,
residual discrepancies between the generated model and the true instrumental response reflect a superposition of imperfectly modelled systematic offsets and are typically at the few percent level .
however , if observational situations arise in which both approaches for modelling the system acceptance are compromised , the resultant disparity could be much larger .
for example , if the telescope configuration or the prevailing operating conditions restrict the availability of appropriate archival background data and the target field - of - view is crowded , then systematic effects could dominate statistical uncertainties when searching for faint @xmath1-ray  sources .
moreover , since the combined impact of multiple systematic effects is often reflected by _ non - uniform _ variations in the system acceptance , the relative extent and location of the sampling regions within the event property parameter space may also bias the estimated value of @xmath0 .
most experiments tacitly acknowledge the uncertainty in @xmath0 by attaching a conservative systematic error term to their quoted results .
conventional stacking analyses typically entail simple summation of the observed event counts associated with the individual targets in the population sample , with the aggregate datasets forming the basis for subsequent astrophysical inference .
however , the background estimation procedures outlined in @xmath8[subsec : obs_technique ] render this traditional approach ( hereafter referred to as _
data stacking _ ) sub - optimal in the context of vhe @xmath1-ray  observations . in particular , data stacking analyses are complicated somewhat by the requirement to synthesise a combined value of the normalisation parameter @xmath9 which corresponds to the stacked dataset .
a viable approach uses the definition of the overall signal excess , @xmath10 to form an average over all @xmath11 targets in the sample , weighted by the individual off - source counts .
@xmath12 unfortunately , this technique fails to account for any target - specific uncertainties that arise during derivation of the individual @xmath13 .
even if no systematic _ biases _ are introduced , the diverse observational parameters that correspond to each individual target dataset will likely affect accuracy to which the corresponding values of @xmath13 can be determined .
the resultant non - uniformity renders subsequent propagation of the individual error estimates to the value of @xmath9 somewhat problematic for the data stacking approach .
indeed , it is often unclear how the individual uncertainties should be combined in a statistically consistent manner , particularly when they are characterised by asymmetric intervals or more complicated probability distributions .
assignment of a uniform but conservative systematic error term to all of the @xmath13 renders the problem tractable , but inevitably results in an overall loss of sensitivity .
moreover , indications exist that the shortcomings of the data stacking technique can be problematic in experimental situations .
indeed , @xcite derived anomalously high combined significance results when applying a data stacking procedure to two independent target ensembles comprising 37 and 44 putative vhe @xmath1-ray sources for which @xmath14 and @xmath15 . by studying the on and off - source event count distributions ,
@xcite concluded that a relative target - wise dispersion @xmath16 was required to explain the derived significances in the absence of a true @xmath1-ray  signal .    in subsequent sections ,
the statistical behaviour of the data stacking approach is investigated , highlighting the limited applicability of this technique in scenarios for which @xmath0 is uncertain . in response to these inherent shortcomings , a statistically robust method for the combination of iact observations
is outlined , which allows systematic uncertainties to be treated on a target - by - target basis . using this technique ,
observations yielding weakly constrained values of @xmath13 may be usefully and consistently combined with more reliable datasets , without diluting the scientific utility of the latter .
the new method operates by defining target - specific likelihood functions which facilitate appropriate treatment of relevant systematic uncertainties . stacking is implemented by forming a product of individual target likelihood functions and using this combined likelihood to estimate the shared characteristics of the putative @xmath1-ray  signals .
it should be emphasised that the applicability of the method is contingent upon an implicit assumption of at least one identical signal characteristic for all targets comprising the sample . realistically ,
signal characteristics for which the required assumption of universality is reasonable are typically target - specific functions of the experimental observables . as discussed in the subsequent paragraphs , disparities between putative sub - populations comprising the target sample are inherently problematic in the context of data stacking . in contrast
, the suggested approach intrinsically facilitates straightforward customisation of the individual target likelihoods .
construction of the single target likelihood function proceeds under the assumption that the sample of @xmath1-ray - like events that are reconstructed within a nominal sampling region is drawn from a parent population with poisson distributed arrival times .
accordingly , if the value of @xmath0 were precisely constrained , then would imply @xmath17 where @xmath18 and @xmath19 denotes the true mean value of the poisson distributed variables @xmath2 and @xmath6 respectively .
the new parameter @xmath20 represents the unknown , true value of the derived normalisation parameter .
in fact , the assumed validity of is implicit in the derivation of @xmath9 in with likely deviations from this idealised behaviour undermining the reliability of the traditional data stacking framework .
conversely , the combined likelihood approach treats target - specific systematic uncertainties by modelling @xmath0 as a random variable with arbitrary distribution @xmath21 . as indicated in @xmath8[subsec : obs_technique ] , the specific functional definitions of @xmath21 are dependent upon observational parameters which are likely to vary on a target - by - target basis .
the probability density function which models an abstract single - target dataset @xmath22 is simply the product of the distributions of its component data .
@xmath23 accordingly , substitution for @xmath24 using a concrete observational dataset @xmath25 enables calculation of the target - specific likelihood describing the true @xmath1-ray  signal . @xmath26
modelling systematically uncertain parameters as random variables with known probability density functions is a common statistical approach , with applications extending beyond the limited domain of stacking analyses ( e.g. * ? ? ?
indeed , equations and are equally valid in single target iact analyses that must accommodate non - negligible systematic uncertainties on the estimated value of @xmath0 .
the ultimate goal of this stacking procedure is to obtain improved constraints on the global @xmath1-ray  signal characteristics . in this context , @xmath19 and @xmath20
are not of primary interest and are therefore categorised as nuisance parameters throughout the subsequent analysis .    finally , the joint likelihood describing the global signal characteristics of the entire ensemble of @xmath11 targets is simply the product of the individual target likelihoods .
@xmath27 accordingly , the set of values which parameterise @xmath28 is the union of the parameters of the component single - target likelihood functions and therefore incorporates @xmath29 uncertain nuisance parameters .
the initial objective of a stacking analysis is typically the conclusive detection of a combined @xmath1-ray  excess , with detailed investigation of specific signal characteristics assuming subsidiary importance . in such situations ,
the probability of detection is typically evaluated in terms of the the significance , @xmath30 with which experimental data exclude the null hypothesis of zero signal .    for an abstract likelihood function
@xmath31 relating the experimental data @xmath32 to multiple nuisance parameters , @xmath33 and parameters of interest @xmath34 , a popular formula for calculation of detection significance @xcite employs the likelihood ratio defined by @xcite @xmath35 where a caret denotes the maximum likelihood estimate of the accented symbol , @xmath36 denotes the value of @xmath37 which corresponds to the null hypothesis , and @xmath38 represents the conditional maximum likelihood estimate for @xmath39 given that @xmath40 .
the significance is subsequently defined in terms of @xmath41 @xmath42 which reduces to @xmath43^{n_{\rm on } } + n_{\rm off}\ln\left[(1+\alpha)\frac{n_{\rm off}}{n_{\rm on } + n_{\rm off } } \right]^{n_{\rm on}}\right\}^{\frac{1}{2}}\ ] ] as reported by ( * ? ? ?
* equation 17 ) and is nominally @xmath44 distributed for a typical , single - target dataset with negligible @xmath0 uncertainty i.e. @xmath22 .
proponents of data stacking typically emulate the single - target approach by using equation 17 in conjunction with a pseudo - dataset @xmath45 .
consequently , non - uniform observational dependencies the individual @xmath13 become entangled , which inevitably complicates statistically robust treatment of their effects .
conversely , direct substitution of @xmath46 in the calculation of @xmath47 in the joint - likelihood approach ensures that the resultant expression for @xmath30 is constructed using all available information regarding target - specific systematic uncertainties .
recently , @xcite proposed an extension to the method suggested by @xcite which uses well - calibrated estimates of the instrumental point - spread function to achieve enhanced sensitivity relative to the more traditional analysis .
their technique ameliorates the effect of systematic variations in the telescope acceptance characteristics by segregating the observational data on the basis of prevailing instrumental and environmental parameters .
results that are derived from a joint likelihood stacking analysis comprise estimates of the various experimental parameters of interest , with any uncertainty quantified using associated confidence intervals .
the frequentist definition of a properly constructed @xmath48 confidence interval states that @xmath48 of such intervals , generated from a large number of independent experimental measurements of a quantity @xmath49 , will contain ( or _ cover _ ) the true value @xmath50 .
confidence intervals which fulfil this criterion are described as having correct _
coverage_. construction of confidence intervals typically uses experimental data to define a test statistic which is subsequently used to identify regions of the relevant parameter space that fulfil the required statistical criteria . the _ profile likelihood _ is an appropriate choice of test statistic in situations that require the treatment of multiple nuisance parameters .
the profile likelihood is defined as the ratio @xmath51 where previously encountered symbols retain their earlier definitions and @xmath52 represents the conditional maximum likelihood estimate for @xmath39 assuming a specific value of @xmath37 .
conveniently , the distribution of @xmath53 converges to that of a @xmath54 random variate with @xmath55 degrees of freedom for large experimental data sets ( e.g. * ? ? ?
* ) . accordingly
, straightforward derivation of confidence intervals is facilitated by comparison of the derived test statistic with appropriate percentiles of the relevant @xmath54 distribution .
moreover , the profile likelihood has the desirable property of being independent of @xmath39 , facilitating the derivation of robust confidence intervals , even in the presence of uncertain nuisance parameters .
verification of the performance and reliability joint likelihood stacking procedure employed a computerised toy monte carlo approach .
the roofit framework @xcite was used to generate multiple simulated datasets consistent with the assumed distributions of @xmath2 , @xmath6 and @xmath0 for specific values of the true signal parameters @xmath56 $ ] , @xmath57 and @xmath58 . to better understand the effect of the distribution of @xmath0 on the outcome of each stacking procedure
, data were generated using three alternative parameterisations for @xmath59 . a basic test case , simulating unbiassed systematic uncertainties , employed a gaussian parameterisation @xmath60 with @xmath61 ( hereafter referred to as _ model a _ ) . two less idealised examples , adopting bifurcated gaussian functions @xmath62 with @xmath63 and @xmath64 ( hereafter referred to as _ model b _ and _ model c _ ,
respectively ) , allowed the effect of increasing asymmetry in the modelled @xmath0 distribution to be investigated .
figure [ fig : alphadists ] shows representative distributions of @xmath0 corresponding to each of the simulated scenarios . models a and b mimic somewhat pessimistic observational situations in which the choice of off - source sampling regions is restricted , limiting event statistics and biasing the derivation of @xmath0 .
accordingly , the corresponding results are particularly relevant to galactic source populations , for which source confusion and diffuse background contamination within target fields - of - view can be particularly problematic .
model c represents an extreme case which is unlikely to occur in real experimental contexts , but is nonetheless included to demonstrate the efficacy of the joint likelihood technique .     corresponding to model a ( _ black _ ) ,
model b ( _ red _ ) , and model c ( _ blue_).,scaledwidth=60.0% ]    using roofit , ensembles of the generated single - target datasets were then employed in conjunction with the relevant compound probability density functions to obtain multiple realisations of the joint likelihood @xmath65 corresponding to a discrete range of target multiplicities @xmath66 $ ] . for each ensemble dataset @xmath67 ,
the statistical significance ( @xmath68 ) of the combined @xmath1-ray  signal was evaluated using the likelihood ratio prescription of @xcite @xmath69    for comparison , a traditional data stacking analysis was also applied to the generated data .
the components of the ensemble datasets used to construct each realisation of @xmath65 were combined to obtain corresponding stacked datasets , @xmath70 .
subsequent statistical inference employed a likelihood function @xmath71 , which was formed by substitution of the stacked data into the single target probability density function @xmath72 with @xmath73 defined as a delta function centred on the stacked @xmath9 estimate , @xmath74 .
following the convention outlined in @xmath8[sec : inf_sig_char ] , equation was evaluated using the components of @xmath75 do derive the statistical significance @xmath76 of the combined @xmath1-ray  signal corresponding to the data stacking approach .    for both stacking methodologies ,
construction of the associated profile likelihoods was accomplished using the intrinsic capabilities of roofit , adopting @xmath77 as the sole parameter of interest .
confidence intervals were then defined as the ranges of @xmath77 outside which @xmath53 exceeded an appropriate percentile of the nominal @xmath78 distribution .
for each distinct combination of the true signal parameters , modelled distribution of @xmath0 , and target multiplicity , the monte carlo approach outlined in @xmath8[sec : monte_carlo ] was applied to derive 5000 independent estimates of @xmath79 and @xmath30 corresponding to each stacking technique . in combination with appropriate statistical metrics ,
the resultant data enable a comparative evaluation of the joint likelihood and traditional data stacking approaches .
an experimentally relevant diagnostic for both stacking analyses is the probability with which data corresponding to a particular value of @xmath77 will yield a significance @xmath30 , in excess of a specified threshold @xmath80 .
assuming data that are distributed in accordance with the null hypothesis , this probability is called the _ significance level_.
although the specific choice of @xmath80 is arbitrary , it is typically chosen in order to obtain a desired significance level and ensure a controlled rate of false - positive detections .
objective comparison of the alternative stacking techniques is facilitated by a threshold which corresponds to a nominal percentile of the appropriate null distribution of @xmath30 .
a related statistic is the _ power _ , which describes the probability that derived values of @xmath81 will correctly identify a genuine signal , and provides useful insights regarding the sensitivity of the corresponding analytical method .
the relevant monte carlo distributions for @xmath30 , corresponding to @xmath82 , are plotted for each target multiplicity in figure [ fig : null_sigma_dists ] .
assuming that the true value of @xmath20 is 0.1 , systematic uncertainties which affect the estimation of @xmath13 according to the distributions plotted in figure [ fig : alphadists ] will generate misleading results in a data stacking analysis .
in many experimental situations , a small number of erroneous results is tolerable , as long as the expected frequency with which they occur can be reliably predicted .
this predictability criterion is realised if the derived values consistently conform to a known statistical distribution .
irrespective of @xmath21 , and for all @xmath83 $ ] , the significance estimates derived using the joint likelihood technique appear to retain the @xmath44 distribution which arises in case of zero @xmath0 uncertainty .
in contrast , results that correspond to traditional data stacking exhibit substantial deviations from this nominal distribution .
moreover , adoption of asymmetric @xmath0 distributions introduces a monotonic dependence on the target multiplicity , yielding systematically larger significance estimates as @xmath11 increases .
consideration of the procedure used during data stacking to synthesise a combined @xmath0 estimate suggests an intuitive explanation of the observed behaviour . models b and c generate ensemble data sets in which the subset of overestimated @xmath0 values is typically predominant and has an absolute _ mean _ offset from @xmath20 which exceeds that of the remaining , underestimated @xmath13 .
accordingly , the frequency with which equation yields a substantial overestimate for @xmath9 should increase with the ensemble size , which is consistent with the observed behaviour .
conversely , symmetrically distributed @xmath0 uncertainties should not inherently bias the data stacking process .
instead , the target - specific weighting of each @xmath13 specified in equation prevents perfect cancellation of the systematic offsets and inhibits convergence to the nominal null distribution for @xmath30 as @xmath84 . as outlined in @xmath8[sec : monte_carlo ] all monte carlo data sets used for this study assume a common @xmath57 , with the range of inter - target variability in @xmath85 restricted to the level of poisson fluctuations .
in experimental contexts , the true number of off events is likely to be different for each target and the weights accorded to the corresponding @xmath13 would be more diverse .
the adverse impact of symmetric systematic uncertainties would then depend critically on the joint , target - wise distribution of @xmath0-offset and @xmath85 , with specific ensembles potentially realising particularly benign or pathological scenarios .    as an alternative to the absolute measure of significance defined by equation , experimental practitioners often choose to multiply @xmath30 by the sign of the corresponding @xmath1-ray  excess . adopting this convention , systematic _
_ over__estimates of @xmath9 during data stacking would tend to over - generate negative significances when @xmath82 .
in many situations the notion of a negative signal is not physically meaningful and such results would probably be disregarded . in general
, the ability to eliminate spurious results on the basis of their physical validity may ameliorate the impact of particular systematic effects , and reduce the rate of false - positive detections .
nonetheless , unfeasibly negative significances should raise concerns regarding the trustworthiness of corresponding upper limits .
corresponding to the joint likelihood and data stacking approaches .
each histogram is representative of 5000 independent monte carlo datasets , which were generated assuming @xmath82 .
results are shown which correspond model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) for target multiplicities @xmath66 $ ] . all monte carlo datasets were generated assuming @xmath57 and @xmath58.,title="fig:",scaledwidth=45.0% ]   corresponding to the joint likelihood and data stacking approaches .
each histogram is representative of 5000 independent monte carlo datasets , which were generated assuming @xmath82 .
results are shown which correspond model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) for target multiplicities @xmath66 $ ] .
all monte carlo datasets were generated assuming @xmath57 and @xmath58.,title="fig:",scaledwidth=45.0% ] +   corresponding to the joint likelihood and data stacking approaches .
each histogram is representative of 5000 independent monte carlo datasets , which were generated assuming @xmath82 .
results are shown which correspond model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) for target multiplicities @xmath66 $ ] .
all monte carlo datasets were generated assuming @xmath57 and @xmath58.,title="fig:",scaledwidth=45.0% ]   corresponding to the joint likelihood and data stacking approaches .
each histogram is representative of 5000 independent monte carlo datasets , which were generated assuming @xmath82 .
results are shown which correspond model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) for target multiplicities @xmath66 $ ] . all monte carlo datasets were generated assuming @xmath57 and @xmath58.,title="fig:",scaledwidth=45.0% ] +   corresponding to the joint likelihood and data stacking approaches .
each histogram is representative of 5000 independent monte carlo datasets , which were generated assuming @xmath82 .
results are shown which correspond model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) for target multiplicities @xmath66 $ ] .
all monte carlo datasets were generated assuming @xmath57 and @xmath58.,title="fig:",scaledwidth=45.0% ]   corresponding to the joint likelihood and data stacking approaches .
each histogram is representative of 5000 independent monte carlo datasets , which were generated assuming @xmath82 .
results are shown which correspond model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) for target multiplicities @xmath66 $ ] . all monte carlo datasets were generated assuming @xmath57 and @xmath58.,title="fig:",scaledwidth=45.0% ]    significance thresholds corresponding to the 95th percentile of the various null distributions of @xmath30 are plotted in the left - hand column of figure [ fig : power_diffs ] .
results derived using the joint - likelihood approach exhibit minimal multiplicity dependence and appear consistent with the nominal @xmath86 expected for a @xmath44 random variate .
conversely , thresholds which correspond to the data stacking approach systematically exceed their joint likelihood counterparts , and become increasing discrepant for larger @xmath11 in simulations that assume asymmetric distributions of @xmath0 .
accordingly , recourse to a nominal distribution of @xmath30 is not appropriate in the data stacking framework , and valid interpretation of the significance of a particular detection requires empirical calibration of distinct significance thresholds for each target multiplicity .
the values of @xmath87 plotted in figure [ fig : power_diffs ] permit derivation of appropriately calibrated estimates of the statistical power at each vertex of the investigated model parameter space .
the resultant probabilities are presented in figure [ fig : powers ] , while the results plotted in the right - hand column of figure [ fig : power_diffs ] reveal the corresponding differences power between the alternative stacking techniques .
results pertaining to models a and b exhibit saturation at extreme values of @xmath77 and @xmath11 , caused by the limited statistics of the monte carlo datasets .
results corresponding a symmetric gaussian distribution for @xmath0 reveal derived powers which are compatible to @xmath88 for all @xmath66 $ ] and @xmath56 $ ] .
although traditional data stacking appears to offer marginally superior performance for this scenario , asymmetric parameterisations for the distribution of @xmath0 reverse this outcome .
indeed , powers derived using the joint likelihood approach in conjunction with models b and c exhibit substantial enhancement with respect to their data stacking counterparts .
moreover , powers corresponding to the data stacking technique exhibit a marked sensitivity to the degree of asymmetry in the adopted @xmath0 distribution , which appears to be substantially ameliorated by the joint likelihood approach . strong suppression of the resultant data stacking power is evident when model c is applied to the monte carlo analysis , with derived discrepancies @xmath89 separating the alternative stacking techniques at the upper extremes of the modelled parameter ranges .
more significantly for practical applications , assuming the intermediate scenario represented by model b , reveals a maximum disparity of @xmath90 for the experimentally interesting region of @xmath91 as @xmath92 . in this context
, the joint likelihood approach yields a two - fold enhancement in the likelihood of detecting a genuine @xmath1-ray signal .     for the joint likelihood ( _ blue _ ) and data stacking ( _ red _ ) approaches . _
right - hand column : _ differences between the derived powers corresponding to the joint likelihood and data stacking approaches .
the plotted results correspond to model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) . each bin is derived using analyses of 5000 independent monte carlo datasets which assume to true signals @xmath56 $ ] and target multiplicities @xmath66 $ ] .
all monte carlo datasets were generated assuming @xmath57 and @xmath58.,title="fig:",scaledwidth=45.0% ]   for the joint likelihood ( _ blue _ ) and data stacking ( _ red _ ) approaches .
_ right - hand column : _ differences between the derived powers corresponding to the joint likelihood and data stacking approaches .
the plotted results correspond to model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) . each bin is derived using analyses of 5000 independent monte carlo datasets which assume to true signals @xmath56 $ ] and target multiplicities @xmath66 $ ] .
all monte carlo datasets were generated assuming @xmath57 and @xmath58.,title="fig:",scaledwidth=45.0% ] +    for the joint likelihood ( _ blue _ ) and data stacking ( _ red _ ) approaches .
_ right - hand column : _ differences between the derived powers corresponding to the joint likelihood and data stacking approaches .
the plotted results correspond to model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) . each bin is derived using analyses of 5000 independent monte carlo datasets which assume to true signals @xmath56 $ ] and target multiplicities @xmath66 $ ] .
all monte carlo datasets were generated assuming @xmath57 and @xmath58.,title="fig:",scaledwidth=45.0% ]   for the joint likelihood ( _ blue _ ) and data stacking ( _ red _ ) approaches .
_ right - hand column : _ differences between the derived powers corresponding to the joint likelihood and data stacking approaches .
the plotted results correspond to model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) . each bin is derived using analyses of 5000 independent monte carlo datasets which assume to true signals @xmath56 $ ] and target multiplicities @xmath66 $ ] .
all monte carlo datasets were generated assuming @xmath57 and @xmath58.,title="fig:",scaledwidth=45.0% ] +   for the joint likelihood ( _ blue _ ) and data stacking ( _ red _ ) approaches .
_ right - hand column : _ differences between the derived powers corresponding to the joint likelihood and data stacking approaches .
the plotted results correspond to model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) . each bin is derived using analyses of 5000 independent monte carlo datasets which assume to true signals @xmath56 $ ] and target multiplicities @xmath66 $ ] .
all monte carlo datasets were generated assuming @xmath57 and @xmath58.,title="fig:",scaledwidth=45.0% ]   for the joint likelihood ( _ blue _ ) and data stacking ( _ red _ ) approaches .
_ right - hand column : _ differences between the derived powers corresponding to the joint likelihood and data stacking approaches .
the plotted results correspond to model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) .
each bin is derived using analyses of 5000 independent monte carlo datasets which assume to true signals @xmath56 $ ] and target multiplicities @xmath66 $ ] .
all monte carlo datasets were generated assuming @xmath57 and @xmath58.,title="fig:",scaledwidth=45.0% ]     corresponding to the 95th percentile of the null distributions of @xmath30 for the joint likelihood ( _ left - hand column _ ) and data stacking ( _ right - hand column _ ) approaches .
each bin is derived using analyses of 5000 independent monte carlo datasets .
the plotted results correspond to model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) assuming true signals @xmath56 $ ] and target multiplicities @xmath66 $ ] .
the underlying datasets are as for figure [ fig : power_diffs],title="fig:",scaledwidth=45.0% ]   corresponding to the 95th percentile of the null distributions of @xmath30 for the joint likelihood ( _ left - hand column _ ) and data stacking ( _ right - hand column _ ) approaches .
each bin is derived using analyses of 5000 independent monte carlo datasets .
the plotted results correspond to model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) assuming true signals @xmath56 $ ] and target multiplicities @xmath66 $ ] .
the underlying datasets are as for figure [ fig : power_diffs],title="fig:",scaledwidth=45.0% ] +   corresponding to the 95th percentile of the null distributions of @xmath30 for the joint likelihood ( _ left - hand column _ ) and data stacking ( _ right - hand column _ ) approaches .
each bin is derived using analyses of 5000 independent monte carlo datasets .
the plotted results correspond to model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) assuming true signals @xmath56 $ ] and target multiplicities @xmath66 $ ] .
the underlying datasets are as for figure [ fig : power_diffs],title="fig:",scaledwidth=45.0% ]   corresponding to the 95th percentile of the null distributions of @xmath30 for the joint likelihood ( _ left - hand column _ ) and data stacking ( _ right - hand column _ ) approaches .
each bin is derived using analyses of 5000 independent monte carlo datasets .
the plotted results correspond to model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) assuming true signals @xmath56 $ ] and target multiplicities @xmath66 $ ] .
the underlying datasets are as for figure [ fig : power_diffs],title="fig:",scaledwidth=45.0% ] +   corresponding to the 95th percentile of the null distributions of @xmath30 for the joint likelihood ( _ left - hand column _ ) and data stacking ( _ right - hand column _ ) approaches .
each bin is derived using analyses of 5000 independent monte carlo datasets .
the plotted results correspond to model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) assuming true signals @xmath56 $ ] and target multiplicities @xmath66 $ ] .
the underlying datasets are as for figure [ fig : power_diffs],title="fig:",scaledwidth=45.0% ]   corresponding to the 95th percentile of the null distributions of @xmath30 for the joint likelihood ( _ left - hand column _ ) and data stacking ( _ right - hand column _ ) approaches .
each bin is derived using analyses of 5000 independent monte carlo datasets .
the plotted results correspond to model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) assuming true signals @xmath56 $ ] and target multiplicities @xmath66 $ ] .
the underlying datasets are as for figure [ fig : power_diffs],title="fig:",scaledwidth=45.0% ]      for an analysis to perform reliably in an experimental context , it is important that any generated confidence intervals have correct coverage . in reality , despite sophisticated treatment of associated systematic and statistical uncertainties , residual disparities between the assumed and actual distributions of experimental data often prevent practical realisation of this criterion .
moreover , deviations from correct coverage often lead to an unexpected increase in the frequency of spuriously inferred scientific conclusions .
accordingly , the degree by which the derived confidence intervals deviate from their nominal coverage provides an informative comparator for the alternative stacking techniques .     which include the true signal value , @xmath77 .
the underlying datasets are as for figure [ fig : power_diffs].,title="fig:",scaledwidth=45.0% ]   which include the true signal value , @xmath77 .
the underlying datasets are as for figure [ fig : power_diffs].,title="fig:",scaledwidth=45.0% ] +   which include the true signal value , @xmath77 .
the underlying datasets are as for figure [ fig : power_diffs].,title="fig:",scaledwidth=45.0% ]   which include the true signal value , @xmath77 .
the underlying datasets are as for figure [ fig : power_diffs].,title="fig:",scaledwidth=45.0% ] +   which include the true signal value , @xmath77 .
the underlying datasets are as for figure [ fig : power_diffs].,title="fig:",scaledwidth=45.0% ]   which include the true signal value , @xmath77 .
the underlying datasets are as for figure [ fig : power_diffs].,title="fig:",scaledwidth=45.0% ]    figure [ fig : coverage_fractions ] displays the fraction of derived 95% confidence intervals for @xmath3 which cover the true signal value , for each parameterisation of @xmath21 .
complementary insight is provided by figure [ fig : coverage_residuals ] , which illustrates the corresponding deviations from correct coverage as a function of @xmath77 and the target multiplicity , @xmath11 .
it is evident that confidence intervals generated by the traditional data stacking approach are generally incompatible with their stated coverage .
while the derived coverage fractions exceed the nominal 95% for low signals and target multiplicities , the majority of the @xmath93 parameter space is characterised significant negative deviations .
this behaviour is typically described as _ under - coverage _ , and implies excessively permissive confidence intervals with an increased propensity to generate false - positive results .
the observed under - coverage is maximised for small non - zero signals and appears to be exacerbated by the addition of targets to the ensemble dataset .
moreover , increased asymmetry of the modelled @xmath0 distribution has a markedly detrimental effect on the derived coverage characteristics .
indeed , the maximum divergence from correct coverage increases from 4% to 25% and then to 85% for model a , model b , and model c , respectively . in the worst case
, this means that only 10% of the derived intervals include the true parameter value .
the inherent inability of the data stacking technique to acknowledge systematic uncertainties leads to confidence intervals which are unrealistically narrow .
consequently , reported accuracy of experimental measurements will be excessively optimistic and in the worst cases could be used to infer spurious scientific conclusions .
corresponding to the joint likelihood ( jl ) and data stacking ( ds ) approaches .
results are shown which correspond model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) .
the underlying datasets are as for figure [ fig : power_diffs].,title="fig:",scaledwidth=45.0% ]    corresponding to the joint likelihood ( jl ) and data stacking ( ds ) approaches .
results are shown which correspond model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) .
the underlying datasets are as for figure [ fig : power_diffs].,title="fig:",scaledwidth=45.0% ] +   corresponding to the joint likelihood ( jl ) and data stacking ( ds ) approaches .
results are shown which correspond model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) .
the underlying datasets are as for figure [ fig : power_diffs].,title="fig:",scaledwidth=45.0% ]   corresponding to the joint likelihood ( jl ) and data stacking ( ds ) approaches .
results are shown which correspond model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) .
the underlying datasets are as for figure [ fig : power_diffs].,title="fig:",scaledwidth=45.0% ] +   corresponding to the joint likelihood ( jl ) and data stacking ( ds ) approaches .
results are shown which correspond model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) .
the underlying datasets are as for figure [ fig : power_diffs].,title="fig:",scaledwidth=45.0% ]   corresponding to the joint likelihood ( jl ) and data stacking ( ds ) approaches .
results are shown which correspond model a ( _ top row _ ) , model b ( _ middle row _ ) and model c ( _ bottom row _ ) .
the underlying datasets are as for figure [ fig : power_diffs].,title="fig:",scaledwidth=45.0% ]    in contrast , notable stability in the coverage fractions derived using the joint likelihood technique indicates robust handling of systematic uncertainties .
confidence intervals derived under the assumption of a gaussian distribution in @xmath0 exhibit coverage which is correct to within @xmath94 throughout the studied region of the model parameter space .
variation of the coverage fraction as a function of @xmath77 remains minimal when asymmetric parametrisations of @xmath21 are assumed .
although under - coverage which worsens with increasing target multiplicity is evident in results that correspond to models b and c , the discrepancy with respect to correct coverage does not exceed @xmath95 .
the comparative evaluation presented in @xmath8[sec : results ] reveals several limitations to the applicability of traditional data stacking in situations when @xmath0 is uncertain , many of which are addressed by the joint likelihood technique .
reliable inference of signal characteristics is impaired by significant levels of under - coverage for @xmath96 in the data stacking approach .
moreover , the inherent permissivity of derived confidence intervals is compounded by the inclusion of additional targets . in combination , these characteristics imply a substantially increased tendency to generate spurious results which is exacerbated as the stacked target ensemble is enlarged . in an experimental context
, this behaviour would be highly undesirable and largely undermines the motivation for combined source analysis .
in contrast , confidence intervals provided by the joint likelihood approach closely approximate correct coverage under the assumption of symmetric uncertainties on @xmath0 , and exhibit multiplicity - dependent under - coverage at @xmath97 levels if an asymmetric distribution is adopted .
the deviations from correct coverage that are exhibited by the data stacking approach are consistent with the erroneous assumption of negligible uncertainty in the value of @xmath0 .
resolution of this issue is complicated by the lack of a straightforward prescription for propagating systematic uncertainties to the calculated value of @xmath9 .
conversely , the joint likelihood method provides a robust technique for the treatment of uncertain @xmath0 estimates on a target - specific basis .
appropriate interpretation of the combined signal significance is also more complicated within the data stacking framework .
the monte carlo null distributions for @xmath30 presented in figure [ fig : null_sigma_dists ] indicate that application of equation requires proper calibration of @xmath87 to prevent spurious rejection of the null hypothesis .
the situation deteriorates when increasingly asymmetric parameterisations of the generated @xmath0 distribution are adopted . under these circumstances ,
nave assumption of a nominal @xmath44 distribution for @xmath30 induces a systematic overestimation of corresponding significance levels which worsens with increasing target multiplicity . in an experimental context ,
the implied increase in the false - positive detection rate for larger target samples is contrary to common expectation and therefore represents a serious shortcoming of the data stacking technique .
in contrast , significance estimates derived for @xmath77 using the joint likelihood approach appear insensitive to the value of @xmath11 and display excellent correspondence with the expected @xmath44 distribution .    notwithstanding appropriate calibration of a suitable detection threshold @xmath87 ,
the powers which characterise the data stacking technique indicate that asymmetry in the adopted @xmath0 distribution substantially diminishes the overall sensitivity .
conversely , the powers corresponding to the joint likelihood analysis appear relatively unaffected by the choice of @xmath21 .
the alternative approaches exhibit similar properties , and indeed data stacking appears to marginally outperform the joint likelihood approach , if symmetric systematic uncertainties are assumed .
it should be acknowledged that the degree of adverse behaviour inherent in the data stacking technique is contingent upon the adopted values of @xmath20 and @xmath19 , as well as the assumed magnitude of the simulated systematic effects .
accurate modelling of the system acceptance may ameliorate the observed pathologies , with the cumulative effect of target - specific @xmath0 uncertainties only becoming significant for target ensembles with @xmath98 .
figure [ fig : delta_alpha_mag ] illustrates the combined effect on data stacking of systematic offsets at the few percent level using calibrated values of the significance threshold that correspond to the 95th percentile of simulated null distributions for @xmath30 .
the monte carlo data sets assume relative target - wise uncertainties @xmath99 , for both symmetric and asymmetric parameterisations for @xmath21 .
the curves correspond to simulated ensembles comprising @xmath100 target sources for which @xmath101 and @xmath102 . despite an inevitable reduction in the influence of the modelled systematic offsets ,
it is clear that even small target - specific biasses can reinforce to distort the combined significance for large observational datasets .
moreover , even the pessimistic parameter values that define models a and b may be practically relevant , especially when the extent of off - source regions is restricted by nearby sources , or stringent event selection limits the overall count statistics .     for the and data stacking approach .
the illustrated results correspond to gaussian ( _ left _ ) and bifurcated gaussian ( _ right _ ) parameterisations for @xmath21 , using target - specific uncertainties @xmath103 for the symmetric models , and @xmath104 with @xmath105 for the asymmetric models .
each datapoint is derived using analyses of 5000 independent monte carlo datasets , which assume ensembles of @xmath100 targets having true signals @xmath106 .
all monte carlo datasets were generated assuming @xmath57 and @xmath58.,title="fig:",scaledwidth=48.0% ]   for the and data stacking approach .
the illustrated results correspond to gaussian ( _ left _ ) and bifurcated gaussian ( _ right _ ) parameterisations for @xmath21 , using target - specific uncertainties @xmath103 for the symmetric models , and @xmath104 with @xmath105 for the asymmetric models .
each datapoint is derived using analyses of 5000 independent monte carlo datasets , which assume ensembles of @xmath100 targets having true signals @xmath106 .
all monte carlo datasets were generated assuming @xmath57 and @xmath58.,title="fig:",scaledwidth=48.0% ]    the joint likelihood method demonstrates good performance in a number of simple but experimentally relevant scenarios where the reliability of traditional data stacking is seriously impaired .
nonetheless , it should be stated that the _ full _ potential of the joint likelihood method can only be realised if the distributions of all the systematic uncertainties affect each observational dataset are parameterisable with sufficient accuracy .    admittedly , definitive derivation of the distribution of @xmath0 is unlikely to be straightforward in many situations
. semi - analytic estimation of the required distributions necessitates detailed knowledge of the instrumental response as well as careful measurement of the environmental conditions at the time of observation .
accordingly , imperfect or incomplete understanding of the dominant systematic biases might render this approach untenable .
plausible alternative strategies include jackknife or bootstrap resampling of off - source data from randomly selected background sampling regions to derive multiple estimates for @xmath0 and construct an empirical distribution . in this case , the accuracy of the resultant parameterisation is limited by the finite number of permutations available for the resampling process . emulating the approach of @xcite and segregating data on the basis of quantifiable _ operating conditions _ would enable the use of large representative datasets to derive template distributions that pertain to finite subsets of the observational parameter space .    in situations where the suggested techniques are unable to accurately reconstruct the shape of the @xmath0 distribution , a generic parameterisation
could be tailored using target - specific estimates of the dispersion in derived values of the on / off normalisation . by acknowledging the existence of the associated systematic uncertainties , this first - order approximation would ameliorate under - coverage as well as deviations from the nominal @xmath44 distribution for @xmath30 , thereby reducing the rate of unexpected false - positive detections
moreover , by facilitating limited adaptation of the modelled systematic uncertainties , this approach retains a key advantage of the full joint likelihood technique that can not be straightforwardly emulated by traditional data stacking .
indeed , it is likely that this simplified approach might recover a significant proportion of the power which is achieved when the true distribution of @xmath0 is available
. nonetheless , as demonstrated by the monte carlo results for a symmetric distribution of @xmath0 , there may be situations in which the advantages offered by the joint likelihood approach are marginal and the performance of the data stacking approach is deemed sufficient .
while this study has focussed upon parameterisation of @xmath0 uncertainties , the joint likelihood technique represents a highly flexible and extensible analytical approach .
indeed , related analyses are able to parameterise arbitrary properties of the instrument response , the measured @xmath1-ray signal , and even suspected source properties such as the spectral index and temporal variability ( e.g. * ? ? ?
toy monte carlo simulations have been used to investigate the effect of non - negligible systematic uncertainties affecting the relative normalisation of the on and off - source event sampling regions in atmospheric cherenkov telescope observations . as a specific example , the properties of two alternative strategies for combined source analysis have been examined .
situations have been identified in which the traditional _ data stacking _ approach exhibits unexpected and undesirable statistical behaviour . even when correctly calibrated null distributions for the combined significance are employed , the sensitivity of the data stacking approach appears markedly impaired if asymmetrically distributed @xmath0 uncertainties are assumed . the data stacking technique is also yields unreliable estimates for the @xmath1-ray  signal parameters , with derived confidence intervals deviate from their stated coverage by a margin which widens with increasing target multiplicity .
an alternative to data stacking has been outlined which combines target - specific likelihood functions that explicitly account for non - uniform systematic uncertainties . as an analytical approach ,
the _ joint likelihood _
technique exhibits many characteristics which surpass those of traditional data stacking .
it offers a statistically robust prescription for the treatment of target - specific systematic uncertainties , and effectively addresses the shortcomings which are inherent in the data stacking framework .
indeed , the joint likelihood effectively eliminates pathological behaviour inherent in data stacking , with combined source significances conforming to a single , nominal null distribution .
moreover , it achieves equivalent or superior sensitivity to the data stacking technique and yields parameter confidence intervals that exhibit minimal deviation from their stated coverage .
many of the insights provided by this study of combined source analyses are equally applicable to single - target analyses involving similarly abundant event statistics
. indeed , the synthesis of any extensive dataset often combines observations which incorporate diverse systematic effects .
this study has shown that the joint likelihood method provides a viable approach for the robust combination of data with inhomogeneous systematic uncertainties , irrespective of the celestial target coordinates .
although it is a generally applicable technique , the joint likelihood analysis is likely to prove most useful in experimental situations involving limited event statistics and a restricted choice of off - source sampling regions .      , m. , ajello , m. , albert , a. , atwood , w.  b. , baldini , l. , ballet , j. , barbiellini , g. , bastieri , d. , bechtol , k. , bellazzini , r. , berenji , b. , blandford , r.  d. , bloom , e.  d. , bonamente , e. , borgland , a.  w. , bregeon , j. , brigida , m. , bruel , p. , buehler , r. , burnett , t.  h. , buson , s. , caliandro , g.  a. , cameron , r.  a. , caadas , b. , caraveo , p.  a. , casandjian , j.  m. , cecchi , c. , charles , e. , chekhtman , a. , chiang , j. , ciprini , s. , claus , r. , cohen - tanugi , j. , conrad , j. , cutini , s. , de angelis , a. , de palma , f. , dermer , c.  d. , digel , s.  w. , do couto e silva , e. , drell , p.  s. , drlica - wagner , a. , falletti , l. , favuzzi , c. , fegan , s.  j. , ferrara , e.  c. , fukazawa , y. , funk , s. , fusco , p. , gargano , f. , gasparrini , d. , gehrels , n. , germani , s. , giglietto , n. , giordano , f. , giroletti , m. , glanzman , t. , godfrey , g. , grenier , i.  a. , guiriec , s. , gustafsson , m. , hadasch , d. , hayashida , m. , hays , e. , hughes , r.  e. , jeltema , t.  e. , jhannesson , g. , johnson , r.  p. , johnson , a.  s. , kamae , t. , katagiri , h. , kataoka , j. , kndlseder , j. , kuss , m. , lande , j. , latronico , l. , lionetto , a.  m. , llena garde , m. , longo , f. , loparco , f. , lott , b. , lovellette , m.  n. , lubrano , p. , madejski , g.  m. , mazziotta , m.  n. , mcenery , j.  e. , mehault , j. , michelson , p.  f. , mitthumsiri , w. , mizuno , t. , monte , c. , monzani , m.  e. , morselli , a. , moskalenko , i.  v. , murgia , s. , naumann - godo , m. , norris , j.  p. , nuss , e. , ohsugi , t. , okumura , a. , omodei , n. , orlando , e. , ormes , j.  f. , ozaki , m. , paneque , d. , parent , d. , pesce - rollins , m. , pierbattista , m. , piron , f. , pivato , g. , porter , t.  a. , profumo , s. , rain , s. , razzano , m. , reimer , a. , reimer , o. , ritz , s. , roth , m. , sadrozinski , h.  f .- w . , sbarra , c. , scargle , j.  d. , schalk , t.  l. , sgr , c. , siskind , e.  j. , spandre , g. , spinelli , p. , strigari , l. , suson , d.  j. , tajima , h. , takahashi , h. , tanaka , t. , thayer , j.  g. , thayer , j.  b. , thompson , d.  j. , tibaldo , l. , tinivella , m. , torres , d.  f. , troja , e. , uchiyama , y. , vandenbroucke , j. , vasileiou , v. , vianello , g. , vitale , v. , waite , a.  p. , wang , p. , winer , b.  l. , wood , k.  s. , wood , m. , yang , z. , zimmer , s. , kaplinghat , m. , martinez , g.  d. , dec .
constraining dark matter models from a combined analysis of milky way satellites with the fermi large area telescope .
physical review letters 107  ( 24 ) , 241302 .    ,
f. , akhperjanian , a.  g. , anton , g. , barres de almeida , u. , bazer - bachi , a.  r. , becherini , y. , behera , b. , bernlhr , k. , boisson , c. , bochow , a. , borrel , v. , braun , i. , brion , e. , brucker , j. , brun , p. , bhler , r. , bulik , t. , bsching , i. , boutelier , t. , chadwick , p.  m. , charbonnier , a. , chaves , r.  c.  g. , cheesebrough , a. , chounet , l .- m .
, clapson , a.  c. , coignet , g. , dalton , m. , daniel , m.  k. , davids , i.  d. , degrange , b. , deil , c. , dickinson , h.  j. , djannati - ata , a. , domainko , w. , oc .
drury , l. , dubois , f. , dubus , g. , dyks , j. , dyrda , m. , egberts , k. , emmanoulopoulos , d. , espigat , p. , farnier , c. , feinstein , f. , fiasson , a. , frster , a. , fontaine , g. , fling , m. , gabici , s. , gallant , y.  a. , grard , l. , giebels , b. , glicenstein , j.  f. , glck , b. , goret , p. , hauser , d. , hauser , m. , heinz , s. , heinzelmann , g. , henri , g. , hermann , g. , hinton , j.  a. , hoffmann , a. , hofmann , w. , holleran , m. , hoppe , s. , horns , d. , jacholkowska , a. , de jager , o.  c. , jung , i. , katarzyski , k. , katz , u. , kaufmann , s. , kendziorra , e. , kerschhaggl , m. , khangulyan , d. , khlifi , b. , keogh , d. , komin , n. , kosack , k. , lamanna , g. , lenain , j .-
p . , lohse , t. , marandon , v. , martin , j.  m. , martineau - huynh , o. , marcowith , a. , maurin , d. , mccomb , t.  j.  l. , medina , m.  c. , moderski , r. , moulin , e. , naumann - godo , m. , de naurois , m. , nedbal , d. , nekrassov , d. , niemiec , j. , nolan , s.  j. , ohm , s. , olive , j .- f .
, de oa wilhelmi , e. , orford , k.  j. , ostrowski , m. , panter , m. , paz arribas , m. , pedaletti , g. , pelletier , g. , petrucci , p .- o . , pita , s. , phlhofer , g. , punch , m. , quirrenbach , a. , raubenheimer , b.  c. , raue , m. , rayner , s.  m. , reimer , o. , renaud , m. , rieger , f. , ripken , j. , rob , l. , rosier - lees , s. , rowell , g. , rudak , b. , rulten , c.  b. , ruppel , j. , sahakian , v. , santangelo , a. , schlickeiser , r. , schck , f.  m. , schrder , r. , schwanke , u. , schwarzburg , s. , schwemmer , s. , shalchi , a. , skilton , j.  l. , sol , h. , spangler , d. , stawarz ,  . , steenkamp , r. , stegmann , c. , superina , g. , szostek , a. , tam , p.  h. , tavernet , j .-
terrier , r. , tibolla , o. , van eldik , c. , vasileiadis , g. , venter , c. , venter , l. , vialle , j.  p. , vincent , p. , vivier , m. , vlk , h.  j. , volpe , f. , wagner , s.  j. , ward , m. , zdziarski , a.  a. , zech , a. , may 2009 .
hess upper limit on the very high energy @xmath1-ray emission from the globular cluster 47 tucanae .
499 , 273277 .        , m.  f. , fegan , d.  j. , gibbs , k. , gorham , p.  w. , hillas , a.  m. , lamb , r.  c. , liebing , d.  f. , mackeown , p.  k. , porter , n.  a. , stenger , v.  j. , aug . 1985 .
application of imaging to the atmospheric cherenkov technique . in : jones ,
f.  c. ( ed . ) , international cosmic ray conference .
. 453456 .          , abramowski , a. , acero , f. , aharonian , f. , akhperjanian , a.  g. , anton , g. , barnacka , a. , barres de almeida , u. , bazer - bachi , a.  r. , becherini , y. , becker , j. , behera , b. , bernlhr , k. , bochow , a. , boisson , c. , bolmont , j. , bordas , p. , borrel , v. , brucker , j. , brun , f. , brun , p. , bulik , t. , bsching , i. , carrigan , s. , casanova , s. , cerruti , m. , chadwick , p.  m. , charbonnier , a. , chaves , r.  c.  g. , cheesebrough , a. , chounet , l .- m . ,
clapson , a.  c. , coignet , g. , conrad , j. , dalton , m. , daniel , m.  k. , davids , i.  d. , degrange , b. , deil , c. , dickinson , h.  j. , djannati - ata , a. , domainko , w. , drury , l.  o.  c. , dubois , f. , dubus , g. , dyks , j. , dyrda , m. , egberts , k. , eger , p. , espigat , p. , fallon , l. , farnier , c. , fegan , s. , feinstein , f. , fernandes , m.  v. , fiasson , a. , fontaine , g. , frster , a. , fling , m. , gallant , y.  a. , gast , h. , grard , l. , gerbig , d. , giebels , b. , glicenstein , j.  f. , glck , b. , goret , p. , gring , d. , hague , j.  d. , hampf , d. , hauser , m. , heinz , s. , heinzelmann , g. , henri , g. , hermann , g. , hinton , j.  a. , hoffmann , a. , hofmann , w. , hofverberg , p. , horns , d. , jacholkowska , a. , de jager , o.  c. , jahn , c. , jamrozy , m. , jung , i. , kastendieck , m.  a. , katarzyski , k. , katz , u. , kaufmann , s. , keogh , d. , kerschhaggl , m. , khangulyan , d. , khlifi , b. , klochkov , d. , kluniak , w. , kneiske , t. , komin , n. , kosack , k. , kossakowski , r. , laffon , h. , lamanna , g. , lennarz , d. , lohse , t. , lopatin , a. , lu , c .- c .
, marandon , v. , marcowith , a. , masbou , j. , maurin , d. , maxted , n. , mccomb , t.  j.  l. , medina , m.  c. , mhault , j. , moderski , r. , moulin , e. , naumann , c.  l. , naumann - godo , m. , de naurois , m. , nedbal , d. , nekrassov , d. , nguyen , n. , nicholas , b. , niemiec , j. , nolan , s.  j. , ohm , s. , olive , j .- f .
, de oa wilhelmi , e. , opitz , b. , ostrowski , m. , panter , m. , paz arribas , m. , pedaletti , g. , pelletier , g. , petrucci , p .- o . , pita , s. , phlhofer , g. , punch , m. , quirrenbach , a. , raue , m. , rayner , s.  m. , reimer , a. , reimer , o. , renaud , m. , de los reyes , r. , rieger , f. , ripken , j. , rob , l. , rosier - lees , s. , rowell , g. , rudak , b. , rulten , c.  b. , ruppel , j. , ryde , f. , sahakian , v. , santangelo , a. , schlickeiser , r. , schck , f.  m. , schnwald , a. , schwanke , u. , schwarzburg , s. , schwemmer , s. , shalchi , a. , sikora , m. , skilton , j.  l. , sol , h. , spengler , g. , stawarz ,  . , steenkamp , r. , stegmann , c. , stinzing , f. , sushch , i. , szostek , a. , tavernet , j .-
terrier , r. , tibolla , o. , tluczykont , m. , valerius , k. , van eldik , c. , vasileiadis , g. , venter , c. , vialle , j.  p. , viana , a. , vincent , p. , vivier , m. , vlk , h.  j. , volpe , f. , vorobiov , s. , vorster , m. , wagner , s.  j. , ward , m. , wierzcholska , a. , zajczyk , a. , zdziarski , a.  a. , zech , a. , zechlin , h .- s .
, h.e.s.s .
collaboration , mar .
constraints on dark matter annihilations towards the sculptor and carina dwarf galaxies .
astroparticle physics 34 , 608616 .          , s. , degrange , b. , punch , m. , barrau , a. , bazer - bachi , r. , cabot , h. , chounet ,
l.  m. , debiais , g. , dezalay , j.  p. , djannati - atai , a. , dumora , d. , espigat , p. , fabre , b. , fleury , p. , fontaine , g. , george , r. , ghesquiere , c. , goret , p. , gouiffes , c. , grenier , i.  a. , iacoucci , l. , malet , i. , meynadier , c. , munz , f. , palfrey , t.  a. , pare , e. , pons , y. , quebert , j. , ragan , k. , renault , c. , rivoal , m. , rob , l. , schovanek , p. , smith , d. , tavernet , j.  p. , vrana , j. , oct .
1998 . a new analysis method for very high definition imaging atmospheric cherenkov telescopes as applied to the cat telescope . nuclear instruments and methods in physics research a 416 , 425437 .
neyman , j. , pearson , e.  s. , 1933 . on the problem of the most efficient tests of statistical hypotheses .
philosophical transactions of the royal society of london .
series a , containing papers of a mathematical or physical character 231  ( 694 - 706 ) , 289337 . http://rsta.royalsocietypublishing.org / content/231/694-% 706/289.short[http://rsta.royalsocietypublishing.org / content/231/694-% 706/289.short ]      , t.  c. , cawley , m.  f. , fegan , d.  j. , gibbs , k.  g. , hillas , a.  m. , kowk , p.  w. , lamb , r.  c. , lewis , d.  a. , macomb , d. , porter , n.  a. , reynolds , p.  t. , vacanti , g. , jul . 1989 .
observation of tev gamma rays from the crab nebula using the atmospheric cerenkov imaging technique .
342 , 379395 .