globular clusters ( gcs ) have played an important role as tracers of stellar populations under the context that gc is a simple system of stars that can be represented by an assumption of simple stellar population .
recently , it has been found that gcs have much more diverse sub - populations than conventionally believed : gcs with multiple stellar populations , faint fuzzy clusters , and extended star clusters ( escs ) , etc .
this leads to an issue how these new populations of gcs could challenge the long - standing usage of gcs as tracers of stellar populations and kinematics in galaxies . on the other hand , for escs that are characterized by systematically larger size than typical gcs
, this kind of challenge could be another opportunity for a new tracer if escs turn out to be associated with some peculiar properties of galaxies that may allow a peek into their evolutionary history .
one example is an argument that escs might be associated with dwarf galaxy accretion events ( e.g. , @xcite ) .
however , this requires thorough studies on the physical , chemical , and kinematic properties of esc population .
one simple complication to such studies is that escs are usually faint and are discovered in rather distant galaxies , sometimes more than several mpc away from the milky way ( mw ) .
this is a serious challenge because spectroscopic observations are required for the reliable determination of physical properties , which is feasible only with nearby star clusters . in this regard , the escs in ngc 6822 , one of the nearest dwarf galaxies in the local group ,
are ideal targets for the spectroscopic studies .
there are at least five escs in ngc 6822 discovered to date @xcite .    for a small and isolated dwarf
irregular galaxy , ngc 6822 is known to have a relatively large stellar halo populated with intermediate age carbon stars with @xmath10 gyr @xcite as well as red giant stars with @xmath11 gyr @xcite .
combined with bright and young stars concentrated on the central body as well as hi disk - like structure @xcite , ngc 6822 has complex stellar structure that extends out to about @xmath12 arcmin , well beyond the extent of a central optical body .
this has led to a suggestion that ngc 6822 might have undergone merger - like interactions rather recently , which have significantly increased the star formation rate within the last 3 gyr @xcite .    to understand physical conditions and extent of primordial ngc 6822
, we need to concentrate on old stellar components that still pervade throughout the galaxy .
the spheroidal or halo of a galaxy is an ideal for this purpose since it is mainly composed of old stars with much less contamination by bright and young stars usually found near the galaxy center . a recent study by @xcite shows that a significant population of intermediate age agb stars is found out to 28 arcmin , corresponding to 4 kpc , from the center of ngc 6822 in projected distance , which is consistent with the results of @xcite and @xcite .
however , there is no clear evidence on the boundary of ngc 6822 halo and not much information on the properties of stellar components in the very outer part of its halo .
the escs discovered in ngc 6822 have expanded the boundary of its stellar halo even further out to 77 arcmin or 10.5 kpc from the center of galaxy . since escs are star clusters with many observational advantages over individual stars , this provides an excellent opportunity to investigate the physical and kinematic properties of outer stellar components as well as to explore the extent of the galaxy . from the photometric study based on the cfht megacam image data
, we have shown in @xcite that those new escs are probably old and metal poor populations . however
, the results suffer uncertainties caused by insufficient spatial resolution and shallow photometric depth of the ground - based image data as well as the age - metallicity degeneracy inherent to the photometric cmd method .    in this study , we present the first result of the integrated spectroscopic study for four escs among those five discovered in ngc 6822 based on the observations made with gmos at gemini - south .
we assume the same distance to each esc as ngc 6822 based on the result of cmd analysis @xcite and adopt @xmath13 , an average of distance moduli measured by using rr ryrae @xcite , cepheid @xcite , and nir trgb @xcite .
this translates to about 470 kpc in physical distance to ngc 6822 where @xmath14 corresponds to about 0.132 kpc in projected scale .
the target escs in ngc 6822 were discovered in our previous imaging survey of ngc 6822 with cfht megacam and the detailed information on these clusters including the coordinates , magnitude , and size is listed in @xcite .
the spectroscopic observations of the four escs in ngc 6822 were made using the gemini multi - object spectrograph ( gmos ) of gemini - south 8.1 m telescope in queue mode operation under the program i d gs-2011b - q-16 ( pi : n. hwang ) between august and october 2011 .
we used the gmos in long - slit mode with b600_g5323 grating in which each target is placed at the central 0.75 arcsec wide slit in each exposure . the exposures were taken in multiples of 700 sec ( for c1 ) or 1800 sec ( for c2 , c3 , and c4 ) and the total integrated exposure times run from 2800 sec for c1 to 3 hours for c2/c4 and 4 hours for c3 .
we dithered each exposure by @xmath15 arcsec to prevent a few bright stars from dominating the whole spectra , which is necessary since the target escs are partially resolved into their member stars .
each exposure was binned by 2 pixels in the spectral direction and by 4 pixels in the spatial direction to improve the signal of the obtained spectra .
the wavelength coverage of the spectra is about 39006500  with a spectral resolution of about 0.92  per pixel , safely including major absorption features of interest such as ca h+k , h@xmath16 , mgb , and some iron lines including fe5270 and fe5335 .
we also obtained spectra of two old gcs in ngc 6822 , hubble vii ( h vii ) and hubble viii ( h viii ) for the comparison with target escs , and four mw gcs ( ngc 6624 , m12 , m15 , m107 ) for the calibration of lick indices using the same observational settings .
the integrated exposure times for these clusters range from 1 min to 1 hour depending on the surface brightness . for the flux calibration , we observed ltt7379 as our spectral standard .
each science exposure was preceded and followed by flat field and cuar arc exposures with the same observational settings .
the reduction of data was carried out with the gemini package in iraf .
first , we used @xmath17 to prepare the raw data for further reduction and @xmath18 to flatfield , to correct overscan , to trim , and to mosaic the science images .
the wavelength calibration was established by using @xmath19 task on cuar arc taken together with science data , and then , the derived wavelength solution was applied to the corresponding science data by using @xmath20 .
the calibrated science spectra were combined to make a single data and then , the combined data were traced and extracted by using @xmath21 to make one dimensional spectral data . the finally reduced spectra with several major absorption features are shown figure [ spectra ] .
we have derived the radial velocities of target clusters by using @xmath22 task in iraf @xmath23 package .
the spectra of four mw gcs ( ngc 6624 , m12 , m107 , and m15 ) were used as templates for the correlation with target spectra over the wavelength range of @xmath24    where several prominent absorption lines including h@xmath16 and mgb are available .
the radial velocities of mw gcs were taken from the catalog by @xcite ( 2010 version ) and are in the range of -107.0 km / s for m15 to 53.9 km / s for ngc 6624 .
each target spectrum was correlated with template spectra of four mw gcs and then the derived velocities were weight - averaged with errors to calculate the final radial velocity .
the determined radial velocities range from @xmath0 km / s for c1 to @xmath25 km / s for c4 and are listed in table 1 . for h vii and h viii ,
the radial velocities are determined to be @xmath26 km / s and @xmath27 km / s , respectively .
these velocities of h vii and h viii are in good agreement with the radial velocity @xmath28 km / s of ngc 6822 listed in the nasa / ipac extragalactic database ( ned ) within the measurement errors .
the standardized lick index system @xcite is a set of the absorption line strength measures for low - resolution spectra that can be compared to theoretical stellar population models to derive the ages , metallicities , and [ @xmath29/fe ] of target system .
there are 25 lick indices , running from cn@xmath30 to tio@xmath31 , of which measurement wavelength range was defined by @xcite .
we measured the lick indices in the spectra of four escs and two hubble clusters in ngc 6822 as well as four mw gcs using gonzo , a code for lick index measurement described in @xcite .
gonzo measures the line index of each lick feature according to the definition by @xcite .
we used the sky spectrum for each target with gonzo to simulate the uncertainty of the lick index measurements through 100 monte carlo realizations . for each realization , gonzo measures the indices again in the simulated spectra , and the 1 standard deviation of the measured index is adopted as the index uncertainty .    for the calibration of the measured lick index values
, we compared the index measurements of four mw gcs , such as ngc 6624 , m12 , m107 , and m15 with the standard lick index values listed in @xcite and @xcite .
then , the zero point offsets between standard lick and the measured indices were calculated in the following way : @xmath32 .
we determined the zero point offsets for 24 indices that were measured in more than two mw gc calibrator spectra .
the offsets and their rms are listed in table [ tab2 ] .
the finally derived 24 lick indices and their errors for four escs and two hubble clusters in ngc 6822 are listesd in tables [ tab3a ] and [ tab3b ] , respectively .
for the reliable determination of age and metallicity from the lick indices , we need high s / n for major indices such as h@xmath16 , mg2 , mgb , fe5270 , and fe5335 , where s / n value is measured at the continuum part of the corresponding lick indices .
the s / n for those major lick indices is between 15 and 60 for c1c3 , h7 , and h8 .
however , for c4 , the s /
n values for the same indices are about 514 , which leads to relatively large errors .
we have used two methods for the age and metallicity determination of star clusters using lick indices : a model grid method and a @xmath33 minimization method .
we have used the lick index model grid method ( the grid method hereafter ) to determine the age and metallicity of target clusters .
this method compares the measured and calibrated lick indices with the index grids calculated from the theoretical ssp models . in this study , we use the grids spanned by [ mgfe]@xmath34 versus balmer lines such as h@xmath16 , h@xmath35 , and h@xmath36 lines to estimate the metallicity and age @xcite .
the composite index [ mgfe]@xmath34 , defined as [ mgfe]@xmath34 @xmath37 , is a good tracer for metallicity with little sensitivity to [ @xmath29/fe ] , while balmer lines are a good tracer of age @xcite . for the age and metallicity for a star cluster
, we adopted a weighted average of values derived from the model grids of [ mgfe]@xmath34 versus h@xmath16 , h@xmath35 , and h@xmath36 lines , respectively @xcite .
however , each theoretical model grid still depends on [ @xmath29/fe ] that can be , in principle , derived from the grid of mg2 versus @xmath38 , where @xmath39 , which is also a function of age .
we have tried to determine [ @xmath29/fe ] using the grid of mg2 versus @xmath38 based on the technique used by @xcite that iterates between these model grids to finally determine the age , metallicity , and [ @xmath29/fe ] for target clusters .
after some exhaustive tests with this approach , we have found that the derived [ @xmath29/fe ] values include rather large uncertainties that do not allow further physical application .
therefore , we decided to use the age and metallicity values determined by applying the theoretical model with [ @xmath29/fe]=0.3 , the average value for mw gcs , to the grid of [ mgfe]@xmath34 and balmer lines .      instead of using a few major lick indices ,
we have also applied a ` @xmath33 minimization method ' ( @xmath33 fit method hereafter ) that utilizes all available line indices to fit the model index lines to determine the age and metallicity from the input spectra .
this method was suggested by @xcite as a more robust method for determining physical parameters of globular clusters .
we applied this method to our target star clusters using the same ssp models with [ @xmath29/fe]=0.3 as used in the grid method .
we also tested the fit result by varying [ @xmath29/fe ] values , but could not find any sign of significant improvement .
the total number of lines used for each cluster is about 15 with best signal available for the corresponding target .
the error of each parameter was estimated by calculating the 1@xmath40 significance level above the minimum point in the @xmath33 distribution .
figure [ kin1 ] displays the radial velocities of escs and hubble clusters as well as those of carbon stars along the projected distance from the ngc 6822 center .
it is known that those carbon stars exhibit a systematic rotation around the main body of ngc 6822 @xcite .
figure [ kin1 ] shows clearly that escs in ngc 6822 do not fit into the scheme of rotation displayed by carbon stars in the halo of ngc 6822 @xcite .
it is also evident that the velocities of escs do not show any sign of systematic motion either , while the velocities of two hubble clusters may be consistent with the rotation of carbon stars : the velocities of h vii and h viii are within @xmath41 of the mean velocity of carbon stars .
this result suggests that the escs are not kinematically coupled with the intermediate stellar populations and that the esc system are pressure supported , rather than rotation supported .
we have determined the mean velocity and velocity dispersion of carbon stars and escs : @xmath42 and @xmath43 km s@xmath1 for carbon stars , and @xmath44 and @xmath45 km s@xmath1 for escs .
however , the carbon stars are systematically rotating so that we have derived the rotation velocity of carbon stars as @xmath46 km s@xmath1 arcmin@xmath1 or @xmath47 km s@xmath48 kpc@xmath48 based on the radial velocity data provided by @xcite . then , the rotation corrected velocity dispersion of carbon stars is @xmath49 km s@xmath1 . considering that the systematic radial velocity of ngc 6822 is @xmath28 km / s as listed in ned , the system of escs is moving toward us faster than ngc 6822 itself and carbon stars , while the velocity dispersion of esc system is very similar to that of carbon stars .
these results show that esc system has kinematical properties distinct from those of the other stellar components in ngc 6822 including carbon stars .
the hi - disk like structure does not have any common kinematic characteristic with esc system in ngc 6822 , either @xcite . considering the absence of any systematic motion
, it may be a clue supporting that escs had accreted into the halo of ngc 6822 , which is separated from the galaxy - wide kinematics involving the carbon stars and the hi - disk .
we list the measured metallicities and ages of each cluster in ngc 6822 in table [ tab4 ] , and compare those values derived from the grid and @xmath33 fit methods in figure [ grid2chi ] .
the upper panel shows that both methods return consistent results on metallicity [ z / h ] .
we have derived linear least square fits between two metallicity values and found that the rms values are not greater than @xmath50 .
the lower panel also shows that the ages determined by the grid and @xmath33 methods are very well correlated with each other although there are some scatters with large errors .
the result of linear least square fit exhibits an offset between two age measurements of about @xmath51 gyr , which is usually smaller than the age errors marked in the plot .
figure [ mwgc ] shows the comparison of age and metallicities of mw gcs derived by the grid and @xmath33 fit methods with those values listed in @xcite ( 2010 version ) .
we have assumed [ @xmath29/fe]=0.3 , the average value for mwgcs , to calculate the metallicities with the equation [ fe / h ] @xmath52 - 0.94 \times { \rm [ \alpha / fe]}$ ]
it is noted that ages are relatively better reproduced by the grid method , while metallicities are better traced by the @xmath33 fit method .
this result of comparison also suggests that the derived age of @xmath53 gyr may actually be an indication of 10 gyr or older due to the uncertainties larger than expected by the grid and @xmath33 fit methods themselves .
therefore , we adopt the age and metallicity values derived by the @xmath33 fit method for further discussions unless specifically noted otherwise , while we interpret the age with a caution .
however , we keep ages and metallicities derived from both methods in table [ tab4 ] and in figure [ agemet1 ] for reference .
figure [ agemet1](a ) displays the age distribution of 4 escs and 2 hubble clusters in ngc 6822 , determined by the @xmath33 fit ( filled symbols ) and the grid ( open symbols ) method .
the result shows that all star clusters are older than about 8 gyr except for h viii that is estimated to be @xmath54 gyr old .
it is noted that the age of h vii is estimated to be about 12 gyr , while c2 is about 13 gyr and c1 is estimated about 10 gyr old .
considering that the oldest age that can be measured through the current theoretical model is about 10  14 gyr , and that h vii is known as a genuine old gc in ngc 6822 through the existing spectroscopic study @xcite , this result supports that escs c1 and c2 are almost as old as h vii , and c1 is a genuine old gc with the largest separation of about 77 arcmin or 10.5 kpc from the center of ngc 6822 .
c3 is about 7.8 gyr old although c3 is located relatively closer to ngc 6822 center than the other escs and has higher chance of younger stellar populations from the galaxy body .
this implies that c3 may be slightly younger than h vii but still old , especially considering the uncertainty in the age determination .
the age of c4 is about 9.0 gyr with rather large error of about 3 gyr
. this large error may be due to the extended structure with low surface brightness of c4 , resulting in low s / n spectra .
combined with its integrated color @xmath55 from @xcite , c4 is probably old with @xmath56 8  10 gyr in spite of the large age error .
it is noted that the age of h viii is estimated younger than the other clusters of ngc 6822 investigated in this study : @xmath57 gyr with the @xmath33 fit and @xmath58 gyr with the grid method .
the age measurements made by individual h lines return @xmath59 gyr for h@xmath16 , @xmath60 gyr for h@xmath35 , and @xmath61 gyr for h@xmath36 lines .
therefore , h viii may be slightly older than indicated by the grid and the @xmath33 fit methods , maybe up to about @xmath62 gyr .
however , it still suggests that h viii is younger than the other gcs in ngc 6822 including h vii and four escs .
this result on the age of h viii is in qualitative agreement with the result by @xcite that derived @xmath63 gyr based on the optical spectroscopy made with ctio and another report by @xcite that derived @xmath64 gyr based on the optical photometry data obtained with hst . on the other hand , @xcite reports
that the age of h viii is about 34 gyr based on the low resolution spectroscopy made with keck , which is much older than the other results mentioned above .
figure [ agemet1](b ) displays the radial metallicity distribution of 4 escs and 2 hubble clusters in ngc 6822 , calculated by assuming [ @xmath29/fe]=0.3 , the average value for mwgcs .
this shows that escs and h vii are very metal poor with [ fe / h]@xmath65 , ranging from [ fe / h]@xmath66 for c4 to [ fe / h]@xmath67 for c3 . for h viii
, the metallicity is estimated to be [ fe / h]@xmath68 .
this metallicity for h viii is higher than [ fe / h]@xmath69 derived for h viii by @xcite .
however , the metallicity for h vii , [ fe / h]@xmath70 is consistent with the values in the literature , such as [ fe / h]@xmath71 by @xcite and [ fe / h]@xmath72 by @xcite .
the metallicity of c1 is [ fe / h]@xmath73 , which suggests that the outermost esc of ngc 6822 is a genuinely metal poor population .
the result on the age and metallicity in this study of ngc 6822 star clusters shows that star clusters older than about 8 gyr are metal poor with [ fe / h]@xmath4 , and that the old and metal poor clusters are preferentially located in the outer halo , farther than 15 arcmin or 2 kpc from the center of ngc 6822 except for h vii .
combined with the radial distribution of carbon stars shown in figure [ kin1 ] , this suggests that the old stellar halo of ngc 6822 , located roughly more than 20 arcmin or 2.6 kpc away from the galaxy center , is composed of old ( @xmath56 8 gyr ) and metal poor ( [ fe / h]@xmath74 ) stellar populations .
compared with this , the inner halo of ngc 6822 is populated with intermediate age ( @xmath75 gyr ) and slightly metal rich ( [ fe / h]@xmath76 ) as well as old ( @xmath77 gyr ) and metal poor ( [ fe / h]@xmath5 ) populations .
the existence of an old stellar spheroidal or halo around a dwarf galaxy and its physical properties have been subjects of many studies . for ngc 6822 ,
an extended structure of old and intermediate age stars has been first detected by @xcite .
further investigation by @xcite and @xcite revealed that the spheroidal or halo structure is extended out to , at least , about 30 arcmin from the center of ngc 6822 .
the mean metallicity of stars in ngc 6822 is [ fe / h]=@xmath78 based on the near infrared photometry of rgb stars @xcite , which is in good agreement with [ fe / h]=@xmath79 determined by the equivalent widths of caii triplet lines @xcite .
however , it is noted by @xcite that the metallicity ranges from -0.5 to -2.0 for stars selected in the central 5 to 11 arcmin region of ngc 6822 .
this metallicity spread is also consistent with [ fe / h]@xmath80 for old rr lyrae variables @xcite and [ fe / h]@xmath81 for a - type supergiants @xcite in the central region of ngc 6822 .
recently , @xcite show that the global metallicity of stars is [ fe / h]@xmath82 within about 28 arcmin radius from ngc 6822 center , hinting an existence of systematically lower metallicity component in the outer halo .
the star clusters of ngc 6822 investigated in this study are old ( @xmath83 gyr ) and metal poor ( [ fe / h]@xmath4 ) except for one cluster : h viii is relatively young ( @xmath84 gyr ) and metal rich ( [ fe / h]@xmath85 ) .
it is noted that the metallicities of very old clusters , c1 , c2 , and h vii , range from @xmath86 to @xmath87 , which is in agreement with [ fe / h]@xmath80 for old rr lyrae variables @xcite .
this makes escs a good tracer of old stellar population . considering the wide spatial distribution of escs , this result suggests the presence of old and metal poor stellar halo extended out to as far as 77 arcmin or 10.5 kpc ( e.g. , c1 ) from the center of ngc 6822 , one of the largest old stellar halos known for dwarf galaxies in the local group .
this extent goes beyond the previously explored area @xcite and covers about three times larger radial distance than observed by @xcite .
it is interesting to find out that , for ngc 6822 , the extended old and metal poor population appears to exhibit different kinematics when compared with the intermediate age components .
figure [ kin1 ] shows that the radial velocities of escs do not fit into the rotation by carbon stars @xcite . considering that carbon stars with about 1  3 gyr old are concentrated near the galaxy center
, the central component or main body of ngc 6822 may be kinematically detached from the extended stellar halo mostly represented by escs .
it is also noted that the rotation direction of carbon stars are roughly consistent ( approaching west wing and receding east wing ) with the rotation curve of hi gas overlaid on the main body but extended toward the perpendicular direction to the stellar halo of ngc 6822 @xcite .
the distinct kinematic characteristics of different components in ngc 6822 may be the evidence of merging - like events @xcite , combined with different spatial distributions of different populations @xcite .
recent discoveries of many escs ( e.g. , @xcite ) have led to inquiries regarding the origin of these escs and how they are made larger than typical gcs .
there have been discussions on the possible origins of these escs and some of the proposed scenarios are summarized in @xcite . among them , there are scenarios involving tidally stripped dwarf galaxies , collisions of star clusters , and intrinsically extended star clusters that have survived tidal disruption .
it has been also implied that observed escs may be a mixture of heterogeneous populations with different formation mechanisms .
the spectra of escs in ngc 6822 confirms that they are old stellar population with low metallicities .
the large separation of these escs from the galaxy center also implies that they may be survivors of weak tidal force in the outer halo of ngc 6822 .
these observational results are consistent with a theoretical model by @xcite that escs are natural products of early star formation in small dwarf galaxies with moderate to weak tidal forces , which is an ideal condition for escs to survive the tidal disruption .
the relative isolation of ngc 6822 itself could have helped the formation and survival of escs in their current locations .    even in the mw , it has been noted that large and extended gcs are preferentially found in the outer halo where the distance from the mw center , @xmath88 is larger than 40 kpc @xcite .
many of those extended gcs belong to the young halo ( yh ) population , which leads to a suggestion that these extended gcs may have come from the accreted dwarf galaxies @xcite . considering the similar physical properties of escs in ngc 6822 to those extended gcs in mw , this may be independent evidence supporting the hypothesis that extended gcs mostly came from the accreted dwarf galaxies .
however , it is also argued that extended gcs in the outer part of mw - like galaxies can be explained by introducing the expansion of initially compact gcs , without invoking accretions of dwarf galaxies @xcite .
it is interesting to note that escs in ngc 6822 do not exhibit any clear signature of systematic kinematics unlike the intermediate age carbon stars , mostly concentrated around the central main body of the galaxy .
this indicates that escs , old population in the halo , are kinematically detached from the central body of ngc 6822 , composed of young and intermediate age populations as well as a huge disk - like hi structure @xcite .
combined with the lack of any systematic kinematics among escs , this may suggest that escs in ngc 6822 have accreted from the external components such as neighboring dwarf galaxies .
the external origin of escs also implies that the observed escs may not be necessarily bound to ngc 6822 system .
the best example can be the outermost esc , c1 .
it should make c1 the nearest intergalactic globular cluster . at the moment
, however , there is no clear evidence to confirm or to deny the dynamical containment of c1 or the other escs in ngc 6822 system .
even if we are to confirm that the escs are gravitationally bound to ngc 6822 , it does not necessarily mean that they have originally formed in ngc 6822 or that they have accreted from other neighboring systems because the old ages and low metallicities are easily expected in both scenarios .
at least , it seems clear that escs are kinematically separated from intermediate stellar structure ( e.g. , carbon stars ) as well as hi - disk like structure with young stars .
since old rgb stars exhibit a similar spatial distribution with escs , it may be interesting to investigate the kinematical and chemical properties of old rgb and rr lyrae stars observed near the escs in ngc 6822 halo . with spectra of many such old stars
, it will be easier to determine the overall kinematical properties of any halo stellar structures that might be associated with escs . the existence of such stellar structures with distinct kinematical properties , regardless of whether they are gravitationally bound to the host galaxy or not , could be construed as a result of the unrelaxed recent merger - like interactions of ngc 6822 with its neighbors .
therefore , it will be very useful to compare the kinematical as well as chemical properties of escs with those of adjacent halo stars in many galaxies to solve the issue of the esc origin as well as the dwarf galaxy accretion , even in the context of evolution of large mw - like galaxies .
we have estimated the dynamical mass of ngc 6822 by using the  tracer mass estimator " method based on the assumption that the esc system is pressure supported as a whole because no significant signature of rotation is observed .
we have adopted the definition of mass estimator defined by @xcite as eq.[eq1 ] combined with eq.[eq2 ] , which is described as a function of line of sight velocities @xmath89 and galactocentric distances @xmath90 of clusters :    @xmath91    where @xmath92    the @xmath36 is determined by the tracer population density distribution and the @xmath29 is an indicator of the properties of galaxy potential under consideration .
when @xmath93 , which is for the typical stellar spheroidal halo , the value of c is given by @xmath94    we also assume an isothermal potential for ngc 6822 halo , which makes @xmath95 . for comparison , two extreme cases with velocity distribution of tracers
are tried : @xmath96 for an isotropic velocity distribution and @xmath97 for tracers on radial orbits and the estimated mass for each case is quoted as an upper and lower limit of the estimated mass hereafter .
figure [ kin2 ] displays the estimated mass of ngc 6822 system calculated by assuming each cluster is the outermost tracer .
the mass estimated by assuming a circular rotation of carbon stars is also marked for comparision .
the estimated mass increases from @xmath98 to @xmath99 as we move from c3 , the innermost esc , to c1 , the outermost esc in ngc 6822 .
if we limit the radial range to include only out to c2 , then the mass estimate is @xmath100 .
this value is still larger than the mass estimate made with carbon stars under the rotational velocity field , which is @xmath101 .
however , it is noted that the mass estimate converges to about @xmath102 between c4 and c1 , that is , between 40 and 77 arcmin from the center of ngc 6822 . we have determined the total dynamical mass of ngc 6822 , m@xmath103 , measured at the location of c1 , about @xmath104 arcmin or 10.5 kpc from the galaxy center .
this mass is about twice the mass estimated from the hi rotation measurements combined by the pseudo - isohtermal ( iso ) dark matter model assumption by @xcite , which is @xmath105 enclosed within about r@xmath106 arcmin radius .
we have derived the m /
l value of ngc 6822 using the newly determined dynamical mass and found that ( m / l)@xmath107 .
this m / l value is higher than previously known for ngc 6822 : ( m / l)@xmath108 ( m / l)@xmath109@xcite and ( m / l)@xmath110 ( m / l)@xmath109 @xcite .
it is also higher than m /
l of other dwarf galaxies in the local group with similar luminosities , i.e. , @xmath111 , as shown in figure 9 of @xcite : m / l is usually lower than 30 for dwarf galaxies with @xmath111 .
it is noted that m / l of ngc 6822 is comparable with that of faint dwarf spheroidal galaxies such as ursa minor with @xmath112 and ( m / l)@xmath113 ( m / l)@xmath109 @xcite .
this result indicates that ngc 6822 is one of the most dark matter dominated dwarf galaxies in the local group , which is also consistent with the conclusion made by @xcite based on the hi rotation curve .
the spectroscopic study of the four escs as well as two hubble clusters in ngc 6822 has shown that the radial velocities of escs range from about @xmath114 km s@xmath1 ( for c1 ) to about @xmath115 km s@xmath1 ( for c4 ) , and the mean radial velocity of escs are @xmath116 km s@xmath1 , approaching toward us faster than ngc 6822 itself ( @xmath117 km s@xmath1 ) as well as system of carbon stars ( @xmath118 km s@xmath1 ) .
interestingly , the escs do not display any sign of systematic rotation unlike carbon stars rotating within 20 arcmin from ngc 6822 center .
the ages and metallicities derived using the lick indices suggest that the escs are old ( @xmath3 gyr ) and metal poor ( [ fe / h]@xmath4 ) .
the metallicity of c1 , the outermost esc of ngc 6822 , is estimated to be [ fe / h]@xmath73 , while the metallicity of c3 , the innermost esc , is [ fe / h]@xmath119 . however , the lowest metallicity of [ fe / h]@xmath120 is expected from c2 and c4 .    there is no clear sign of radial metallicity gradient in the star clusters of ngc 6822 , but it is found that both metal poor ( [ fe / h]@xmath5 ) and metal rich ( [ fe / h]@xmath6 ) components co - exist within 15 arcmin or 2 kpc from the center of ngc 6822 , while only metal poor component is observed in the outer halo with @xmath7 arcmin or 2.6 kpc . considering no systematic motion of esc system , we suggest that escs are primordial stellar components with low metallicity that had accreted into the outer halo of ngc 6822 .
the extended structure may have originated under the environment of relatively weak tidal force in a small dwarf galaxy , which is consistent with the theoretical predictions .
based on the wide spatial distribution of escs , we have determined that the dynamical mass of ngc 6822 is m@xmath103 enclosed within 77 arcmin or 10.5 kpc in projected distance .
the m / l ratio of ngc 6822 is @xmath121 , which is much higher than previously known @xcite and about twice higher than estimated from the hi disk rotation curve @xcite .
this strongly indicates that ngc 6822 is a highly dark matter dominated system among the other dwarf galaxies in the local group .
it is not clear yet whether the high content of dark matter has anything with formation and/or survival of escs in ngc 6822 halo .
however , with more kinematical and chemical data for old stars in ngc 6822 halo , we may be able to better understand the origin of escs as well as the evolutionary history of ngc 6822 itself , a small dwarf galaxy with complex structure .
the authors are grateful to the anonymous referee for the useful comments and suggestions that helped to improve the original manuscript .
this work was supported by the national research foundation of korea ( nrf ) grant funded by the korea government ( mest ) ( no .
2012r1a4a1028713 ) .
n.h . was supported in part by korea gmt project operated by korea astronomy and space science institute ( kasi ) .
the authors are grateful to thomas puzia for generously providing the gonzo package and to serge demers for radial velocity data of ngc 6822 carbon stars .
this research has made use of the nasa / ipac extragalactic database ( ned ) which is operated by the jet propulsion laboratory , california institute of technology , under contract with the national aeronautics and space administration .
hwang , n. , et al .
2005 , iau colloq .  198 : near field cosmology with dwarf elliptical galaxies , eds . h. jerjen & b. binggeli ( cambridge : cambridge univ .
press ) , 257 hwang , h.  s. , lee , m.  g. , park , h.  s. , et al .
2008 , , 674 , 869            lee , m.  g. , & hwang , n.  2005 , iau colloq .  198 : near field cosmology with dwarf elliptical galaxies , eds . h. jerjen & h. binggeli ( cambridge : cambridge univ .
press ) , 181 letarte , b. , demers , s. , battinelli , p. , & kunkel , w.  e.2002 , , 123 , 832                                              lc ngc6822c1 &  -61.2 @xmath122 20.4 + ngc6822c2 & -105.6 @xmath122 30.7 + ngc6822c3 &  -70.9 @xmath122 17.3 + ngc6822c4 & -115.3 @xmath122 57.9 + hubble vii &  -64.5 @xmath122 20.6 + hubble viii &  -46.9 @xmath122 31.2 +    cccc cn@xmath30 & mag & -0.084 & 0.056 + cn@xmath31 & mag & -0.079 & 0.062 + ca4227 &  & -0.140 & 0.989 + g4300 &  & -2.621 & 1.145 + fe4383 &  & 0.843 & 0.863 + ca4455 &  & -0.283 & 1.002 + fe4531 &  & -0.408 & 1.375 + fe4668 &  & -1.886 & 1.932 + h@xmath16 &  & 0.573 & 1.028 + fe5015 &  & -0.657 & 1.662 + mg@xmath30 & mag & -0.001 & 0.055 + mg@xmath31 & mag & 0.012 & 0.035 + mgb &  & 0.091 & 1.071 + fe5270 &  & 0.125 & 1.051 + fe5335 &  & -0.386 & 1.058 + fe5406 &  & -0.171 & 1.006 + fe5709 &  & -0.386 & 0.996 + fe5782 &  & 0.017 & 0.865 + nad &  & 0.622 & 1.109 + tio@xmath30 & mag & 0.000 & 0.035 + h@xmath123 &  & 1.697 & 2.794 + h@xmath124 &  & -1.338 & 0.937 + h@xmath125 &  & 0.910 & 1.985 + h@xmath126 &  & 0.659 & 1.763 +    lcccccccccccccccccccccccc c1 & -0.019 & -0.068 & 0.411 & 1.902 & 1.240 & 0.273 & 1.103 & -1.408 & 1.763 & 1.541 & 0.006 & 0.064 & 1.176 & 0.914 & 1.426 & -0.559 & 0.718 & 0.037 & 2.319 & 0.008 & 2.346 & 2.896 & 1.663 & 2.390 + c2 & -0.028 & -0.062 & 0.451 & 1.754 & 0.475 & 0.485 & 0.366 & 0.611 & 2.868 & 0.058 & 0.017 & 0.066 & 0.600 & 0.529 & 0.347 & -0.022 & -0.262 & -0.292 & 4.519 & 0.057 & 2.726 & 1.174 & 2.847 & 1.906 + c3 & -0.013 & -0.005 & 1.030 & 4.475 & -0.393 & 0.429 & 2.275 & 0.542 & 2.827 & 3.494 & 0.002 & 0.050 & 0.581 & 1.104 & 1.945 & 0.852 & 0.495 & 0.117 & 0.973 & 0.036 & -1.060 & 0.715 & -0.375 & 1.083 + c4 & -0.069 & -0.211 & -1.567 & 2.421 & -4.056 & 0.084 & 3.584 & -1.098 & 2.387 & -0.540 & 0.002 & 0.056 & -2.364 & 0.833 & 0.039 & 1.629 & 0.270 & -0.113 & 0.954 & 0.098 & 1.469 & 3.233 & -3.239 & 0.777 + h7 & 0.009 & -0.004 & 0.236 & 1.332 & 0.262 & 0.537 & 0.829 & -0.995 & 2.865 & 1.386 & 0.010 & 0.043 & 0.780 & 0.950 & 0.927 & 0.411 & 0.638 & 0.313 & 0.990 & 0.006 & 3.298 & 2.860 & 3.557 & 3.099 + h8 & -0.101 & -0.085 & 0.251 & 2.482 & -2.825 & 1.309 & 2.156 & 0.014 & 5.001 & 2.451 & -0.015 & 0.047 & 0.678 & 1.281 & 1.401 & 0.730 & 0.139 & 0.347 & 2.242 & 0.026 & 7.536 & 7.059 & 5.699 & 5.119    lcccccccccccccccccccccccc c1 & 0.002 & 0.004 & 0.143 & 0.168 & 0.192 & 0.195 & 0.203 & 0.224 & 0.226 & 0.238 & 0.007 & 0.007 & 0.244 & 0.246 & 0.248 & 0.249 & 0.249 & 0.250 & 0.251 & 0.007 & 0.280 & 0.297 & 0.303 & 0.307 + c2 & 0.005 & 0.008 & 0.269 & 0.289 & 0.328 & 0.333 & 0.357 & 0.396 & 0.400 & 0.413 & 0.012 & 0.012 & 0.424 & 0.426 & 0.429 & 0.430 & 0.431 & 0.432 & 0.433 & 0.012 & 0.479 & 0.490 & 0.500 & 0.505 + c3 & 0.004 & 0.006 & 0.221 & 0.240 & 0.274 & 0.280 & 0.294 & 0.318 & 0.320 & 0.329 & 0.010 & 0.010 & 0.343 & 0.345 & 0.347 & 0.348 & 0.349 & 0.350 & 0.351 & 0.011 & 0.387 & 0.401 & 0.415 & 0.420 + c4 & 0.013 & 0.020 & 0.720 & 0.833 & 0.951 & 0.990 & 1.035 & 1.118 & 1.126 & 1.159 & 0.035 & 0.035 & 1.191 & 1.197 & 1.206 & 1.211 & 1.214 & 1.216 & 1.221 & 0.037 & 1.383 & 1.452 & 1.503 & 1.523 + h7 & 0.001 & 0.002 & 0.073 & 0.079 & 0.092 & 0.093 & 0.097 & 0.109 & 0.109 & 0.112 & 0.003 & 0.003 & 0.115 & 0.116 & 0.116 & 0.117 & 0.117 & 0.117 & 0.118 & 0.003 & 0.130 & 0.133 & 0.138 & 0.139 + h8 & 0.005 & 0.007 & 0.249 & 0.268 & 0.322 & 0.327 & 0.343 & 0.373 & 0.375 & 0.389 & 0.010 & 0.010 & 0.403 & 0.406 & 0.410 & 0.411 & 0.413 & 0.413 & 0.415 & 0.011 & 0.459 & 0.474 & 0.484 & 0.489    lcccccc ngc6822c1 & @xmath127 & @xmath128 & -1.76 & @xmath129 & @xmath130 & -2.00 + ngc6822c2 & @xmath131 & @xmath132 & -2.06 & @xmath133 & @xmath134 & -2.53 + ngc6822c3 & @xmath135 & @xmath136 & -1.61 &  @xmath137 & @xmath138 & -1.52 + ngc6822c4 &  @xmath139 & @xmath140 & -2.44 &  @xmath141 & @xmath142 & -2.53 + hubble vii & @xmath143 & @xmath144 & -2.10 & @xmath145 & @xmath146 & -2.34 + hubble viii &  @xmath147 & @xmath148 & -1.21 &   @xmath149 & @xmath150 & -0.61 +


classical work on variable selection dates back to @xcite , who proposed to choose a model that minimizes the kullback- leibler ( kl ) divergence of the fitted model from the true model , leading to the well - known akaike information criterion ( aic ) .
@xcite took a bayesian approach by assuming prior distributions with nonzero probabilities on lower dimensional subspaces .
he proposed what is known as the bic method for model selection .
other types of @xmath0 penalties include @xmath1 @xcite , aicc @xcite , ric @xcite and ebic @xcite , among others .
the @xmath0 regularization has a natural interpretation in the form of best subset selection .
it also exhibits good sampling properties @xcite .
however , in a high - dimensional setting , the combinatorial problem has np - complexity , which is computationally prohibitive . as a result
, numerous attempts have been made to modify the @xmath0 type regularization to alleviate the computational burden .
they include bridge regression @xcite , non - negative garrote @xcite , lasso @xcite , scad @xcite , elastic net @xcite , adaptive lasso or alasso @xcite , dantzig selector @xcite , sica @xcite , mcp @xcite , among others .    to a certain extent
, existing penalties can be classified into one of the following two categories : convex penalty and nonconvex penalty .
convex penalties , such as lasso @xcite , can lead to a sparse solution and are stable as the induced optimization problems are convex .
nonconvex penalties , such as scad @xcite and mcp @xcite , can on the other hand lead to sparser solutions as well as the so - called oracle properties ( the estimator works as if the identities of nonzero regression coefficients were known beforehand ) . however , the non - convexity of the penalty could make the entire optimization problem nonconvex , which in turn could lead to a local minimizer and the solution may not be as stable as the one if instead a convex penalty is used .
therefore , an important issue for nonconvex penalties is a good balance between sparsity and stability .
for example , both scad and mcp have an extra tuning parameter which regulates the concavity of the penalty so that , when it exceeds a threshold , the optimization problem becomes convex .
it is well known that penalty functions have bayesian interpretation .
the classical @xmath2 penalty ( ridge regression ) is equivalent to the bayesian estimator with a normal prior .
the @xmath3-type penalties , such as lasso , alasso etc . , also have bayesian counterparts ; cf .
@xcite , @xcite and @xcite .
@xcite initiated the discussion about the issue of stability in model selection .
he demonstrated that many model selection methods are unstable but can be stabilized by perturbing the data and averaging over many predictors .
@xcite introduced the random forest , providing a way to stabilize the selection process .
@xcite derived theoretical results to analyze the variance reduction effect of bagging in hard decision problems .
@xcite proposed a stable selection , which combines the subsampling with high - dimensional variable selection methods .
the main objective of the paper is to introduce a family of penalty functions for generalized linear models that can achieve a proper balance between sparsity and stability .
because for the generalized linear models , the loss function is often chosen to be the negative log - likelihood , it is conceivable to take into consideration the form of the likelihood in the construction of penalty functions .
the bayesian connection to the penalty construction and to the likelihood function make it natural to introduce penalty functions through suitable prior distributions . to this end
, we introduce the family of negative absolute priors ( nap ) and use it to develop what to be called likelihood adaptively modified penalties ( lamp ) .
we define two types of asymptotic stability that cover a wide range of situations and provide a mathematical framework under which the issue of stability can be studied rigorously .
we show that under suitable regularity conditions , the lamp results in an asymptotically stable estimator .    the rest of the paper is organized as follows .
section 2 introduces the lamp family with motivations from its likelihood and bayesian connections .
specific examples are given for the commonly encountered generalized linear models . in section 3
, we introduce two types of asymptotic stability and study the asymptotic properties of lamp family .
the choice of the tuning parameters and an efficient algorithm are discussed in section 4 . in section 5 ,
we present simulation results and applied the proposed method to two real data sets .
we conclude with a short discussion in section 6 .
all the technical proofs are relegated to the appendix .
to introduce our approach , we will first focus on the generalized linear models @xcite .
it will be clear that the approach also works for other types of regression models , including various nonlinear regression models .
indeed , our simulation results presented in section 5 also include the probit model , which does not fall into the exponential family induced generalized linear models .    throughout the paper
, we shall use @xmath4 and @xmath5 to denote the iid random variables for @xmath6 , where @xmath7 is the response observation of @xmath8 and @xmath9 is the @xmath10-dimensional covariate observation of @xmath11 , @xmath12 @xmath13 with @xmath14 .
let @xmath15 , the @xmath16 matrix of observed covariates .
following @xcite , we assume that the conditional density of @xmath7 given covariates @xmath9 has the following form @xmath17,\end{aligned}\ ] ] where @xmath18 is a smooth convex function , @xmath19 or @xmath20 , @xmath21 and @xmath22 is the dispersion parameter .
then up to an affine transformation , the log - likelihood function is given by @xmath23.\end{aligned}\ ] ] note that the form of @xmath24 is uniquely determined by @xmath18 and vice versa .
for a given @xmath18 , we propose the induced penalty function @xmath25,\ ] ] which contains three parameters @xmath26 , @xmath27 and @xmath28 .
the corresponding negative penalized log - likelihood function is @xmath29 because the penalty function defined by ( [ lamp ] ) is likelihood specific , we will call such a penalty likelihood adaptively modified penalty ( lamp ) .
we clearly have @xmath30 and @xmath31 .
furthermore , taking the first and second derivatives , we get @xmath32    the parameters have clear interpretations : @xmath33 is the usual tuning parameter to control the overall penalty level ; @xmath34 is a location parameter , which may be fixed as a constant ; @xmath35 controls the concavity of the penalty in the same way as @xmath36 in scad ( fan and li , 2001 ) and @xmath37 in mcp ( zhang , 2010 ) .    the exponential family assumption given by implies that @xmath38 and @xmath39 .
when @xmath8 is nonnegative , @xmath40 . thus @xmath41 is negative and the corresponding lamp must be concave .    like many other penalty functions
, the family of lamps also has a bayesian interpretation . to see this , we introduce the following prior for any given @xmath18 that defines the exponential family .
let @xmath42 , @xmath43 and @xmath44 @xmath45 be constants .
define a prior density , to be called negative absolute prior ( nap ) , @xmath46 .
\end{aligned}\ ] ]    if we choose @xmath47 , @xmath48 and @xmath49 $ ] , then the posterior mode is exactly the minimizer of ( [ eq::lik - pen ] ) the penalty form of lamp .
we will show that such a choice will lead to good asymptotic properties .
the additive form for the penalty function suggests that the prior must be of the product form .
for each @xmath50 , hyperparameter @xmath51 scales @xmath52 while hyperparameter @xmath53 gives the speed of decay . for the @xmath50th parameter @xmath52 ,
the larger the values of @xmath51 and @xmath53 are , the more information the prior has for @xmath52 . translating it into the penalty function ,
it means that values of @xmath51 and @xmath53 represent the level of penalty and they can be adjusted separately for each component .
the form of nap is to similar to that of a conjugate prior , in that the shape of the prior is adapted to that of the likelihood function .
however , nap also differs from the conjugate prior in several aspects : negative when @xmath54 , absolute , from separate dimension , and with a lasso term taken away . unlike conjugate
prior , which assumes additional samples , this can be seen as to take away the absolute value of redundant sample information from each dimension .
it is worth looking into the commonly encountered generalized linear models and examine properties of the corresponding lamps .
+ _ linear regression_. in this case , @xmath55 .
thus , lamp reduces to the elastic net @xcite . @xmath56
_ logistic regression_. here @xmath57 .
consequently , the penalty function @xmath58 ,    \end{aligned}\ ] ] where @xmath59
. this penalty will be called sigmoid penalty .
_ poisson regression_. here @xmath60 and we have @xmath61.\ ] ] this will be called the poisson penalty .    _ gamma regression_. for the gamma regression , we have @xmath62 .
then , the penalty has the following form @xmath63.\ ] ]    _ inverse gaussian regression_. for the inverse gaussian , we have @xmath64 . the resulting penalty @xmath65.\ ] ]    _ probit regression_. as we mentioned earlier , lamp approach can also accommodate regression models not in the form of naturally parametrized exponential families . in particular , it is applicable to the probit regression for binary outcomes . in this case ,
@xmath66 , which leads to the following penalty form @xmath67},\ ] ] where @xmath68 and @xmath69 are respectively distribution and density functions of the standard normal random variable .
[ remark::alpha_1_choice ] for the above examples , the effect of tuning parameters in the penalty function varies across settings .
for example , @xmath34 does not play a role in the poisson regression .
in addition , we have a natural choice for @xmath34 for the penalty functions .
specifically , we can choose @xmath70 for the cases of linear , gamma , and inverse gaussian , and @xmath71 for the cases of logistic and probit .
, title="fig : " ] , title="fig : " ]    as the examples show , the lamp family is fairly rich .
they also differ from the commonly used penalties .
figure [ fig : penaltyfunctions1 ] contains plots of penalty functions ( left panel ) along with their derivatives ( right panel ) that include lasso , scad , mcp and two members of the lamp family ( sigmoid and poisson ) . here
@xmath72 for mcp , @xmath73 for scad , @xmath74 for sigmoid and @xmath75 for poisson penalty , and @xmath76 for sigmoid penalty .
the parameters are chosen to keep the maximum concavity of these penalties the same .
figure [ fig : penaltyfunctions1 ] shows that sigmoid and poisson penalties lie between mcp and scad when the maximum concavity is the same . also , from the graphs of the derivatives , it is easy to identify that the penalties of the lamp family have continuous derivatives ( actually they have continuous derivatives of any order for most common generalized linear models ) as compared with the discontinuous ones for scad and mcp
. it will be shown that this feature can make the optimization problem easier and the estimation more stable .
consider a one - dimensional penalized logistic regression problem , @xmath77 $ ] , where derivative of the penalty function @xmath78 if the true parameter @xmath79 , we need @xmath80 , where @xmath81 is a @xmath82-centered ball with radius @xmath83 uniform in @xmath84 , to get @xmath85 , while for @xmath86 , we need @xmath87 .
thus , to differentiate a nonzero @xmath82 from 0 , we should make the difference between @xmath88 for @xmath89 and @xmath90 as large as possible .
in addition , we need to control the second derivative of the penalty function to make the penalized negative log - likelihood function globally convex .
figure [ fig : concavity ] illustrates graphically how such dual objectives can be met for the logistic regression under the sigmoid penalty and mcp .
the grey area represents the difference between @xmath91 and @xmath90 for the sigmoid penalty .
a subset of the grey area , marked by darker color , represent the corresponding difference under mcp .
the reason that mcp tends to have a smaller difference compared with sigmoid penalty is because the second derivative of the penalty needs to be controlled by that of the negative log - likelihood in order to maintain the global convexity .    ]
recall that the negative log - likelihood considered here is convex , and the maximum likelihood estimation is uniquely defined and stable . by adding a nonconvex penalty , the convexity may be destroyed . to study stability of the penalized mle ,
it is necessary to study the impact of the penalty on the concavity , especially when @xmath84 is large .
for the negative penalized maximum log - likelihood estimation procedure , if nonconvex penalties are used , the solution to the minimization problem may not be unique .
therefore , it is natural to study the behavior of the local maximizers in penalized likelihood estimates when the observations are perturbed .
here we introduce a new concept of asymptotic stability to describe the asymptotic performances of local minimizers in penalized likelihood estimates .
note that even for the negative penalized likelihood estimators with convex penalty where the unique minimizer exists , such asymptotic stability concept is still useful in characterizing the behavior of the global maximizer .
suppose we want to minimize with respect to @xmath92 a criterion function @xmath93 , where @xmath94 and @xmath95 is the @xmath50th observation of @xmath96 .
denote by @xmath97 and @xmath98 the support for @xmath99 and domain for @xmath92 , respectively .
we say that @xmath100 is a local minimizer if there exists a neighborhood within which @xmath101 attains its minimum .
more precisely , the set of the local minimizers is defined as @xmath102 throughout the paper , @xmath103 denotes the @xmath2-norm of a vector or matrix ( vectorized ) while @xmath104 denotes the @xmath3 norm . for any @xmath105 let @xmath106 the be @xmath107-centered ball with radius @xmath108 .
it is clear from the definition that the set of local maximizers is random .
we characterize its asymptotic behavior in terms of whether or not the set converges to a single point as @xmath109 . for a set @xmath110 ,
define its diameter as @xmath111 .
we say that the set of local minimizers of @xmath112 satisfies weak asymptotic stability if @xmath113 @xmath114>\delta\big)=0.\ ] ]    the weak asymptotic stability characterizes the asymptotic behavior of local minimizers when the data are perturbed slightly .
it shows that for large @xmath84 and small perturbation , the local minimizers stay sufficiently close to each other with high probability .
defined below is a stronger version , which guarantees uniqueness of the minimizer .
we say that the set of local minimizers of @xmath112 satisfies strong asymptotic stability if @xmath115=0\big)=1.\ ] ]    under the weak asymptotic stability , multiple minimizers , though shrinking to @xmath116 , may exist with high probability for any finite @xmath84 . the strong asymptotic stability , on the other hand , entails that for sufficiently large @xmath84 , the probability of having multiple minimizers must converge to @xmath116 , implying that there must be a unique minimizer with high probability .
@xmath0 penalties , though may have the weak asymptotic property if we adjust its tuning parameter like aic , will never possess the strong asymptotic property , because then the solution of each submodel with the number of parameters constrained will be a local optimizer , and with no probability all solutions will coincide , as @xmath117 .
we now consider the situation in which @xmath93 can be approximated by an i.i.d .
sum with a remainder term , i.e. , @xmath118 this general form includes the form of a negative log - likelihood plus a penalty .
let @xmath119 .
we assume throughout the rest of the paper that @xmath98 is compact with the true parameter value , denoted by @xmath120 , lying in its interior and that @xmath121 is finite .
we need the following regularity conditions .    1 .   for any @xmath122
is convex as a function @xmath92 , and @xmath123 is strictly convex .
2 .   there exists function @xmath124 such that @xmath125 and , for any @xmath126 @xmath127 and @xmath128 , such that @xmath129 @xmath130 4 .
there exists a local minimizer of that is a consistent estimator of @xmath131 5 .
there exists @xmath132 such that @xmath133    when @xmath134 and @xmath135 are both smooth functions , conditions ( c2 ) and ( c3 ) can be guaranteed by assuming that the derivative of @xmath134 is bounded uniformly and that the derivative of @xmath135 tends to 0 uniformly .
condition ( c5 ) is guaranteed by the convexity around the true parameters , uniformly in @xmath84 .
the next two lemmas provide sufficient conditions for the two types of asymptotic stability .
[ lemma::stability : weak ] if conditions ( c1)-(c3 ) are satisfied , then we have weak asymptotic stability .
it is straightforward to verify that for generalized linear models , scad , mcp , sigmoid penalty and poisson penalty all satisfy conditions ( c1)-(c3 ) , leading to the weak asymptotic stability .
[ lemma : stability : strong ] if conditions ( c1)-(c5 ) are satisfied , then strong asymptotic stability holds .      in this subsection
, we study asymptotic properties for the proposed lamp , including parameter estimation consistency , model selection consistency and asymptotic stability .
suppose @xmath136 or @xmath137 is the true value of @xmath138 or @xmath139 , @xmath140 .
let @xmath141 , the number of signals .
without loss of generalization , we assume @xmath142 , where the true value @xmath143 has no zero element , and @xmath144 , which indicates a @xmath145 vector with each element being @xmath116 . denote @xmath146 , @xmath147 , then @xmath148 $ ] is the range of signal level .
for any sequences @xmath149 we say @xmath150 if @xmath151 . here
, we consider the setting of fixed @xmath152 when @xmath153 though some results may be extended to the case of @xmath154 .
we first introduce certain regularity conditions which are needed for establishing asymptotic properties .    1 .
@xmath155 where @xmath156 denotes the @xmath157th derivative of @xmath18 , and @xmath158 of a matrix `` @xmath159 '' denotes its minimum eigenvalue .
2 .   @xmath160 at @xmath161 and @xmath162 ; @xmath163 is increasing at @xmath164 , where @xmath26 is a constant .
3 .   @xmath165 , @xmath166 , and @xmath167 4 .
@xmath168 [ ^t]}>.@xmath169    [ theo : lampasymp ] suppose that conditions ( c6)-(c9 ) are satisfied
. then the penalized maximum likelihood estimator based on the lamp family is consistent and asymptotically normal , and achieves model selection consistency and strong asymptotic stability .
[ lemma : rate ] suppose that ( c6 ) and ( c7 ) are satisfied and @xmath170=x^ul(x)$ ] , where @xmath171 is a constant and @xmath172 is negative and slowly varying at @xmath173 , i.e. , for any @xmath174 , @xmath175=1,$ ] and @xmath176
. then @xmath177 implies ( c8 ) .
it can be verified that the condition on @xmath170 $ ] is satisfied for the logistic , poisson and probit regression models . to achieve model selection consistency , we can choose @xmath178 and @xmath179    we now present the corresponding results for the case of sigmoid penalty . here , @xmath180 where @xmath181 $ ] is a slowly varying function .
the following conditions simplify ( c6)-(c9 ) .    1 .
parameter @xmath183 is a constant ( does not depend on @xmath84 ) and @xmath184 .
3 .   @xmath185(1+\rho)/\rho.\ ] ]    the following proposition shows that the results of theorem [ theo : lampasymp ] carry over to the penalized logistic regression when ( c6)(c8 ) are assumed .    for the penalized maximum likelihood estimator of logistic regression with the sigmoid penalty
, we have parameter estimation consistency , model selection consistency and strong asymptotic stability under conditions ( c6)-(c8 ) .
an important aspect of the penalized likelihood estimation method is the computational efficiency . for the lasso penalty ,
@xcite proposed the path - following lars algorithm . in @xcite ,
the coordinate - wise descent method was proposed .
it optimizes a target function with respect to a single parameter at a time , cycling through all parameters until convergence is reached . for non - convex penalties
, @xcite used the lqa approximation approach . in @xcite , a local linear approximation type method was proposed for maximizing the penalized likelihood for a broad class of penalty functions . in @xcite , the coordinate - wise descent method was implemented for non - convex penalties as well .
@xcite proposed a hybrid approach of newton - raphson and coordinate descent for calculating the approximate path for penalized likelihood estimators with both convex and non - convex penalties .
we apply quadratic approximation and use the coordinate decent algorithm similar to @xcite and @xcite . recall that our objective function is the negative penalized log - likelihood @xmath186 following @xcite , let @xmath187 and define the violation function @xmath188    we see that the objective function achieves its maximum value if and only if @xmath189 for all @xmath190 .
thus we use @xmath191 as the stop condition of our iteration , with @xmath192 being the chosen tolerance threshold .    in each step
, we use quadratic approximation to the log - likelihood function @xmath193 where @xmath194 and @xmath195 depend on the current value of @xmath92 .
the algorithm is summarized as follows .    * algorithm : * set values for @xmath196 .
denote by @xmath197 the @xmath198th column of @xmath199    * standardize @xmath200 * initialize @xmath201 .
calculate @xmath202 and go to s3 if @xmath203 or else go to s5 .
* choose @xmath204 .
calculate @xmath205 @xmath206 @xmath207 if @xmath208 let @xmath209 ; else @xmath210 . *
if @xmath211 else @xmath212 . calculate @xmath213 and go to s3 if @xmath203 , else go to s5 .
* do the transformation of the coefficients @xmath214 due to standardization .    for s2
, the initial solution @xmath215 can be taken as the zero solution or the mle or the estimate calculated using a parameter @xmath216 from the previous steps .    for s4
, we first carry out the iterations for the variables in the current active set until convergence , then check whether additional variables should join the active set .
alternatively , we may speed up the calculation by using  warm start " .
readers are referred to @xcite and @xcite for details of the strategies to speed up calculation in coordinate descent algorithms .
for example , the logistic regression with sigmoid penalty is , @xmath217 @xmath218 where @xmath219,$ ] for @xmath220 we define @xmath221 , and @xmath222 . in s3
, we have the following two different approximation methods for updating .
1 .   quadratic approximation from irls @xcite .
let @xmath223 @xmath224 @xmath225 @xmath226 and @xmath227 where @xmath228 .
2 .   quadratic approximation using taylor expansion .
let @xmath229 and @xmath230,$ ] where @xmath231 $ ] and @xmath232 is the component - wise product operator .
for an initial estimator @xmath215 , denote by @xmath233 a quadratic approximation of @xmath234 at @xmath215 , i.e. , @xmath235    let @xmath236 be a closed set and the objective function @xmath237 is strictly convex .
in addition , assume the quadratic approximation at @xmath215 satisfies @xmath238 for all @xmath239 .
then the algorithm constrained in @xmath240 ( minimization within @xmath240 ) converges to the true minimum @xmath241 .
in addition , method 1 for the logistic regression satisfies the conditions on quadratic approximation .
[ theo : algorithmconverge ]      an important issue is how to choose tuning parameters in the penalized likelihood estimation . for the lamp family , there are three tuning parameters , i.e. , @xmath33 , @xmath35 and @xmath34 .
our numerical experiences show that the resulting estimator is not sensitive to the choice of @xmath34 . in most cases , we may simply take @xmath70 or @xmath71 , depending on the type of regression ( see remark [ remark::alpha_1_choice ] ) . for @xmath33 and @xmath35
, we recommend using cross - validation or bic , so long as the solutions are stable enough . the @xmath242 package described in @xcite to determine a stable area or perform local diagnosis
is recommended .
there are two approaches to get a stable area : to control the smoothness of the @xmath33-estimate curve and calculate the smallest eigenvalue of the penalized likelihood at each point of the path as stated in theorem 1 . here , we take the second approach in all numerical analysis .
our algorithm differs from @xmath242 in the following two aspects : we use the  viol " function as the convergence criteria ; we do not use the adaptive - scale .
both algorithms 1 and 2 use the linear approximation ( suppose at @xmath243 ) of the penalty term .
@xmath244 for algorithm 1 , from concavity , we have @xmath245 which naturally falls into the mm - algorithm framework .
to choose the @xmath246 pair , we use the hybrid approach introduced by @xcite , i.e. , combining bic , cross - validation , and convexity diagnostics . for
a path of solutions with a given value of @xmath35 large enough , use aic / bic to select @xmath33 and use the convexity diagnostics to determine the locally convex regions of the solution path .
if the chosen solution lies outside the stable region , we lower @xmath35 to make the penalty more convex .
after this process is iterated multiple times , we can find a value of @xmath35 that produces a good balance between sparsity and convexity .
then we can fix @xmath35 and use bic or cross - validation to choose the best @xmath33 .
simulation studies cover logistic , poisson and probit cases .
the performance of the lamp family is compared with those of lasso , scad and mcp .
particular attention is given to the logistic regression to demonstrate how sparsity and stability are properly balanced .
two classification examples from microarray experiments involving cancer patients are presented .
we simulate from the logistic regression model with @xmath247 , @xmath248 , @xmath249 , @xmath250 , and @xmath251 , where @xmath252 with @xmath253 .
the number of replications is 100 for this and all the subsequent simulations .
table 1 reports true positive ( tp ) , false positve ( fp ) , proportion of correct fit ( cf ) , proportion of over fit ( of ) , proportion of under fit ( uf ) , @xmath254 ( l1 loss ) , and @xmath255 ( l2 loss ) . to compare performances among lasso , scad , mcp and the sigmoid penalty , we use @xmath256 to calculate the lasso solution path , @xmath242 to calculate the scad and mcp . for all penalties ,
we use ebic @xcite to choose the tuning parameter @xmath33 with other parameters fixed . the ebic parameter @xmath257 .    from table [ tab : logisticcv ] , it is clear that the sigmoid penalty outperforms scad and mcp in the sense that at a similar level of tp , the sigmoid penalty results in a smaller fp .
somewhat surprisingly the lasso has a competitive performance , which may be attributed to the use of the ebic selection criterion .    .
simulation results for model selection and estimation under different penalties .
entries are mean values with the standard error in parentheses . here  sig " represents the sigmoid penalty .
the number inside the parentheses following by the penalty name represents the concavity parameter .
[ tab : logisticcv ] [ cols="<,<,<,<,<,<,<,<",options="header " , ]
penalty based regularization methods have received much attention in recent years .
this paper proposes a family of penalty functions ( lamp ) that is adaptive and specific to the shapes of the log - likelihood functions .
the proposed lamp family is different from the well - known lasso , scad and mcp .
it can be argued that the new approach provides a good balance between sparsity and stability , two important aspects in model selection .
it is shown that the resulting penalized estimation achieves model selection consistency and strong asymptotic stability , in addition to the usual consistency and asymptotic normality .
an important issue is how to choose the three parameters imbedded in a lamp .
the `` location '' parameter @xmath34 can be chosen in an obvious way for the standard generalized linear models , while @xmath33 , which represents the penalty level , can be chosen through standard cv or information criteria . for @xmath35 , which controls the concavity level , it is computationally intensive to use cv .
it is desirable to develop more effective ways to select @xmath35 .
it is also important to study the stability of the solution path .
the lamp approach can be modified to handle grouped variable selection .
it will also be of interest to develop parallel results for semiparametric regression models .
we first state a general result about estimation consistency , model selection consistency and asymptotic normality .
consider the penalized log - likelihood function @xmath258 as defined by .
let @xmath259 be the true value of @xmath260 .
recall @xmath261 is the nonzero part of @xmath262 and @xmath263 . for notational simplicity ,
let    let @xmath264 , @xmath265 be i.i.d . with density @xmath266 that satisfies the following regularity conditions ( see @xcite ) :    1
.   @xmath267=0,$ ]
@xmath268=- \mathrm{e}_{{\boldsymbol{\theta}}}[\frac{\partial^2\log f({\boldsymbol{z } } , { \boldsymbol{\theta}})}{\partial\theta_j\partial\theta_k}],\]]where @xmath269 ; 2 .   @xmath270^{\bigotimes
2}<\infty;\ ] ] 3 .
there exist functions @xmath271 , a neighborhood @xmath272 of @xmath120 such that @xmath273 and @xmath274 for all @xmath275 , @xmath190 , @xmath157 and @xmath24 .
note that for the generalized linear models , ( c10)-(c12 ) are satisfied under mild assumptions on covariates .
@xmath276,1\leq j\leq q}|p'_{\lambda , j}(\beta)| ; \ ; p_{2,n}(\beta)\triangleq\inf_{q < j\leq p}p'_{\lambda , j}(\beta);\ ; p_{2,n}\triangleq p_{2,n}(0)\ ] ] @xmath277,1\leq j\leq q}|p''_{\lambda , j}(\beta)|;\ ] ] @xmath278,1\leq j\leq q}p''_{\lambda , j}(\beta);\ ; { \boldsymbol{\sigma}}_1= \mathrm{diag}\{p''_{\lambda,1}(|\beta_{10}|),\cdots , p''_{\lambda , q}(|\beta_{q0}|)\};\ ] ] @xmath279 let @xmath280 be the fisher information matrix at @xmath120 partitioned by the intercept , the nonzero and zero parts and @xmath281 for @xmath282 , define @xmath283 let @xmath284 be the @xmath173 norm of a matrix @xmath285 .
suppose that both @xmath286 and @xmath287 are strictly convex , satisfying ( c10)-(c12 ) , and that @xmath288 are continuous at 0 .
assume there exist @xmath289 such that @xmath290 , the k - th derivative of @xmath291 is continuous for @xmath292 $ ] and exists at the limit @xmath293 , @xmath294.\ ] ] @xmath295 for @xmath296 , @xmath297 then , we have the following results .    1 .
( parameter estimation consistency ) if either of the following two conditions , ( 1.a ) and ( 1.b ) , holds , then there exists a consistent local maximizer @xmath298 * @xmath299 as @xmath153 . *
@xmath300 and @xmath301 2 .
( model selection consistency ) if any of the following three conditions , ( 2.a)-(2.c ) , holds , then any consistent local maximizer is model selection consistent . * as @xmath302 , @xmath303 and for any @xmath304 , @xmath305 .
* there exists @xmath306 such that @xmath307 and @xmath308 ; @xmath309 ; and @xmath310 * for any @xmath311 , @xmath312 3 .
( asymptotic normality ) assume the estimator has the model selection consistency as stated in 2 .
if @xmath313 , we have the asymptotic normality for the nonzero part , @xmath314    [ lemma : oracle ]    lemma [ lemma : oracle ] covers commonly used penalties including lasso , scad , mcp , adaptive lasso , hard thresholding , bridge and the lamp family . note that the conditions are satisfied for scad , and are slightly weaker than those imposed in @xcite .
it is also easy to verify that condition ( 2.a ) is satisfied for scad and mcp , ( 2.b ) for lasso and ( 2.c ) for bridge .
suppose contrary to ( 2.a ) , @xmath315 and @xmath316 then , the resulting estimator @xmath317 does not have the model selection consistency .
for any @xmath318 we have @xmath319 , @xmath320 .
select @xmath321 define function @xmath322    throughout the proof , we use the following conventions : @xmath323 denotes a quantity approaching 0 as @xmath117 and @xmath324 simultaneously ; @xmath325 for approaching 0 as @xmath117 ; @xmath326 for approaching 0 as @xmath324 with @xmath84 fixed , and @xmath327 for a bounded sequence with @xmath328 if a subscript @xmath329 is used , then the convergence ( boundedness ) is in probability .
second , from condition ( c1 ) , the @xmath332 are convex . we will show that for any @xmath333 $ ] , @xmath334 , and @xmath320 , @xmath335 since @xmath336 is a local minimum of @xmath337 , there exists @xmath338 such that @xmath339 where the last inequality follows from the convexity of @xmath340 .
therefore , @xmath341 which , in view of condition ( c3 ) , implies for @xmath342 .
the case of @xmath343 can be proved similarly .
third , @xmath344 from the law of large number .
note that @xmath345\\\nonumber&+&[m_n({\mathcal{z}}_n,{\boldsymbol{u}}'_{2,n})-f_2({\boldsymbol{u}}'_{2,n } ) ] \\\nonumber     & - & [ \mathrm{e}m_n({\mathcal{z}}_n,{\boldsymbol{u}}_{1,n})- m_n({\mathcal{z}}_n,{\boldsymbol{u}}_{1,n})]\\\nonumber&-&[m_n({\mathcal{z}}_n,{\boldsymbol{u}}_{1,n } ) -f_1({\boldsymbol{u}}_{1,n})]\\\nonumber     & + & [ f_2({\boldsymbol{u}}'_{2,n})-f_1({\boldsymbol{u}}'_{2,n})]+[f_1({\boldsymbol{u}}'_{2,n})-f_1({\boldsymbol{u}}_{1,n})]\\\nonumber     & \geq&o_p(1,n)+o(1,\epsilon;n)o_p(1,n)= o_p(1,\epsilon , n).\nonumber\end{aligned}\ ] ] in other words , for any @xmath346 , @xmath347<-\delta)=0.\ ] ] similarly , @xmath348<-\delta)=0.\ ] ] combine these two together , we have , for any @xmath346 and @xmath349 $ ] , @xmath350<-\delta)=0.\ ] ] define @xmath351,\ ] ] and @xmath352 since @xmath98 is compact , there exists @xmath353 such that @xmath354 exists for any @xmath355 $ ] .
since @xmath356 is strictly convex , @xmath357 as @xmath358 and @xmath359 we thus conclude from ( [ eqn : lemma2delta ] ) that for any @xmath346 @xmath360 by the definition of @xmath354 , for @xmath361 , @xmath362 therefore , for any @xmath363 , @xmath364 since @xmath346 implies @xmath365 and @xmath366 implies @xmath367 , @xmath368 can be arbitrarily small .
thus , for any @xmath369 , @xmath370    from condition ( c2 ) and similar to the proof of lemma [ lemma::stability : weak ] , @xmath371}{{\boldsymbol{\theta}}_i\in{\boldsymbol{\theta}},i=1,2}}\large\{[r m_n({\mathcal{z}}_n+{\mathcal{e}}_n,{\boldsymbol{\theta}}_1)+(1-r ) m_n({\mathcal{z}}_n+{\mathcal{e}}_n,{\boldsymbol{\theta}}_2 ) \\     & - & m_n({\mathcal{z}}_n+{\mathcal{e}}_n , r{\boldsymbol{\theta}}_1+(1-r){\boldsymbol{\theta}}_2)]\\&- & [ r m_n({\mathcal{z}}_n,{\boldsymbol{\theta}}_1)+(1-r ) m_n({\mathcal{z}}_n,{\boldsymbol{\theta}}_2 ) \\
& - & m_n({\mathcal{z}}_n , r{\boldsymbol{\theta}}_1+(1-r){\boldsymbol{\theta}}_2)]\large\}\\     & = & o_p(1,n)o(1,\epsilon;n).\end{aligned}\ ] ] in view of this and condition ( c5 ) , there exists @xmath372 such that if @xmath373 then @xmath374    on the other hand , ( c4 ) and weak asymptotic stability imply @xmath375 @xmath376 thus , @xmath377 denote by @xmath378 and @xmath100 the minimizers of @xmath379 and @xmath93 over @xmath380 , respectively .
we have @xmath381 thus @xmath382 which , along with strict convexity of @xmath379 as in ( [ eqn : lemmastrongstability : strictconvex ] ) , implies @xmath383 combining and , we have @xmath384        since @xmath394 is a slowly - varing function , we have @xmath395 or @xmath396 .
thus , a sufficient condition will be @xmath397 . then taking @xmath398-th power on both slides , we have @xmath399^{1/u}\ll \lambda_0 $ ] , which can be guaranteed by the assumption @xmath400 .
part 1 ( parameter estimation consistency ) .
+ it suffices to show that for any @xmath318 there exists @xmath401 such that @xmath402>1-\epsilon.\ ] ] this is because , under ( [ eqn : para - consistency ] ) , there exists a local maximizer @xmath403 such that @xmath404 , where @xmath405 .
therefore , consistency holds as @xmath406 .
we now deal with the four terms on right - hand side of . from condition ( 1.a ) ,
the first term is of order @xmath411 and the second term is of order @xmath412 . by the cauchy inequality , @xmath413 since @xmath414
is fixed , it is also of the same or a smaller order compared to the second term . as @xmath415 , @xmath416 in the fourth term vanishes .
thus the fourth term is also controlled by the second term .
regarding the constant involving @xmath417 , the second term contains @xmath418 , while both the first and third terms contain @xmath419 .
consequently , the whole expression is controlled by its second term as long as we choose a sufficiently large @xmath420 , noting that @xmath421 is positive definite .      .
+ first of all , from any of condition ( 2.a ) , ( 2.b ) , and ( 2.c ) , we have for @xmath84 sufficiently large , @xmath422 .
assume we have an @xmath423-consistent local minimizer @xmath424 .
if the model selection consistency does not hold , then there exists a @xmath425 such that @xmath426
. this will result in contradiction if we can show that there exist @xmath427 and a neighborhood of @xmath428 , @xmath429 , within which the sign of @xmath430 does not change . since @xmath431 is a solution , the sign of left derivative should be different from the sign of right derivative at this value .
so the non - zero @xmath431 does not exist .
taking the taylor expansion , we get @xmath432 for @xmath433 we see that the third term on the right - hand side of does not depend on @xmath434 and is only related to the sign of @xmath138 , which remains constant in @xmath435 since @xmath436 .
so if the first two terms are controlled by the third one , we can derive the sparsity using the method above .
the coefficient of the sign function in the third term should be positive to control the direction of the derivative .
that is , @xmath437    under condition ( 2.a ) , the orders of the three terms in are @xmath438 @xmath439 where @xmath440 is the sequence given in condition ( 2.a ) .
condition ( 2.a ) guarantees that the first two terms are controlled by the third one .
likewise , condition ( 2.c ) leads to the same conclusion .      since @xmath443 , we have @xmath444 @xmath445 and , for any @xmath446 , @xmath447 the above results , together with @xmath448 imply that @xmath449\\\nonumber & = & \tilde{l}({\boldsymbol{\theta}}_0)+np_{1,n}^2\big[-\frac{1}{2}{\boldsymbol{v}}{\mathcal{r}}{\boldsymbol{v}}^t-\sum_{j=1}^q\mbox{sgn}(\beta_{j,0})\frac{p'_{\lambda , j}(|\beta_{j,0}|)}{p_{1,n } } v_j\\\nonumber & & -\sum_{j = q+1}^p\frac{p'_{\lambda , j}(0)}{p_{1,n}}|v_j|\big](1+o_p(1)).\nonumber\end{aligned}\ ] ]    as @xmath450 is an maximizer given by , there exists @xmath451 such that for any given @xmath318 there exists a constant @xmath306 such that @xmath452 from @xmath453(1+o_p(1)),\ ] ] we get @xmath454 thus we have @xmath455 now , we investigate the minimizer of @xmath456 .
let @xmath457 where @xmath458 is a @xmath459 vector .
we see @xmath460 in probability is a necessary condition for sparsity . from conclusions above , @xmath461\xrightarrow{~p~}0,\end{aligned}\ ] ]
where @xmath462 @xmath463 @xmath464 and @xmath465    kkt conditions lead to the following equations .
@xmath466 or @xmath467 where @xmath468 and @xmath469 therefore @xmath470 then @xmath471.\end{aligned}\ ] ] from ( [ eqn::conditionsparsity2 ] ) , @xmath472 .
so with @xmath473 a sufficient condition for sparsity is that @xmath474 is controlled by @xmath475 coordinatewisely .
that is , @xmath476 which is similar to the last equation of ( [ eq::proof - lemma-4:kkt ] ) and equivalent to @xmath477 , which is implied by @xmath478 .
furthermore , it can be guaranteed by @xmath479 from , it follows that the first two terms are controlled by the third one .
part 3 ( asymptotic normality and oracle property ) .
+ suppose @xmath480 is the local minimizer , noting that @xmath481 with probability tending to 1 .
using parameter estimation consistency and model selection consistency property , for @xmath482 @xmath483 .
\nonumber\end{aligned}\ ] ] thus @xmath484     \longrightarrow n\left[0,\left (                                                        \begin{array}{cc }                                                          { \mathcal{r}}_{00 } & { \mathcal{r}}_{01 } \\                                                          { \mathcal{r}}_{10 } & { \mathcal{r}}_{11 } \\                                                        \end{array }                                                      \right)\right].\end{aligned}\ ] ] if the order of @xmath485 is controlled by @xmath486 , the oracle property holds .
given @xmath311 , from @xmath501 we get @xmath502 from @xmath503 we get @xmath504 . together with the smoothness of the function @xmath18 , @xmath505 from condition ( c8 ) ,
it is obvious that @xmath506 condition ( 2.a ) and conditions for asymptotic normality in lemma [ lemma : oracle ] hold .
lastly , ( c5 ) is implied by ( c9 ) .    in conclusion , with ( c6)@xmath507(c9 ) ,
the penalized maximum likelihood estimator based on the lamp family is consistent and asymptotically normal , and achieves model selection consistency and strong asymptotic stability .
the idea of the proof is adapted from @xcite and @xcite . for convenience , we define the following notations .
@xmath508 where @xmath509 are the iteration times of @xmath510 respectively and @xmath511 . from the concavity of the penalty on the positive part
, we have @xmath512 where @xmath513 is a @xmath514-vector with the @xmath190-th element 1 and all the others 0 ; from conditions of the theorem , we see @xmath515 and @xmath516 in the algorithm , @xmath517 then @xmath518 since @xmath519 decreases as iteration continues and has an lower bound , it converges .    by monotonicity of @xmath520 (
@xmath521 represents the number of iterations ) , all points @xmath522 are in a compact set @xmath523 it is compact because @xmath524 is continuous and coercive .
then there exists a convergent subsequence @xmath525 , @xmath526 @xmath527 such that @xmath528 next let @xmath529 for any @xmath530 , we have : @xmath531 assume @xmath532 .
taking limit @xmath533 on both sides of the equation above , we have @xmath534 thus the subgradient of @xmath535 at @xmath536 is 0 , which is exactly the derivative of @xmath524 with respect to @xmath537 at @xmath538 because it can be easily verified that the smooth approximation keeps the first - order derivative the same .    from the algorithm and the definition of the `` viol '' function ,
@xmath539 taking the derivative of both sides of the equation above , the subgradient of @xmath540 at @xmath536 is 0 , which is exactly the same as the partial derivative of @xmath524 with respect to @xmath541 at @xmath542 from strict convexity , @xmath100 is the unique local minimum of @xmath524 .
akaike , h. ( 1973 ) .
information theory and an extension of the maximum likelihood principle .
_ in : _ b.n.petrov and f.csaki , eds .
_ second international symposium on information theory .
_ budapest : akademiai kiado , pp .
267 - 281 .
gordon , g. j. , jensen , r. v. , hsiao , l .- l . , gullans , s. r. , blumenstock , joshua e. , ramaswamy , sridhar , richards , william g. , sugarbaker , d. j. and bueno , r. ( 2002 ) .
translation of microarray data into clinically relevant cancer diagnostic tests using gene expression ratios in lung cancer and mesothelioma . _ cancer research _ , * 62 * 4963 - 4967 .
munk , a. , bissantz , n. , dumbgen , l. and stratmann , b. ( 2006 ) .
convergence analysis of generalized iteratively reweighted least squares algorithms on convex function spaces .
_ siam journal on optimization _ , * 19 * , 1828 - 1845 .
singh , d. , febbo , p. , ross , k. , jackson , d. , manola , j. , ladd , c. , tamayo , p. , renshaw , a. , damico , a. and richie , j. ( 2002 ) .
gene expression correlates of clinical prostate cancer behavior .
_ cancer cell _ * 1 * , 203 - 209 .