the biological and physical properties of proteins are compelling for many reasons .
while just a small amount of the nowadays hundreds of thousands known protein sequences are experimentally characterized , the variety of their functions is overwhelming .
though the structure has been resolved only for a subset of these sequences , the number of stable folds that are expressed in nature is seemingly small compared to the number of sequences .
the relationship between fold and function is far from obvious , and examples such as intrinsically unstructured proteins and multi - functional folds resist simple schemes for classification .
the question what really makes a protein functional hence needs to be addressed in the context of its specific biological environment .    from a physical point of view , an attempt to find some unifying concepts for the interpretation of dynamics and thermodynamics is the description of proteins in term of energy landscapes@xcite , in which the evolution of the system is related to the dynamics on a high - dimensional rugged energy surface .
the existence of local minima , connected by saddles of different barrier height and rank , leads to a distribution of timescales that are reflected in the dynamics of the proteins .
although the energy landscape provides a reduced description , the complex interactions in proteins and their interaction with the environment , which involve multi - body interactions and subtle effects of charges , make its complete characterization neither experimentally nor theoretically conceivable .
this situation is somewhat reminiscent of other complex systems such as glasses which , though being more homogeneous systems , share the property of displaying a high - dimensional landscape leading to complex dynamics .
the energy landscape picture is useful for a qualitative analysis of protein properties , but for quantitative studies , an exhaustive sampling and and the full characterization are practically infeasible for this high - dimensional representation .
therefore , in order to obtain comprehensive quantitative predictions on generic protein properties from the information on the landscape , the picture needs to be simplified .
a recent work@xcite has shown that a reduced description of the energy landscape , originally devised for the analysis of super - cooled liquids by stillinger and weber@xcite , can successfully capture the essential thermodynamic aspects of folding in the context of a simplified protein model .
in particular , it was shown that the density of states constructed from the local minima of the energy landscape , called inherent structures , can be used to compute the most important thermodynamic observables .
this finding is important because it provides a general scheme for theoretical studies of protein thermodynamics , showing how the relevant information can be quantitatively accessed from its imprint on the potential energy surface .
the approach has consequently been used in the context of studies of the folding properties of a @xmath0-barrel forming protein@xcite , the construction of the free energy landscape by mechanical unfolding@xcite , and the network of native contacts@xcite .
other earlier works including inherent structure analysis but not necessarily seeking to characterize the full thermodynamics of folding can be found in @xcite .
however the validity of an analysis based on the inherent structure landscape ( isl ) must be critically examined because the method involves a fundamental assumption which could be questioned : the vibrational free energy within the basin of attraction of an inherent structure is assumed to be independent of the basin . a recent study @xcite tried to go beyond this approximation by assuming that the vibrational free energy can depend on the energy of the inherent structures .
still , the question is subtle as we show in the present work that , even when the vibrational free energy depends on the inherent structure energy , the derivation of thermodynamic quantities such as the specific heat from the isl can be validly carried without any change in the procedure .
therefore an understanding of the limits of the isl approach requires a deeper analysis .
this is the aim of the present work .
we proceed in two steps . in a first step ( section [ section3 ] ) , after briefly summarizing the isl formalism and introducing the protein model used in section [ section2 ] , we test the validity of the isl approach by comparing its results to the data obtained from equilibrium molecular dynamics for a set of structures .
we selected four previously unstudied two - state folding proteins of varying size and secondary structure elements . in a second step ( section   [ section4 ] )
, we critically revisit the major hypotheses of the isl approach , as well as its practical limitations , such as the sampling of the phase space , and suggest routes for improvements .
finally , we summarize our findings in section [ section5 ] and give an outlook on possible future studies that stem from our results .
in this subsection , we briefly review the major results of @xcite on obtaining reduced thermodynamics from an analysis of the inherent structures .
the method is general and not bound to a specific protein model , provided the phase space of the protein can be explored by molecular dynamics , and that the energies of the visited states can be calculated . from simulations at fixed temperature close to the folding temperature @xmath1 , which insures that the system evolves in a large part of the configuration space , the local potential minima , labelled by @xmath2 ,
are determined by conjugate gradient minimizations performed at fixed frequency along a molecular dynamics trajectory .
the global minimum @xmath3 is defined as the reference ground state with zero energy .
let @xmath4 , denote the @xmath5 cartesian coordinates of the @xmath6-particle system , and @xmath7 its potential energy function .
the probability to find a particular minimum @xmath2 with potential energy @xmath8 can be written as @xmath9 where @xmath10 , @xmath11 denotes the configurational part of the partition function and @xmath12 is the basin of attraction of the minimum @xmath2 . with the definition@xmath13 the unknown integral over the complex landscape of the basin of attraction @xmath12
is summed in an free - energy like function @xmath14 which in principle depends both on the nature of the basin and temperature .
notice that although we use the index @xmath15 like  vibrational  , @xmath14 is obtained from the full nonlinear integral over @xmath12 , and not from its harmonic approximation .
+ the inherent structure landscape approach makes two key assumptions@xcite which enable to considerably reduce the amount of information needed on the landscape while keeping its most important features .    *
( a1 ) the function @xmath16 for two minima @xmath17 that are distinct but close in energy , @xmath18 , is the same for both minima : @xmath19 .
consequently , @xmath20 . *
( a2 ) the function @xmath21 does not vary significantly for different minima , i.e. @xmath22 .    both assumptions were discussed in @xcite . in section [ section4 ] , we show that assumption ( a2 ) can actually be relaxed to the less strong form @xmath23 while most calculations remain feasible and some of the thermodynamic variables unchanged . with these assumptions , the contribution from the function @xmath24 factorizes in the numerator and denominator of ( [ eq1 ] ) so that it can be eliminated to give @xmath25 where the sum in the partition function includes all inherent structures found from the global minimum @xmath3 to the minimum @xmath26 having the highest energy . here ,
the energy scale is shifted such that the energy of the global minimum @xmath3 is zero .
introducing an energy density function for the inherent structures @xmath27 , the probability to find a minimum in the interval @xmath28 $ ] at temperature @xmath29 is @xmath30 for the model used in this work , the low energy minima are in practice sparsely separated in energy . as the ground state
is isolated , one obtains @xmath31 with the probability of the ground state @xmath32 , so that the inherent structure density of states can be estimated from the probability to be in the basin of attraction of a minimum in a fixed temperature simulation at temperature @xmath33 as @xmath34 though above we have chosen a continuous notation to simplify the equations , it should be noted that the density built from an estimate of the probability density function of sampled minima for the present model in practice always comprises discrete and continuous parts which can be integrated separately .
once the inherent structure density of states is known , one can compute the inherent structure partition function @xmath35 from ( [ eq : piszis ] ) , from which all thermodynamics functions can be derived , including the free energy @xmath36 and the internal energy @xmath37 .
given that most states of the system can be sampled close to the folding temperature , it is sufficient to simulate the system at a single temperature @xmath33 to construct the inherent structure landscape , in contrast to the full thermodynamics where one needs to sample different ranges of temperatures
. therefore , the isl approach can be computationally very efficient . in the following
, we will restrict ourselves to the computation of specific heat @xmath38 being a quantity of fundamental importance in a physical system , as it is sensitive to fluctuations and , for instance , shows a clear signature of phase transitions .
it can be deduced from numerical derivatives of the partition function @xmath39 through @xmath40 and hence @xmath41      since our goal is to analyze the validity of the isl approach and not to derive quantitative data for a particular protein , we decided to choose a simplified model , which allows the sampling of phase space at a reasonable computational cost .
however the model must be rich enough to properly describe the complex features of its physics , and should be able to distinguish between proteins which differ , for instance , in their secondary structure .
we use frustrated off - lattice g - models identical to the ones introduced in @xcite because they provide a good compromise between all - atom simulations and simplified models that do not fully describe the geometry of a protein .
these models provide a representation with a single particle per residue centered at the location of each @xmath42-atom . for details on the model and the parameters
, we refer to @xcite and a brief review in the appendix [ ap1 ] .
although the validity of such models to provide a faithful representation of protein folding is a recurrent subject of debate , off - lattice g - models have been successfully used to study folding kinetics @xcite and the mechanical resistance of proteins @xcite . from a physical point of the view , despite a strong bias towards the ground state , these models have a complex energy landscape with a large number of local minima well suited for the analysis in terms of inherent structures . + as the results of the isl approach depend on the density of states of the inherent structures , for a reliable test of the method it is important to examine examples which could differ in their properties , i.e. to investigate proteins of different size and structure . to test the inherent structure approach beyond the previously employed immunoglobulin ( ig ) binding domain of protein g ( 2gb1 )
, we selected four two - state folding proteins of varying size and folds from the pdb database@xcite : the trp - cage mini - protein construct ( 1l2y , 20 residues , @xmath43-helical ) , the ww domain fpb28 ( 1e0l , 37 residues , @xmath0-sheets ) , the src - sh3 domain ( 1srl , 56 residues , @xmath0-sheets ) and ubiquitin ( 1ubq , 76 residues , @xmath44-fold ) .
the motivation for these choices is discussed in section [ section3 ] for each protein ( see insets of figures [ fig1]-[fig4 ] for structural representations of these four proteins drawn with pymol@xcite ) .
the positions of the @xmath45-atoms of the pdb files is chosen as a reference for the construction of the g - model . in the case of nmr resolved structures , the first structure is selected as the reference .
the native contacts of the model were established according to the distances between atoms belonging to different residues .
a native contact is formed if the shortest distance belonging to atoms of two different residues is smaller than @xmath46 .
the number of native contacts according to this criterion are : @xmath47 for the ww domain , @xmath48 for ubiquitin , @xmath49 for src - sh3 and @xmath50 for trp - cage .
this definition is simple and includes some arbitrariness .
there exist other methods for probing contacts between side - chains , e.g. by invoking the van der waals radii of residue atoms and solvent molecules@xcite .
though using the latter method preserves the main structure of the contact map , it leads to quantitative differences in the the number and location of contacts along the sequence .
consequently , one can expect that the topology of the energy surface and key thermodynamic properties such as the folding temperature are also altered when the definition of the contact map is varied .
for the purpose of the present study which does not attempt to give a quantitative description of side chain contacts , and focusses on global properties of the landscape rather than its detailed relation to the network of contacts , the cutoff - based approach is acceptable .
+ molecular dynamics simulations were performed using the brooks - brnger - karplus algorithm @xcite with a time - step of @xmath51 and a friction constant of @xmath52 ( all units in this section are dimensionless , see @xcite for details ) . to ensure equilibration ,
the system was thermalized starting from the native state ( pdb coordinates ) for @xmath53 .
the simulation time for a single temperature point and a single initial condition was @xmath54 , and the data obtained for both inherent structure sampling ( fixed temperature ) and thermodynamic sampling ( variable temperature ) were averaged over various initial sets of velocities .
minimization was performed using the conjugate gradient method with the polak - ribire algorithm . to estimate the vibrational free energy at the minimum
, mass weighted normal mode analysis was performed using lapack diagonalization routines .
the second - order derivatives of the potential energy function at the minimum were calculated by numerical differentiation of the analytical first - order derivatives .
in this section , the validity of the isl approach is tested by comparing the equilibrium thermodynamics deduced from molecular dynamics simulations to the reduced thermodynamics from inherent structure sampling . as discussed in section [ section2 ]
, we evaluate the specific heat @xmath55 as a function of temperature as a representative example of the thermodynamic observables .      .
the inset shows a close up on the low - energy range .
the size of the energy bins for the density estimate is @xmath56 . _
right : _ comparison of the specific heat from equilibrium trajectories @xmath57 ( points ) , from which the specific heat of a harmonic oscillator in @xmath5 dimensions has been subtracted , and @xmath58 from inherent structure analysis ( solid red line ) ; see text for further explanations.,title="fig:",width=249 ] .
the inset shows a close up on the low - energy range .
the size of the energy bins for the density estimate is @xmath56 . _
right : _ comparison of the specific heat from equilibrium trajectories @xmath57 ( points ) , from which the specific heat of a harmonic oscillator in @xmath5 dimensions has been subtracted , and @xmath58 from inherent structure analysis ( solid red line ) ; see text for further explanations.,title="fig:",width=347 ]    the src - sh3 domain was chosen since it has the same number of residues as ig binding domain of protein g studied in @xcite , but contrasts to the latter in terms of structure .
the src - sh3 domain is mostly composed of @xmath0-sheets and does not contain an @xmath43-helical - secondary structure element ( only five residues form a small right - handed helix segment ) . the inherent structure density of states , shown on the left - hand side of figure [ fig1 ] , was obtained from various simulations close to the folding temperature ( @xmath59 ) and built from @xmath60 minima according to ( [ ihs ] ) . after computing an energy histogram using @xmath61 bins to yield an estimate of the inherent structure probability density , energy bins with only a single count
have been discarded from the analysis to avoid a bias that could be introduced by insufficiently sampled isolated minima .
the right hand side of figure [ fig1 ] shows a comparison between the temperature dependence of the specific heat calculated from inherent structures , @xmath58 , and the temperature dependence of the specific heat calculated from equilibrium molecular dynamics simulations at variable temperature @xmath57 .
the equilibrium thermodynamics has been determined by averaging the results of 10 initial conditions per temperature step except for points close to the transition where the results of 20 initial conditions have been used . despite this averaging ,
the variance , indicated by error - bars on the y - axis , is large in the vicinity of the folding transition as the waiting time for a transition to occur becomes comparable to the simulation time . for a harmonic system , @xmath62 where @xmath63 is the number of degrees of freedom . at low temperatures @xmath64 ,
harmonic contributions are dominating , and the difference between @xmath57 and @xmath58 is approximately @xmath65 , which is subtracted from @xmath57 in figure [ fig1 ] .
figure [ fig1 ] shows that the isl approach is able to capture the main features of the thermodynamics of the g - model of the src - sh3 domain .
the value of the folding temperature is correctly determined by the isl approach , but @xmath38 underestimates the maximum by more than @xmath66 if the highest point of @xmath57 is selected as a reference .
this discrepancy at the maximum had previously also been observed for the inherent structure analysis of the ig binding domain of protein g @xcite . on the other hand , towards higher temperatures
, @xmath58 decays slower than @xmath67 .       for annotation.the size of the energy bins for the density estimate
is @xmath68 . , title="fig:",width=249 ]   for annotation.the size of the energy bins for the density estimate is @xmath68 .
, title="fig:",width=347 ]    ubiquitin , with its 76 amino - acids , is a protein with a fairly rich secondary structure since it contains a @xmath43 helix and 5 @xmath0 sheets .
similarly to the src - sh3 domain , the ubiquitin g - model presents a sharp folding transition associated with a large peak in the specific heat ( see right - hand side of figure [ fig2 ] ) .
the specific heat @xmath57 was estimated from averages on 8 initial conditions per temperature step , and @xmath69 was obtained using @xmath70 minima from several independent trajectories close to the folding temperature using a histogram of @xmath71 bins .
the agreement between the full thermodynamics and the isl approach is better than for src - sh3 , though similar trends of discrepancies can be observed .       for annotation .
the size of the energy bins for the density estimate is @xmath72.,title="fig:",width=241 ]   for annotation .
the size of the energy bins for the density estimate is @xmath72.,title="fig:",width=355 ]    to contrast with sharp two - state transitions of protein g ( 56 residues ) , src - sh3 ( 56 residues ) and ubiquitin ( 76 residues ) , we selected smaller structures , the ww domain ( 37 residues ) and the trp - cage ( 20 residues ) , to examine the performance of the inherent structure approach for less structured proteins , showing a broader transition . for such small protein domains ,
the validity of the g - model can be questioned as the model is built from the geometrical structure of the folded state . for small molecules the discrimination between folded and unfolded states becomes subtle due to fluctuations covering a large part of the accessible configurational space in a broad range of temperatures .
the point in selecting these structures is not to asses the validity of the g - model itself , but to test the isl approach in very stringent cases to highlight possible limitations .
the density of states @xmath69 was obtained from @xmath73 minima from several independent trajectories slightly above the folding transition ( see figure [ fig3 ] ) using a histogram of @xmath71 bins .
in contrast to the two previous cases , the histogram of minima does not show a clear separation of basins of local minima associated to the folded / unfolded state .
we observe a difference in the apparent shape of the density of states ( left - hand side of figure [ fig3 ] ) , which is globally concave in contrast to the convex densities obtained for src - sh3 and ubiquitin .
the same shape was also found for protein g in @xcite , for which the relation between the concave shape and the two - hump structure of @xmath74 was discussed in the vicinity of the folding temperature .
moreover , by comparing the insets of the left - hand side of figs .
[ fig1]-[fig3 ] , one observes that the low energy range of @xmath69 is more discrete , and states tend to lie less densely packed .
+ the temperature dependence of @xmath57 was obtained by averaging over 12 initial conditions .
an interesting feature of the curve is the shoulder in the low temperature range which indicates a partially unfolded structure associated to the breaking of a small number of contacts . comparing the results of @xmath57 and @xmath58 ,
it is apparent that though the specific heat reconstructed from inherent structure thermodynamics correctly captures the global shape of @xmath57 , including the existence of the shoulder , important deviations can be observed .
similarly to the cases analyzed above , @xmath58 underestimates @xmath67 at lower temperatures while giving an overestimation at high temperatures .
in contrast to the results for larger proteins , we also observe a significant shift of the transition temperature .       for annotation .
the size of the energy bins for the density estimate is @xmath75 .
, title="fig:",width=241 ]   for annotation .
the size of the energy bins for the density estimate is @xmath75 .
, title="fig:",width=355 ]    with only 20 residues , the last protein fragment studied in this series is also the smallest , and mainly consists of a single @xmath43-helix .
its inherent structure density of states @xmath69 was estimated from @xmath76 minima sampled from several independent trajectories close to the folding temperature using a histogram of @xmath71 bins .
for such a small system , the low lying energy states are largely separated from each other , and the resulting density of states presents large gaps in a relatively broad range of energies . the continuum representation assumed for the inherent structure landscape is certainly questionable in such a case .
the equilibrium thermodynamics were constructed from averages on 10 runs over different initial conditions .
it is interesting to notice that the value of the specific heat computed with reduced thermodynamics is still fairly close to the actual specific heat , although we notice again that the peak is underestimated and a high temperature tail is observed as in the previous cases .
in contrast to the results for the ww domain , the folding temperature of the trp - cage protein domain is correctly found by the analysis of inherent structures .
our studies of four proteins , combined with the earlier results on protein g @xcite , allow us to describe some trends in the inherent structure analysis of g - model proteins .
+ for the density of states given by ( [ ihs ] ) , a general exponential dependence , @xmath77 is observed for all proteins , with slightly different slopes for the low energy states , corresponding to states occupied in the folded configuration , and for the high energy states , occupied in the unfolded configuration .
the value of @xmath78 associated to the low energy range is a good estimate of the folding temperature , as previously reported for the case of protein g @xcite .
figure [ newfig ] ( left - hand panel ) , which compares the density of states of the inherent structures for the four proteins shows that , when being presented in reduced units as a function of @xmath79 , the functional form of these densities is highly similar . for the large proteins that we studied , src - sh3 and ubiquitin ( as well as protein g ) ,
the slope is slightly larger in the high energy range than in the low energy range .
the converse is true for the small protein domains ww and trp - cage .
a formal calculation of the reduced specific heat @xmath38 from a bi - exponential density of inherent structure energies shows that this property is related to the sharpness of the folding transition .
a density of states that is curved downwards for the energies associated to unfolded configurations leads to the broad folding transition expected for small protein domains .     including the data for the ig binding domain of protein g from @xcite ;
the color coding is : protein g ( black ) , src - sh3 ( green ) , ww domain ( red ) , ubiquitin ( blue ) , trp - cage ( magenta ) . _
right : _ deviation between the specific heat obtained from full thermodynamics and inherent structure analysis .
, title="fig:",width=294 ]   including the data for the ig binding domain of protein g from @xcite ; the color coding is : protein g ( black ) , src - sh3 ( green ) , ww domain ( red ) , ubiquitin ( blue ) , trp - cage ( magenta ) . _
right : _ deviation between the specific heat obtained from full thermodynamics and inherent structure analysis .
, title="fig:",width=302 ]    the calculation of the specific heat @xmath38 shows that the isl approach is able to determine the specific heat of a protein with reasonable accuracy , including the overall shape of the folding transition . to obtain such an agreement
the ground state probability @xmath80 must be sufficiently well sampled to ensure that the density of inherent states is correctly normalized .
however , our studies of several proteins shows that limitations exist since systematic deviations from the full thermodynamics are apparent . at low temperatures , and up to the transition temperature
, @xmath58 underestimates the specific heat .
the peak of @xmath58 is less pronounced than expected from the equilibrium trajectories , and tends to broaden towards higher temperatures ( @xmath81 ) where @xmath38 is larger than @xmath57 .
these deviation are shown in a comparative illustration in the right - hand side panel of figure [ newfig ] for the four proteins .
our data also reveals that the g model , with its strong bias towards the native state , does not yield qualitatively differences depending on the secondary structure of the protein under consideration .
+ owing to the results found for various proteins which show systematic deviations from the results of equilibrium thermodynamics , it is important to examine the assumptions made in approximating the inherent structure of states , which we do in the following section .
in section [ section2 ] we introduced the major assumptions ( a1 ) and ( a2 ) of the isl approach .
the derivation of thermodynamic quantities such as the specific heat is carried out as if the free energy contribution within a basin of attraction , defined by ( [ fdefine ] ) , did not depend on the particular inherent structure @xmath2 .
it is difficult to test this assumption as it would in principle require the determination of the complete basin on the energy landscape , including the calculation of all the saddle points that determine the frontier of the basin as well as the shape of the basin within this frontier .
still , one can at least compute @xmath82 _ in the harmonic approximation , _ as done also in @xcite .    assuming that the contribution to the integral ( [ fdefine ] ) can be approximated by local normal modes in the vicinity of the energy minimum
, the effective free energy can be written as @xmath83 where @xmath84 are the normal mode frequencies at the ground state @xmath85 .
this expression allows us to calculate a harmonic approximation to @xmath16 by calculating the normal modes for each minimum that we sample , and subsequently summing their different contributions according to ( [ harmapprox ] ) .
figure [ fig5 ] shows the @xmath86-dependent part @xmath87 as a function of the energy minimum for the two examples of src - sh3 domain ( left ) and ww domain ( right ) .
the minima were obtained along a single trajectory close to the folding temperature .
the distribution of the minima along the energy axis reflects the character of the probability distribution function for the two proteins , one being divided into two basins ( src - sh3 domain ) , the other being a single distribution ( ww domain ) .     of the vibrational free energy @xmath88 in the harmonic approximation , calculated from a sample of 1000 minima .
_ left : _ src - sh3 domain .
_ right : _ ww domain .
an arbitrary offset was added to shift the origin of the ordinate .
, title="fig:",width=302 ]   of the vibrational free energy @xmath88 in the harmonic approximation , calculated from a sample of 1000 minima .
_ left : _ src - sh3 domain .
_ right : _ ww domain .
an arbitrary offset was added to shift the origin of the ordinate .
, title="fig:",width=294 ]    as a first important observation , we note that the variation of @xmath87 with @xmath89 can not be assumed to be negligible as assumed in ( a2 ) , according to which @xmath90 should be approximately constant in @xmath89 .
both proteins show the same trend toward a decreasing effective free energy with increasing @xmath89 . for the src - sh3 domain
, a nonlinear dependence can be observed in the high energy range in agreement with previously reported results on protein g @xcite . +
a second point to be noticed is that , for a given @xmath89 , a distribution of values of @xmath91 can be found ( variance on the y - axis in figure [ fig5 ] ) .
while such a variance ( or fluctuation ) could be attributed to the limited numerical accuracy of the normal modes at high energies , this is also true for the low energy part for which the numerical scheme provides accurate results , as can be checked on the vanishing six lowest eigenmodes .
consequently , it appears that the first approximation ( a1 ) , i.e. @xmath92 does not hold as assumed , leaving the possibility that the observed deviations in section [ section3 ] could be caused by this simplification .
the results of the previous subsection seem to challenge the validity of the isl approach performed under the assumptions ( a1 ) and ( a2 ) . at a first glance
, the main problem seems to arise from the approximation ( a2 ) that @xmath93 does not depend on the particular basin considered , which is obviously untrue . on the other hand , although there is clearly a variance associated to @xmath94 for the same energy range @xmath89 in disagreement with approximation ( a1 ) , one can observe a general evolution of @xmath93 with @xmath89 , which suggests that approximating @xmath93 by @xmath95 may be acceptable .
however , we show below that , if the free energy within a basin can be written as a sum @xmath96 with @xmath97 at the ground state , the calculation of @xmath38 _ can be carried out without any change , _ so that approximation ( a2 ) appearing to be to particularly bad at a first glance may not be the decisive one .
it should be noticed that , as discussed in the previous section , the property ( [ separation ] ) is verified if the motion in each basin of attraction can be described by a combination of harmonic vibrations .
+ starting again from ( [ eq1 ] ) , and proceeding as in section [ ihstheory ] , we can eliminate the part of @xmath16 that depends on temperature only in the expression for the partition function and the probability distribution function , keeping only the @xmath43-dependent part .
one gets @xmath98 the principle of the calculation is to compute @xmath99 form a _ measurement _ of the probability density function @xmath100 estimated from md simulations at a given temperature @xmath33 .
this can be achieved through the intermediate calculation of a density of states of inherent structures @xmath69 , which is temperature independent and from which @xmath99 can be obtained at all temperatures . in equation ( [ newzis ] ) , we notice that the inclusion of the term @xmath101 is equivalent in definition an  effective  density of states @xmath102 from which the classical thermodynamic expression can be derived as shown below . in the calculation of section [ ihstheory ] , the density of states is given by equation ( [ eq : piszis ] ) .
this density @xmath103 and all other observable calculated in section [ ihstheory ] will henceforth denote with and index @xmath104 . in the new scheme including the @xmath43-dependent part of the free energy in the harmonic approximation , the probability density @xmath74 becomes @xmath105 yielding the inherent structure density @xmath106 the latter expression shows that if the variation of @xmath16 with @xmath89 can not be ignored , the previously derived density of states @xmath107 is not the correct one .
the two are related by @xmath108 a similar result was also reported in @xcite which considered the particular case of a piecewise linear dependence on @xmath89 . though the densities differ , substituting ( [ relatedens ] ) in equations ( [ newzis ] ) or ( [ eq : piszis ] ) , we immediately have @xmath109 , and the inherent structure observables such as @xmath110 and @xmath111 are unchanged , i.e. @xmath112 and @xmath113 even when @xmath114 . + as a consequence , using equation ( [ newz ] ) , the full free energy @xmath115 of the protein can be written as @xmath116 therefore , in the isl formalism , taking into account the variation of @xmath16 as in equation ( [ separation ] ) does not alter the free energy and can not be expected to be at the origin of the quantitative differences between @xmath55 derived from the isl formalism and the full numerical results presented in section [ section3 ] .
we conclude that the origin of these discrepancies is likely to be found in the non - separability between the @xmath43 and the @xmath29 dependency within the basins .
such an non - separability can be expected as soon as the anharmonicity of the different basins is taken into account .
this is certainly relevant for proteins , in particular as the denaturation involves frequent transitions between basins of different shape and volume associated to the semi - rigid folded and the highly flexible unfolded state .
+ when @xmath16 can not be separated into @xmath43- and @xmath29-dependent contributions to simplify the calculation of the partition function , the remaining possible approximation that can tackle the computational difficulty would be the saddle point approximation of the free energy @xcite .
this approximation is acceptable in the thermodynamic limit for large systems , but can not be justified in the present problem as the number of particles involved is still small and the interactions between particles are heterogeneous . while the harmonic approximation seems to be invalid for the present problem which involves large conformational changes due to the denaturation transition , results on super - cooled liquids @xcite indicate that the correction of the heterogeneity of the basins at low temperatures is small and the decoupling approximation of vibrational and inherent structure contributions appears to be possible at least in these temperature regimes .
the main practical difficulty of the isl method comes from the need to properly sample all the inherent structures in order to get a meaningful density of states @xmath69 in all energy ranges . in the present scheme of inherent structure sampling , a single temperature is selected to simulate the dynamics of the protein for a finite period of time .
the choice of a temperature close to the folding temperature is natural as the protein samples both the folded and the unfolded configurations at this temperature .
there are however two questions that have to be answered : _
i ) _ how long should we follow a protein md trajectory to get a sufficient sampling ? _
ii ) _ is it possible to combine data from simulations at a few different temperatures instead of keeping @xmath29 fixed ?
+ let us first analyze the effect of the sampling time .
it should be chosen long enough to cover the slowest intrinsic timescale of the system , and various trajectories with different initial conditions or realizations of the thermostat should be used to ensure that the order of events does not alter the shape of the distribution .
an estimate of the time range that sampling must cover is provided by the folding / unfolding time of the protein , to guarantee that the protein explores both configurational subspaces .
a possible check of the choice of the simulation time is to compute the specific heat with an increasing number of samples , and stop when the improvement brought by additional samples is negligible .
still , as computer time is limited , it can not be ensured that all relevant states are sufficiently well sampled to yield a converged probability density . in particular ,
the high energy minima are sampled only with low probability , such that the high energy cut - off in the density of states is likely to be underestimated in finite time sampling . in this section ,
we analyze the impact of this cutoff on a model density to see how the inherent structure specific heat is possibly affected .    to analyze the effect of the sampling independently of a particular case ,
let us assume a  model
 inherent structure density of states taken as a single exponential @xmath117 similar to the shape of the densities that can be found in limited ranges of energies for the numerical results in section [ section3 ] .
the partition function than can be readily calculated as @xmath118 likewise , we can calculate the first two moments @xmath119 and @xmath120 to find the specific heat as a function of the temperature , the parameter @xmath121 and cutoff in energy @xmath122 @xmath123 and analyze the result graphically as a function of the energy cutoff @xmath122 in figure [ fig6 ] .     as a function of temperature and the cutoff parameter @xmath122 .
_ right : _ location of the maxima of @xmath38 for different values of the cutoff @xmath122.,title="fig:",width=302 ]   as a function of temperature and the cutoff parameter @xmath122 .
_ right : _ location of the maxima of @xmath38 for different values of the cutoff @xmath122.,title="fig:",width=302 ]    as can be inferred from left - hand side of figure [ fig6 ] , @xmath124 $ ] increases with higher cut - off @xmath122 .
using symbolical computation @xcite , we can further inspect the result to find the local maxima of the the specific heat for fixed cutoff @xmath122 . on the right - hand side of figure [ fig6 ]
, we observe that a lower cutoff in the density of states shifts the maximum of the specific heat towards higher temperatures .
in addition to the shift , the curve becomes broader and the value at the maximum decreases .
this situation is similar to the physical scenario when protein folding is altered by confinement ( see e.g. @xcite ) .
the high energy states disappear from the density of states as the system is prohibited to explore these by external forces . for the present purpose of the inherent structure analysis , although derived for a highly idealized model density , the results indicate that insufficient sampling at high energies can significantly alter the global shape of the transition .
we have checked that these conclusions remain unchanged for a piecewise constant density of states .
for instance , for the ww domain , one finds @xmath125 which is higher than the range of values for which a shift of the maximum can be expected from figure [ fig6 ] .
consequently , the origin of this shift can not be attributed to inefficient sampling in the high energy range .
+ because the high energy minima are less frequently visited , it is tempting to try to sample the minima from a high temperature molecular dynamics trajectory . on the other hand , as the method relies on the probability to occupy the ground state which determines @xmath126 , it is also necessary to properly sample the ground state , i.e. to select a simulation temperature which is below @xmath1 . to reconcile these two exclusive conditions , one solution is to combine results sampled at two different temperatures to calculate @xmath69 , which should be temperature independent .
this is possible because , according to ( [ eq : pz ] ) @xmath127 with @xmath128 , so that the ratio of @xmath129 can be calculated from the probabilities to occupy a basin at temperatures @xmath130 and @xmath131 . a molecular dynamics trajectory obtained at a temperature @xmath132 can be used to determine @xmath133 from the probability to occupy the ground state , and subsequently a second simulation at a higher temperature @xmath131 can sample high energy basins more efficiently
. for all basins which are properly sampled in both molecular dynamics runs , the ratio @xmath129 can be evaluated with ( [ eq : zratio ] ) .
although it should not depend on the particular basin that was used for its calculation , this ratio actually fluctuates around a mean value which can be used to determine @xmath134 from @xmath135 .
then ( [ eq : pz ] ) , applied at the higher temperature @xmath131 , can be used to compute @xmath69 in the high energy range . moreover , in the intermediate energy range , the basins are properly sampled by the two trajectories at temperatures @xmath130 and @xmath131 , which gives two ways to evaluate @xmath69 for those basins , and thus provides a way to check the consistency of the method .
( @xmath136 minima , red ) and @xmath137 ( @xmath138 minima , blue ) _ left : _ probability of occupation of the inherent structures versus @xmath89 . _
right : _ density of inherent states energy ( in logarithmic scale ) , calculated from the simulation at @xmath130 ( red ) and calculated at @xmath131 using the ratio @xmath129.,title="fig:",width=294 ]    ( @xmath136 minima , red ) and @xmath137 ( @xmath138 minima , blue ) _ left : _ probability of occupation of the inherent structures versus @xmath89 .
_ right : _ density of inherent states energy ( in logarithmic scale ) , calculated from the simulation at @xmath130 ( red ) and calculated at @xmath131 using the ratio @xmath129.,title="fig:",width=266 ]    figure [ fig:2 t ] shows the results for the ww domain from different molecular dynamics simulations , simulated respectively at @xmath139 and @xmath140 .
for the simulations at @xmath131 , the ground state is not sampled in the finite interval of time of the simulations , but @xmath141 can nevertheless be obtained through the evaluation of @xmath142 deduced from @xmath143 for all values of @xmath89 for which the histograms of the left - hand side of figure [ fig:2 t ] overlap .
the right - hand side of figure [ fig:2 t ] shows that the values of the density of inherent state energies computed from data at @xmath130 and @xmath131 are in rather good agreement in the whole energy range where the basins are sampled at the two temperatures .
there is however a discrepancy between the two results , with a systematic deviation towards lower values of @xmath69 for high inherent state energies when the density of states is calculated with data sampled at high temperatures .
this is counterintuitive as one could tend to believe that sampling the basins at low temperatures would , on the contrary , underestimate the density of basins at high energy .
this systematic deviation , which has been observed in all our calculations could point out a limitation of the isl method as presently applied , i.e.  with a calculation which is only valid if @xmath144 is the sum of a term that depends on @xmath89 and a term that depends on temperature ( see ( [ separation ] )  ) . when the specific heat is calculated with the value of @xmath69 extended in the high energies range with this method ,
the function is still very close to the value obtained with only the data at temperature @xmath130 and the agreement with the numerical value of @xmath57 is not improved .
this shows that the discrepancy between the exact results and those deduced from the isl approach are not due to technical difficulties such as an insufficient sampling in some energy range , but that they are rather inherent to the method itself together with its assumptions .
we applied the inherent structure landscape ( isl ) approach to four different proteins of varying size and secondary structure elements using a coarse - grained off - lattice protein model , and calculated their inherent structure density of states . using these densities , we derived the specific heat from the reduced inherent structure thermodynamics , and compared it to the value obtained from equilibrium molecular dynamics as a function of temperature .
our results show that the isl approach can correctly capture the shape of the temperature dependence of the specific heat , including some characteristic features such as the hump observed at @xmath145 for the ww domain .
this is remarkable since the result is deduced from molecular dynamics simulations at a single temperature , close to @xmath1 , and nevertheless predicts the main features of the specific heat in a large temperature range , including low temperatures for which very long simulations would be necessary to reach exhaustive sampling of the phase space .
this shows that _ many features of protein thermodynamics are encoded in the inherent structure landscape .
_ still , the approach is not perfect as we observed quantitative differences between @xmath58 and @xmath57 which are particularly significant for small protein domains .
the deviations show a systematic trend , the specific heat being underestimated below @xmath1 and overestimated above .
this lead us to reexamine the approximations that enter the construction of the reduced thermodynamics from inherent structures for the model that we considered .
the first approximation assumes that the correction to the density of states due to the structure of the basin associated to a minimum @xmath146 depends on the energy level of the minimum only , and not of the individual minimum .
an evaluation of @xmath146 using a harmonic approximation based on local normal modes ( section [ nma ] ) shows that this is only approximately correct . for a given @xmath89 ,
the values of @xmath147 are actually distributed around an average value , with fluctuations that grow for higher values of @xmath89 and that appear to be larger for small proteins .
this could explain some of the discrepancies between the isl results and the equilibrium data .
moreover , the calculation of @xmath147 indicates that the second assumption that the correction can be considered to be @xmath43-independent is certainly not valid .
however , we showed that if @xmath148 splits into a temperature - dependent and an @xmath43-dependent part , which is the case in the harmonic approximation , most of the thermodynamic results deduced from a direct application of the isl approach are not affected .
this is true in particular for the the specific heat . in view of the persisting quantitative differences between reduced inherent structure and equilibrium thermodynamics ,
we therefore conclude that the correction of the free energy in term of a harmonic approximation is not sufficient .
it is likely that the nonlinear terms in the free energy associated to a basin can not be ignored , and play a significant role .
this is not surprising because , especially in the high temperature range , the protein fluctuates by exploring many basins , and consequently can not be assumed to be well described by a harmonic approximation .
+ in future studies , it would be useful to analyze the role of the structure of the full basin on the thermodynamic results beyond the approximation by local normal modes around the minima .
this is a true challenge owing to the complexity of the energy landscape . a starting point for
such a study might be the examination of the distribution of first rank saddle points associated to the different minima on the potential energy surface .
a second aspect which is suggested by the present work is to apply the isl approach for protein folding in the context of more complex energy landscapes that arise in more realistic potential energy functions .
the results on the small proteins analyzed in this study show that the global separation of the probability density into two basins associated to folded and unfolded states is not a necessary requirement to construct the reduced thermodynamics .
it appears therefore likely that the formalism remains useful in cases where the energy landscape is less biased towards the ground state than in the g - model .
an application of the isl method to other protein models therefore appears to be desirable and promising .    *
* acknowledgements :  * * we thank the anonymous referee for valuable suggestions .
j - g.h . acknowledges financial support from the collge doctoral franco - japonais and the rgion rhne - alpes .
the simulations were partially performed at the ple scientifique de modlisation numrique ( psmn ) in lyon .
in this work , we analyze the properties of an off - lattice g - type @xcite in which the smallest building unit is a single amino acid . effective interactions between amino acids
are based on the reference positions of the @xmath42-carbons of each residue .
these interactions are  color - blind  in the sense that they do not distinguish between the type of amino acids .
the potential energy of the system comprises five terms : @xmath149 +     \sum_{i > j-3}^{non - native } \epsilon    \left(\frac{c}{r_{ij}}\right)^{12}\nonumber\\     & & + \
\sum_{i=1}^{n-3}k_d      \left(1-cos\left(2\phi_i-\frac{\pi}{2}\right)\right ) \end{aligned}\ ] ] here , @xmath150 denotes the euclidean distance between residues @xmath151 .
the @xmath152 degrees of freedom of the system are most conveniently expressed via internal coordinates : @xmath153 euclidean bond distances @xmath154 along the backbone , @xmath155 bond angles formed between two consecutive bond directions , and @xmath156 dihedral angles measured between the normal vectors of planes spanned by atoms @xmath157 and @xmath158 ) .
bond distance and bond angle interactions are modelled through harmonic forces with coupling strengths @xmath159 and @xmath160 respectively . the zero indices indicate that the quantities ( angles , distances ) are evaluated in the reference state , i.e. , the position from the nmr / crystallographic structure .
the dihedral angle potential does not assume a minimum in the reference position defined by the experimentally resolved structure : it favors angles close to @xmath161 and @xmath162 irrespective of the secondary structure element ( helix , sheet , turn ) the amino acid belongs to .
while such values can be found in @xmath43-helices , they statistically do not appear largely in other secondary structure elements .
as a consequence , the reference state defined by an nmr or crystallographic structure can give rise to a competition between the helix for which the reference state is close to its minimum energy , and other parts which experience forces due to the angular constraint .
the constraint was introduced as a source of additional  frustration  affecting the dynamics and thermodynamics of the model towards a more realistic representation @xcite .
attractive non - bonded native interactions are modelled by steep ( 12,10)-lennard - jones potentials accounting for non - local contacts between residues due to side chains .
the database of contacts is established as described in section [ section2 ] .
in addition , non - native repulsive interactions are added to those residues which do not form a contact and which lie at least four residues apart .
the dimensionless parameters used in this study are @xcite : @xmath163 , @xmath164 , @xmath165 , @xmath166 , @xmath167 .
99 n. nakagawa and m. peyrard ; proc .
usa * 103 * , 5279 ( 2006 ) p.w .
fenimore , h. frauenfelder , b.h .
mcmahon and r.d .
young ; proc .
usa * 101 * , 14408 ( 2004 ) f.h .
stillinger and t.a .
weber ; phys .
a * 25 * , 978 ( 1982 ) j. kim and t. keyes ; j. phys .
b * 111 * , 2647 ( 2007 ) a. imparato , s. luccioli , a. torcini ; phys .
lett . * 99 * , 168101 ( 2007 ) d.m .
ming , m. anghel and m.e .
wall ; phys .
e * 77 * , 021902 ( 2008 ) z. guo and d. thirumalai ; j. mol .
263 * , 323 ( 1996 ) a. baumketner , j .- e . shea and y. hiwatari ; phys . rev .
e * 67 * , 011912 ( 2003 ) n. nakagawa and m. peyrard ; phys .
e * 74 * , 041916 ( 2006 ) j. karanicolas and c.l .
brooks iii ; proc .
usa * 100 * , 3954 ( 2003 ) d.k .
west , d.j .
brockwell , p.d . olmsted .
s.e . radford and e. paci ; biophys .
j. * 90 * , 287 ( 2006 ) http://www.rcsb.org w.l .
delano ( 2002 ) ; _ the pymol molecular graphics system .
_ ; http://www.pymol.sourceforge.org v. sobolev _
et al . _ ; bioinformatics * 15 * , 327 ( 1999 ) a. brnger , c.l .
brooks iii and m. karplus ; chem .
phys . lett . *
105 * , 495 ( 1984 ) n. nakagawa ; phys .
lett . * 98 * , 128104 ( 2007 ) mathematica 5.0 , wolfram inc .
n. rathore , t.a .
knotts , j.j .
de pablo ; biophys .
j. * 90 * , 1767 ( 2006 )


model predictive control ( mpc ) is a consolidated control technique that can efficiently handle constraints on the process to be controlled .
nevertheless , its application is not yet widespread in many domains where real - time computational constraints and requirements of certified solutions are of major concern , such as aerospace or automotive applications .
there is a growing interest in both industry and academia for exploring parallel solutions to mpc problems  ( @xcite ) , especially in light of the emerging many - core architectures , aiming to improve the computational efficiency of solving the underlying optimization problem .
* contribution*. in this paper , we explore the use of parallelization techniques to efficiently solve a typical mpc problem for a linear discrete - time system , with a substantial computational speedup compared to nonparallel implementations .
our proposed algorithm combines the use of alternating direction method of multipliers ( admms  @xcite , @xcite ) to handle the coupling constraints that arise from the dynamics of the system and inexact solvers ( i.e. , solvers that guarantee feasibility and optimality only _ asymptotically _ with the number of iterations ) , such as the nesterov s dual fast gradient ( dfg ) method  @xcite .
in particular , the first step of the proposed algorithm is to split the original mpc problem over the length @xmath0 of the prediction horizon into @xmath1 independent subproblems ( _ time - splitting _
@xcite ) solved by @xmath1 parallel _ workers _ periodically exchanging information at predetermined synchronization points . then
, the second step is to solve these subproblems in parallel using an inexact solver and guarantee , at the same time , that the solution of the original mpc problem is _ recursively feasible _ and the system is _ closed - loop stable_. the combination of parallelization and inexact solvers can result in infeasibility and closed - loop instability .
we rely on an algorithm based on constraint tightening to overcome these issues . loosely speaking ,
constraint - tightening algorithms solve an alternative problem in which the constraints have been tightened by a certain amount to compensate for the accuracy loss ( and possible related infeasibility ) introduced by the solver .
we rely on an _ adaptive _ tightening strategy to select an appropriate amount of tightening for our algorithm .
every time new measurements are available from the plant , our algorithm chooses the amount of tightening required for each subproblem in order to compensate for the error introduced by the time - splitting combined with the inexact solver .    *
related work*. the _ time - splitting _ technique has been proposed in  @xcite .
in contrast to  @xcite , we combine admm with inexact solvers and focus on the requirements for recursive feasibility and closed - loop stability of the original problem .
other constraint - tightening schemes have been proposed in the literature ( outside the parallel framework ) .
for example , the authors in  @xcite propose an algorithm in which the amount of tightening is chosen offline to guarantee suboptimality and feasibility of the solution for all the initial states of the mpc problem .
solutions based on adaptive constraint tightening have been recently proposed in @xcite , where the tightening parameter is chosen adaptively .
compared to  @xcite , our tightening update rule allows for a nonuniform amount of tightening ( the tightening varies along the prediction horizon ) .
furthermore , thanks to the modular structure of our approach , the optimizer solves simpler problems of fixed dimension , which is independent from @xmath0 . as a consequence ,
an increase of @xmath0 does not affect the conditioning of the problem and the convergence of the solver .
hence , our approach leads to a performance improvement even when forcing full serialization of the parallel operations ( i.e. , _ serialized _ mode  @xcite ) .    _ * outline*_. in the following , section  [ sec : problem_formulation ] presents the initial problem formulation .
section  [ sec : subproblem_reformulation ] introduces the auxiliary subproblems and our proposed solver .
section  [ sec : tightening_improvements ] describes our strategy to select the tightening of each subproblem to handle the parallelization error .
section  [ sec : closed_loop_certification ] proposes an online update strategy of the tightening parameters that guarantees recursive feasibility , suboptimality , and closed - loop stability .
section  [ sec : evaluation ] presents numerical results using an academic example .
finally , section  [ sec : conclusion ] concludes the paper . _ * notation*_. for @xmath2 , @xmath3 is the euclidean norm and @xmath4_+$ ] is the projection onto non - negative orthant @xmath5 . given a matrix @xmath6 , @xmath7_i$ ] denotes the @xmath8-th row of a and @xmath7_{i , j}$ ] the entry @xmath9 of a. furthermore , @xmath10 is the vector of ones in @xmath11 and @xmath12 the identity matrix in @xmath13 . in addition ,
@xmath14 and @xmath15 denote the largest and the smallest ( modulus ) eigenvalues of the matrix a , respectively .
@xmath16 denotes that @xmath17 is positive definite .
consider the discrete - time linear system described below : @xmath18 where @xmath19 denotes the state of the system and @xmath20 denotes the control input .
the sets @xmath21 and @xmath22 are simple proper convex sets ( i.e. , convex sets that contain the origin in their interior ) .
our goal is to steer @xmath23 to the origin and satisfy the plant constraints .
we use mpc to achieve these objectives . in this respect , consider the following finite - time optimal control problem :    [ eq : initial_problem ] @xmath24    where @xmath25 and @xmath26 are more compact notations for @xmath23 and @xmath27 , respectively . for @xmath28 (
@xmath0 denotes the prediction horizon ) , the states and the control inputs are constrained in the polyhedral set described by  , where @xmath29 , @xmath30 , @xmath31 .
note that can include constraints on the state only , i.e. , @xmath32 , and/or constraints on the control inputs only , i.e. , @xmath33 . in  , @xmath34 and @xmath35 .
our problem formulation considers also a terminal cost @xmath36 associated with a terminal polyhedral set @xmath37 .    through the remaining of the paper ,
we assume :    [ ass : stabilizability ] the pair @xmath38 is stabilizable .
[ ass : terminalset ] suppose assumption  [ ass : stabilizability ] holds .
given the gain @xmath39 obtained by the infinite - horizon linear quadratic regulator ( ih - lqr)characterized by the matrices @xmath6 , @xmath40 , @xmath41 , and @xmath42the following holds : @xmath43 in addition , the terminal penalty @xmath44 in the stage cost   is defined by the solution of the algebraic riccati equation associated with the ih - lqr .
in general , the mpc controller solves the optimization problem   every time new measurements are available from the plant and returns an optimal sequence of states and control inputs that minimizes the cost  .
let the optimal sequence be defined as follows : @xmath45 only the first element of @xmath46 is implemented in closed - loop , i.e. , the control law obtained using the mpc controller is given by : @xmath47 and the closed - loop system is described by @xmath48      we aim to solve problem   in parallel .
hence , we exploit a similar approach as the one proposed in  @xcite .
specifically , as in  @xcite , problem   is decomposed along the length of the prediction horizon @xmath0 into @xmath1 independent subproblems to be solved by @xmath1 _ parallel workers _ @xmath49 ( @xmath50 ) .
each @xmath49 is allowed to communicate with its neighbours @xmath51 and @xmath52 at predefined synchronization points .
the decomposition is possible thanks to the introduction of @xmath0 auxiliary variables @xmath53 used to break the dynamic coupling that arises from  .
these @xmath54 can be seen as the global variables of the algorithm . in particular ,
each @xmath54 stores the local predicted state @xmath55 of each subproblem and exchanges this stored information to guarantee consensus between neighboring subproblems , i.e. , to ensure that the predicted state of the @xmath56-th subproblem , namely @xmath57 , is equal to the current state of the @xmath58-st subproblem , namely @xmath59 . specifically , by introducing the _ consensus constraints _ @xmath60 , defining @xmath61^t$ ] , @xmath62 $ ] , @xmath63 $ ] , @xmath64 problem   becomes :    [ eq : consensus_problem ] @xmath65    where , defining @xmath66^t$ ] :    * @xmath67 , where @xmath68 . *
@xmath69 , @xmath70 , . *
@xmath71 , where @xmath72 .    furthermore , @xmath73 and @xmath74 vary for each subproblem as follows :    * @xmath75 $ ] and @xmath76 , @xmath77 .
* @xmath78 $ ] and @xmath79 .
note that we introduced a quadratic penalty in the cost of the form @xmath80 , according to the admm strategy  @xcite .
this penalty has no impact on the cost of the original problem  , if the consensus constraints are satisfied .    in the following ,
we introduce the subproblems that derive from problem  .
let @xmath81 ( @xmath28 ) and @xmath82 ( @xmath83 ) be the lagrange multipliers associated with the equality constraints   and  , respectively .
then , let the augmented lagrangian with respect to the multipliers @xmath81 and @xmath84 be defined as follows : @xmath85.\end{aligned}\ ] ] hence , we obtain the following @xmath1 independent subproblems , called _ original _ subproblems , associated with the @xmath1 workers @xmath49 ( @xmath50 ) : @xmath86      figure  [ fig : steps ] summarizes the main steps that lead to a suboptimal solution of the aforementioned problem and introduces the keywords used in the remaining of the paper .
consider the mpc problem   and refer to this problem as the _ original _ mpc problem .
the first step ( _ parallelization _ , detailed in section  [ subsec : parallelization ] ) is to rewrite the original problem in @xmath1 independent subproblems ( the _ original _ subproblems ) .
the aim is to use a dual fast gradient ( dfg ) method to solve these subproblems in order to certify  in terms of suboptimality and recursive primal feasibility , along with closed - loop stability  the mpc solution
. the use of the inexact solver will eventually cause a violation of the consensus constraints  - introduced to define the subproblems  .
hence , the second step ( _ relaxation equality constraints _ detailed in section  [ subsec : equality_relaxation ] ) is introduced to relax the consensus constraints by a quantity indicates that @xmath87 varies along the prediction horizon .
this also holds for the later - defined @xmath88 , @xmath89 , and @xmath90 . ]
@xmath87 , preventing the occurrence of consensus - constraint violations .
we refer to these subproblems as the _ equality relaxed _ ( er ) subproblems .
the set of inequality constraints of the er subproblems includes the inequality constraints of the original subproblems   and the inequality constraints due to the relaxation of the consensus constraints  - .
the third step ( _ definition tightening parameters _ detailed in sections  [ subsec : up_lagrange_multiplier ] ,  [ sec : tightening_improvements ] , and  [ sec : closed_loop_certification ] ) is required to address the following remaining issues .
first , the solution of each er subproblem computed by the dual fast gradient method might violate the inequality constraints , due to the termination of the solver after a finite number of iterations .
hence , the constraints of the er subproblems must be tightened by a quantity @xmath88 proportional to the desired level of suboptimality @xmath90 chosen by the algorithm .
second , due to the relaxation of the consensus constraints , the _ consolidated _ prediction , i.e. , the predicted evolution of the state computed ( a posteriori ) using the control sequence obtained by the independent subproblems , might deviate from the predicted _ local _ solution computed by the independent subproblems and , eventually , violate the inequality constraints of the original problem . hence , an additional tightening ( dependent on @xmath87 ) must be introduced on the subset of inequality constraints of the er subproblems that corresponds to the original inequality constraints .
the proposed algorithm addresses the aforementioned issues by exploiting the _ inequality tightened _ ( it ) subproblems .
the it subproblems differ from the er subproblems in the definition of the feasibility region , which is tightened by a quantity @xmath91 that depends on both @xmath88 and @xmath87 .
the last step ( _ set solver accuracy _ ) selects a suboptimality level @xmath90 for each subproblem , that guarantees a primal feasible and suboptimal solution for the original mpc problem within a fixed number of iterations .
in the following , we introduce the er subproblems and the proposed algorithm to solve them using @xmath1 parallel workers . furthermore , we introduce an initial formulation of the it subproblems and derive conditions on the choice of the relaxation and tightening parameters to guarantee primal feasible and suboptimal solutions for of each subproblem .
our goal is to obtain a solution for problem   by solving the independent subproblems   in parallel using inexact solvers , such as the nesterov s dfg  @xcite . in order to use our proposed solver ( introduced in section  [ sec : alg1 ] ) , which relies on first - order methods ,
we introduce a reformulation of problem   to take into account that the constraints   and   can not be satisfied at the equality due to the iterative nature of the proposed solver and its asymptotic convergence properties .
in particular , introducing the relaxation parameters @xmath92 , for each subproblem ( @xmath28 ) , the former equality constraints  - are replaced by the following inequality constraints :      or , in a more compact notation : @xmath94 where @xmath95 and @xmath96 .    in the remaining of the paper ,
we consider the following _ equality relaxed _
( er ) subproblems : @xmath97 hence , let @xmath98^t\in \mathbb r^{p_{\xi_t}}_+$ ] be the lagrange multiplier associated with the new set of inequality constraints defined by  , where @xmath99 , @xmath100 @xmath101 , @xmath102 , and @xmath103 are the multipliers associated with the constraints  ,  ,  ,  , and  , respectively .
then , to handle the complicated constraints  , define , for each subproblem , the dual function @xmath104 as follows : @xmath105 where @xmath106 .
we refer to as the _ inner subproblem_. hence , we aim to solve the following dual subproblems ( _ outer subproblem _ ) in parallel to obtain a solution for problem  : @xmath107    [ rem : modularity ] the size of the er subproblems remains unaffected if @xmath0 increases .
intuitively , this _
modularity _ is an additional feature that can be exploited to preserve some favorable numerical properties of the problem ( e.g. , conditioning , lipschitz constant , etc . )
even when the algorithm is running in serialized mode .
this section introduces algorithm  [ alg : alg1 ] that we use to solve the mpc problem   exploiting @xmath1 parallel workers @xmath49 .
note that , at this stage , we can not yet ensure that the computed solution is feasible and suboptimal for problem  .
algorithm  [ alg : alg1 ] relies on nesterov s dfg in which the inner problem is solved in an admm fashion , as explained below .
specifically ,  at each iteration of the algorithm_{1:n}=x_0 $ ] and @xmath108 to initialize algorithm  [ alg : alg1 ] . ]
, @xmath49 computes a minimizer @xmath109 for @xmath110 ( steps 1 - 4 ) , i.e. , the algorithm returns a solution for each inner subproblem  . in particular , our algorithm , in compliance with the admm strategy , first minimizes @xmath111 with respect to @xmath112 in parallel for each subproblem ( step 1 ) .
then , using the information received by @xmath52 , i.e. , the updated value of @xmath113 ( synchronization step 2 ) , our algorithm computes  in parallel for each subproblem  the value of the global variable @xmath54 according to the following rule ( step 3 ) : @xmath114 note that this strategy allows to handle the coupling introduced by the 2-norm in the cost function of  .
then , ( synchronization step 4 ) @xmath49 receives ( sends ) the updated value of @xmath115 ( @xmath116 ) from @xmath52 ( to @xmath117 ) , respectively .
finally , the worker  @xmath49 computes the new values of the multipliers @xmath118 ( steps 5 - 7 ) .
we compute offline ( for each subproblem ) the lipschitz constant @xmath119 associated with @xmath120 to perform the multipliers update :    * @xmath121 . * @xmath122 , ( @xmath70 ) .
* @xmath123 .
[ sec : alg1 ]     of algorithm  [ alg : alg1 ] . ]
note that our update rule is different from the one proposed in  @xcite , where admm is used in combination with nesterov s fast gradient methods . at each iteration
, the algorithm proposed in  @xcite , first computes the exact minimizer @xmath112 and then updates @xmath124 and @xmath84 . our algorithm does not wait until the dfg returns a minimizer @xmath112 to update the multipliers @xmath124 and @xmath84 , but starts updating their values along with the dfg iterations , encouraging the information exchange between neighboring subproblems .
this algorithm is also different from the one proposed in  @xcite . in particular , the workers exchange the necessary pieces of information before the update of the lagrange multipliers and none of the dual variables is exchanged between the neighboring workers .
furthermore , the information exchange between neighboring workers is unidirectional , i.e. , @xmath52 sends the updated information to @xmath49 , but @xmath49 does not send any updated information to @xmath52 .    using an argument similar to the one of theorem 1 in  @xcite , we can compute the primal feasibility violation and the level of suboptimality of the solution of each er subproblem returned by algorithm  [ alg : alg1 ] .
[ thm : thm1 ] ( @xcite ) let @xmath125 be strongly convex , the sequences ( @xmath126 , @xmath127 , @xmath128 ) be generated by algorithm  [ alg : alg1 ] , and @xmath129 .
then , an estimate on the primal feasibility violation for the er subproblem   is given by the following : @xmath130_+\|\le \frac{8r_{t}{\max\{l_{\mu_t}\}}}{(k+1)^2}=:\eta_t,\ ] ] where @xmath131 .
moreover , an estimate on primal suboptimality is given by the following : @xmath132    algorithm  [ alg : alg1 ] terminates after a fixed number of iterations that depends on @xmath90 and @xmath133  @xcite : @xmath134      in order to guarantee the primal feasibility of each subproblem using algorithm  [ alg : alg1 ] , we introduce @xmath1 auxiliary subproblems , namely the _ inequality tightened _ ( it ) subproblems , which differ from the er subproblems   in the definition of the feasible region .
in particular , each it subproblem can be defined as follows : @xmath135 where @xmath136 is the tightening parameter , which depends on the suboptimality level  @xmath90 that the proposed algorithm can reach within @xmath137 iterations  . according to  @xcite , solving   using algorithm  [ alg : alg1 ] ensures , with a proper choice of @xmath88 , that the solution of   is primal feasible and suboptimal for subproblem  .    to define an @xmath88 similar to the one introduced in  @xcite
, we must compute an upper bound for the optimal lagrange multiplier , namely @xmath138 , associated with the it subproblem  .
we use an argument similar to the one of lemma 1 in  @xcite .
in particular , we compute the aforementioned upper bound for @xmath138 according to the following lemma .    [
lem : lemma_up_bound ] assume that there exists a slater vector @xmath139 such that @xmath140 .
then , there exists @xmath141 , @xmath142 , @xmath143 , such that the upper bound for @xmath138 is given by @xmath144_j\}}},\ ] ] where @xmath145 [ 2\rho(\epsilon_{z_t}-\epsilon_t)\operatorname{\mathbf{1}}_{n}^t ] [ 2\rho(\epsilon_{z_{t+1}}-\epsilon_t)\operatorname{\mathbf{1}}_{n}^t]\big]^t\in \mathbb r^{p_t+2n}$ ] , and @xmath146 is the dual function for the original subproblem   evaluated at @xmath147
.    see appendix  [ app : lemma1 ] .
see appendix i in  @xcite .
lemma  [ lem : lemma_up_bound ] does not only provide an upper bound for @xmath148 , but it also provides guidelines to select the values of @xmath149 and @xmath150 as a function of @xmath151 , which only depends on the primal variable @xmath152 . an alternative way to determine the relaxation parameters is to include @xmath149 and @xmath150 in the set of decision variables and penalize them in the cost function as it is usually done to handle soft constraints .
this will , however , increase the number of decision variables in the problem formulation and it will have an impact on the original cost .
, the blue color refers to subproblem handled by worker  @xmath153 , etc . ) . ]
the previous section showed how to choose the tightening parameter @xmath88 of each it subproblem to ensure that the @xmath154-th _ local _ solution , i.e. , the solution computed by the @xmath154-th it subproblem  , is primal feasible for the @xmath154-th er subproblem .
this section provides guidelines to improve the choice of the tightening parameter of each it subproblem   in order to guarantee the primal feasibility of the _ consolidated _  solution , i.e. , the predictions obtained , starting from the initial state @xmath155 , using the control sequence @xmath156 where the elements of @xmath157 are computed by the independent it subproblems  .
in particular , when a new measurement is available from the plant , the subsystems   compute in parallel @xmath158 @xmath159,@xmath160 and @xmath161 , respectively . according to the results of the previous section ,
the pair @xmath162 is primal feasible for the @xmath154-th subproblem  , thanks to the introduction of the it subproblems .
nevertheless , due to the relaxation introduced on the equality constraints  - , there is a bounded mismatch between @xmath57 and @xmath59 ( @xmath28 ) .
hence , starting from the initial state @xmath155 , when the control sequence @xmath163 is applied to compute the consolidated state prediction   @xmath164 the feasibility of @xmath165 is no longer guaranteed .
note , however , that @xmath166 , i.e. , @xmath157 is feasible . hence , no additional tightening is needed on the input constraints .    in the following
, section  [ subsec : upbound ] defines an upper bound on the maximal feasibility violation of @xmath165 .
this feasibility violation is a consequence of the local relaxations of the equality constraints .
then , section  [ subsec : improve_tightening ] introduces sufficient conditions to ensure the primal feasibility of the _ consolidated _  prediction and provides guidelines for the choice of the tightening parameters for each it subproblem .
let @xmath168 and @xmath169 be defined by   and  , respectively .
moreover , from   and  , the following holds : @xmath170 our goal is to characterize how far the _ consolidated _  predicted state is from the _ local _  predicted state .
[ lem : upper_bound_global_prediction ] let the @xmath154-step - ahead _ consolidated _  prediction @xmath171 be defined by   and assume that   holds .
then , there exists @xmath172 , such that the mismatch between @xmath171 and the state of the @xmath154-th subproblem @xmath173 is bounded , as follows : @xmath174
. see appendix  ii in  @xcite .
[ rem : after_lemma_2_a ] according to lemma  [ lem : upper_bound_global_prediction ] a possible choice of @xmath175 is the following : @xmath176      according to lemma  [ lem : upper_bound_global_prediction ] , @xmath171 differs from @xmath173 by a quantity bounded by @xmath175 .
thus , @xmath171 might violate the constraints of the @xmath154-th subproblem   by as much as @xmath175 , in the worst - case scenario .
in particular , we must ensure that @xmath177 . using the computed upper
bound  , the following holds : @xmath178 where @xmath179 indicates the absolute value of @xmath180 . recall that these mismatches are caused by the use of inexact solvers and that @xmath175 depends on @xmath87 . in the following , we provide guidelines to improve the choice of @xmath88 for each subproblem .
furthermore , we provide a modified upper bound for the optimal lagrange multiplier associated with the tightened subproblems  , which considers the additional tightening introduced by @xmath175 .
[ lem : improve_epsilon_t ] consider the following it subproblems : @xmath181 for @xmath182 , where @xmath89@xmath183@xmath184  @xmath185^t$ ] .
consider the assumptions of lemma  [ lem : lemma_up_bound ] and the existence of @xmath175 for all @xmath83 according to lemma  [ lem : upper_bound_global_prediction ] .
then , for each subproblem , there exist @xmath141 , @xmath186 such that the upper bound for the optimal lagrange multiplier associated with the it subproblems   is described by @xmath187_j\}}},~{\ensuremath{t\!=\!0,\ldots , n}},\ ] ] @xmath188 [ 2\rho ( \epsilon_{z_{t}}-\epsilon_t)\mathbf{1}_n^t ] [ 2\rho(\epsilon_{z_{t+1}}-\epsilon_t)\mathbf{1}_n^t]\big]^t\in \mathbb r^{p_t+2n}$ ] .
see appendix  [ app : lemma3 ] .
see appendix  iii in  @xcite .
[ rem : after_lemma_3 ] the choice of @xmath88 ( @xmath182 ) is not unique and depends on the choice of @xmath87 ( @xmath83 ) .
for example , given @xmath175 in  , a possible choice of @xmath87 ( @xmath83 ) is : @xmath189_{j , i}|\big\}}}}\!\bigg\}. \label{eq : choice_epsilon_z}\end{aligned}\ ] ] consequently , the tightening parameters are given by : @xmath190 for @xmath182 .
this choice implies that first we select the relaxation parameters and then we _ adapt _ the tightening parameters on the original inequality constraints based on the choice of @xmath87 for all @xmath83 .
an alternative is to fix @xmath88 for the inequality constraints and consequently compute @xmath87 . in general
, the choice of the parameters strongly depends on the system - state matrix @xmath6 in  .
[ rem : offline_computation_parameters ] in the context of this work , algorithm  [ alg : alg2 ] , described in the next section , adapts the above derived parameters at each problem instance .
if we consider a fixed tightening scheme , such as the one proposed by  @xcite , @xmath191 and @xmath87 can be computed offline ( for all the initial states in the region of attraction ) .    in the following ,
we show that by using @xmath192@xmath193 is the control sequence obtained by solving the it subproblems   and @xmath194 is the corresponding consolidated prediction  the inequality constraints of the original mpc problem   are satisfied .
consequently , the predicted final state is in the terminal set of the original problem .
if the desired level of suboptimality of algorithm  [ alg : alg1 ] is chosen as : @xmath195 then , according to theorem  [ thm : thm1 ] , there exists @xmath196^t$ ] such that @xmath197_+\| \leq\eta_t<\epsilon_t$ ] . using similar arguments as in  @xcite
, the following holds for @xmath182 : @xmath198_+<\epsilon_t\operatorname{\mathbf{1}}_{p_t+4n}.\end{aligned}\ ] ] hence , for all @xmath199 , the following holds @xmath200_j\bigg]_+\leq \epsilon_t.\end{aligned}\ ] ] consequently , exploiting the upper bound  , for all @xmath199 , we have : @xmath201_j\leq \epsilon_t\end{aligned}\ ] ] which leads to @xmath202 , where @xmath203 is the @xmath154-step - ahead _ consolidated _  prediction computed using the solution to the it subproblem   with tighening parameter @xmath89 .    in summary
, this section showed that there exists a choice of the relaxation and tightening parameters that guarantee a feasible consolidated prediction with respect to the original problem  .
in the following , we derive bounds for @xmath204 , i.e. , the cost obtained using @xmath192 , with respect to the optimal cost @xmath205 of the original problem .
[ th : theorem2 ] assuming that there exist @xmath88 ( @xmath182 ) and @xmath87 ( @xmath83 ) selected according to lemma  [ lem : improve_epsilon_t ] , then the following holds : @xmath206 where @xmath207_{j , i}|\big\}}}\alpha_t$ ] .
see appendix  [ app : proof_theorem_2 ] .
see appendix iv in  @xcite .
theorem  [ th : theorem2 ] established the level of suboptimality of the consolidated prediction with respect to the original problem . in particular , the sequence @xmath208 is suboptimal for the original problem and satisfies the original inequality constraints ( including those associated with @xmath209 ) .
recall that for the update of @xmath210 , our algorithm requires a strictly feasible vector @xmath152 for  .
hence , every time new measurements are available from the plant , our algorithm must provide a strictly feasible solution ( not necessarily optimal ) for the first @xmath211 inequality constraints of each er subproblem .
the following lemma provides guidelines to compute @xmath152 .
[ lem : update_y ] let @xmath212 be defined as @xmath213=[(x_{0}^t~\bar u_{0,\gamma_0}^t)\ldots(\bar x_{n-1,\gamma_{n-1}}^t~\bar u_{n-1,\gamma_{n-1}}^t)~(\bar x_{n,\gamma_n}^t))]^t$ ] .
then , a feasible @xmath214 at the next problem instance , is given by : @xmath215}}((a+bk_f)\bar x_{n,\gamma_n})^t]^t \end{aligned}\ ] ]    see appendix  [ app : proof_lemma_update_y ] . see appendix v in  @xcite .
we want to show that the cost decreases at each problem instance . using a similar argument as in  @xcite , under assumption  [ ass : terminalset ] on @xmath216 and ensuring that @xmath217 ( thanks to a proper choice of the tightening parameters , as the previous section showed )
, we can show that : @xmath218 where @xmath219 is the region of attraction .
hence , from and , the following holds : @xmath220\!\!-\!\!{\ensuremath{\mathbf v}}_{0}(y_{0,\gamma_0})\end{aligned}\ ] ] where @xmath221 , using @xmath222 to represent the updated values of these parameters according to @xmath223 .
the inequality above shows that the total cost decreases at each problem instance if @xmath216 is defined according to assumption  [ ass : terminalset ] and if the @xmath0-step - ahead _ consolidated _  prediction lies in the terminal set .
asymptotic stability of our controller follows if @xmath224 .
hence , we can modify the update of @xmath88 and @xmath87 to ensure that   is satisfied .
[ rem : update_z ] a possible choice of @xmath87 @xmath225 to fulfill   is the following : @xmath226 @xmath227_{j , i}|\big\}}}\bigg)}\bigg]^{-1}.\notag\end{aligned}\ ] ] consequently , @xmath88 can be selected according to   to preserve the definition of the upper bound on the optimal lagrange multipliers given in lemma  [ lem : improve_epsilon_t ] .
algorithm  [ alg : alg2 ] summarizes the main steps needed to obtain a stabilizing control law when the original mpc problem is solved in parallel using inexact solvers . in particular , note that , if the measured state is in @xmath216 , from assumption  [ ass : terminalset ] , the state and the control constraints are automatically satisfied without solving the mpc problem in parallel .
steps 17 - 23 are the only nonparallel ones of the algorithm ( algorithm  [ alg : alg1 ] is instead fully parallelizable ) .
the main reason is in the adaptive nature of the algorithm ( see also remark  [ rem : offline_computation_parameters ] ) .
algorithm  [ alg : alg2 ] adapts @xmath88 and @xmath87 every time new measurements are available from the plant . a fully parallel algorithm  [ alg : alg2 ] is possible using a fixed tightening strategy , in which @xmath88 and @xmath87 can be computed offline .
we evaluated algorithm  [ alg : alg2 ] using the lti system described in  @xcite .
the system ( sampled at @xmath228 s ) is described by : @xmath229 where @xmath230 , @xmath231 , and the quadruple @xmath232 is given by : @xmath233 the weighting matrices @xmath41 , @xmath42 , and @xmath234 in the cost   and the ih - lqr gain @xmath235 are selected according to  @xcite .
we implemented our design in matlab ( to tune the controller and test the initial design ) and in c ( to run a performance analysis ) .
in particular , in matlab , we used the parallel computing toolbox  to assign the computation of algorithm  [ alg : alg1 ] to 8 parallel workers , given a prediction horizon @xmath236 .
furthermore , we relied on the mpt3 toolbox  @xcite to compute @xmath216 and the optimal solution of problem  .
finally , we compared our design to  @xcite .
we considered the following scenario .
the initial state of the system is @xmath237^t$ ] .
the total number of complicated constraints   for the original problem is 90 .
we used   and   to initialize @xmath87 and @xmath191 , respectively . to update them
, we relied on   and  .
the selected @xmath155 caused @xmath238 and @xmath239 to saturate ( 12 active constraints ) . in this scenario ,
the state enters @xmath216 in 3 steps .
figure  [ fig : upp_bound_alpha ] shows the mismatch between the _ local _  prediction and the _ consolidated _  prediction for one problem instance . as figure  [ fig : upp_bound_alpha ] depicts , the mismatch ( for both states ) is below the predicted upper bound @xmath175 for all the @xmath1 subproblems .
table  [ tab : iterations ] compares the proposed technique to  @xcite .
the table reports the upper bound @xmath240 on the number of iterations needed to achieve a suboptimal solution for problem   and the level of suboptimality @xmath241 .
the table lists only the first four subproblems , which are the most significant due to the presence of active constraints in these subproblems .
the method in  @xcite and our new proposed parallel algorithm produce a comparable behavior , thanks to an appropriate selection of the tightening parameters .
the parallel algorithm , however , is able to achieve similar results to those in  @xcite using a smaller number of iterations .
the larger values of @xmath240 for  @xcite are probably caused by the value of the lipschitz constant and by the problem conditioning , which affect the convergence requiring a higher accuracy for the solver .
in particular , in our proposed framework , the dfg is applied to simpler problems characterized , in the worst case scenario , by a lipschitz constant @xmath242 and by a condition number @xmath243 . in  @xcite
, the dfg solves a larger problem characterized by a lipschitz constant @xmath244 and by a condition number @xmath245 .
hence , the modularity of our approach has positive implications on important properties for the convergence of the solver .
table  [ tab : iterations ] lists the time required by the optimizer to return a suboptimal solution for problem  . to measure the performance , we implemented both algorithms in c on a linux - based os .
we noticed that given the small size of the problem , running algorithm  [ alg : alg1 ] in parallel did not result in significant speedups compared to our algorithm running in serialized mode  @xcite .
nevertheless , in both cases , we registered a speedup ( 230x ) compared to  @xcite .
the modularity of the proposed algorithm is beneficial even for problems of small size , such as the one considered in this section for the comparison with  @xcite .
we expect the benefits to be even more pronounced when considering problems of larger size .
.performance analysis of algorithm  [ alg : alg1 ] and  @xcite .
results show the median of 11 experiments .
[ cols="^ , < , < , < , < , < " , ]     [ tab : iterations ]
we proposed an algorithm tailored to mpc that guarantees recursive feasibility and closed - loop stability , when the solution of the mpc problem is computed using inexact solvers in a parallel framework .
in particular , our algorithm combines admm and dfg methods and relies on an adaptive constraint - tightening strategy to certify the mpc law .
our numerical analysis shows performance improvements compared to state - of - the - art nonparallel techniques  @xcite .
furthermore , our study shows that , for small - size problems , even if the solver is implemented in a serialized mode , there is substantial performance improvement with respect to the state of the art .
we expect further benefits from the parallelization when the size of the problem increases .
a scalability analysis of the proposed algorithm on many - core architectures is part of our ongoing work .
this section contains the proof of lemma  [ lem : lemma_up_bound ] presented in section  [ subsec : up_lagrange_multiplier ] .
assume that there exists a slater vector @xmath139 such that @xmath140 .
then , there exists @xmath246 , @xmath142 , @xmath143 , such that the upper bound on @xmath138 is given by @xmath247_j\}}},\ ] ] where @xmath248 and @xmath146 is the dual function for the original subproblem   evaluated at @xmath147 .
the following inequality holds : @xmath249 where the last inequality takes into account that @xmath250 .
define @xmath251 and @xmath252 . consequently , using the definition of @xmath253 and @xmath254 , the following holds : @xmath255^t\|.\ ] ] furthermore , recalling that @xmath256 , @xmath257 , and @xmath258 , the following holds : @xmath259^t\|\!\leq\![\lambda_{t,\epsilon_t}^{*t}~w_{t,\epsilon_t}^{*t}~v_{t+1,\epsilon_t}^{*t}]^t\!\!\operatorname{\mathbf{1}}_{p_t+2n}.\ ] ] hence , if we compute an upper bound for the vector @xmath260^t$ ] , we obtain an upper bound for @xmath148 .
thus , from the inequality  , it follows that : @xmath261 notice that choosing @xmath262 , @xmath263 , i.e. , according to the assumptions of the lemma , the elements of @xmath264 are all greater than zero .
thus , using   and  , it follows : @xmath265_j\}\|\mu_{t,\epsilon_t}^*\| \le\notag \\ \label{eq : lemma_1_proof } & \le \begin{bmatrix } \lambda_{t,\epsilon_t}^ { * } &   w_{t,\epsilon_t}^ { * } & v_{t+1,\epsilon_t}^{*}\end{bmatrix } \gamma_t.\end{aligned}\ ] ] consequently , the upper bound on the optimal lagrange multiplier is given by : @xmath266_j\}}.\end{aligned}\ ] ]
this section contains the proof of lemma  [ lem : upper_bound_global_prediction ] presented in section  [ subsec : upbound ] .
let the @xmath154-step - ahead _ consolidated _  prediction @xmath171 be defined by   and assume that   holds .
then , there exists @xmath172 , such that the mismatch between @xmath171 and the state of @xmath154-th subproblem @xmath173 is bounded , as follows : @xmath267    in the following , we omit the dependence from @xmath88 to simplify the notation .
the proof is constructive . for @xmath268 , @xmath269 . for @xmath270 , @xmath271 , which is the 1-step - ahead state computed by the local subproblem 0 , i.e. , the subproblem associated to worker @xmath272 .
hence , the mismatch between @xmath273 and @xmath274 is simply given by @xmath275 for @xmath276 , the following holds : @xmath277 @xmath278 which proves the lemma .
this section contains the proof of lemma  [ lem : improve_epsilon_t ] presented in section  [ sec : tightening_improvements ] .    consider the following it subproblems : @xmath279 for @xmath182 , where @xmath89@xmath183@xmath184  @xmath185^t$ ] .
given the assumptions of lemma  [ lem : lemma_up_bound ] and the existence of @xmath175 for all @xmath83 according to lemma  [ lem : upper_bound_global_prediction ] .
then , for each subproblem , there exist @xmath141 , @xmath186 such that the upper bound on the optimal lagrange multiplier associated with the it subproblems   is described by @xmath187_j\}}},~{\ensuremath{t\!=\!0,\ldots , n}},\ ] ] @xmath280    this lemma follows from lemma  [ lem : lemma_up_bound ] applied to the subproblems  . from inequality   formulated for subproblem  ,
the following must hold @xmath281 hence , in order to satisfy the inequality above , we can select the relaxation parameters @xmath87 and the tightening parameters @xmath88 according to the assumption of the lemma for @xmath182 , i.e. , the following must hold : @xmath282_{j , i}|\big\}}}\alpha_t+\epsilon_t\\ \text{\it ( ii)~ } & { \ensuremath{\max\limits_{j=1,\ldots , p_t}\!\!\!\big\{\sum_{i=1}^n|[c_{t}]_{j , i}|\big\}}}\alpha_t+\epsilon_t > 0\\ \text{\it ( iii)~}&\epsilon_{z_t},\epsilon_{z_{t+1}}\geq \epsilon_t\geq 0,\end{aligned}\ ] ] where @xmath152 is a strictly feasible solution for the original @xmath154-th subproblem . hence , there exists @xmath210 such that the upper bound on the optimal lagrange multiplier @xmath283 is defined as follows : @xmath284\}}}.\end{aligned}\ ] ]
this section contains the proof of theorem  [ th : theorem2 ] presented in section  [ sec : closed_loop_certification ] .    assuming that there exist @xmath88
( @xmath182 ) and @xmath87 ( @xmath83 ) selected according to lemma  [ lem : improve_epsilon_t ] , then the following holds : @xmath285 where @xmath207_{j , i}|\big\}}}\alpha_t$ ] .    due to the tightening of the original inequality constraints , @xmath286 , given that , as proved in section  [ subsec : improve_tightening ] ,
the feasible region of the tightened subproblems is inside the one of the original subproblems .
recall that the consolidated prediction satisfies the equality constraints   by construction .
hence , the following holds : @xmath287\gamma_t\right\rangle\big]\\ \leq & \mathcal v^ * + 2\sum\limits_{t=0}^n\mathcal r_t\sqrt{p_t}(\epsilon_t+\!\!\!{\ensuremath{\max\limits_{j=1,\ldots , p_t}\!\!\!\big\{\sum_{i=1}^n|[c_{t}]_{j , i}|\big\}}}\alpha_t).\end{aligned}\ ] ] where @xmath288\gamma_t$ ] selects the first @xmath211 components of the vector @xmath89 .
this section contains the proof of lemma  [ lem : update_y ] presented in section  [ sec : closed_loop_certification ] .
let @xmath212 be defined as @xmath213=[(x_{0}^t~\bar u_{0,\gamma_0}^t)\ldots(\bar x_{n-1,\gamma_{n-1}}^t~\bar u_{n-1,\gamma_{n-1}}^t)~(\bar x_{n,\gamma_n}^t))]^t$ ] .
then , @xmath214 at the next problem instance , is given by : @xmath289}}((a+bk_f)\bar x_{n,\gamma_n})^t]^t \end{aligned}\ ] ]    we can use a similar argument as the one of lemma 4.2 in  @xcite , recalling that @xmath290 for @xmath28 , @xmath291 for @xmath292 , @xmath293 for @xmath28 , @xmath294 for @xmath292 , and @xmath295 according to assumption  [ ass : terminalset ] .
99 s.  d.  cairano , m.  brand , and s.  a.   bortoff , `` projection - free parallel quadratic programming for linear model predictive control '' .
_ international journal of control _ , vol .
86 , no . 8 , pp . 13671385 , 2013 .
m.  k " ogel and r.  findeisen , `` parallel solution of model predictive control using the alternating direction multiplier method '' , proc . of the _ ifac conference on nmpc
1 , pp . 369374 , 2012 .
s.  boyd et al .
`` distributed optimization and statistical learning via the alternating direction method of multipliers '' . in  _ foundations and trends@xmath296 in machine learning _ , vol .
1 , pp . 1122 , 2011 .
m.  k " ogel and r.  findeisen , `` fast predictive control of linear , time - invariant systems using an algorithm based on the fast gradient method and augmented lagrange multipliers '' , proc . of the _ ieee cca _ , pp .  780785 , 2011 .
m. rubagotti , p. patrinos and a. bemporad , `` stabilizing linear model predictive control under inexact numerical optimization '' , in _ ieee trans . on automatic control _ ,
59 , no . 6 , pp . 16601666 , 2014 .
i.  necoara , l.  ferranti , and t.  keviczky , `` an adaptive tightening approach to linear model predictive control based on approximation algorithms for optimization '' , _ optimal control applications and methods _
, doi : 10.1002/oca.2121 , http://dx.doi.org/10.1002/oca.2121 , to appear in 2015 .
99 s.  d.  cairano , m.  brand , and s.  a.   bortoff , `` projection - free parallel quadratic programming for linear model predictive control '' . _ international journal of control _ , vol .
86 , no . 8 , pp . 13671385 , 2013 .
m.  k " ogel and r.  findeisen , `` parallel solution of model predictive control using the alternating direction multiplier method '' , proc . of the _ ifac conference on nmpc
1 , pp . 369374 , 2012 .
s.  boyd et al .
`` distributed optimization and statistical learning via the alternating direction method of multipliers '' . in  _ foundations and trends@xmath296 in machine learning _
1 , pp . 1122 , 2011 .      m.  k " ogel and r.  findeisen , `` fast predictive control of linear , time - invariant systems using an algorithm based on the fast gradient method and augmented lagrange multipliers '' , proc . of the _ ieee cca _ , pp .  780785 , 2011 .
m. rubagotti , p. patrinos and a. bemporad , `` stabilizing linear model predictive control under inexact numerical optimization '' , in _ ieee trans . on automatic control _ , vol .
59 , no . 6 , pp . 16601666 , 2014 .
i.  necoara , l.  ferranti , and t.  keviczky , `` an adaptive tightening approach to linear model predictive control based on approximation algorithms for optimization '' , in _ optimal control applications and methods _
, doi : 10.1002/oca.2121 , 2015 .