control refers to the ability to steer a dynamical system from an initial to a final state with a desired accuracy ; optimal control does so with minimum expenditure of effort and resources .
a famous example is the apollo space mission where optimal control was used to safely land the spacecraft on the moon .
the essence of this control task can be stripped down to a textbook example where students calculate the change in acceleration , that is , the rate of burning fuel , required to reach the moon s surface with zero velocity .
this example highlights the central role of optimal control in any type of engineering , its importance being rivaled only by feedback , a subject not covered in this review .    in _
quantum _ optimal control  @xcite , newton s equations governing the motion of the spacecraft are replaced by the quantum mechanical laws of motion , of course .
in contrast , the control , corresponding for example to a radio - frequency ( rf ) amplitude or the electric field of a laser , is assumed to be classical .
quantum optimal control represents one variant of quantum control  @xcite and is closely related to coherent control  @xcite .
the latter requires exploitation of quantum coherence , i.e. , matter wave interference .
in contrast , quantum control could also refer to inducing a desired dynamics , for example by amplitude modulations that avoid driving certain transitions , without matter wave interference .    despite of its prominence in mathematics and engineering  @xcite
, optimal control was introduced to nmr spectroscopy  @xcite and to the realm of matter wave dynamics  @xcite only in the 1980s . in the latter case , the idea was to calculate , via numerical optimization , laser fields that would steer a photoinduced chemical reaction in the desired way  @xcite .
it was triggered by the advent of femtosecond lasers and pulse shaping capabilities that opened up seemingly endless possibilities to create intricate laser pulse trains .
while a controlled breaking of chemical bonds was indeed demonstrated soon after  @xcite , the pulses were obtained by closed - loop optimizations in the experiments  @xcite rather than from theoretical calculations . in experimental closed - loop optimization ,
a shaped pulse is applied to the sample , and the outcome is measured .
based on the outcome , the pulse shape is modified , typically by a genetic algorithm . however , even for a chemical reaction as simple as breaking the bond in a diatomic alkali molecule , the calculated optimized laser field can not directly be used in the experiment  @xcite .
the reason for this is two - fold : the way how the optimized laser fields are obtained is rather different in theory and experiment .
whereas the field in calculations is shaped as a function of time  @xcite , experiments employ spectral shaping  @xcite . as a result ,
calculated pulses are often incompatible with experimental pulse shaping capabilities .
second , the theoretical modeling is simply not accurate enough .
this results in pulses which are optimal for the wrong dynamics and which can therefore not directly be applied in the experiments .
these obstacles are not present , or at least much less severe , in other fields of application  @xcite .
once the timescale of the relevant dynamics is nanoseconds or slower , pulse shaping in the experiment is also done in time domain  @xcite .
while device response might still be an issue  @xcite , the overall approaches in theory and experiment are similar in spirit .
moreover , hamiltonians and relaxation parameters may be known much more accurately than is currently the case in photoinduced chemical reactions .
a prominent example is nmr where the development of optimal control in theory and experiment went hand in hand , yielding beautiful results , for example on arbitrary excitation profiles  @xcite , or robust broadband excitation  @xcite .    given these observations , quantum information processing ( qip ) and related technologies
offer themselves as an obvious playground for quantum optimal control : in these applications , typically the quantum system to be controlled is well characterized , and timescales are sufficiently slow to use electronics for pulse shaping .
not surprisingly , quantum optimal control has attracted much interest in these fields over the last decade .
this included the adaptation of optimal control tools , for example to gate optimization  @xcite , creation of entanglement  @xcite , or measurement  @xcite .
gate optimizations were carried out for almost all qip platforms , notably comprising ions  @xcite , atoms  @xcite , nitrogen vacancy ( nv ) centers in diamond  @xcite , and superconducting qubits  @xcite .
other qip tasks , such as state preparation  @xcite , transport  @xcite , and storage  @xcite , have also been the subject of optimal control studies .
these tasks are not only relevant for quantum computing and communication but also for related applications that exploit coherence and entanglement , for example quantum sensing or quantum simulation .
protocols derived with optimal control have by now reached a maturity that allows them to be tested in experiments .
examples include the crossing of a phase transition studied with trapped , cold atoms  @xcite ; the improvement of the imaging capabilities of a single nv center  @xcite ; and the creation of spin entanglement  @xcite , quantum error correction  @xcite and matter wave interferometry  @xcite .
all of these examples share a generic feature that is typical for quantum engineering : control over the system , which inevitably also brings about noise , needs to be balanced with sufficient isolation of the desired quantum features .
this sets the theme for controlling open quantum systems .
traditionally , a quantum system is defined to be open when it interacts with its environment  @xcite .
this interaction results in loss of energy and phase information .
it can be modeled phenomenologically within the semigroup approach or microscopically , by embedding the system in a bath .
besides coupling to a bath , the dynamics of a quantum system becomes effectively dissipative also when the system is subject to measurements or noisy controls .
dissipative processes pose a challenge to quantum control . at the same time
, desired dissipation may act as an enabler for control .
we will review control strategies in both cases and then explain how optimal control theory can be used to adapt them to more complex quantum systems .
this topical review is organized as follows : section  [ sec : oqs ] briefly recalls the basic concepts in the theory of open quantum systems , introducing the distinction between markovian and non - markovian dynamics in sec .
[ subsec : marknonmark ] and addressing the issue of gauging success of control for open quantum systems in sec .
[ subsec : success ] .
the problem of analyzing controllability of open quantum systems , an important prerequisiste to synthesizing control fields , is introduced in sec .
[ subsec : controllability ] .
progress in the control of open quantum systems is reviewed in sections  [ subsec : strategies ] and  [ sec : oc - oqs ] with sec .
[ subsec : strategies ] dedicated to control strategies that were constructed with analytical methods and sec .  [ sec : oc - oqs ] covering numerical optimal control . in sec .
[ subsec : oct ] , the numerical methodology is explained in detail for a simple example , followed by a discussion of the modifications required to adapt it to more advanced control targets . the remainder of sec .
[ sec : oc - oqs ] reviews applications of numerical optimal control to open quantum systems , starting with examples for fighting or avoiding decoherence in sec .
[ subsec : fighting ] .
control strategies that rely on the presence of the environment are discussed in secs .
[ subsec : cooling ] and  [ subsec : exploiting ] .
section  [ sec : concl ] concludes .
the state of an open quantum system is described by the density operator @xmath0 which is an element of liouville space . any theory that aims at the control of an open quantum system
is faced with two basic prerequisites  the ability to calculate the system s dynamics , @xmath1 , and the ability to quantify success of control .
formally , the time evolution of any open quantum system can be described by a dynamical map , @xmath2 which is completely positive and trace preserving ( cptp )  @xcite
. the dynamical map is divisible if it can be written as the composition of two cptp maps @xmath3 @xmath4 .
if the dynamical map is divisible , the open system s time evolution is memoryless and called markovian .
various scenarios can lead to markovian dynamics , weak coupling between system and environment together with a decay of environmental correlations much faster than the timescales of the system dynamics being the most common case  @xcite . however , open systems often exhibit pronounced memory effects , in particular in condensed matter experiments , which reflect characteristic features of the environment .
the dynamics are then called non - markovian .
memory effects are caused by structured spectral densities , nonlocal correlations between environmental degrees of freedom and correlations in the initial system - environment state  @xcite . in the markovian case ,
the dynamics can be described by a master equation in lindblad form  @xcite . in general
, it needs to be solved numerically to determine @xmath5 .
this can be done with arbitrarily high precision  @xcite .
however , the computational effort may quickly become challenging due to the exponential scaling of the size of hilbert and liouville space .
to date , room for improvement seems to be limited  @xcite .
the situation is worse for non - markovian dynamics , where a unified framework such as the master equation in lindblad form does not exist .
a variety of methods has been developed  @xcite , each with different assumptions and hence a different range of applicability .
they include time - local non - markovian master equations  @xcite , stochastic unravellings  @xcite , and an auxiliary density matrix approach  @xcite .
a common feature of these methods is their ability to correctly describe thermalization of the system .
slightly different in philosophy are methods which attempt to solve the dynamics of both system and environment  @xcite .
key is to account only for that part of the environment that is relevant for the system s dynamics , i.e. , for the effective modes , which can be spins or harmonic oscillators .
the underlying idea is that of quantum simulation on a classical computer  @xcite , where the true environment is replaced by a surrogate one that generates the same dynamics .
if one is interested in short times , the number of modes in the surrogate hamiltonian can be truncated with a prespecified error  @xcite .
longer propagation times than those computationally affordable with exact dynamics of system and environment become possible by separating the environment into two baths , one that is responsible for the memory effects and that is modeled by effective modes as explained above , and a second one that by itself would lead to markovian dynamics only .
the secondary bath can be accounted for in terms of a markovian master equation in lindblad form  @xcite or via a stochastic unravelling using a single secondary bath mode  @xcite .
a more comprehensive overview over methods to tackle non - markovian dynamics is found in ref .
@xcite .    understanding the influence of memory effects
requires the ability to quantify them .
an obvious way to define a measure of non - markovianity is to quantify deviation from divisibility  @xcite .
interestingly , this corresponds to an increase of correlations if the system is bi- or multipartite  @xcite .
other measures to capture memory effects focus on specific features such as recoherence and information backflow . these can be characterized in terms of distinguishability between quantum states  @xcite , re - expansion of the volume of accessible states  @xcite , or the capacity to reliably transmit quantum information  @xcite .
a comprehensive overview over the different measures is found in ref .
@xcite , and an illustrative comparison for a toy model is presented in ref .
@xcite .
the proposed non - markovianity measures can be classified in a hierarchy by generalizing the notion of divisibility  @xcite . while this is gratifying from a theoretical perspective
, it is still an open question how non - markovianity can be measured in a condensed phase experiment .
although some of the measures have been evaluated in experiment  @xcite , dissipation in these examples was either engineered or artificial , in the sense that different degrees of freedom within one particle were considered to play the role of system and bath .
a true condensed phase setting is more challenging due to limited control and thus limited access to measurable quantities .
current interest in non - markovian dynamics is fueled by the revival of genuine quantum properties such as quantum coherence and correlations that non - markovianity entails .
it has sparked the hope to exploit non - markovianity as a resource .
quantum control in particular , which relies on properties such as coherence , should be more powerful in the non - markovian compared to the markovian regime .
when the goal is to control an open quantum system , the ability to gauge success of control is even more important than that to measure the degree of non - markovianity .
any suitable figure of merit needs to fulfill two conditions : ( i ) it should take its optimum value if and only if the control target is reached .
( ii ) it needs to be computable .
an obvious control target is to drive a given initial state to a desired target state .
the corresponding figure of merit is the projection onto the target state . for open quantum systems ,
this is given in terms of the hilbert schmidt product of the state of the system at the final time and the target state , @xmath6 this figure of merit has been used for example in control studies of cooling where the timescales of the dissipative process and the coherent system dynamics are comparable  @xcite .
typically , the target for cooling is a pure state .
sometimes the timescale of dissipation is much slower than that of the coherent dynamics .
this situation is encountered when using femtosecond lasers for laser cooling  @xcite . in order to avoid the very long propagation times for repeated cooling cycles consisting of coherent excitation and spontaneous emission as well as the expensive description in liouville space
, one can expand @xmath7 in a basis of hilbert space vectors and tailor the dynamics of the hilbert space vectors such that the target will be reached irrespective of the initial state  @xcite .
the construction of the proper figure of merit in that case will be discussed below in section  [ subsec : cooling ] .
an important control target in the context of quantum information processing is the implementation of unitary operations , or quantum gates .
this corresponds to simultaneous state - to - state transitions for all states in the logical basis  @xcite . a straightforward way to express this control target in liouville space
is given by  @xcite @xmath8 where @xmath9 denotes the desired target operation , defined on the logical subspace of dimension @xmath10 .
the set of @xmath11 forms a suitable orthonormal basis of the @xmath12-dimensional liouville ( sub)space or , more simply , all @xmath12 matrices for which one entry is equal to one and all other zero . the hilbert schmidt product in eq .
checks how well the actual evolution , @xmath13 , matches the desired one , @xmath14 .
the scaling of eq .   with system size
@xmath10 restricts its use to examples with very few qubits .
if the target is the implementation of a unitary operation , and not an arbitrary dynamical map , much less resources are required to gauge success of control .
this observation is at the basis of all current proposals to estimate the average gate fidelity  @xcite which forego the full knowledge of @xmath15 that is obtained in quantum process tomography in favor of efficiency .
one way to understand the reduction in effort is to start from eq .   and ask how many states are required in the sum to have a well - defined figure of merit , i.e. , a figure of merit that takes its optimum value if and only if the target operation is realized .
surprisingly , the answer to this question is three , independent of system size  @xcite : @xmath16 one state in eq .
measures the departure from unitarity or , more precisely , from unitality in the logical subspace , and two more states are necessary to distinguish any two unitaries  .
the latter requires two states because one needs to determine the basis in which the unitary is diagonal and then check whether the phases on the diagonal are identical . only two states are required because it is possible to construct one density operator that fixes the complete hilbert space basis , @xmath17 , using one - dimensional orthogonal projectors , @xmath18 , with non - degenerate eigenvalues , @xmath19 . a variant of eq .
is obtained by replacing the two states for the basis and phases by @xmath10 states @xmath20 .
this is still a reduction compared to the @xmath12 states in eq .   and was found to lead to faster convergence in control calculations than eq .
evaluation of both eq .
and its @xmath21 state variant are much more efficient than that of eq .
@xcite .
both eqs .   and   target implementation of a specific unitary @xmath9 .
for difficult control problems , where a numerical search can easily get stuck , it is desirable to formulate the control target in the most flexible way .
for example , instead of implementing a specific two - qubit gate such as cnot , it may be sufficient to realize a gate that is locally equivalent to cnot , i.e. , that differs from cnot by local operations .
the corresponding figure of merit is based on the so - called local invariants  @xcite .
similarly , one can formulate a figure of merit for targeting an arbitrary perfect entangler  @xcite .
since these figures of merit are based on the local invariants which in turn are calculated from the unitary evolution , extension to non - unitary dynamics requires to first determine the unitary part of the overall evolution .
this is possible , using the same mathematical concepts that have led to eq .
the theory of controlling open quantum system can be divided into two main questions  analysis of controllability and synthesis of controls ( called motion planning in the classical automatic control community ) : when the goal is to realize a certain desired dynamics , it is worthwhile to check first whether performance of the task is possible at all , before starting to search for controls that lead to the target
. section  [ subsec : controllability ] briefly reviews the current state of the art in controllability analysis of open quantum systems , whereas sec .
[ subsec : strategies ] summarizes strategies for control synthesis that are based on certain properties of the system s interaction with its environment , and optimal control theory as a tool for control synthesis will be presented in sec .
[ sec : oc - oqs ] .
controllability analysis provides the mathematical tools for answering the question whether the target is reachable  @xcite .
in particular , a complete framework exists for finite - dimensional systems undergoing unitary dynamics : separating the hamiltonian into drift and control terms , @xmath22 the system is controllable provided the lie algebra spanned by the nested commutators of @xmath23 and @xmath24 is full rank  @xcite .
the elements of the lie algrebra can be interpreted as tangential vectors , i.e. , as the directions , of the unitary evolution ( which is an element of a lie group ) .
if evolution into all directions can be generated , the system is controllable .
controllability can also be viewed in terms of connectivity between hilbert space basis states  @xcite ; it then corresponds to presence of the respective matrix elements .    for open quantum systems ,
the evolution is not unitary anymore , and analysis of the hamiltonian alone is not sufficient to decide controllability : the dissipative part of the evolution may prevent or enable certain states to be reached .
for example , even if the full rank condition for the lie algebra of the hamiltonian is fulfilled , fast decoherence will inhibit transitions between pure states by turning any pure state into a mixed one .
merely the presence of non - vanishing matrix elements in the hamiltonian is thus not sufficient to decide controllability .
their magnitude matters as well , in particular of those in the drift hamiltonian @xmath23 that can not be tuned by external controls @xmath25 . to date , rigorous controllability analysis does not take such a dependence on operator norms , or competing time scales into account .    as a result
, one needs to turn to numerical search for most open quantum systems , even for an example as simple as the central spin model  @xcite .
this is rather unsatisfactory since a numerical search can not provide rigorous answers to controllability , in particular lack thereof ( in the sense of reachability of the target with a predetermined error @xmath26 ) , due to its local character .
an extension of controllability analysis to the needs of open quantum systems would address this issue but remains an open problem to date .
it would be particularly relevant for open quantum systems with almost unitary dynamics , which are often encountered e.g. in quantum technology applications .    as an example where the dissipative part of the overall evolution enables certain states to be reached ,
consider cooling which turns mixed states into pure ones . obviously , controllability analysis based on the lie rank condition for the hamiltonian alone can not provide any information on time evolutions which change the purity of the system s state , @xmath27 $ ] .    by and large , controllability of open quantum systems still remains uncharted territory to date  @xcite .
this refers in particular to dynamic controllability where the analysis accounts for available dynamical resources such as coupling to external fields and environmental degrees of freedom , or measurements , in contrast to kinematic controllability .
the latter implies existence of a dynamical map that transforms any initial state into the target state .
while this existence can be proven for finite - dimensional systems  @xcite , it is of limited relevance for practical applications since , in general , one can not derive any dynamical information from the proof .    to tackle controllability of open quantum systems ,
two routes can be followed : either one starts from a complete description of the system and its environment , or one considers the reduced description of the system alone . in the first case , the tools of controllability analysis for unitary dynamics can be employed .
this way it was possible to show , for example , that even for completely controllable system - environment dynamics , cooling is possible only if the environment contains a sufficiently large virtual subsystem which is in a state with the desired purity  @xcite .
while exact solution of the combined system - environment dynamics is extremely challenging ( and impossible in many cases ) , controllability analysis from this perspective is expected to significantly advance our understanding already for simple models and for generic questions , as in the example of ref .
moreover , it appears to be promising for two reasons  it does not rely on _ a priori _ assumptions on the reduced dynamics , and most likely it will benefit from recent progress in the controllability of infinite - dimensional systems  @xcite .
rigorous controllability analyses for reduced dynamics have been limited to date to the markovian case  @xcite . in particular , the sets of reachable states
were characterized  @xcite , and the lindblad operators were shown to form a lie wedge  @xcite . while the lie wedge provides a sufficient , but
not necessary condition for controllability , necessary but not sufficient criteria can be identified by considering isotropy of the generator of the dissipative motion  @xcite .
numerically , non - markovian dynamics were shown to lead to @xmath28 controllability ( in the sense of reachability of the target with a predetermined error @xmath26 ) for a system whose hamiltonian allows for realization of @xmath29 operations only  @xcite .
however , no rigorous analysis of controllability for non - markovian dynamics has been performed to date ; and it is not yet clear whether and under which conditions non - markovian effects can improve controllability of an open quantum system .
control strategies that are obtained by analytical methods can be roughly divided into two classes  those that exploit symmetries in the system - bath interaction and those that make assumptions on the timescale of this interaction . in the first case ,
protection from decoherence is achieved by keeping the system s state in a so - called decoherence - free subspace  @xcite : if the system - bath interaction contains a symmetry , for example qubits couple indistinguishably to their environment , it is possible to construct a set of system states that are invariant under the system - bath interaction .
these states form a decoherence - free subspace in the system s total hilbert space  @xcite .
stimulated raman adiabatic passage ( stirap ) and electromagnetically induced transparency represent examples for decoherence - free subspaces  @xcite . in
the context of quantum information , two or more physical qubits , carried for example by atoms , can be used to encode one logical qubit that is decoherence - free  @xcite .
decoherence - free subspaces have been demonstrated , for example , in liquid - state nuclear magnetic resonance  @xcite and with trapped ions  @xcite .
numerical methods can be employed to identify ( approximate ) decoherence - free subspaces  @xcite and to find an external control that drives the system dynamics into a decoherence - free subspace  @xcite .
more generally , in physics the presence of a symmetry implies existence of a conserved quantity . in the context of decoherence , a symmetry in the system - bath interaction leads to a quantum number which is preserved under this interaction .
the eigenstates belonging to the preserved quantum number define a noiseless subsystem , i.e. , a logical subsystem that is intrinsically protected from noise  @xcite .
the main limitation of this set of approaches is imposed by the existence of a suitable symmetry which is not necessarily available .    in the second case of control strategies that are built on assumptions on the timescale of the system - bath interaction , a trivial strategy
is obtained for slow decoherence : one simply needs to perform the desired operation on a time scale much faster than that of decoherence . but this may not always be possible , and slow decoherence also allows for eliminating the effects of decoherence based on average hamiltonian theory  @xcite or , in more intuitive terms , spin echo techniques from nuclear magnetic resonance and generalizations thereof .
this set of strategies is often referred to as dynamical decoupling  @xcite .
it relies on many quasi - instantaneous actions of control fields that do not allow the system to interact with its environment , creating an effective dynamics of the system alone .
extensive work over the last two decades has allowed to account for e.g. pulse imperfections  @xcite and extend the technique beyond spin dynamics for which it was originally developed , for example to ions  @xcite , and superconducting circuits  @xcite .
the main limitation of the dynamical decoupling approach is the finite duration of any control field which can not always be made sufficiently short . by
now dynamical decoupling has grown into a field of its own which has been covered by several reviews  @xcite , and the reader is referred to these for a more in - depth analysis .
the time - dependent perspective used in dynamical decoupling can be translated into a frequency - space picture using the generalized transfer filter function approach  @xcite .
this allows to efficiently predict fidelities , at least for weak noise  @xcite , and provides a connection to control strategies that decouple the system from its environment by engineering a spectral separation  @xcite .
in particular , it was shown that the system - bath interaction can be cancelled , at least to second order , by choosing the time - dependence of the control field such that its spectrum becomes orthogonal to the bath or noise spectrum  @xcite .
such an approach requires weak coupling and negligible initial system - bath correlations .
moreover , the bath spectrum needs to be known .
another example of engineering a spectral separation is given by the protection of so - called edge states in topological insulators via band liouvillians  @xcite .
in addition to clarifying the relation between time - domain based and frequency - domain based control strategies , the transfer filter function perspective also provides a practical tool for characterizing the noise spectral density  @xcite .
its applicability to a variety of physical platforms has already been demonstrated  @xcite .
noise spectroscopy provides an excellent starting point for deriving microscopic models for the system - environment interaction and thus a more thorough understanding of noise at the quantum mechanical level .
it also allows for tailoring control synthesis to specific spectral features of the noise , either , if possible , by using the transfer filter function approach directly  @xcite , or by exploiting knowledge of these features using optimal control theory , in sec .
[ sec : oc - oqs ] below .
quantum optimal control theory refers to a set of methods that synthesize external control fields from knowledge of the control target , including constraints , and the time evolution of the quantum system  @xcite .
it is based on the calculus of variations , i.e. , on formulating the control target as a functional of external controls that realize the desired dynamics .
knowledge of the system s time evolution enters implicitly via evaluation of the target functional and , possibly , its derivatives .    for a few exceptional cases , for example one or two spins ( or qubits )
@xcite , a harmonic oscillator  @xcite , or a sequence of @xmath30-systems subject to decay  @xcite , the external controls can be determined using geometric techniques based on pontryagin s maximum principle  @xcite . typically , however , the control problem can not be solved in closed form , and one needs to resort to numerical optimization .    most often , controlling open quantum systems is a difficult control task such that efficiency of the optimization algorithm is important .
therefore , mainly algorithms based on the target functional s gradient have been employed for open quantum systems to date .
they will be reviewed in sec .
[ subsec : oct ] .
the remainder of this section is dedicated to control strategies that were developed using numerical optimization , starting with strategies avoiding decoherence in sec .
[ subsec : fighting ] , followed by strategies exploiting presence of the environment in sec .
[ subsec : cooling ] and  [ subsec : exploiting ] .
conceptually the simplest control problem is represented by state - to - state transfer : given a known initial state , @xmath31 , at time @xmath32 , find the external field that drives this state at final time @xmath33 into the target state , @xmath34 , with prespecified error , @xmath26 .
the corresponding target functional is found in eq .   where dependence on the set of external controls @xmath35 is implicit in the time evolution , @xmath36 $ ] .
this control problem was first stated in the context of laser cooling molecular vibrations  @xcite .
the time evolution was modeled by a markovian master equation in lindblad form , and later extended to a non - markovian example  @xcite . for the sake of conceptual clarity , we present here the algorithm for a markovian master equation , @xmath37,{\boldsymbol{\mathsf{\hat{\rho}}}}\right ]    + \mathcal{l}_d({\boldsymbol{\mathsf{\hat{\rho}}}})\,,\ ] ] with the hamiltonian of the form  . for simplicity , we assume a single control @xmath38 in eq .  . in the example of laser cooling molecular vibrations , @xmath39 would be the electric field of a short laser pulse , and @xmath40 in eq .
the transition dipole moment of the molecule .
the dissipative part of eq .   is given by  @xcite @xmath41 where the lindblad operators @xmath42 model the various dissipative channels .
for example , @xmath43 for spontaneous decay from a level @xmath44 to the ground state with rate @xmath45 , inversely proportional to the level s lifetime .
optimization algorithms are obtained by seeking an extremum of @xmath46 , cf .
eq .  , with respect to the control , @xmath39
. this can be done by direct evaluation of the extremum condition  @xcite or by building in monotonic convergence _ a priori _ using krotov s method  @xcite .
the resulting set of coupled equations are , surprisingly , rather similar .
the main difference is in the update of the control which can be performed concurrently  @xcite , i.e. , for all times @xmath47 at once , or sequentially in time  @xcite .
guaranteed monotonic convergence is only obtained with a sequential update of the control . in this case , the equation for determining the control reads @xmath48        \right\}\,.\end{aligned}\ ] ] @xmath49 denotes a shape function that can be used to switch the control on and off smoothly  @xcite or to impose an initial or final ramp  @xcite ; and @xmath50 is a parameter of the algorithm whose choice determines the step size in the change of the control .
its optimal value can be estimated in an automated way , similarly to a line search in quasi - newton methods  @xcite .
@xmath51 denotes the so - called co - state or adjoint state , and the derivative with respect to the control is given by the commutator @xmath52 }        { \partial u}\big|_{u^{(i+1)}},{\boldsymbol{\hat{\rho}}}^{(i+1)}\right]\,.\ ] ] for the common case of linear coupling to the control , as in eq .  , the explicit dependence on @xmath53 vanishes and the commutator simply becomes @xmath54 $ ] .
nonetheless , the right - hand side of eq .
depends on @xmath53 via @xmath55 , i.e. , it is an implicit equation .
solution of the implicit equation can usually be avoided by a low order approximation in the iterative algorithm , employing two shifted time discretizations to represent the time dependence of states and control , @xmath56 and @xmath57  @xcite .
equation   also depends on the state of system at time @xmath47 , @xmath5 , and the co - state , @xmath51 .
these are obtained by solving    [ eq : forward ] @xmath58,{\boldsymbol{\mathsf{\hat{\rho}}}}^{(i)}\right ]    + \mathcal{l}_d({\boldsymbol{\mathsf{\hat{\rho}}}}^{(i)})\end{aligned}\ ] ] with initial condition @xmath59    and    [ eq : backward ] @xmath60,{\boldsymbol{\mathsf{\hat{\sigma}}}}^{(i)}\right ]    -\mathcal{l}_d({\boldsymbol{\mathsf{\hat{\sigma}}}}^{(i)})\ , ,   \end{aligned}\ ] ] which is solved backward in time .
the initial condition is derived from the target functional at final time @xmath46 , @xmath61    this coupled set of equations needs to be solved iteratively , starting with some guess for the control , @xmath62 , where the index @xmath63 denotes iteration .    the algorithm represented by eqs . , and is straightforwardly extended from targeting a single state to targeting a unitary operation  @xcite : a unitary operation @xmath64 can be viewed as several simultaneous state - to - state transfers  @xcite which are all driven by the same control . consequently , eq .   becomes @xmath65        \right\}\,,\ ] ] and eqs .   and need to be solved for @xmath66 states @xmath67 and @xmath66 co - states @xmath68 simultaneously . as explained in sec .
[ subsec : success ] , it was first believed that the sum in eq .   has to run over @xmath69 states where @xmath10 is the dimension of the space on which the desired operation is defined  @xcite .
the initial conditions @xmath70 are then given by orthogonal basis states spanning this space .
recently it was shown that @xmath66 can be reduced all the way down to 3 in which case the states discussed in sec .
[ subsec : success ] need to be taken as initial conditions @xmath70  @xcite .
the initial conditions for the co - states are always given in terms of the desired target operation , @xmath71 , up to a suitable normalization  @xcite .
moreover , weights may be introduced in @xmath72 to speed up convergence by attaching different importance to different basis states @xmath70  @xcite .
extension of the optimization algorithm to more flexible control targets , such as an arbitrary perfect entangler  @xcite instead of a specific unitary , requires two steps .
first , a modified target functional results in a modification of eq .  : the right - hand side of eq .   will be replaced by the derivative of the new target functional with respect to the states , @xmath11 , evaluated at time @xmath33 . for a target functional based on the local invariants , this requires , in particular , to determine the unitary part of the overall actual evolution , as explained in sec .
[ subsec : success ] .
second , dependence of the functional on the states @xmath11 may be non - convex . in this case , eq .
needs to be amended by a second term in its right - hand side  @xcite which depends additionally on the change in the states , @xmath73 . while the additional computational effort for evaluating the control update is negligible , storage of all @xmath74 is necessary and may become a limiting factor when scaling up the system size .
such extensions of the optimization algorithm to control targets other than a specific state or unitary have been applied to coherent dynamics  @xcite . for open quantum systems , they are still under exploration
.    typically , more than one solution exists to a quantum control problem .
when using the basic optimization algorithm presented above , it will then depend on the initial guess @xmath75 which solution @xmath76 the algorithm identifies .
two strategies can be employed in order to fine - tune the iterative search and guide it toward a solution with certain desired properties
careful selection of the initial guess by scanning or preoptimization  @xcite or use of additional constraints  @xcite . in the first case
, the initial guess needs to be parametrized in a suitable form , for example in terms of amplitudes and phases of fourier components , or amplitudes , widths and positions of gaussians .
these parameters can easily be pre - optimized within a prespecified range employing a standard gradient - free optimization method  @xcite . when the result is used as initial guess in the optimization algorithm presented above
, the ensuing fine - tuning will usually not lead to drastic changes in the field , keeping it close to the parametrized form  @xcite .    a more stringent way to enforce certain desired properties of the control solution
is obtained by employing additional constraints  @xcite .
this comes at the expense of a modified optimization algorithm .
an explicit description for deriving the modified algorithms is available when using krotov s method  @xcite .
it allows for formulating constraints as a functional of the control , with the only condition that the functional be positive ( or negative ) semidefinite  @xcite .
this requirement is necessary to ensure monotonic convergence . as an example , consider a spectral constraint on the control  @xcite , @xmath77 = \frac{1}{2\pi } \int_0^t \int_0^t    \delta u(t ) k(t - t^\prime ) \delta u(t^\prime ) dt^\prime dt\,,\ ] ] where @xmath78 is the fourier transform of a spectral filter @xmath79 . as a result ,
the update equation for the control becomes a fredholm equation of the second kind  @xcite .
a judicious choice of the shape function @xmath49 allows for analytically solving the fredholm equation in frequency domain such that the additional numerical effort for including the spectral constraint consists merely in two additional fourier transforms  @xcite .
more than one constraint may be employed at a time , with different weights allowing to emphasize importance of one compared to another  @xcite .
while additional constraints provide information that guides the optimization algorithm , they also restrict the space of admissible solutions  @xcite . therefore care
needs to be taken to balance their benefits and their disadvantages .
while it is probably the dream of every control engineer to discover unthought of control schemes , a more realistic scenario starts from known a control strategy , as those described in sec .
[ subsec : strategies ] , and extends it to a wider range of conditions , new types of systems , or new types of dissipative processes using the optimization techniques described above .
one of the most popular control strategy in the area of quantum technologies currently is dynamical decoupling  @xcite .
while already powerful in itself , dynamical decoupling can be made more robust by numerical optimization that targets specific noise features that were previously unaccounted for , using , for example , the gradient - ascent technique  @xcite or genetic algorithms  @xcite . in these examples ,
optimization did not compromise feasibility of the pulse sequences .
moreover , the length of dynamical decoupling sequences can be minimized  @xcite .
dynamical decoupling and numerically optimized pulses can also complement each other , as recently demonstrated for entanglement generation and distribution in nv centers in diamonds  @xcite .    a second successful control strategy described in sec .
[ subsec : strategies ] is based on decoherence - free subspaces and noiseless subsystems .
these are somewhat less often used than dynamical decoupling , mainly due to the difficulty of identifying them for more complex systems . while direct identification of decoherence - free subspaces is hampered by presence of numerous traps in the search space  @xcite ,
quantum optimal control may be used to dynamically identify them . indeed , optimization of an open system s dynamics for targets that rely on quantum coherence is intrinsically biased toward those subspaces in hilbert ( or liouville ) space that are least affected by decoherence  @xcite .
for example , transfer of coherence and polarization between coupled heteronuclear spins was improved by cross - correlated relaxation optimized pulse ( crop ) sequences and relaxation optimized pulse elements ( rope )  @xcite .
optimization can take both longitudinal and transveral relaxation into account  @xcite .
the underlying mechanism was revealed to consist in tuning cross - correlated to autocorrelated relaxation rates  @xcite .
counterintuitively , maximum polarization transfer between coupled spins was achieved with sequences that are longer than conventional ones  @xcite , highlighting the importance to include the dissipative dynamics in the optimization .
finally , if all regions in hilbert space are similarly affected by decoherence , an obvious control strategy consists in beating decoherence by the fastest possible operation .
this strategy is faced , however , with the so - called quantum speed limit , i.e. , a fundamental bound on the shortest operation time  @xcite .
for a two - level system , it can be estimated analytically  @xcite . for more complex systems
, optimal control theory can be used as a tool to both identify the quantum speed limit and determine controls that drive the system at the quantum speed limit  @xcite .
for example , the shortest possible duration of entangling quantum gates was determined for cold , trapped atoms  @xcite and for superconducting qubits  @xcite . in quantum dots ,
phonon - assisted decoherence was minimized  @xcite .
interestingly , presence of the environment may improve the quantum speed limit  @xcite .
this has not yet been explored systematically but could be done , using quantum optimal control .
the example of cooling  @xcite was already taken as reference to introduce optimal control of open quantum systems in sec .
[ subsec : oct ] .
since cooling changes the purity of the state , it relies on the presence of the environment . when using the algorithm outlined in sec .
[ subsec : oct ] , the control that drives the cooling process is determined for each initial state separately .
alternatively , one may seek a control that will lead to cooling irrespective of the initial state  @xcite .
such an approach is particularly useful if the timescales of the coherent and the dissipative dynamics is different , as in the case of optical pumping  @xcite which consists of many repeated cycles of excitation and spontaneous emission . the theoretical framework lends itself to generalization to quantum reservoir engineering which is why it is outlined in more detail in the following .
the idea is to start from an orthogonal basis for the space on which the initial states are defined and ensure transitions favorable to cooling for every basis state  @xcite . in the case of optical pumping , these are transitions into states from which spontaneous emission preferrably occurs to the cooling target . as is usual in quantum optimal control , this control task is stated in terms of a yield functional .
additionally , the control should not excite any population which has already been accumulated in the cooling target state .
in other words , the cooling target should remain a steady state of the evolution .
this requirement is translated into a second term in the optimization functional , besides the yield .
moreover , it is often not possible to cool arbitrary initial states , due to limitations on control bandwidth .
instead , one can seek to cool states which are defined on a certain subspace .
this results in an additional term in the optimization functional that suppresses leakage from this subspace in order to keep the cooling cycle closed .
finally , one needs to guarantee that for all basis states cooling occurs with the same efficiency ; otherwise the cooling might get stuck .
this can be achieved either by imposing symmetric excitation of all basis states or by having all basis states form an assembly line , i.e. , enforce one specific excitation pathway for all states .
all requirements need to be met simultanously and , consequently , the optimization functional consists of four terms
one for the yield , one of the steady state , one to suppress leakage and one to ensure symmetric excitation or enforce a specific excitation pathway for all states  @xcite .
application of this optimization framework showed that laser cooling of molecular vibrations is possible even in cases where the molecular structure favors heating rather than cooling  @xcite .
it also answers the question about the minimal requirement on the molecular structure to realize , with shaped pulses , cooling instead of heating , assuming no constraints on the control  existence of one state which undergoes spontaneous emission with moderate probability into the cooling target .    if the molecular structure is favorable to cooling vibrations , an optimized laser pulse results in a substantially smaller number of cooling cycles than an unshaped pulse  @xcite .
a similar speed up of the cooling due to pulse sequences obtained from quantum optimal control theory has also been reported for an optomechanical resonator  @xcite and for trapped , quasi - condensed cold atoms  @xcite .
laser cooling can be viewed as a particular example of quantum reservoir engineering  @xcite , where a desired state becomes the ground state of a driven dissipative system .
it holds the promise of a particularly robust control strategy .
however , applications of quantum reservoir engineering have been limited to quantum optics to date . in a condensed phase settings , both desired and undesired dissipative channels come into play , and non - markovian effects may occur .
thus , quantum reservoir engineering in the condensed phase represents a challenging control problem .    as with any control problem ,
two questions need to be tackled  that of controllability and that of control synthesis , i.e. , what states are attainable and how can the necessary driving be realized .
the first question has been answered for generic models , such as a two- and a four - level system and a harmonic oscillator , that undergo markovian dynamics  @xcite .
the obtained understanding of controllability can be exploited to construct dissipative channels that allow for the robust generation of long - distance entanglement  @xcite .
the question which states are attainable in the presence of additional undesired dissipative channels , a generic feature of any condensed phase setting , has not yet been tackled to date .
a possible influence of non - markovian effects on the reachable states has also not yet been addressed .
control synthesis may be achieved in several ways .
first , incoherent control by the environment , for example , via certain population distributions in the environmental modes , may be used to control the system  @xcite .
however , this contradicts the assumption that the environment by definition is uncontrollable .
alternatively , measurements effectively lead to dissipative dynamics and may thus be used to generate desired dissipation  @xcite .
they may be augmented by suitably tailored coherent excitation for more effective control  @xcite .
quantum reservoir engineering may also be formulated as an optimization problem where the target is a certain desired steady state .
an optimization algorithm is obtained by generalizing the theoretical framework for laser cooling  @xcite outlined above .
however , the search space is even larger than for a standard quantum control problem ; and the efficient numerical implementation is an open challenge .
meeting this challenge would allow for exploring quantum reservoir engineering in the presence of undesired dissipation typical for condensed phase settings and in the non - markovian regime .
it was shown already several years ago that non - markovian evolution may ease control  @xcite , and cooperative effects of dissipation and driving were reported  @xcite . however , a more thorough understanding of the nature of non - markovianity was required to understand its interplay with quantum control . as described in sec .
[ subsec : marknonmark ] , non - markovianity has in the meantime been characterized in terms of information flow from the environment to the system  @xcite , increase of correlations in a bipartite system  @xcite , or re - expansion of the volume of accessible states  @xcite , among others .
the important point in the context of quantum control is that each of these measures holds a promise for better control : correlations between system and environment may improve fidelities of single qubit gates  @xcite , cooperative effects of control and dissipation may allow for entropy export and thus cooling  @xcite ; and harnessing non - markovianity may enhance the efficiency of quantum information processing and communication  @xcite .
a first example of exploiting non - markovianity for quantum control was reported in ref .
@xcite , showing that , for an anharmonic ladder system , the environment may be utilized to extend possible operations from @xmath29 to @xmath28 .
presence of at least one two - level defect in the environment that is sufficiently isolated and sufficiently strongly coupled to the system was identified as prerequisite for the observed controllability enhancement .
such conditions are found in current experiments with superconducting circuits and other systems which are immersed in a small , natural spin bath , for example color centers in diamond .
the limited number of optimal control studies of open quantum systems with non - markovian dynamics  @xcite testifies to the fact that control of these systems remains largely uncharted territory .
the full potential of the specific features of non - markovian dynamics for quantum control remains yet to be explored .
open questions include , for example , how the build - up of memory influences control ; whether specific features of the spectral density can be exploited for control , and if so , how . the tools for performing these studies , both in terms of simulating non - markovian dynamics  @xcite and carrying out optimal control calculations , cf .
[ subsec : oct ] , have been developed and are there to be used .
the present review has been focused on control of open quantum systems as they are encountered in the field of quantum technologies . it will be concluded by briefly mentioning examples from other fields of current interest : quantum optimal control for open systems has been employed in the context of quantum thermodynamics , in order to determine the optimal efficiency of a noisy heat engine  @xcite ; biological chromophore complexes , in order to maximize exciton transfer  @xcite ; molecules immersed in dissipative media , in order to maximally align them with respect to a laboratory axis  @xcite ; molecular junctions , in order to control the current , shot noise and fano factors  @xcite ; as well as chemical reaction dynamics  @xcite , including charge transfer in molecules  @xcite , and surface photochemistry  @xcite .
the numerous applications attest to the maturity as well as versatility of the quantum control toolbox  @xcite .      1 .
if the desired operation shall keep pure states pure , markovian dynamics are unwanted .
the effect of the environment in this case is detrimental .
a suitable strategy is then to perform any desired operation as fast as possible .
quantum optimal control theory is a viable tool to determine both the shortest operation time and the control that drives the desired dynamics .
the actual dissipative processes may be neglected during the optimization for computational simplicity .
explicit account of the dissipative processes comes at a significantly larger numerical cost but allows for identifying subspaces which are less affected by or even immune to decoherence .
if the desired operation changes the purity of the system s state , presence of the environment is necessary for realizing the control target . in this case ,
markovian dynamics may be desired : the control target is reachable if it is a fixed state of the liouvillian .
external control fields may be used to ensure that this is the case .
the corresponding control strategy is referred to as quantum reservoir engineering .
if the liouvillian has several fixed points , external fields may also be used to drive the dynamics to the desired one .
the role of non - markovian effects in this type of desired dissipation has not been explored to date .
3 .   non - markovian dynamics in general may have both beneficial and detrimental effects on controlled quantum dynamics .
improved controllability is a first example of a benefit .
it requires presence of a few strongly coupled and sufficiently isolated environmental modes which can effectively act as ancillas  , and use of quantum optimal control for properly exploiting these modes .
an improved quantum speed limit is a second example .    while the number of examples for successful control of open quantum systems is growing , our current understanding of controllability and the most promising control strategies for open quantum systems is still rather limited . in particular , a thorough understanding of
the role of non - markovian effects is lacking to date , and it is currently still unknown which features of non - markovianity can be exploited for quantum control .
investigation of a larger range of models , with both small and large baths , consisting of harmonic modes and spins , and a systematic analysis of non - markovianity may elucidate this question .
such an improved understanding would not only be crucial for advancing quantum technologies but would also be beneficial for adjacent fields such as condensed matter physics or chemical reaction dynamics .
i would like to thank ugo boscain , steffen glaser , dominique sugny , and david tannor for their comments on the manuscript .
recent advances in the control of open quantum systems in my own group were made possible by the work of michael goerz , giulia gualdi and daniel reich whom i would like to thank for their dedication and perserverance .


video streaming applications have become over the past few years the dominant applications in the internet and generate the prevalent part of traffic in today s ip networks ; see for instance guillemin et al .
@xcite for an illustration of the application breakdown in a commercial ip backbone network .
video files are currently downloaded by customers from large data centers , like google s data centers for youtube files . in the future
, it is very likely that video files will be delivered by smaller data centers located closer to end users , for instance cache servers disseminated in a national network .
it is worth noting that as shown in guillemin et al .
@xcite , caching is a very efficient solution for youtube traffic . while this solution can improve performances by reducing delays ,
the limited capacity of those servers in terms of bandwidth and computing can cause overload .
one possibility to reduce overload is to use bit rate adaptation .
video files can indeed be encoded at various bit rates ( e.g , small and high definition video ) .
if a node can not serve a file at a high bit rate , then the video can be transmitted at a smaller rate .
it is remarkable that video bit rate adaptation has become very popular in the past few years with the specification of mpeg - dash standard where it is possible to downgrade the quality of a given transmission , see schwarz et al .
@xcite , sieber et al .
@xcite , aorga et al .
@xcite , vadlakonda et al .
@xcite and fricker et al .
adaptive streaming is also frequently used in mobile networks where bandwidth is highly varying . in this paper
, we investigate the effect of bit rate adaptation in a node under saturation .
we assume that customers request video files encoded at various rates , say , @xmath3 for @xmath4 , with @xmath5
. jobs of class @xmath6 require bit rate @xmath3 .
the total capacity of the communication link is @xmath0 . if @xmath7 is the state of the network at some moment , with @xmath8 being the number of class @xmath9 jobs , the quantity @xmath10 has to be less than @xmath0 .
the quantity @xmath11 is defined as the _ occupancy _ of the link .
the algorithm has a parameter @xmath1 and works as follows : if there is an arrival of a job of class @xmath12 ,    * if @xmath13 then the job is accepted ; * if @xmath14 then the job is accepted but as a class @xmath15 job , i.e. it has an allocated bit rate of @xmath16 and service rate @xmath17 ; * if @xmath18 , the job is rejected .    for @xmath19 , jobs of class @xmath9 arrive according to a poisson process with rate @xmath20 and have an exponentially distributed transmission time with rate @xmath21
additionally , it is assumed that @xmath22      to study this allocation scheme , a scaling approach is used .
it is assumed that the server capacity is very large , namely scaled up by a factor @xmath23 . the bit rate adaptation threshold and the request arrival rates
are scaled up accordingly , i.e. @xmath24 _ performances of the algorithm . _
our main result shows that , for the downgrading policy and if @xmath25 is chosen conveniently , then    1 .
the equilibrium probability of rejecting a job converges to @xmath26 as @xmath23 goes to infinity ; 2 .
the equilibrium probability of accepting a job without downgrading it converges to @xmath27 as @xmath23 goes to infinity .
see theorem  [ theoeq ] and corollary  [ corol ] .
the above formula gives an explicit expression of the success rate of this allocation mechanism .
the quantity @xmath28 , the probability of downgrading requests , can be seen as the `` price '' of the algorithm to avoid rejecting jobs .
the scaling   has been introduced by kelly to study loss networks .
see kelly  @xcite .
the transient behavior of these networks under this scaling has been analyzed by hunt and kurtz  @xcite .
this last reference provides essentially a framework to establish convenient convergence theorems involving stochastic averaging principles .
this line of research has been developed in the 1990 s to study uncontrolled loss networks where a request is rejected as soon as its demand can not be accepted .    when the demand can be adapted to the state of the network , for controlled loss networks ,
several ( scarce ) examples have been also analyzed during that period of time .
one can mention bean et al .
@xcite , zachary and ziedins  @xcite and zachary  @xcite for example .
our model can be seen as a `` controlled '' loss networks instead of a pure loss network .
controlled loss networks may have mechanisms such as trunk reservation or may allocate requests according to some complicated schemes depending on the state of the network . in our case , the capacity requirements of requests are modified when the network is in a `` congested '' state .
contrary to classical uncontrolled loss networks , as it will be seen , the markov process associated to the evolution of the vector of the number of jobs for each class is not reversible .
additionally , the invariant distribution of this process does not seem to have a closed form expression .
kelly s approach  @xcite is based on an optimization problem , it can not be used in our case to get an asymptotic expression of some characteristics at equilibrium . for this reason
, the equilibrium behavior of these policies is investigated in a two step process :    1 .
transient analysis .
we investigate the asymptotic behavior of some characteristics of the process on a finite time interval when the scaling parameter @xmath23 goes to infinity .
2 .   equilibrium .
the stability properties of the limiting process are analyzed , we prove that the equilibrium of the system for a fixed @xmath23 converges to the equilibrium of the limiting process .
for our model , the transient analysis involves the _ explicit _ representation of the invariant distribution of a specific class of markov processes .
it is obtained with complex analysis arguments .
as it will be seen , this representation plays an important role in the analysis of the asymptotic behavior at equilibrium .
it should be noted that related models have recently been introduced to investigate resource allocation in a cloud computing environment where the nodes receive requests of several types of resources .
we believe that this domain will receive a renewed attention in the coming years .
see stolyar  @xcite and fricker et al .
@xcite for example . in some way
one could say that the loss networks are back and this is also a motivation of this paper to shed some light on the methods that can be used to study these systems .
we consider a system in overload . because of bit
rate adaptation , requests may be downgraded but not systematically rejected as in a pure loss system . as it will be seen , the stability properties of this algorithm are linked to the behavior of a markov process associated to the occupation of the link . under exponential assumptions for inter - arrival and service times , this process turns out to be , after rescaling by a large parameter @xmath23 , a bilateral random walk instead of a reflected random walk as in the case of loss networks .
using complex analysis methods , an explicit expression of the invariant distribution of this random walk is obtained . with this result , the asymptotic expression of the probability
that , at equilibrium , a job is transmitted at its requested rate ( and therefore does not experience a bit rate adaptation ) is derived .
this paper is organized as follows : in section  [ model ] , we present the model used to study the network under some saturation condition . convergence results when the scaling factor @xmath23 tends to infinity are proved in section  [ secmod ] . the invariant distribution of a limiting process associated to the occupation of the link is computed in section  [ secinv ] by means of complex analysis techniques .
applications are discussed in section  [ app ] .    *
acknowledgments * + the authors are very grateful to an anonymous referee for pointing out a gap in the proof of theorem  [ theoeq ] in the first version of this work .
one considers a service system where @xmath29 classes of requests arrive at a server with bandwidth / capacity @xmath0
. requests of class @xmath9 , @xmath30 , arrive according to a poisson process @xmath31 with rate @xmath20 .
a class @xmath9 request has a bandwidth requirement of @xmath3 units for a duration of time which is exponentially distributed with parameter @xmath21 . for the systems investigated in this paper ,
there is no buffering , requests have to be processed at their arrival otherwise they are rejected . without any flexibility on the resource allocation ,
this is a classical loss network with one link .
see kelly  @xcite for example .
this paper investigates allocation schemes which consist of reducing the bandwidth allocation of arriving requests to a minimal value when the link has a high level of congestion . in other words
the service is downgraded for new requests arriving during a saturation phase .
if the system is correctly designed , it will reduce significantly the fraction of rejected transmissions and , hopefully , few jobs will in fact experience downgrading .
we introduce @xmath1 , the parameter @xmath2 will indicate the level of congestion of the link .
it is assumed that the vector of integers @xmath33 is such that @xmath34 .
the condition @xmath16 is used to simplify the presentation of the results and to avoid problems of irreducibility in particular but this is not essential .    if the network is in state @xmath7 and
if the occupancy @xmath11 is less than @xmath2 , then any arriving request is accepted .
if the occupancy is between @xmath2 and @xmath35 , it is accepted but with a minimal allocation , as a class @xmath15 job .
finally it is rejected if the link is fully occupied , i.e. @xmath36 .
it is assumed that @xmath37 , for @xmath19 , i.e. class  1 jobs are served with the smallest service rate .
mathematically , the stochastic model is close to a loss network with the restriction that a job may change its requirements depending on the state of the network .
this is a controlled loss network , see zachary and ziedins  @xcite .
it does not seem that , like in uncontrolled loss networks , the associated markov process giving the evolution of the vector @xmath38 has reversibility properties , or that its invariant distribution has a product form expression .
related schemes with product form are trunk reservation policies for which requests of a subset of classes are systematically rejected when the level of congestion of the link is above some threshold . see bean et al .  @xcite and zachary and ziedins  @xcite for example
. concerning controlled loss networks , mathematical results are more scarce .
one can mention networks where jobs requiring congested links are redirected to less loaded links .
several mathematical approximations have been proposed to study these models .
see the surveys kelly  @xcite and zachary and ziedins  @xcite . in our model , in the language of loss networks ,
the control is on the change of capacity requirements instead of a change of link .
the invariant distribution being , in general , not known , a scaling approach is used .
the network is investigated under kelly s regime , i.e. under heavy traffic regime with a scaling factor @xmath23 .
it has been introduced in kelly  @xcite to study the equilibrium of uncontrolled networks .
the arrival rates are scaled by @xmath23 : @xmath20 is replaced by @xmath39 as well as the capacity @xmath0 by @xmath40 and the threshold @xmath2 by @xmath41 which are such that @xmath42 for @xmath43 .    for @xmath30 and @xmath44
, @xmath45 denotes the number of class @xmath9 jobs at time @xmath46 in this system and @xmath47
.    it will be assumed that the system is overloaded when the jobs have their initial bandwidth requirements @xmath48 with @xmath49 and @xmath50 , @xmath19 .
the first condition gives that , without any change on the bandwidth requirement of jobs , the system will reject jobs .
the second condition implies that the network could accommodate all jobs without losses ( with high probability ) if all of them would require the reduced bit rate @xmath16 and service rate @xmath17 .
it should be noted that , from the point of view of the design of algorithms , the constant @xmath25 has to be defined . if one takes @xmath51 then , @xmath52 hold .    if @xmath53 , it is not difficult to see that the system is equivalent to a classical underloaded loss network with one link and multiple classes of jobs .
there is , of course , no need to use downgrading policies since the system can accommodate incoming requests without any loss when @xmath23 is large .
see kelly  @xcite or section  7 of chapter  6 of robert  @xcite for example .
in this section , we prove convergence results when the scaling parameter @xmath23 goes to infinity . these results are obtained by studying the asymptotic behavior of the occupation of the link around @xmath41 , @xmath54 in the context of loss networks , the analogue of such quantity is the number of empty places .
the following proposition shows that , for the downgrading policy , the boundary @xmath40 does not play a role after some time if condition   holds .
[ propbound ] under condition   and if the initial state is such that @xmath55 then , for @xmath56 , there exists @xmath57 such that , for @xmath58 , @xmath59    define @xmath60 where @xmath61 is the process of the number of jobs of an independent @xmath62 queue with @xmath63 , service rate @xmath17 and arrival rate @xmath49 and , for @xmath30 , @xmath64 where @xmath65 is a sequence of i.i.d .
exponentially distributed random variables with rate @xmath21.the quantity @xmath66 is the number of initial class @xmath9 jobs still present at time @xmath46 . using theorem  6.13 of robert  @xcite , one gets the convergence in distribution @xmath67 and , consequently , @xmath68 since @xmath69 for @xmath19 , @xmath70 by condition  .
note that the asymptotic occupancy , when @xmath23 is large , remains below the initial occupancy .
if @xmath71 and @xmath72 such that @xmath73 , let @xmath74 then , on the event @xmath75 , the downgrading policy gives that the identity in distribution @xmath76 holds .
condition   gives the existence of @xmath77 such that @xmath78 convergence   shows that the sequence @xmath79 converges in distribution to @xmath77 .
note that , if @xmath80 , as long as the process @xmath81 stays above @xmath41 on @xmath82 , a relation similar to   holds . by using again convergence  ,
one gets that , as @xmath23 goes to infinity , the process @xmath83 remains below @xmath84 with probability close to @xmath15 on @xmath85 .
the proposition is proved .
we are now investigating the asymptotic behavior of the process @xmath86 defined by relation  .
the variable indicates if the network is operating in saturation at time @xmath46 , @xmath87 , or not , @xmath88 .
in pure loss networks , when @xmath23 is large , up to a change of time scale , the analogue of this process , the process of the number of empty places converges to a reflected random walk in @xmath89 . in our case , as it will be seen , the corresponding process is in fact a random walk on @xmath90 .
[ def1 ] for @xmath91 , let @xmath92 be the markov process on @xmath90 whose @xmath93-matrix @xmath94 is defined by , for @xmath95 and @xmath30 , @xmath96 with @xmath97 .
the following proposition summarizes the stability properties of the markov process @xmath98 .
[ propm ] if @xmath91 , then the markov process @xmath92 is ergodic if @xmath99 with @xmath100 @xmath101 denotes the corresponding invariant distribution .
the markov process @xmath92 on @xmath90 behaves like a random walk on each of the two half - lines @xmath89 and @xmath102 .
definition   implies that if @xmath103 , then the drift of the random walk is positive when in @xmath102 and negative when in @xmath89 .
this property implies the ergodicity of the markov process by using the lyapounov function @xmath104 , for example .
see corollary  8.7 of robert  @xcite for example .
one now extends the expression @xmath101 for the values @xmath105 .
this will be helpful to describe the asymptotic dynamic of the system .
see theorem  [ thlds ] further .
[ def2 ] one denotes @xmath106 , the dirac measure at @xmath107 when @xmath108 , with @xmath109 and @xmath110 if @xmath111 , with @xmath112      for @xmath113 , denote by @xmath114 a poisson process on @xmath115 with rate @xmath116 and @xmath117 an i.i.d .
sequence of such processes .
all poisson processes are assumed to be independent .
classically , the process @xmath118 can be seen as the unique solution to the following stochastic differential equations ( sde ) , @xmath119 with initial condition @xmath120 such that @xmath121 .
[ thlds ] under condition  , if the initial conditions are such that @xmath122 and @xmath123 then there exists continuous process @xmath124 such that the convergence in distribution @xmath125 holds for any function @xmath126 with finite support on @xmath90 .
furthermore , there exists @xmath127 such that @xmath128 satisfies the differential equations @xmath129 where @xmath101 , for @xmath130 , is the distribution of proposition  [ def1 ] and definition  [ def2 ] .
it should be noted that , since the convergence holds for the convergence in distribution of processes , the limit @xmath131 is a priori a _ random _ process .    by using the same method as hunt and kurtz  @xcite ,
one gets the analogue of theorem  3 of this reference .
fix @xmath56 such that @xmath132 , from proposition  [ propbound ] , one gets that the existence of @xmath133 such that @xmath134 which implies that the boundary condition @xmath135 in the evolution equations   can be removed . consequently , only the boundary condition of @xmath86 at @xmath26 plays a role which gives relation   as in hunt and kurtz  @xcite .
note that , contrary to the general situation described in this reference , we have indeed a convergence in distribution because , for any @xmath136 , @xmath92 has exactly one invariant distribution ( which may be a dirac mass at infinity ) by proposition  [ propm ] .
see conjecture  5 of hunt and kurtz  @xcite .
the following proposition gives a characterization of the equilibrium point of the dynamical system @xmath131 .
[ fpprop ] under conditions   and  , there exists a unique equilibrium point @xmath137 of the process @xmath138 defined by equation   given by @xmath139 where @xmath140 with @xmath141 .
the process @xmath142 is ergodic in this case .
assume that there exists an equilibrium point @xmath143 of @xmath138 defined by equation  , it is also an equilibrium point of the dynamical system defined by equation  , then @xmath144 with @xmath145 .
one gets @xmath146 we now show that the vector @xmath147 is on the boundary , i.e. @xmath148 if we assume that @xmath149 from theorem  [ thlds ] and the definition of @xmath86 , we know that , for the convergence of processes , the following relation holds @xmath150 for @xmath151 , @xmath152 and @xmath153 , @xmath154 by using again theorem  [ thlds ] and the fact that @xmath147 is an equilibrium point of the dynamical system , we have , for the convergence in distribution @xmath155).\ ] ] the left - hand side of the above expression can be arbitrarily close to @xmath15 when @xmath156 is large . by convergence of the sequence @xmath157 to @xmath158 ,
one gets that , for the convergence in distribution , the relation @xmath159 holds for @xmath56 , which implies that @xmath160 .
thus relation   holds .
finally , relations   and   give relation  . one concludes therefore that @xmath161 , the associated process @xmath142 is necessarily ergodic by proposition  [ propm ] and relations  .    to prove that the @xmath147 defined by relations   and   is indeed an equilibrium point of the dynamical system defined by equation  , one has to show that the right - hand side of equation   is indeed equal to @xmath162 .
this is proved in proposition  [ propfp2 ] of section  [ secinv ] .      in this section
our main result establishes the convergence of the invariant distribution of the process @xmath86 as @xmath23 gets large .
this will give in particular the convergence with respect to @xmath23 of the probability of not downgrading a request at equilibrium .
[ lem22 ] if the process @xmath163 is the process @xmath164 at equilibrium then , for any @xmath56 and @xmath165 , @xmath166    let @xmath164 be the process with initial state empty , then one can easily construct a coupling such that the relation @xmath167 holds almost surely , where @xmath168 is the @xmath62 queue associated to class @xmath9 requests .
one deduces that , @xmath169 where @xmath170 is a poisson random variable with parameter @xmath171 and @xmath172 is the stochastic ordering of random variables .
one can therefore construct another coupling such that @xmath173 where @xmath174 is a stationary version of the @xmath62 queue associated to class @xmath9 requests .
the lemma is then a consequence of the following convergence in distribution of processes , @xmath175 for @xmath176 , see theorem  6.13 pp .
159 of robert  @xcite for example .
[ defla ] let @xmath177 be the dynamical system on @xmath178 satisfying @xmath179 with @xmath180    [ lem3 ] if @xmath181 and if there exists an instant @xmath165 such that @xmath182 for @xmath183 $ ] then @xmath177 and @xmath184 coincide on the time interval @xmath185 $ ] , where @xmath131 is the solution of equations   with @xmath186 .
the proposition is a simple consequence of the representation   of the differential equations defining the dynamical system @xmath131 and of the explicit expression of the quantity @xmath187 given by relation   when @xmath103 , see relation  .
the next proposition investigates the stability properties of @xmath177 .
let @xmath188 be the hyperplane @xmath189 if @xmath190 then @xmath191 for all @xmath44 and @xmath177 is converging exponentially fast to @xmath147 defined in proposition  [ fpprop ] .
it is easily checked that @xmath192 so that if @xmath193 , then the function @xmath194 is constant and equal to @xmath25 , hence @xmath195 for all @xmath196 .    for @xmath176 ,
@xmath197 with @xmath198 in matrix form , if @xmath199 , it can be expressed as @xmath200 with @xmath201 and @xmath202 with @xmath203 if @xmath204 is an eigenvector for the eigenvalue @xmath205 of @xmath206 , then @xmath207 hence , @xmath205 is an eigenvalue if and only if it is a solution of the equation @xmath208 if @xmath209 is the number of distinct values of @xmath21 , @xmath210 , such that @xmath211 , then the above equation shows that an eigenvalue is a zero of a polynomial of degree at most @xmath209 . using conditions  , it is easy to check that the relation @xmath212 holds .
in particular @xmath26 is not an eigenvalue and , consequently @xmath206 is invertible . due to the poles of @xmath213 at the @xmath214 , @xmath210 and the relations @xmath212 and @xmath215 for @xmath210 , one has already @xmath209 negative solutions of the equation @xmath216 .
all eigenvalues of @xmath206 are thus negative , consequently , @xmath217 converges to @xmath26 .
( see corollary  2 of chapter  25 of arnold  @xcite for example . )
equation   can be solved as @xmath218 therefore the function @xmath219 has a limit at infinity given by @xmath220 which is clearly @xmath221 . the proposition is proved .
one can now prove the main result of this section .
[ theoeq ] if @xmath147 is the quantity defined in proposition  [ fpprop ] , then the equilibrium distribution of @xmath86 converges to @xmath222 when @xmath23 goes to infinity .
recall that @xmath223 and let @xmath224 be the invariant distribution of @xmath118 .
it is assumed that the distribution of @xmath225 is @xmath224 for the rest of the proof . in particular
@xmath86 is a stationary process .
one first proves that @xmath226 converges in distribution to @xmath147 .
the boundary condition @xmath227 gives that the sequence of random variables @xmath226 is tight .
if @xmath228 is a convergent subsequence to some random variable @xmath229 , by theorem  [ thlds ] , one gets that , for the convergence in distribution , the relation @xmath230 holds , where @xmath131 is a solution of equation   with initial point at @xmath231 .
note that @xmath131 is a stationary process , its distribution is invariant under any time shift .    by lemma  [ lem22 ]
one has that the relation @xmath232 , for @xmath176 , holds almost surely on any finite time interval and , by proposition  [ propbound ] , @xmath233 also holds almost surely on finite time intervals .
assume that @xmath234 holds .
the odes defining the limiting dynamical system are given by @xmath235 as long as the condition @xmath236 holds , hence on the corresponding time interval , one has @xmath237 so that @xmath238 since @xmath239 , there exists some @xmath240 such that @xmath241 .    hence , by stationarity in distribution of @xmath131 , one can shift time at @xmath133 and assume that @xmath242 . on this event
@xmath243 similarly , since @xmath244 for all @xmath176 , @xmath245 and the last quantity is independent of @xmath246 .
relations   and   show that @xmath247 and , by equations   and , they also hold for @xmath46 in a small neighborhood @xmath85 of @xmath26 independent of @xmath246 so that @xmath248 for @xmath249 . consequently , the dynamical system @xmath131 never leaves @xmath250 .
lemma  [ lem3 ] shows that the two dynamical systems @xmath131 and @xmath177 ( with @xmath251 ) coincide .
hence , on one hand @xmath131 is a stationary process and , on the other hand , it is a dynamical system converging to @xmath147 , one deduces that it is constant and equal to @xmath147 .
we have thus proved that the sequence @xmath226 converges in distribution to @xmath147 .
using again theorem  [ thlds ] , one gets that , for the convergence in distribution , @xmath252 holds for any function @xmath126 with finite support on @xmath90 . by using the stationarity of @xmath86 and lebesgue s theorem ,
one obtains @xmath253 the theorem is proved .
since a job arriving at time @xmath46 is not downgraded if @xmath254 , one obtains the following corollary .
[ corol ] as @xmath23 goes to infinity , the probability that , at equilibrium , a job is not downgraded in this allocation scheme is converging to @xmath255 defined in proposition  [ fp ] , @xmath256
we assume in this section that @xmath99 , as defined in proposition  [ propm ] , so that @xmath92 is an ergodic markov process .
the goal of this section is to derive an explicit expression of the invariant distribution @xmath101 on @xmath90 of @xmath92 . at the same time
, proposition  [ propfp2 ] below gives the required argument to complete the proof of proposition  [ fpprop ] on the characterization of the fixed point of the dynamical system .      in the following we denote by @xmath257 a random variable with distribution @xmath258 .
for @xmath259 , we will use the notation @xmath260 for sake of simplicity , we will use @xmath261 and @xmath262 .    with the notation
@xmath263 the random variable @xmath257 is such that @xmath264 where @xmath265 and @xmath266 are polynomials defined by @xmath267,\\      \displaystyle    p_2(z )   = \sum\limits_{j=1}^j \left[\rule{0mm}{4 mm }               \lambda_j z^{{a_j } + a_j } + \mu_j \ell_j z^{{a_j}-a_j } -(\lambda_j + \mu_j \ell_j ) z^{a_j } \right ] .
\end{cases}\ ] ]    for @xmath268 define @xmath269 such that @xmath270 , for @xmath271 .
equilibrium equations for @xmath92 give the identity @xmath272 where @xmath94 is the @xmath93-matrix of @xmath92 given by equation  .
after some simple reordering , one gets the relation @xmath273 by using the definition of @xmath274 and @xmath275 , equation   can be rewritten as equation  .
[ propfp2 ] if @xmath103 then @xmath276 in particular if @xmath277 is given by relation   then @xmath278    note that the right - hand side of the last relation is precisely @xmath255 of relation   which is the result necessary to complete the proof of proposition  [ fpprop ] .    with the same notations as before , from relation  , @xmath279 holds for @xmath280 , with @xmath281 . by definition of @xmath282 and @xmath283 ,
@xmath284 since @xmath15 is a zero of @xmath265 and @xmath266 , this gives the relation @xmath285 using the expression of @xmath286 , with some algebra , one gets @xmath287 the proposition is proved .
relation   is valid on the unit circle , however the function @xmath288 ( resp .
@xmath289 ) is defined on @xmath290 ( resp .
@xmath291 ) .
this can then be expressed as a wiener - hopf factorization problem analogous to the one used in the analysis of reflected random walks on @xmath89 .
this is used in the analysis of the @xmath292 queue , see chapter  viii of asmussen  @xcite or chapter  3 of robert  @xcite for example . in a functional context , this is a special case of a riemann s problem , see gakhov  @xcite . in our case
, this is a random walk in @xmath90 , with a drift depending on the half - space where it is located .
the first ( resp .
second ) condition in the definition of the set @xmath250 in definition   implies that the drift of the random walk in @xmath293 ( resp . in @xmath89 )
is positive ( resp .
negative ) .
the first step in the analysis of equation   is to determine the locations of the zeros of @xmath265 and @xmath266 .
this is the purpose of the following lemma .
[ lemma1][lemma2](location of the zeros of @xmath265 and @xmath266 ) let @xmath38 be in @xmath250 .    1 .
polynomial @xmath266 has exactly two positive real roots @xmath15 and @xmath2940,1[$ ] .
there are @xmath295 roots in @xmath296 and @xmath295 roots whose modulus are strictly greater than  @xmath15 .
polynomial @xmath265 has exactly two positive real roots @xmath15 and @xmath297 .
the @xmath295 remaining roots have a modulus strictly smaller than  @xmath15 .
one first notes that @xmath266 is a polynomial with the same form as the @xmath126 defined by equation  ( 13 ) in bean et al .
@xcite ( with @xmath298 , @xmath299 and @xmath300 ) .
the roots of @xmath93 are exactly the roots of @xmath126 .
lemma  2.2 of bean et al .
@xcite gives assertion  ( _ i _ ) of our lemma .
the proof of assertion  _ ( ii ) _ uses an adaptation of the argument for the proof of lemma  2.2 of bean et al .
define the function @xmath301 . recall that @xmath265 is a polynomial with degree @xmath302 .
there are exactly two real positive roots for @xmath265 .
indeed , @xmath303 and it is easily checked that @xmath126 is strictly concave with @xmath304 since @xmath99 , by the second condition in definition  . hence @xmath265 has a real zero @xmath305 greater than @xmath15 .
let @xmath306 be fixed , note that @xmath307 .
define @xmath308 so that @xmath309 .
fix some @xmath310 . by expressing these functions in terms of real and imaginary parts ,
@xmath311 one gets @xmath312 with @xmath313 cauchy - schwarz s inequality gives the relation @xmath314 since @xmath315 for @xmath316 , @xmath317 .
thus , @xmath318 since @xmath319 , @xmath320 can be chosen so that @xmath321 . from the above relation and equation
, one gets that for @xmath322 , the relation @xmath323 holds . by rouch s theorem ,
one obtains that , for any @xmath324 , @xmath265 has exactly @xmath325 roots in @xmath326 .
one concludes that @xmath265 has exactly @xmath325 roots in @xmath327 .
it is easily checked that if @xmath281 and @xmath328 then the real part of @xmath329 is positive , hence @xmath330 can not be a root of the polynomial @xmath265 .
consequently , @xmath265 has exactly @xmath295 roots in @xmath290 .
the lemma is proved .
[ def2 ] for @xmath331 , denote by @xmath332 the set of the zeros of @xmath333 different from @xmath15 .
define @xmath334 with @xmath49 and the same notations as before . by definition ,
function @xmath335 is holomorphic in @xmath290 and @xmath291 and , from relation  , is continuous on @xmath336 .
the analytic continuation theorem , theorem  16.8 of rudin  @xcite for example , gives that @xmath335 is holomorphic on @xmath337 .
for @xmath338 , @xmath339 since the cardinality of @xmath340 ( resp .
@xmath341 ) is @xmath342 ( resp .
@xmath343 ) , the holomorphic function @xmath335 is therefore bounded on @xmath337 . by liouville
s theorem , @xmath335 is constant , equal to @xmath344 .
therefore @xmath345 recall that @xmath346 is a generating function , in particular @xmath347 . plugging the previous expressions for @xmath288 and @xmath289 in @xmath348 ,
one gets the relation @xmath349 hence , using equation  , @xmath350 where @xmath351 is introduced in definition  [ defla ] .
note that @xmath352 is positive .
we can now state the main result of this section .
[ invariant ] if @xmath99 defined by relation  , then the invariant measure @xmath353 can be expressed , for @xmath354 , as @xmath355 where @xmath305 is defined in lemma  [ lemma1 ] , and @xmath265 and @xmath266 by relation  , @xmath356 for @xmath357 , @xmath358 is the coefficient of degree @xmath359 of the polynomial @xmath360    note that , for @xmath361 , @xmath362 for @xmath338 , @xmath363 since @xmath364 by lemma  [ lemma1 ] , @xmath289 has the following partial fraction decomposition @xmath365 denote @xmath366 then @xmath367 one concludes by using the expression of @xmath352 obtained before .
using the probability generating function @xmath369 of @xmath370 from equation  , one can derive an explicit expression of the mean , the variance and the skewness of such distribution .
the skewness of a random variable @xmath371 is a measure of the asymmetry of the distribution of @xmath371 , @xmath372 ^ 3)}\ ] ] see doane and seward  @xcite for example .
[ mean_variance_skew ] if @xmath373 is a random variable with distribution @xmath370 then @xmath374 where , for @xmath375 , @xmath376 and @xmath377 with @xmath378 defined in proposition  [ invariant ] .
the proof is straightforward , modulo some tedious calculations of the successive derivatives of @xmath369 evaluated at @xmath15 .
figure  [ figdist ] shows that the distribution of @xmath379 is significantly asymmetrical .
for this example @xmath380 , @xmath381 and @xmath382 .     with the parameters @xmath383 , @xmath384 , @xmath385 , @xmath386 and @xmath387 .
in this case , a request which can not be accommodated is rejected right away . recall that , with probability @xmath15 , our algorithm does not reject any request .
the purpose of this section is to discuss the price of such a policy . intuitively , at equilibrium the probability @xmath388 of accepting a job at requested capacity in a pure loss system is greater that the corresponding quantity @xmath389 for the downgrading algorithm .
see proposition  [ propcmp ] below . a further question is to assess the impact of such policy , i.e. the order of magnitude of the difference @xmath390 .    under the same assumptions about the arrivals and under the condition @xmath391 with @xmath392 ,
then , as @xmath23 gets large , the equilibrium probability that a request of class @xmath19 is accepted in the pure loss system is converging to @xmath393 , where @xmath394 is the unique solution of the equation @xmath395 see kelly  @xcite .
consequently , the asymptotic load of accepted requests is given by @xmath396 under the downgrading policy , the equilibrium probability that a job is accepted without degradation is given by @xmath255 , the asymptotic load of requests accepted without degradation is @xmath397 for @xmath398 .
note that , when the service rates are constant equal to @xmath15 , then @xmath388 ( resp .
@xmath389 ) is the asymptotic throughput of accepted requests ( resp . of non - degraded requests ) .
the representation of these quantities gives that the relation to prove is equivalent to the inequality @xmath400 by using the fact that @xmath401 and equation  , it is enough to show that the quantity @xmath402 is positive .
but this is clear since @xmath403 and the terms of both series of the right hand side of this relation are non - negative due to the fact that @xmath404 .
numerical experiments have been done to estimate the difference @xmath390 , see figure  [ figccmp ] .
the general conclusion is that , at moderate load under condition  ( @xmath405 ) , the downgrading algorithm performs quite well with only a small fraction of downgraded jobs .
as it can be seen this is not anymore true for high load where , as expected , most of requests are downgraded but nobody is lost .
we consider now a link with large bandwidth , @xmath406 gbps , in charge of video streaming .
requests that can not be immediately served are lost .
video transmission is offered in two standard qualities , namely , _ low quality _ ( lq ) and _ high quality _
( hq ) . from aorga
_ et  al . _
@xcite , the bandwidth requirement for youtube s videos at 240p is 1485 kbps , and for 720p it is 2737.27 kbps .
using the values above , after renormalization , one takes @xmath16 , @xmath407 and @xmath408 , @xmath409 .
jobs arrive at rate @xmath410 in this system asking for hq transmission , but clients accept to watch the video in lq .
in particular @xmath411 .
service times are assumed to be the same for both qualities and taken as the unity , @xmath412 .
condition   is satisfied when @xmath413 we define @xmath414 , with @xmath415 .
the quantity @xmath416 is defined as the largest value of @xmath417 such that the loss probability of a job is less than @xmath56 . with the notations of section  [ secinv ] , we write @xmath418 note that this is an approximation , since the variable @xmath379 corresponds to the case when the scaling parameter @xmath23 goes to infinity .      by using the explicit expression of the distribution of @xmath379 of proposition  [ invariant ] , figure  [ fig_alpha ] plots the threshold @xmath419 that ensures a loss rate less than @xmath420 as a function of @xmath420 , for several values of @xmath410 . in the numerical example , taking @xmath421 is sufficient to get a loss probability less than @xmath422 .
now let @xmath423 be the value of @xmath255 defined by corollary  [ corol ] for @xmath424 . recall that @xmath425 is the asymptotic equilibrium probability that a job is not downgraded is given by relation  , @xmath426 for comparison
, @xmath427 is defined as the corresponding acceptance probability when no control is used in the system .
we show in figure  [ fig_down ] the relation between these quantities and the workload @xmath410 , for fixed loss rates of @xmath428 , @xmath429 and @xmath430 .
we have @xmath431 , see robert  ( * ? ? ?
* proposition  6.19 ) .
the difference @xmath432 can be seen as the fraction of jobs which are downgraded for our policy but lost in the uncontrolled policy .
intuitively it can be seen as the price of not rejecting any job .
notice also that the curves plotting @xmath423 for @xmath433 , @xmath429 , @xmath430 are close and that @xmath427 is larger than @xmath255 .
one remarks nevertheless that , for high loads , the system can not hold these demands , because our policy is no longer effective .
javier aorga , saioa arrizabalaga , beatriz sedano , maykel alonso - arce , and jaizki mendizabal .
s dash implementation analysis . in _ proceedings of the 19th international conference on communications _ , volume  50 of _ recent advances in electrical engineering series _
, pages 6166 , zakynthos , ionion , greece , 06 2015 .
fabrice guillemin , thierry houdoin , and stphanie moteau .
volatility of youtube content in orange networks and consequences . in _ proceedings of ieee international conference on communications ,
icc 2013 , budapest , hungary , june 9 - 13 , 2013 _ , pages 23812385 , 2013 .
fabrice guillemin , bruno kauffmann , stphanie moteau , and alain simonian .
experimental analysis of caching efficiency for youtube traffic in an isp network . in _ 25th international teletraffic congress ,
itc 2013 , shanghai , china , september 10 - 12 , 2013 _ , pages 19 , 2013 .
christian sieber , tobias hofeld , thomas zinner , phuoc tran - gia , and christian timmerer .
implementation and user - centric comparison of a novel adaptation logic for dash with svc . in _
im13 _ , pages 13181323 , 2013 .
stan zachary and ilze ziedins .
loss networks . in richard  j. boucherie and nico  m. van dijk ,
editors , _ queueing networks _ , volume 154 of _ international series in operations research & management science _ , pages 701728 .
springer us , 2011 .