the intuitive meaning of _ heat _ and _ work _ in thermodynamics is that of two types of energetic resources , one fully controllable and useful , the other uncontrolled and wasteful . an impressive effort has been devoted to provide a consistent mathematical characterisation of these notions within a quantum mechanical description of physics @xcite
this is a challenge since in contrast to other thermodynamic quantities , such as internal energy and entropy , heat and work are not properties of individual states of a system .
they are defined for _ continuous processes _ connecting different states  @xcite , implying that their statistical fluctuations can not be described in terms of a single system observable .
two - point correlation functions characterising the correlations along process paths are required - a problematic territory for quantum mechanics where definite trajectories can not be fixed unless the system is continuously measured . resolving these issues
has been the topic of a number of publications that have formulated quantum trajectory approaches @xcite .
in contrast here we focus on the _ mean _ values of heat and work where the analysis simplifies but still requires careful thought .
we will adopt the identification of the system s internal energy with @xmath0 $ ] where @xmath1 is the density matrix describing the state of the system at given time , and @xmath2 is its instantaneous hamiltonian .
clearly , a proper definition of this hamiltonian is in general problematic !
if the system is coupled to an environment the non - equilibrium behaviour of a general open system makes the definition of the system s hamiltonian ambiguous @xcite both , mathematically and experimentally
. ultimately the choice of the hamiltonian one assigns to the system must rely on the set of operations and observables one can access experimentally . in many situations of physical interest @xmath2
can be identified with the bare system hamiltonian or an effective system hamiltonian that incorporates the effect of the environment .
while the environment degrees are in principle uncontrolled , full control can be exerted over the temporal  variation " of the system hamiltonian .
for instance , the size of a container in which steam is pumped can be freely chosen and a piston can be attached to the container that can push the wheels of a train . a formal definition of mean heat and work is then obtained by considering an infinitesimal change of the internal energy @xmath3 =   { { \rm tr}}[\rho \ , { d}h ] + { { \rm tr } } [ { d}\rho \ , h]\ ; , \end{aligned}\ ] ] associated with the time evolution of the system which brings its density matrix from @xmath1 to @xmath4 while the hamiltonian varies from @xmath2 to @xmath5 . the origin for the change of @xmath1 may here be due to both , the variation of @xmath2 induced by the experimenter and by the dynamics due to the coupling with the environment .
the possibility of externally controlling @xmath2 suggests to identify the first term on the r.h.s . of eq .
( [ firsteq ] ) with the average work done by the experimenter during the evolution .
the second term describes the internal energy change due to a reconfiguration of the system , i.e. a variation of the system s density matrix .
this is an energy contribution over which the experimenter has no direct control and this is why it is associated with heat .
the infinitesimal average _ heat absorbed by the system _ and the infinitesimal average _ work done on the system _ @xcite are therefore defined as @xmath6 \quad \mbox{and } \quad { { \delta}}w : = { { \rm tr } } [ \rho \ ,   { d}h]\;,\end{aligned}\ ] ] with the symbol @xmath7 indicating that heat and work are in general no full differentials , i.e. they do not correspond to observables .    while the first law of thermodynamics states that the sum of the two average energy types is the average internal energy , @xmath8 the _ split _ into these two types of energies is crucial as it allows the formulation of the second law of thermodynamics .
a fundamental law of physics , it sets limits on the work extraction of heat engines and establishes the notion of _ irreversibility _ in physics .
the second law can be phrased in form of clausius inequality : @xmath9 stating that the change in a system s entropy must be larger than the average heat absorbed by the system during a process .
while the first law of thermodynamics is fundamental for any process , the second law was originally stated for processes that _ start and end in equilibrium_. recently , the non - equilibrium work relation due to jarzynski has been used to argue that the second law should also hold for any process starting from equilibrium , at temperature @xmath10 , but ending in an arbitrary non - equilibrium state @xcite . however
, no conclusive argument has yet established the most general set of dynamical processes that obey the clausius inequality @xcite .    extending the infinitesimal scenario to _ finite , continuous processes _ in which the temporal evolution of @xmath11 and @xmath12 in time @xmath13 is known , the mean heat and work can be found by integrating over the trajectory taken from @xmath14 and @xmath15 to @xmath16 and @xmath17 , i.e. @xmath18 \ ; ,   \label{eq : q } \\
w & : = & \int_{0}^{\tau } \ , { d}t \ , { { \rm tr } } [ \rho(t ) \ ,   \dot { h}(t)]\ ; , \label{eq : q+w}\end{aligned}\ ] ] while the first law becomes @xmath19 = q + w\;.\end{aligned}\ ] ] the mathematical consistency of the above expressions and their compatibility with the predictions of thermodynamics have been verified for many models , for example , for processes that are induced by markovian master equations  @xcite .
there are two paradigmatic examples of _ all work _ and _ all heat _ processes that we introduce here and which will become important in the later part of the manuscript .
the first process is a unitary process , which we will also refer to as _ closed _
, where the ( non - equilibrium ) evolution of the state is given by the schrdinger equation , @xmath20\;. \label{inuni}\end{aligned}\ ] ] mean heat and work are then @xmath21 \ , h(t ) ]   = 0\ ; , \\
w_{unitary } & = & \delta u\ ; , \label{example1}\end{aligned}\ ] ] consistent with the physical intuition that _ no _ heat has been provided to the system during the evolution .
the second example is a system that evolves through the action of a dissipative , i.e. _ open _ , markov process via a master equation  @xcite , @xmath22 + { \cal l}(\rho(t))\ ; , \label{ddf}\end{aligned}\ ] ] with @xmath23 being the dissipative lindblad term . under the assumption that the typical time scales associated with the time - independent @xmath2 are much shorter than those associated with @xmath23 we can treat the system as almost isolated and use eq.([firsteq ] ) to compute its internal energy . in this limit eq .
( [ eq : q+w ] ) is valid with the hamiltonian just being the time - independent @xmath2 , @xmath24 - { { \rm tr}}[\rho(0 ) \ , h ] = \delta u , \,\ , \label{identity111}\end{aligned}\ ] ] which is in full agreement with the physical intuition that no work has been performed on the system .
while these examples constitute special cases of continuous processes the heat and work in a general process depend intimately on the exact details of the process .
however , the caveat with this viewpoint is that in most real life applications one does _ not _ know what the dynamics of the state of the system is nor what the appropriate local hamiltonian is at all times .
importantly , this is not just due to our ignorance of what happens at the quantum level .
quantum physics has strong fundamental limitations on what we _ can know _ without choosing a measurement apparatus , measuring the system and interpreting the data .
moreover , if the system is indeed measured then the experimenter s choice of what degrees of freedom she actually measures will effect what the _ measured _ heat and work will be .
in other words , we propose that there is no _
one _ average heat and work for a particular process , there are different sensible outcomes to this question and the answer depends on the choice of system hamiltonians in time , @xmath12 , that corresponds to specific measurement choices .
the aim of this paper is to show that it is possible to formulate a general second law independently of these choices . to achieve this
we will depart entirely from the traditional continuous trajectory approach and propose a rather drastic but pragmatic change of perspective .
we develop a consistent framework of mean heat and work for _ discrete thermodynamic processes_. the rationale for this approach is that while the true process is continuous , observations we make on the system are almost always discrete .
( we will neglect here the possibility of monitoring through continuous weak measurements . ) for discrete snapshots of the dynamics , we find that by decomposing the transition into possible sequences of two fundamental primitives , it is possible to define heat and work for the discrete process in a way that is experimentally and mathematically clear .
this allows us to establish a general second law for discrete processes between equilibrium and non - equilibrium states and the analysis of a discrete carnot cycle , where we uncover the usual carnot efficiency .
the paper is structured as follows . in sec .
[ sec : entropy ] we review the traditional perspective on the second law and the definition of entropy . in sec .
[ sec : configuration ] we define the dynamical configuration space of a system that allows us to formulate a notion of two primitives for discrete processes in sec .  [
sec : duts+dtts ] , the discrete unitary and discrete thermalising transformations ( duts and dtts ) .
[ sec:2ndlaw ] contains the main results of the paper .
first we show that entropic inequalities when applied to discrete trajectories formed by concatenating duts and dtts yields the second law of thermodynamics in the clausius formulation .
we then derive two consequences : we find the minimum and maximum heat for a single dut and dtt sequence and prove the existence of a discrete trajectory , formed by sequences of duts and dtts , that connects two given thermodynamical configurations while asymptotically saturating the clausius inequality .
finally we identify a discrete trajectory that connects the same initial and final configurations as the continuous trajectory through a sequence of duts and dtts , and which approximates the continuous heat . in sec .
[ sec : efficiency ] we derive the thermal efficiency of a discrete cycle , the carnot efficiency , and conclude in sec .
[ sec : conc ] .
in 1865 clausius established that the overall heat flow in any cyclic , reversible process vanishes , implying that the integral over any non - cyclic process must be path independent .
this led him to define the state function _
entropy _ ,
@xmath25 , and the entropy change , @xmath26 , between the final and initial point of a reversible process , @xmath27 clausius also showed that any cyclic process , reversible or irreversible , obeys @xmath28 this relation is the basis for a formulation of the second law of thermodynamics , known as the _ clausius - inequality_. it is a statement for all thermodynamic processes , not just cyclic ones , that start from equilibrium at temperature @xmath10 , @xmath29 and it simplifies to @xmath30 when the system interacts with a bath at constant temperature , @xmath10 . in this form
clausius inequality establishes the existence of an upper bound to the heat received by the system .
clearly , clausius s goal was to characterise different forms of _ energy _ and their interconversion . however , by formulating the second law of thermodynamics he defined a new quantity : entropy .
in contrast , in modern information theory the focus is on the _ state _ of a system .
entropy is here used as the central physical quantity to measure the amount of information of a state , while heat and work , and energy in general , have no well - defined purpose for the interpretation of information processing .
this opens the possibility of turning clausius original argument around !
it allows us to use the entropy change in discrete quantum processes to _ define _ the average heat , and work . before we proceed ,
let us first highlight that non - trivial entropy bounds exists for any process between two states .
a state @xmath1 describes an amount of information , quantified by the
_ von neumann entropy _ , @xmath31 $ ] .
the evolution of a quantum system from an initial state @xmath32 to a final state @xmath33 through an arbitrary process , or _ quantum channel _ , has a meaningful associated entropy change , @xmath34 + { { \rm tr}}[\rho_i \ln \rho_i ] , \end{aligned}\ ] ] which quantifies the change of the encoded amount of information .
the entropy change is non - trivially bounded from above and below by virtue of the positivity of the _ relative entropy _
( classically kullback - leibler divergence @xcite ) .
the relative entropy , @xmath35 , between two states @xmath36 and @xmath37 characterises the number of additional bits required to encode @xmath36 when using the diagonal basis of @xmath37 , rather than the diagonal basis of @xmath36 .
it is defined as  @xcite @xmath38 - { { \rm tr}}[\rho_1 \ln \rho_2]\;,\end{aligned}\ ] ] and is a positive quantity @xmath39 intuitively , the relative entropy is similar to a distance measure , however , it is important to keep in mind that it is asymmetric @xmath40 . rewriting the entropy change , eq .
( [ eq : entropychange ] ) , in two ways @xmath41   +   s(\rho_i\| \rho_f ) \\           &
= &   -   { { \rm tr } } [ \delta \rho \ , \ln \rho_i ]   - s(\rho_f\| \rho_i ) ,    \label{eq : v - entropy}\end{aligned}\ ] ] a lower and upper bound on the entropy change emerge @xmath42 \geqslant \delta s(\rho_i,\rho_f ) \geqslant   -   { { \rm tr } } [ \delta \rho \ , \ln \rho_f ] .\end{aligned}\ ] ] from the information theory point of view , bounds on the entropy change are important in their own right as they characterise how much information is lost or gained .
if we now assume the special case that @xmath33 is a thermal state for the hamiltonian @xmath43 at an inverse temperature @xmath44 then the lower bound becomes @xmath45.\ ] ] interpreting @xmath46 $ ] as the heat of the discrete process , the above expression would constitute exactly the second law of thermodynamics .
this is exactly what we will pursue in sec .
[ sec : duts+dtts ] , e.g. in eq .
( [ dttheat ] ) .
from ( [ eq : entropybounds ] ) it is apparent that also an upper bound on the entropy change exists that is rarely discussed in the literature . this maximum value of the entropy change is enforced to ensure that any reverse process , from @xmath33 to @xmath32 , also obeys the second law .
\geqslant \delta s(\rho_i,\rho_f ) $ ] becomes @xmath47,$ ] with @xmath48 being the state increment for the reverse process . ]
to assist our discussion of discrete quantum processes we introduce the concept of configuration space , following the spirit of  @xcite , and propose a graphical representation for that space , see fig .
[ fig : config ] .
let @xmath25 be the quantum system under investigation , with @xmath49 its hilbert space , @xmath50 the set of linear operators on @xmath49 , and @xmath51 the set of density matrices on  @xmath49 .
we define the _ dynamical configuration space _ @xmath52 of @xmath25 as the set formed by the pairs @xmath53 with @xmath54 a density matrix = 1 $ ] . ] and @xmath55 a hermitian operator on @xmath49 whose spectrum is bounded from below .
points in the dynamical configuration space @xmath56 are called `` configurations '' to distinguish them from `` states '' , @xmath1 .
the evolution of the system is described by discrete trajectories in @xmath52 :    a _ discrete trajectory _
@xmath57 is defined as an ordered list of elements of @xmath52 that describes the succession of configurations , with each element @xmath58 containing both the density matrix @xmath1 of @xmath25 and the local hamiltonian @xmath2 of @xmath25 at that specific instance of the evolution .
we stress that both @xmath1 and @xmath2 of a configuration point @xmath59 have a clear experimental meaning .
@xmath1 is the density matrix that one would reconstruct by state tomography , i.e. the preparation of many copies of the same state @xmath1 and the full tomographic measurement of its properties .
the hamiltonian of the system , @xmath2 , is determined by the set of projective measurements @xmath60 the experimenter performs on the system to `` measure the energy '' together with the interpretation of the corresponding energy eigenvalues , @xmath61 , so that @xmath62 . ( the choice of the measurement and interpretation can be motivated by a process tomography on the hamiltonian at any point in time .
for this the system needs to be decoupled from the rest of the universe at that instance and evolve for a complete set of states for a short time interval @xmath63 through the action of @xmath2 . by measuring the final states of the evolution the unitary @xmath64 and
hence @xmath2 can be uncovered . )
it is then straightforward to establish the internal energy and the entropy for each point in dynamical configuration space .    for each configuration @xmath65 in @xmath52
we define the internal energy as @xmath66,\end{aligned}\ ] ] and the entropy as the von neumann entropy @xmath67 of @xmath1 , @xmath68.\end{aligned}\ ] ]    a central notion in thermodynamics is the canonical gibbs state , often also referred to as _ thermal state _ or _ equilibrium _ state .
since a thermal state , @xmath1 , at temperature @xmath10 is well - defined only with respect to a certain hamiltonian , @xmath2 , it is actually the _ configuration _ @xmath69 that is thermal .
an element @xmath70 describes a _ thermal equilibrium configuration _ ( or briefly _ thermal configuration _ ) if @xmath1 is a gibbs state of the hamiltonian , @xmath2 , for some finite inverse temperature @xmath71 , i.e. @xmath72 with @xmath73 $ ] being the associated partition function . to be finite . in the zero temperature limit
the associated density matrix @xmath1 of the thermal configuration @xmath74 approaches the projector on the ground state of @xmath2 .
the limiting case does however not belong to the set of the thermal configurations but to their closure .
this definition ensures that the density matrices @xmath1 of the thermal configurations @xmath75 are always full rank and hence strictly positive , i.e. the state has no zero eigenvalue . ] in the following the thermal configurations will be indicated by @xmath76 with the subscript @xmath77 specifying the configuration s temperature .    thermal configurations @xmath78 are very special .
firstly , for a given hamiltonian , @xmath2 , from all possible states that have a fixed value of the internal mean energy , @xmath79 $ ] , the thermal state maximises the entropy @xmath80 $ ] .
in other words @xmath81 is the most unbiased configuration one can assert to the system given only the knowledge of @xmath82 @xcite .
another insightful characterisation of thermal configurations in terms of a property called _ complete passivity _ was achieved by lenard @xcite , building on ideas of pusz and woronowicz @xcite .
complete passivity captures the intuitive notion of thermal equilibrium .
a configuration @xmath58 is said to be _ passive _ if no work can be extracted from the system , i.e. @xmath83 cf .
( [ eq : q+w ] ) , when subjected to any unitary transformation for a time @xmath63 generated by an arbitrary time - dependent hamiltonian with the sole constraint that @xmath84 .
a configuration @xmath85 is _ completely passive _ if all its regularised configurations @xmath86 are passive for @xmath87 . here
the unitary operations entering in this definition are generated by _
arbitrary _ time - dependent hamiltonians @xmath88 that satisfy the constraint @xmath89 .
i.e. during @xmath900,\tau[$ ] , @xmath88 is allowed to introduce any sort of interactions between the various copies of @xmath1 .
it turns out that while all @xmath69 with commuting @xmath1 and @xmath2 are passive configurations , only thermal configurations @xmath75 and the ground state are _ completely passive _ @xcite . to stress the special role of thermal configurations graphically ,
they are denoted as red circles while all configuration that are not thermal will be called _ non - equilibrium _ configurations and are depicted as blue squares , see fig .
[ fig : config ] .
[ [ a - note - on - gauge . ] ] a note on gauge .
+ + + + + + + + + + + + + + + +    given a generic state @xmath91 which is full rank , there always exists a hermitian operator @xmath92 and a @xmath93 such that @xmath78 is thermal is not full rank there is no thermal configuration @xmath75 whose density matrix exactly coincides with @xmath1 .
however , it is still possible to find gibbs configurations whose density matrices are arbitrarily close to @xmath1 .
] at the inverse temperature @xmath77 .
in fact the problem admits infinite solutions , since there are two gauge freedoms for the choice of @xmath2 and @xmath77 .
firstly , the zero - point of the energy scale can be chosen arbitrarily by a constant @xmath94 .
the second gauge , @xmath95 , is the temperature itself , which sets a spacing of the energy scale . the pair @xmath96 is equivalent to @xmath97 in that they have the same set of thermal configurations .
in particular the internal energy  ( [ defu ] ) and the entropy  ( [ defs ] ) of such configurations do not depend on the values of @xmath94 and @xmath95 . in the following
we will assume that both gauges have been chosen to some fixed values .
among all possible discrete transformations in dynamical configuration space @xmath52 we identify two classes that admit a clear analysis of the energetic balance and can be used as primitives for general discrete dynamical evolutions .
these transformations map an initial configuration @xmath98 to a final configuration @xmath99 , denoted as @xmath100 , with the only constraint that @xmath101 for some _ unitary _ @xmath102 .
no constraint is posed on the relationship between @xmath103 and @xmath43 .
the definition of duts is inspired by continuous unitary transformations , see eq .
( [ eq : unitary ] ) . there
the system is thermally isolated while evolving through the action of some external force that modifies the hamiltonian in time , @xmath12 , and generates arbitrary unitary evolutions @xmath104 where @xmath57 indicates time ordering .
for the discrete mapping @xmath100 no assumption is made on the time duration @xmath63 nor the specific form of @xmath12 which realises the unitary @xmath102 .
in analogy to the continuous situation , we define the work done on the system due to a dut identical to the total variation of the internal energy , @xmath105 , i.e. @xmath106 ,        \end{split}\ ] ] while no heat is associated with duts , i.e. @xmath107    a special class of duts are the _ discrete unitary quenches _ ( duqs ) . experimentally , a quench is an abrupt , instantaneous change of the system hamiltonian which leaves the system density matrix unchanged , i.e. @xmath108 , @xmath109 .
we also note that for full rank states @xmath32 a duq can be found that brings @xmath110 to a final configuration that is thermal , @xmath111 , with the hamiltonian defined as @xmath112 .
three duts are shown , depicted as blue arrows , each ending at a final configuration @xmath113 for @xmath114 .
the special case where @xmath115 is transformed into @xmath116 is an example of a duq .
also shown are two dtts , depicted as red fuzzy arrows , originating from @xmath115 and ending at thermal configurations @xmath117 and @xmath118 where @xmath119 and @xmath120 are inverse temperatures associated with the thermal configurations .
, title="fig : " ]    duts will be denoted as blue arrows in the graphical representation of the configuration space , see fig .
[ fig : duts&dtts ] . these
work arrows " indicate the closed nature of the transformation .
the duts characteristic properties are summarised here :    1 .
duts can start from and end at either non - thermal or thermal configurations .
2 .   duts change the state by a unitary and no entropy change is induced by a dut , i.e. @xmath121 .
duts can be concatenated to produce another dut .
any dut has an inverse that is also a dut .
dtts are defined as those transformations which take a generic @xmath122 into a gibbs state at some inverse temperature @xmath77 , @xmath123 , without modifying the system hamiltonian @xmath2 .
the prototypical example of a dtt is an arbitrary thermalisation process in which the system is put into a weak thermal contact with a reservoir at inverse temperature @xmath77 and left until its state becomes time - independent .
physically this is realised by the system weakly interacting with a large external environment .
the requirement of a _ small _ coupling ensures a clear definition of a local system hamiltonian .
for example , the dissipative evolution @xmath124 defined in eq .
( [ ddf ] ) with the additional assumption that the lindblad term @xmath23 commutes with @xmath2 will for @xmath125 converge to @xmath36 . in analogy with this continuous process , we assume that the internal energy change due to a dtt is a result solely of the heat absorbed by the system @xmath126 ,      \end{split}\ ] ] while the work of a dtt vanishes , @xmath127 this non - trivial expression of the heat is exactly of the form that we expected from the bounds on the entropy in eq .
( [ eq : entropy ] ) , and it will be the basis for deriving a general second law for discrete quantum trajectories in the next section .
dtts will be denoted as horizontal red arrows in the graphical representation , see fig .
[ fig : duts&dtts ] .
the fuzziness of these  heat arrows " indicates the open nature of the transformation .
the characteristic properties of dtts are summarised here :    1 .
dtts always end in thermal configurations .
dtts do not change the hamiltonian .
the entropy change associated with a dtt is in general nonzero , i.e. @xmath128 4 .
dtts can be concatenated to produce another dtt .
the inverse of a dtts is in general not a dtt .
only if the initial configuration @xmath115 was already thermal , can the action of a dtt be reversed by another dtt .
having identified two fundamental process primitives in configuration space , we now focus on more complex discrete trajectories .
these can start from equilibrium or non - equilibrium configurations , however , we restrict ourselves to discrete trajectories that can be obtained by concatenating dut and dtts . within this scenario
we will be able to formulate a general second law for discrete quantum processes , that does not require detailed knowledge of the continuous state and local hamiltonian evolution .
let us begin with the simplest non trivial discrete transformation which can be used to connect two equilibrium configurations .
we consider a trajectory that starts from a thermal configuration @xmath129 and ends at a final thermal configuration @xmath130 via the action of a single dut followed by a dtt .
the heat of the discrete process can then be determined as the sum of the heats of each component , for both of which the heat is a well - defined quantity .
the dut first unitarily rotates the input density matrix to @xmath131 while the hamiltonian changes from @xmath103 to @xmath43 , ending in an intermediate ( not necessarily thermal ) configuration @xmath132 .
a dtt follows that brings @xmath133 to @xmath134 , resulting in the discrete overall trajectory @xmath135 shown in fig .
[ fig : dut+dtttraj ] .
( black arrow ) and discrete decomposition into a dut , @xmath136 ( blue arrow ) , to an intermediate point @xmath132 followed by a dtt , @xmath137 ( red arrow).,title="fig : " ]    while heat of process ( [ eq : dut+dtt ] ) is only exchanged during the dtt , the amount of exchanged heat depends on the duts unitary @xmath102 @xmath138.\end{aligned}\ ] ] clearly , the value of the heat depends on the choice of the unitary @xmath102 with the maximum and minimum heat given by @xmath139 where @xmath140 and @xmath141 are the eigenvalues of @xmath43 and @xmath103 ordered in decreasing order and @xmath142 the partition functions of the initial and final configuration .
the derivation of this expression and the corresponding unitaries @xmath143 and @xmath144 , are given in appendix [ sec : min&max ] .    however ,
for any possible choice of the dut connecting @xmath145 to the intermediate step @xmath133 , i.e. for any unitary transformation @xmath102 , a second law can be established by linking the heat and the entropy change .
the entropy change is bounded according to eq .
( [ eq : entropybounds ] ) , by @xmath146   \\          & = \beta_f \ ;   { { \rm tr}}[(\rho_f - v \ , \rho_i \ , v^{\dag } ) \ ; h_f ] .       \end{aligned}\end{aligned}\ ] ] implying @xmath147 thus the process ( [ eq : dut+dtt ] ) obeys a clausius - type inequality , cf .
( [ eq : clausius ] ) , which states that the heat absorbed by the system is upper bounded by the entropy change .
we now turn to discrete non - equilibrium processes for which establishing the clausius inequality in the continuous case has only recently been addressed @xcite . in our approach
this can be done by observing that given two generic configurations @xmath98 and @xmath148 in @xmath52 , it always possible to connect them via a discrete trajectory composed by three primitive steps which differs from the one given in eq .
( [ eq : dut+dtt ] ) only by a final duq transformation .
specifically we can write @xmath149 with intermediate configurations @xmath150 and @xmath151 .
notice that the first and the last step of  ( [ real1333 ] ) do not alter the entropy of the system , nor contribute to the heat exchange since they are duts .
this implies the identity @xmath152 and allows us to identify the heat associated with @xmath57 with the quantity @xmath153 .\ ] ] the lower bound of eq .
( [ eq : entropybounds ] ) can then be used to establish a clausius - type inequality for the discrete transformation  ( [ real1333 ] ) , i.e. @xmath154       = \beta_2 \ ; q({\cal t}),\end{aligned}\ ] ] where @xmath120 is the temperature of the intermediate configuration @xmath155 .
+   as a sequence of two dut+dtt transformations , via an intermediate thermal configuration , @xmath156 .
panel * b * shows the realisation of a general transformation @xmath157 through a sequence of dut+dtt transformations , via many intermediate thermal configurations , @xmath158.,title="fig : " ] + * b * +   as a sequence of two dut+dtt transformations , via an intermediate thermal configuration , @xmath156 .
panel * b * shows the realisation of a general transformation @xmath157 through a sequence of dut+dtt transformations , via many intermediate thermal configurations , @xmath158.,title="fig : " ]    the trajectories defined in eq .
( [ eq : dut+dtt ] ) and eq .
( [ real1333 ] ) are just specific choices of discrete trajectories connecting two configurations @xmath159 and @xmath160 .
we will now show that a clausius inequality , e.g. inequalities of the type ( [ eq : gg1113 ] ) , holds for general discrete processes as long as they can be decomposed in a _ sequence _ of dut+dtts steps . to show this
, we first consider the discrete trajectory , @xmath161 , pictured in panel * a * of fig .
[ fig : multiple ] where @xmath162 is transformed into @xmath163 via two dut+dtt transformations and a third thermal configuration @xmath164 , i.e. @xmath165 in this scenario the following inequality for the entropy holds , @xmath166 where @xmath167 and @xmath168 , and where eq .
( [ eq : gg1113 ] ) was used for the two dut+dtt transformations .
inequality  ( [ hhvv ] ) can immediately be generalised to an arbitrary number of intermediate dut+dtt steps connecting @xmath169 to @xmath170 .
specifically , consider a generic discrete trajectory @xmath57 composed of @xmath171 consecutive dut+dtt steps that pass through the thermal configurations @xmath172 as shown in panel * b * in fig .  [ fig : multiple ] .
then by expressing the total entropy increment @xmath173 as a sum of terms @xmath174 associated with the various steps of @xmath57 and applying eq .
( [ eq : gg1113 ] ) to each one of them , the clausius inequality becomes @xmath175 the generality of this derivation implies that sequences of discrete unitary and discrete thermalising transformations always fulfil a clausius type equation .    to formulate this as a lemma
, we introduce a useful discrete process quantity , @xmath176 , for a dut+dtt sequence , @xmath177 , \\          & =   \beta_{k+1 } \ , q(c_{k } ( \beta_{k } ) \stackrel{dut+dtt}{\longrightarrow } c_{k+1 } ( \beta_{k+1 } ) ) .
\end{split}\end{aligned}\ ] ] the quantity @xmath176 is the discrete analog to the continuous expression @xmath178 . for the trajectory @xmath179 the overall @xmath180 is obtained by summing over the @xmath176 contributions of the various steps , i.e. @xmath181 with @xmath182 and @xmath183 corresponding to the initial and final configurations , @xmath184 and @xmath185 , respectively .
then the lower entropy bound , eq .
( [ yyy1 ] ) , can be neatly expressed :    any trajectory @xmath57 made of sequences of dut+dtts fulfils a clausius inequality of the form @xmath186    while in general a single dut+dtt process can not saturate the equality , see appendix [ sec : min&max ] , we will now show that augmenting intermediate steps will always increase the r.h.s . of eq .
( [ yyy1 ] ) .
moreover , we find that in the limit of infinitely long sequences the asymptotic saturation of the inequality  ( [ yyy1 ] ) is always possible .      to show that the entropy bound eq .
( [ yyy1 ] ) can be saturated we construct a class of trajectories @xmath187 from a generic dut+dtt trajectory @xmath57 , as depicted in panel * b * of fig  [ fig : multiple ] , for which the functional @xmath188 is always larger than @xmath180 .
one class of trajectories @xmath187 is the trajectory identical to @xmath57 however with the step @xmath189 replaced with the sequence @xmath190 as shown in fig .
[ fig : augmenting ] , where @xmath191 has an intermediate density matrix @xmath192 with mixing probability @xmath1930,1[$ ] . is a well - defined thermal configuration as its state is by construction full rank . ]
the increment on the r.h.s . of ( [ eq : sl ] ) for the new trajectory @xmath194 , @xmath195 , see fig .
[ fig : augmenting ] , is then _ strictly positive _ for any @xmath196    @xmath197 -{{\rm tr } } [ \ln \rho_{k+1 } \ , ( \rho_{k+1 } - \rho_{m } ) ]   + { { \rm tr } } [ \ln \rho_{k+1 } \ , ( \rho_{k+1 } - \tilde{\rho}_{k } ) ] \nonumber\\       & >   - p s ( \tilde{\rho}_{k } \| \tilde{\rho}_{k } ) - ( 1-p ) \ ; s ( \rho_{k+1 }   \| \tilde{\rho}_{k } ) - p s(\rho_{k+1 } \|   \tilde{\rho}_{k } )   -   ( 1-p)\ ;   s(\rho_{k+1 } \| \rho_{k+1 } ) + s(\rho_{k+1 } \| \tilde{\rho}_{k } ) \\      & = 0 ,          \end{aligned}\ ] ]    where we have assumed @xmath198 , and used eq .
( [ middlepoint ] ) and the joint convexity of the relative entropy  @xcite , @xmath199 with equality _ iff _ @xmath200 .
we summarise this result in the following lemma :    adding intermediate thermal configurations @xmath201 ( see eq .  [ middlepoint ] ) to any trajectory @xmath57 results in a new trajectory @xmath202 with increased @xmath176 ,
i.e. @xmath203    having confirmed that it is possible for any given discrete trajectory to introduce intermediate steps such that the r.h.s .
( [ eq : sl ] ) increases , the task is now to show that the entropy bounds can be saturated by reiterating the procedure .
the proof relies on lower bounding @xmath176 and showing that the bound converges to the upper bound on @xmath176 , eq .
( [ eq : sl ] ) , in the limit of infinite steps .
the detailed derivation is given in appendix [ sec : satproof ] proving the following theorem :    [ lem : clausiussat ] let @xmath57 be a discrete trajectory connecting the initial gibbs configuration @xmath204 to the final gibbs configuration @xmath205 via a sequence of @xmath171 concatenated dut+dtt steps @xmath206 connecting the thermal configurations @xmath207 as in panel * b * in fig .
[ fig : multiple ] .
then a sequence of trajectories @xmath208 exists , obtained from @xmath57 by adding @xmath209 intermediate thermal steps , which saturates the clausius bound  ( [ yyy1 ] ) in the asymptotic limit , i.e. @xmath210     by a single dtt with heat @xmath211 , and by a sequence of two duq+dtt transformations via an intermediate thermal configurations , @xmath212 .
the two dtts have heats @xmath213 and @xmath214 , respectively.,title="fig : " ]      in the introduction we have seen that for continuous processes where consistent definitions of @xmath11 and of the local hamiltonian @xmath12 can be assigned for all @xmath13 , eq .
( [ eq : q ] ) defines the heat absorbed by the system .
we have already discussed the difficulties of knowing @xmath11 and identifying a proper local hamiltonian @xmath12 for the system .
however , in what follows we will assume that some  valid " continuous trajectory @xmath215 is given for which eqs .
( [ eq : q ] ) and  ( [ eq : q+w ] ) apply .
we now wish to identify a discrete trajectory that connects the same initial and final configurations as the continuous trajectory through a sequence of duts and dtts , and which approximates the continuous heat .
the analysis leads to the following theorem :    for a continuous process between two configurations @xmath216 and @xmath217 that obeys the clausius inequality , a discrete trajectory @xmath218 exists that connects the same configurations and has exactly the same heat as the continuous process .
_ proof : _ consider an infinitesimal heat increment along the continuous trajectory , @xmath219,\end{aligned}\ ] ] with @xmath11 and @xmath220 being the density matrices of two infinitesimally separated configurations on the trajectory . define the initial and final configuration for a discrete trajectory to be @xmath221 and @xmath222 . to compare the continuous heat  ( [ quantity ] ) with a discrete heat we need to identify a discrete trajectory , @xmath161 , connecting the same initial and final configuration as the continuous trajectory .
one example is the sequence @xmath161 shown as a solid line in fig .
[ fig : triangle ] , @xmath223 where @xmath224 and @xmath225 are equilibrium configurations requires @xmath33 to be full rank .
if this is not the case one can still define a trajectory ( [ trj ] ) with @xmath226 replaced by a full rank configuration which can be chosen to be arbitrarily close to @xmath226 . ] and @xmath227 is a non - equilibrium configuration . the inverse temperatures of the equilibrium configurations @xmath228 and @xmath229 are both chosen @xmath230 .
heat @xmath231 , @xmath232 ,      \end{split}\ ] ] is exchanged when passing from @xmath233 via a duq+dtt through the intermediate configuration @xmath133 , see fig .
[ fig : triangle ] .
heat @xmath214 , @xmath234,\ ] ] is exchanged when passing from @xmath235 .
therefore @xmath236     and @xmath226 , of the continuous process .
a discrete trajectory , @xmath161 , that connects @xmath115 and @xmath226 is also indicated ( solid ) . also shown is the closed loop discrete trajectory @xmath237 ( dotted ) .
the two thermal configurations @xmath238 and @xmath225 are both chosen with inverse temperature @xmath239 , as indicated in the circles .
, title="fig : " ]    on the other hand , the continuous heat increment @xmath240 can be decomposed into two heat contributions , @xmath241 = { { \rm tr}}[(\rho_2 - \rho_1 ) \tilde{h}_2 ] \\          & =   { { \rm tr } } [ ( { \rho}_2 -\tilde{\rho}_2 ) \tilde{h}_2 ] +   { { \rm tr } } [ ( \tilde{\rho}_2 -\rho_1 ) \tilde{h}_2 ]    \\          & = - { { \rm tr } } [ ( { \rho}_2 -\tilde{\rho}_2 ) \ln \tilde{\rho}_2   ] - { { \rm tr } } [ ( \tilde{\rho}_2 -\rho_1 ) \ln \tilde{\rho}_2 ]   \\          & = - { } q_f + { } q_i .      \end{aligned}\ ] ] where @xmath242 would be the heat absorbed by the system if it passed from @xmath226 to @xmath228 via a dtt , i.e. @xmath243 .\ ] ] to compare the continuous heat ( [ defdq ] ) with the discrete heat ( [ defqgamma ] ) , we introduce a second discrete trajectory @xmath237 .
this is a closed loop sequence of duq and dtt transformations , see fig .
[ fig : triangle ] , @xmath244 in trajectory @xmath237 heat is exchanged from @xmath245 and from @xmath246 , so @xmath247 . as discussed in previous sections
the discrete heat always obeys the clausius inequality ( [ eq : gg1113 ] ) , and with @xmath248 for both steps this implies @xmath249 for trajectory @xmath237 . using this in eq .
( [ defqgamma ] ) we find that the heat associated with the discrete trajectory @xmath161 from @xmath115 to @xmath226 is a _ lower bound _ to the infinitesimal continuous heat for the same initial and final configuration , ( [ quantity ] ) , i.e. @xmath250 this can immediately be extended to the full continuous process : for any arbitrary continuous process between @xmath216 and @xmath217 there is always a discrete trajectory @xmath251 between the same two configurations that has a lower heat than the continuous heat , eq .
( [ eq : q ] ) .
moreover , by augmenting intermediate steps in the discrete trajectory @xmath251 , resulting in the trajectory @xmath218 that passes through an infinite sequence of points @xmath252 , it is possible to increase the associated heat , as shown in sec .
[ sec : multiple ] . from theorem [ lem : clausiussat ] follows that if the continuous trajectory fulfils the clausius inequality , then a discrete trajectory connecting the same initial and final configuration can be found that has the same heat as the continuous trajectory . @xmath253
the last piece in our analysis of the energy balance in discrete quantum processes is to determine the efficiency of a discrete cyclic process , such as the one depicted in fig .
[ fig : cycle ] where @xmath117 , @xmath254 are equilibrium configurations , while @xmath255 , and @xmath256 are not . this results in the following lemma :    the thermal efficiency of the discrete cycle depicted in fig .
[ fig : cycle ] is bounded by the carnot efficiency , @xmath257 and the optimal efficiency is achievable .    _ proof : _ for the overall loop , @xmath258 the entropy change is zero . however , the entropy change nevertheless bounds the heat of the two heat - producing dtt processes , @xmath259 and @xmath260 , @xmath261    ) .
, title="fig : " ]    this implies that at least one of the two heats must be negative .
let us assume for instance that the heat exchanged with the thermal reservoir at temperature @xmath262 is positive , @xmath263 , while the other heat is negative @xmath264 ( other scenarios can be treated analogously , see below ) .
the total heat absorbed per cycle is @xmath265 with the energy balance implying that the overall absorbed heat must be equal to the negative work done on the system during the cycle , @xmath266 the thermal efficiency is defined as the ratio between the work performed and the heat absorbed , leading to @xmath267 where we used eq .
( [ eq : heatbound ] ) . if @xmath268 the system absorbs heat from a higher temperature bath and gives heat to a lower temperature bath .
the efficiency @xmath269 is then positive and smaller than unity with the optimal efficiency reproducing the carnot efficiency .
the optimal efficiency can be reached by augmenting the discrete trajectory to saturate the equality in the clausius - inequality , see theorem [ lem : clausiussat ] .
@xmath253    _ remark : _ if instead @xmath270 , i.e. heat is absorbed from a lower temperature bath and given to one at a higher temperature , the system operates as a refrigerator . in this case the total work _ absorbed _ by the system , @xmath271 , is positive .
the efficiency of the process can be measured by the coefficient of performance , cop@xmath272 , defined as the ratio between the heat absorbed from the cold reservoir @xmath273 ( i.e. @xmath274 ) and the total work done on the system @xmath275 which again is always smaller than one .
finally , if the signs for the heats @xmath274 and @xmath276 are interchanged the above argument still holds with eqs .
( [ eta ] ) and ( [ cooling ] ) being replaced by the inequalities @xmath277 and @xmath278 , respectively .
the early development of thermodynamics culminating in the formulation of the second law also gave birth to a new quantity , the entropy , whose physical meaning was at first opaque . only later was its meaning elucidated by the works of boltzmann and others . in this paper
we proposed to turn the original argument around and use the well - established notion of entropy that characterises the information content in a ( quantum ) state to motivate the definition of a notion of heat for discrete quantum processes .
the approach circumvents the large cluster of problems surrounding the idea of a unique definition of heat and work in processes where ( i ) the hamiltonian of the system is not well - defined due to the open nature of the system and ( ii ) there are fundamental limitations on the notion of trajectories where full knowledge is only given at discrete points in time when a measurement with a specific hamiltonian occurred .    by introducing thermodynamic configurations , identifying two primitives for discrete processes , duts and dtts , and defining heat to pertain only to dtts
we were able to uncover a general second law valid for any discrete process consisting of sequences of dut+dtts between both , equilibrium and non - equilibrium configurations .
moreover , we showed that an infinite sequence of dut+dtt processes exists that saturates the clausius inequality .
in other words , saturation occurs when a discrete trajectory is mapped out into a continuous one by a sequence of measurements that are infinitely close together .
this provides a link between _ reversibility _ - here the reversibility of a discrete process - and the equality in the second law for discrete processes , reminiscent of the clausius statement of equality for thermodynamic reversible continuous processes , eq .
( [ eq : reversible ] ) . on the other hand , we also showed that for any continuous process between two configurations that obeys the clausius inequality , there exists a discrete process between the same configurations with the same heat .
finally , we showed that for the discrete version of a thermodynamic cycle , formed by a discrete trajectory passing through four configurations carnot s efficiency is recovered .
the strength of our approach is to give meaning to heat and work , reversibility and efficiency following from just a few sensible and simple definitions . in some respect
this is analogous to the axiomatic approach to thermodynamics first developed by carathodory  @xcite .
we hope that the presented analysis will inspire discussions and future work on characterizing heat and work in quantum processes .
of course many open questions remain .
one direction of particular relevance is clearly the identification of a proper _ metric _ in configuration space , that would allow to quantify , in a precise and ( hopefully ) operationally well defined way , how distant two generic discrete trajectories are .
vg thanks rosario fazio and seth lloyd for fruitful discussions and comments .
vg is supported by miur through firb - ideas project no .
ja is supported by the royal society .
here we discuss the impact of the unitary @xmath102 of eq .
( [ eq : heatdut+dtt ] ) on the heat of the dut+dtt process  ( [ eq : dut+dtt ] ) .
specifically , we want to identify the duts that maximize and minimize the heat on the r.h.s of eq .
( [ eq : gg1113 ] ) and establish if a dut exists that leads to a saturated clausius equality
. the last question can be easily solved by noticing that saturation occurs only when the inequality holds in eq .
( [ eq : s - bound ] ) .
however , this is only true iff @xmath279 , i.e. @xmath32 and @xmath33 must be unitarily equivalent for some unitary @xmath280 , @xmath281 . in other words equivalence in ( [ eq : dut+dtt ] ) requires that no dtt enters in the process so that @xmath282 . for any non - trivial dtt a finite gap between the l.h.s . and the r.h.s . of eq .
( [ eq : gg1113 ] ) exists .
( this is not true however for sequences of dut - dtt transformations as considered in sec .
[ sec : sat ] . )     to the gibbs state @xmath130 via some dut , specified by a unitary @xmath102 , followed by an appropriate dtt .
, title="fig : " ]    to determine the minimum / maximum gap we require the maximum / minimum heat with respect to all possible duts of a dut+dtt process connecting two thermal configurations @xmath129 and @xmath130 , see fig  [ fig : max - minheat ] , i.e. @xmath283 , \\
q_{\min }       & : =   \min_{v } { { \rm tr}}[(\rho_f - v \ , \rho_i \ , v^\dag ) \ ; h_f ] ,      \end{split}\ ] ] where the maximisation / minimisation is taken over all unitary transformations @xmath102 .
this task is solved with the following lemma .    given @xmath284 and @xmath285 hermitian operators on a finite dimensional hilbert space @xmath286 , with @xmath287 and @xmath288 being their corresponding eigenvalues which are ordered in decreasing order ( i.e. @xmath289 , @xmath290 ) .
then the minimum of @xmath291 $ ] over the set of unitary transformations is achieved by the unitary @xmath143 which maps the eigenvector @xmath292 of @xmath293 into the eigenvectors @xmath294 of @xmath295 in such a way that @xmath296 i.e. the maximum eigenvector of @xmath293 is mapped into the minimum eigenvector of @xmath295 . as a consequence the minimum expectation value is @xmath297 = { { \rm tr } } [ a \ , v_{\min } \ , b \ , v_{\min}^\dag ] = \sum_j \alpha_j \beta_{n - j+1}.\ ] ] similarly the maximum of @xmath291 $ ] over the set of unitary transformations is achieved by the unitary @xmath144 that maps the eigenvectors @xmath292 of @xmath293 into the eigenvectors @xmath294 of @xmath295 in such a way that @xmath298 consequently the maximum expectation value is @xmath299       = { { \rm tr } } [ a \ , v_{\max } \ , b \ , v_{\max}^\dag ] = \sum_j \alpha_j \beta_{j}.\ ] ]    _ proof : _ these minimum and maximum expectation values are a trivial consequence of the theorem 2 of ref
.  @xcite .
@xmath253 + application of eqs .  ( [ eq : min ] ) and ( [ eq : max ] ) gives the minimum and maximum heat for the dut+dtt process  ( [ eq : dut+dtt ] ) @xmath300 where @xmath140 and @xmath141 are the eigenvalues of @xmath43 and @xmath103 ordered in decreasing order .
consider the @xmath301-th step of the trajectory @xmath57 in panel * b * in fig .  [ fig : multiple ] , which connects the thermal points @xmath302 and @xmath303 .
we define a new trajectory @xmath304 which is identical with the original trajectory @xmath57 except that the @xmath301-th step is now replaced with a sequence of @xmath305 intermediate _ thermal configurations _
@xmath306 , @xmath307 , @xmath308 that are linked through a duq - dtt sequence @xmath309 the configurations @xmath310 have density matrices @xmath311 , @xmath307 , @xmath312 defined by the mixtures @xmath313 where @xmath314 and @xmath315 . applying the clausius inequality  ( [ yyy1 ] ) in the form of ( [ eq : sl ] ) to sequence  ( [ real22222 ] ) yields @xmath316 by definition ( [ eq : lambdapiece ] ) , the transformations being _ discrete unitaries _ and
the fact that intermediate inverse temperatures are all set to 1 , @xmath317 can be expressed as @xmath318 \\          & = { { \rm tr}}\left [ ( \rho_{{k } } - \rho_{k+1})\ ; \frac{1}{n }   \sum_{\ell=0}^{n-1 } \ ;   \ln \rho'_{\ell+1 } \right ] .      \end{split}\ ] ] on the other hand the entropy change @xmath174 can be lower bounded by @xmath319 \\          & =   { { \rm tr}}\left [ ( \rho_{{k } } - \rho_{k+1})\ ;
\frac{1}{n }   \sum_{\ell=0}^{n-1 } \
; \ln \rho'_{\ell } \right]\\          & =   \lambda({\cal t}_{k;n } ' )   + { { \rm tr}}\left [ ( \rho_{k } - \rho_{k+1})\ ;    \frac{\ln \rho_k - \ln \rho_{k+1}}{n } \right]\\          & = \lambda({\cal t}_{k;n } ' )   + \frac{s(\rho_{k+1}\| \rho_{k})+ s(\rho_{k}\| \rho_{k+1})}{n } ,      \end{split}\ ] ] which implies @xmath320 @xmath321 and @xmath322 are density matrices of gibbs configurations and thus of full rank . consequently , the quantity @xmath323 is finite .
explodes if and only if the kernel of @xmath324 or @xmath322 admits a non - trivial overlap with the support of the other state @xcite . since @xmath321 and @xmath322 are full rank , neither conditions can be fulfilled and the symmetric sum of relative entropies is always finite . ] from eq .
( [ yyy1121 ] ) and ( [ tttt ] ) it then follows that @xmath325 converges to @xmath174 for @xmath326 , i.e. @xmath327 in other words by augmenting the intermediate points of which connects @xmath328 and @xmath329 we can saturate the associated clausius inequality for the @xmath301-th step of the trajectory @xmath57 . by repeating the same procedure for each of the steps of @xmath57
a new trajectory emerges as the union of the individual sequences , @xmath330 where @xmath209 is the multidimensional variable @xmath331 .
lemma [ lem : clausiussat ] follows from the additivity of @xmath176 ( [ functionals ] ) and taking the limit of each @xmath332  ( [ limit ] ) . @xmath253


to probe dynamical properties of a system , one often applies an external stimulus to the system and investigate its response .
particularly , periodically stimulated biological oscillators have attracted much attention in various systems such as the embryonic chick heart - cell aggregates @xcite and the squid giant axon @xcite .
these periodically forced systems have been found to exhibit rich regular and chaotic behaviors @xcite .
recently , similar lockings and chaotic responses have also been found in neocortical networks of pyramidal neurons under periodic synaptic input @xcite . on the contrary ,
quasiperiodically forced case has received little attention @xcite .
hence , intensive investigation of quasiperiodically forced biological oscillators is necessary for understanding their dynamical responses under the quasiperiodic stimulus .
strange nonchaotic ( sn ) attractors typically appear between the regular and chaotic attractors in quasiperiodically forced dynamical systems @xcite .
they exhibit some properties of regular as well as chaotic attractors . like regular attractors , their dynamics
is nonchaotic in the sense that they do not have a positive lyapunov exponent ; like usual chaotic attractors , they have a geometrically strange fractal structure . here , we are interested in dynamical responses of neural oscillators subject to quasiperiodic stimulation .
sn oscillations are expected to occur in quasiperiodically forced neural oscillators .
this paper is organized as follows . in sec .
[ sec : sn ] , we study dynamical responses of the quasiperiodically forced hodgkin - huxley ( hh ) neuron which was originally introduced to describe the behavior of the squid giant axon @xcite . as a dc stimulus passes a threshold value , a self - sustained oscillation ( corresponding to a spiking state ) is induced .
effect of periodic forcing on this hh oscillator was previously studied @xcite .
thus , regular ( such as phase locking and quasiperiodicity ) and chaotic responses were found .
we note that similar dynamical responses were also observed in experimental works of the periodically forced squid giant axon @xcite . in this way
, the model study on the hh neuron may be examined in real experiments of the squid giant axon .
here , we numerically study the case that the hh oscillator is quasiperiodically forced at two incommensurate frequencies and compare the dynamical responses with those for the periodically forced case . in the periodically forced case ( _ i.e. _ , in the presence of only one ac stimulus source ) , a transition from a periodic to a chaotic oscillation
was found to occur via period - doubling bifurcations @xcite .
effect of the quasiperiodic forcing on this period - doubling route to chaotic oscillation is particularly investigated by adding another independent ac stimulus source .
thus , unlike the case of periodic forcing , new type of sn oscillating states are found to occur between the regular and chaotic oscillating states as intermediate ones . as a result of their strange geometry ,
sn oscillating states give rise to the appearance of aperiodic complex spikings , as in the case of chaotic oscillations .
diverse dynamical routes to sn oscillations are identified , like the case of the quasiperiodically forced logistic map @xcite .
it is also expected that these sn spikings might be observed in experimental works on the quasiperiodically forced squid giant axon . finally , a summary is given in sec .
[ sec : sum ] .
we consider the conductance - based hh neuron model which serves as a canonical model for tonically spiking neurons .
the dynamics of the hh neuron , which is quasiperiodically forced at two incommensurate frequencies @xmath0 and @xmath1 , is governed by the following set of differential equations :    @xmath2    [ eq : hh1 ]    where the external stimulus current density ( measured in units of @xmath3 ) is given by @xmath4 , @xmath5 is a dc stimulus , @xmath6 and @xmath7 are amplitudes of quasiperiodic forcing , and @xmath8 is irrational ( @xmath0 and @xmath1 : measured in units of khz ) . here
, the state of the hh neuron at a time @xmath9 ( measured in units of ms ) is characterized by four variables : the membrane potential @xmath10 ( measured in units of mv ) , the activation ( inactivation ) gate variable @xmath11 of the @xmath12 channel [ _ i.e. , _ the fraction of sodium channels with open activation ( inactivation ) gates ] , and the activation gate variable @xmath13 of the @xmath14 channel ( _ i.e. , _ the fraction of potassium channels with open activation gates ) . in eq .
( [ eq : hha ] ) , @xmath15 represents the membrane capacitance per surface unit ( measured in units of @xmath16 ) and the total ionic current @xmath17 consists of the sodium current @xmath18 , the potassium current @xmath19 , and the leakage current @xmath20 .
each ionic current obeys ohm s law .
the constants @xmath21 , @xmath22 , and @xmath23 are the maximum conductances for the ion and the leakage channels , and the constants @xmath24 , @xmath25 , and @xmath26 are the reversal potentials at which each current is balanced by the ionic concentration difference across the membrane .
the three gate variables obey the first - order kinetics of eq .
( [ eq : hhb ] ) .
the rate constants are given by    @xmath27}{\exp [ \{25-(v - v_r)\}/10 ] - 1 } , \;\ ; \beta_m(v ) = 4 \exp [ -(v - v_r)/18 ] , \\
\alpha_h(v ) & = & 0.07 \exp [ -(v - v_r)/20 ] , \;\ ; \beta_h(v ) = \frac{1}{\exp [ \{30-(v - v_r)\}/10]+1 } , \\
\alpha_n(v ) & = & \frac{0.01[10-(v - v_r)]}{\exp [ \{10-(v - v_r)\}/10]-1 } , \;\ ; \beta_n(v ) = 0.125 \exp [ -(v - v_r)/80],\end{aligned}\ ] ]    [ eq : rc ]    where @xmath28 is the resting potential when @xmath29 . for the squid giant axon , typical values of the parameters ( at 6.3 @xmath30 )
are @xcite : @xmath31 , @xmath32 , @xmath33 , @xmath34 , @xmath35 mv , @xmath36 mv , @xmath37 mv , and @xmath38 mv .    to obtain the poincar map of eq .
( [ eq : hh1 ] ) , we make a normalization @xmath39 , and then eq .
( [ eq : hh1 ] ) can be reduced to the following differential equations :    @xmath40 , \\ \frac{dm}{dt } & = & f_2({\bf{x}},\theta ) = { \frac { 1 } { f_1 } } [ \alpha_m ( v ) ( 1-m ) - \beta_m ( v ) m ] , \\ \frac{dh}{dt } & = & f_3({\bf{x}},\theta ) = { \frac { 1 } { f_1 } } [ \alpha_h ( v ) ( 1-h ) - \beta_h ( v ) h ] , \\ \frac{dn}{dt } & = & f_4({\bf{x}},\theta ) = { \frac { 1 } { f_1 } } [ \alpha_n ( v ) ( 1-n ) - \beta_n ( v ) n ] , \\
\frac { d\theta } { dt } & = & \omega~~{\rm { ( mod~1)}},\end{aligned}\ ] ]    [ eq : hh2 ]    where @xmath41 \equiv ( v , m , h , n)$ ] and @xmath42 .
the phase space of the quasiperiodically forced hh oscillator is six dimensional with coordinates @xmath10 , @xmath43 , @xmath44 , @xmath13 , @xmath45 , and @xmath9 . since the system is periodic in @xmath45 and @xmath9 , they are circular coordinates in the phase space .
then , we consider the surface of section , the @xmath10-@xmath43-@xmath44-@xmath13-@xmath45 hypersurface at @xmath46 ( @xmath13 : integer ) .
the phase - space trajectory intersects the surface of section in a sequence of points
. this sequence of points corresponds to a mapping on the five - dimensional hypersurface . the map can be computed by stroboscopically sampling the orbit points @xmath47 @xmath48 $ ] at the discrete time @xmath13 ( corresponding to multiples of the first external driving period @xmath49 ) .
we call the transformation @xmath50 the poincar map , and write @xmath51
.    numerical integration of eqs .
( [ eq : hh1 ] ) and ( [ eq : hh2 ] ) is done using the fourth - order runge - kutta method .
dynamical analysis is performed in both the continuous - time system ( _ i.e. _ , flow ) and the discrete - time system ( _ i.e. _ , poincar map ) .
for example , the time series of the membrane potential @xmath52 and the phase flow are obtained in the flow . on the other hand , the lyapunov exponent @xcite and the phase sensitivity exponent @xcite of an attractor
are calculated in the poincar map . to obtain the lyapunov exponent of an attractor in the poincar map , we choose 20 random initial points
@xmath53 with uniform probability in the range of @xmath54 , @xmath55 , @xmath56 , @xmath57 and @xmath58 . for each initial point , we get the lyapunov exponent , and choose the average value of the 20 lyapunov exponents .
( the method of obtaining the phase sensitivity exponent will be explained below . )    in the presence of only the dc stimulus ( @xmath59 @xmath60 ) , a transition from a resting state to a periodic spiking state occurs for @xmath61 @xmath62 @xmath63 via a subcritical hopf bifurcation when the resting state absorbs the unstable limit cycle born via a fold limit cycle bifurcation for @xmath64 @xmath65 @xcite .
thus , a self - sustained oscillation ( corresponding to a spiking state ) is induced in the hh neuron model for @xmath66 . here
, we set @xmath67 @xmath65 and @xmath68 to be the reciprocal of the golden mean [ _ i.e. _ , @xmath69 , and numerically investigate dynamical responses of the ( self - sustained ) hh oscillator under the ac external stimulus .
we first study the case of periodic forcing ( _ i.e. _ , @xmath70 ) by varying @xmath6 for @xmath71 hz .
figures [ fig : pd](a)-[fig : pd](c ) show the time series of @xmath52 for @xmath72 , @xmath73 , and @xmath74 @xmath65 , respectively , and the bifurcation diagram in the poincar map @xmath75 is also given in fig .
[ fig : pd](d ) ; stroboscopically sampled points in @xmath75 are represented by solid circles in figs .
[ fig : pd](a)-[fig : pd](c ) . as @xmath6 is decreased ,
successive period - doubling bifurcations occur .
for example , periodic oscillations of @xmath52 in figs .
[ fig : pd](a ) and [ fig : pd](b ) correspond to period-1 and period-2 states in @xmath75 , respectively .
when @xmath6 passes a threshold @xmath76 @xmath77 @xmath65 ) a chaotic transition occurs .
thus , for @xmath78 chaotic oscillations with positive lyapunov exponents appear , as shown in fig .
[ fig : pd](c ) .    from now
on , we investigate the effect of quasiperiodic forcing on the period - doubling route to chaotic oscillation by changing @xmath6 and @xmath7 for @xmath71 hz .
figure [ fig : sd ] shows a state diagram in the @xmath79 plane .
each state is characterized by the largest ( nontrivial ) lyapunov exponent @xmath80 , associated with dynamics of the variable @xmath81 [ besides the ( trivial ) zero exponent , related to the phase variable @xmath45 of the quasiperiodic forcing ] and the phase sensitivity exponent @xmath82 . the exponent @xmath82 measures the sensitivity of the variable @xmath83 with respect to the phase @xmath45 of the quasiperiodic forcing and characterizes the strangeness of an attractor @xcite .
regular quasiperiodic oscillations occur on smooth tori . a smooth torus that has a negative largest lyapunov exponent ( _ i.e. _ , @xmath84 ) and has no phase sensitivity ( _ i.e. _ , @xmath85 ) exists in the region denoted by @xmath86 and shown in light gray .
when crossing a solid line , the smooth torus becomes unstable and bifurcates to a smooth doubled torus in the region represented by @xmath87 .
smooth quadrupled tori , bifurcated from doubled tori , also exist in the region denoted by @xmath88 .
on the other hand , chaotic oscillating states with positive largest lyapunov exponents ( @xmath89 ) exist in the region shown in black . between these regular and chaotic regions , sn
oscillating states that have negative largest lyapunov exponents ( @xmath90 ) and positive phase sensitivity exponents @xmath91 exist in the region shown in gray . due to their high phase sensitivity ,
sn oscillating states have a strange fractal phase space structure .
various dynamical routes to sn oscillations via gradual fractalization , collision with a smooth unstable torus , and collision with a nonsmooth ring - shaped unstable set will be discussed below .    when passing a heavy solid boundary curve in fig .
[ fig : sd ] , a transition from a smooth torus to an sn attractor occurs via gradual fractalization @xcite . as an example
, we study such transition to sn oscillations along the route @xmath92 by decreasing @xmath6 for @xmath93 @xmath65 . figures [ fig : frac](a)-[fig : frac](c ) show the time series of @xmath52 for the quasiperiodic oscillation , the sn oscillation , and the chaotic oscillation when @xmath94 , @xmath95 , and @xmath96 @xmath97 , respectively .
these regular , sn , and chaotic states are analyzed in terms of the largest lyapunov exponent @xmath80 and the phase sensitivity exponent @xmath82 in the poincar map .
projections of their corresponding attractors onto the @xmath98 plane are shown in figs .
[ fig : frac](d)-[fig : frac](f ) . for the regular state ,
a smooth torus exists in the @xmath98 plane [ see fig .  [
fig : frac](d ) ] .
as @xmath6 is decreased , the smooth torus becomes more and more wrinkled and transforms to an sn attractor without apparent mediation of any nearby unstable invariant set @xcite .
as an example , see an sn attractor in fig .
[ fig : frac](e ) .
this kind of gradual fractalization is the most common route to sn attractors .
with further decrease in @xmath6 , such an sn attractor turns into a chaotic attractor , as shown in fig .
[ fig : frac](f ) .
a dynamical property of each attractor is characterized in terms of the largest lyapunov exponent @xmath80 ( measuring the degree of sensitivity to initial conditions ) .
the lyapunov - exponent diagram ( _ i.e. _ , plot of @xmath80 vs. @xmath6 ) is given in fig .
[ fig : frac](g ) .
when passing a threshold value of @xmath99 @xmath65 , an sn attractor appears .
the graph of @xmath80 for the sn attractor is shown in black , and its value is negative as in the case of smooth torus . however , as @xmath6 passes the chaotic transition point of @xmath100 @xmath65 , a chaotic attractor with a positive @xmath80 appears .
although sn and chaotic attractors are dynamically different , both of them have strange geometry . to characterize the strangeness of an attractor , we investigate the sensitivity of the attractor with respect to the phase @xmath45 of the external quasiperiodic forcing @xcite .
this phase sensitivity may be characterized by differentiating @xmath101 with respect to @xmath45 at a discrete time @xmath46 .
using eq .
( [ eq : hh2 ] ) , we may obtain the following governing equation for @xmath102 @xmath103 , @xmath104 where @xmath105 and @xmath106 s @xmath103 are given in eq .
( [ eq : hh2 ] ) . starting from an initial point @xmath107 and an initial value @xmath108 for @xmath109 , we may obtain the derivative values of @xmath110 @xmath111 at all subsequent discrete time @xmath46 by integrating eqs .
( [ eq : hh2 ] ) and ( [ eq : pse ] ) .
one can easily see the boundedness of @xmath112 by looking only at the maximum @xmath113 we note that @xmath114 depends on a particular trajectory . to obtain a `` representative '' quantity that is independent of a particular trajectory
, we consider an ensemble of randomly chosen initial points @xmath115 , and take the minimum value of @xmath116 with respect to the initial orbit points @xcite , @xmath117 figure [ fig : frac](h ) shows a phase sensitivity function @xmath118 , which is obtained in an ensemble containing 20 random initial orbit points @xmath119 which are chosen with uniform probability in the range of @xmath54 , @xmath120 , @xmath56 , @xmath57 and @xmath58 . for the case of the smooth torus in fig .
[ fig : frac](d ) , @xmath118 grows up to the largest possible value of the derivative @xmath121 along a trajectory and remains for all subsequent time .
thus , @xmath118 saturates for large @xmath122 and hence the smooth torus has no phase sensitivity ( _ i.e. _ , it has smooth geometry ) . on the other hand , for the case of the sn attractor in fig .
[ fig : frac](e ) , @xmath123 grows unboundedly with the same power @xmath82 , independently of @xmath124 , @xmath125 here , the value of @xmath126 is a quantitative characteristic of the phase sensitivity of the sn attractor , and @xmath82 is called the phase sensitivity exponent . for obtaining satisfactory statistics , we consider 20 ensembles for each @xmath6 , each of which contains
20 randomly chosen initial points and choose the average value of the 20 phase sensitivity exponents obtained in the 20 ensembles .
figure [ fig : frac](i ) shows a plot of @xmath82 versus @xmath127 @xmath128 .
note that the value of @xmath82 monotonically increases from zero as @xmath6 is decreased away from the sn transition point @xmath76 @xmath129 @xmath130 . as a result of this phase sensitivity , the sn oscillating state has strange fractal geometry leading to aperiodic complex spikings , as in the case of chaotic oscillations [ _ e.g. , _ see figs .  [
fig : frac](b ) and [ fig : frac](c ) ] .    as a dashed boundary curve in fig .
[ fig : sd ] is crossed , another route to sn attractors appears through collision between a stable smooth doubled torus and its unstable smooth parent torus @xcite . as an example
, we study this transition to sn oscillations along the route @xmath131 by decreasing @xmath6 for @xmath132 @xmath65 .
figure [ fig : hh ] shows a stable two - band torus ( denoted by a solid curve ) and an unstable smooth one - band parent torus ( denoted by a short - dashed curve ) for @xmath133 @xmath65 . the unstable parent torus is located in the middle of the two bands of the the stable torus . as @xmath6 is decreased , the bands of the stable torus becomes more and more wrinkled , while the unstable torus remains smooth [ see fig .  [
fig : hh](b ) ] .
when @xmath6 passes a threshold value of @xmath134 @xmath65 , the two bands of the stable torus touch its unstable parent torus at a dense set of @xmath45 values ( not at all @xmath45 values ) . as a result of
this phase - dependent ( nonsmooth ) collision between the stable doubled torus and its unstable parent torus , an sn attractor is born , as shown in fig .
[ fig : hh](c ) .
this sn attractor , containing the former bands of the torus as well as the unstable parent torus , has a positive phase sensitivity exponent ( @xmath59 @xmath135 ) , inducing the strangeness of the sn attractor .
however , its dynamics is nonchaotic because the largest lyapunov exponent is negative ( @xmath59 @xmath136 ) . as another threshold value of @xmath137 @xmath65
is passed , the sn attractor transforms to a chaotic attractor with a positive largest lyapunov exponent @xmath80 [ see fig .  [
fig : hh](d ) ] .
a main interesting feature of the state diagram in fig .  [ fig : sd ] is the existence of `` tongues '' of quasiperiodic motion that penetrate into the chaotic region .
the first - order ( second - order ) tongue lies near the terminal point ( denoted by a cross ) of the first - order ( second - order ) torus - doubling bifurcation curve .
when crossing the upper boundary of the tongue ( denoted by a dotted line ) , an intermittent sn attractor appears via phase - dependent collision of a stable torus with a nonsmooth ring - shaped unstable set @xcite .
we first study the transition to an intermittent sn attractor along the route @xmath138 in the first - order tongue by increasing @xmath7 for @xmath139 @xmath97 .
figure [ fig : int](a ) shows a smooth torus for @xmath140 @xmath65 .
when passing a threshold value of @xmath141 @xmath65 , a sudden transition to an intermittent sn attractor occurs , as shown in fig .
[ fig : int](b ) for @xmath142 . due to high phase sensitivity
, this sn attractor with @xmath143 has a strange fractal structure , while its dynamics is nonchaotic because of a negative largest lyapunov exponent ( @xmath144 ) . a typical trajectory on the intermittent sn attractor spends a long stretch of time in the vicinity of the former torus ,
then it bursts out from this region and traces out a much larger fraction of the state space , and so on . to characterize the intermittent bursting , we use a small quantity @xmath145 for the threshold value of the magnitude of the deviation from the former torus . when the deviation is smaller ( larger ) than @xmath145 , the intermittent attractor is in the laminar ( bursting ) phase . for each @xmath7 , we follow a long trajectory until @xmath146 laminar phases are obtained in the poincar map @xmath75 and get the average of characteristic time @xmath147 between bursts . as shown in fig .
[ fig : int](c ) , the average value of @xmath147 exhibits a power - law scaling behavior , @xmath148 where the overbar represents time averaging and @xmath149 @xmath150 .
the scaling exponent @xmath151 seems to be the same as that for the case of the quasiperiodically forced map @xcite .
as @xmath7 passes another threshold value of @xmath152 @xmath65 , the sn attractor transforms to a chaotic attractor because the largest lyapunov exponent @xmath80 becomes positive , as shown in fig .
[ fig : int](d ) . furthermore , using the rational approximation , the mechanism for the intermittent route to sn attractors will be investigated below .
thus , a smooth torus is found to transform to an intermittent sn attractor via phase - dependent collision with a nonsmooth ring - shaped unstable set .
we also study another intermittent route to sn attractors along the route @xmath153 in the second - order tongue by increasing @xmath7 for @xmath154 @xmath65 .
figure [ fig : int](e ) shows a smooth two - band torus for @xmath155 @xmath65 . as @xmath7 passes a threshold value of @xmath156 @xmath157 , a band - merging transition from a smooth doubled torus to a single - band sn attractor
occurs @xcite .
thus , an intermittent single - band sn attractor appears [ _ e.g. , _ see the intermittent sn attractor with @xmath158 and @xmath159 in fig .
[ fig : int](f ) for @xmath160 . a typical trajectory of the second iterate of the poincar map @xmath75 ( _ i.e. _ @xmath161 ) spends a long stretch of time near one of the two former attractors ( _ i.e. , _ smooth tori ) , then it bursts out of this region and comes close to the same or other former torus where it remains again for some time interval , and so on . as in the above case of intermittent route to sn attractors
, we also obtain the @xmath146 laminar phases from a long trajectory in @xmath161 , and get the average of characteristic time @xmath147 between bursts . as shown in fig .  [
fig : int](g ) , the average characteristic time shows a power - law scaling behavior , @xmath148 where @xmath162 @xmath163 .
the scaling exponent @xmath151 seems to be the same as that for the case of the intermittent route to sn attractors occurring near the first - order tongue .
since the dynamical mechanism for the appearance of intermittent sn attractors near the first - order and second - order tongues are the same ( _ i.e. , _ an intermittent sn attractor appears via a phase - dependent collision between a smooth torus and a nonsmooth ring - shaped unstable set ) , the intermittent sn attractors for both cases seem to exhibit the same scaling behaviors . as @xmath7 is further increased and passes another threshold value of @xmath164 @xmath65 , the sn attractor turns into a chaotic attractor with a positive largest lyapunov exponent @xmath80 , as shown in fig .
[ fig : int](h ) .
the dynamical mechanisms for the appearance of intermittent sn attractors near the tongues are the same , irrespectively of the tongue order . here
, we consider the case of the main first - order tongue , and using the rational approximation to the quasiperiodic forcing , we search for an unstable orbit that causes the intermittent transition via collision with the smooth torus for @xmath165 @xmath65 . for the inverse golden mean @xmath166 $ ] ,
its rational approximants are given by the ratios of the fibonacci numbers , @xmath167 , where the sequence of @xmath168 satisfies @xmath169 with @xmath170 and @xmath171 .
instead of the quasiperiodically forced system with @xmath68 , periodically forced systems with @xmath172 are studied in the rational approximation . as an example , we consider the rational approximation of level @xmath173 . the rational approximation to the smooth torus ( denoted by a black curve ) , composed of stable orbits with period @xmath174 ,
is shown in fig .
[ fig : ra](a ) for @xmath175 @xmath65 .
we note that a ring - shaped unstable set , composed of @xmath176 small rings , lies near the smooth torus . at first
, each ring is composed of the stable ( shown in black ) and unstable ( shown in gray ) orbits with period @xmath176 [ see the inset in fig .
[ fig : ra](a ) ] .
however , as @xmath6 is changed such rings make evolution , as shown in fig .  [
fig : ra](b ) for @xmath177 @xmath65 . for fixed values of @xmath6 and @xmath7
, the phase @xmath45 may be regarded as a `` bifurcation parameter . '' as @xmath45 is varied , a chaotic attractor appears via an infinite sequence of period - doubling bifurcations of stable periodic orbits in each ring , and then it disappears via a boundary crisis when it collides with the unstable @xmath176-periodic orbit [ see the inset in fig .
[ fig : ra](b ) ] .
thus , the attracting part ( shown in black ) of each ring is composed of the union of the originally stable @xmath176-periodic attractor , the higher @xmath178-periodic @xmath179 and chaotic attractors born through the period - doubling cascade . on the other hand , the unstable part ( shown in gray ) of each ring consists of the union of the originally unstable @xmath176-periodic orbit [ _ i.e. , _ the lower gray line in the inset in fig .
[ fig : ra](b ) ] and the destabilized @xmath176-periodic orbit [ _ i.e. , _ the upper gray line in the inset in fig .
[ fig : ra](b ) ] via a period - doubling bifurcation .
as the parameters , @xmath6 and @xmath7 , are further changed , both the size and shape of the rings change , and eventually each ring is composed of a large unstable part ( shown in gray ) and a small attracting part ( shown in black ) , as shown in fig .
[ fig : ra](c ) for @xmath139 @xmath65 and @xmath180 @xmath65 [ a magnified view is given in fig .
[ fig : ra](d ) ] .
we also note that new rings appear inside or outside the `` old '' rings .
finally , in terms of the rational approximation of level 7 , we explain the mechanism for the intermittent transition occurring in the first - order tongue for @xmath139 @xmath65 [ see figs .
[ fig : int](a)-[fig : int](b ) ] .
as we approach the border of the intermittent transition in the state diagram , the ring - shaped unstable set comes closer to the smooth torus , as shown in fig .
[ fig : ra](c ) for @xmath180 @xmath65 [ see a magnified view in fig .
[ fig : ra](d ) ] .
as @xmath7 passes a threshold value of @xmath181 @xmath65 , a phase - dependent ( nonsmooth ) collision occurs between the smooth torus and the unstable part ( shown in gray ) of the nonsmooth ring - shaped unstable set .
then , the new attractor of the system contains the attracting part ( shown in black ) of the ring - shaped unstable set and becomes nonsmooth , which is shown in fig .
[ fig : ra](e ) for @xmath182 @xmath65 [ see a magnified view in fig .
[ fig : ra](f ) ] . as @xmath7 is further increased ,
the chaotic component in the rational approximation to the attractor increases , and eventually for @xmath183 @xmath65 , it becomes suddenly widened via an interior crisis when it collides with the nearest ring [ _ e.g. , _ see fig .  [
fig : ra](g ) ] .
then , @xmath174 `` gaps , '' where no attractors with period @xmath176 exist , are formed .
a magnified gap is shown in fig .  [
fig : ra](h ) .
we note that this gap is filled by intermittent chaotic attractors .
thus , the rational approximation to the whole attractor consists of the union of the periodic and chaotic components . for this case ,
the periodic component is dominant , and hence the average largest lyapunov exponent @xmath184 becomes negative , where @xmath185 denotes the average over the whole @xmath45 .
hence , the rational approximation to the attractor becomes nonchaotic .
we note that the 7th rational approximation to the attractor in fig .
[ fig : ra](g ) resembles the ( original ) intermittent sn attractor in fig .
[ fig : int](b ) , although the level of the rational approximation is low . in this way
, the intermittent transition to an sn attractor occurs through two steps in the rational approximation : the phase - dependent ( nonsmooth ) collision and the interior crisis .
we have numerically studied dynamical responses of the quasiperiodically forced hh neural oscillator and compared them with those for the periodically forced case . for the case of periodic forcing , a transition from a periodic to a chaotic oscillation has been found to occur via period doublings in both numerical and experimental works .
effect of the quasiperiodic forcing on this period - doubling route to chaotic oscillation has been investigated .
in contrast to the case of periodic forcing , new type of sn oscillating states have been found to exist between the regular and chaotic oscillating states as intermediate ones . due to their strange geometry ,
these sn oscillations lead to the occurrence of aperiodic complex spikings , as in the case of chaotic oscillations .
hence , sn oscillating states might be a dynamical origin for the complex spikings which are usually observed in cortical neurons .
various routes to sn oscillations via fractalization , collision with a smooth unstable torus , and collision with a nonsmooth ring - shaped unstable set have been identified , as in the quasiperiodically forced logistic map @xcite .
these sn responses are also found to occur in other neurons exhibiting period - doubling route to chaos ( _ e.g. , _ the morris - lecar neuron and the fitzhugh - nagumo neuron ) under quasiperiodic stimulus @xcite . finally , we suggest an experiment on the quasiperiodically forced squid giant axon and expect that sn spikings to be observed . however , the real biological environment is a noisy one .
hence , it is necessary to further investigate the effect of noise on the sn response for real experiment .
this type of investigation is beyond the scope of the the present paper , and hence it is left as a future work .
m. r. guevara , l. glass , and a. shrier , science * 214 * , 1350 ( 1981 ) ; l. glass , m. r. guevara , a. shrier , and r. perez , physica d * 7 * , 89 ( 1983 ) .
k. aihara , t. numajiri , g. matsumoto , and m. kotani , phys .
a * 116 * , 313 ( 1986 ) ; n. takahashi , y. hanyu , t. musha , r. kubo , and g. matsumoto , physica d * 43 * , 318 ( 1990 ) ; d. t. kaplan , j. r. clay , t. manning , l. glass , m. r. guevara , and a. shrier , phys .
* 76 * , 4074 ( 1996 ) .
k. aihara , scholarpedia 3(5 ) : 1786 ( 2008 ) ; see also references therein . l. glass and m. c. mackey , _ from clocks to chaos _
( princeton university press , princeton , 1988 ) .
r. stoop , k. schindler , and l.a .
bunimovich , neurosci .
36 * , 81 ( 2000 ) ; nonlinearity * 13 * , 1515 ( 2000 ) . m. ding and j. a. s. kelso , int . j. bifurcation chaos appl .
* 2 * , 295 ( 1992 ) .
u. feudel , s. kuznetsov , and a. pikovsky , _ strange nonchaotic attractors _ ( world scientific , singapore , 2006 ) .
a. prasad , s. s. negi , and r. ramaswamy , int .
j. bifuraction chaos appl .
* 11 * , 291 ( 2001 ) ; u. feudel , c. grebogi , and e. ott , phys . rep .
* 290 * , 11 ( 1997 ) . c. grebogi , e. ott , s. pelikan , and j. a. yorke , physica d * 13 * , 261 ( 1984 ) .
k. kaneko , prog .
. phys . * 72 * , 202 ( 1984 ) ; t. nishikawa and k. kaneko , phys .
e * 54 * , 6114 ( 1996 ) .
j. f. heagy and s. m. hammel , physica d * 70 * , 140 ( 1994 ) .
a. s. pikovsky and u. feudel , chaos * 5 * , 253 ( 1995 ) .
a. prasad , v. mehra , and r. ramaswamy , phys .
rev.lett .
* 79 * , 4127 ( 1997 ) .
kim , w. lim , and e. ott , phys .
e * 67 * , 056203 ( 2003 ) ; s .- y .
kim and w. lim , j. phys .
a * 37 * , 6477 ( 2004 ) .
w. lim and s .- y .
kim , phys .
a * 335 * , 383 ( 2005 ) .
w. lim and s .- y .
kim , phys .
a * 355 * , 331 ( 2006 ) ; s .- y . kim and w. lim , _ ibid . _ * 334 * , 160 ( 2005 ) .
kim , s .- y .
kim , b. hunt , and e. ott , phys .
e * 67 * , 036211 ( 2003 ) .
w. l. ditto , m. l. spano , h. t. savage , s. n. rauseo , j. heagy , and e. ott , phys .
lett . * 65 * , 533 ( 1990 ) ; w. x. ding , h. deutsch , a. dinklage , and c. wilke , phys .
e * 55 * , 3769 ( 1997 ) ; b. p. bezruchko , a. p. kuznetsov , and y. p. seleznev , phys .
e * 62 * , 7828 ( 2000 ) ; k. thamilmaran , d. v. senthikumar , a. venkatesan , and m. lakshmanan , phys .
e * 74 * , 036205 ( 2006 ) .
a. l. hodgkin and a. f. huxley , j. physiol.(london ) * 117 * , 500 ( 1952 ) .
k. aihara , g. matsumoto , and y. ikegaya , j. theor.biol .
* 109 * , 249 ( 1984 ) .
d. hansel , g. mato , and c. meunier , europhys.lett .
* 23 * , 367 ( 1993 ) . a. j. lichtenberg and m. a. lieberman , _ regular and stochastic motion _ ( springer - verlag , new york , 1983 ) , p. 283 .
e. m. izhikevich , int .
j. bifurcation chaos appl .
eng . * 10 * , 1171 ( 2000 ) . s .-
lee , a. neiman , and s. kim , phys .
e * 57 * , 3292 ( 1998 ) .
w. lim , s .- y .
kim , and y. kim ( unpublished ) .
@xmath65 and @xmath71 hz ( @xmath70 ) .
time series of @xmath52 for ( a ) @xmath72 @xmath157 , ( b ) @xmath186 @xmath65 , and ( c ) @xmath187 @xmath65 , which correspond to the period-1 , period-2 , and chaotic states in the poincar map @xmath75 ( solid circles represent stroboscopically sampled points in @xmath75 ) , respectively . the largest lyapunov exponent for the chaotic oscillation in ( c ) is @xmath188 .
( d ) bifurcation diagram ( _ i.e. _ , plot of @xmath10 versus @xmath6 ) in @xmath75 .
[ fig : pd ] ]     plane for @xmath67 @xmath65 and @xmath71 hz in the quasiperiodically forced hh oscillator .
regular , sn , and chaotic regions are shown in light gray , gray , and black , respectively . in the regular region ,
the torus , the doubled torus , and the quadrupled torus exist in the regions denoted by @xmath86 , @xmath87 , and @xmath88 , respectively , and the solid lines represent torus doubling bifurcation curves with terminal points denoted by crosses .
sn attractors appear via fractalization , collision with a smooth unstable torus , and collision with a nonsmooth ring - shaped unstable set when passing the heavy solid line , the dashed line , and the dotted line , respectively .
[ fig : sd ] ]     in fig .
[ fig : sd ] for @xmath93 @xmath157 .
time series of @xmath52 for ( a ) the quasiperiodic spiking state ( @xmath94 @xmath65 ) , ( b ) the sn spiking state ( @xmath189 @xmath65 ) , and ( c ) the chaotic spiking state ( @xmath190 @xmath65 ) .
projections of attractors onto the @xmath98 plane in the poincar map are shown for ( d ) the smooth torus [ corresponding to ( a ) ] , ( e ) the sn attractor [ corresponding to ( b ) ] , and ( f ) the chaotic attractor [ corresponding to ( c ) ] .
( g ) lyapunov - exponent diagram ( _ i.e. _ , plot of @xmath80 vs. @xmath6 ) ; @xmath80 for the sn attractor is shown in black .
( h ) phase sensitivity functions @xmath118 are shown for the smooth torus ( @xmath86 ) [ ( d ) ] and the sn attractor ( sna ) [ ( e ) ] .
for the case of the sn attractor , the graph is well fitted with a dashed straight line with slope @xmath191 .
( i ) plot of the phase sensitivity exponent @xmath82 versus @xmath127 @xmath128 for the sn attractor ; @xmath192 .
[ fig : frac ] ]     in fig .
[ fig : sd ] for @xmath132 @xmath65 .
stable two - band torus ( denoted by a solid curve ) and its unstable smooth torus ( represented by a short - dashed curve ) for ( a ) @xmath133 @xmath65 and ( b ) @xmath193 @xmath65 .
( c ) sn attractor with @xmath194 and @xmath195 for @xmath196 @xmath65 .
( d ) chaotic attractor with @xmath197 for @xmath139 @xmath65 . [
fig : hh ] ]     in fig .
[ fig : sd ] for @xmath139 @xmath65 .
( a ) smooth torus with @xmath198 for @xmath140 @xmath157 .
( b ) intermittent sn attractor with @xmath199 and @xmath143 for @xmath200 @xmath157 .
( c ) plot of @xmath201 vs. @xmath202 .
the graph is well fitted with a dashed straight line with slope @xmath203 . here
@xmath204 is the average characteristic time between bursts and @xmath162 @xmath205 @xmath63 .
for each @xmath206 , @xmath204 is calculated from @xmath146 laminar phases in the poincar map @xmath75 .
( d ) chaotic attractor with @xmath207 for @xmath208 @xmath65 . ( e)-(h )
band - merging transition from a two - band torus to an intermittent single - band sn attractor along the route @xmath153 in fig .
[ fig : sd ] for @xmath154 @xmath157 .
( e ) smooth two - band torus with @xmath209 for @xmath155 @xmath65 .
( f ) intermittent single - band sn attractor with @xmath158 and @xmath159 for @xmath210 @xmath65 .
( g ) plot of @xmath211 vs. @xmath212 .
the graph is well fitted with a dashed straight line with slope @xmath213 . here
@xmath204 is the average characteristic time between bursts and @xmath162 @xmath214 @xmath65 ) . for each @xmath206 ,
@xmath204 is calculated from @xmath146 laminar phases in @xmath161 .
( h ) chaotic attractor with @xmath215 for @xmath216 @xmath157 .
[ fig : int ] ]     @xmath65 in the rational approximation of level @xmath173 .
( a ) smooth torus ( denoted by a black curve ) and ring - shaped unstable set for @xmath175 @xmath65 .
each ring is composed of the attracting part ( shown in black ) and the unstable part ( shown in gray ) .
a magnified view of a ring is given in the inset .
( b ) smooth torus ( represented by a black curve ) and an evolved ring - shaped unstable set for @xmath177 @xmath65 .
as @xmath6 is decreased , the unstable part ( shown in gray ) in each ring becomes dominant .
( c)-(h ) mechanism for the intermittent transition to an sn attractor along the route @xmath138 in fig .
[ fig : sd ] for @xmath139 @xmath65 .
( c ) smooth torus and a ring - shaped unstable set for @xmath180 @xmath65 [ a magnified view near @xmath217 is given in ( d ) ] .
new rings appear inside or outside the old rings .
( e ) nonsmooth attractor born via a phase - dependent ( nonsmooth ) collision between the smooth torus and a ring - shaped unstable set for @xmath182 @xmath65 [ ( f ) is a magnified view near @xmath217 ] .
( g ) intermittent sn attractor with @xmath176 gaps ( born via an interior crisis ) for @xmath219 @xmath65 .
( h ) a magnified gap near @xmath217 .
[ fig : ra ] ]