in this paper we set out to study the functions in multivariate complex variables which however always take real values .
such functions are frequently encountered in engineering applications arising from signal processing  @xcite , electrical engineering , and control theory  @xcite .
it is interesting to note that such complex functions are usually not studied by conventional complex analysis , since they are typically not even analytic because the cauchy - riemann conditions will never be satisfied unless the function in question is trivial .
there has been a surge of research attention to solve optimization models related to such kind of complex functions  @xcite .
sorber et al .
@xcite developed a matlab toolbox for optimization problems in complex variables , where the complex function in question is either _ pre - assumed _ to be always real - valued  @xcite , or it is the modulus / norm of a complex function  @xcite . an interesting question thus arises : _ can such real - valued complex functions be characterized ? _ indeed there does exist a class of special complex functions that always take real values : the hermitian quadratic form @xmath0 where @xmath1 is a hermitian matrix . in this case , the quadratic structure plays a key role .
this motivates us to search for more general complex polynomial functions with the same property .
interestingly , such complex polynomials can be completely characterized , as we will present in this paper .
as is well - known , polynomials can be represented by tensors .
the same question can be asked about complex tensors .
in fact , there is a considerable amount of recent research attention on the applications of complex tensor optimization .
for instance , hilling and sudberythe  @xcite formulated a quantum entanglement problem as a complex multilinear form optimization under the spherical constraint , and zhang and qi  @xcite and ni et al .
@xcite discussed quantum eigenvalue problems , which arised from the geometric measure of entanglement of a multipartite symmetric pure state in the complex tensor space
. examples of complex polynomial optimization include aittomaki and koivunen  @xcite who formulated the problem of beam - pattern synthesis in array signal processing as complex quartic polynomial minimization , and aubry et al .
@xcite who modeled a radar signal processing problem by complex polynomial optimization .
solution methods for complex polynomial optimization can be found in , e.g. , @xcite . as mentioned before ,
polynomials and tensors are known to be related . in particular in the real domain , homogeneous polynomials ( or forms )
are bijectively related to _ symmetric _ tensors ; i.e. , the components of the tensor is invariant under the permutation of its indices .
this important class of tensors generalizes the concept of symmetric matrices . as the role played by symmetric matrices in matrix theory and quadratic optimization ,
symmetric tensors have a profound role to play in tensor eigenvalue problems and polynomial optimization
. a natural question can be asked about complex tensors : _ what is the higher order complex tensor generalization of the hermitian matrix ? _ in this paper , we manage to identify two classes of symmetric complex tensors , both of which include hermitian matrices as a special case when the order of the tensor is two .    in recent years , the eigenvalue of tensor has become a topic of intensive research interest .
perhaps a first attempt to generalize eigenvalue decomposition of matrices can be traced back to 2000 when de lathauwer et al .
@xcite introduced the so - called higher - order eigenvalue decomposition . shortly after that
, kofidis and regalia  @xcite showed that blind deconvolution can be formulated as a nonlinear eigenproblem .
a systematic study of eigenvalues of tensors was pioneered by lim  @xcite and qi  @xcite independently in 2005 .
various applications of tensor eigenvalues and the connections to polynomial optimization problems have been proposed ; cf .
@xcite and the references therein .
we refer the interested readers to the survey papers  @xcite for more details on the spectral theory of tensors and various applications of tensors .
computation of tensor eigenvalues is an important source for polynomial optimization  @xcite .
essentially the problem is to maximize or minimize a homogeneous polynomial under the spherical constraint , which can also be used to test the ( semi)-definiteness of a symmetric tensor . in this paper
we are primarily interested in complex polynomials / tensors that arise in the context of optimization . by nature of optimization
, we are interested in the complex polynomials that always take real values .
however , it is easy to see that if no _ conjugate _ term is involved , then the only class of real - valued complex polynomials is the set of real constant functions . ] .
therefore , the conjugate terms are necessary for a complex polynomial to be real - valued .
hermitian quadratic forms mentioned earlier belong to this category , which is an active area of research in optimization ; see e.g.  @xcite . in the aforementioned papers
@xcite on eigenvalues of complex tensors , the associated complex polynomials however are not real - valued .
the aim of this paper is different .
we target for a systematic study on the nature of symmetricity for higher order complex tensors which will lead to the property that the associated polynomials always take real values .
the main contribution of this paper is to give a full characterization for the real - valued conjugate complex polynomials and to identify two classes of symmetric complex tensors , which have already shown potentials in the algorithms design  @xcite .
we also proposed two new types of tensor eigenvalues / eigenvectors for the new classes of complex tensors .
this paper is organized as follows .
we start with the preparation of various notations and terminologies in section  [ sec : preparation ] . in particular ,
two types of conjugate complex polynomials are defined and their symmetric tensor representations are discussed . section  [ sec : condition ] presents the necessary and sufficient condition for real - valued conjugate complex polynomials , based on which two types of symmetric complex tensors are defined , corresponding to the two types of real - valued conjugate complex polynomials . as an important result in this paper ,
we then present the definitions and properties of eigenvalues and eigenvectors for two types of symmetric complex tensors in section  [ sec : eigenvalue ] . in section  [ sec : banach ] , we discuss banach s theorem , which states that the largest eigenvalue ( in the absolute value sense ) of a symmetric real tensor is equal to its largest singular value , and extend it to the two new types of symmetric complex tensors .
some application examples are discussed in section  [ sec : application ] to show the significance in practice of the theoretical results in this paper .
finally , we conclude this paper by summarizing our main findings and outlining possible future work in section  [ sec : conclusion ] .
throughout this paper we use usual lowercase letters , boldface lowercase letters , capital letters , and calligraphic letters to denote scalars , vectors , matrices , and tensors , respectively .
for example , a scalar @xmath2 , a vector @xmath3 , a matrix @xmath4 , and a tensor @xmath5 .
we use subscripts to denote their components , e.g. @xmath6 being the @xmath7-th entry of a vector @xmath3 , @xmath8 being the @xmath9-th entry of a matrix @xmath4 and @xmath10 being the @xmath11-th entry of a third order tensor @xmath5 . as usual , the field of real numbers and the field of complex numbers are denoted by @xmath12 and @xmath13 , respectively .    for any complex number @xmath14 with @xmath15 , its real part and imaginary part
are denoted by @xmath16 and @xmath17 , respectively .
its modulus is denoted by @xmath18 , where @xmath19 denotes the conjugate of @xmath20 . for any vector @xmath21 ,
we let @xmath22 be the transpose of its conjugate , and we define it analogously for matrices . throughout this paper
we uniformly use the 2-norm for vectors , matrices and tensors in general , which is the usual euclidean norm .
for example , the norm of a vector @xmath21 is defined as @xmath23 , and the norm of a @xmath24-th order tensor @xmath25 is defined as @xmath26      a multivariate complex polynomial @xmath27 is a polynomial function of variable @xmath21 whose coefficients are complex , e.g.  @xmath28 .
a multivariate _ conjugate
_ complex polynomial ( sometimes abbreviated by conjugate polynomial in this paper ) @xmath29 is a polynomial function of variables @xmath30 , which is differentiated by the subscript @xmath31 , standing for ` conjugate ' , e.g. @xmath32 .
in particular , a general @xmath33-dimensional @xmath24-th degree conjugate complex polynomial can be explicitly written as summation of monomials @xmath34 in the above notation for a monomial @xmath35 , the indices of the coefficient @xmath36 are always partitioned by a ` , ' to separate that of conjugate variables and that of regular variables . in particular
, the coefficient of a monomial that only has conjugate variables such as @xmath37 will be written as @xmath38 . in this definition , it is obvious that complex polynomials are a subclass of conjugate complex polynomials .
remark that a pure complex polynomial can never only take real values unless it is a constant .
this observation follows trivially from the basic theorem of algebra .
given a @xmath24-th order complex tensor @xmath25 , its associated multilinear form is defined as @xmath39 where @xmath40 for @xmath41 .
a complex tensor @xmath42 is called _ symmetric _ if @xmath43 and every component @xmath44 are invariant under all permutations of the indices @xmath45 .
we remark that conjugation is not involved here when speaking of symmetricity for complex tensors .
closely related to a symmetric tensor @xmath46 is a general @xmath24-th degree complex homogeneous polynomial function @xmath27 ( or complex form ) of variable @xmath47 , i.e. , @xmath48 in fact , symmetric tensors ( either in the real domain or in the complex domain ) are bijectively related to homogeneous polynomials ; see  @xcite . in particular , for any @xmath33-dimensional @xmath24-th degree complex form @xmath49 there is a uniquely defined @xmath33-dimensional @xmath24-th order symmetric complex tensor @xmath46 with @xmath50 satisfying  , where @xmath51 is the set of all distinct permutations of the indices @xmath52 . on the other hand , in light of formula  , a complex form @xmath27 is easily obtained from the symmetric multilinear form @xmath53 by letting @xmath54 .      to discuss higher order conjugate complex forms and complex tensors ,
let us start with the well - established properties of hermitian matrices .
let @xmath55 with @xmath56 , which is not symmetric in the usual sense because @xmath57 in general .
the following conjugate quadratic form @xmath58 always takes real values for any @xmath21 .
in particular , we notice that each monomial in the above form is the product of one ` conjugate ' variable @xmath59 and one usual ( non - conjugate ) variable @xmath60 .    to extend the above form to higher degrees , let us consider the following special class of conjugate polynomials :    [ def : sform ] a symmetric conjugate form of the variable @xmath21 is defined as @xmath61    essentially , @xmath62 is the summation of all the possible @xmath63-th degree monomials that consist of @xmath24 conjugate variables and @xmath24 usual variables . here
the subscript ` @xmath64 ' stands for ` symmetric ' .
the following example is a special case of  .    given a @xmath24-th degree complex form @xmath65 ,
the function @xmath66 is a @xmath63-th degree symmetric conjugate form .
notice that @xmath67 is actually a real - valued conjugate polynomial . later in section  [ sec : condition ] we shall show that a symmetric conjugate form @xmath62 in   always takes real values if and only if the coefficients of any pair of conjugate monomials @xmath68 and @xmath69 are conjugate to each other , i.e. , @xmath70    as any complex form uniquely defines a symmetric complex tensor and vice versa , we observe a class of tensors representable for symmetric conjugate forms .
[ def : partial - symmetric ] an even order tensor @xmath71 is called partial - symmetric if for every @xmath72 @xmath73    we remark that the so - called partial - symmetricity was studied earlier in algebraic geometry by carlini and chipalkatti  @xcite , and was also studied in polynomial optimization  @xcite in the framework of mixed polynomial forms , i.e. , for any fixed first @xmath24 indices of the tensor , it is symmetric with respect to its last @xmath24 indices , and vise versa .
it is clear that partial - symmetricity   is weaker than the usual symmetricity for tensors .
let us formally define the bijection @xmath74 ( taking the first initial of symmetric conjugate forms ) between symmetric conjugate forms and partial - symmetric complex tensors , as follows : + ( i ) @xmath75 : given a partial - symmetric tensor @xmath71 with its associated multilinear form @xmath76 , the symmetric conjugate form is defined as @xmath77 ( ii ) @xmath78 : given a symmetric conjugate form @xmath79  , the components of the partial - symmetric tensor @xmath71 are defined by @xmath80 for all @xmath81 and @xmath82 .    given a bivariate fourth degree symmetric conjugate form @xmath83 , the corresponding partial - symmetric tensor @xmath84 satisfies that @xmath85 and other entries are zeros .
conversely , @xmath62 can be obtained from @xmath86 .    according to the mappings defined previously , the following result readily follows .
[ thm : tensors ] the bijection @xmath74 is well - defined , i.e. , any @xmath33-dimensional @xmath63-th order partial - symmetric tensor @xmath71 uniquely defines an @xmath33-dimensional @xmath63-th degree symmetric conjugate form , and vice versa .      in , for each monomial the numbers of conjugate variables and the usual variables
are always equal .
this restriction can be relaxed further .
[ def : gform ] a general conjugate form of the variable @xmath21 is defined as @xmath87    essentially , @xmath88 is the summation of all the possible @xmath24-th degree monomials , allowing any number of conjugate variables as well as the usual variables in each monomial . here
the subscript ` @xmath89 ' stands for ` general ' . obviously @xmath62 is a special case of @xmath88 , and @xmath88 is a special case of @xmath29 .    in section  [ sec : condition ] we shall show that a general conjugate form @xmath88 will always take real values for all @xmath3 if and only if the coefficients of each pair of conjugate monomials are conjugate to each other . to this end , below we shall explicitly treat the conjugate variables as new variables : + ( i ) @xmath90 : given a symmetric tensor @xmath91 with its associated multilinear form @xmath53 , the general conjugate form of @xmath21 is defined as @xmath92 ( ii ) @xmath93 : given a general conjugate form @xmath94 of @xmath21 as  , the components of the symmetric tensor @xmath91 are defined as follows : for any @xmath95 , sort these @xmath96 s in a nondecreasing order as @xmath97 and let @xmath98 , then @xmath99    given a symmetric second order tensor ( matrix ) @xmath100 , the corresponding general conjugate form is @xmath101 conversely , @xmath102 can obtained component - wisely by  .
similar to lemma  [ thm : tensors ] , the following is easily verified ; we leave its proof to the interested readers .
[ thm : tensorg ] the bijection @xmath103 is well - defined , i.e. , any @xmath104-dimensional @xmath24-th order symmetric tensor @xmath91 uniquely defines an @xmath33-dimensional @xmath24-th degree general conjugate form , and vice versa .    to conclude this section we remark that a partial - symmetric tensor ( representation for a symmetric conjugate form ) is less restrictive than a symmetric tensor ( representation for a general conjugate form ) , while a symmetric conjugate form is a special case of a general conjugate form .
one should note that the dimensions of these two tensor representations are actually different .
in this section , we study the two types of conjugate complex forms introduced in section  [ sec : preparation ] : symmetric conjugate forms and general conjugate forms .
let us first focus on polynomials , and present the following general characterization of real - valued conjugate complex polynomials .
[ thm : realvalue ] a conjugate complex polynomial function is real - valued if and only if the coefficients of any pair of its conjugate monomials are conjugate to each other , i.e. , any two monomials @xmath105 and @xmath106 with @xmath2 and @xmath107 being their coefficients satisfying @xmath108 must have that @xmath109 .
the above condition actually implies that the coefficient of any self - conjugate monomial must be real . applying theorem  [ thm : realvalue ] to the two classes of conjugate forms that we just introduced , the conditions for them to always take real values
can now be characterized :    [ thm : condition ] a symmetric conjugate form @xmath110is real - valued if and only if @xmath111 a general conjugate form @xmath112is real - valued if and only if @xmath113    let us now prove theorem  [ thm : realvalue ] .
we first show the ` if ' part of the theorem , which is quite straightforward . to see this , for any pair of conjugate monomials ( including self - conjugate monomial as a special case ) of a conjugate complex polynomial : @xmath105 and @xmath114 with @xmath115 being their coefficients , if @xmath109 , then @xmath116 implying that @xmath117 is real - valued .
since all the conjugate monomials of a conjugate complex polynomial can be partitioned by conjugate pairs and self - conjugate monomials , the result follows immediately .    to proceed to the ` only if ' part of the theorem , let us first consider an easier case of univariate conjugate polynomials .
[ thm : uni - zero ] a univariate conjugate complex polynomial @xmath118 for all @xmath119 if and only if all its coefficients are zeros , i.e. , @xmath120 for all @xmath121 and @xmath122 .
let @xmath123 with @xmath124 and @xmath125 , and the identity can be rewritten as @xmath126 for any fixed @xmath127 , the function can be viewed as a polynomial with respect to @xmath128 . therefore the coefficient of the highest degree monomial @xmath129 must be zero , i.e. , @xmath130 consequently we have for any @xmath125 , @xmath131 the first and second parts of   can be respectively simplified as @xmath132 and @xmath133 by the orthogonality of the trigonometric functions , the above further leads to @xmath134 similarly ,   implies @xmath135 combining the above two sets of identities yields @xmath136 the degree of the function in   ( in terms of @xmath128 ) is then reduced by 1 .
the desired result follows obviously .
let us now extend lemma  [ thm : uni - zero ] to general multivariate conjugate polynomials .
[ thm : multi - zero ] an @xmath33-dimensional @xmath24-th degree conjugate complex polynomial @xmath137 for all @xmath21 if and only if all its coefficients are zeros , i.e. , @xmath138 for all @xmath139 , @xmath122 , @xmath140 and @xmath141 .
we shall prove the result by induction on the dimension @xmath33 .
the case @xmath142 is already shown in lemma  [ thm : uni - zero ] .
suppose the claim holds for all positive integers no more than @xmath143 .
then for the dimension @xmath33 , the conjugate polynomial @xmath29 can be rewritten according to the degrees of @xmath144 and @xmath145 as @xmath146 for any given @xmath147 , taking @xmath148 as a univariate conjugate polynomial of @xmath145 , by lemma  [ thm : uni - zero ] we have @xmath149 for any given @xmath150 , as @xmath151 is a conjugate polynomial of dimension at most @xmath143 , by the induction hypothesis all the coefficients of @xmath152 are zeros . observing that all the coefficients of @xmath148 are distributed in the coefficients of @xmath152 for all @xmath150 , the result is proven for dimension @xmath33 .    with lemma  [ thm : multi - zero ] at hand
, we can finally complete the ` only if ' part of theorem  [ thm : realvalue ] .
suppose a conjugate polynomial @xmath27 is real - valued for all @xmath21 .
clearly we have @xmath153 for all @xmath21 , i.e. , @xmath154 by lemma  [ thm : multi - zero ] it follows that @xmath155 for all @xmath139 , @xmath122 , @xmath140 and @xmath141 , proving the ` only if ' part of theorem  [ thm : realvalue ] .    with theorem  [ thm : realvalue ] ,
in particular corollary  [ thm : condition ] , we are in a position to characterize the tensor representations for real - valued conjugate forms . before concluding this subsection ,
let us present an alternative representation of real - valued symmetric conjugate forms , as a consequence of corollary  [ thm : condition ] .
[ thm : polyrealvalued ] a symmetric conjugate form @xmath62 is real - valued if and only if @xmath156 where @xmath157 is a complex form and @xmath158 for all @xmath159 .
the ` if ' part is trivial .
next we prove the ` only if ' part of the proposition .
if @xmath62 is real - valued , by corollary  [ thm : condition ] we have  .
then for any @xmath160 and @xmath161 , the sum of the conjugate pair satisfies @xmath162 summing up all such pairs ( taking half if it is a self - conjugate pair ) , the conclusion follows .
similarly we have the following result for general conjugate forms .
a general conjugate form @xmath88 is real - valued if and only if @xmath163 where @xmath157 is a complex polynomial and @xmath158 for all @xmath159 .      as any symmetric conjugate form uniquely defines a partial - symmetric tensor ( lemma  [ thm : tensors ] ) , it is interesting to see more structured tensor representations for real - valued symmetric conjugate forms .
[ thm : cps ] an even order tensor @xmath71 is called conjugate partial - symmetric if + ( i ) @xmath164 for all @xmath165 and @xmath82 , and + ( ii ) @xmath166 + hold for all @xmath167 and @xmath168 .
we remark that when @xmath169 , a conjugate partial - symmetric tensor is simply a hermitian matrix . for a general even degree ,
the square matrix flattening of a conjugate partial - symmetric tensor ; i.e. , flattening a tensor in @xmath170 to a matrix in @xmath171 by grouping the tensor s first @xmath24 modes into the rows of the matrix and its last @xmath24 modes into the columns of the matrix , is actually a hermitian matrix .
the conjugate partial - symmetric tensors and the real - valued symmetric conjugate forms are connected as follows .
[ thm : conju - mapping ] any @xmath33-dimensional @xmath63-th order conjugate partial - symmetric tensor @xmath71 uniquely defines ( under @xmath74 ) an @xmath33-dimensional @xmath63-th degree real - valued symmetric conjugate form , and vice versa ( under @xmath172 ) .    for any conjugate partial - symmetric tensor @xmath5
, @xmath173 satisfies @xmath174 implying that @xmath79 is real - valued .    on the other hand , for any real - valued symmetric conjugate form @xmath62 in
, it follows from corollary  [ thm : condition ] that @xmath175 holds for all the possible @xmath176 . by
, its tensor representation @xmath177 with @xmath178 satisfies the 2nd condition in definition  [ thm : cps ] , proving the conjugate partial - symmetricity of @xmath5 .
below is a useful property for conjugate partial - symmetric tensors , in the same vein as proposition  [ thm : polyrealvalued ] for the real - valued symmetric conjugate forms .
[ thm : conju - decomp ] an even order tensor @xmath71 is conjugate partial - symmetric if and only if @xmath179 where @xmath180 is symmetric and @xmath158 for all @xmath159 .
according to definition  [ thm : cps ] , it is straightforward to verify that @xmath181 is conjugate partial - symmetric , proving the ` if ' part of the proposition .
let us now prove the ` only if ' part .    by proposition  [ thm : conju - mapping ] , @xmath182 is a real - valued symmetric conjugate form . further by proposition  [ thm : polyrealvalued ]
, @xmath182 can be written as @xmath183 where @xmath157 is a complex form and @xmath158 for @xmath184 .
let @xmath180 be the symmetric complex tensor associated with the complex form @xmath157 for @xmath184 ; i.e. , @xmath185 we have @xmath186 thus , the symmetric conjugate form @xmath187 satisfies @xmath188 i.e. , @xmath189 . as @xmath74 is bijective , we have @xmath190 .
similar as for real - valued symmetric conjugate forms , we have the following tensor representations for real - valued general conjugate forms .
[ thm : css ] an even dimensional tensor @xmath91 is called conjugate super - symmetric if + ( i ) @xmath5 is symmetric , and + ( ii ) @xmath191 holds for all @xmath192 with @xmath193 for @xmath41 .
we remark that the conjugate super - symmetricity is actually _ stronger _ than the ordinary symmetricity for complex tensors since a second condition in definition  [ thm : css ] is required .
actually , this condition is to ensure that the general conjugate form @xmath194 is real - valued .
this is because if @xmath193 holds for @xmath41 , then the monomial with coefficient @xmath195 and the monomial with coefficient @xmath196 in the above form are actually a conjugate pair by noticing that the position of a conjugate variable @xmath59 and that of a usual variable @xmath6 in the vector @xmath197 differs exactly by @xmath33 for every @xmath7 . under the mapping @xmath103 defined in section  [ sec : gform ] , it is straightforward to verify the following tensor representations for real - valued general conjugate forms .
[ thm : gform - rv ] any @xmath104-dimensional @xmath24-th order conjugate super - symmetric tensor @xmath91 uniquely defines ( under @xmath103 ) an @xmath33-dimensional @xmath24-th degree real - valued general conjugate form , and vice versa ( under @xmath198 ) .
as mentioned earlier , lim  @xcite and qi  @xcite independently proposed to systematically study the eigenvalues and eigenvectors for real tensors .
subsequently , the topic has attracted much attention due to the potential applications in magnetic resonance imaging , polynomial optimization theory , quantum physics , statistical data analysis , higher order markov chains , and so on .
after that , this study was also extended to complex tensors  @xcite without considering the conjugate variables .
zhang and qi in  @xcite proposed the so - called q - eigenvalues of complex tensors .
[ thm : qeigen ] a scalar @xmath199 is called a q - eigenvalue of a symmetric complex tensor @xmath200 , if there exists a vector @xmath3 called q - eigenvector , such that @xmath201    throughout this paper , the notation ` @xmath202 ' stands for a position left for a vector entry . in definition  [ eq : qeigen ] , as the corresponding complex tensor does not have conjugate - type symmetricity , the q - eigenvalue does not specialize to the classical eigenvalues of hermitian matrices . in particular , @xmath203 is required in the system  . later on , ni et al .
@xcite defined the notion of unitary symmetric eigenvalue ( us - eigenvalue ) and demonstrated a relation with the geometric measure of quantum entanglement .
[ thm : useigen ] a scalar @xmath199 is called a us - eigenvalue of a symmetric complex tensor @xmath200 , if there exists a vector @xmath3 called us - eigenvector , such that @xmath204    in fact , the q - eigenvalue and the us - eigenvalue are essentially the same .
@xmath205 is a pair of q - eigenvalue and q - eigenvector if and only if @xmath206 is a pair of us - eigenvalue and us - eigenvector .
first , definition  [ thm : useigen ] implies that a us - eigenvalue is always real . to see this
, pre - multiplying @xmath207 to the first equation of   gives @xmath208 and pre - multiplying @xmath209 to the second equation of   yields @xmath210 therefore @xmath211 and so @xmath203 .
this actually implies that the first and second equations of   are the same by applying the conjugation to the second one .
thus ,   is equivalent to @xmath212 the claimed equivalence is obvious by comparing the above system with  .    in terms of eigenvalues ,
definitions  [ thm : qeigen ] and  [ thm : useigen ] are the same .    now with all the new notions introduced in the previous sections  in particular the bijection between conjugate partial - symmetric tensors and real - valued symmetric conjugate forms , and the bijection between conjugate super - symmetric tensors and real - valued general conjugate forms  we are able to present new definitions and properties of eigenvalues for complex tensors , which are naturally related to that of hermitian matrices .
let us first introduce two types of eigenvalues for conjugate partial - symmetric tensors and conjugate super - symmetric tensors .
[ thm : ceigen ] @xmath213 is called a c - eigenvalue of a conjugate partial - symmetric tensor @xmath5 , if there exists a vector @xmath47 called c - eigenvector , such that @xmath214    [ thm : geigen ] @xmath213 is called a g - eigenvalue of a conjugate super - symmetric tensor @xmath5 , if there exists a vector @xmath47 called g - eigenvector , such that @xmath215    in fact , the two types of eigenvalues defined above are always real , although they are defined in the complex domain .
this property generalizes the well - known property of hermitian matrices .
in particular , definition  [ thm : ceigen ] includes eigenvalues of hermitian matrices as a special case when @xmath169 .
[ thm : eigen - real ] every @xmath31-eigenvalue of a conjugate partial - symmetric tensor is always real ; so is every @xmath89-eigenvalue of a conjugate super - symmetric tensor .
suppose @xmath216 is a c - eigenvalue and c - eigenvector pair of a conjugate partial - symmetric tensor @xmath5 .
multiplying @xmath217 on both sides of the first equation in  , we get @xmath218 as @xmath5 is conjugate partial - symmetric , the left hand side of the above equation is real - valued , and so is @xmath199 . next ,
suppose @xmath216 is a g - eigenvalue and g - eigenvector pair of a conjugate super - symmetric tensor @xmath5 .
multiplying @xmath219 on both sides of the first equation in   yields @xmath220 as @xmath5 is conjugate super - symmetric , the left hand side of the above equation is real - valued , and so is @xmath199 .    as a consequence of proposition  [ thm : eigen - real ] , one can similarly define the c - eigenvalue @xmath203 and its corresponding c - eigenvector @xmath21 for a conjugate partial - symmetric tensor @xmath5 equivalently as follows .
[ thm : ceigen2 ] @xmath213 is a c - eigenvalue of a conjugate partial - symmetric tensor @xmath5 , if and only if there exists a vector @xmath21 , such that @xmath221    one important property of the z - eigenvalues for real symmetric tensors is that they can be fully characterized by the kkt solutions of a certain optimization problem  @xcite . at a first glance
, this property may not hold for c - eigenvalues and g - eigenvalues since the real - valued complex functions are not analytic . therefore ,
direct extension of the kkt condition of an optimization problem with such objective function may not be valid .
however , this class of functions is indeed analytic if we treat the complex variables and their conjugates as a whole due to the so - called wirtinger calculus  @xcite developed in the early 20th century . in the optimization context , without noticing the wirtinger calculus , brandwood  @xcite first proposed the notion of complex gradient .
in particular , the gradient of a real - valued complex function can be taken as @xmath222 .
interested readers are referred to  @xcite for more discussions on the wirtinger calculus in optimization with complex variables .    with the help of wirtinger calculus ,
we are able to characterize c - eigenvalues and c - eigenvectors in terms of the kkt solutions . therefore many optimization techniques can be applied to find the c - eigenvalues / eigenvectors for a conjugate partial - symmetric tensor .
[ prop : c - eigen ] @xmath21 is a c - eigenvector associated with a c - eigenvalue @xmath203 for a conjugate partial - symmetric tensor @xmath5 if and only if @xmath3 is a kkt point of the optimization problem @xmath223 with lagrange multiplier being @xmath224 and the corresponding objective value being @xmath199
.    by the multilinearity of @xmath5 , the gradient on @xmath3 of the real - valued symmetric conjugate form associated with @xmath5 is given by @xmath225 where the equality is due to the partial - symmetry of @xmath5 .
denote @xmath226 to be the lagrange multiplier associated with the constraint @xmath227 .
the kkt condition gives rise to the equations @xmath228 the conclusion follows immediately by comparing the above with   and  .
similarly , we have the following characterization .    [ prop : g - eigen ] @xmath21 is a g - eigenvector associated with a g - eigenvalue @xmath203 for a conjugate super - symmetric tensor @xmath5 if and only if @xmath3 is a kkt point of the optimization problem @xmath229 with lagrange multiplier being @xmath224 and the corresponding objective value being @xmath199 .      although the definitions of the c - eigenvalue , the g - eigenvalue , and the previously defined q - eigenvalue and the us - eigenvalue involve different tensor spaces , they are indeed closely related .
our main result in this section essentially states that the q - eigenvalue and the us - eigenvalue are special cases of the c - eigenvalue , and the c - eigenvalue is a special case of the g - eigenvalue .
[ thm : q - c - eigen ] denote @xmath230 to be a complex tensor and define @xmath231 .
it holds that + ( i ) @xmath200 is symmetric if and only if @xmath5 is conjugate partial - symmetric ; + ( ii ) if @xmath200 is symmetric , then all the c - eigenvalues of @xmath5 are nonnegative ; + ( iii ) if @xmath200 is symmetric , then @xmath232 is a c - eigenvalue of @xmath5 if and only if @xmath199 is a q - eigenvalue ( or a us - eigenvalue ) of @xmath200 .
\(i ) this equivalence can be easily verified by the definition of conjugate partial - symmetricity ( definition  [ thm : cps ] ) .
\(ii ) let @xmath21 be a c - eigenvector associated with a c - eigenvalue @xmath203 of @xmath5 .
by multiplying @xmath3 on both sides of the first equation in  , we obtain @xmath233    \(iii ) since the q - eigenvalue is the same as the us - eigenvalue , we only prove the former case .
suppose @xmath21 is a q - eigenvector associated with a q - eigenvalue @xmath203 of @xmath200 . by   we have @xmath227 and @xmath234 , and so @xmath235 by the similar derivation in the proof of ( ii ) , we get @xmath236 implying that @xmath232 is a c - eigenvalue of @xmath5 .
on the other hand , suppose @xmath21 is a c - eigenvector associated with a nonnegative c - eigenvalue @xmath232 of @xmath5 . then by   we have @xmath227 and @xmath237 where the first equality is due to the symmetricity of @xmath200 .
this leads to @xmath238 .
let @xmath239 with some fixed @xmath125 , and further define @xmath240 .
we then get @xmath241 now we are able to verify that @xmath242 is a q - eigenvector associated with q - eigenvalue @xmath199 of @xmath200 . observing @xmath243 , and by  , @xmath244 we finally get @xmath245    as we saw in section  [ sec : preparation ] , by definition , a symmetric conjugate form is a special general conjugate form .
hence in terms of their tensor representations , a conjugate partial - symmetric tensor is a special case of conjugate super - symmetric tensor , although they live in different tensor spaces . to study the relationship between the c - eigenvalue and the g - eigenvalue ,
let us embed a conjugate partial - symmetric tensor @xmath71 to the space of @xmath246 .
the conjugate super - symmetric tensor @xmath247 corresponding to @xmath5 is then defined by @xmath248 for example when @xmath169 , a conjugate partial - symmetric tensor is simply a hermitian matrix @xmath55 .
then its embedded conjugate super - symmetric tensor is @xmath249 , and clearly we have @xmath250 in general it is straightforward to verify that @xmath251 based on this , we are led to the following relationship between the c - eigenvalue and the g - eigenvalue .
[ thm : c - g - eigen ] if @xmath252 is a conjugate super - symmetric tensor induced by a conjugate partial - symmetric tensor @xmath253 according to  , then @xmath199 is a c - eigenvalue of @xmath5 if and only if @xmath254 is a g - eigenvalue of @xmath255 .
first , by taking the gradient @xmath256 on both sides of  , we have that @xmath257 next , according to definition  [ thm : ceigen ] and proposition  [ thm : ceigen2 ] , @xmath199 is a c - eigenvalue of @xmath5 if and only if there exists a vector @xmath21 such that @xmath258 finally , according to definition  [ thm : geigen ] , @xmath254 is a g - eigenvalue of @xmath255 if and only if there exists a vector @xmath21 such that @xmath259 the conclusion follows immediately by combining the above three facts .
a classical result originally due to banach  @xcite states that if @xmath260 is a continuous symmetric @xmath24-linear form , then @xmath261 in the space of real tensors where @xmath262 and @xmath263 is a multilinear form defined by a real symmetric tensor @xmath264 ,   states that the largest singular value  @xcite of @xmath263 is equal to the largest eigenvalue  @xcite ( in the absolute value sense ) of @xmath263 , i.e. , @xmath265 alternatively ,   is essentially equivalent to the fact that the best rank - one approximation of a real symmetric tensor can be obtained at a symmetric rank - one tensor  @xcite . a recent development on this topic for special classes of real symmetric tensors can be found in  @xcite . in this section
, we shall extend banach s theorem to symmetric conjugate forms ( the conjugate partial - symmetric tensors ) and general conjugate forms ( the conjugate super - symmetric tensors ) .
let us start with conjugate super - symmetric tensors , which are a generalization of conjugate partial - symmetric tensors .
a key observation leading to the equivalence ( theorem  [ thm : equal - con ] ) is the following result .
[ lemma : super - sym ] for a given real tensor @xmath266 , if @xmath267 for every @xmath268 and every permutation @xmath269 of @xmath270 , then @xmath5 is symmetric .
our first result in this section extends   to any conjugate super - symmetric tensors in the complex domain .
[ thm : equal - con ] for any conjugate super - symmetric tensor @xmath271 , we have @xmath272    let @xmath273 for @xmath274 .
we observe that @xmath275 is also a multilinear form with respect to @xmath276 . as a result
, we are able to find a real tensor @xmath277 such that @xmath278 as @xmath255 is conjugate super - symmetric , for any @xmath279 and any permutation @xmath269 of @xmath280 , one has @xmath281 by lemma  [ lemma : super - sym ] we have that the real tensor @xmath5 is symmetric . finally , noticing that @xmath282 for @xmath41 , the conclusion follows immediately by applying   to @xmath5 and then using the equality  .      for extending banach s theorem to a conjugate partial - symmetric tensor @xmath71
, one could hope to proceed as follows . since it is a special case of the conjugate super - symmetric tensor
, one can embed @xmath5 into a conjugate super - symmetric tensor @xmath247 using  .
then , by applying theorem  [ thm : equal - con ] to @xmath255 and rewriting the real part of its associated multilinear form @xmath283 in terms of @xmath5 , we may have an equivalent expression as  .
however , this expression is not succinct . taking the case @xmath284 ( degree 4 ) for example ,
it is straightforward to verify from   that @xmath285 and this would lead to @xmath286 instead , one would hope to get @xmath287 however , this does not hold in general .
the main reason is that @xmath288 which is easily observed since its left hand side is invariant under the permutation of @xmath289 while its right hand side is not . in particular ,   only holds for @xmath169 , viz .
hermitian matrices ; see the following proposition and example  [ ex : quarticfail ] .
[ degree2 ] for any hermitian matrix @xmath290 , it holds that @xmath291 furthermore , for any optimal solution @xmath292 of @xmath293 with @xmath294 , @xmath295 is an optimal solution of @xmath296 as well .
denote @xmath297 and @xmath298 to be the optimal values of @xmath296 and @xmath293 , respectively . noticing that @xmath299 , by the optimality condition of @xmath293 we have that @xmath300 where @xmath199 and @xmath226 are the lagrangian multipliers of the constraints @xmath227 and @xmath301 , respectively .
pre - multiplying the first two equations in   with @xmath302 and @xmath303 respectively , and summing them up , lead to @xmath304 similarly , the summation of the third and fourth equations in   leads to @xmath305 which further leads to @xmath306    moreover , the summation of the first and fourth equations in   yields @xmath307 which further leads to @xmath308 let @xmath309 .
clearly @xmath310 is a feasible solution of @xmath296 . by   and
we have @xmath311 this implies that @xmath312 .
notice that @xmath293 is a relaxation of @xmath296 and hence @xmath313 .
therefore we conclude that @xmath314 , and an optimal solution @xmath310 of @xmath296 is constructed from an optimal solution @xmath292 of @xmath293 .
[ ex : quarticfail ] let @xmath315 with @xmath316 and other entries being zeros .
clearly @xmath5 is conjugate partial - symmetric . in this case
fails to hold because : + ( i ) @xmath317 for any @xmath318 with @xmath227 .
+ ( ii ) @xmath319 for @xmath320 and @xmath321 .
thus , banach s theorem   does not hold in general for conjugate partial - symmetric tensors .
a natural question arises : is there any reasonable condition to ensure the identity to hold ?
recall from proposition  [ thm : conju - decomp ] that every conjugate partial - symmetric tensor can be written as @xmath181 where @xmath180 is symmetric and @xmath158 for all @xmath159 .
if further we have all @xmath322 s being nonnegative , then   is true . before presenting this result
, we first need the following type of banach s theorem for symmetric complex tensors , whose proof can be constructed almost identically to that of theorem  [ thm : equal - con ] .
[ thm : complexbanach ] if @xmath323 is symmetric , then @xmath324    [ thm : banach2 ] if a conjugate partial - symmetric tensor @xmath71 written as @xmath325 satisfies that @xmath326 for all @xmath159 , then @xmath327    let us first introduce a sandwiched optimization model : @xmath328 denote @xmath329 , @xmath330 and @xmath331 to be the optimal values of @xmath332 , @xmath333 and @xmath334 , respectively . clearly , @xmath334 is a relaxation of @xmath333 , and @xmath333 is a relaxation of @xmath332 , implying that @xmath335 .
next , let @xmath336 be an optimal solution of @xmath334 . consider the following problem : @xmath337 whose optimal solution is denoted by @xmath338 .
noticing that @xmath339 is symmetric , by proposition  [ thm : complexbanach ] , we have @xmath340 for the same reason , we have @xmath341 implying that @xmath342 .
finally , let @xmath343 be an optimal solution of @xmath333 . since @xmath326 for all @xmath344 , we have @xmath345 remark that the positivity of @xmath322 s is exploited when invoking the triangle inequality in the first inequality above .
this implies that either @xmath346 or @xmath347 attains @xmath330 , proving that @xmath348 .
therefore we have @xmath349 .
we remark that the condition for @xmath322 s being nonnegative in @xmath5 in theorem  [ thm : banach2 ] is actually the condition for the real - valued symmetric conjugate form @xmath182 being a sum of squares ( sos ) of complex polynomials ; see the relation between propositions  [ thm : polyrealvalued ] and  [ thm : conju - decomp ] . in the field of polynomial optimization , checking
whether a polynomial is sos can be done by the feasibility of a semidefinite program . in fact , there is an easy sufficient condition for the condition on @xmath5 in theorem  [ thm : banach2 ] to hold : the square matrix flattening of @xmath5 is hermitian positive semidefinite .
interested readers are referred to  @xcite for details .
the theoretical results developed in the previous sections are also useful in practice . in this section , we shall discuss some applications that can be formulated as real - valued complex polynomial optimization models .
in particular , these problems can be cast as finding the largest c - eigenvalue of a conjugate partial - symmetric tensor or the largest g - eigenvalue of a conjugate super - symmetric tensor .
one challenge of these eigenvalue optimization problems is that the variables are coupled in the complex polynomial objective function .
however , the extended banach s theorem in section  [ sec : banach ] , specifically theorems  [ thm : equal - con ] and  [ thm : banach2 ] , guarantee that we can separate the variables without losing the optimality .
this enables us to focus on the multilinear ( block ) optimization model @xmath350 for a conjugate super - symmetric tensor @xmath255 , or @xmath351 for certain conjugate partial - symmetric tensor @xmath5 .
one great advantage of the above models is that the optimization over one block variable is easy when other blocks are fixed .
therefore , some efficient solution methods tailored for these models can be applied , such as the block coordinate decent method  @xcite and the maximum block improvement method  @xcite .
conversely , the extended banach s theorem in section  [ sec : banach ] provides an alternative way to solve the symmetric multilinear optimization model by resorting to some approaches tailored for symmetric tensor problems such as the power method  @xcite and the semidefinite programming method  @xcite .
in particular , as the search space can be restricted to symmetric solutions , the latter equivalent model significantly reduces the number of decision variables , which is beneficial to many practical algorithms such as semidefinite programs .
the ambiguity function of the waveform is often used to probe the environment in radar system . by controlling both the doppler and the range resolutions of the system
, it can regulate the interference power produced by unwanted returns  @xcite . to be specific ,
suppose @xmath352 is the normalized target doppler frequency and @xmath353 is the radar code to be optimized .
there are @xmath354 interfering scatterers and the matrix @xmath355 for @xmath356 is defined as @xmath357 the ambiguity function of @xmath358 for the time - lag @xmath356 and the normalized doppler frequency @xmath359 $ ] is given by @xmath360 where @xmath361 and @xmath362 denotes the hadamard product ; interested readers are referred to  @xcite for more details of the ambiguity function and radar waveform design .
denote by @xmath363 the time - lag of the @xmath364-th scatterer , and let @xmath365 be the normalized doppler frequency of the @xmath364-th scatterer .
the latter is usually modeled as a random variable uniformly distributed around a mean frequency @xmath366 with some tolerance @xmath367 , i.e. , @xmath365 is a uniform distribution in @xmath368 $ ] .
consequently , the disturbance power at the output of the matched filter is given by @xmath369 + \sigma^2\|{\boldsymbol{s}}\|^2,\ ] ] where @xmath370 is the variance of the circular white noise , and @xmath371 is the echo mean power produced by the @xmath364-th scatterer .
to simplify the notation , all the following normalized doppler frequencies are expressed in terms of the difference with respect to @xmath352 .
we discretize the normalized doppler interval @xmath372 into @xmath373 bins , denoted by discrete frequencies @xmath374 for @xmath375 .
let @xmath376 \neq \varnothing \right\}.\ ] ] then the above statistical expectations can be approximated by the sample means over @xmath377 , i.e. , @xmath378 \approx \frac{1}{|\delta_k|}\sum_{j \in \delta_k } g_{{\boldsymbol{s } } } ( r_k , x_{j } ) , \ ] ] plugging the above expression into  , the total disturbance power at the output of the matched filter can be rewritten as @xmath379 where @xmath380 with @xmath381 being the kronecker delta and @xmath382 being an indicator function .    to obtain phase - only modulated waveforms , an optimization model to minimize @xmath383 subject to constant modulus constraints
was proposed in  @xcite : @xmath384 .
another modeling strategy is to account for the finite energy transmitted by the radar and assume that @xmath385 .
however , this single constraint does not provide any kind of control on the shape of the resulting coded waveform . to circumvent this drawback ,
one practical approach is to enforce a similarity constraint ( see  @xcite for more details ) : @xmath386 where @xmath387 is a known code which shares some nice properties such as a constant modula and a reasonable range resolution .
moreover , since any feasible @xmath358 satisfies @xmath388 and @xmath389 therefore , @xmath390 is equivalent to @xmath391 .
typically , the similarity constraint   is not a hard constraint , it aims to restrict the searching area within some neighborhood of @xmath387 and the size of the neighborhood is controlled by @xmath392 .
motivated by the aforementioned equivalence , a similar result can be achieved by penalizing the quantity @xmath393 in the objective and we arrive the following formulation @xmath394 with penalty parameter @xmath128 .
notice that the objective function in   is a real - valued quartic conjugate complex form .
if @xmath395 is the optimal solution and so is @xmath396 , then we can choose one of them to make sure that @xmath397 .
the model   is obviously finding the smallest c - eigenvalue of a conjugate partial - symmetric tensor , which can also be viewed as finding the smallest g - eigenvalue of a conjugate super - symmetric tensor as mentioned in theorem  [ thm : c - g - eigen ] .
many modern engineering problems can be cast as multilinear least squares regression given as @xmath398 where @xmath399 is a given nonzero complex tensor .
for instance , in quantum entanglement the geometric measure of a given @xmath24-partite pure state @xmath5 is defined by  ; see  @xcite for details .
in fact ,   can be also categorized as a g - eigenvalue problem for a conjugate super - symmetric tensor . to see this , first it is easy to see that   is equivalent to @xmath400 when all @xmath401 s with @xmath402 for @xmath403 are fixed , the optimal @xmath199 satisfies @xmath404 therefore , by multilinearity ,   is equivalent to @xmath405    let us now consider a relaxation of the above model @xmath406 a key observation is that this relaxation is actually tight . to see this ,
suppose @xmath407 is an optimal solution of  .
trivially we have @xmath408 as @xmath5 is nonzero and so @xmath409 for @xmath41 . by noticing @xmath410
we have that @xmath411 and so @xmath412 therefore , the feasible solution @xmath413 of   is already optimal to the relaxation model  , proving the equivalence between   and  .    finally , to formulate   as a g - eigenvalue optimization problem , let us denote @xmath414 and construct a symmetric complex tensor @xmath415 such that @xmath416 thus ,   can be rewritten as @xmath417 where @xmath418 is a conjugate super - symmetric tensor .
the multilinear least square model   is shown to be a special case of the g - eigenvalue optimization problem .
this paper focuses on complex polynomial functions that incorporate conjugate variables .
we introduced two types of conjugate complex forms and their symmetric tensor representations . necessary and sufficient conditions for these conjugate complex forms being
real - valued are presented , based on which two types of symmetric complex tensors are introduced .
we present new definitions of eigenvalues / eigenvectors , namely the @xmath31-eigenvalue and the @xmath89-eigenvalue , which generalize the existing concepts of eigenvalues in the literature .
extensions of banach  @xcite type s theorem on these complex tensors are discussed as well . to give the readers a holistic picture table  [ table ]
summarizes the main contents .
.summary of the symmetric conjugate form and the general conjugate form [ cols="<,<,<",options="header " , ]     an important aspect of polynomials is the theory of nonnegativity .
most existing results only apply for polynomials in real variables , for the reason that such polynomials are real - valued . since we have the full characterization of real - valued conjugate complex polynomials introduced in this paper , the question about their nonnegativity naturally arises , in particular , the relationship between nonnegativity and sos . in the real domain ,
this problem was completely solved by hilbert  @xcite in 1888 . however , relationship between nonnegative complex polynomials and sos has not been established explicitly in the literature as far as we know .
this would be one of the future research using the notion of conjugate polynomials .
moreover , the new notions of symmetric complex tensors and the eigenvalues / eigenvectors would hopefully attract future modelling opportunities , and the newly developed properties , in particular the extension of banach s result would be helpful in solution methods for complex polynomial optimization .
the authors would like to thank the anonymous referees and the associated editor for their insightful comments , which helped to significantly improve this paper from its original version .
we are also grateful to augusto aubry for discussions on radar waveform design with similarity constraint .
a. aubry , a. de maio , a. farina , and m. wicks , _ knowledge - aided ( potentially cognitive ) transmit signal and receive filter design in signal - dependent clutter _ , ieee transactiopns on aerospace and electronic systems , 49 , 93117 , 2013 .
lim , _ singular values and eigenvalues of tensors : a variational approach _ , proceedings of the ieee international workshop on computational advances in multi - sensor adaptive processing , 1 , 129132 , 2005 .
l. sorber , m. van barel , and l. de lathauwer , _ optimization - based algorithms for tensor decompositions : canonical polyadic decomposition , decomposition in rank-@xmath420 terms and a new generalization _ , siam j. optim . , 23 , 695720 , 2013