rayleigh - bnard system rotating uniformly about a vertical axis  @xcite is an interesting problem for studying pattern - forming instabilities and bifurcations ,  @xcite chaos ,  @xcite and turbulence  @xcite in addition to its potential applications in rotating cryogenics .  @xcite the rotation about a vertical axis introduces coriolis force as well as centrifugal force  @xcite in the flow .
rubio , lopez & marques  @xcite showed interesting effects of the centrifugal force even for small values ( @xmath16 ) of the froude number @xmath17 , which is a ratio of the centrifugal force to the force of buoyancy .
the coriolis force is known to break the mirror symmetry of the convective flow patterns  @xcite even at small rotation rates .
chandrasekhar  @xcite analyzed the effects of coriolis force on the onset of convection in a rayleigh - bnard system .
the linear theory of chandrasekhar predicted the onset of rayleigh - bnard convection ( rbc ) through a stationary instability for fluids with prandtl number @xmath18 for all rotation rates .
the selection of patterns is , however , a purely nonlinear phenomenon , and can not be determined by a linear theory .
the non - linear analysis of the problem by kppers and lortz  @xcite ( kl ) showed that ( i ) a set of parallel rolls was the steady state solution at the instability onset for the dimensionless rotation rates ( @xmath19 ) below a critical value @xmath20 , and ( ii ) the convection was always unsteady at the instability onset for @xmath21 .
this led to interesting pattern dynamics .
a set of parallel rolls was found to be replaced by another set of parallel rolls oriented at an angle of about @xmath22 with the old rolls  @xcite for @xmath21 .
the change in orientation of rolls was because of noise .
the linear theory of chandrasekhar also predicted the possibility of oscillatory convection at the onset for @xmath23 at dimensionless rotation rates above a critical value @xmath24 . for a fluid with @xmath25 , the critical value @xmath26 of the taylor number
@xmath27 is equal to @xmath28 .
however , the oscillatory convection may appear at small or moderate rotation rates for low - prandtl - number fluids .
the previous investigations on instabilities and bifurcations above the onset of oscillatory rayleigh - bnard convection in fluids rotating uniformly about a vertical axis  @xcite were done in small simulation boxes .
low - prandtl - number convection  @xcite is relevant for geophysical  @xcite and astrophysical  @xcite problems .
the estimated value of @xmath29 for earth s molten core  @xcite is approximately equal to @xmath30 .
the molten outer core and the inner solid core are separated by a transition zone , which itself is in liquid state .
the other transition zone between the molten core and the lower mantle is also highly viscous and deformable .
the transition zones on the two sides of earth s molten core have discontinuities , and they keep drifting non - uniformly . the boundary conditions for the velocity and the temperature fields are complex on these bounding surfaces .
the boundaries of the  convective zone " in stars ( @xmath31 ) are also complex .
the numerical simulations to investigate the phenomenon of thermal convection in earth s molten core , or in the convective zones of a star , are usually done either with _ no - slip _ or _ free - slip _ ( _ stress - free _ ) boundary conditions on the velocity field .
the no - slip conditions are appropriate where the bounding surfaces are rigid and stationary .
the predictions of the simulations with no - slip boundary conditions have the advantage of being verified in controlled laboratory experiments .
however , the stress - free boundary conditions may be a more useful approximation on a boundary between two liquids with a large difference in their viscosities .
goldstein and graham  @xcite achieved almost stress - free boundaries in experiments .
the famous kl instability  @xcite was predicted and understood for the first time by considering stress - free boundary conditions .
in addition , the idealized boundary conditions are useful in developing simple models to investigate details of bifurcations qualitatively .
both types of boundary conditions are useful for better understanding of the natural convection in geophysical and astrophysical problems in the absence of exact boundary conditions .    we present , in this article , the results of our investigations of the role of coriolis force on the convective instabilities near the onset of rayleigh - bnard convection ( rbc ) in a low - prandtl - number fluid rotating uniformly about a vertical axis .
we have considered @xmath0 , which is relevant for earth s molten core .
the onset of convection is then oscillatory  @xcite at relatively smaller rotation rates .
our aim is to investigate the effects of the coriolis force on the onset of rbc when the conduction state becomes unstable via an oscillatory instability .
we have carried out direct numerical simulations ( dns ) of three - dimensional flows in a box with thermally conducting and stress - free top and bottom surfaces for the purpose .
the stress - free boundary conditions also allowed us to investigate the effects of coriolis force on the instabilities and bifurcations  @xcite observed in low - prandtl - number fluids without rotation .
simulations were done in a box of size @xmath1 for a wide range of taylor numbers ( @xmath2 ) .
the ratio @xmath3 of the horizontal dimensions @xmath32 and @xmath33 of the simulation box was varied in a range of @xmath34 ( @xmath35 )
. this enabled us to investigate the nonlinear interactions between two sets of rolls of different wavelengths and at different orientations .
the simulations done show the appearance of convection in the form of two - dimensional standing waves in smaller boxes ( @xmath6 and @xmath7 ) .
we observe fluid patterns , which vary quasiperiodically in time , at the instability onset in simulation boxes with @xmath8 and @xmath9 .
we observe three - dimensional ( 3d ) patterns just above the onset of convection for @xmath36 in a simulation box with square cross - section ( @xmath8 ) .
these patterns describe a nonlinear superposition of two sets of mutually perpendicular rolls .
the two largest fourier modes @xmath37 and @xmath38 show amplitude modulation with time .
the amplitude and the frequency of modulation of both the modes are found to be equal . in a small window of taylor numbers ( @xmath39 ) , the primary instability displays temporally chaotic behavior .
the chaotic flow becomes once again quasiperiodic at @xmath40 .
however , the amplitude and the frequency of modulation of both the modes @xmath37 and @xmath38 are unequal in this case .
the resulting patterns are cross - rolls varying quasiperiodically in time .
the amplitude of @xmath38 decreases with further increase in @xmath41 .
a bifurcation from three - dimensional quasiperiodic flow to two - dimensional ( 2d ) periodic convection occurs at the primary instability for @xmath42 .
the 2d oscillatory rolls continue to exist until @xmath43 .
we also present a low - dimensional model constructed for a square simulation box . in a box with rectangular cross - section ( @xmath9 )
, we observe the appearance of convection as 3d waves varying quasiperiodically in time for all values of @xmath41 considered here .
three - dimensional ( 3d ) temporally chaotic convection is observed at the instability onset in longer boxes ( @xmath44 ) .
the convective patterns at the onset show a chaotic competition between two sets of rolls oriented at an angle @xmath15 , as observed in kl instability .
however , the sequence of convective patterns during kl type instability consist of rolls , rhombic patterns , and oblique wavy rolls just above the primary instability .
we consider a thin layer of a boussinesq fluid of mean density @xmath45 , thermal expansion coefficient @xmath46 , kinematic viscosity @xmath47 and thermal diffusivity @xmath48 confined between two conducting horizontal surfaces separated by a distance @xmath49 .
the whole system is supposed to be rotating uniformly about a vertical axis with uniform rotation rate @xmath50 . the bottom surface is uniformly heated , while the top surface is uniformly cooled .
an adverse temperature gradient @xmath51 is imposed across the fluid layer by maintaining a temperature difference @xmath52 across it .
we have considered convection near the onset in a low - prandtl - number ( @xmath53 ) fluid with the boussinesq parameter @xmath54 for dimensionless rotation rate @xmath55 .
the ratio of coriolis force and the force of buoyancy is @xmath56 , while the ratio of centrifugal force and coriolis force is @xmath57 for all values of @xmath41 considered here .
all the simulations have been done in boxes of aspect ratio @xmath58 between @xmath59 and @xmath60 .
the froude number @xmath61 therefore varies from @xmath62 to @xmath63 .
the effects of centrifugal force are therefore ignored here .
we have considered the state of steady conduction as the basic state in a rotating frame of reference .
we have not considered the situation where the basic state has a mean flow .
the dimensionless hydrodynamic equations , which govern the convective flow in a boussinesq fluid , are then given by , @xmath64 & = & { \nabla}^2 \theta + v_3,\label{eq : theta}\\ \nabla{\cdot}{\bf v } & = & 0 , \label{eq : continuity}\end{aligned}\ ] ] where @xmath65 is the velocity field , and the unit vector @xmath66 is directed vertically upward .
the deviations in the pressure and temperature fields from their values in the basic state of stationary conduction are denoted as @xmath67 and @xmath68 respectively .
lengths , time , velocity and temperature fields are measured in units of the fluid thickness @xmath49 , the viscous diffusion time @xmath69 , @xmath70 and @xmath71 respectively .
dimensionless numbers are : prandtl number @xmath72 , rayleigh number @xmath73 and taylor number @xmath41 @xmath74 @xmath75 @xmath74 @xmath76 , where @xmath77 is the gravitational acceleration .
the boundary conditions at thermally conducting and stress - free bounding surfaces located at @xmath78 are : @xmath79 all fields are considered to be periodic in horizontal plane .
the use of periodic boundary conditions is very popular to simulate flows in an extended layer of fluid .
it captures the flow structure nicely away from the lateral walls .
the periodic boundary conditions ( pbc ) allow a high resolution simulation in a box .
the simulation of a flow in a large container without pbc may require prohibitive grids to resolve the flow structure .
the use of pbc is the most appropriate with pseudo spectral method used here , as it facilitates the computation of terms like @xmath80 , @xmath81 exactly in numerical sense .
the nature of thermal convection at the primary instability  @xcite depends upon the values of the taylor number @xmath41 and prandtl number @xmath29 .
the critical rayleigh number @xmath82 and the corresponding wavenumber @xmath83 for stationary convection are : @xmath84,~~\     k_{c}(ta ) = \pi \sqrt{a_{+}+a_{-}-1/2},\nonumber\\   \text{with }   a_{\pm } & = & \left ( \frac{1}{4}\left\lbrace \frac{1}{2}+\frac{ta}{\pi^4}\pm \left [ \left ( \frac{1}{2 } + \frac{ta}{\pi^4}\right)^2 -\frac{1}{4}\right]^\frac{1}{2 } \right\rbrace \right)^\frac{1}{3}.\end{aligned}\ ] ] the critical rayleigh number @xmath85 and the corresponding wavenumber @xmath86 for the oscillatory convection are : @xmath87,~~\    k_{\circ } ( ta , pr ) = \pi \sqrt{b_{+}+b_{-}-1/2},\nonumber\\ \text{with } b_{\pm } & = & \left ( \frac{1}{4}\left\lbrace \frac{1}{2}+\frac{pr^2}{(1+pr)^2}\frac{ta}{\pi^4}\pm   \left [ \left ( \frac{1}{2}+\frac{pr^2}{(1+pr)^2}\frac{ta}{\pi^4}\right)^2 -\frac{1}{4}\right]^\frac{1}{2 } \right\rbrace \right)^\frac{1}{3}.\end{aligned}\ ] ] the angular frequency @xmath88 of the oscillatory convection is given by the expression : @xmath89^{\frac{1}{2}}.\ ] ] it is always real , and @xmath90 in a fluid with @xmath0 , if @xmath91 .
the conduction state therefore loses stability via oscillatory instability , if @xmath92 in a fluid with @xmath0 .
the velocity , temperature , and pressure fields are expanded as : @xmath93 where @xmath94 , @xmath95 , @xmath96 , @xmath97 , and @xmath98 are the fourier amplitudes in the expansion of the fields @xmath99 , @xmath100 , @xmath101 , @xmath102 , and @xmath103 respectively .
@xmath104 is the horizontal wave vector of the perturbations .
the integers @xmath105 can take values consistent with the continuity equation  ( eq .  [ eq : continuity ] ) .
this leads to the condition : @xmath106 we allow all the modes , which are compatible with eq .
[ cont_1 ] , in our simulation .
perturbations with the critical wavenumber @xmath86 for the oscillatory convection are the most dangerous ones , as soon as @xmath107 is raised above its critical value @xmath108 . in addition , perturbations with long wavelengths are always present in larger containers .
we therefore set @xmath109 , and treat @xmath110 as a parameter .
simulations are done in a rectangular box of size @xmath1 , where @xmath111 and @xmath112 .
the ratio @xmath113 is varied in a wide range ( @xmath35 ) for each value of @xmath41 .
varying the parameter @xmath34 allows us to investigate the nonlinear interactions of perturbations of different wavelengths with 2d rolls .
we numerically integrate the hydrodynamic system ( eqs .
[ eq : momentum]-[eq : continuity ] ) with the boundary conditions ( eq .  [ bcs ] ) using pseudo - spectral method .
@xcite the code is validated for low - prandtl - number rbc with and without rotation .
the limit of zero - prandtl - number rbc  @xcite without rotation was investigated in detail by pal et al .
@xcite after validating the code with the results of thual  @xcite for stress - free boundary conditions .
the turbulent flow in low - prandtl - number rbc with uniform rotation was studied using the code by pharasi et al .
@xcite after reproducing the results of king et al .
@xcite for @xmath114 .
we have used three spatial grids ( @xmath115 , @xmath116 and @xmath117 ) for our simulations . a standard fourth order runge - kutta ( rk4 )
scheme with step size @xmath118 was used for time advancement .
simulations for different values of @xmath41 were carried out with small random initial conditions and were continued until a steady state was reached .
the fourier modes @xmath119 and @xmath120 , which are responsible for the mean horizontal flow , are not generated in the simulations for all the values of @xmath41 considered here .
the convective flow was assumed to be steady , if the temporal behavior of the box averaged kinetic energy @xmath121 and the nusselt number @xmath122 showed steady behavior for a period more than three hundred viscous diffusion time @xmath69 .
the power spectra of the fourier modes @xmath37 and @xmath38 also confirmed the flow in a steady state .
the symbol @xmath123 stands for the average over the simulation box .
the final values of all fields in a steady state , in a given run , were also used as initial conditions for the next run when the reduced rayleigh number @xmath124 was raised in small steps ( @xmath125 ) for a fixed value of @xmath41 .
the simulations showing temporally quasiperiodic states were first done on @xmath115 grids for more than three hundred viscous diffusion time .
then the final values of all the fields were used as initial conditions on @xmath117 grids for more than one hundred dimensionless time unit .
similar spatial grids were used for longer simulation boxes .
.convective patterns for @xmath53 just above the primary instability ( @xmath126 ) in different simulation boxes . two - dimensional ( 2d ) and three - dimensional ( 3d ) standing waves ( sw ) , quasiperiodic cross - rolls ( qpcr ) , and kppers - lortz ( kl ) type patterns were observed in dns . [ cols="^,^,^,^,^",options="header " , ]
the convective patterns , computed from dns , just @xmath127 above the onset of convection are listed in table  [ table1 ] . for shorter periodic boxes ( @xmath128 and @xmath7 )
, we observe the onset of convection in the form of two - dimensional ( 2d ) standing waves ( sw ) .
the convective patterns consist of a set of straight rolls .
the locations of up - flow and down - flow alternate periodically .
the patterns computed by dns in small simulation boxes are in agreement with earlier predictions  @xcite near the onset of oscillatory rbc with rotation .
dawes  @xcite called the time - periodic 2d rolls as standing rolls .
the boxes with smaller cross - section in horizontal plane do not allow two sets of rolls simultaneously .
however , we observe interesting behavior in square ( @xmath129 ) and rectangular ( @xmath130 ) boxes .
the convection appears in the form of a quasiperiodic competition between two sets of mutually perpendicular sets of rolls .
we label them as quasiperiodic cross - rolls ( qpcr ) .
similar patterns are also known as quasiperiodic standing waves  @xcite or quasiperiodic standing cross - rolls  @xcite in literature .
we also observe a chaotic competition between two sets of wavy rolls oriented with each other at an angle near the primary instability in larger simulation boxes ( @xmath131 ) for all values of @xmath41 considered here .
rhombic patterns , which are due to the nonlinear superposition of the two sets of wavy rolls , are observed during the change in orientation of the rolls .
we label them as kl - type patterns .     and @xmath38 for the patterns ( @xmath132 , @xmath133 , @xmath8 ) shown in fig .
[ contour_ta_750 ] : ( a ) the variation of the fourier modes @xmath37 [ blue ( black ) curves ] and @xmath38 [ pink ( gray ) curves ] with time , ( b ) the same as in ( a ) but for a shorter time interval , ( c ) the power spectral density ( psd ) of the modes @xmath37 [ blue ( black ) curves ] and @xmath38 [ pink ( gray ) curves ] , and ( d ) the projection of the phase space on the @xmath134 plane.,width=14,height=11 ]      we now present the results computed from dns in a box with square ( @xmath8 ) cross - section , and discuss them . the contour plots of the temperature field for @xmath0 at different instants of time are displayed in fig .  [ contour_ta_750 ] .
it shows different patterns due to time dependent competition between two sets of mutually perpendicular rolls .
we observe square patterns whenever the amplitudes of two sets of rolls become equal .
the patterns appear as cross rolls for most of the time . the positions of up - flow and down - flow alternate in time .
the temporal variations of the two largest fourier modes @xmath37 and @xmath38 for the patterns shown in fig .
[ contour_ta_750 ] are displayed in the first row of fig .
[ qp_ta_750 ] ( @xmath136 and @xmath132 ) .
the amplitudes and frequencies of modulation of both the modes @xmath37 and @xmath38 are equal , but they are out of phase [ fig .
[ qp_ta_750](a ) ] .
the faster time variation of these two modes are compared in fig .
[ qp_ta_750 ] ( b ) .
the phase difference between the two modes varies slowly with time . the power spectra [ fig .  [ qp_ta_750 ] ( c ) ] of the fourier modes
@xmath37 [ blue ( black ) curve ] and @xmath38 [ pink ( gray ) curve ] look similar .
the peaks in the power spectra appear at exactly the same frequencies , although their heights are different . the power spectra [ see the inset of fig .
[ qp_ta_750 ] ( c ) ] show the two largest peaks at frequencies @xmath137 and @xmath138 ( @xmath139 ) , which differ slightly .
the difference between the two frequencies @xmath140 is the frequency of amplitude modulation .
there are many smaller peaks in the spectra at frequencies @xmath141 and @xmath142 , where @xmath143 is a positive integer .
other frequencies are the higher harmonics of these frequencies .
the projection of the phase space on the @xmath134 plane is shown in fig .
[ qp_ta_750 ] ( d ) after a long time .
the region of the phase space gets continuously filled as time passes .
the trajectories in the actual ( @xmath117 dimensional ) phase space never return to any point .
the behavior observed in fig .
[ qp_ta_750 ] ( b ) -(d ) clearly shows that the convective patterns vary quasiperiodically in time .
we label the patterns as quasiperiodically oscillating cross - rolls ( qpcr ) .
these patterns are consistent with the results of rihai ,  @xcite who ruled out any time - periodic three dimensional convection in square box .
similar patterns were also predicted by dawes  @xcite in a low - prandtl - number fluid ( @xmath144 ) for much higher values of the taylor number ( @xmath145 ) .
we observe these patterns at the onset of convection for @xmath146 at much smaller rotation rates .
similar patterns are also observed in numerical simulations  @xcite with no - slip boundary conditions .    ) in a square box ( @xmath147 ) with the variation of taylor number @xmath41 .
the plots in the first , second and third columns are for @xmath148 , @xmath149 and @xmath42 respectively .
the temporal variation of the fourier modes @xmath37 [ blue ( black ) curves ] is given in the first row for three different values of @xmath41 , while the same is given for the fourier mode @xmath38 [ pink ( gray ) curves ] in the second row .
the third row shows the power spectral density for the modes @xmath37 [ blue ( black ) curves ] and @xmath38 [ pink ( gray ) curves ] for three different values of @xmath41.,width=16,height=10 ]    as @xmath41 is raised , the temporal variation of these modes becomes more complex , but the convection remains quasiperiodic at the instability onset .
the amplitude and the frequency of modulation of the fourier modes @xmath37 and @xmath38 remain similar and out of phase for @xmath150 .
the period of amplitude modulation increases with @xmath41 for @xmath150 .
the first column of fig .
[ psd_sq_box ] shows properties of the two largest fourier modes just above the onset ( @xmath132 ) for @xmath148 .
the fourier modes become chaotic ( not shown here ) in a small window of @xmath41 ( @xmath39 ) .
these modes become temporally quasiperiodic once again for @xmath151 .
the first two rows of the second column of fig .
[ psd_sq_box ] display the temporal variations of the two largest modes for @xmath149 and @xmath132 .
the amplitudes of modulation of the modes @xmath37 and @xmath38 become different .
the largest and the second largest peaks in the power spectra of these two modes appear at slightly different frequencies .
however , the modulation frequency for both the modes remains the same .
the third column of fig .
[ psd_sq_box ] describes the convection near onset for @xmath42 .
the fourier mode @xmath38 vanishes and the power spectra of the fourier mode @xmath37 shows the peak at a single frequency .
this signifies a bifurcation from a three - dimensional ( 3d ) quasiperiodic convection to a two - dimensional ( 2d ) periodic convection .
the state of 2d standing waves at the primary instability continues to exist until @xmath43 .    ) for @xmath53 and @xmath8 : the variation of the maximum of ( a ) the nusselt number @xmath152 and ( b ) the box averaged kinetic energy @xmath153 with the taylor number @xmath41 .
both @xmath153 and @xmath154 show a bifurcation at @xmath155.,width=16,height=9 ]    the variation of the maximum of convective heat flux ( @xmath152 ) and box averaged kinetic energy @xmath153 with @xmath41 near the instability onset ( @xmath132 ) in a square box ( @xmath8 ) are shown for @xmath0 in fig .
[ figure4 ] .
the heat flux due to convection @xmath156 remains small , as expected at smaller values of the prandtl number @xmath29 [ see , fig .
[ figure4 ] ( a ) ] .
it increases initially with @xmath41 , and reaches a peak at @xmath157 .
it then decreases slightly with increasing @xmath41 , and again starts increasing monotonically with @xmath41 .
the variation of the maximum of kinetic energy @xmath153 with @xmath41 [ fig .
[ figure4 ] ( b ) ] shows exactly the same behavior .
the peaks at @xmath157 in the plots of both @xmath156 and @xmath153 with @xmath41 indicate a bifurcation .
the largest and the second largest peaks in the power spectrum of fourier mode @xmath37 ( see , the third row of fig .
[ psd_sq_box ] ) are located at frequencies @xmath158 and @xmath159 , respectively .
the two frequencies differ only slightly .
similarly , the power spectrum of the fourier mode @xmath38 shows the largest and the second largest peaks at frequencies @xmath160 and @xmath161 , respectively .
the details of the bifurcation may be understood by studying the effects of rotation on these frequencies .
the variations of @xmath158 [ blue ( black ) curve ] and @xmath160 [ pink ( gray ) curve ] with @xmath41 are shown in fig .
[ bifurcation_sq ] ( a ) near the primary instability ( @xmath132 ) in a square box ( @xmath8 ) .
both the frequencies for two modes remain exactly the same till @xmath162 , and become slightly different at @xmath163 [ see the inset of fig .
[ bifurcation_sq ] ( a ) ] .
the maxima of the nusselt number and the kinetic energy also showed peaks exactly at @xmath157 ( fig .
[ figure4 ] ) .
this behavior continues till @xmath11 .
only the frequency @xmath158 exists for @xmath14 , which then increases monotonically with @xmath41 .
figure  [ bifurcation_sq ] ( b ) shows the variation of frequencies @xmath159 and @xmath161 with @xmath41 .
they also remain initially equal , and then become unequal at @xmath163 . both the frequencies for two modes exist only for @xmath11 .
figure  [ bifurcation_sq ] ( c ) displays the variations of the maxima of modes @xmath37 [ blue ( black ) curve ] and @xmath38 [ pink ( gray ) curve ] with @xmath41 .
the maxima of modes @xmath37 and @xmath38 remain exactly the same until @xmath162 .
they show a peak at @xmath157 and become unequal for @xmath163 .
the maximum of @xmath37 first decreases slightly , and then starts increasing once again with @xmath41 , while the maximum of @xmath38 decreases monotonically with increasing @xmath41 .
the mode @xmath38 vanishes at @xmath42 .
the mode @xmath37 keeps increasing monotonically with @xmath41 , as @xmath41 is raised further .
figure  [ bifurcation_sq](d ) shows the variation of the modulation frequency @xmath164 @xmath74 @xmath158 @xmath165 @xmath159 of the mode @xmath37 and the modulation frequency @xmath166 @xmath74 @xmath160 @xmath165 @xmath161 of the mode @xmath38 , respectively , with @xmath41 .
the modulation frequencies of both mode remain exactly the same , and siege to exist for @xmath14 .
the patterns show a series of bifurcations . we observe a quasiperiodic competition between two sets of mutually perpendicular rolls ( qpcr ) of equal maximum intensity at the primary instability for @xmath36 .
a bifurcation occurs at @xmath167 , and the flow becomes chaotic .
the convection is chaotic in a narrow range of @xmath41 ( @xmath39 ) .
another type of convective flow appears for @xmath168 .
it now shows a quasiperiodic competition between two set of mutually perpendicular rolls of unequal maximum intensity ( @xmath169 @xmath170 @xmath171 ) .
a bifurcation from a three - dimensional quasiperiodic convection ( qpcr ) to 2d periodic convection occurs at @xmath42 .
the convection shows 2d standing waves instead of 3d quasiperiodic cross - rolls at the primary instability for @xmath14 .
it is interesting to note that the variation of the maximum of @xmath156 and @xmath153 shows only signature of a bifurcation at @xmath157 , when the flow becomes chaotic .
figure  [ e_ta_1100_1130 ] shows the temporal variations [ blue ( black ) curve ] of the spatially averaged values of @xmath172 , @xmath173 , @xmath174 and the kinetic energy @xmath175 for @xmath148 . for any time dependent flow in a forced dissipative system like rotating rbc
, the amount of energy injected in the system is not equal to the energy dissipated at every instant of time .
however , the time averaged values of these quantities over a suitable period remain constant .
note the time averaged value of the kinetic energy @xmath176 is a finite positive constant , and therefore the same for @xmath177 is equal to zero . as @xmath177 fluctuates in time
, the energy @xmath178 also varies from its average value .
the energy @xmath153 and the convective heat flux ( @xmath179 ) vary quasiperiodically in time in this case . the period of amplitude modulations of @xmath172 [ fig .
[ e_ta_1100_1130](a ) ] and @xmath173 [ fig .  [ e_ta_1100_1130](b ) ] is equal to twice the period of amplitude modulation for @xmath174 [ fig .
[ e_ta_1100_1130](c ) ] for @xmath180 .
although the period of amplitude modulations for @xmath172 and @xmath173 is the same , they are out of phase .
the period of amplitude modulation for @xmath153 and @xmath154 ( not shown here ) is similar to that of @xmath174 .
the second column of fig .
[ e_ta_1100_1130 ] displays similar plots for @xmath149 .
the period of amplitude modulation is the same for all the quantities @xmath172 , @xmath173 , @xmath174 , and @xmath153 in this case .
the amplitude modulations for @xmath172 and @xmath173 are again out of phase .    )
near onset ( @xmath181 ) in a square box ( @xmath147 ) as the taylor number @xmath41 is varied .
mid - plane temperature contour plots at different instants [ ( a)(f ) ] of 3d quasiperiodic patterns for @xmath182 display a competition between two sets of mutually perpendicular rolls .
different phases [ ( g)(i ) ] of a 2d standing wave for @xmath183 are shown in the last row.,width=12,height=11 ]    figure  [ e_nu_ta_3000 ] displays the temporal variation of ( a ) @xmath172 , ( b ) @xmath173 , ( c ) @xmath174 , ( d ) @xmath184 , ( e ) @xmath153 and ( f ) @xmath156 for @xmath183 .
all the fields become periodic .
notice that all the velocity components @xmath185 , @xmath186 and @xmath187 are nonzero .
a bifurcation from 3d quasiperiodic convection to 2d periodic convection is displayed in fig .
[ contour_3d_to_2d ] .
the upper and middle rows [ see fig .
[ contour_3d_to_2d](a)(f ) ] show the contour plots of the temperature field for six different instants of time for @xmath182 , while the lower row [ fig .
[ contour_3d_to_2d](g)(i ) ] displays the convective patterns at different instants of time for @xmath183 .
this shows a bifurcation from 3d convection to 2d convection , which occurs at @xmath188 .
a set of parallel rolls in the presence of coriolis force always has all the three velocity components nonzero .
this can be easily seen from the expressions for the vertical velocity @xmath187 and vertical vorticity @xmath189 ( @xmath190 ) for a set of straight rolls parallel to the @xmath191 axis .
considering only the critical modes , the fields @xmath187 and @xmath189 may be written as : @xmath192 the horizontal velocities @xmath185 and @xmath186 may be obtained using the following relations : @xmath193 the expressions for the horizontal velocities @xmath185 and @xmath186 are given by , @xmath194 this clearly shows that all the velocity components are nonzero , if the vertical vorticity is nonzero .
in fact , it is the velocity @xmath186 that breaks the mirror symmetry of the steady @xmath195 rolls parallel to the @xmath191 axis .
we now present the results of our simulations in a rectangular box ( @xmath197 ) .
we begin with the results of dns for @xmath130 .
the temporal variations of the two largest fourier modes @xmath37 and @xmath198 , the convective heat flux ( @xmath156 ) , and the kinetic energy @xmath153 near the instability onset are displayed for @xmath136 and @xmath53 in fig .
the convection is temporally quasiperiodic at the onset ( see the first column of fig .
[ l2 ] for @xmath199 ) .
the amplitude modulations of the fourier modes @xmath37 [ fig .
[ l2 ] ( a ) ] and @xmath198 [ fig
.  [ l2 ] ( b ) ] are out of phase
. however , the convective heat flux ( @xmath156 ) [ fig .  [ l2 ] ( c ) ] across the fluid layer and the kinetic energy @xmath153 [ fig .  [ l2 ] ( d ) ] are in phase .
the mid - plane contour plots of the temperature field at the instability onset for the simulation box with @xmath130 are displayed in fig .
[ contour_eta_2 ] . the convective patterns ( fig .  [ contour_eta_2 ] )
are quasiperiodically oscillating cross - rolls ( qpcr ) , as observed in a square box ( fig .
[ contour_ta_750 ] ) .
the period of amplitude modulation decreases with increase in @xmath200 [ see fig .
[ l2](e ) - ( h ) ] . as @xmath200
is raised to a value just @xmath201 above the threshold for oscillatory convection , the flow becomes chaotic in time ( see the third column of fig .
the chaotic behavior was also predicted by dawes  @xcite at the onset for much higher values of @xmath41 ( @xmath202 ) in a fluid with @xmath53 .
we observe the chaotic flow at a much smaller value of @xmath41 , and it occurs as a secondary instability .
we observe an interesting change in the fluid pattern dynamics at the instability onset for @xmath203 ( see fig .  [ contour_eta_4 ] ) .
two sets of rolls inclined at an angle of @xmath204 @xmath74 @xmath205 @xmath165 @xmath206 compete with each other .
the patterns vary in time chaotically .
we observe a gradual transition from one set of wavy rolls oriented along the @xmath207 axis to another set of rolls oriented at an angle of approximately @xmath208 with the @xmath207 axis .
we observe rhombic patterns during the transition .
figure  [ signal_details_eta_4 ] gives the details of the two largest fourier modes @xmath209 and @xmath210 for patterns shown in fig .
[ contour_eta_4 ] .
the temporal variation of both the modes [ see , fig .
[ signal_details_eta_4](a ) , ( b ) ] shows chaotic behavior .
the time average of both the modes is zero .
the phase between the maximum or minimum of these two modes varies with time .
the power spectra of @xmath209 [ blue ( black ) curve ] and @xmath210 [ purple ( gray ) curve ] are shown in fig .
[ signal_details_eta_4 ] ( c ) .
the details of the first largest peak [ see the inset of fig .
[ signal_details_eta_4](c ) ] show a narrow band of frequencies instead of a few discrete ones .
the largest peak in the power spectra for both the modes @xmath209 and @xmath210 appear at slightly different frequencies .
the temporal evolution of any trajectory in the @xmath211 plane shows a chaotic behavior .
the convective patterns shown in fig .
[ contour_eta_4 ] have similarity with kppers - lortz instability ,  @xcite where the change in orientation of rolls are determined by noise .
the change in orientation of rolls occur here due to the presence of the wavy modes ( e.g. , @xmath210 ) in a longer container .
the waves along the roll axis are easily excited in low - prandtl - number fluids .
the longer box size allows the distortion of fields easily even at slow rotation rates .
the nonlinear interactions of these perturbations with the critical modes lead to the excitation of more than two independent frequencies .
this causes temporally chaotic patterns at the onset of convection .
the oblique wavy rolls appear as soon as the mode @xmath209 vanishes , but the value of @xmath210 remains relatively large .
the wavy rolls are oriented along the @xmath207 axis when the mode @xmath210 is vanishingly small .
we observe rhombic patterns when both the modes are nonzero .
the angle between the two sets of wavy rolls is fixed , and is equal to @xmath15 , although the dynamics is chaotic .
the convective patterns observed at the primary instability are similar in other larger containers ( @xmath131 ) .
we now construct a low - dimensional model for the rayleigh - bnard convection with rotation in a square box ( @xmath8 ) .
we first recast the hydrodynamic equations in a convenient form for this purpose .
we operate by curl twice on eq .
[ eq : momentum ] and use the equation of continuity ( eq .
[ eq : continuity ] ) .
the equations for the vertical velocity @xmath187 and the vertical vorticity @xmath189 are then given by , @xmath212,\label{velocity}\\   \partial_{t}\omega_{3 } & = & \nabla^{2}\omega_{3 } + \sqrt{ta } \partial_{z}v_{3 }    + [ ( { \bf{\omega \cdot\nabla}})v_3 - ( { \bf{v\cdot\nabla}})\omega_3 ] . \label{vorticity}\end{aligned}\ ] ] the equation ( eq .  [ eq : theta ] ) of temperature field remains unchanged .
the spatial dependence of all the fields is expanded in terms of fourier series with appropriate horizontal and vertical boundary conditions .
the fourier modes found to carry higher energy in the direct numerical simulations ( dns ) are retained for the construction of the low - dimensional model .
the vertical velocity @xmath213 , the vertical vorticity @xmath214 and the temperature @xmath102 fields are expressed as : @xmath215\sin{\pi z } + w_{112}(t)\cos{kx } \cos{ky } \sin{2\pi z},\ ] ] @xmath216\cos{\pi z } + z_{110}(t)\cos{kx}\cos{ky}\nonumber\\ & + & z_{112}(t)\cos{kx}\cos{ky}\cos{2\pi z}+z_{200}(t)\cos{2kx}+z_{020}(t)\cos{2ky}\nonumber\\   & + & z_{130}(t)\sin{kx}\sin{3ky } + z_{310}(t)\sin{3kx}\sin{ky},\end{aligned}\ ] ] @xmath217\sin{\pi z } + \theta_{112}(t)\cos{kx}\cos{ky}\sin{2\pi z}\nonumber\\ & + & \theta_{002}(t)\sin{2\pi z}. \end{aligned}\ ] ]    projecting the hydrodynamical equations ( eqs .
[ velocity]-[vorticity ] ) and the equation for the temperature field ( eq .  [ eq : theta ] ) onto these modes , we arrive at a set of fifteen ordinary nonlinear differential equations .
fourier modes @xmath218 , which decay linearly much faster than the other modes , are then adiabatically eliminated .
this leads to a nine - mode model given by : @xmath219 , \label{model_eq1a}\end{aligned}\ ] ] @xmath220 , \label{model_eq1b}\end{aligned}\ ] ] @xmath221 @xmath222 @xmath223 @xmath224 @xmath225 @xmath226 @xmath227 where @xmath228 , @xmath229 , @xmath230 , @xmath231 , @xmath232 , @xmath233 , @xmath234 , @xmath235 , @xmath236 @xmath74 @xmath237 , @xmath46 @xmath74 @xmath238 , @xmath239 @xmath74 @xmath240 , @xmath241 @xmath74 @xmath242 , @xmath243 @xmath74 @xmath244 , and @xmath245 @xmath74 @xmath246 .
figure  [ modes_model ] shows the temporal variation of the leading modes at four different rotation rates @xmath247 , @xmath248 , @xmath249 , and @xmath250 obtained from the low - dimensional model ( eqs .
[ model_eq1a]-[model_eq5 ] ) .
the results computed from the model are in good agreement with those obtained from dns at the primary instability , and in qualitative agreement with those at secondary and tertiary instabilities . at @xmath136 , both the modes @xmath37 and
@xmath38 are found to oscillate quasiperiodically just above the onset of oscillatory convection .
this behavior continues to exist until @xmath251 .
the primary instability is temporally chaotic in a small range of the taylor numbers @xmath252 . at @xmath253 ,
a bifurcation occurs and both the leading modes @xmath37 and @xmath38 show quasiperiodic temporal variation with different modulation amplitudes and frequencies .
the bifurcation from 3d quasiperiodic behavior into 2d periodic behavior occurs at @xmath183 .
one of the roll - modes becomes zero and the other oscillates with zero mean .
the threshold values for these bifurcations obtained from the model are slightly higher than those computed from dns .
the results in a square box ( @xmath8 ) near the instability onset , computed from dns as well as from the low - dimensional - model , are compared in fig .
[ model_dns ] for @xmath0 and @xmath136 .
the amplitudes of the temporal modulation of the fourier modes @xmath37 [ blue ( black ) curve ] and @xmath38 [ pink ( gray ) curve ] just above the onset of convection ( @xmath132 ) are shown in the first column of fig .
[ model_dns ] .
the modulation amplitudes ( frequencies ) of both the modes computed from the model [ fig .
[ model_dns ] ( b ) ] are within @xmath254 ( @xmath255 ) of those obtained from dns [ fig .
[ model_dns ] ( a ) ] .
dns gives larger period of amplitude modulation than that found in the model .
as @xmath107 is raised for a fixed value of @xmath41 in dns , the quasiperiodic competition between two sets of rolls bifurcates into stationary square patterns at the secondary instability ( @xmath256 ) .
the model also captures the stationary square patterns near the secondary instability .
however , the secondary bifurcation occurs at the higher value of @xmath200 in the model .
the values of the two largest modes @xmath37 and @xmath38 obtained from the model are compared with those obtained in dns for @xmath257 .
they are about @xmath258 smaller than those obtained from dns [ fig .
[ model_dns ] ( c ) ] .
the stationary square patterns ( @xmath259 ) bifurcate into oscillating square patterns at @xmath260 , as @xmath200 is raised further .
we observe qualitatively similar behavior in the model .
the secondary and tertiary instabilities occur in the model at much higher values of @xmath200 .
the low - dimensional model qualitatively captures the essential features of the pattern dynamics near the onset of oscillatory convection in a slowly rotating rayleigh - bnard system with @xmath8 . the model becomes worse at higher rotation rates .
the model and simulations suggest that the amplitude equations need to consider the distortions of fields even at the instability onset in low - prandtl - number fluids in larger boxes and at higher rotation rates .
we have investigated the effects of the coriolis force on the convective patterns near onset of oscillatory convection in a rayleigh - bnard system ( @xmath53 ) with stress - free top and bottom surfaces , and rotating uniformly about a vertical axis .
we have considered several values of the horizontal aspect ratio @xmath34 . for shorter boxes ( @xmath261 and @xmath262 )
, the primary instability appears in the form of two - dimensional periodic standing waves for a wide range of the taylor number @xmath41 .
the locations of up - flow and down - flow keep alternating periodically .
the convective patterns at the primary instability in small containers of horizontal aspect ratios @xmath8 and @xmath263 are interesting .
the patterns at the primary instability in a square box ( @xmath8 ) depend on the value of @xmath41 .
the patterns may be due to a competition between two sets of rolls having identical modulation amplitudes for smaller values of @xmath41 , or due to a competition between two sets of rolls with unequal modulation amplitudes for relatively higher values of @xmath41 , or two - dimensional periodic standing waves for further higher values of @xmath41 .
the convective flow also shows stationary as well as oscillatory square patterns for @xmath147 , if the rayleigh number @xmath107 is raised keeping @xmath41 fixed .
the patterns at the primary instability , in a rectangular box ( @xmath9 ) , are due to quasiperiodic competition between two sets of rolls in mutually perpendicular directions for a wide range of @xmath41 .
the primary instability is always found to be chaotic in rectangular boxes with @xmath131 .
the patterns are due to a competition between two sets of rolls oriented at some angle in the horizontal plane .
these patterns have similarity with the pattern dynamics observed due to kl instability . however , the patterns near the onset of oscillatory convection appear due to a dynamical chaos rather than the noise as in the kl instability .
the chaotic competition between a set of straight rolls and another set of oblique wavy rolls is initiated due to the excitation of the wavy modes in low - prandtl - number fluids .
rhombic patterns are observed during the change in orientation of the rolls .
the angle @xmath204 between the two sets of chaotically competing rolls is given by @xmath264 .
* acknowledgements : * we benefited from fruitful discussions with pinaki pal , priyanka maity , arnab basak , and deepesh kumar .
the presentation of this work has been greatly improved by useful comments from two anonymous referees .
99 ,  the instability of a fluid layer of fluid heated from below and subjected to coriolis forces , " proc .
a * 217 * , 306 ( 1953 ) ; y. nakagawa and p. frenzen ,  a theoretical and experimental study of cellular convection in rotating fluids , " tellus * 7 * , 1 ( 1955 ) . ,
 cellular convection with finite amplitude in a rotating fluids , " j. fluid mech . * 5 * , 401 ( 1959 ) ;  motion at subcritical values of rotation rayleigh number in a rotating fluid , " j. fluid mech .
* 24 * , 545 ( 1966 ) ;  large - amplitude bnard convection in a rotating fluid , " j. fluid mech . * 31 * , 113 ( 1968 ) .
, _ hydrodynamic and hydromagnetic stability _
, oxford university press , oxford ( 1961 ) , republished by dover publications ( 1981 ) .
,  a study of bnard convection with and without rotation , " j. fluid mech .
* 36 * , 309 ( 1969 ) .
,  on the influence of rotation on the convective structure in a deep homogeneous fluid , " dokl .
nauk sssr * 273 * , 718 ( 1983 ) . ,
rotating convection : recent developments , " intl j. engng sci . *
36 * , 1421 ( 1998 ) .
,  convection in a low prandtl number fluid layer rotating about a vertical axis , " eur . j. mech .
b - fluids * 19 * , 213 ( 2000 ) . ,  scaling laws for rotating rayleigh - bnard convection , " phys .
e * 72 * , 056315 ( 2005 ) . , 114101 ( 2012 ) . ,
transition from laminar convection to thermal turbulence in a rotating fluid layer , " j. fluid .
* 35 * , 609 ( 1969 ) .
,  the stability of steady finite amplitude convection in a rotating fluid layer , " phys .
a * 32 * , 7 ( 1970 ) .
,  convection in a rotating layer : a simple case of turbulence , " science * 208 * , 173 ( 1980 ) . ,
 direct transition to turbulence in rotating bnard convection , " phys .
. lett . * 57 * , 2524 ( 1986 ) . ,  rotating rayleigh - bnard convection : kppers - lortz transition , " physica d * 51 * , 596 ( 1991 ) . ,
 weakly nonlinear oscillatory convection in a rotating fluid , " proc .
a * 436 * , 33 ( 1992 ) . ,
 oscillatory convection in a rotating layer , " physica d * 63 * , 213 ( 1993 ) . ,
stable quasiperiodic solutions in the hopf bifurcation with @xmath265 symmetry , " phys .
a * 262 * , 158 ( 1999 ) . ,
 pattern selection in oscillatory rotating convection , " physica d * 147 * , 336 ( 2000 ) . ,  travelling wave convection in a rotating layer , " geophys .
fluid dyn . * 51 * , 195 ( 1990 ) ; j.m .
rodrguez , c. prez - graca , m. bestehorn , m fantz , and r. friedrich ,  pattern formation in convection of rotating fluids with broken vertical symmetry , " phys . rev . a * 46 * , 4729 ( 1992 ) ; t. clune and e. knobloch ,  pattern selection in rotating convection with experimental boundary conditions , " phys .
e * 47 * , 2536 ( 1993 ) ; k. kumar , s. chaudhuri , and a. das ,
quasiperiodic waves at the onset of zero - prandtl - number convection with rotation , " phys .
e * 65 * , 026311 ( 2002 ) . ,  time and length scales in rotating rayleigh - bnard convection , " phys .
* 74 * , 5040 ( 1995 ) ; y. hu , r.e .
ecke , and g. ahlers ,
convection under rotation for prandtl numbers near 1 : linear stability , wave - number selection , and pattern dynamics , " phys . rev .
e * 55 * , 6928 ( 1997 ) .
square patterns in rayleigh - bnard convection with rotation about a vertical axis , " phys .
81 * , 806 ( 1998 ) . ,
hexagonal pattern instabilities in rotating rayleigh - bnard convection of a non - boussinesq fluid : experimental results , " phys .
e * 69 * , 066311 ( 2004 ) . ,
square patterns in rotating rayleigh - bnard convection , " phys .
e * 72 * , 036307 ( 2005 ) . ,
bifurcation to oscillations in three - dimensional rayleigh - bnard convection , " phys .
e * 56 * , 5511 ( 1997 ) ; j.d .
scheel , p.l .
mutyaba and t. kimmel ,  patterns in rotating rayleigh - bnard convection at high rotation rates , " j. fluid mech . * 659 * , 24 ( 2010 ) .
,  instability of rotating convection , " j. fluid mech . *
403 * , 153 ( 2000 ) . ,
 finite size scaling of domain chaos , " phys .
e * 63 * , 045201(r ) ( 2001 ) .
,  onset of kppers - lortz like dynamics in finite rotating thermal convection , " j. fluid mech . * 644 * , 337 ( 2010 ) . ,  heat transport scaling in turbulent rayleigh - bnard convection : effects of rotation and prandtl number , " phys .
lett . * 79 * , 2257 ( 1997 ) ; k. julien and e. knobloch ,  fully nonlinear three - dimensional convection in a rapidly rotating layer , " phys .
fluids * 11 * , 1469 ( 1999 ) ; r.j.a.m .
stevens , j - q zhong , h.j.h .
clercx , g. ahlers , and d. lohse ,  transitions between turbulent states in rotating rayleigh - bnard convection , " phys
lett . * 103 * , 024503 ( 2009 ) ; g. ahlers , s. grossmann , and d. lohse ,  heat transfer and large scale dynamics in turbulent rayleigh - bnard convection , " rev .
mod . phys . * 81 * , 503 ( 2009 ) . ,
boundary layer control of rotating convection systems , " nature * 457 * , 301 ( 2009 ) .
,  turbulence in rotating rayleigh - bnard convection in low - prandtl - number fluids , " phys .
e * 84 * , 047301 ( 2011 ) .
,  stability and heat transfer of rotating cryogens .
influence of rotation on the onset of convection in liquid @xmath266 , " j. fluid mech . *
129 * , 251 ( 1983 ) ; j.m .
pfotenhauer , p.g.j . lucas and r.j .
donnelly ,
stability and heat transfer of rotating cryogens .
effects of rotation on heat - transfer properties of convection in liquid he , " j. fluid mech .
* 145 * , 239 ( 1984 ) ; j.m .
pfotenhauer , j.j .
niemela and r.j .
donnelly ,
stability and heat transfer of rotating cryogens .
effects of finite cylindrical geometry and rotation on the onset of convection , " j. fluid mech . *
175 * , 85 ( 1987 ) ; m.r .
ardron , p.g.j .
lucas , t. onions , m.d.j .
terrett , and m.s .
thurlow ,  rotating cyrogenic platform , " physica b * 165 * & * 166 * , 55 ( 1990 ) . ,
 effect of the centrifugal force on domain chaos in rayleigh - bnard convection , " phys .
e * 73 * , 066309 ( 2006 ) .
,  low - prandtl - number convection in a layer heated from below , " j. fluid mech . *
102 * , 61 ( 1981 ) . ,  viscous and inertial convection at low prandtl number : experimental study , " europhys
. lett . * 4 * , 555 ( 1987 ) . ,  zero - prandtl - number convection , " j. fluid mech .
* 240 * , 229 ( 1992 ) . ,  experimental and numerical studies of convection in a rapidly rotating spherical shell , " j. fluid mech .
* 580 * , 83 ( 2007 ) .
, `` bifurcation and chaos in zero - prandtl - number convection , '' europhys .
87 * , 54003 ( 2009 ) .
, `` patterns and bifurcations in low - prandtl - number rayleigh - bnard convection , '' europhys . lett . * 89 * , 44003 ( 2010 ) ; p. pal , p. maity , k. kumar , and s.k .
dana , `` pattern dynamics near inverse homoclinic bifurcation in fluids , '' phys .
e * 87 * , 023001 ( 2013 ) .
,  evidence against ` ultrahard ' thermal turbulence at very high rayleigh numbers , " nature * 401 * , 885 ( 1999 ) . ,  on the interaction between convection and magnetic fields ,
" astrophys .
j. * 588 * , 1183 ( 2003 ) .
,  stability of a horizontal fluid layer with zero shear boundaries , " phys
* 12 * , 1133 ( 1969 ) . ,  benchmarking and scaling studies of pseudospectral code tarang for turbulence simulations , " pramana * 81 * , 617 - 629 ( 2013 )


with decoding of the human genome and other eukaryotic organisms molecular biology has entered into a new era .
high - throughput technologies , such as genomic microarrays can be used to measure the expression levels of essentially all the genes within an entire genome scale simultaneously in a single experiment and can provide information on gene functions and transcriptional networks @xcite .
the major challenge in microarray data analysis is due to their size , where the number of genes or variables ( @xmath0 ) far exceeds the number of samples or observations ( @xmath1 ) , commonly known as the `` large @xmath0 , small @xmath1 '' problem .
this takes it difficult or even impossible to apply class prediction methods ( e.g. , logistic regression , discriminant analysis ) to the microarray data .
class prediction is a crucial aspect of microarray studies and plays important role in the biological interpretation and clinical application of microarray data @xcite . for the last few years
, microarray - based class prediction has been a major topic in applied statistics @xcite . in a class prediction study ,
the task is to induce a class predictor ( classifier ) using available learning samples ( i.e. , gene expression profiles ) from different diagnostic classes . given the learning samples representing different classes , first the classifier is learned and then the classifier is used to predict the class membership ( i.e. , diagnostic class ) of unseen samples @xcite .    generally , the performance of a classifier depends on three factors : the sample size , number of variables , and classifier complexity @xcite .
it was shown that for the fixed sample size , the prediction error of a designed classifier decreases and then increases as the number of variables grows .
this paradox is referred to as the peaking phenomenon @xcite . moreover , some well known classifiers are even inapplicable in the setting of high - dimensional data . for example , the pooled within - class sample covariance in linear discriminant analysis ( lda ) is singular if number of variables exceeds the number of samples .
similarly , in logistic regression the hessian matrix will not have full rank and statistical packages will fail to produce reliable regression estimates @xcite .
therefore , the number of samples must be larger than the number of variables for good prediction performance and appropriate use of classifiers .
this naturally calls for the reduction of the ratio of sample size to dimensionality .
there are two major ways to handle high - dimensional microarray data in the class prediction framework .
the first approach is to eliminate redundant or irrelevant genes ( a.k.a .
feature selection ) .
the idea is to find genes with maximal discrimination performance and induce a classifier using those genes only @xcite .
the most commonly used procedures of feature selection are based on simple statistical tests ( e.g. , fold change , @xmath2-test , anova , etc . ) , which are calculated for all genes individually , and genes with the best scores are selected for classifier construction @xcite .
the advantages of this approach are its simplicity , low computational cost , and interpretability .
an alternative approach to overcome the problem of high - dimensionality is application of dimension reduction techniques ( a.k.a .
feature extraction ) .
generally , the aim of dimension reduction procedures is to summarize the original @xmath0-dimensional gene space in a form of a lower @xmath3-dimensional gene components space ( @xmath4 ) that account for most of the variation in the original data @xcite
. most commonly used methods for feature extraction with microarray gene expression data are principal component analysis ( pca ) @xcite , partial least squares ( pls ) @xcite , and sliced inverse regression ( sir ) @xcite .
although statistical analysis dealing with microarray data has been one of the most investigated areas in the last decade , there are only a few papers addressing the development and experimental validation of new methods and techniques for microarray dimension reduction .
as @xcite claimed , the high - dimensional data analysis will be one of the most important research topics in statistics in the nearest future . here
, we fill this gap by proposing a latent variable approach for handling high - dimensional microarray data and show its promising potential for class prediction .
the conceptual framework on latent variable modeling originates from psychometrics , starting at the beginning of the 20th century @xcite .
utility of these models in biomedical research has only quite recently been recognized @xcite . by latent variable model we mean any statistical model that relates a set of observed variables to set of latent variables @xcite .
a latent variable is a variable that is not directly observable but does have a measurable impact on observable variables .
latent variables describe features that underlie the data . for example , a child s intelligence ( i.e. , latent variable ) is typically assessed by measuring their answers to solving problems or items ( i.e. , observed variables ) on intelligence test .
the more items we ask of the child and the wider the breadth of items is included in the assessment , the more our understanding of that child s intellectual ability will be accurate .
the rasch model ( rm ) , originally proposed by @xcite , is the simplest latent variable model .
the idea behind the rm is that the probability of getting an item correct is a function of a latent trait or ability .
for example , a child with higher intellectual ability would be more likely to correctly respond to a given item on an intelligence test . in psychological applications ,
data are usually given in a matrix , with rows being participants and columns being responses to a set of items .
microarray gene expression data can be represented in a similar way : columns are used to represent genes and rows are used to represent expression levels in biological samples .
the rm can therefore be used to explain the observed gene expression patterns over different samples .
we assume that gene expression levels vary under the influence of @xmath3 latent gene factors .
the idea behind our approach is to partition @xmath0 genes into @xmath3 functional subgroups and that covariations between genes with similar expression ( i.e. , genes in the same partition ) could be described with a single gene factor .
the factors in the model are latent , unobserved variables that account for the covariation among genes .
it is assumed that genes with similar expression patterns might share biological function or might be under common regulatory control @xcite .
moreover , it is particularly interesting to model a large set of genes as functions of fewer gene factors , because biologist believe the changes of mrna levels are due to some regulatory factors @xcite .
specifically , regulatory factors are proteins that bind certain dna elements to regulate gene transcription to mrna .
therefore , the gene factors obtained from latent modeling of gene expression could be interpreted as latent measurements of common regulatory factors of related genes . the number of gene factors is considered to be a meta - parameter and must be estimated or directly supplied based on researcher s prior knowledge .
rm can then be used to estimate the magnitude of gene factors .
class prediction using standard prediction methods can then be carried out in the reduced space by using constructed gene factors as predictor variables .
the main objective of this paper is to evaluate the potential of rm - based dimensionality reduction with microarray gene expression data and investigate its prediction accuracy in the context of class prediction using lda . to validate the proposed approach we apply a parallel pca - based dimension reduction .
we propose a framework for dimension reduction and class prediction with application to gene expression data as illustrated in figure  [ fig : figure1 ] .
our procedure consists of two basic steps : the first step is dimension reduction , in which data are reduced from high @xmath0-dimensional gene space to a lower @xmath3-dimensional gene factor space ; the second step is class prediction , in which response classes are predicted using a class prediction method on the extracted gene factors .
we apply our algorithms to two publicly available microarray data sets which have been considered before by several authors .
the leukemia data set @xcite contains @xmath5 tissue samples with @xmath6 genes : @xmath7 samples of acute lymphoblastic leukemia ( all ) and @xmath8 samples of acute myeloid leukemia ( aml ) .
the prostate data set @xcite contains @xmath9 tissue samples with @xmath10 genes : @xmath11 prostate tumor samples and @xmath12 non - tumor prostate samples .
both data sets are from affymetrix high - density oligonucleotide microarrays and are publicly available @xcite .    for both data sets ,
the pre - processing steps are applied as follows @xcite : ( a ) thresholding , floor of @xmath13 and ceiling of @xmath14 ; ( b ) filtering , exclusion of genes with @xmath15 and @xmath16 , where @xmath17 and @xmath18 refer to the maximum and minimum intensities for a particular gene across all samples ; and ( c ) @xmath19 transformation and standardization to zero mean and unit variance .
the data were then summarized by a matrix @xmath20 , where @xmath21 denotes the expression level for gene @xmath22 in sample @xmath23 . the data for each sample consist of a gene expression profile @xmath24 and a class label @xmath25 .
after data preprocessing the dimension of the matrix @xmath26 was @xmath27 and @xmath28 for leukemia and prostate data set , respectively .
although the procedure described here can handle a large number ( thousands ) of genes , the number of genes may still be too large for practical use .
the model assessment procedure is very cpu - expensive and therefore time - consuming process , because it requires fitting the data many times due to cross - validation and re - randomization .
furthermore , a considerable percentage of the genes do not show differential expression across groups and only a subset of genes is of interest .
we used two different methods for feature selection in this study .
first we performed an unsupervised random subset selection , consisting of @xmath29 ( @xmath30 ) genes from the set of all genes , as described by @xcite .
we selected @xmath29 genes with @xmath31 from both experimental data sets .
as the supervised alternative , we applied welch s
@xmath2-test @xcite to embed the class information in feature selection process and thus improved prediction accuracy .
@xmath2-test provides the measure of the statistical significance of changes in gene expression between classes .
@xmath2-test defines the statistic @xmath2 by @xmath32 where @xmath33 , @xmath34 , and @xmath35 are the mean , sample variance , and sample size of the class @xmath36 ( @xmath37 ) for each gene , respectively .
feature selection was carried out based on absolute value of the @xmath2-statistic and the top @xmath29 genes with @xmath31 were used for further processing .      here
we describe the core of feature extraction based on the rms and then briefly outline the pca method , which we used as a benchmark .      in this subsection
we first give a short overview of the rm theory in its original form , and then present its application to gene expression data .
the rm is a simple latent factor model , primarily used for analyzing data from assessments to measure psychological constructs such as personality traits , abilities , and attitudes @xcite .
assume that we have @xmath38 persons and @xmath39 items .
let @xmath40 be the response of person @xmath23 to the item @xmath22 , where the @xmath40 is ` 1 ' if person @xmath23 answered item @xmath22 correctly and ` 0 ' otherwise .
in the rm , the probability of the outcome @xmath41 is given by @xmath42 for @xmath43 and @xmath44 .
@xmath45 is the person parameter that denotes the latent factor of the @xmath23th person that is measured by the item @xmath22 and @xmath46 is the item parameter , which denotes the difficulty of the item @xmath22 .
difficulty of the item describes the region of the latent trait distribution where the probability of producing a specific response changes from low to high .
probability of the response is monotonous in both person and item parameters . figure  [ fig : figure2 ] plots the rasch probabilities as a function of the value of the latent factor ( @xmath47 ) for three different items .
it can be seen that for a given item , persons with larger @xmath47 value tend to have greater probability of expressing high scores on the latent factor , and for a given person , the response probabilities are different for items with different @xmath48 values .    , @xmath49 , and @xmath50 , respectively .
]    the final step of the rm - based modeling is to derive latent scores from the item responses .
latent score is the total score of person @xmath23 over @xmath39 items .
the most common approach to calculate latent scores is to use the expectation of the posterior distribution of @xmath45 given @xmath51 with parameter estimates plugged in @xcite .
details on the calculation can be found in @xcite .
[ [ application - of - rasch - model - to - gene - expression - data ] ] application of rasch model to gene expression data + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +    in terminology of rm , we denote each gene as an `` item '' and each sample as a `` person '' . the expression level @xmath21 of gene @xmath22 in sample @xmath23 is the response of a given sample to a given gene .
our main assumption is , that one - dimensional latent model may not hold for the complete set of @xmath29 genes selected in the gene filtering step ( see subsection  [ subsec : feature_selection ] ) .
based on the assumption that expressional similarity implies functional similarity of the genes ( and vice versa ) , we assume that genes with similar expression patterns determine one latent factor @xcite .    to identify coexpressed genes we used @xmath52-means clustering @xcite to partition @xmath29 genes into @xmath3 partitions ( @xmath53 ) based on their gene expression profiles over @xmath1 samples .
@xmath3-means clustering is a simple and widely used partitioning algorithm .
its helpfulness in discovering groups of coexpressed genes has been demonstrated @xcite .
the optimal number of @xmath3 is estimated following the procedure described in subsection  [ subsec : model_selection ] .
to apply the rm to the gene expression data , we need to discretize the gene expression data matrix @xmath26 into binary form .
we use the median as a cut - off point for discretization .
the intensity of every gene expression value is compared with the median gene expression data of the @xmath26 and assigned a ` @xmath54 ' if it is above and ` @xmath55 ' otherwise .
note that gene partitioning is done before discretization step .
we fit a rm for genes in each of the @xmath3 partitions respectively and calculate gene factor scores .
specifically , we construct @xmath3 latent gene factors on which each gene in the @xmath52 partition is located .
the measure for each sample for each gene factor is then estimated . to fit the rm for genes in the @xmath52th partition ,
let @xmath23 be the sample index , and @xmath22 be the gene index , for @xmath56 , and @xmath57 , and let @xmath58 be the latent gene factor for the @xmath23th sample which is determined by the genes in the @xmath52th partition , and @xmath46 be the gene specific parameter for the @xmath22th gene .
class prediction is then carried out in the reduced space by using the gene factors .
pca is the most commonly used technique for dimension reduction in microarray data analysis @xcite . the main idea behind
the pca is to reduce the dimensionality of a data set , while retaining as much as possible the variation in the original variables @xcite .
this is achieved by transforming the @xmath29 original variables @xmath59 $ ] to a new set of @xmath3 predictor variables @xmath60 $ ] , which are linear combinations of the original variables .
more formally , pca sequentially maximizes the variance of a linear combination of the original variables , @xmath61 subject to the constraint @xmath62 , for all @xmath63 , where @xmath64 is covariance matrix of the original data .
the orthogonal constraint ensures that the linear combinations are uncorrelated .
linear combinations @xmath65 are known as the principal components .
these linear combinations represent the selection of a new coordinate system obtained by rotating the original system .
the new axes represent the directions with maximum variability and are ordered in terms of the amount of variation of the original data they account for . the first principal component accounts for as much of the variability in the original data as possible , and each succeeding component accounts for as much of the remaining variability as possible .
computations of the weighting vectors @xmath66 involves the calculation of the eigenvalue decomposition of a data covariance matrix @xmath67 , @xmath68 where @xmath69 is the @xmath23th eigenvalue in the descending order for @xmath70 and @xmath71 is the corresponding eigenvector .
the eigenvalue @xmath69 measures the variance of the @xmath23th principal component and the eigenvector @xmath71 provides the loadings for the linear transformation .
the number of components @xmath3 is specified on the basis of researcher s prior knowledge or determined using dedicated procedures ( e.g. , kaiser - guttman rule , cattell s scree test , etc . ) .
class prediction using standard methods can then be carried out in the reduced space by using the constructed principal components .
after dimension reduction , the high dimension of @xmath29 is now reduced to a lower dimension .
the original data matrix is approximated by matrix of gene factors ( @xmath72 , where @xmath73 ) , constructed by rms or pca , as described in the previous section . to avoid confusion ,
we use the term `` factor '' to refer to both latent factor obtained from rm analysis and principal component derived from pca .
once the @xmath3 gene factors are constructed we consider prediction of the response classes .    to describe the class prediction problem formally ,
let we have a learning set @xmath74 consisting of samples whose class is known and a test set @xmath75 consisting of samples whose class has to be predicted
. denote the data matrix corresponding to @xmath74 as the learning data matrix @xmath76 , and the data matrix corresponding to @xmath75 as the test data matrix @xmath77 .
the vector containing the classes of the samples from @xmath74 is denoted as @xmath78 .
the goal is to build a rule implementing the information from @xmath76 and @xmath78 in order to predict the class @xmath36 of the @xmath23th sample from the test set given the gene expression profile @xmath79 : @xmath80    because our focus here is on dimension reduction , we fixed the class prediction step with lda , although other methodologies can be used @xcite .
a short description of the lda method is given in the following @xcite .
suppose we have @xmath3 predictor variables .
the random vector @xmath81 is assumed to a multivariate normal distribution within class @xmath82 ( in our procedure @xmath83 ) with mean @xmath84 and covariance matrix @xmath85 . in lda
, @xmath85 is assumed to be the same for all classes : for all @xmath36 , @xmath86 . using estimates @xmath87 and @xmath88 in place of @xmath84 and @xmath89 , the discriminant rule assign the @xmath23th new observation @xmath79 to the class @xmath90    lda has been well studied and widely used for class prediction problems .
lda relies on a hypothesis of multinormality , and assumes that the classes have the same covariance matrix .
although these hypotheses are rarely satisfied with real data sets , lda generally gives good results .
studies have demonstrated favorable prediction performances of lda models when compared with more complicated and computationally intensive algorithms such as neural networks and tree method @xcite .
for the details of the calculation we refer the reader to @xcite .
the number of gene factors @xmath3 is a meta - parameter in the procedure .
we estimate @xmath3 on the learning set @xmath74 using leave - one - out cross - validation ( loocv ) .
loocv has been shown to give an almost unbiased estimator of the prediction error @xcite , and therefore provide a sensible criterion for our purposes . in a nutshell ,
a subset of @xmath29 genes is selected ( @xmath30 ) from @xmath74 , and one of the samples is left - out .
the feature extraction models are fitted to all but the left - out sample ( see subsection  [ subsec : feature_extraction ] ) .
the fitted models are then used to predict the class of the left - out sample ( see subsection  [ subsec : class_prediction ] ) .
this is repeated for all samples in the learning data set @xmath91 with @xmath3 taking successively different values .
the mean error rate ( _ mer _ ) over the @xmath91 runs is computed for each value of @xmath3 by @xmath92 where @xmath93 is the predicted response class and @xmath25 is the observed response class .
@xmath38 is the indicator function ( @xmath94 if @xmath95 is true , @xmath96 otherwise ) . the value of @xmath3 minimizing the _ mer _ is selected and denoted as @xmath97 .
we select @xmath98 in our experiments .      to assess the performance of the rm- and pca - based dimension reduction methods in the framework of class prediction we perform a re - randomization study .
this evaluation approach was first used by @xcite .
the reader may refer to the review of @xcite on this subject .
the procedure consists of the six steps as follows .    1 .   for each data set , create @xmath99 random partitions into learning data set @xmath74 with @xmath91 samples and a test set @xmath75 with @xmath100 samples ( @xmath101 ) .
denote @xmath76 as the learning data matrix of size @xmath102 , and @xmath77 as the test data matrix of size @xmath103 .
2 .   select a subset of @xmath29 genes from the set of all genes @xmath0 from matrix @xmath76 using one of the gene selection methods , resulting in @xmath104 matrix of size @xmath105 and @xmath106 matrix of size @xmath107 ( see subsection  [ subsec : feature_selection ] ) .
3 .   use the learning data matrix @xmath104 to determine the number of latent factors @xmath97 , by loocv ( see subsection  [ subsec : model_selection ] ) .
perform dimension reduction using rm- or pca - based dimension reduction ( see subsection  [ subsec : feature_extraction ] ) .
let @xmath108 denote the matrix containing the factor loadings of size @xmath109 .
compute the matrix @xmath110 of gene factors for the learning data set ( @xmath111 ) , and the matrix @xmath112 of gene factors for the test data set ( @xmath113 )
. refers to component loadings , and matrix @xmath114 to gene components when pca is performed . ]
fit the class prediction model to the learning gene factors @xmath110 .
predict the classes of samples in the test set using the fitted classifier and the test gene factors , @xmath112 ( see subsection  [ subsec : class_prediction ] ) .
repeat all above steps @xmath115 times with re - randomization of the whole data set .
the mean error rate ( @xmath116 ) for each method is given by @xmath117 where @xmath93 is the predicted response class and @xmath25 is the observed response class .
@xmath38 is the indicator function ( @xmath94 if @xmath95 is true , @xmath96 otherwise ) .
although the @xmath116 is the most widely used metric for measuring the performance of the prediction systems , it considers all mispredictions as equally damaging @xcite .
it has been demonstrated @xcite that , when the prior class probabilities are different , this measure is not appropriate because it does not consider misprediction cost , is strongly biased to favor the majority class , and is sensitive to class skewness . to overcome these problems the performance evaluation
was also carried out via receiver operator characteristic ( roc ) analysis .
for comprehensive introduction to roc analysis we refer the reader to @xcite .
the roc analysis was performed by plotting true positive rate ( sensitivity ) versus the false positive rate ( 1@xmath118specificity ) at various threshold values , and the resulting curve was integrated to give an area under the curve ( _ auc _ ) value .
_ auc _ is a measure of the discriminative power of the classes using the given features and classifier , and varies from @xmath119 for non - distinguishable classes to @xmath120 for perfectly distinguishable classes @xcite .
the _ auc _ can be interpreted as the probability that two random samples from the two classes will be predicted correctly , and is invariant to changes in class proportions ( unlike _ mer _ ) .
an @xmath121 is generally considered acceptable , @xmath122 as good , and @xmath123 as excellent prediction performance .
all computations were carried out in the @xmath124 software environment for statistical computing and graphics @xcite .
@xmath3-means clustering was performed using generic ` kmeans ` function .
binarization of continuous gene expression values was performed by ` binarize ` function in the ` minet ` package .
the function ` generate.split ` of the ` wilcoxcv ` package was used to generate random splitting into learning and test data sets .
rm analysis was performed using ` ltm ` package .
pca was conducted using generic ` prcomp ` function .
lda was carried out using ` lda ` function in the ` mass ` package .
roc analysis was performed using the ` caret ` package .
the procedures described here can be reproduced using the @xmath124 scripts available from http://www2.arnes.si/~akastr1/rasch/
we illustrate the interest of rm - based dimension reduction by considering applications for the class prediction of microarray data .
we compare the results from our procedure with the performance of the pca - based approach .
we will consider in turn the leukemia and prostate data sets , as described previously in subsection  [ subsec : data_sets ]      after data preprocessing , we applied the proposed performance evaluation procedure on the leukemia data set .
first , we consider @xmath31 randomly selected genes and used @xmath99 random subsets .
we randomly split each subset of genes into two data sets : a learning set with @xmath125 samples and a test set with @xmath126 samples .
we used loocv procedure on the learning set to determine the number of gene factors ( components in the case of pca ) , and the test set for evaluating prediction performances . in total
, @xmath127 class predictions were calculated using each of the dimension reduction method based on @xmath13 randomization trials .
table  [ tab : table1 ] gives the estimated mean error rates ( _ mer _ ) , average values of the estimated meta - parameters ( @xmath97 ) , corresponding standard deviations , and areas under the roc curves ( _ auc _ ) with the considering methods , for different number of variables .
a roc curve analysis is depicted in figure  [ fig : figure3](a ) .
it can be seen from table  [ tab : table1 ] that _ mer _ decreases with the increase of the size of gene subsets @xmath29 .
inversely , the _ auc _ increases when more predictor genes are included in model building . at any of the subsets size ,
the _ _ mer__s of pca - based class prediction are lower that that of rm - based procedure .
_ auc _ scores suggest acceptable prediction performance for rm - based dimension reduction model and excellent performance for the pca - based model .
.prediction performances of the rm- and pca - based prediction models using random gene selection on the leukemia data set with @xmath128 split of samples over @xmath13 randomization trials .
[ cols=">,^,^,^,^,^,^,^ " , ]     legend : rm - lda  rm - based class prediction ; pca - lda  pca - based class prediction ; @xmath29  number of selected genes ; _ mer _  mean error rate ; @xmath97  estimated number of gene factors ( components ) ; _ auc _  area under the roc curve .
in this paper we explored the possibility of rms to solve the course of dimensionality problem arising in the context of microarray gene expression data , and evaluated its performance in class prediction framework using lda .
to our knowledge , this is the first extensive validation study addressing rms for microarray data analysis . in terms of using rm - based dimension reduction of microarray data
, the evaluated approach appears to be as effective as widely used pca - based dimension reduction .
theoretically rms can handle a large number of genes .
however , as many other multivariate methods it is challenged by large computational time and danger of over - fitting . therefore , we have used unsupervised random selection of small subset of genes and supervised welch s @xmath2-test gene selection procedure . applying random selection and using the _ mer _ and _ auc _ scores as class prediction performances , overall average values of @xmath129 ( @xmath130 ) and @xmath131 ( @xmath132 ) have been reached for leukemia and prostate data sets , respectively .
we demonstrated that simple @xmath2-test improve the prediction performance significantly .
considering supervised gene selection procedure , overall average values of @xmath133 ( @xmath134 ) and @xmath135 ( @xmath136 ) have been reached for leukemia and prostate data sets , respectively .
the patterns of performance measures between rm- and pca - based procedures were similar , although the results suggested that rms benefit more from preliminary gene selection .
compared to other studies aimed at class prediction , such as ones by @xcite , @xcite , or @xcite , our performance values are comparable .
slightly better prediction performances in the case of leukemia data set confirm the fact that the biological separation between the two classes is more pronounced in leukemia data set @xcite .
we have developed our approach for discretized microarray data because rm scaling assumes a binary response of a gene expression level . although our results indicate that the loss of information due to discretization step in our procedure is minimal , it is still the issue , if it is reasonable to consider gene expression discretely .
referring to the work of @xcite , who demonstrated the effectiveness of the gibbs sampling to the biclustering of discretized microarray data , we argue that discretization may improve the robustness and generalizability of the prediction algorithm with regard to the high noise level in the microarray data .
following @xcite the discretization of continuous gene expression levels is preferred for three reasons : ( i ) gene transcription occurs in one of a small number of states ( low  high , off  low
high , low  medium  high , off  low  medium  high , etc . ) ; ( ii ) the mechanisms of cellular regulatory networks can be reasonably approximated by primarily qualitative statements describing the relationships between states of genes ; ( iii ) discretization , as a general rule , introduces a measure of robustness against error .
it is a worthwhile future project to study the performance of our method on different levels of dicretization , using polytomous latent variable models ( e.g. , partial credit model ) that could model more than two states of gene expression .
the major dilemma coupled with class prediction studies is the measurement of the performance of the classifier .
the classifier can not be evaluated accurately when sample size is very low .
moreover , feature selection and feature extraction steps should be an integral part of the classifier , and as such they must be a part of the evaluation procedure that is used to estimate the prediction performance @xcite .
@xcite reported several studies published in high impact factor journals where this issue is overlooked , and biased prediction performances are reported . to address these issues we applied loocv scheme to estimate the appropriate number of gene factors and re - randomization experimental design to stabilize performance measures .
it seems that loocv is appropriate , but a more sophisticated design ( e.g. , subsampling , bootstrap sampling , @xmath137 estimator , etc . ) to determine the number of gene factors could improve the prediction performance of the rm - based approach .
the vast amounts of gene expression data generated in the last decade have significantly reshaped statistical thinking and data analysis .
the approach presented here can be also applied to many other problems in computational biology ( e.g. , single nucleotide polymorphism ( snp ) array data analysis ) and could be generalized to the other fields of sciences and humanities ( e.g. , health studies , risk management , financial engineering , etc . ) . hence
, innovative statistical methods like the one presented in this paper are of great relevance .
we have proposed a rm - based dimension reduction approach for the class prediction on microarray gene expression data .
our method is designed to address the course of dimensionality and overcome the problem of `` large @xmath0 , small @xmath1 '' so common in microarray data analysis .
experimental results showed that our procedure appears to be as effective as widely used pca - based dimension reduction method .
we demonstrated that binarization of continuous gene expression levels does not affect prediction performance of the classifier .
we showed that appropriate gene selection is crucial before dimension reduction is performed .
we restricted our approach to the binary prediction problem , but the methodology can be extended to cover multiclass prediction .
the application of our method to other prediction problems ( e.g. , regression , survival analysis ) is straightforward .
we are currently working on extending this work on other latent variable models ( e.g. , partial credit model , rasch - andrich model , etc . ) .
the first author was supported by junior research fellowship granted by slovenian research agency .
00 alter , o. , brown , p. o. , & botstein , d. ( 2000 ) . singular value decomposition for genome - wide expression data processing and modeling .
_ proc natl acad sci unit states am _ , _
97_(18 ) , 1010110106 .
antoniadis , a. , lambert - lacroix , s. , & leblanc , f. ( 2003 ) .
effective dimension reduction methods for tumor classification using gene expression data .
_ bioinformatics _ , _ 19_(5 ) , 563570 .
asyali , m. h. , colak , d. , demirkaya , o. , & inan , m. s. ( 2006 ) .
gene expression profile classification : a review .
_ curr bioinformatics _ , _
1_(1 ) , 5573 .
bellazzi , r. , & zupan , b. ( 2008 ) .
predictive data mining in clinical medicine : current issues and guidelines .
_ int j med informat _ , _
77_(2 ) , 8197 .
boulesteix , a .-
pls dimension reduction for classification with microarray data .
_ stat appl genet mol biol _ ,
_ 3_(1 ) . retrieved from doi:10.2202/1544 - 6115.1075 boulesteix ,
l . , & strimmer , k. ( 2007 ) .
partial least squares : a versatile tool for the analysis of high - dimensional genomic data . _ brief bioinform _ , _
8_(1 ) , 3244 .
boulesteix , a .-
l . , strobl , c. , augustin , t. , & daumer , m. ( 2008 ) .
evaluating microarray - based classifiers : an overview .
_ canc informat _ ,
_ 6 _ , 7797 . retrieved from http://www.la-press.com/evaluating-microarray-based-classifiers-an-overview-a577 bura , e. , & pfeiffer , r. m. ( 2003 ) .
graphical methods for class prediction using dimension reduction techniques on dna microarray data . _ bioinformatics _ , _
19_(10 ) , 12521258 .
chen , j. j. ( 2007 ) .
key aspects of analyzing microarray gene - expression data . _ pharmacogenomics _ , _
8_(5 ) , 473482 .
chiaromonte , f. , & martinelli , j. ( 2002 ) .
dimension reduction strategies for analyzing global gene expression data with a response .
_ math biosci _ , _
176_(1 ) , 123144 . cordero , f. , botta , m. , & calogero , r. a. ( 2007 ) .
microarray data analysis and mining approaches .
_ brief funct genomic proteomic _ , _
6_(4 ) , 265281 .
dai , j. j. , lieu , l. , & rocke , d. ( 2006 ) .
dimension reduction for classification with gene expression microarray data .
_ stat appl genet mol biol _ , _ 5_(1 ) . retrieved from doi:10.2202/1544 - 6115.1147 de boeck , p. , & wilson , m. ( eds . ) .
_ explanatory item response models : a generalized linear and nonlinear approach_. new york , ny : springer .
de smet , f. , moreau , y. , engelen , k. , timmerman , d. , vergote , i. , & de moor , b. ( 2004 ) .
balancing false positives and false negatives for the detection of differential expression in malignancies . _
br j canc _ , _
91_(6 ) , 11601165 . dettling , m. ( 2004 ) .
bagboosting for tumor classification with gene expression data .
_ bioinformatics _ , _
20_(18 ) , 3583 - 3593 . do , j. h. , & choi , d. k. ( 2008 ) . clustering approaches to identifying gene expression patterns from dna microarray data .
_ mol cells _ , _
25_(2 ) , 279288 .
dudoit , s. , fridlyand , j. , & speed , t. p. ( 2002 ) .
comparison of discrimination methods for the classification of tumors using gene expression data .
_ j am stat assoc _ , _
97_(457 ) , 7787 .
dupuy , a. , & simon , r. m. ( 2007 ) .
critical review of published microarray studies for cancer outcome and guidelines on statistical analysis and reporting .
_ j natl cancer inst _ , _
99_(2 ) , 147157 . fan , j. , & li , r. ( 2006 ) .
statistical challenges with high dimensionality : feature selection in knowledge discovery . in m. sanz - sol , j. soria , j. l. varona , & j. verdera ( eds . ) , _ proceedings of the international congress of mathematicians _
( pp . 595622 ) .
madrid : european mathematical society publishing house .
fawcett , t. ( 2006 ) .
an introduction to roc analysis . _ pattern recogn lett _ , _
27_(8 ) , 861874 .
fischer , g. h. , & molenaar , i. w. ( eds . ) .
( 1995 ) . _
rasch models : foundations , recent developments , and applications_. berlin : springer .
gan , g. , ma , c. , & wu , j. ( 2007 ) .
_ data clustering : theory , algorithms , and applications_. philadelphia , pa : society for industrial and applied mathematics .
golub , t. r. , slonim , d. k. , tamayo , p. , huard , c. , gaasenbeek , m. , mesirov , j. p. , et al .
molecular classification of cancer : class discovery and class prediction by gene expression monitoring . _ science _ , _
286_(5439 ) , 531537 .
hartemink , a. j. ( 2001 ) .
_ principled computational methods for the validation and discovery of genetic regulatory networks_. unpublished doctoral dissertation , massachusetts institute of technology , boston .
hastie , t. , tibshirani , r. , & friedman , j. h. ( 2001 ) . _
the elements of statistical learning_. new york , ny : springer .
holter , n. s. , mitra , m. , maritan , a. , cieplak , m. , banavar , j. r. , & fedoroff , n. v. ( 2000 ) .
fundamental patterns underlying gene expression profiles : simplicity from complexity . _
proc natl acad sci unit states am _ , _
97_(15 ) , 84098414 .
huang , j. , & ling , c. x. ( 2005 ) .
using auc and accuracy in evaluating learning algorithms .
_ ieee trans knowl data eng _ , _
17_(3 ) , 299310 .
hughes , g. ( 1968 ) . on the mean accuracy of statistical pattern recognizers .
_ ieee trans inform theor _ , _
14_(1 ) , 5563 . jain , a. k. , duin , r. p. w. , & mao , j. ( 2000 ) .
statistical pattern recognition : a review .
_ ieee trans pattern anal mach intell _ , _
22_(1 ) , 437 .
jeffery , i. b. , higgins , d. g. , & culhane , a. c. ( 2006 ) .
comparison and evaluation of methods for generating differentially expressed gene lists from microarray data .
_ bmc bioinformatics _ , _ 7 _ , 359 . retrieved from doi:10.1186/1471 - 2105 - 7 - 359 larraaga , p. , calvo , b. , santana , r. , bielza , c. , galdiano , j. , inza , i. , et al .
machine learning in bioinformatics . _
brief bioinform _ , _
7_(1 ) , 86112 .
li , h. , & hong , f. ( 2001 ) .
cluster - rasch models for microarray gene expression data .
_ genome biol _ , _
2_(8 ) . retrieved from doi:10.1186/gb-2001 - 2 - 8-research0031 nguyen , d. v. , & rocke , d. m. ( 2002 ) .
tumor classification by partial least squares using microarray gene expression data .
_ bioinformatics _ , _
18_(1 ) , 3950 .
nguyen , d. v. , & rocke , d. m. ( 2004 ) . on partial least squares dimension reduction for microarray - based classification : a simulation study .
comput stat data anal _ , _
46_(3 ) , 407425 .
orlando , d. a. , lin , c. y. , bernard , a. , wang , j. y. , socolar , j. e. , iversen , e. s. , et al .
global control of cell - cycle transcription by coupled cdk and network oscillators .
_ nature _ , _
453_(7197 ) , 944947 .
r development core team ( 2008 ) .
_ r : a language and environment for statistical computing_. vienna : r foundation for statistical computing .
available from http://www.r-project.org rabe - hesketh , s. , & skrondal , a. ( 2008 ) .
classical latent variable models for medical research . _
stat meth med res _ , _
17_(1 ) , 532 .
rasch , g. ( 1966 ) .
an item analysis which takes individual differences into account . _
br j math stat psychol _ , _
19_(1 ) , 4957 .
raudys ,  .
measures of data and classifier complexity and the training sample size . in m. basu , & t. k. ho ( eds . ) , _ data complexity in pattern recognition _
london : springer .
richards , a. l. , holmans , p. , odonovan , m. c. , owen , m. j. , & jones , l. ( 2008 ) . a comparison of four clustering methods for brain expression microarray data . _ bmc bioinformatics _ , _ 9 _ , 490 .
retrieved from doi:10.1186/1471 - 2105 - 9 - 490 ripley , b. d. ( 1996 ) .
_ pattern recognition and neural networks_. cambridge : cambridge university press .
sheng , q. , moreau , y. , & de moor , b. ( 2003 ) .
biclustering microarray data by gibbs sampling .
_ bioinformatics _ , _ 19_(suppl .
2 ) , 196205 . simon , r. ( 2003 ) .
diagnostic and prognostic prediction using gene expression profiles in high - dimensional microarray data .
_ br j canc _ , _
89_(9 ) , 15991604 .
singh , d. , febbo , p. g. , ross , k. , jackson , d. g. , manola , j. , ladd , c. , et al .
gene expression correlates of clinical prostate cancer behavior .
_ canc cell _ , _
1_(2 ) , 203 - 209 .
slawski , m. , daumer , m. , & boulesteix , a .-
cma - a comprehensive bioconductor package for supervised classification with high dimensional data .
_ bmc bioinformatics _ , _
9_(1 ) , 439 . retrieved from doi:10.1186/1471 - 2105 - 9 - 439 tibshirani , r. , hastie , t. , narasimhan , b. , & chu , g. ( 2002 ) .
diagnosis of multiple cancer types by shrunken centroids of gene expression .
_ proc natl acad sci unit states am _ , _
99_(10 ) , 65676572 . zhang , c. , fu , h. , jiang , y. , & yu , t. ( 2007 ) .
high - dimensional pseudo - logistic regression and classification with applications to gene expression data .
_ comput stat data anal _ , _ 52_(1 ) ,