Instruct: Given a scientific claim, retrieve documents that support or refute the claim.
Query: Measuring routine outcomes is more beneficial to clinical practice than assessing treatment adherence.
OBJECTIVES To examine the effect of routinely administered psychiatric questionnaires on the recognition, management, and outcome of psychiatric disorders in non-psychiatric settings. DATA SOURCES Embase, Medline, PsycLIT, Cinahl, Cochrane Controlled Trials Register, and hand searches of key journals. METHODS A systematic review of randomised controlled trials of the administration and routine feedback of psychiatric screening and outcome questionnaires to clinicians in non-psychiatric settings. Narrative overview of key design features and end points, together with a random effects quantitative synthesis of comparable studies. MAIN OUTCOME MEASURES Recognition of psychiatric disorders after feedback of questionnaire results; interventions for psychiatric disorders; and outcome of psychiatric disorders. RESULTS Nine randomised studies were identified that examined the use of common psychiatric instruments in primary care and general hospital settings. Studies compared the effect of the administration of these instruments followed by the feedback of the results to clinicians, with administration with no feedback. Meta-analytic pooling was possible for four of these studies (2457 participants), which measured the effect of feedback on the recognition of depressive disorders. Routine administration and feedback of scores for all patients (irrespective of score) did not increase the overall rate of recognition of mental disorders such as anxiety and depression (relative risk of detection of depression by clinician after feedback 0.95, 95% confidence interval 0.83 to 1.09). Two studies showed that routine administration followed by selective feedback for only high scorers increased the rate of recognition of depression (relative risk of detection of depression after feedback 2.64, 1.62 to 4.31). This increased recognition, however, did not translate into an increased rate of intervention. Overall, studies of routine administration of psychiatric measures did not show an effect on patient outcome. CONCLUSIONS The routine measurement of outcome is a costly exercise. Little evidence shows that it is of benefit in improving psychosocial outcomes of those with psychiatric disorder managed in non-psychiatric settings.
OBJECTIVE This study compared, in treatment and control groups, the phenomena of coaction, which is the probability that taking effective action on one behavior is related to taking effective action on a second behavior. METHODS Pooled data from three randomized trials of Transtheoretical Model (TTM) tailored interventions (n=9461), completed in the U.S. in 1999, were analyzed to assess coaction in three behavior pairs (diet and sun protection, diet and smoking, and sun protection and smoking). Odds ratios (ORs) compared the likelihood of taking action on a second behavior compared to taking action on only one behavior. RESULTS Across behavior pairs, at 12 and 24 months, the ORs for the treatment group were greater on an absolute basis than for the control group, with two being significant. The combined ORs at 12 and 24 months, respectively, were 1.63 and 1.85 for treatment and 1.20 and 1.10 for control. CONCLUSIONS The results of this study with addictive, energy balance and appearance-related behaviors were consistent with results found in three studies applying TTM tailoring to energy balance behaviors. Across studies, there was more coaction within the treatment group. Future research should identify predictors of coaction in more multiple behavior change interventions.
SETTING The rural health district of Hlabisa, KwaZulu-Natal, South Africa.   OBJECTIVES To assess the acceptability and effectiveness of traditional healers as supervisors of tuberculosis (TB) treatment in an existing directly observed treatment, short-course (DOTS) programme. DESIGN An observational study comparing treatment outcomes among new TB patients in the three intervention sub-districts offered the additional option of traditional healers for directly observed treatment (DOT) supervision with those in the remainder of the district offered the standard range of options for DOT supervision (health facility, community health worker and lay persons). A comparison was also made of treatment outcomes between different options for DOT supervision. RESULTS A total of 3461 TB patients were registered in Hlabisa District from April 1999 to December 2000, of whom 2823 were discharged from hospital to the ambulatory DOT programme. Treatment outcomes were known for 1816 patients in Hlabisa District (275 patients in the intervention area and 1541 patients in the control area). There was no significant difference (P < 0.5) in treatment outcome in the intervention and control areas (77% vs. 75%). Among 275 patients with known outcomes in the intervention area, 48 patients were supervised by traditional healers and 227 patients supervised by people other than traditional healers. Treatment completion was not significantly higher among patients supervised by traditional healers than among patients supervised by other categories of DOT supervisor (88% vs. 75%, P = 0.3841). Interviews with 41 of 51 traditional healer patients who had completed treatment revealed high levels of satisfaction with the care received. CONCLUSIONS Traditional healers make an effective contribution to TB programme performance in this pilot scheme in Hlabisa district. Further evaluation will be necessary as this approach is scaled up.
I present methods for assessing the relative effectiveness of two treatments when they have not been compared directly in a randomized trial but have each been compared to other treatments. These network meta-analysis techniques allow estimation of both heterogeneity in the effect of any given treatment and inconsistency ('incoherence') in the evidence from different pairs of treatments. A simple estimation procedure using linear mixed models is given and used in a meta-analysis of treatments for acute myocardial infarction.
Psychiatrists have long recognised that routine clinical practice needs to be shaped and informed by external evidence (Lewis, 1958). Psychiatric researchers were among the first to utilise multi-centre randomised controlled trials (demonstrating the effectiveness of antipsychotics), and psychologists were among the first in the health field to develop techniques of meta-analysis. Social workers, too, point to their tradition with the publication of one of the earliest controlled trials (Lehrman, 1949).
Background  Extensive debate exists in the healthcare community over whether outcomes of medical care at teaching hospitals and other healthcare units are better or worse than those at the respective nonteaching ones. Thus, our goal was to systematically evaluate the evidence pertaining to this question. Methods and Findings  We reviewed all studies that compared teaching versus nonteaching healthcare structures for mortality or any other patient outcome, regardless of health condition. Studies were retrieved from PubMed, contact with experts, and literature cross-referencing. Data were extracted on setting, patients, data sources, author affiliations, definition of compared groups, types of diagnoses considered, adjusting covariates, and estimates of effect for mortality and for each other outcome. Overall, 132 eligible studies were identified, including 93 on mortality and 61 on other eligible outcomes (22 addressed both). Synthesis of the available adjusted estimates on mortality yielded a summary relative risk of 0.96 (95% confidence interval [CI], 0.93–1.00) for teaching versus nonteaching healthcare structures and 1.04 (95% CI, 0.99–1.10) for minor teaching versus nonteaching ones. There was considerable heterogeneity between studies (I2 = 72% for the main analysis). Results were similar in studies using clinical and those using administrative databases. No differences were seen in the 14 studies fully adjusting for volume/experience, severity, and comorbidity (relative risk 1.01). Smaller studies did not differ in their results from larger studies. Differences were seen for some diagnoses (e.g., significantly better survival for breast cancer and cerebrovascular accidents in teaching hospitals and significantly better survival from cholecystectomy in nonteaching hospitals), but these were small in magnitude. Other outcomes were diverse, but typically teaching healthcare structures did not do better than nonteaching ones. Conclusions  The available data are limited by their nonrandomized design, but overall they do not suggest that a healthcare facility's teaching status on its own markedly improves or worsens patient outcomes. Differences for specific diseases cannot be excluded, but are likely to be small.
As the global incidence of HIV exceeds 2 million new infections annually, effective interventions to decrease HIV transmission are needed. Randomized, placebo-controlled studies have demonstrated that daily oral antiretroviral pre-exposure prophylaxis (PrEP) with a fixed-dose combination tablet containing tenofovir disoproxil fumarate and emtricitabine can significantly reduce HIV incidence among diverse at-risk populations. In these studies, the efficacy of PrEP was correlated with levels of adherence. Official guidelines recommend provision of PrEP to people at greatest risk of HIV acquisition, and demonstration projects suggest that high levels of uptake and adherence are possible outside of controlled studies. However, several potential barriers to implementing PrEP remain. These challenges include low awareness and utilization of PrEP by at-risk individuals, uncertainty about adherence in ‘real-world’ settings, the majority of healthcare providers being untrained in PrEP provision, limited data about potential adverse effects from long-term use of tenofovir–emtricitabine, high costs of PrEP medications, and stigma associated with PrEP use and the behaviors that would warrant PrEP. Innovative pharmacologic chemoprophylactic approaches could provide solutions to some of these challenges. Less-than-daily oral dosing regimens and long-acting injectable medications could reduce pill burdens and facilitate adherence, and local delivery of PrEP medications to genital compartments via gels, rings and films may limit systemic drug exposure and potential toxicities. As the portfolio of chemoprophylactic agents and delivery systems expands to meet the diverse sexual health needs and product preferences of individuals who may benefit from PrEP, it is hoped that antiretroviral chemoprophylaxis could become an acceptable, feasible, and highly effective addition to existing HIV prevention strategies.
AIMS To explore the utility of self-report measures of inhaled corticosteroid (ICS) adherence, degree of rhinitis and smoking status and their association with asthma control. METHODS Patients prescribed ICS for asthma at 85 UK practices were sent validated questionnaire measures of control (Asthma Control Questionnaire; ACQ) and adherence (Medication Adherence Report Scale), a two-item measure of smoking status, and a single-item measure of rhinitis. RESULTS Complete anonymised questionnaires were available for 3916 participants. Poor asthma control (ACQ >1.5) was associated with reported rhinitis (OR = 4.62; 95% CI: 3.71-5.77), smoking (OR = 4.33; 95% CI: 3.58-5.23) and low adherence to ICS (OR = 1.35; 95% CI: 1.18-1.55). The degree of rhinitis was important, with those reporting severe rhinitis exhibiting the worst asthma control, followed by those reporting mild rhinitis and then those reporting no rhinitis symptoms (F(2, 3913)=128.7, p<.001). There was a relationship between the number of cigarettes smoked each day and asthma control (F(5,655)=6.08, p<.001). CONCLUSIONS Poor asthma control is associated with self-reported rhinitis, smoking and low medication adherence. These potentially modifiable predictors of poor asthma control can be identified through a brief self-report questionnaire, used routinely as part of an asthma review.
A novel design for intervention studies is presented, the so called PROBE study (Prospective Randomized Open, Blinded End-point). This design is compared to the classical double-blind design. Among the advantages of the PROBE design are lower cost and greater similarity to standard clinical practice, which should make the results more easily applicable in routine medical care. Since end-points are evaluated by a blinded end-point committee it is obvious that there should be no difference between the two types of trials in this regard.
BACKGROUND Improving the design and implementation of evidence-based practice depends on successful behaviour change interventions. This requires an appropriate method for characterising interventions and linking them to an analysis of the targeted behaviour. There exists a plethora of frameworks of behaviour change interventions, but it is not clear how well they serve this purpose. This paper evaluates these frameworks, and develops and evaluates a new framework aimed at overcoming their limitations. METHODS A systematic search of electronic databases and consultation with behaviour change experts were used to identify frameworks of behaviour change interventions. These were evaluated according to three criteria: comprehensiveness, coherence, and a clear link to an overarching model of behaviour. A new framework was developed to meet these criteria. The reliability with which it could be applied was examined in two domains of behaviour change: tobacco control and obesity. RESULTS Nineteen frameworks were identified covering nine intervention functions and seven policy categories that could enable those interventions. None of the frameworks reviewed covered the full range of intervention functions or policies, and only a minority met the criteria of coherence or linkage to a model of behaviour. At the centre of a proposed new framework is a 'behaviour system' involving three essential conditions: capability, opportunity, and motivation (what we term the 'COM-B system'). This forms the hub of a 'behaviour change wheel' (BCW) around which are positioned the nine intervention functions aimed at addressing deficits in one or more of these conditions; around this are placed seven categories of policy that could enable those interventions to occur. The BCW was used reliably to characterise interventions within the English Department of Health's 2010 tobacco control strategy and the National Institute of Health and Clinical Excellence's guidance on reducing obesity. CONCLUSIONS Interventions and policies to change behaviour can be usefully characterised by means of a BCW comprising: a 'behaviour system' at the hub, encircled by intervention functions and then by policy categories. Research is needed to establish how far the BCW can lead to more efficient design of effective interventions.
OBJECTIVES To identify and describe misunderstandings between patients and doctors associated with prescribing decisions in general practice. DESIGN Qualitative study. SETTING 20 general practices in the West Midlands and south east England. PARTICIPANTS 20 general practitioners and 35 consulting patients. MAIN OUTCOME MEASURES Misunderstandings between patients and doctors that have potential or actual adverse consequences for taking medicine. RESULTS 14 categories of misunderstanding were identified relating to patient information unknown to the doctor, doctor information unknown to the patient, conflicting information, disagreement about attribution of side effects, failure of communication about doctor's decision, and relationship factors. All the misunderstandings were associated with lack of patients' participation in the consultation in terms of the voicing of expectations and preferences or the voicing of responses to doctors' decisions and actions. They were all associated with potential or actual adverse outcomes such as non-adherence to treatment. Many were based on inaccurate guesses and assumptions. In particular doctors seemed unaware of the relevance of patients' ideas about medicines for successful prescribing. CONCLUSIONS Patients' participation in the consultation and the adverse consequences of lack of participation are important. The authors are developing an educational intervention that builds on these findings.
BACKGROUND Treatment regimens for active tuberculosis (TB) that are intermittent, or use rifampin during only the initial phase, offer practical advantages, but their efficacy has been questioned. We conducted a systematic review of treatment regimens for active TB, to assess the effect of duration and intermittency of rifampin use on TB treatment outcomes. METHODS AND FINDINGS PubMed, Embase, and the Cochrane CENTRAL database for clinical trials were searched for randomized controlled trials, published in English, French, or Spanish, between 1965 and June 2008. Selected studies utilized standardized treatment with rifampin-containing regimens. Studies reported bacteriologically confirmed failure and/or relapse in previously untreated patients with bacteriologically confirmed pulmonary TB. Pooled cumulative incidences of treatment outcomes and association with risk factors were computed with stratified random effects meta-analyses. Meta-regression was performed using a negative binomial regression model. A total of 57 trials with 312 arms and 21,472 participants were included in the analysis. Regimens utilizing rifampin only for the first 1-2 mo had significantly higher rates of failure, relapse, and acquired drug resistance, as compared to regimens that used rifampin for 6 mo. This was particularly evident when there was initial drug resistance to isoniazid, streptomycin, or both. On the other hand, there was little evidence of difference in failure or relapse with daily or intermittent schedules of treatment administration, although there was insufficient published evidence of the efficacy of twice-weekly rifampin administration throughout therapy. CONCLUSIONS TB treatment outcomes were significantly worse with shorter duration of rifampin, or with initial drug resistance to isoniazid and/or streptomycin. Treatment outcomes were similar with all intermittent schedules evaluated, but there is insufficient evidence to support administration of treatment twice weekly throughout therapy.
BACKGROUND The increased caloric requirements of HIV-positive individuals, undesirable side effects of treatment that may be worsened by malnutrition (but alleviated by nutritional support), and associated declines in adherence and possible increased drug resistance are all justifications for developing better interventions to strengthen the nutrition security of individuals receiving antiretroviral treatment. OBJECTIVE To highlight key benefits and challenges relating to interventions aimed at strengthening the nutrition security of people living with HIV who are receiving antiretroviral treatment. METHODS Qualitative research was undertaken on a short-term nutrition intervention linked to the provision of free antiretroviral treatment for people living with HIV in western Kenya in late 2005 and early 2006. RESULTS Patients enrolled in the food program while on treatment regimens self-reported greater adherence to their medication, fewer side effects, and a greater ability to satisfy increased appetite. Most clients self-reported weight gain, recovery of physical strength, and the resumption of labor activities while enrolled in dual (food supplementation and treatment) programs. Such improvements were seen to catalyze increased support from family and community. CONCLUSIONS These findings provide further empirical support to calls for a more holistic and comprehensive response to the coexistence of AIDS epidemics with chronic nutrition insecurity. Future work is needed to clarify ways of bridging the gap between short-term nutritional support to individuals and longer-term livelihood security programming for communities affected by AIDS. Such interdisciplinary research will need to be matched by intersectoral action on the part of the agriculture and health sectors in such environments.
Thirty patients with tension-type headache were randomly chosen to undergo a trial of traditional Chinese acupuncture and sham acupuncture. Five measures were used to assess symptom severity and treatment response: intensity, duration and frequency of headache pain episodes, headache index and analgesic intake. The five measures were assessed during a 4 week baseline period, after 4 and 8 weeks of treatment, and 1, 6 and 12 months thereafter. Before the start of the study, each patient was administered the MMPI. Split-plot ANOVAs showed that, compared to baseline, at 1 month after the end of treatment and for the 12 month follow-up, the frequency of headache episodes, analgesic consumption and the headache index (but not the duration or intensity of headache episodes) significantly decreased over time; however, no difference between acupuncture and placebo treatment was found. No single MMPI scale predicted the response to treatment, but the mean MMPI profile of acupuncture non-responders showed the presence of 'Conversion V'.
OBJECTIVE To measure whether the benefits of a single education and self management structured programme for people with newly diagnosed type 2 diabetes mellitus are sustained at three years. DESIGN Three year follow-up of a multicentre cluster randomised controlled trial in primary care, with randomisation at practice level. SETTING 207 general practices in 13 primary care sites in the United Kingdom. PARTICIPANTS 731 of the 824 participants included in the original trial were eligible for follow-up. Biomedical data were collected on 604 (82.6%) and questionnaire data on 513 (70.1%) participants. INTERVENTION A structured group education programme for six hours delivered in the community by two trained healthcare professional educators compared with usual care. MAIN OUTCOME MEASURES The primary outcome was glycated haemoglobin (HbA(1c)) levels. The secondary outcomes were blood pressure, weight, blood lipid levels, smoking status, physical activity, quality of life, beliefs about illness, depression, emotional impact of diabetes, and drug use at three years. RESULTS HbA(1c) levels at three years had decreased in both groups. After adjusting for baseline and cluster the difference was not significant (difference -0.02, 95% confidence interval -0.22 to 0.17). The groups did not differ for the other biomedical and lifestyle outcomes and drug use. The significant benefits in the intervention group across four out of five health beliefs seen at 12 months were sustained at three years (P<0.01). Depression scores and quality of life did not differ at three years. CONCLUSION A single programme for people with newly diagnosed type 2 diabetes mellitus showed no difference in biomedical or lifestyle outcomes at three years although there were sustained improvements in some illness beliefs. TRIAL REGISTRATION Current Controlled Trials ISRCTN17844016.
The ability of children to cope with a chronic medical problem requiring prolonged treatment has an effect on the quality of life of these children and of their parents and serves as an index of the quality of treatment. This study deals with coping ability and satisfaction with treatment of children whose stature was two or more SD below the average for age and gender. The study population included 96 patients, 53 of whom were male, who were on growth hormone (GH) treatment for at least 1 year. 65 patients were without any underlying disease, 15 had classical GH deficiency and 16 had Turner syndrome or renal disease. All patients were treated with daily injections at home from 12 to 66 months. Using a self-administered questionnaire, the ability to cope and the degree of satisfaction and compliance with treatment were assessed. No significant differences were found with respect to gender, the presence of an underlying disease, age at which treatment commenced or duration of treatment. Despite the fact that the outcome of GH treatment on final height has yet to be established, satisfaction and compliance were high.
SETTING Tuberculosis (TB) program, Damien Foundation Projects, Bangladesh. OBJECTIVE To summarize the outcome and its determinants of the first treatment for multidrug-resistant TB using a standardized regimen consisting of a minimum 9 months. DESIGN This was a prospective, observational study of a gatifloxacin (GFX) based directly observed regimen, mainly with initial hospitalization. The 4-month intensive phase was extended until sputum smear conversion. Patients were monitored using culture for up to 2 years after treatment completion. RESULTS Of the 515 patients who met the study inclusion criteria and were successively enrolled from 2005 to 2011, 84.4% had a bacteriologically favorable outcome. Due to extensive disease with delayed sputum conversion, only half of the patients completed treatment within 9 months; however, 95% were able to complete treatment within 12 months. Eleven patients failed or relapsed, and 93.1% of the 435 patients who were successfully treated completed at least 12 months post-treatment follow-up. The strongest risk factor for a bacteriologically unfavorable outcome was high-level fluoroquinolone (FQ) resistance, particularly when compounded by initial pyrazinamide (PZA) resistance. Low-level FQ resistance had no unfavorable effect on treatment outcome. Amplification of drug resistance occurred only once, in a patient strain that was initially only susceptible to kanamycin and clofazimine. CONCLUSION The excellent outcome of the Bangladesh regimen was largely maintained. Bacteriological treatment failures and relapses were rare, except among patients with high-level GFX resistance, notably in the presence of PZA resistance.
Psychosocial factors have significant potential to affect long-term outcomes of bariatric surgery, including emotional adjustment, adherence to the recommended postoperative lifestyle regimen, weight loss outcomes, and co-morbidity improvement and or resolution. Thus, it is recommended that bariatric behavioral health clinicians with specialized knowledge and experience be involved in the evaluation and care of patients both before and after surgery. The evaluating clinician plays a number of important roles in the multidisciplinary treatment of the bariatric patient. Central among these is the role of identifying factors that may pose challenges to optimal surgical outcome and providing recommendations to the patient and bariatric team on how to address these issues. This document outlines recommendations for the psychosocial evaluation of bariatric surgery patients, appropriate qualifications of those conducting these evaluations, communication of evaluation results and suggested treatment plan, and the extension of behavioral healthcare of the bariatric patient to the entire span of the surgical and postsurgical process.
OBJECTIVES To assess the knowledge of interns on standard precautions and post-exposure prophylaxis for HIV, and identify the gap between knowledge and practice relating to standard precautions, as well as determining the perceived barriers against adherence to standard precautions. METHODS The study was conducted on 130 interns of 2010-11 batch from a government-run medical college in Kolkata, India. All participants completed a self-administered questionnaire with items relating to basic components of standard precautions and post-exposure prophylaxis for HIV. The questionnaire also included open ended questions relating to reasons for non-adherence to the practice of standard precautions along with additional space for specific comments, if any. RESULTS Poor adherence in the use of personal protective equipment, hand washing, safe handling and disposal of needles and sharp objects were found to be among the practices for which the interns expressed correct knowledge. While the main reasons for non-adherence were found to be clumsiness in handling needles, wearing gloves, feeling uncomfortable when wearing aprons, impracticality of regular hand-washing and non-availability of equipment. Although the majority of the respondents (84.6%) expressed awareness of washing sites of injured with soap and water, approximately 32.3% did not know that antiseptics could cause more damage. Also, only 63.8% expressed awareness of reporting any incidence of occupational exposure, while knowledge on post-exposure prophylaxis regimens was generally found to be poor. CONCLUSION The considerable gap between knowledge and practice of standard precautions and inadequate knowledge of post-exposure prophylaxis emphasizes the need for continuous onsite training of interns with supportive supervision and monitoring of their activities.
OBJECTIVE To explore how a group of Swedish general practitioners (GPs) manage patients with a sore throat in relation to current guidelines as expressed in interviews. DESIGN Qualitative content analysis was used to analyse semi-structured interviews. SETTING Swedish primary care. SUBJECTS A strategic sample of 25 GPs. MAIN OUTCOME MEASURES Perceived management of sore throat patients. RESULTS It was found that nine of the interviewed GPs were adherent to current guidelines for sore throat and 16 were non-adherent. The two groups differed in terms of guideline knowledge, which was shared within the team for adherent GPs while idiosyncratic knowledge dominated for the non-adherent GPs. Adherent GPs had no or low concerns for bacterial infections and differential diagnosis whilst non-adherent GPs believed that in patients with a sore throat any bacterial infection should be identified and treated with antibiotics. Patient history and examination was mainly targeted by adherent GPs whilst for non-adherent GPs it was often redundant. Non-adherent GPs reported problems getting patients to abstain from antibiotics, whilst no such problems were reported in adherent GPs. CONCLUSION This interview study of sore throat management in a strategically sampled group of Swedish GPs showed that while two-thirds were non-adherent and had a liberal attitude to antibiotics one-third were guideline adherent with a restricted view on antibiotics. Non-adherent GPs revealed significant knowledge gaps. Adherent GPs had discussed guidelines within the primary care team while non-adherent GPs had not. Guideline implementation thus seemed to be promoted by knowledge shared in team discussions.
Objectives: To study the change in outcome for patients admitted to an intensive care unit following the establishment of a team of resident medical staff and a change from an "open" to a "closed" organisational format. Design: Database review of prospectively collected data. Setting: Intensive care unit of a postgraduate teaching hospital. Subjects: 1134 admissions to the intensive care unit over a 3-year period, of whom 476 (42%) followed elective surgery. Main outcome measure: Hospital mortality corrected for illness severity by using the APACHE II scoring system. Results: Crude hospital mortality fell from 28% before the changes to 20% afterwards (P=0.01). With correction for case-mix factors, the probability of death after the changes was reduced by almost half (OR 0.51; CI 0.32, 0.82, P=0.005). Conclusion: A "closed" format of organisation of the delivery of care may result in improved outcomes for patients admitted to intensive care units.
BACKGROUND Data on absolute risks of outcomes and patterns of drug use in cost-effectiveness analyses are often based on randomised clinical trials (RCTs). The objective of this study was to evaluate the external validity of published cost-effectiveness studies by comparing the data used in these studies (typically based on RCTs) to observational data from actual clinical practice. Selective Cox-2 inhibitors (coxibs) were used as an example. METHODS AND FINDINGS The UK General Practice Research Database (GPRD) was used to estimate the exposure characteristics and individual probabilities of upper gastrointestinal (GI) events during current exposure to nonsteroidal anti-inflammatory drugs (NSAIDs) or coxibs. A basic cost-effectiveness model was developed evaluating two alternative strategies: prescription of a conventional NSAID or coxib. Outcomes included upper GI events as recorded in GPRD and hospitalisation for upper GI events recorded in the national registry of hospitalisations (Hospital Episode Statistics) linked to GPRD. Prescription costs were based on the prescribed number of tables as recorded in GPRD and the 2006 cost data from the British National Formulary. The study population included over 1 million patients prescribed conventional NSAIDs or coxibs. Only a minority of patients used the drugs long-term and daily (34.5% of conventional NSAIDs and 44.2% of coxibs), whereas coxib RCTs required daily use for at least 6-9 months. The mean cost of preventing one upper GI event as recorded in GPRD was US$104k (ranging from US$64k with long-term daily use to US$182k with intermittent use) and US$298k for hospitalizations. The mean costs (for GPRD events) over calendar time were US$58k during 1990-1993 and US$174k during 2002-2005. Using RCT data rather than GPRD data for event probabilities, the mean cost was US$16k with the VIGOR RCT and US$20k with the CLASS RCT. CONCLUSIONS The published cost-effectiveness analyses of coxibs lacked external validity, did not represent patients in actual clinical practice, and should not have been used to inform prescribing policies. External validity should be an explicit requirement for cost-effectiveness analyses.
OBJECTIVE To assess the robustness of patient responses to a new national survey of patient experience as a basis for providing financial incentives to doctors. DESIGN Analysis of the representativeness of the respondents to the GP Patient Survey compared with those who were sampled (5.5 million patients registered with 8273 general practices in England in January 2009) and with the general population. Analysis of non-response bias looked at the relation between practice response rates and scores on the survey. Analysis of the reliability of the survey estimated the proportion of the variance of practice scores attributable to true differences between practices. RESULTS The overall response rate was 38.2% (2.2 million responses), which is comparable to that in surveys using similar methodology in the UK. Men, young adults, and people living in deprived areas were under-represented among respondents. However, for questions related to pay for performance, there was no systematic association between response rates and questionnaire scores. Two questions which triggered payments to general practitioners were reliable measures of practice performance, with average practice-level reliability coefficients of 93.2% and 95.0%. Less than 3% and 0.5% of practices had fewer than the number of responses required to achieve conventional reliability levels of 90% and 70%. A change to the payment formula in 2009 resulted in an increase in the average impact of random variation in patient scores on payments to general practitioners compared with payments made in 2007 and 2008. CONCLUSIONS There is little evidence to support the concern of some general practitioners that low response rates and selective non-response bias have led to systematic unfairness in payments attached to questionnaire scores. The study raises issues relating to the validity and reliability of payments based on patient surveys and provides lessons for the UK and for other countries considering the use of patient experience as part of pay for performance schemes.
BACKGROUND Over the past 20 years the prevalence of child and adolescent mental disorders in high-income countries has not changed despite increased investment in mental health services. Insufficient contact with mental health services may be a contributing factor; however, it is not known what proportion of children have sufficient contact with health professionals to allow delivery of treatment meeting minimal clinical practice guidelines, or how long children experience symptoms prior to receiving treatment. AimsTo investigate the level of mental healthcare received by Australian children from age 4 years to 14 years. METHOD Trajectories of mental health symptoms were mapped using the Strengths and Difficulties Questionnaire. Health professional attendances and psychotropic medications dispensed were identified from linked national Medicare Benefits Schedule (MBS) and Pharmaceutical Benefits Scheme records. RESULTS Four trajectories of mental health symptoms were identified (low, high-decreasing, moderate-increasing and high-increasing). Most children with mental health symptoms had few MBS mental health attendances, and only a minority received care meeting study criteria for minimally adequate treatment. Children in the high-increasing and moderate-increasing trajectories were more likely to access care, yet there was no evidence of improvement in symptoms. CONCLUSIONS It is important that children and adolescents with mental health problems receive treatment that meets minimal practice guidelines. Further research is needed to identify the quality of care currently provided to children with mental health difficulties and how clinicians can be best funded and supported to provide care meeting minimal practice guidelines. Declaration of interestsNone.
The validity of the six-question World Health Organization Adult ADHD Self-Report Scale (ASRS) Screener was assessed in a sample of subscribers to a large health plan in the US. A convenience subsample of 668 subscribers was administered the ASRS Screener twice to assess test-retest reliability and then a third time in conjunction with a clinical interviewer for DSM-IV adult ADHD. The data were weighted to adjust for discrepancies between the sample and the population on socio-demographics and past medical claims. Internal consistency reliability of the continuous ASRS Screener was in the range 0.63-0.72 and test-retest reliability (Pearson correlations) in the range 0.58-0.77. A four-category version The ASRS Screener had strong concordance with clinician diagnoses, with an area under the receiver operating characteristic curve (AUC) of 0.90. The brevity and ability to discriminate DSM-IV cases from non-cases make the six-question ASRS Screener attractive for use both in community epidemiological surveys and in clinical outreach and case-finding initiatives.