In this article, the third in the PROGRESS series on prognostic factor research, Sara Schroter and colleagues review how prognostic models are developed and validated, and then address how prognostic models are assessed for their impact on practice and patient outcomes, illustrating these ideas with examples.
In the second article in the PROGRESS series on prognostic factor research, Sara Schroter and colleagues discuss the role of prognostic factors in current clinical practice, randomised trials, and developing new interventions, and explain why and how prognostic factor research should be improved.
Understanding and improving the prognosis of a disease or health condition is a priority in clinical research and practice. In this article, the authors introduce a framework of four interrelated themes in prognosis research, describe the importance of the first of these themes (understanding future outcomes in relation to current diagnostic and treatment practices), and introduce recommendations for the field of prognosis research
In patients with a particular disease or health condition, stratified medicine seeks to identify those who will have the most clinical benefit or least harm from a specific treatment. In this article, the fourth in the PROGRESS series, the authors discuss why prognosis research should form a cornerstone of stratified medicine, especially in regard to the identification of factors that predict individual treatment response A woman with newly diagnosed breast cancer is deciding on a course of therapy, guided by her physician. Evidence on the average prognosis1 and effectiveness of therapeutic interventions is available from studies of large groups of patients with breast cancer in observational studies and randomised trials. But the patient and doctor are faced with making a decision in an individual case, where the prognosis and response to treatment may deviate from average. One way to select the optimal treatment is to consider a test that predicts treatment effect, such as the human epidermal growth factor receptor 2 (HER-2) status.2 The use of HER-2 status in breast cancer management is an example of the translation of results from prognosis research toward improved patient outcomes. The prognosis of breast cancer patients is highly variable,1 HER-2 was discovered as a prognostic factor,3 which provided a specific target for an intervention (trastuzumab), which was then evaluated in trials which recruited women with HER-2 positive cancers (see fig 1⇓). After the success of these trials in improving clinical outcome, trastuzumab is now given to the subgroup (stratum) of women who are HER-2 positive, but not to those testing negative;4 this type of approach has been termed stratified medicine. Fig 1 Example of stratified medicines research, with translation from discovery of human epidermal growth factor receptor 2 (HER-2) status as a prognostic factor for metastatic breast …
Objective To determine the effects of training on the quality of peer review.Design Single blind randomised controlled trial with two intervention groups receiving different types of training plus a control group.Setting and participants Reviewers at a general medical journal.Interventions Attendance at a training workshop or reception of a self taught training package focusing on what editors want from reviewers and how to critically appraise randomised controlled trials.Main outcome measures Quality of reviews of three manuscripts sent to reviewers at four to six monthly intervals, evaluated using the validated review quality instrument; number of deliberate major errors identified; time taken to review the manuscripts; proportion recommending rejection of the manuscripts.Results Reviewers in the self taught group scored higher in review quality after training than did the control group (score 2.85 v 2.56; difference 0.29, 95% confidence interval 0.14 to 0.44; P = 0.001), but the difference was not of editorial significance and was not maintained in the long term. Both intervention groups identified significantly more major errors after training than did the control group (3.14 and 2.96 v 2.13; P < 0.001), and this remained significant after the reviewers' performance at baseline assessment was taken into account. The evidence for benefit of training was no longer apparent on further testing six months after the interventions. Training had no impact on the time taken to review the papers but was associated with an increased likelihood of recommending rejection (92% and 84% v 76%; P = 0.002).Conclusions Short training packages have only a slight impact on the quality of peer review. The value of longer interventions needs to be assessed.