Pilot and feasibility studies are crucial for determining whether follow-up trials should be conducted. To be effective, these studies need to be properly designed and have large enough samples to make correct decisions about proceeding to a future trial at a high rate. However, there is significantly less clarity about best practices concerning sample size justifications compared to larger randomized controlled trials which are usually justified by power analyses. This has led to many feasibility studies justifying sample sizes based on pragmatic reasons (e.g., the ability to complete) or on published guidance and various rules of thumb. We argue that feasibility studies should be designed for, or at least report relevant operating characteristics, specifically, the probability of determining a future trial will be feasible when it is and the probability of determining a trial will be feasible when it is not and that sample size justifications should be based on these operating characteristics whenever possible. If relevant operating characteristics for a study are not reported, it is difficult to know whether the evidence from these trials can be used to claim a future trial would be feasible. In this paper, we review common methods for determining samples sizes in feasibility studies, report a narrative review of recently published feasibility studies and use two case-studies to highlight core issues we believe exist in the current design and reporting of these studies. Finally, we provide some suggestions that we believe will enhance the sample size justifications and overall effectiveness of these important trials.
19 March 2019 in Clinical Journal of the American Society of Nephrology
Background and objectives Cognitive impairment is common in patients with kidney disease and can affect physicians’ perception and/or patients’ ability to complete the pretransplant evaluation. We examined whether cognitive impairment influences the likelihood for transplant listing and whether patients with cognitive impairment take longer to be listed. Design, setting, participants, & measurements We conducted a single-center longitudinal cohort study. Patients presenting for their index kidney transplant evaluation were screened for cognitive impairment using the Montreal Cognitive Assessment. A score <26 indicated cognitive impairment. The transplant selection committee was blinded to the scores. Kaplan–Meier analysis assessed time to active listing by level of cognition. A Cox proportional hazards model that included age, sex, race/ethnicity, smoking, coronary artery disease, and diabetes was constructed to evaluate the association between Montreal Cognitive Assessment score and listing for transplant. Results In total, 349 patients who underwent Montreal Cognitive Assessment testing at their initial visit were included in the analysis. Patients with cognitive impairment were more likely to be older, black, and smokers. The time to listing in patients with cognitive impairment was longer than the time to listing in those with no cognitive impairment (median time, 10.6 versus 6.3 months; log rank test P=0.01). Cognitive impairment was independently associated with a lower likelihood of being listed for transplant (hazard ratio, 0.93 per unit lower Montreal Cognitive Assessment score; 95% confidence interval, 0.88 to 0.99; P=0.02). A lower proportion of patients with cognitive impairment were listed compared with patients without cognitive impairment at 1 month (2% versus 11%), 6 months (17% versus 37%), and 1 year (23% versus 41%), (P<0.001 for all). Conclusions Cognitive impairment is associated with a lower likelihood of being listed for kidney transplant, and is associated with longer time to transplant listing. Visual Abstract
Background: Cognitive impairment is common in kidney transplant (KT) recipients and affects quality of life, graft survival, morbidity, and mortality. Failure to identify patients with cognitive impairment can withhold appropriate and timely intervention. This study determines whether measured cognition with standard screening tools offers any advantage over perceived cognition in screening transplant patients for cognitive impairment. Methods: Cognition was assessed in 157 KT recipients using the Montreal Cognitive Assessment (MoCA; measured cognition). In addition, transplant physicians and nurse coordinators were asked to rate transplant recipients' level of cognition after routine clinical interactions (perceived cognition). Physicians and nurses were blind to MoCA scores. Perceived cognition scores were compared to MoCA scores. Results: Perceived cognition scores fairly correlated with MOCA scores (γ = 0.24, p = 0.001 for physicians and γ = 0.33, p < 0.0001 for nurses). Physician scores moderately correlated with nurses scores (κ = 0.44, p < 0.0001). Clinical perception had a low accuracy for identifying patients with cognitive impairment (sensitivity 66% for physicians, 65% for nurses), and those without cognitive impairment (specificity 67% for physicians, 76% for nurses). Conclusion: Clinical perception is inaccurate at detecting cognitive impairment in KT recipients. Objective tests should be considered to screen KT recipients for cognitive impairment.
The U.S. Cooperative Extension Service (CE) has potential to deliver the National Diabetes Prevention Program (NDPP) to rural residents with prediabetes. However, the CE remains underutilized for the delivery of NDPP. We compared the feasibility/effectiveness of the NDPP (0–6 mos.) delivered by CE personnel to rural residents with prediabetes using Zoom® (CE-Zoom®) or by our research staff using Facebook® (FB). Adults (n = 31, age ~55 years) were enrolled (CE-Zoom® n = 16, FB n = 15). Attendance did not differ significantly between groups (CE Zoom® = 69%, FB = 83%, p = 0.15). Participant retention was similar in the CE Zoom® (88%) and FB groups (87%). CE-Zoom® and FB® groups provided weekly, self-monitoring data for 83% and 84% of the 24 potential weeks, respectively. Six-month weight loss was not different between groups (CE-Zoom® = −5.99 ± 8.0 kg, −5.4%, FB = −1.68 ± 3.3 kg, −1.6% p = 0.13). Participants achieving ≥5% weight loss was greater in the CE-Zoom® (44%) compared with the FB group (7%, p = 0.04). Participants achieving the NDPP program goal for physical activity (≥150 min/week) did not differ (CE-Zoom® = 75%, FB = 67%, p = 0.91). This pilot trial demonstrated the potential feasibility and effectiveness of the NDPP delivered by CE personnel in a group remote format (Zoom®) to adults with prediabetes living in rural areas.