To evaluate the change of the risk of bias (RoB) of acupuncture randomized controlled trials (RCTs) in the past five decades. Multiple databases were searched. We included RCTs identified from systematic reviews (SRs) on acupuncture. General characteristics and RoB judgment for each domain were extracted. The proportions of RCTs at high and unclear RoB were calculated and the changes were examined by the Mann-Kendall test. We included 368 SRs including 4 715 RCTs. The rates of RCTs at unclear RoB were the highest in allocation concealment (63%), and at the lowest in incomplete outcome data (35%); in the last five decades, statistically significant reductions were found for random sequence generation (P < 0.001) and selective reporting (P = 0.01), and increases for blinding of participants and personnel (P < 0.001), blinding of outcome assessment (P < 0.001) and incomplete outcome data (P = 0.04). For the proportions of RCTs at high RoB, blinding of participants and personnel (47%) and blinding of outcome assessment (35%) were the poorest domains; there were no significant differences in changes for all domains. Although improvements concerning unclear risk were observed for random sequence generation and selective reporting, major issues remain for allocation concealment and blinding. It is imperative to use valid randomization, specify how it is conducted, and try to test for selection bias and the success of masking by using the Berger Exner test.
21 March 2024 in Journal of Evidence-Based Medicine
Objectives In this study, we aimed to investigate the characteristics of robot-assisted surgery studies registered on ClinicalTrials.gov and identify factors associated with early trial discontinuation and timely results reporting. Design We searched ClinicalTrials.gov to identify interventional studies on robot-assisted surgery on 24 May 2021. All structured information of the potential studies was downloaded and reviewed. A descriptive analysis was performed. Logistic and Cox regression analyses were respectively performed to determine the significance of the association of study characteristics with results reporting and early discontinuation. Results A total of 529 interventional studies on robot-assisted surgery were included, with 45 studies reporting results and 54 studies being stopped early. Of the 289 due studies, only 45 (16%) had submitted their results, and only 6 (2%) had submitted their results within the 1-year deadline. Funding source was associated with results reporting: academic funded were 63% less likely than industry to report results (OR=0.37, 95% CI: 0.16 to 0.83, p=0.02). Studies related to device feasibility were associated with greater risk of early discontinuation compared to treatment-related studies (HR=2.30, 95% CI: 1.08 to 4.89, p=0.03). Surprisingly, National Institutes of Health-funded studies were at greater hazard of discontinuation compared to industry-funded studies (HR=3.30, 95% CI: 1.09 to 10.00, p=0.04). Conclusions There was poor compliance with results reporting requirements for robot-assisted surgical studies. It is important that investigators remain informed about the regulatory requirements, and should be helped to develop a sense of responsibility for reporting results. Also, they need to ensure the careful design of the study protocol and adequate resources to reduce the risk of early discontinuation.
29 June 2022 in Journal of Evidence-Based Medicine