The mixed methods appraisal tool (MMAT) was developed for critically appraising different study designs. This study aimed to improve the content validity of three of the five categories of studies in the MMAT by identifying relevant methodological criteria for appraising the quality of qualitative, survey, and mixed methods studies. First, we performed a literature review to identify critical appraisal tools and extract methodological criteria. Second, we conducted a two-round modified e-Delphi technique. We asked three method-specific panels of experts to rate the relevance of each criterion on a five-point Likert scale. A total of 383 criteria were extracted from 18 critical appraisal tools and a literature review on the quality of mixed methods studies, and 60 were retained. In the first and second rounds of the e-Delphi, 73 and 56 experts participated, respectively. Consensus was reached for six qualitative criteria, eight survey criteria, and seven mixed methods criteria. These results led to modifications of eight of the 11 MMAT (version 2011) criteria. Specifically, we reformulated two criteria, replaced four, and removed two. Moreover, we added six new criteria. Results of this study led to improve the content validity of this tool, revise it, and propose a new version (MMAT version 2018).
3 June 2008 in Canadian Medical Association Journal
Background: Up to 50% of adverse events that occur in hospitals are preventable. Language barriers and disabilities that affect communication have been shown to decrease quality of care. We sought to assess whether communication problems are associated with an increased risk of preventable adverse events. Methods: We randomly selected 20 general hospitals in the province of Quebec with at least 1500 annual admissions. Of the 145 672 admissions to the selected hospitals in 2000/01, we randomly selected and reviewed 2355 charts of patients aged 18 years or older. Reviewers abstracted patient characteristics, including communication problems, and details of hospital admission, and assessed the cause and preventability of identified adverse events. The primary outcome was adverse events. Results: Of 217 adverse events, 63 (29%) were judged to be preventable, for an overall population rate of 2.7% (95% confidence interval [CI] 2.1%–3.4%). We found that patients with preventable adverse events were significantly more likely than those without such events to have a communication problem (odds ratio [OR] 3.00; 95% CI 1.43–6.27) or a psychiatric disorder (OR 2.35; 95% CI 1.09–5.05). Patients who were admitted urgently were significantly more likely than patients whose admissions were elective to experience an event (OR 1.64, 95% CI 1.07–2.52). Preventable adverse events were mainly due to drug errors (40%) or poor clinical management (32%). We found that patients with communication problems were more likely than patients without these problems to experience multiple preventable adverse events (46% v. 20%; p = 0.05). Interpretation: Patients with communication problems appeared to be at highest risk for preventable adverse events. Interventions to reduce the risk for these patients need to be developed and evaluated.
23 March 2017 in Interactive Journal of Medical Research
Benzodiazepines are frequently prescribed to elderly patients' despite concerns about adverse effects leading to injurious falls. Previous studies have not investigated the extent to which patients with pre-existing risk factors for falls are prescribed benzodiazepines. The objective of this study is to assess if some of the risk factors for falls are associated with new benzodiazepine prescriptions in elderly persons.
In health, organizational participatory research (OPR) refers to health organization members participating in research decisions, with university researchers, throughout a study. This non-academic partner contribution to the research may take the form of consultation or co-construction. A drawback of OPR is that it requires more time from all those involved, compared to non-participatory research approaches; thus, understanding the added value of OPR, if any, is important. Thus, we sought to assess whether the OPR approach leads to benefits beyond what could be achieved through traditional research. We identified, selected, and appraised OPR health literature, and at each stage, two team members independently reviewed and coded the literature. We used quantitative content analysis to transform textual data into reliable numerical codes and conducted a logistic regression to test the hypothesis that a co-construction type OPR study yields extra benefits with a greater likelihood than consultation-type OPR studies. From 8873 abstracts and 992 full text papers, we distilled a sample of 107 OPR studies. We found no difference between the type of organization members’ participation and the likelihood of exhibiting an extra benefit. However, the likelihood of an OPR study exhibiting at least one extra benefit is quadrupled when the impetus for the study comes from the organization, rather than the university researcher(s), or the organization and the university researcher(s) together (OR = 4.11, CI = 1.12–14.01). We also defined five types of extra benefits. This review describes the types of extra benefits OPR can yield and suggests these benefits may occur if the organization initiates the OPR. Further, this review exposes a need for OPR authors to more clearly describe the type of non-academic partner participation in key research decisions throughout the study. Detailed descriptions will benefit others conducting OPR and allow for a re-examination of the relationship between participation and extra benefits in future reviews.
10 December 2012 in Journal of the American Society for Information Science and Technology