Systematic review has developed as a specific methodology for searching for, appraising and synthesizing findings of primary studies, and has rapidly become a cornerstone of the evidence-based practice and policy movement. Qualitative research has traditionally been excluded from systematic reviews, and much effort is now being invested in resolving the daunting methodological and epistemological challenges associated with trying to move towards more inclusive forms of review. We describe our experiences, as a very diverse multidisciplinary group, in attempting to incorporate qualitative research in a systematic review of support for breastfeeding. We show how every stage of the review process, from asking the review question through to searching for and sampling the evidence, appraising the evidence and producing a synthesis, provoked profound questions about whether a review that includes qualitative research can remain consistent with the frame offered by current systematic review methodology. We conclude that more debate and dialogue between the different communities that wish to develop review methodology is needed, and that attempts to impose dominant views about the appropriate means of conducting reviews of qualitative research should be resisted so that innovation can be fostered.
Qualitative research can make a valuable contribution to the study of quality and safety in health care. Sound ways of appraising qualitative research are needed, but currently there are many different proposals with few signs of an emerging consensus. One problem has been the tendency to treat qualitative research as a unified field. We distinguish universal features of quality from those specific to methodology and offer a set of minimally prescriptive prompts to assist with the assessment of generic features of qualitative research. In using these, account will need to be taken of the particular method of data collection and methodological approach being used. There may be a need for appraisal criteria suited to the different methods of qualitative data collection and to different methodological approaches. These more specific criteria would help to distinguish fatal flaws from more minor errors in the design, conduct, and reporting of qualitative research. There will be difficulties in doing this because some aspects of qualitative research, particularly those relating to quality of insight and interpretation, will remain difficult to appraise and will rely largely on subjective judgement.
1 January 2007 in Journal of Health Services Research & Policy
Objective: Qualitative research is increasingly valued as part of the evidence for policy and practice, but how it should be appraised is contested. Various appraisal methods, including checklists and other structured approaches, have been proposed but rarely evaluated. We aimed to compare three methods for appraising qualitative research papers that were candidates for inclusion in a systematic review of evidence on support for breast-feeding. Method: A sample of 12 research papers on support for breast-feeding was appraised by six qualitative reviewers using three appraisal methods: unprompted judgement, based on expert opinion; a UK Cabinet Office quality framework; and CASP, a Critical Appraisal Skills Programme tool. Papers were assigned, following appraisals, to 1 of 5 categories, which were dichotomized to indicate whether or not papers should be included in a systematic review. Patterns of agreement in categorization of papers were assessed quantitatively using κ statistics, and qualitatively using cross-case analysis. Results: Agreement in categorizing papers across the three methods was slight ( κ =0.13; 95% CI 0.06–0.24). Structured approaches did not appear to yield higher agreement than that by unprompted judgement. Qualitative analysis revealed reviewers' dilemmas in deciding between the potential impact of findings and the quality of the research execution or reporting practice. Structured instruments appeared to make reviewers more explicit about the reasons for their judgements. Conclusions: Structured approaches may not produce greater consistency of judgements about whether to include qualitative papers in a systematic review. Future research should address how appraisals of qualitative research should be incorporated in systematic reviews.
19 November 2018 in Qualitative Research in Psychology
Researchers using interpretative phenomenological analysis (IPA) within applied research typically use homogenous samples exploring shared perspectives on a single phenomenon of interest. This article explores the challenges and opportunities involved with developing rigorous and epistemologically coherent research designs for capturing more complex and systemic experiential phenomena, through the use of multiple perspectives to explore the same phenomenon. We outline a series of multiple perspective designs and analytic procedures that can be adapted and used across many diverse settings and populations. Whilst building upon existing approaches within qualitative methods and IPA, these designs and procedures are intended to scaffold clear routes to practical application, psychological intervention, the design of behaviour change interventions, and other recommendations for policy and practice. We discuss a variety of conceptual antecedents which situate these designs within phenomenology, pluralistic idiography, qualitative psychology, and wider debates within psychology and other social and behavioural sciences.
13 August 2010 in Qualitative Research in Psychology
The NHS Health Check was designed by UK Department of Health to address increased prevalence of cardiovascular disease by identifying risk levels and facilitating behaviour change. It constituted biomedical testing, personalised advice and lifestyle support. The objective of the study was to explore Health Care Professionals’ (HCPs) and patients’ experiences of delivering and receiving the NHS Health Check in an inner-city region of England. Patients and HCPs in primary care were interviewed using semi-structured schedules. Data were analysed using Thematic Analysis. Four themes were identified. Firstly, Health Check as a test of ‘roadworthiness’ for people. The roadworthiness metaphor resonated with some patients but it signified a passive stance toward illness. Some patients described the check as useful in the theme, Health check as revelatory. HCPs found visual aids demonstrating levels of salt/fat/sugar in everyday foods and a ‘traffic light’ tape measure helpful in communicating such ‘revelations’ with patients. Being SMART and following the protocolrevealed that few HCPs used SMART goals and few patients spoke of them. HCPs require training to understand their rationale compared with traditional advice-giving. The need for further follow-up revealed disparity in follow-ups and patients were not systematically monitored over time. HCPs’ training needs to include the use and evidence of the effectiveness of SMART goals in changing health behaviours. The significance of fidelity to protocol needs to be communicated to HCPs and commissioners to ensure consistency. Monitoring and measurement of follow-up, e.g., tracking of referrals, need to be resourced to provide evidence of the success of the NHS Health Check in terms of healthier lifestyles and reduced CVD risk.