2 August 2019 in BMC Medical Research Methodology
Longitudinal qualitative research is starting to be used in applied health research, having been popular in social research for several decades. There is potential for a large volume of complex data to be captured, over a span of months or years across several different methods. How to analyse this volume of data – with its inherent complexity - represents a problem for health researchers. There is a previous dearth of methodological literature which describes an appropriate analytic process which can be readily employed. We document a worked example of the Pen Portrait analytic process, using the qualitative dataset for which the process was originally developed. Pen Portraits are recommended as a way in which longitudinal health research data can be concentrated into a focused account. The four stages of undertaking a pen portrait are: 1) understand and define what to focus on 2) design a basic structure 3) populate the content 4) interpretation. Instructive commentary and guidance is given throughout with consistent reference to the original study for which Pen Portraits were devised. The Pen Portrait analytic process was developed by the authors, borne out of a need to effectively integrate multiple qualitative methods collected over time. Pen Portraits are intended to be adaptable and flexible, in order to meet the differing analytic needs of qualitative longitudinal health studies. The Pen Portrait analytic process provides a useful framework to enable researchers to conduct a robust analysis of multiple sources of qualitative data collected over time.
22 September 2018 in Health Expectations
Context: Collecting feedback from patients about their experiences of health care is an important activity. However, improvement based on this feedback rarely materializes. In this study, we focus on answering the question—“what is impeding the use of patient experience feedback?”Methods: We conducted a qualitative study in 2016 across three NHS hospital Trusts in the North of England. Focus groups were undertaken with ward‐based staff, and hospital managers were interviewed in‐depth (50 participants). We conducted a conceptual‐level analysis.Findings: On a macro level, we found that the intense focus on the collection of patient experience feedback has developed into its own self‐perpetuating industry with a significant allocation of resource, effort and time being expended on this task. This is often at the expense of pan‐organizational learning or improvements being made. On a micro level, ward staff struggled to interact with feedback due to its complexity with questions raised about the value, validity and timeliness of data sources.Conclusions: Macro and micro prohibiting factors come together in a perfect storm which provides a substantial impediment to improvements being made. Recommendations for policy change are put forward alongside recognition that high‐level organizational culture/systems are currently too sluggish to allow fruitful learning and action to occur from the feedback that patients give.
23 April 2019 in Health Expectations
Background & objectives: The comparative uses of different types of patient experience (PE) feedback as data within quality improvement (QI) are poorly understood. This paper reviews what types are currently available and categorizes them by their characteristics in order to better understand their roles in QI.Methods: A scoping review of types of feedback currently available to hospital staff in the UK was undertaken. This comprised academic database searches for “measures of PE outcomes” (2000‐2016), and grey literature and websites for all types of “PE feedback” potentially available (2005‐2016). Through an iterative consensus process, we developed a list of characteristics and used this to present categories of similar types.Main results: The scoping review returned 37 feedback types. A list of 12 characteristics was developed and applied, enabling identification of 4 categories that help understand potential use within QI—(1) Hospital‐initiated (validated) quantitative surveys: for example the NHS Adult Inpatient Survey; (2) Patient‐initiated qualitative feedback: for example complaints or twitter comments; (3) Hospital‐initiated qualitative feedback: for example Experience Based Co‐Design; (4) Other: for example Friends & Family Test. Of those routinely collected, few elicit “ready‐to‐use” data and those that do elicit data most suitable for measuring accountability, not for informing ward‐based improvement. Guidance does exist for linking collection of feedback to QI for some feedback types in Category 3 but these types are not routinely used.Conclusion: If feedback is to be used more frequently within QI, more attention must be paid to obtaining and making available the most appropriate types.
1 October 2019 in Health Services and Delivery Research
Background: Patients are increasingly being asked to provide feedback about their experience of health-care services. Within the NHS, a significant level of resource is now allocated to the collection of this feedback. However, it is not well understood whether or not, or how, health-care staff are able to use these data to make improvements to future care delivery. Objective: To understand and enhance how hospital staff learn from and act on patient experience (PE) feedback in order to co-design, test, refine and evaluate a Patient Experience Toolkit (PET). Design: A predominantly qualitative study with four interlinking work packages. Setting: Three NHS trusts in the north of England, focusing on six ward-based clinical teams (two at each trust). Methods: A scoping review and qualitative exploratory study were conducted between November 2015 and August 2016. The findings of this work fed into a participatory co-design process with ward staff and patient representatives, which led to the production of the PET. This was primarily based on activities undertaken in three workshops (over the winter of 2016/17). Then, the facilitated use of the PET took place across the six wards over a 12-month period (February 2017 to February 2018). This involved testing and refinement through an action research (AR) methodology. A large, mixed-methods, independent process evaluation was conducted over the same 12-month period. Findings: The testing and refinement of the PET during the AR phase, with the mixed-methods evaluation running alongside it, produced noteworthy findings. The idea that current PE data can be effectively triangulated for the purpose of improvement is largely a fallacy. Rather, additional but more relational feedback had to be collected by patient representatives, an unanticipated element of the study, to provide health-care staff with data that they could work with more easily. Multidisciplinary involvement in PE initiatives is difficult to establish unless teams already work in this way. Regardless, there is merit in involving different levels of the nursing hierarchy. Consideration of patient feedback by health-care staff can be an emotive process that may be difficult initially and that needs dedicated time and sensitive management. The six ward teams engaged variably with the AR process over a 12-month period. Some teams implemented far-reaching plans, whereas other teams focused on time-minimising ‘quick wins’. The evaluation found that facilitation of the toolkit was central to its implementation. The most important factors here were the development of relationships between people and the facilitator’s ability to navigate organisational complexity. Limitations: The settings in which the PET was tested were extremely diverse, so the influence of variable context limits hard conclusions about its success. Conclusions: The current manner in which PE feedback is collected and used is generally not fit for the purpose of enabling health-care staff to make meaningful local improvements. The PET was co-designed with health-care staff and patient representatives but it requires skilled facilitation to achieve successful outcomes. Funding: The National Institute for Health Research Health Services and Delivery Research programme.
28 November 2016 in BMC Health Services Research
There is growing interest in the role of patients in improving patient safety. One such role is providing feedback on the safety of their care. Here we describe the development and feasibility testing of an intervention that collects patient feedback on patient safety, brings together staff to consider this feedback and to plan improvement strategies. We address two research questions: i) to explore the feasibility of the process of systematically collecting feedback from patients about the safety of care as part of the PRASE intervention; and, ii) to explore the feasibility and acceptability of the PRASE intervention for staff, and to understand more about how staff use the patient feedback for service improvement. We conducted a feasibility study using a wait-list controlled design across six wards within an acute teaching hospital. Intervention wards were asked to participate in two cycles of the PRASE (Patient Reporting & Action for a Safe Environment) intervention across a six-month period. Participants were patients on participating wards. To explore the acceptability of the intervention for staff, observations of action planning meetings, interviews with a lead person for the intervention on each ward and recorded researcher reflections were analysed thematically and synthesised. Recruitment of patients using computer tablets at their bedside was straightforward, with the majority of patients willing and able to provide feedback. Randomisation of the intervention was acceptable to staff, with no evidence of differential response rates between intervention and control groups. In general, ward staff were positive about the use of patient feedback for service improvement and were able to use the feedback as a basis for action planning, although engagement with the process was variable. Gathering a multidisciplinary team together for action planning was found to be challenging, and implementing action plans was sometimes hindered by the need to co-ordinate action across multiple services. The PRASE intervention was found to be acceptable to staff and patients. However, before proceeding to a full cluster randomised controlled trial, the intervention requires adaptation to account for the difficulties in implementing action plans within three months, the need for a facilitator to support the action planning meetings, and the provision of training and senior management support for participating ward teams. The PRASE intervention represents a promising method for the systematic collection of patient feedback about the safety of hospital care.