Objectives To determine the extent to which practice level scores mask variation in individual performance between doctors within a practice. Design Analysis of postal survey of patients’ experience of face-to-face consultations with individual general practitioners in a stratified quota sample of primary care practices. Setting Twenty five English general practices, selected to include a range of practice scores on doctor-patient communication items in the English national GP Patient Survey. Participants 7721 of 15 172 patients (response rate 50.9%) who consulted with 105 general practitioners in 25 practices between October 2011 and June 2013. Main outcome measure Score on doctor-patient communication items from post-consultation surveys of patients for each participating general practitioner. The amount of variance in each of six outcomes that was attributable to the practices, to the doctors, and to the patients and other residual sources of variation was calculated using hierarchical linear models. Results After control for differences in patients’ age, sex, ethnicity, and health status, the proportion of variance in communication scores that was due to differences between doctors (6.4%) was considerably more than that due to practices (1.8%). The findings also suggest that higher performing practices usually contain only higher performing doctors. However, lower performing practices may contain doctors with a wide range of communication scores. Conclusions Aggregating patients’ ratings of doctors’ communication skills at practice level can mask considerable variation in the performance of individual doctors, particularly in lower performing practices. Practice level surveys may be better used to “screen” for concerns about performance that require an individual level survey. Higher scoring practices are unlikely to include lower scoring doctors. However, lower scoring practices require further investigation at the level of the individual doctor to distinguish higher and lower scoring general practitioners.
Background: Despite widespread adoption of patient feedback surveys in international health‐care systems, including the English NHS, evidence of a demonstrable impact of surveys on service improvement is sparse.Objective: To explore the views of primary care practice staff regarding the utility of patient experience surveys.Design: Qualitative focus groups.Setting and participants: Staff from 14 English general practices.Results: Whilst participants engaged with feedback from patient experience surveys, they routinely questioned its validity and reliability. Participants identified surveys as having a number of useful functions: for patients, as a potentially therapeutic way of getting their voice heard; for practice staff, as a way of identifying areas of improvement; and for GPs, as a source of evidence for professional development and appraisal. Areas of potential change stimulated by survey feedback included redesigning front‐line services, managing patient expectations and managing the performance of GPs. Despite this, practice staff struggled to identify and action changes based on survey feedback alone.Discussion: Whilst surveys may be used to endorse existing high‐quality service delivery, their use in informing changes in service delivery is more challenging for practice staff. Drawing on the Utility Index framework, we identified concerns relating to reliability and validity, cost and feasibility acceptability and educational impact, which combine to limit the utility of patient survey feedback.Conclusions: Feedback from patient experience surveys has great potential. However, without a specific and renewed focus on how to translate feedback into action, this potential will remain incompletely realized.
Young adulthood is an important transitional period during which there is a higher risk of individuals engaging in behaviours which could have a lasting impact on their health. Research has shown that young adults are the lowest responders to surveys about healthcare experiences and are also the least satisfied with the care they receive. However, the factors contributing to this reduced satisfaction are not clear. The focus of our research was to explore the needs and experiences of young adults around healthcare services with an aim of finding out possible reasons for lower satisfaction. Twenty young adults were interviewed at GP surgeries and at a local young adult advice agency, exploring their experiences and use of primary care services. Interviews were analysed using thematic analysis. The use of primary care services varied amongst the young adult interviewees. Many interviewees reported positive experiences; those who did not linked their negative experiences to difficulties in negotiating their care with the health care system, and reported issues with trust, and communication difficulties. Most of the interviewees were unaware of the use of patient surveys to inform healthcare planning and delivery and were not inclined to take part, mainly because of the length of surveys and lack of interest in the topic area. In order to effectively address the health needs of young adults, young adults need to be educated about their rights as patients, and how to most efficiently use primary care services. GPs should be alert to effective means of approaching and handling the healthcare needs of young adults. A flexible, varied approach is needed to gathering high quality data from this group in order to provide services with information on the changes necessary for making primary care services more accessible for young adults.
Lateral elbow tendinopathy (LET) is a common condition affecting adults. Although a lack of treatment consensus continues to prompt numerous effectiveness studies, there is a paucity of clear guidance on the choice of outcome measure. Our aim was to undertake a standardised evaluation of the available clinical rating systems that report patient-centred outcomes in LET. A systematic review of studies reporting the development, assessment of metric properties and/or use of instruments aiming to quantify LET-specific patient-centred outcome measures was conducted in MEDLINE, Embase and CINAHL (inception-2017) adhering to PRISMA guidance. The evidence for each instrument was independently assessed by two reviewers using the standardised evaluating measures of patient-reported outcomes (EMPRO) method evaluating overall and attribute-specific instrument performance (metric properties and usability). EMPRO scores > 50/100 were considered indicative of high performance. Out of 7261 references, we identified 105 articles reporting on 15 instruments for EMPRO analysis. Median performance score was 41.6 (range 21.6–72.5), with four instruments meeting high-performance criteria: quick Disabilities of the Arm Shoulder and Hand score (qDASH) (72.5), DASH (66.9), Oxford Elbow Score (OES) (66.6) and Patient-Rated Tennis Elbow Evaluation (PRTEE) (57.0). One hundred seventy-nine articles reported instrument use internationally with DASH as the most frequent (29.7% articles) followed by PRTEE (25.6%), MEPS (15.1%) and qDASH (8.1%). The correlation between frequency of use and performance was r = 0.35 (95%CI − 0.11; 0.83). This is the first study to provide standardised guidance on the choice of measures for LET. A large number of clinical rating systems are both available and being used for patients with LETs. Robust evidence is available for four measures, the DASH, QDASH, PRTEE and OES. The use of instruments in the literature is only in part explained by instrument performance.
12 September 2016 in British Journal of General Practice
Background In recent years, hospitals have made use of new technologies, such as real-time feedback, to collect patient experience information. This approach is currently rarely used in primary care settings, but may provide practices with a useful tool that enables them to take prompt, focused action to improve their services. Aim To identify the factors inhibiting and enabling the implementation of real-time feedback in general practices. Design and setting Qualitative study embedded within an exploratory trial (July 2014 to February 2015) of a real-time feedback intervention targeting patient experience in general practices in south-west England and Cambridgeshire. Method Semi-structured interviews (n = 22) and focus groups (n = 4, total of 28 attendees) with practice staff were audiorecorded, transcribed, and analysed thematically, using a framework based on constructs from normalisation process theory. Results Staff engagement with real-time feedback varied considerably, and staff made sense of real-time feedback by comparing it with more familiar feedback modalities. Effective within-team communication was associated with positive attitudes towards real-time feedback. Timing of requests for feedback was important in relation to patient engagement. Real-time feedback may offer potential as a means of informing practice development, perhaps as a component of a wider programme of capturing and responding to patients’ comments. Conclusion Successful implementation of real-time feedback requires effective communication across the practice team to engender thorough engagement. Feedback processes should be carefully introduced to fit with existing patient and practice routines. Future studies should consider making real-time feedback content relevant to specific practice needs, and support participation by all patient groups.