New patient reported outcome (PRO) measures are regularly developed to assess various aspects of the patients’ perspective on their disease and treatment. For these instruments to be useful in clinical research, they must undergo a proper psychometric validation, including demonstration of cross-sectional and longitudinal measurement properties. This quantitative evaluation requires a study to be conducted on an appropriate sample size. The aim of this research was to list and describe practices in PRO and proxy PRO primary psychometric validation studies, focusing primarily on the practices used to determine sample size. A literature review of articles published in PubMed between January 2009 and September 2011 was conducted. Three selection criteria were applied including a search strategy, an article selection strategy, and data extraction. Agreements between authors were assessed, and practices of validation were described. Data were extracted from 114 relevant articles. Within these, sample size determination was low (9.6%, 11/114), and were reported as either an arbitrary minimum sample size (n = 2), a subject to item ratio (n = 4), or the method was not explicitly stated (n = 5). Very few articles (4%, 5/114) compared a posteriori their sample size to a subject to item ratio. Content validity, construct validity, criterion validity and internal consistency were the most frequently measurement properties assessed in the validation studies. Approximately 92% of the articles reported a subject to item ratio greater than or equal to 2, whereas 25% had a ratio greater than or equal to 20. About 90% of articles had a sample size greater than or equal to 100, whereas 7% had a sample size greater than or equal to 1000. The sample size determination for psychometric validation studies is rarely ever justified a priori. This emphasizes the lack of clear scientifically sound recommendations on this topic. Existing methods to determine the sample size needed to assess the various measurement properties of interest should be made more easily available.
Background: The objective was to solve two problems of an already validated scale measuring inpatient opinion on care: 1) a high non-response rate for some items due to the "not applicable" response option and 2) a skewed score distribution with high ceiling effect. Methods: The EQS-H scale ("échelle de qualité des soins en hospitalisation") comprised 26 items and 2 sub-scales of 13 items each, 'quality of medical information' (MI) and 'relationships with staff and daily routine' (RS). Three studies were conducted: a first mono-centre study (n = 552, response rate = 83.4%, self-completion of the scale the day before discharge) to construct a shorter version of the scale without the items with high non-response rate and maintaining those useful to ensure good internal validity (construct, convergent and divergent) and reliability; a second mono-centre study (n = 1246, response rate = 77.9%, self-completion of the scale before discharge) to confirm psychometric properties of the new version; a third multi-centre national study (n = 886, response rate 41.7%, self-completion at home 15 days after discharge) to test a new response pattern in order to reduce ceiling effect. Results: Six items having a non-response rate >20% were deleted, increasing rates of exhaustive response to all items from 15% to 48%. Factorial analysis supported the evidence for removing 4 more items to ensure good internal validity and reliability of the new version. These good results (initial variance explained: 43%; Cronbach's α: 0.80 (MI) and 0.81 (RS)) were confirmed by the second study. The new response format produced a normalisation of the 2 scores with a large decrease in ceiling effect (25% to 4% for MI subscale and 61% to 8% for RS). Psychometric properties of the final version were excellent: the 2 subscales (8 items each) explained 66% of the variance in principal component analysis, Cronbach's α were respectively 0.92 (MI) and 0.93 (RS). Conclusion: The new version of the EQS-H has better psychometric properties than the previous one. Rates of missing values are lower, and score distribution is normalized. An English version of this scale focused on quality of medical information delivered and on relationship with staff already exists, and this could be useful to conduct cross-cultural studies of health care service quality.
1 November 2004 in American Journal of Infection Control
The concept of shared decision making (SDM) has been developing in many countries since the 1990s. The main challenge of SDM, based on the principles of respect for the person’s autonomy, is to improve patients’ participation, should they so wish, in decisions concerning their personal health. To our knowledge, there is only one SDM evaluation tool validated in metropolitan French that does not measure the entire SDM construct. The aim of this review was to identify existing and validated SDM measurement tools to determine which of them could be adapted in French to cover all the dimensions of SDM. A systematic literature review was conducted based on articles found in the PubMed and PsycINFO bibliographic databases and published between 2010 and 2014. Studies were included if the main goal of the article was the development and psychometric validation of an SDM measurement tool, not specific to any given disease or situation, in English, French and Spanish. We used the nine essential elements of the Makoul and Clayman’s integrative model to describe the different existing tools. Nineteen studies were included. Seven new tools had been published since Scholl’s previous review in 2011. We observed a recent spread of the multi-appraiser approach, which combines points of view of patients, healthcare professionals and sometimes external observers. Several models were used for the development of the seven newly identified tools. None of the identified tools assessed the nine elements of the Makoul’s model. Three of these elements, however, were systematically measured in each of the new tools: “defining/explaining the problem”, “patient values/preferences”, and “checking/clarifying understanding”. We identified several potentially interesting tools for the French context which could cover the whole elements of Makoul’s model. The next step will be the development of a French-language instrument based on these tools.
1 January 2008 in Patient Education and Counseling
Patient age is the main socio-demographic factor influencing patient satisfaction with care but the nature of the relationship between age and patient satisfaction is controversial. This study aims to clarify whether the association of age with satisfaction is linear or shows some other configuration. Data were obtained from two different satisfaction studies conducted in 27 short-stay teaching hospitals. Study 1 included 1547 inpatients, who completed the EQS-H questionnaire at the time of discharge. Study 2 included 7624 inpatients interviewed by phone at home after discharge, who answered the SAPHORA questionnaire. On the basis of the results of the exploratory analysis, three models for adjustment of age on satisfaction were compared: a simple linear model, a five-group step function and a linear model with a change in slope. The most suitable model for adjusting patient age to satisfaction scores for quality of medical and nursing care, whether for the EQS-H or the SAPHORA scale, was not a linear relationship: patient age was linearly and positively correlated to satisfaction before 65 years and negatively thereafter. Adjustment of patient age to accommodation and premises satisfaction scores proved to be different, closer to a linear relationship. These results suggest considering the patient age variable as a non-linear factor for adjusting satisfaction scores, in particular in relation to care. Further studies are needed to confirm the evidence of a threshold around 65 years beyond which satisfaction scores for the quality of medical and nursing care decrease.