Health literacy has become an increasingly important concept in public health. We sought to develop a comprehensive measure of health literacy capable of diagnosing health literacy needs across individuals and organisations by utilizing perspectives from the general population, patients, practitioners and policymakers. Using a validity-driven approach we undertook grounded consultations (workshops and interviews) to identify broad conceptually distinct domains. Questionnaire items were developed directly from the consultation data following a strict process aiming to capture the full range of experiences of people currently engaged in healthcare through to people in the general population. Psychometric analyses included confirmatory factor analysis (CFA) and item response theory. Cognitive interviews were used to ensure questions were understood as intended. Items were initially tested in a calibration sample from community health, home care and hospital settings (N=634) and then in a replication sample (N=405) comprising recent emergency department attendees. Initially 91 items were generated across 6 scales with agree/disagree response options and 5 scales with difficulty in undertaking tasks response options. Cognitive testing revealed that most items were well understood and only some minor re-wording was required. Psychometric testing of the calibration sample identified 34 poorly performing or conceptually redundant items and they were removed resulting in 10 scales. These were then tested in a replication sample and refined to yield 9 final scales comprising 44 items. A 9-factor CFA model was fitted to these items with no cross-loadings or correlated residuals allowed. Given the very restricted nature of the model, the fit was quite satisfactory: χ 2 WLSMV(866 d.f.) = 2927, p<0.000, CFI = 0.936, TLI = 0.930, RMSEA = 0.076, and WRMR = 1.698. Final scales included: Feeling understood and supported by healthcare providers; Having sufficient information to manage my health; Actively managing my health; Social support for health; Appraisal of health information; Ability to actively engage with healthcare providers; Navigating the healthcare system; Ability to find good health information; and Understand health information well enough to know what to do. The HLQ covers 9 conceptually distinct areas of health literacy to assess the needs and challenges of a wide range of people and organisations. Given the validity-driven approach, the HLQ is likely to be useful in surveys, intervention evaluation, and studies of the needs and capabilities of individuals.

Recent advances in the measurement of health literacy allow description of a broad range of personal and social dimensions of the concept. Identifying differences in patterns of health literacy between population sub-groups will increase understanding of how health literacy contributes to health inequities and inform intervention development. The aim of this study was to use a multi-dimensional measurement tool to describe the health literacy of adults in urban and rural Victoria, Australia. Data were collected from clients (n = 813) of 8 health and community care organisations, using the Health Literacy Questionnaire (HLQ). Demographic and health service data were also collected. Data were analysed using descriptive statistics. Effect sizes (ES) for standardised differences in means were used to describe the magnitude of difference between demographic sub-groups. Mean age of respondents was 72.1 (range 19–99) years. Females comprised 63 % of the sample, 48 % had not completed secondary education, and 96 % reported at least one existing health condition. Small to large ES were seen for mean differences in HLQ scales between most demographic groups. Compared with participants who spoke English at home, those not speaking English at home had much lower scores for most HLQ scales including the scales ‘Understanding health information well enough to know what to do’ (ES −1.09 [95 % confidence interval (CI) -1.33 to −0.84]), ‘Ability to actively engage with healthcare providers’ (ES −1.00 [95 % CI −1.24, −0.75]), and ‘Navigating the healthcare system’ (ES −0.72 [95 % CI −0.97, −0.48]). Similar patterns and ES were seen for participants born overseas compared with those born in Australia. Smaller ES were seen for sex, age group, private health insurance status, number of chronic conditions, and living alone. This study has revealed some large health literacy differences across nine domains of health literacy in adults using health services in Victoria. These findings provide insights into the relationship between health literacy and socioeconomic position in vulnerable groups and, given the focus of the HLQ, provide guidance for the development of equitable interventions.

Background Data from subjective patient-reported outcome measures (PROMs) are now being used in the health sector to make or support decisions about individuals, groups and populations. Contemporary validity theorists define validity not as a statistical property of the test but as the extent to which empirical evidence supports the interpretation of test scores for an intended use. However, validity testing theory and methodology are rarely evident in the PROM validation literature. Application of this theory and methodology would provide structure for comprehensive validation planning to support improved PROM development and sound arguments for the validity of PROM score interpretation and use in each new context. Objective This paper proposes the application of contemporary validity theory and methodology to PROM validity testing. Illustrative example The validity testing principles will be applied to a hypothetical case study with a focus on the interpretation and use of scores from a translated PROM that measures health literacy (the Health Literacy Questionnaire or HLQ). Discussion Although robust psychometric properties of a PROM are a pre-condition to its use, a PROM’s validity lies in the sound argument that a network of empirical evidence supports the intended interpretation and use of PROM scores for decision making in a particular context. The health sector is yet to apply contemporary theory and methodology to PROM development and validation. The theoretical and methodological processes in this paper are offered as an advancement of the theory and practice of PROM validity testing in the health sector.

The Health Literacy Questionnaire (HLQ) has nine scales that each measure an aspect of the multidimensional construct of health literacy. All scales have good psychometric properties. However, it is the interpretations of data within contexts that must be proven valid, not just the psychometric properties of a measurement instrument. The purpose of this study was to establish the extent of concordance and discordance between individual patient and clinician interpretations of HLQ data in the context of complex case management. Sixteen patients with complex needs completed the HLQ and were interviewed to discuss the reasons for their answers. Also, the clinicians of each of these patients completed the HLQ about their patient, and were interviewed to discuss the reasons for their answers. Thematic analysis of HLQ scores and interview data determined the extent of concordance between patient and clinician HLQ responses, and the reasons for discordance. Highest concordance (80%) between patient and clinician item-response pairs was seen in Scale 1 and highest discordance (56%) was seen in Scale 6. Four themes were identified to explain discordance: 1) Technical or literal meaning of specific words; 2) Patients’ changing or evolving circumstances; 3) Different expectations and criteria for assigning HLQ scores; and 4) Different perspectives about a patient’s reliance on healthcare providers. This study shows that the HLQ can act as an adjunct to clinical practice to help clinicians understand a patient’s health literacy challenges and strengths early in a clinical encounter. Importantly, clinicians can use the HLQ to detect differences between their own perspectives about a patient’s health literacy and the patient’s perspective, and to initiate discussion to explore this. Provision of training to better detect these differences may assist clinicians to provide improved care. The outcomes of this study contribute to the growing body of international validation evidence about the use of the HLQ in different contexts. More specifically, this study has shown that the HLQ has measurement veracity at the patient and clinician level and may support clinicians to understand patients’ health literacy and enable a deeper engagement with healthcare services.

Background: Cross-cultural research with patient-reported outcomes measures (PROMs) assumes that the PROM in the target language will measure the same construct in the same way as the PROM in the source language. Yet translation methods are rarely used to qualitatively maximise construct equivalence or to describe the intents of each item to support common understanding within translation teams. This study aimed to systematically investigate the utility of the Translation Integrity Procedure (TIP), in particular the use of item intent descriptions, to maximise construct equivalence during the translation process, and to demonstrate how documented data from the TIP contributes evidence to a validity argument for construct equivalence between translated and source language PROMs. Methods: Analysis of secondary data was conducted on routinely collected data in TIP Management Grids of translations (n = 9) of the Health Literacy Questionnaire (HLQ) that took place between August 2014 and August 2015: Arabic, Czech, French (Canada), French (France), Hindi, Indonesian, Slovak, Somali and Spanish (Argentina). Two researchers initially independently deductively coded the data to nine common types of translation errors. Round two of coding included an identified 10th code. Coded data were compared for discrepancies, and checked when needed with a third researcher for final code allocation. Results: Across the nine translations, 259 changes were made to provisional forward translations and were coded into 10 types of errors. Most frequently coded errors were Complex word or phrase (n = 99), Semantic (n = 54) and Grammar (n = 27). Errors coded least frequently were Cultural errors (n = 7) and Printed errors (n = 5). Conclusions: To advance PROM validation practice, this study investigated a documented translation method that includes the careful specification of descriptions of item intents. Assumptions that translated PROMs have construct equivalence between linguistic contexts can be incorrect due to errors in translation. Of particular concern was the use of high level complex words by translators, which, if undetected, could cause flawed interpretation of data from people with low literacy. Item intent descriptions can support translations to maximise construct equivalence, and documented translation data can contribute evidence to justify score interpretation and use of translated PROMS in new linguistic contexts.

Background: Web-based personal health records (PHRs) have the potential to improve the quality, accuracy, and timeliness of health care. However, the international uptake of web-based PHRs has been slow. Populations experiencing disadvantages are less likely to use web-based PHRs, potentially widening health inequities within and among countries. Objective: With limited understanding of the predictors of community uptake and use of web-based PHR, the aim of this study was to identify the predictors of awareness, engagement, and use of the Australian national web-based PHR, My Health Record (MyHR). Methods: A population-based survey of adult participants residing in regional Victoria, Australia, was conducted in 2018 using telephone interviews. Logistic regression, adjusted for age, was used to assess the relationship among digital health literacy, health literacy, and demographic characteristics, and the 3 dependent variables of MyHR: awareness, engagement, and use. Digital health literacy and health literacy were measured using multidimensional tools, using all 7 scales of the eHealth Literacy Questionnaire and 4 out of the 9 scales of the Health Literacy Questionnaire. Results: A total of 998 responses were analyzed. Many elements of digital health literacy were strongly associated with MyHR awareness, engagement, and use. A 1-unit increase in each of the 7 eHealth Literacy Questionnaire scales was associated with a 2- to 4-fold increase in the odds of using MyHR: using technology to process health information (odds ratio [OR] 4.14, 95% CI 2.34-7.31), understanding of health concepts and language (OR 2.25, 95% CI 1.08-4.69), ability to actively engage with digital services (OR 4.44, 95% CI 2.55-7.75), feel safe and in control (OR 2.36, 95% CI 1.43-3.88), motivated to engage with digital services (OR 4.24, 95% CI 2.36-7.61), access to digital services that work (OR 2.49, 95% CI 1.32-4.69), and digital services that suit individual needs (OR 3.48, 95% CI 1.97-6.15). The Health Literacy Questionnaire scales of health care support, actively managing health, and social support were also associated with a 1- to 2-fold increase in the odds of using MyHR. Using the internet to search for health information was another strong predictor; however, older people and those with less education were less likely to use MyHR. Conclusions: This study revealed strong and consistent patterns of association between digital health literacy and the use of a web-based PHR. The results indicate potential actions for promoting PHR uptake, including improving digital technology and skill experiences that may improve digital health literacy and willingness to engage in web-based PHR. Uptake may also be improved through more responsive digital services, strengthened health care, and better social support. A holistic approach, including targeted solutions, is needed to ensure that web-based PHR can realize its full potential to help reduce health inequities.