28 November 2005 in Health and Quality of Life Outcomes
Background: The Health of the Nation Outcome Scales was developed to routinely measure outcomes for adults with mental illness. Comparable instruments were also developed for children and adolescents (the Health of the Nation Outcome Scales for Children and Adolescents) and older people (the Health of the Nation Outcome Scales 65+). All three are being widely used as outcome measures in the United Kingdom, Australia and New Zealand. There is, however, no comprehensive review of these instruments. This paper fills this gap by reviewing the psychometric properties of each. Method: Articles and reports relating to the instruments were retrieved, and their findings synthesised to assess the instruments' validity (content, construct, concurrent, predictive), reliability (test-retest, inter-rater), sensitivity to change, and feasibility/utility. Results: Mostly, the instruments perform adequately or better on most dimensions, although some of their psychometric properties warrant closer examination. Conclusion: Collectively, the Health of the Nation Outcome Scales family of measures can assess outcomes for different groups on a range of mental health-related constructs, and can be regarded as appropriate for routinely monitoring outcomes.
6 December 2013 in Australian Health Review
Objective: To estimate the percentage of Australians with a mental disorder who received treatment for that disorder each year between 2006–07 and 2009–10. Methods: We used: (1) epidemiological survey data to estimate the number of Australians with a mental disorder in any year; (2) a combination of administrative data on people receiving mental health care from the Commonwealth and State and Territories and epidemiological data to estimate the number receiving treatment; and (3) uncertainty modelling to estimate the effects of sampling error and assumptions on these estimates. Results: The estimated population treatment rate for mental disorders in Australia increased from 37% in 2006–07 to 46% in 2009–10. The model estimate for 2006–07 (37%) was very similar to the estimated treatment rate in the 2007 National Survey of Mental Health and Wellbeing (35%), the only data available for external comparison. The uncertainty modelling suggested that the increased treatment rates over subsequent years could not be explained by sampling error or uncertainty in assumptions. Conclusions: The introduction of the Commonwealth’s Better Access initiative in November 2006 has been the driver for the increased the proportion of Australians with mental disorders who received treatment for those disorders over the period from 2006–07 to 2009–10. What is known about the topic?: Untreated mental disorders incur major economic costs and personal suffering. Governments need timely estimates of treatment rates to assess the effects of policy changes aimed at improving access to mental health services. What does this paper add?: Drawing upon a combination of epidemiological and administrative data sources, the present study estimated that the population treatment rate for mental disorders in Australia increased significantly from 37% in 2006–07 to 46% in 2009–10. What are the implications for practitioners?: Increased access to services is not sufficient to ensure good outcomes for those with mental disorders. It is also important to ensure that evidence-based treatment is provided to those Australians accessing these services.
1 April 2011 in Australian & New Zealand Journal of Psychiatry
Object: The concept of recovery has been recognized as important in the treatment of mental illness. A number of specific instruments exist which are designed to: (i) measure recovery at an individual level; and (ii) assess the recovery orientation of services. The current review aimed to identify these and evaluate their potential for routine use in Australian public sector mental health services. Method: We identified potential instruments by drawing on existing reviews, searching MEDLINE and PsycINFO, and consulting with experts. We used a hierarchical criterion-based approach to assess whether given instruments might be candidates for measuring recovery in the Australian context. Results: We identified 33 instruments: 22 designed to measure individuals’ recovery and 11 designed to assess the recovery orientation of services (or providers). Four of the former (Recovery Assessment Scale; Illness Management and Recovery Scales; Stages of Recovery Instrument; Recovery Process Inventory) and four of the latter (Recovery Oriented Systems Indicators Measure; Recovery Self Assessment; Recovery Oriented Practices Index; Recovery Promotion Fidelity Scale) were identified as promising candidates for routine use in Australian public sector mental health services. Conclusions: Further work is required, however, to determine which, if any, might best be used for this purpose; the possibility that modifications to existing instruments or the development of new instruments might be required should not be ruled out. It might be desirable to invest in two instruments: one designed to measure individuals’ recovery and one designed to measure the recovery orientation of services. If Australia were to go down this path, it would make sense to align indicators in each as far as possible, and to ensure that they were consistent with existing endeavours aimed at monitoring and improving recovery-focused aspects of service quality.
19 April 2005 in Australia and New Zealand Health Policy
Objective: This paper describes the Australian experience to date with a national 'roll out' of routine outcome measurement in public sector mental health services. Methods: Consultations were held with 123 stakeholders representing a range of roles. Results: Australia has made an impressive start to nationally implementing routine outcome measurement in mental health services, although it still has a long way to go. All States/Territories have established data collection systems, although some are more streamlined than others. Significant numbers of clinicians and managers have been trained in the use of routine outcome measures, and thought is now being given to ongoing training strategies. Outcome measurement is now occurring 'on the ground'; all States/Territories will be reporting data for 2003–04, and a number have been doing so for several years. Having said this, there is considerable variability regarding data coverage, completeness and compliance. Some States/Territories have gone to considerable lengths to 'embed' outcome measurement in day-to-day practice. To date, reporting of outcome data has largely been limited to reports profiling individual consumers and/or aggregate reports that focus on compliance and data quality issues, although a few States/Territories have begun to turn their attention to producing aggregate reports of consumers by clinician, team or service. Conclusion: Routine outcome measurement is possible if it is supported by a co-ordinated, strategic approach and strong leadership, and there is commitment from clinicians and managers. The Australian experience can provide lessons for other countries.
1 January 2009 in Australasian Psychiatry
Objective: The aim of this paper was to improve understanding of what ‘clinical significance’ means in relation to the Health of the Nation Outcome Scales (HoNOS) and its older persons and child/adolescent equivalents (the HoNOS65+ and HoNOSCA). Method: An anonymous, web-based survey was completed by 94 outcome measurement experts, most of whom had clinical responsibilities. Respondents were asked to indicate for acute inpatient and ambulatory settings: the rating on each item which represented a clinically significant problem; the relative importance of each item in determining overall clinical severity; and the items which would not be expected to improve between admission and review, admission and discharge, review and review, and review and discharge. Results: A score of 2 (‘mild problem but definitely present’) on each HoNOS/HoNOS65+/HoNOSCA item resonates with experts as being evidence of a clinically significant problem that requires active monitoring or intervention. In the main, all items on these instruments are viewed as equally important in making an overall judgement of clinical severity. The items making up the impairment and, to a lesser extent, social subscales are least likely to demonstrate change during the course of an episode of care, according to expert opinion. Generally, these findings apply across instruments and service settings. Conclusions: Overall, the findings provide support for the content validity and clinical utility of the HoNOS/HoNOS65+/HoNOSCA. Further exploration of the question of clinical significance as reflected in these instruments could take a number of forms.