Vignette-based methodologies are frequently used to examine judgments and decision-making processes, including clinical judgments made by health professionals. Concerns are sometimes raised that vignettes do not accurately reflect "real world" phenomena, and that this affects the validity of results and conclusions of these studies. This article provides an overview of the defining features, design variations, strengths, and weaknesses of vignette studies as a way of examining how health professionals form clinical judgments (e.g., assigning diagnoses, selecting treatments). As a "hybrid" of traditional survey and experimental methods, vignette studies can offer aspects of both the high internal validity of experiments and the high external validity of survey research in order to disentangle multiple predictors of clinician behavior. When vignette studies are well designed to test specific questions about judgments and decision-making, they can be highly generalizable to "real life" behavior, while overcoming the ethical, practical, and scientific limitations associated with alternative methods (e.g., observation, self-report, standardized patients, archival analysis). We conclude with methodological recommendations and a description of how vignette methodologies are being used to investigate clinicians' diagnostic decisions in case-controlled field studies for the ICD-11 classification of mental and behavioural disorders, and how these studies illustrate the preceding concepts and recommendations.
This study examined psychologists' views and practices regarding diagnostic classification systems for mental and behavioral disorders so as to inform the development of the ICD‐11 by the World Health Organization (WHO). WHO and the International Union of Psychological Science (IUPsyS) conducted a multilingual survey of 2155 psychologists from 23 countries, recruited through their national psychological associations. Sixty percent of global psychologists routinely used a formal classification system, with ICD‐10 used most frequently by 51% and DSM‐IV by 44%. Psychologists viewed informing treatment decisions and facilitating communication as the most important purposes of classification, and preferred flexible diagnostic guidelines to strict criteria. Clinicians favorably evaluated most diagnostic categories, but identified a number of problematic diagnoses. Substantial percentages reported problems with crosscultural applicability and cultural bias, especially among psychologists outside the USA and Europe. Findings underscore the priority of clinical utility and professional and cultural differences in international psychology. Implications for ICD‐11 development and dissemination are discussed.
The World Health Organization (WHO) Department of Mental Health and Substance Abuse has developed a systematic program of field studies to evaluate and improve the clinical utility of the proposed diagnostic guidelines for mental and behavioral disorders in the Eleventh Revision of the International Classification of Diseases and Related Health Problems (ICD-11). The clinical utility of a diagnostic classification is critical to its function as the interface between health encounters and health information, and to making the ICD-11 be a more effective tool for helping the WHO's 194 member countries, including the United States, reduce the global disease burden of mental disorders. This article describes the WHO's efforts to develop a science of clinical utility in regard to one of the two major classification systems for mental disorders. We present the rationale and methodologies for an integrated and complementary set of field study strategies, including large international surveys, formative field studies of the structure of clinicians' conceptualization of mental disorders, case-controlled field studies using experimental methodologies to evaluate the impact of proposed changes to the diagnostic guidelines on clinicians' diagnostic decision making, and ecological implementation field studies of clinical utility in the global settings in which the guidelines will ultimately be implemented. The results of these studies have already been used in making decisions about the structure and content of ICD-11. If clinical utility is indeed among the highest aims of diagnostic systems for mental disorders, as their developers routinely claim, future revision efforts should continue to build on these efforts. (PsycINFO Database Record
The World Health Organization (WHO) International Classification of Diseases and Related Health Problems (ICD) is used globally by 194 WHO member nations. It is used for assigning clinical diagnoses, providing the framework for reporting public health data, and to inform the organization and reimbursement of health services. Guided by overarching principles of increasing clinical utility and global applicability, the 11th revision of the ICD proposes major changes that incorporate empirical advances since the previous revision in 1992. To test recommended changes in the Mental, Behavioral, and Neurodevelopmental Disorders chapter, multiple vignette-based case-controlled field studies have been conducted which examine clinicians’ ability to accurately and consistently use the new guidelines and assess their overall clinical utility. This manuscript reports on the results from the study of the proposed ICD-11 guidelines for feeding and eating disorders (FEDs). Participants were 2288 mental health professionals registered with WHO’s Global Clinical Practice Network. The study was conducted in Chinese, English, French, Japanese, and Spanish. Clinicians were randomly assigned to apply either the ICD-11 or ICD-10 diagnostic guidelines for FEDs to a pair of case vignettes designed to test specific clinical questions. Clinicians selected the diagnosis they thought was correct for each vignette, evaluated the presence of each essential feature of the selected diagnosis, and the clinical utility of the diagnostic guidelines. The proposed ICD-11 diagnostic guidelines significantly improved accuracy for all FEDs tested relative to ICD-10 and attained higher clinical utility ratings; similar results were obtained across all five languages. The inclusion of binge eating disorder and avoidant-restrictive food intake disorder reduced the use of residual diagnoses. Areas needing further refinement were identified. The proposed ICD-11 diagnostic guidelines consistently outperformed ICD-10 in distinguishing cases of eating disorders and showed global applicability and appropriate clinical utility. These results suggest that the proposed ICD-11 guidelines for FEDs will help increase accuracy of public health data, improve clinical diagnosis, and enhance health service organization and provision. This is the first time in the revision of the ICD that data from large-scale, empirical research examining proposed guidelines is completed in time to inform the final diagnostic guidelines.
1 May 2016 in International Journal of Clinical and Health Psychology
As part of the development of the Eleventh Revision of International Classification of Diseases and Related Health Problems (ICD-11), the World Health Organization Department of Mental Health and Substance Abuse is conducting a series of case-controlled field studies using a new and powerful method to test the application by clinicians of the proposed ICD-11 diagnostic guidelines for mental and behavioural disorders. This article describes the case-controlled field study for Disorders Specifically Associated with Stress. Using a vignette-based experimental methodology, 1,738 international mental health professionals diagnosed standardized cases designed to test key differences between the proposed diagnostic guidelines for ICD-11 and corresponding guidelines for ICD-10. Across eight comparisons, several proposed changes for ICD-11, including the addition of Complex PTSD and Prolonged Grief Disorder, produced significantly improved diagnostic decisions and clearer application of diagnostic guidelines compared to ICD-10. However, several key areas were also identified, such as the description of the diagnostic requirement of re-experiencing in PTSD, in which the guidelines were not consistently applied as intended. These results informed specific revisions to improve the clarity of the proposed ICD-11 diagnostic guidelines. The next step will be to further test these guidelines in clinic-based studies using real patients in relevant settings.