4 January 2023 in The Journal of Applied Laboratory Medicine
Background: Accurate reference intervals are essential for the interpretation of laboratory test results. Typically, they are determined by the central 95% range of test results from a predefined reference population. As these direct studies can face practical and ethical challenges, indirect methods using routine measurements offer an alternative approach.Methods: We provide step-by-step guidance on how to apply an indirect method in practice using refineR, the most recently published indirect method, and showcase the application by evaluating real-world data of 12 prespecified analytes. Measurements were retrieved from ARUP Laboratories’ data warehouse, and were obtained from routine patient testing on cobas c502 or e602 analyzers. Test results were prefiltered and cleaned and, if necessary, physiologically partitioned prior to estimating reference intervals using refineR. Estimated reference intervals were then compared to established intervals provided by the manufacturer.Results: For most analytes, the reference intervals estimated by refineR were comparable to those provided by the manufacturer, shown by overlapping confidence intervals at both reference limits, or only the upper or lower limit. For thyroid-stimulating hormone, refineR estimated higher reference limits, while estimates for prealbumin were lower compared to the established reference interval.Conclusions: We applied the refineR algorithm to a variety of real-world data sets resulting in reference intervals similar to intervals previously established by direct methods. We further provide practical guidance and a code example on how to apply an indirect method in a real-world scenario facilitating their access and thus their use in laboratory settings.
20 October 2022 in Clinical Chemistry
Background: Indirect methods leverage real-world data for the estimation of reference intervals. These constitute an active field of research, and several methods have been developed recently. So far, no standardized tool for evaluation and comparison of indirect methods exists.Methods: We provide RIbench, a benchmarking suite for quantitative evaluation of any existing or novel indirect method. The benchmark contains simulated test sets for 10 biomarkers mimicking routine measurements of a mixed distribution of non-pathological (reference) values and pathological values. The non-pathological distributions represent 4 common distribution types: normal, skewed, heavily skewed, and skewed-and-shifted. To identify strengths and weaknesses of indirect methods, test sets have varying sample sizes and pathological distributions differ in location, extent of overlap, and fraction. For performance evaluation, we use an overall benchmark score and sub-scores derived from absolute z-score deviations between estimated and true reference limits. We illustrate the application of RIbench by evaluating and comparing the Hoffmann method and 4 modern indirect methods –TML (Truncated-Maximum-Likelihood), kosmic, TMC (Truncated-Minimum-Chi-Square), and refineR– against one another and against a nonparametric direct method (n = 120).Results: For the modern indirect methods, pathological fraction and sample size had a strong influence on the results: With a pathological fraction up to 20% and a minimum sample size of 5000, most methods achieved results comparable or superior to the direct method.Conclusions: We present RIbench, an open-source R-package, for the systematic evaluation of existing and novel indirect methods. RIbench can serve as a tool for enhancement of indirect methods, improving the estimation of reference intervals.