27 August 2021 in Journal of Virological Methods
The Elecsys® Anti-SARS-CoV-2 S immunoassay (Roche Diagnostics International Ltd, Rotkreuz, Switzerland) has been developed for the detection of antibodies to the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) spike (S) protein. We evaluated the assay performance using samples from seven sites in Germany, Austria, and Switzerland. For specificity and sensitivity analyses, 7880 presumed negative pre-pandemic samples and 827 SARS-CoV-2 PCR-confirmed single or sequential samples from 272 different patients were tested, respectively. The overall specificity and sensitivity (≥14 days post-PCR) for the Elecsys Anti-SARS-CoV-2 S immunoassay were 99.95% (95% confidence interval [CI]: 99.87–99.99; 7876/7880) and 97.92% (95% CI: 95.21–99.32; 235/240), respectively. The Elecsys Anti-SARS-CoV-2 S immunoassay had significantly higher specificity compared with the LIAISON® SARS-CoV-2 S1/S2 IgG (99.95% [2032/2033] vs 98.82% [2009/2033]), ADVIA Centaur® SARS-CoV-2 Total (100% [928/928] vs 86.96% [807/928]), ARCHITECT SARS-CoV-2 IgG (99.97% [2931/2932] vs 99.69% [2923/2932]), iFlash-SARS-CoV-2 IgM (100.00% [928/928] vs 99.57% [924/928]), and EUROIMMUN Anti-SARS-CoV-2 IgG (100.00% [903/903] vs 97.45% [880/903]) and IgA (100.00% [895/895] vs 95.75% [857/895]) assays. The Elecsys Anti-SARS-CoV-2 S immunoassay had significantly higher sensitivity (≥14 days post-PCR) compared with the ARCHITECT SARS-CoV-2 IgG (98.70% [76/77] vs 87.01% [67/77]), iFlash-SARS-CoV-2 IgG (100.00% [76/76] vs 93.42% [71/76]) and IgM (100.00% [76/76] vs 35.53% [27/76]), and EUROIMMUN Anti-SARS-CoV-2 IgG (98.26% [113/115] vs 93.91% [108/115]) assays. Therefore, the Elecsys Anti-SARS-CoV-2 S assay demonstrated a reliable performance across various sample populations for the detection of anti-S antibodies.
4 January 2023 in The Journal of Applied Laboratory Medicine
Background: Accurate reference intervals are essential for the interpretation of laboratory test results. Typically, they are determined by the central 95% range of test results from a predefined reference population. As these direct studies can face practical and ethical challenges, indirect methods using routine measurements offer an alternative approach.Methods: We provide step-by-step guidance on how to apply an indirect method in practice using refineR, the most recently published indirect method, and showcase the application by evaluating real-world data of 12 prespecified analytes. Measurements were retrieved from ARUP Laboratories’ data warehouse, and were obtained from routine patient testing on cobas c502 or e602 analyzers. Test results were prefiltered and cleaned and, if necessary, physiologically partitioned prior to estimating reference intervals using refineR. Estimated reference intervals were then compared to established intervals provided by the manufacturer.Results: For most analytes, the reference intervals estimated by refineR were comparable to those provided by the manufacturer, shown by overlapping confidence intervals at both reference limits, or only the upper or lower limit. For thyroid-stimulating hormone, refineR estimated higher reference limits, while estimates for prealbumin were lower compared to the established reference interval.Conclusions: We applied the refineR algorithm to a variety of real-world data sets resulting in reference intervals similar to intervals previously established by direct methods. We further provide practical guidance and a code example on how to apply an indirect method in a real-world scenario facilitating their access and thus their use in laboratory settings.
20 October 2022 in Clinical Chemistry
Background: Indirect methods leverage real-world data for the estimation of reference intervals. These constitute an active field of research, and several methods have been developed recently. So far, no standardized tool for evaluation and comparison of indirect methods exists.Methods: We provide RIbench, a benchmarking suite for quantitative evaluation of any existing or novel indirect method. The benchmark contains simulated test sets for 10 biomarkers mimicking routine measurements of a mixed distribution of non-pathological (reference) values and pathological values. The non-pathological distributions represent 4 common distribution types: normal, skewed, heavily skewed, and skewed-and-shifted. To identify strengths and weaknesses of indirect methods, test sets have varying sample sizes and pathological distributions differ in location, extent of overlap, and fraction. For performance evaluation, we use an overall benchmark score and sub-scores derived from absolute z-score deviations between estimated and true reference limits. We illustrate the application of RIbench by evaluating and comparing the Hoffmann method and 4 modern indirect methods –TML (Truncated-Maximum-Likelihood), kosmic, TMC (Truncated-Minimum-Chi-Square), and refineR– against one another and against a nonparametric direct method (n = 120).Results: For the modern indirect methods, pathological fraction and sample size had a strong influence on the results: With a pathological fraction up to 20% and a minimum sample size of 5000, most methods achieved results comparable or superior to the direct method.Conclusions: We present RIbench, an open-source R-package, for the systematic evaluation of existing and novel indirect methods. RIbench can serve as a tool for enhancement of indirect methods, improving the estimation of reference intervals.