Dominik Weber

Mr. Dominik Weber

orcid

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications

16 February 2023 in Journal of Intelligence
Verified
Journal Article
Open access
PDF file
DWDominik Weber
Dominik Weber
FKFlorian Krieger
Florian Krieger
FSFrank M. Spinath
Frank M. Spinath
SGSamuel Greiff
Samuel Greiff
JHJohanna Hissbach
Johanna Hissbach
NBNicolas Becker
Nicolas Becker
As a component of many intelligence test batteries, figural matrices tests are an effective way to assess reasoning, which is considered a core ability of intelligence. Traditionally, the sum of correct items is used as a performance indicator (total solution procedure). However, recent advances in the development of computer-based figural matrices tests allow additional indicators to be considered for scoring. In two studies, we focused on the added value of a partial solution procedure employing log file analyses from a computer-based figural matrices test. In the first study (n = 198), we explored the internal validity of this procedure by applying both an exploratory bottom-up approach (using sequence analyses) and a complementary top-down approach (using rule jumps, an indicator taken from relevant studies). Both approaches confirmed that higher scores in the partial solution procedure were associated with higher structuredness in participants’ response behavior. In the second study (n = 169), we examined the external validity by correlating the partial solution procedure in addition to the total solution procedure with a Grade Point Average (GPA) criterion. The partial solution procedure showed an advantage over the total solution procedure in predicting GPA, especially at lower ability levels. The implications of the results and their applicability to other tests are discussed.

12 January 2026 in Frontiers in Psychology
Verified
Journal Article
Open access
PDF file
DWDominik Weber
Dominik Weber
NBNicolas Becker
Nicolas Becker
FSFrank M. Spinath
Frank M. Spinath
MKMarco Koch
Marco Koch
Introduction: It is crucial for researchers and test developers to compare results from different test sets (e. g., re-testing, parallel test forms). To ensure comparability, test sets are often linked using anchor items as a common denominator alongside distinct items. To date, most studies on test equating have been limited in scope, typically comparing only absolute numbers of anchor items or focusing on a single IRT model or equating method. Furthermore, previous research has primarily evaluated the absolute deviation of estimated parameters from true parameters. However, in diagnostic contexts, the correlation between these values is often more relevant for ensuring validity and test fairness. Therefore, the aim of this simulation study was to examine the impact of a broad range of key factors on test equating. Methods: We evaluated correlations and recovery indices between predefined true values and values estimated through test equating for three IRT parameters (discrimination, difficulty, and ability). To this end, we varied the equating method (MS, MM, MGM, IRF, TRF), the IRT model (2PL vs. 3PL), guessing probability (0.000–0.250), anchor item proportion (5–25%), test set size (20–80 items), and the discrimination parameters of the anchor items. In addition, we used samples of 25–100 individuals to assess equating quality under challenging conditions as well as samples of 500 and 1,000 individuals to reflect adequate modeling conditions. Results: Low guessing probabilities and high anchor item discrimination parameters strongly improved test equating quality for all three IRT parameters. Recovery of discrimination and ability parameters increased logarithmically with larger test set sizes and higher anchor item proportions, with each of these two factors partially compensating for reductions in the other. While sample sizes below 100 individuals produced inadequate parameter recovery, samples of 100 or 500 individuals were justifiable under certain conditions. However, samples of only 100 individuals carried a slight risk of non-convergence. The choice of the equating method had rather minor effects and the impact of the IRT model was ambivalent. Discussion: These findings highlight the importance of using distractor-free response formats without any guessing probability, anchor items with high discrimination parameters, and large samples to ensure valid test equating. For individual research and test application purposes, we provide a comprehensive data set covering multiple factor levels and a step-by-step simulation guide.

28 May 2025 in Journal of Intelligence
Verified
Journal Article
Open access
PDF file
DWDominik Weber
Dominik Weber
MKMarco Koch
Marco Koch
FSFrank M. Spinath
Frank M. Spinath
FKFlorian Krieger
Florian Krieger
NBNicolas Becker
Nicolas Becker
Previous research has shown individual differences in (a) time on task (ToT) and (b) the degree of structuredness in processing figural matrices. The goal of this article was to integrate these two lines of research by analyzing log files from a computer-based assessment (N = 198) to examine the role of three ToT sub-components: onset times (before engaging with the first matrix rule), interrule times (between the rules), and intrarule times (within a single rule). We tested three clues that support the assumptions that the interrule times reflect the cognitive construction of a rule-specific solution plan, while the onset times represent a global orientation reaction, and the intrarule times capture the behavioral execution of the plan: (1) based on the interrule times, we identified two clusters of participants, of which one processed the matrices in a more structured fashion; (2) only the accelerating effect of the interrule times across the test was associated with test performance, indicating higher reasoning saturation; (3) a mediated path analysis revealed that faster interrule times propagate in faster intrarule times and more structured processing of matrix rules, resulting in better performance. Confirming internal validity, the three log file times accounted for an incremental 24.30% of test performance variance beyond the traditional ToT. Confirming external validity, two clusters were also identified based on the interrule times from the first test and performance scores from a second matrix test.

1 July 2026 in Journal of Intelligence
Verified
Journal Article
Open access
PDF file
DWDominik Weber
Dominik Weber
NBNicolas Becker
Nicolas Becker
FSFrank M. Spinath
Frank M. Spinath
MKMarco Koch
Marco Koch
In applied diagnostics, scores from multiple intelligence tests are often combined by simple arithmetic averaging. Although convenient, this practice is statistically imprecise: it neglects (a) that tests are positively correlated but not identical, each capturing somewhat different aspects of intelligence, and (b) that combining correlated measures reduces variance. Consequently, arithmetic means underestimate intelligence above the IQ scale center and overestimate it below the center. Such distortions can lead to serious misjudgments in high-stakes assessment, such as in educational placement or forensic evaluations of legal culpability. To obtain exploratory evidence on the prevalence of simple averaging practice, we surveyed n = 75 psychologically educated individuals familiar with IQ metrics. In response to a case vignette requiring the combination of several IQ scores, 58 participants (77.33%) applied simple averaging, and none considered intercorrelations and variance reduction. Therefore, the aim of this article was to propose the application of a more valid method for combining scores (as well as corresponding reliabilities and validities) of multiple tests. To validate the method, we performed Monte Carlo simulations, covering a wide range of test characteristics. Results showed virtually perfect accuracy (r = 1.00, p < .001), and the outcomes were robust against variations in the number of tests to be combined, score distributions, and intercorrelations. To facilitate adoption in practical diagnostics, we developed and introduced an open-source R package and an accompanying open-access Shiny web application.