The positive manifold—the finding that cognitive ability measures demonstrate positive correlations with one another—has led to models of intelligence that include a general cognitive ability or general intelligence (g). This view has been reinforced using factor analysis and reflective, higher-order latent variable models. However, a new theory of intelligence, Process Overlap Theory (POT), posits that g is not a psychological attribute but an index of cognitive abilities that results from an interconnected network of cognitive processes. These competing theories of intelligence are compared using two different statistical modeling techniques: (a) latent variable modeling and (b) psychometric network analysis. Network models display partial correlations between pairs of observed variables that demonstrate direct relationships among observations. Secondary data analysis was conducted using the Hungarian Wechsler Adult Intelligence Scale Fourth Edition (H-WAIS-IV). The underlying structure of the H-WAIS-IV was first assessed using confirmatory factor analysis assuming a reflective, higher-order model and then reanalyzed using psychometric network analysis. The compatibility (or lack thereof) of these theoretical accounts of intelligence with the data are discussed.
In previous research, young adults who were told they were being observed and evaluated reported more tip-of-the-tongue (TOT) instances than those who were not. We first tested whether the same effect is obtained for older adult participants, and then compared the effects of ostensible evaluative observation on word retrieval for adults across the lifespan. Participants in the observed condition were told they were being evaluated throughout the Trier Social Stress Test (TSST) procedure and a word retrieval task, whereas participants in the unobserved condition performed similar tasks with no mention of observation or evaluation. In Experiment 1, older adult participants in the observed condition experienced more TOTs than those in the unobserved condition. In Experiment 2, observation increased TOTs to a similar extent for adults ages 18-80, replicating earlier findings with young adults and Experiment 1. Observation can impair cognitive performance similarly for adults of a wide range of ages.
In a recent publication in the Journal of Intelligence, Dennis McFarland mischaracterized previous research using latent variable and psychometric network modeling to investigate the structure of intelligence. Misconceptions presented by McFarland are identified and discussed. We reiterate and clarify the goal of our previous research on network models, which is to improve compatibility between psychological theories and statistical models of intelligence. WAIS-IV data provided by McFarland were reanalyzed using latent variable and psychometric network modeling. The results are consistent with our previous study and show that a latent variable model and a network model both provide an adequate fit to the WAIS-IV. We therefore argue that model preference should be determined by theory compatibility. Theories of intelligence that posit a general mental ability (general intelligence) are compatible with latent variable models. More recent approaches, such as mutualism and process overlap theory, reject the notion of general mental ability and are therefore more compatible with network models, which depict the structure of intelligence as an interconnected network of cognitive processes sampled by a battery of tests. We emphasize the importance of compatibility between theories and models in scientific research on intelligence.
The positive manifold—the finding that cognitive ability measures demonstrate positive correlations with one another—has led to models of intelligence that include a general cognitive ability or general intelligence (g). This view has been reinforced using factor analysis and latent variable models. However, a new theory of intelligence, Process Overlap Theory (POT; Kovacs & Conway, 2016), posits that g is not a psychological attribute but an index of cognitive abilities that results from an interconnected network of cognitive processes. From this perspective, psychometric network analysis is an attractive alternative to latent variable modeling. Network analyses display partial correlations among observed variables that demonstrate direct relationships among observed variables. To demonstrate the benefits of this approach, the Hungarian Wechsler Adult Intelligence Scale Fourth Edition (H-WAIS-IV; Wechsler, 2008) was analyzed using both psychometric network analysis and latent variable modeling. Network models were directly compared to latent variable models. Results indicate that the H-WAIS-IV data was better fit by network models than by latent variable models. We argue that POT, and network models, provide a more accurate view of the structure of intelligence than traditional approaches.