30 March 2020 in Psychometrika
Effect size indices are useful tools in study design and reporting because they are unitless measures of association strength that do not depend on sample size. Existing effect size indices are developed for particular parametric models or population parameters. Here, we propose a robust effect size index based on M-estimators. This approach yields an index that is very generalizable because it is unitless across a wide range of models. We demonstrate that the new index is a function of Cohen’s d, \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} $$R^2$$ , and standardized log odds ratio when each of the parametric models is correctly specified. We show that existing effect size estimators are biased when the parametric models are incorrect (e.g., under unknown heteroskedasticity). We provide simple formulas to compute power and sample size and use simulations to assess the bias and standard error of the effect size estimator in finite samples. Because the new index is invariant across models, it has the potential to make communication and comprehension of effect size uniform across the behavioral sciences.
27 November 2024 in Nature
Brain-wide association studies (BWAS) are a fundamental tool in discovering brain–behaviour associations1,2. Several recent studies have shown that thousands of study participants are required for good replicability of BWAS1–3. Here we performed analyses and meta-analyses of a robust effect size index using 63 longitudinal and cross-sectional MRI studies from the Lifespan Brain Chart Consortium4 (77,695 total scans) to demonstrate that optimizing study design is critical for increasing standardized effect sizes and replicability in BWAS. A meta-analysis of brain volume associations with age indicates that BWAS with larger variability of the covariate and longitudinal studies have larger reported standardized effect size. Analysing age effects on global and regional brain measures from the UK Biobank and the Alzheimer’s Disease Neuroimaging Initiative, we showed that modifying study design through sampling schemes improves standardized effect sizes and replicability. To ensure that our results are generalizable, we further evaluated the longitudinal sampling schemes on cognitive, psychopathology and demographic associations with structural and functional brain outcome measures in the Adolescent Brain and Cognitive Development dataset. We demonstrated that commonly used longitudinal models, which assume equal between-subject and within-subject changes can, counterintuitively, reduce standardized effect sizes and replicability. Explicitly modelling the between-subject and within-subject effects avoids conflating them and enables optimizing the standardized effect sizes for each separately. Together, these results provide guidance for study designs that improve the replicability of BWAS.
14 September 2021 in Human Brain Mapping
TRTimothy Robert‐Fitzgerald
Timothy Robert‐Fitzgerald
+5
Many key findings in neuroimaging studies involve similarities between brain maps, but statistical methods used to measure these findings have varied. Current state‐of‐the‐art methods involve comparing observed group‐level brain maps (after averaging intensities at each image location across multiple subjects) against spatial null models of these group‐level maps. However, these methods typically make strong and potentially unrealistic statistical assumptions, such as covariance stationarity. To address these issues, in this article we propose using subject‐level data and a classical permutation testing framework to test and assess similarities between brain maps. Our method is comparable to traditional permutation tests in that it involves randomly permuting subjects to generate a null distribution of intermodal correspondence statistics, which we compare to an observed statistic to estimate ap‐value. We apply and compare our method in simulated and real neuroimaging data from the Philadelphia Neurodevelopmental Cohort. We show that our method performs well for detecting relationships between modalities known to be strongly related (cortical thickness and sulcal depth), and it is conservative when an association would not be expected (cortical thickness and activation on then‐back working memory task). Notably, our method is the most flexible and reliable for localizing intermodal relationships within subregions of the brain and allows for generalizable statistical inference.
26 October 2017 in Journal of Cerebral Blood Flow & Metabolism
TSTheodore D Satterthwaite
+8
The human brain consumes a disproportionate amount of the body’s overall metabolic resources, and evidence suggests that brain and body may compete for substrate during development. Using perfusion MRI from a large cross-sectional cohort, we examined developmental changes of MRI-derived estimates of brain metabolism, in relation to weight change. Nonlinear models demonstrated that, in childhood, changes in body weight were inversely related to developmental age-related changes in brain metabolism. This inverse relationship persisted through early adolescence, after which body and brain metabolism began to decline. Females achieved maximum body growth approximately two years earlier than males, with a correspondingly earlier stabilization of brain metabolism to adult levels. These findings confirm prior findings with positron emission tomography performed in a much smaller cohort, demonstrate that relative brain metabolism can be inferred from noninvasive MRI data, and extend observations on the associations between body growth and brain metabolism to sex differences through adolescence.