Magnetic resonance imaging (MRI) has transformed our understanding of the human brain through well-replicated mapping of abilities to specific structures (for example, lesion studies) and functions1–3 (for example, task functional MRI (fMRI)). Mental health research and care have yet to realize similar advances from MRI. A primary challenge has been replicating associations between inter-individual differences in brain structure or function and complex cognitive or mental health phenotypes (brain-wide association studies (BWAS)). Such BWAS have typically relied on sample sizes appropriate for classical brain mapping4 (the median neuroimaging study sample size is about 25), but potentially too small for capturing reproducible brain–behavioural phenotype associations5,6. Here we used three of the largest neuroimaging datasets currently available—with a total sample size of around 50,000 individuals—to quantify BWAS effect sizes and reproducibility as a function of sample size. BWAS associations were smaller than previously thought, resulting in statistically underpowered studies, inflated effect sizes and replication failures at typical sample sizes. As sample sizes grew into the thousands, replication rates began to improve and effect size inflation decreased. More robust BWAS effects were detected for functional MRI (versus structural), cognitive tests (versus mental health questionnaires) and multivariate methods (versus univariate). Smaller than expected brain–phenotype associations and variability across population subsamples can explain widespread BWAS replication failures. In contrast to non-BWAS approaches with larger effects (for example, lesions, interventions and within-person), BWAS reproducibility requires samples with thousands of individuals.
1 November 2016 in Neuroscience & Biobehavioral Reviews
Significant improvements in cognitive control occur from childhood through adolescence, supported by the maturation of prefrontal systems. However, less is known about the neural basis of refinements in cognitive control proceeding from adolescence to adulthood. Accumulating evidence indicates that integration between hippocampus (HPC) and prefrontal cortex (PFC) supports flexible cognition and has a protracted neural maturation. Using a longitudinal design (487 scans), we characterized developmental changes from 8 to 32 years of age in HPC-PFC functional connectivity at rest and its associations with cognitive development. Results indicated significant increases in functional connectivity between HPC and ventromedial PFC (vmPFC), but not dorsolateral PFC. Importantly, HPC-vmPFC connectivity exclusively predicted performance on the Stockings of Cambridge task, which probes problem solving and future planning. These data provide evidence that maturation of high-level cognition into adulthood is supported by increased functional integration across the HPC and vmPFC through adolescence.
Magnetic resonance imaging (MRI) continues to drive many important neuroscientific advances. However, progress in uncovering reproducible associations between individual differences in brain structure/function and behavioral phenotypes (e.g., cognition, mental health) may have been undermined by typical neuroimaging sample sizes (median N=25) 1,2 . Leveraging the Adolescent Brain Cognitive Development (ABCD) Study 3 (N=11,878), we estimated the effect sizes and reproducibility of these brain-wide associations studies (BWAS) as a function of sample size. The very largest, replicable brain-wide associations for univariate and multivariate methods were r=0.14 and r=0.34, respectively. In smaller samples, typical for brain-wide association studies (BWAS), irreproducible, inflated effect sizes were ubiquitous, no matter the method (univariate, multivariate). Until sample sizes started to approach consortium-levels, BWAS were underpowered and statistical errors assured. Multiple factors contribute to replication failures 4–6 ; here, we show that the pairing of small brain-behavioral phenotype effect sizes with sampling variability is a key element in wide-spread BWAS replication failure. Brain-behavioral phenotype associations stabilize and become more reproducible with sample sizes of N⪆2,000. While investigator-initiated brain-behavior research continues to generate hypotheses and propel innovation, large consortia are needed to usher in a new era of reproducible human brain-wide association studies.
The development of the striatum dopamine (DA) system through human adolescence, a time of increased sensation seeking and vulnerability to the emergence of psychopathology, has been difficult to study due to pediatric restrictions on direct in vivo assessments of DA. Here, we applied neuroimaging in a longitudinal sample of n = 146 participants aged 12–30. R2′, an MR measure of tissue iron which co-localizes with DA vesicles and is necessary for DA synthesis, was assessed across the sample. In the 18–30 year-olds (n = 79) we also performed PET using [11C]dihydrotetrabenazine (DTBZ), a measure of presynaptic vesicular DA storage, and [11C]raclopride (RAC), an indicator of D2/D3 receptor availability. We observed decreases in D2/D3 receptor availability with age, while presynaptic vesicular DA storage (as measured by DTBZ), which was significantly associated with R2′ (standardized coefficient = 0.29, 95% CI = [0.11, 0.48]), was developmentally stable by age 18. Our results provide new evidence for maturational specialization of the striatal DA system through adolescence.