Diogo Almeida

Diogo Almeida

Auto-generated profile, based on publicly available information

Diogo Almeida

New York University Abu Dhabi

Research Focus & Metrics

Academic Career Length

23Years (2004-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 September 2013 in Lingua
Verified
Journal Article
Closed access
JSJon Sprouse
Jon Sprouse
CSCarson T. Schütze
Carson T. Schütze
DADiogo Almeida
Diogo Almeida

8 February 2012 in Journal of Linguistics
Verified
Journal Article
Closed access
PDF file
JSJon Sprouse
Jon Sprouse
DADiogo Almeida
Diogo Almeida
There has been a consistent pattern of criticism of the reliability of acceptability judgment data in syntax for at least 50 years (e.g., Hill 1961), culminating in several high-profile criticisms within the past ten years (Edelman & Christiansen 2003, Ferreira 2005, Wasow & Arnold 2005, Gibson & Fedorenko 2010, in press). The fundamental claim of these critics is that traditional acceptability judgment collection methods, which tend to be relatively informal compared to methods from experimental psychology, lead to an intolerably high number of false positive results. In this paper we empirically assess this claim by formally testing all 469 (unique, US-English) data points from a popular syntax textbook (Adger 2003) using 440 naïve participants, two judgment tasks (magnitude estimation and yes–no), and three different types of statistical analyses (standard frequentist tests, linear mixed effects models, and Bayes factor analyses). The results suggest that the maximum discrepancy between traditional methods and formal experimental methods is 2%. This suggests that even under the (likely unwarranted) assumption that the discrepant results are all false positives that have found their way into the syntactic literature due to the shortcomings of traditional methods, the minimum replication rate of these 469 data points is 98%. We discuss the implications of these results for questions about the reliability of syntactic data, as well as the practical consequences of these results for the methodological options available to syntacticians.

1 December 2009 in Brain and Language
Verified
Journal Article
Closed access
ELEllen Lau
Ellen Lau
DADiogo Almeida
Diogo Almeida
PHPaul C. Hines
Paul C. Hines
DPDavid Poeppel
David Poeppel

1 March 2007 in Linguistic Inquiry
Verified
Journal Article
Closed access
DADiogo A. de A. Almeida
Diogo A. de A. Almeida
MYMasaya Yoshida
Masaya Yoshida

1 April 2013 in Language and Cognitive Processes
Verified
Journal Article
Closed access
JSJon Sprouse
Jon Sprouse
DADiogo Almeida
Diogo Almeida
This is a commentary in response to The need for quantitative methods in syntax and semantics research, by Edward Gibson and Evelina Fedorenko.

20 January 2017 in Glossa: A Journal of General Linguistics
Verified
Journal Article
Open access
PDF file
JSJon Sprouse
Jon Sprouse
DADiogo Almeida
Diogo Almeida
Previous investigations into the validity of acceptability judgment data have focused almost exclusively on type I errors (or false positives) because of the consequences of such errors for syntactic theories (Sprouse & Almeida 2012; Sprouse et al. 2013). The current study complements these previous studies by systematically investigating the type II error rate (false negatives), or equivalently, the statistical power, of a wide cross-section of possible acceptability judgment experiments. Though type II errors have historically been assumed to be less costly than type I errors, the dynamics of scientific publishing mean that high type II error rates (i.e., studies with low statistical power) can lead to increases in type I error rates in a given field of study. We present a set of experiments and resampling simulations to estimate statistical power for four tasks (forced-choice, Likert scale, magnitude estimation, and yes-no), 50 effect sizes instantiated by real phenomena, sample sizes from 5 to 100 participants, and two approaches to statistical analysis (null hypothesis and Bayesian). Our goals are twofold (i) to provide a fuller picture of the status of acceptability judgment data in syntax, and (ii) to provide detailed information that syntacticians can use to design and evaluate the sensitivity of acceptability judgment experiments in their own research.