This paper introduces a novel collection of word embeddings, numerical representations of lexical semantics, in 55 languages, trained on a large corpus of pseudo-conversational speech transcriptions from television shows and movies. The embeddings were trained on the OpenSubtitles corpus using the fastText implementation of the skipgram algorithm. Performance comparable with (and in some cases exceeding) embeddings trained on non-conversational (Wikipedia) text is reported on standard benchmark evaluation datasets. A novel evaluation method of particular relevance to psycholinguists is also introduced: prediction of experimental lexical norms in multiple languages. The models, as well as code for reproducing the models and all analyses reported in this paper (implemented as a user-friendly Python package), are freely available at: https://github.com/jvparidon/subs2vec.
Written language, a human cultural invention, is far too recent a development for dedicated neural infrastructure to have evolved in its service. Newly acquired cultural skills, such as reading, thus recycle evolutionarily older circuits that originally evolved for different, but similar, functions (e.g., visual object recognition). The destructive-competition hypothesis predicts that this neuronal recycling has detrimental behavioral effects on the cognitive functions for which a cortical network originally evolved. In a study with 97 literate, low-literate, and illiterate participants from the same socioeconomic background, we found that even after adjusting for cognitive ability and test-taking familiarity, learning to read was associated with an increase, rather than a decrease, in object-recognition abilities. These results are incompatible with the claim that neuronal recycling results in destructive competition and are consistent with the possibility that learning to read instead fine-tunes general object-recognition mechanisms, a hypothesis that needs further neuroscientific investigation.
Certain colors are strongly associated with certain adjectives (e.g. red is hot, blue is cold). Some of these associations are grounded in visual experiences such as seeing glowing red embers. Surprisingly, despite having no visual experience, many congenitally blind people show very similar color associations which are likely learned through language. We show that these associations are indeed embedded in the statistical structure of language. We apply a projection method to word embeddings trained on corpora of spoken and written language to identify color-adjective associations as they are represented in English. These projections were predictive of color-adjective associations reported by blind and sighted English speakers. The most predictive projections were generated by embeddings derived from a corpus of fiction, which outperformed even the state-of-the-art large language model, GPT-4. By augmenting the training corpora in various ways we discover the types of sentences most responsible for conveying the color-adjective associations to the models. We find that word embedding models learn these associations from indirect (second-order) co-occurrences, and that when prompted, people are able to identify some of the words that are most informative for associating colors with specific adjectives. Learning through linguistic co-occurrences is one way word meanings can be continually aligned across language users despite large variations in perceptual experience.