A statistical analysis of semantic memory should reflect the complex, multifactorial structure of the relations among its items. Still, a dominant paradigm in the study of semantic memory has been the idea that the mental representation of concepts is structured along a simple branching tree spanned by superordinate and subordinate categories. We propose a generative model of item representation with correlations that overcomes the limitations of a tree structure. The items are generated through “factors” that represent semantic features or real-world attributes. The correlation between items has its source in the extent to which items share such factors and the strength of such factors: if many factors are balanced, correlations are overall low; whereas if a few factors dominate, they become strong. Our model allows for correlations that are neither trivial nor hierarchical, but may reproduce the general spectrum of correlations present in a dataset of nouns. We find that such correlations reduce the storage capacity of a Potts network to a limited extent, so that the number of concepts that can be stored and retrieved in a large, human-scale cortical network may still be of order 107, as originally estimated without correlations. When this storage capacity is exceeded, however, retrieval fails completely only for balanced factors; above a critical degree of imbalance, a phase transition leads to a regime where the network still extracts considerable information about the cued item, even if not recovering its detailed representation: partial categorization seems to emerge spontaneously as a consequence of the dominance of particular factors, rather than being imposed ad hoc. We argue this to be a relevant model of semantic memory resilience in Tulving’s remember/know paradigms.
Categorization is a fundamental information processing phenomenon in the brain. It is critical for animals to compress an abundance of stimulations into groups to react quickly and efficiently. In addition to labels, categories possess an internal structure: the goodness measures how well any element belongs to a category. Interestingly, this categorization leads to an altered perception referred to as categorical perception: for a given physical distance, items within a category are perceived closer than items in two different categories. A subtler effect is the perceptual magnet: discriminability is reduced close to the prototypes of a category and increased near its boundaries. Here, starting from predefined abstract categories, we naturally derive the internal structure of categories and the phenomenon of categorical perception, using an information theoretical framework that involves both probabilities and pairwise similarities between items. Essentially, we suggest that pairwise similarities between items are to be tuned to render some predefined categories as well as possible. However, constraints on these pairwise similarities only produce an approximate matching, which explains concurrently the notion of goodness and the warping of perception. Overall, we demonstrate that similarity-based information theory may offer a global and unified principled understanding of categorization and categorical perception simultaneously.
Identical physical inputs do not always evoke identical percepts. To investigate the role of stimulus history in tactile perception, we designed a task in which rats had to judge each vibrissal vibration, in a long series, as strong or weak depending on its mean speed. After a low-speed stimulus (trial n-1 ), rats were more likely to report the next stimulus (trial n ) as strong, and after a high-speed stimulus, they were more likely to report the next stimulus as weak, a repulsive effect that did not depend on choice or reward on trial n-1 . This effect could be tracked over several preceding trials (i.e. n-2 and earlier) and was characterized by an exponential decay function, reflecting a trial-by-trial incorporation of sensory history. Surprisingly, the influence of trial n-1 strengthened as the time interval between n-1 and n grew. Human subjects receiving fingertip vibrations showed these same key findings. We are able to account for the repulsive stimulus history effect, and its detailed time scale, through a single-parameter model, wherein each new stimulus gradually updates the subject’s decision criterion. This model points to mechanisms underlying how the past affects the ongoing subjective experience.
We analyze an autoassociative network of Potts units, coupled via tensor connections, as an effective model of extended cortical networks with distinct short and long-range synaptic connections. To study semantic memory, organized in terms of the relations between the attributes of real-world knowledge, we formulate a generative model of item representation with correlations. The model ascribes such correlations to the influence of underlying "factors": items with more shared factors have more correlated representations. Moreover, if many factors are balanced, correlations are overall low; whereas if a few factors dominate (increasing a dominance parameter ζ), they become strong. Our model allows for correlations that are neither trivial (random) nor merely hierarchical (an ultrametric tree). The network can retrieve one from up to p ≃ CS^2/a weakly correlated items, of order 10,000,000 with human cortical parameters. When its storage capacity is exceeded, however, retrieval fails completely only for low ζ; above a critical dominance value, a phase transition leads to a regime where the network still extracts considerable information about the cued item, even if not recovering its detailed representation: possibly a model of semantic memory resilience in remember/know paradigms.
Aging is associated with declines in sensorimotor and cognitive functions that affect internal motor models, thought to mediate the risk of falls. Motor imagery, an experimental window into internal models, has been studied in aging, but it remains unclear whether age differentially impacts their predictive versus updating components. In this study, younger and older adults completed the Timed Up and Go task along with imagined trials before and after execution, enabling separate assessment of prediction and update accuracy. It was found that older adults exhibited similar or better accuracy during prediction and update, but the accuracy measures were linked with distinct cognitive and sensorimotor factors in the two age groups. These findings suggest that while internal model function is preserved in healthy aging, at least for every-day tasks, it is shaped by different compensatory mechanisms across the lifespan.
A statistical analysis of semantic memory should reflect the complex, multifactorial structure of the relations among its items. Still, a dominant paradigm in the study of semantic memory has been the idea that the mental representation of concepts is structured along a simple branching tree spanned by superordinate and subordinate categories. We propose a generative model of item representation with correlations that overcomes the limitations of a tree structure. The items are generated through "factors" that represent semantic features or real-world attributes. The correlation between items has its source in the extent to which items share such factors and the strength of such factors: if many factors are balanced, correlations are overall low; whereas if a few factors dominate, they become strong. Our model allows for correlations that are neither trivial nor hierarchical, but may reproduce the general spectrum of correlations present in a data-set of nouns. We provide an estimate of the number of concepts that can be stored and retrieved by a large-scale cortical network, the Potts network, which is perhaps approximately 107 with human cortical parameters. When this storage capacity is exceeded, however, retrieval fails completely only for balanced factors; above a critical degree of imbalance, a phase transition leads to a regime where the network still extracts considerable information about the cued item, even if not recovering its detailed representation: partial categorization seems to emerge spontaneously as a consequence of the dominance of particular factors, rather than being imposed ad hoc. We argue this to be a relevant model of semantic memory resilience in Tulving’s remember/know paradigms.