The structure of event knowledge plays a critical role in prediction, reconstruction of memory for personal events, construction of possible future events, action, language usage, and social interactions. Despite numerous theoretical proposals such as scripts, schemas, and stories, the highly variable and rich nature of events and event knowledge have been formidable barriers to characterizing the structure of event knowledge in memory. We used network science to provide insights into the temporal structure of common events. Based on participants' production and ordering of the activities that make up events, we established empirical profiles for 80 common events to characterize the temporal structure of activities. We used the event networks to investigate multiple issues regarding the variability in the richness and complexity of people's knowledge of common events, including: the temporal structure of events; event prototypes that might emerge from learning across many experiential instances and be expressed by people; the degree to which scenes (communities) are present in various events; the degree to which people believe certain activities are central to an event; how centrality might be distributed across an event's activities; and similarities among events in terms of their content and their temporal structure. Thus, we provide novel insights into human event knowledge, and describe 18 predictions for future human studies.
Our knowledge of events and situations in the world plays a critical role in our ability to understand what is happening around us, to predict what might happen next, and to comprehend language. What has not been so clear is the form and structure of this knowledge, how it is learned, and how it is deployed in real time. Despite many important theoretical proposals, often using different terminology such as schemas, scripts, frames, and event knowledge, developing a model that addresses these three questions (the form, learning, and use of such knowledge) has remained an elusive challenge for decades. In this article, we present a connectionist model of event knowledge that attempts to fill this gap. From sequences of activities, the model learns both the internal structure of activities as well as the temporal structure that organizes activity sequences. The model simulates a wide range of human behaviors that have been argued to involve the use of event knowledge and the temporal structure of events. Furthermore, it makes testable predictions about behaviors not yet observed. Most importantly, the model's ability to learn event structure from experience is a novel solution to the question, "What is the form and representation of event knowledge?"
Knowledge of common events is central to many aspects of cognition. Intuitively, it seems as though events are linear chains of the activities of which they are comprised. In line with this intuition, a number of theories of the temporal structure of event knowledge have posited mental representations (data structures) consisting of linear chains of activities. Competing theories focus on the hierarchical nature of event knowledge, with representations comprising ordered scenes, and chains of activities within those scenes. We present evidence that the temporal structure of events typically is not well-defined, but it is much richer and more variable both within and across events than has usually been assumed. We also present evidence that prediction-based neural network models can learn these rich and variable event structures and produce behaviors that reflect human performance. We conclude that knowledge of the temporal structure of events in the human mind emerges as a consequence of prediction-based learning.
To appear in William Bechtel & George Graham (Eds.), A Companion to Cognitive Science. Oxford: Basil Blackwell. Support for the work described here has been provided by NIH/NIDCD-R01-DC00216, NIH-NIDCD P50 DC1289-9351, NIH/NINDS P50 NS22343, and a grant from the John D. and Catherine T. MacArthur Foundation Research Network on Early Childhood Transitions. Please address all correspondence to Elizabeth Bates, Center for Research in Language 0526, University of California at San Diego, La Jolla, California 92093-0526, or bates@crl.ucsd.edu.
Periodically in science there arrive on the scene what appear to be dramatically new theoretical frameworks (what the philosopher of science Thomas Kuhn has called paradigm shifts). Characteristic of such changes in perspective is the recasting of old problems in new terms. By altering the conceptual vocabulary we use to think about problems, we may discover solutions which were obscured by prior ways of thinking about things. Connectionism, artificial life, and dynamical systems are all approaches to cognition which are relatively new and have been claimed to represent such paradigm shifts. Just how deep the shifts are remains an open question, but each of these approaches certainly seems to offer novel ways of dealing with basic questions in cognitive science.
Although the size of a child's vocabulary associates with language-processing skills, little is understood regarding how this relation emerges. This investigation asks whether and how the structure of vocabulary knowledge affects language processing in English-learning 24-month-old children (N=32; 18 F, 14 M). Parental vocabulary report was used to calculate semantic density in several early-acquired semantic categories. Performance on two language-processing tasks (lexical recognition and sentence processing) was compared as a function of semantic density. In both tasks, real-time comprehension was facilitated for higher density items, whereas lower density items experienced more interference. The findings indicate that language-processing skills develop heterogeneously and are influenced by the semantic network surrounding a known word.
Infants, 18-24 months old who have difficulty learning words compared to their peers are often referred to as "late talkers" (LTs). These children are at risk for continued language delays as they grow older. One critical question is how to best identify which LTs will have language disorders, such as Specific Language Impairment (SLI) at school age, in order to maximize the opportunity for early and appropriate intervention and support. Recent research suggests that LTs are not only slower to learn and speak words than their peers, but are also slower to recognize and interpret known words in real time.This investigation examined online moment-by-moment processing of novel word learning in 18-month-olds. A low vocabulary, late talking group (LT, N = 14) and an age and cognitive-level matched typical group (TYP, N = 14) of infants participated in an eye-tracked novel word learning task and completed standardized testing of vocabulary and cognitive ability. Infants were trained on two novel word-picture pairs and then were tested using an adaptation of the looking while listening paradigm. Results suggest that there are differences between groups in the time-course of looking to the novel target picture during testing. These findings suggest that LTs and typical infants developed strong enough representations to recognize novel words using traditional measures of accuracy and reaction time, however interesting group differences emerge when using additional fine-grained processing measures. Implications for differences in emerging knowledge and learning patterns are discussed.Learning outcomes: The reader will be able to understand many benefits of using eye-tracking methods to study young infant and toddler populations with and without language disorders. Readers will learn that examining moment-by-moment time course of novel word learning allows additional insight into different learning patterns. Finally, readers should understand the data from this article suggest late talkers may have different emerging representations of novel words than their typical peers, which may contribute to their difficulty learning new words. (C) 2015 Elsevier Inc. All rights reserved.
Despite extensive evidence that adults and children rapidly integrate world knowledge to generate expectancies for upcoming language, little work has explored how this knowledge is initially acquired and used. We explore this question in 3- to 10-year-old children and adults by measuring the degree to which sentences depicting recently learned connections between agents, actions and objects lead to anticipatory eye-movements to the objects. Combinatory information in sentences about agent and action elicited anticipatory eye-movements to the Target object in adults and older children. Our findings suggest that adults and school-aged children can quickly activate information about recently exposed novel event relationships in real-time language processing. However, there were important developmental differences in the use of this knowledge. Adults and school-aged children used the sentential agent and action to predict the sentence final theme, while preschool children's fixations reflected a simple association to the currently spoken item. We consider several reasons for this developmental difference and possible extensions of this paradigm.
The brain is able to acquire information about an unknown word's meaning from a highly constraining sentence context with minimal exposure. In this study, we investigate the potential contributions of the cerebral hemispheres to this ability. Undergraduates first read weakly or strongly constraining sentences completed by known or unknown (novel) words. Subsequently, their knowledge of the previously exposed words was assessed via a lexical decision task in which each word served as visual primes for lateralized target words that varied in their semantic relationship to the primes (unrelated, identical or synonymous). As expected, smaller N400 amplitudes were seen for target words preceded by identical (vs. unrelated) known word primes, regardless of visual field of presentation. When Unknown words served as primes, N400 reductions to synonymous target words were observed only if the prime had appeared under High sentential constraint; targets appearing in the LVF/RH elicited a small N400 effect and modulation of a subsequent late positivity whereas those in the RVF/LH elicited modulation on the late positivity only. Unknown words initially seen in Low constraint contexts showed priming effects only in a late positivity and only in the RVF/LH. Strength of contextual constraint clearly seems to impact the hemispheres’ rapid acquisition of novel word meanings. N400 modulation for novel words under strong contextual constraint in the LVH/RH suggests that fast-mapped lexical representations may initially activate meanings that are weakly, distantly, associatively or thematically-related. More extensive and bilateral semantic processing seems to occur at longer processing latencies (post N400).
We combined magnetoencephalography (MEG) with magnetic resonance imaging and electrocorticography to separate in anatomy and latency 2 fundamental stages underlying speech comprehension. The first acoustic-phonetic stage is selective for words relative to control stimuli individually matched on acoustic properties. It begins ∼60 ms after stimulus onset and is localized to middle superior temporal cortex. It was replicated in another experiment, but is strongly dissociated from the response to tones in the same subjects. Within the same task, semantic priming of the same words by a related picture modulates cortical processing in a broader network, but this does not begin until ∼217 ms. The earlier onset of acoustic-phonetic processing compared with lexico-semantic modulation was significant in each individual subject. The MEG source estimates were confirmed with intracranial local field potential and high gamma power responses acquired in 2 additional subjects performing the same task. These recordings further identified sites within superior temporal cortex that responded only to the acoustic-phonetic contrast at short latencies, or the lexico-semantic at long. The independence of the early acoustic-phonetic response from semantic context suggests a limited role for lexical feedback in early speech perception.
One remarkable characteristic of speech comprehension in typically developing (TD) children and adults is the speed with which the listener can integrate information across multiple lexical items to anticipate upcoming referents. Although children with Specific Language Impairment (SU) show lexical deficits (Sheng & McGregor, 2010) and slower speed of processing (Leonard et al., 2007), relatively little is known about how these deficits manifest in real-time sentence comprehension. In this study, we examine lexical activation in the comprehension of simple transitive sentences in adolescents with a history of SLI and age-matched, TD peers. Participants listened to sentences that consisted of the form, Article-Agent-Action-Article-Theme, (e.g., The pirate chases the ship) while viewing pictures of four objects that varied in their relationship to the Agent and Action of the sentence (e.g., Target, Agent-Related, Action-Related, and Unrelated). Adolescents with SLI were as fast as their TD peers to fixate on the sentence's final item (the Target) but differed in their post-action onset visual fixations to the Action-Related item. Additional exploratory analyses of the spatial distribution of their visual fixations revealed that the SU group had a qualitatively different pattern of fixations to object images than did the control group. The findings indicate that adolescents with SLI integrate lexical information across words to anticipate likely or expected meanings with the same relative fluency and speed as do their TO peers. However, the failure of the SLI group to show increased fixations to Action-Related items after the onset of the action suggests lexical integration deficits that result in failure to consider alternate sentence interpretations.Learning outcomes: As a result of this paper, the reader will be able to describe several benefits of using eye-tracking methods to study populations with language disorders. They should also recognize several potential explanations for lexical deficits in SLI, including possible reduced speed of processing, and degraded lexical representations. Finally, they should recall the main outcomes of this study, including that adolescents with SLI show different timing and location of eye-fixations while interpreting sentences than their age-matched peers. (C) 2013 Published by Elsevier Inc.
In a classroom setting, accommodating students with diverse backgrounds and levels of knowledge can be pedagogically challenging, especially for topics that have a knowledge space containing complex dependencies. Intelligent Tutoring Systems (ITS) attempt to address this challenge by providing computer-based learning environments that adapt to a student's level, facilitating self-paced and personalized learning trajectories. Traditionally, the knowledge domains of these systems are modeled explicitly, according to expert knowledge that may not always match the underlying learning dependencies of a novice, instead of taking full advantage of a corpus of user data in combination with machine learning techniques. In the field of second-language learning, this problem of knowledge domain mapping is exacerbated by the wide variety of factors influencing the structure of the underlying knowledge space, such as first language and previous language exposure. We are developing a web-based system for hybrid English as a Second Language (ESL) learning that takes a data-driven approach to the problem of domain mapping, assuming only very high-level organization of the domain knowledge, and having the actual structure of the student model be induced from a large corpus of student response data. We believe that a data-driven approach to student knowledge modeling, facilitated by the wide reach of free online learning systems and the explosive growth of internet access in developing countries, can drive a revolution in personalized learning.
Adults can incrementally combine information from speech with astonishing speed to anticipate future words. Concurrently, a growing body of work suggests that vocabulary ability is crucially related to lexical processing skills in children. However, little is known about this relationship with predictive sentence processing in children or adults. We explore this question by comparing the degree to which an upcoming sentential theme is anticipated by combining information from a prior agent and action. 48 children, aged of 3 to 10, and 48 college-aged adults' eye-movements were recorded as they heard a sentence (e.g., The pirate hides the treasure) in which the object referred to one of four images that included an agent-related, action-related and unrelated distractor image. Pictures were rotated so that, across all versions of the study, each picture appeared in all conditions, yielding a completely balanced within-subjects design. Adults and children quickly made use of combinatory information available at the action to generate anticipatory looks to the target object. Speed of anticipatory fixations did not vary with age. When controlling for age, individuals with higher vocabularies were faster to look to the target than those with lower vocabulary scores. Together, these results support and extend current views of incremental processing in which adults and children make use of linguistic information to continuously update their mental representation of ongoing language.
We investigated the impact of contextual constraint on the integration of novel word meanings into semantic memory. Adults read strongly or weakly constraining sentences ending in known or unknown (novel) words as scalp-recorded electrical brain activity was recorded. Word knowledge was assessed via a lexical decision task in which recently seen known and unknown word sentence endings served as primes for semantically related, unrelated, and synonym/identical target words. As expected, N400 amplitudes to target words preceded by known word primes were reduced by prime-target relatedness. Critically, N400 amplitudes to targets preceded by novel primes also varied with prime-target relatedness, but only when they had initially appeared in highly constraining sentences. This demonstrates for the first time that fast-mapped word representations can develop strong associations with semantically related word meanings and reveals a rapid neural process that can integrate information about word meanings into the mental lexicon of young adults.
Learning words is central in human development. However, lacking clear evidence for how or where language is processed in the developing brain, it is unknown whether these processes are similar in infants and adults. Here, we use magnetoencephalography in combination with high-resolution structural magnetic resonance imaging to noninvasively estimate the spatiotemporal distribution of word-selective brain activity in 12- to 18-month-old infants. Infants watched pictures of common objects and listened to words that they understood. A subset of these infants also listened to familiar words compared with sensory control sounds. In both experiments, words evoked a characteristic event-related brain response peaking ∼400 ms after word onset, which localized to left frontotemporal cortices. In adults, this activity, termed the N400m, is associated with lexico-semantic encoding. Like adults, we find that the amplitude of the infant N400m is also modulated by semantic priming, being reduced to words preceded by a semantically related picture. These findings suggest that similar left frontotemporal areas are used for encoding lexico-semantic information throughout the life span, from the earliest stages of word learning. Furthermore, this ontogenetic consistency implies that the neurophysiological processes underlying the N400m may be important both for understanding already known words and for learning new words.
Bilingualism provides a unique opportunity for understanding the relative roles of proficiency and order of acquisition in determining how the brain represents language. In a previous study, we combined magnetoencephalography (MEG) and magnetic resonance imaging (MRI) to examine the spatiotemporal dynamics of word processing in a group of Spanish-English bilinguals who were more proficient in their native language. We found that from the earliest stages of lexical processing, words in the second language evoke greater activity in bilateral posterior visual regions, while activity to the native language is largely confined to classical left hemisphere fronto-temporal areas. In the present study, we sought to examine whether these effects relate to language proficiency or order of language acquisition by testing Spanish-English bilingual subjects who had become dominant in their second language. Additionally, we wanted to determine whether activity in bilateral visual regions was related to the presentation of written words in our previous study, so we presented subjects with both written and auditory words. We found greater activity for the less proficient native language in bilateral posterior visual regions for both the visual and auditory modalities, which started during the earliest word encoding stages and continued through lexico-semantic processing. In classical left fronto-temporal regions, the two languages evoked similar activity. Therefore, it is the lack of proficiency rather than secondary acquisition order that determines the recruitment of non-classical areas for word processing.
Garrison W. Cottrell合作论文数Computer Science & Engineering Department, University of California, San Diego2