Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268

Statistical approaches to processing natural language text have become dominant in recent years This foundational text is the first comprehensive introduction to statistical natural language processing (NLP) to appear The book contains all the theory and algorithms needed for building NLP tools It provides broad but rigorous coverage of mathematical and linguistic foundations, as well as detailed discussion of statistical methods, allowing students and researchers to construct their own implementations The book covers collocation finding, word sense disambiguation, probabilistic parsing, information retrieval, and other applications

/pdf/foundations-of-statistical-natural-language-processing-1ou5e6c2q6.pdf

Foundations of Statistical Natural Language Processing

A theory of the way working memory capacity constrains comprehension is proposed. The theory proposes that both processing and storage are mediated by activation and that the total amount of activation available in working memory varies among individuals. Individual differences in working memory capacity for language can account for qualitative and quantitative differences among college-age adults in several aspects of language comprehension. One aspect is syntactic modularity: The larger capacity of some individuals permits interaction among syntactic and pragmatic information, so that their syntactic processes are not informationally encapsulated. Another aspect is syntactic ambiguity: The larger capacity of some individuals permits them to maintain multiple interpretations. The theory is instantiated as a production system model in which the amount of activation available to the model affects how it adapts to the transient computational and storage demands that occur in comprehension.

/pdf/a-capacity-theory-of-comprehension-individual-differences-in-4pgbsbb38c.pdf

A capacity theory of comprehension: individual differences in working memory.

This article describes the Dual Route Cascaded (DRC) model, a computational model of visual word recognition and reading aloud. The DRC is a computational realization of the dual-route theory of reading, and is the only computational model of reading that can perform the 2 tasks most commonly used to study reading: lexical decision and reading aloud. For both tasks, the authors show that a wide variety of variables that influence human latencies influence the DRC model's latencies in exactly the same way. The DRC model simulates a number of such effects that other computational models of reading do not, but there appear to be no effects that any other current computational model of reading can simulate but that the DRC model cannot. The authors conclude that the DRC model is the most successful of the existing computational models of reading.

DRC: a dual route cascaded model of visual word recognition and reading aloud.

This article describes a 2-systems model that explains social behavior as a joint function of reflective and impulsive processes. In particular, it is assumed that social behavior is controlled by 2 interacting systems that follow different operating principles. The reflective system generates behavioral decisions that are based on knowledge about facts and values, whereas the impulsive system elicits behavior through associative links and motivational orientations. The proposed model describes how the 2 systems interact at various stages of processing, and how their outputs may determine behavior in a synergistic or antagonistic fashion. It extends previous models by integrating motivational components that allow more precise predictions of behavior. The implications of this reflective–impulsive model are applied to various phenomena from social psychology and beyond. Extending previous dual-process accounts, this model is not limited to specific domains of mental functioning and attempts to integrate cognitive, motivational, and behavioral mechanisms.

/pdf/reflective-and-impulsive-determinants-of-social-behavior-fd62htt3ys.pdf

Reflective and Impulsive Determinants of Social Behavior

Ambiguity resolution is a central problem in language comprehension. Lexical and syntactic ambiguities are standardly assumed to involve different types of knowledge representations and be resolved by different mechanisms. An alternative account is provided in which both types of ambiguity derive from aspects of lexical representation and are resolved by the same processing mechanisms. Reinterpreting syntactic ambiguity resolution as a form of lexical ambiguity resolution obviates the need for special parsing principles to account for syntactic interpretation preferences, reconciles a number of apparently conflicting results concerning the roles of lexical and contextual information in sentence processing, explains differences among ambiguities in terms of ease of resolution, and provides a more unified account of language comprehension than was previously available.

The lexical nature of syntactic ambiguity resolution

M. A. Just and P. A. Carpenter’s (1992) capacity theory of comprehension posits a linguistic working memory functionally separated from the representation of linguistic knowledge. G. S. Waters and D. Caplan’s (1996) critique of this approach retained the notion of a separate working memory. In this article, the authors present an alternative account motivated by a connectionist approach to language comprehension. In their view, processing capacity emerges from network architecture and experience and is not a primitive that can vary independently. Individual differences in comprehension do not stem from variations in a separate working memory capacity; instead they emerge from an interaction of biological factors and language experience. This alternative is argued to provide a superior account of comprehension results previously attributed to a separate working memory capacity. The concept of a working memory resource or capacity for temporary storage and manipulation of information has played an important role in many theories of cognition, particularly theories of language processing (e.g., Baddeley, 1986; Engle, Cantor, & Carullo, 1992; Just & Carpenter, 1992). The particular approach advocated by Just and Carpenter (1992) is one in which linguistic working memory capacity directly constrains the operation of language comprehension processes, and that variation in the capacity of linguistic working memory within the normal population is a primary source of individual differences in language comprehension. Just and Carpenter further suggest that reductions in working memory capacity in aging can explain reduced language comprehension and production abilities among normal elderly adults and that aphasic patients’ language comprehension deficits following brain injury may be explained by a deficit in working memory capacity rather than by a loss of linguistic knowledge (Miyake, Carpenter, & Just, 1994). Just and Carpenter’s work has been extremely successful in emphasizing the importance of individual differences in language research, but their approach is not without controversy. Criticisms of their claims have taken several forms. Waters and Caplan (1996) suggested that there are at least two different working memory capacities that subserve language use, and they have sharply criticized the data that Just and Carpenter interpreted in support of a single working memory capacity (see also Caplan & Waters, 1999b; cf. Just, Carpenter, & Keller, 1996). Similarly, several aphasia researchers have suggested that a reduction of working memory capacity is not an adequate description of these

/pdf/reassessing-working-memory-comment-on-just-and-carpenter-27voasgtfk.pdf

Reassessing Working Memory: Comment on Just and Carpenter (1992) and Waters and Caplan (1996)

Working memory constraints on the processing of syntactic ambiguity

Language production processes can provide insight into how language comprehension works and language typology-why languages tend to have certain characteristics more often than others. Drawing on work in memory retrieval, motor planning, and serial order in action planning, the Production-Distribution-Comprehension (PDC) account links work in the fields of language production, typology, and comprehension: (1) faced with substantial computational burdens of planning and producing utterances, language producers implicitly follow three biases in utterance planning that promote word order choices that reduce these burdens, thereby improving production fluency. (2) These choices, repeated over many utterances and individuals, shape the distributions of utterance forms in language. The claim that language form stems in large degree from producers' attempts to mitigate utterance planning difficulty is contrasted with alternative accounts in which form is driven by language use more broadly, language acquisition processes, or producers' attempts to create language forms that are easily understood by comprehenders. (3) Language perceivers implicitly learn the statistical regularities in their linguistic input, and they use this prior experience to guide comprehension of subsequent language. In particular, they learn to predict the sequential structure of linguistic signals, based on the statistics of previously-encountered input. Thus, key aspects of comprehension behavior are tied to lexico-syntactic statistics in the language, which in turn derive from utterance planning biases promoting production of comparatively easy utterance forms over more difficult ones. This approach contrasts with classic theories in which comprehension behaviors are attributed to innate design features of the language comprehension system and associated working memory. The PDC instead links basic features of comprehension to a different source: production processes that shape language form.

/pdf/how-language-production-shapes-language-form-and-3avv9nkgh5.pdf

How language production shapes language form and comprehension.

Natural languages contain probabilistic constraints that influence the resolution of ambiguities. Current models of sentence processing agree that probabilistic constraints affect syntactic ambiguity resolution, but there has been little investigation of the constraints themselves-what they are, how they differ in their effects on processing, and how they interact with one another. Three different types of probabilistic constraints were investigated: “pre-ambiguity” plausibility information, information about verb argument structure frequencies, and “post-ambiguity” constraints that arrive after the introduction of the ambiguity but prior to its disambiguation. Reading times for syntactically ambiguous sentences were compared to reading times for unambiguous controls in three self-paced reading experiments. All three kinds of constraints were found to be helpful, and when several constraints converged, ambiguity resolution was facilitated compared to when constraints conflicted. The importance of...

Maryellen C. MacDonald

Papers

The lexical nature of syntactic ambiguity resolution

Reassessing Working Memory: Comment on Just and Carpenter (1992) and Waters and Caplan (1996)

Working memory constraints on the processing of syntactic ambiguity

How language production shapes language form and comprehension.

Probabilistic constraints and syntactic ambiguity resolution