From the Publisher:
This book takes an empirical approach to language processing, based on applying statistical and other machine-learning algorithms to large corpora.Methodology boxes are included in each chapter. Each chapter is built around one or more worked examples to demonstrate the main idea of the chapter. Covers the fundamental algorithms of various fields, whether originally proposed for spoken or written language to demonstrate how the same algorithm can be used for speech recognition and word-sense disambiguation. Emphasis on web and other practical applications. Emphasis on scientific evaluation. Useful as a reference for professionals in any of the areas of speech and language processing.

/pdf/speech-and-language-processing-an-introduction-to-natural-atzaecqfem.pdf

Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition

Social Network Analysis

In this paper we explore a new theory of discourse structure that stresses the role of purpose and processing in discourse. In this theory, discourse structure is composed of three separate but interrelated components: the structure of the sequence of utterances (called the linguistic structure), a structure of purposes (called the intentional structure), and the state of focus of attention (called the attentional state). The linguistic structure consists of segments of the discourse into which the utterances naturally aggregate. The intentional structure captures the discourse-relevant purposes, expressed in each of the linguistic segments as well as relationships among them. The attentional state is an abstraction of the focus of attention of the participants as the discourse unfolds. The attentional state, being dynamic, records the objects, properties, and relations that are salient at each point of the discourse. The distinction among these components is essential to provide an adequate explanation of such discourse phenomena as cue phrases, referring expressions, and interruptions.The theory of attention, intention, and aggregation of utterances is illustrated in the paper with a number of example discourses. Various properties of discourse are described, and explanations for the behavior of cue phrases, referring expressions, and interruptions are explored.This theory provides a framework for describing the processing of utterances in a discourse. Discourse processing requires recognizing how the utterances of the discourse aggregate into segments, recognizing the intentions expressed in the discourse and the relationships among intentions, and tracking the discourse through the operation of the mechanisms associated with attentional state. This processing description specifies in these recognition tasks the role of information from the discourse and from the participants' knowledge of the domain.

Attention, intention, and the structure of discourse

/pdf/attention-intentions-and-the-structure-of-discourse-sat0ew257g.pdf

Attention, intentions, and the structure of discourse

Currently, computational linguists and cognitive scientists working in the area of discourse and dialogue argue that their subjective judgments are reliable using several different statistics, none of which are easily interpretable or comparable to each other. Meanwhile, researchers in content analysis have already experienced the same difficulties and come up with a solution in the kappa statistic. We discuss what is wrong with reliability measures as they are currently used for discourse and dialogue work in computational linguistics and cognitive science, and argue that we would be better off as a field adopting techniques from content analysis.

Assessing agreement on classification tasks: the kappa statistic

Thesis (Ph.D.)--Massachusetts Institute of Technology, Dept. of Linguistics and Philosophy, 1980.

The phonology and phonetics of English intonation

To appear in J. Bybee & P. Hopper (eds.), Frequency effects and emergent grammar. Amsterdam: John Benjamins. Exemplar theory was first developed as a model of similarity and classification in perception. In this paper, the theory is extended to model speech production as well as speech perception. Straightforward extension of the model provides a formal framework for thinking about the quantitative predictions of usage-based phonology, as proposed by Bybee. A model is proposed which allows us to derive the finding that leniting historical changes are more advanced in frequent words than in rarer ones. Calculations using this model are presented which reveal the interaction of production noise, lenition and entrenchment. A realistic treatment is also provided for the time course of a phonological merger which originates from lenition of a marked category.

/pdf/exemplar-dynamics-word-frequency-lenition-and-contrast-14m2zg5dea.pdf

Exemplar dynamics: Word frequency, lenition and contrast

"Japanese Tone Structure" provides a thorough, phonetically grounded description of accent and intonation in Tokyo Japanese and uses it to develop an explicit account of surface phonological representation. The unusual amount of quantitative phonetic data analyzed and its testing in a detailed model make this an important new study for theoretical phonologists, phoneticians, and specialists in Japanese.The authors' broader purpose, however, is to develop a general theory of surface representation that can capture salient facts about prosodic structure in all languages and provide a suitable input to phonetic rules. The theory integrates autosegmental principles into a metrical account of prosodic structures in an explicit formalism. The work establishes phonology and phonetics as a productive area in cognitive science.Janet B. Pierrehumbert is a member of the technical staff in the Department of Artificial Intelligence Research at AT&T Bell Laboratories. Mary E. Beckman is an Assistant Professor in the Department. of Linguistics at Ohio State University. "Japanese Tone Structure" is a Linguistic Inquiry Monograph.

Japanese Tone Structure

TOBI: a standard for labeling English prosody.

Comparisons between Japanese and English prosodics have usually either focused on the strikingly apparent phonetic differences between the stress patterns of English and the tonal accent patterns of Japanese or concentrated upon formal similarities between the abstract arrangements of the stresses and tones. A recent investigation of tone structure in Japanese (Pierrehumbert & Beckman forthcoming), however, has convinced us that if the proper prosodic phenomena are compared, far more pervasive similarities can be discovered and of a much more concrete sort than hitherto suspected. In particular, there is now extensive evidence that Japanese tonal patterns are very sparsely specified, which suggests that they are much more similar to English intonational structures than earlier descriptions would have allowed.

https://www.cambridge.org/core/services/aop-cambridge-core/content/view/S095267570000066X

Janet B. Pierrehumbert

Papers

The phonology and phonetics of English intonation

Exemplar dynamics: Word frequency, lenition and contrast

Japanese Tone Structure

TOBI: a standard for labeling English prosody.

Intonational structure in Japanese and English