An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

A mobile terminal including a body; a touchscreen provided to a front and extending to side of the body and configured to display content; and a controller configured to detect one side of the body comes into contact with one side of an external terminal, display a first area on the touchscreen corresponding to a contact area of the body and the external terminal and a second area including the content, receive an input of moving the content displayed in the second area to the first area, display the content in the first area, and share the content in the first area with the external terminal.

Mobile terminal and method for controlling the same

Systems and methods are provided for receiving speech and non-speech communications of natural language questions and/or commands, transcribing the speech and non-speech communications to textual messages, and executing the questions and/or commands. The invention applies context, prior information, domain knowledge, and user specific profile data to achieve a natural environment for one or more users presenting questions or commands across multiple domains. The systems and methods creates, stores and uses extensive personal profile information for each user, thereby improving the reliability of determining the context of the speech and non-speech communications and presenting the expected results for a particular question or command.

Systems and methods for responding to natural language speech utterance

A necessary condition for visually guided action is that an organism perceive what actions are afforded by a given environmental situation. Warren (1984) proposed that an affordance such as the climbability of a stairway is determined by the fit between properties of the environment and the organism and can be characterized by optimal points, where action is most comfortable or efficient, and critical points, where a phase transition to a new action occurs. Perceiving an affordance, then, implies perceiving the relation between the environment and the observer's own action system. The present study is an extension of this analysis to the visual guidance of walking through apertures. We videotaped large and small subjects walking through apertures of different widths to determine empirically the critical aperture-to-shoulder-width ratio (A/S) marking the transition from frontal walking to body rotation. These results were compared with perceptual judgments of "passability" under static and moving viewing conditions. Finally, we tested the hypothesis that such judgments are based on intrinsic or body-scaled information specifying aperture width as a ratio of the observer's eyeheight. We conclude (a) that the critical point in free walking occurs at A/S = 1.30, (b) that static monocular information is sufficient for judging passability, and (c) that the perception of passability under such conditions is based on body-scaled eyeheight information.

http://www.cog.brown.edu/Research/ven_lab/Publications/WarrenWhang_Aperture_JEP87.pdf

Visual guidance of walking through apertures: body-scaled information for affordances.

Second language acquisition (SLA) is a field that investigates child and adult SLA from a variety of theoretical perspectives. This article provides a survey of some key areas of concern including formal generative theory and emergentist theory in the areas of morpho-syntax and phonology. The review details the theoretical stance of the two different approaches to the nature of language: generative linguistics and general cognitive approaches. Some results of key acquisition studies from the two theoretical frameworks are discussed. From a generative perspective, constraints on wh-movement, feature geometry and syllable structure, and morphological development are highlighted. From a general cognitive point of view, the emergence of tense and aspect marking from a prototype account of inherent lexical aspect is reviewed. Reference is made to general cognitive learning theories and to sociocultural theory. The article also reviews individual differences research, specifically debate on the critical period in adult language acquisition, motivation, and memory. Finally, the article discusses the relationship between SLA research and second language pedagogy. Suggestions for further reading from recent handbooks on SLA are provided. WIREs Cogni Sci 2011 2 277-286 DOI: 10.1002/wcs.106 For further resources related to this article, please visit the WIREs website.

Second language acquisition.

According to some aspects, a method of monitoring an acoustic environment of a mobile device, at least one computer readable medium encoded with instructions that, when executed, perform such a method and/or a mobile device configured to perform such a method is provided. The method comprises receiving, by the mobile device, acoustic input from the environment of the mobile device, detecting whether the acoustic input includes a voice command from a user without requiring receipt of an explicit trigger from the user, and initiating responding to the detected voice command.

Methods and apparatus for detecting a voice command

A method of speech recognition is described for use with mobile devices. A portion of an initial speech recognition result is presented on the mobile device including a set of general alternate recognition hypotheses associated with the portion of the speech recognition result. A key input representative of one or more associated letters is received from the user. The user is provided with a set of restricted alternate recognition hypotheses starting with the one or more letters associated with the key input. Then a user selection is accepted of one of the restricted alternate recognition hypotheses to represent a corrected speech recognition result.

Mobile dictation correction user interface

One aspect includes determining validity of an identity asserted by a speaker using a voice print associated with a user whose identity the speaker is asserting, the voice print obtained from characteristic features of at least one first voice signal obtained from the user uttering at least one enrollment utterance including at least one enrollment word by obtaining a second voice signal of the speaker uttering at least one challenge utterance that includes at least one word not in the at least one enrollment utterance, obtaining at least one characteristic feature from the second voice signal, comparing the at least one characteristic feature with at least a portion of the voice print to determine a similarity between the at least one characteristic feature and the at least a portion of the voice print, and determining whether the speaker is the user based, at least in part, on the similarity.

Speaker verification methods and apparatus

In some embodiments, the recognition results produced by a speech processing system (which may include two or more recognition results, including a top recognition result and one or more alternative recognition results) based on an analysis of a speech input, are evaluated for indications of potential significant errors. In some embodiments, the recognition results may be evaluated to determine whether a meaning of any of the alternative recognition results differs from a meaning of the top recognition result in a manner that is significant for a domain, such as the medical domain. In some embodiments, words and/or phrases that may be confused by an ASR system may be determined and associated in sets of words and/or phrases. Words and/or phrases that may be determined include those that change a meaning of a phrase or sentence when included in the phrase/sentence.

Detecting potential significant errors in speech recognition results

A method is described for improving the accuracy of a transcription generated by an automatic speech recognition (ASR) engine. A personal vocabulary is maintained that includes replacement words. The replacement words in the personal vocabulary are obtained from personal data associated with a user. A transcription is received of an audio recording. The transcription is generated by an ASR engine using an ASR vocabulary and includes a transcribed word that represents a spoken word in the audio recording. Data is received that is associated with the transcribed word. A replacement word from the personal vocabulary is identified, which is used to re-score the transcription and replace the transcribed word.

William F. Ganong

Papers

Methods and apparatus for detecting a voice command

Mobile dictation correction user interface

Speaker verification methods and apparatus

Detecting potential significant errors in speech recognition results

Systems and methods for improving the accuracy of a transcription using auxiliary data such as personal data