An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

An electronic device may capture a voice command from a user. The electronic device may store contextual information about the state of the electronic device when the voice command is received. The electronic device may transmit the voice command and the contextual information to computing equipment such as a desktop computer or a remote server. The computing equipment may perform a speech recognition operation on the voice command and may process the contextual information. The computing equipment may respond to the voice command. The computing equipment may also transmit information to the electronic device that allows the electronic device to respond to the voice command.

Electronic Devices with Voice Command and Contextual Data Processing Capabilities

A method for operating a voice trigger is provided. In some implementations, the method is performed at an electronic device including one or more processors and memory storing instructions for execution by the one or more processors. The method includes receiving a sound input. The sound input may correspond to a spoken word or phrase, or a portion thereof. The method includes determining whether at least a portion of the sound input corresponds to a predetermined type of sound, such as a human voice. The method includes, upon a determination that at least a portion of the sound input corresponds to the predetermined type, determining whether the sound input includes predetermined content, such as a predetermined trigger word or phrase. The method also includes, upon a determination that the sound input includes the predetermined content, initiating a speech-based service, such as a voice-based digital assistant.

Voice trigger for a digital assistant

An integrated system includes a system user interface (SUI) that provides an iconic, at-a-glance representation of integrated security system status. The SUI is for use across all client devices including mobile or cellular telephones, a mobile portal, a web portal, and a touchscreen device. The SUI includes a number of display elements presented across all types of client devices for monitoring status of the integrated security system. The display elements of the SUI include an orb icon, text summary, security button, device warnings, system warnings, interesting sensors, and quiet sensors. The SUI thus provides system status summary information agnostically across all clients. Additionally, the SUI provides consistent iconography, terminology, and display rules across all clients as well as consistent sensor and system detail across clients.

Cross-client sensor user interface in an integrated security network

A device can be configured to receive speech input from a user. The speech input can include a command for accessing a restricted feature of the device. The speech input can be compared to a voiceprint (e.g., text-independent voiceprint) of the user's voice to authenticate the user to the device. Responsive to successful authentication of the user to the device, the user is allowed access to the restricted feature without the user having to perform additional authentication steps or speaking the command again. If the user is not successfully authenticated to the device, additional authentication steps can be request by the device (e.g., request a password).

Device access using voice authentication

At least one exemplary embodiment is directed to a listening device (100) can include a receiver (102) and means for directing a sound produced by the receiver into an ear of the user, a microphone (104) and means for mounting the microphone so as to receive the sound in an environment , detecting means for detecting an auditory signal in the sound received by the microphone, and alerting means for alerting the user to the presence of the auditory signal, whereby the user's personal safety is enhanced due to the user being alerted to the presence of the auditory signal, which otherwise may be unnoticed by the user due to loud sound level created at the ear of the user by the receiver.

Method and device for sound detection and audio control

At least one exemplary embodiment is directed to a website configured to collect sound signatures from around the world and beyond. A communication device automatically stores acoustic information received by a microphone of the communication device. The acoustic information is analyzed for a trigger event. The trigger event stores the acoustic information, attaches metadata, creates a Gaussian Mixture Model, and measures sound pressure level. The communication device automatically sends the sound signature to a database when a communication path is opened to communication device. Each sound signature has associated metadata including a time stamp and geocode. Automatically collecting sounds using a communication device adapted for the process enables a database that captures sounds globally on a continuous basis.

Sound library and method

At least one exemplary embodiment is directed to a method of generating a Personalized Audio Content (PAC) comprising: selecting Audio Content (AC) to personalize; selecting an Earprint; and generating a PAC using the Earprint to modify the AC.

Method of modifying audio content

At least one exemplary embodiment so directed to an earpiece (100). The earpiece can include an Ambient Sound Microphone (111) configured to capture ambient sound, an Ear Canal Microphone (123) configured to capture internal sound in the ear canal, a memory (208) configured to record at least a portion of the history of the ambient sound and the internal sound, and a processor (121) configured to save a recent portion of the history responsive to an event.

Method and device for audio recording

A system that records audio and stores the recording is provided. The system includes first and second monitoring assemblies mounted in an earpiece that occludes and forms an acoustic seal of an ear canal. The first monitoring assembly includes an ambient sound microphone (ASM) to monitor an ambient acoustic field and produce an ASM signal. The second monitoring assembly includes an ear canal microphone (ECM) to monitor an acoustic field within the ear canal and produce an ECM signal. The system also includes a data storage device configured to act as a circular buffer for continually storing at least one of the ECM signal or the ASM signal, a further data storage device and a record-activation system. The record-activation system activates the further data storage device to record a content of the data storage device.

Steven Wayne Goldstein

Papers

Method and device for sound detection and audio control

Sound library and method

Method of modifying audio content

Method and device for audio recording

Always on headwear recording system