An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

A mobile terminal including a body; a touchscreen provided to a front and extending to side of the body and configured to display content; and a controller configured to detect one side of the body comes into contact with one side of an external terminal, display a first area on the touchscreen corresponding to a contact area of the body and the external terminal and a second area including the content, receive an input of moving the content displayed in the second area to the first area, display the content in the first area, and share the content in the first area with the external terminal.

Mobile terminal and method for controlling the same

A portable electronic device displays a plurality of icons (e.g., graphical objects) in a region in a touch-sensitive display; detects a predefined user action, with respect to the touch-sensitive display, for initiating a predefined user interface reconfiguration process; and varies positions of one or more icons in the plurality of icons in response to detecting the predefined user action. The varying includes varying the positions of the one or more icons about respective average positions.

Portable electronic device with interface reconfiguration mode

A virtual assistant uses context information to supplement natural language or gestural input from a user. Context helps to clarify the user's intent and to reduce the number of candidate interpretations of the user's input, and reduces the need for the user to provide excessive clarification input. Context can include any available information that is usable by the assistant to supplement explicit user input to constrain an information-processing problem and/or to personalize results. Context can be used to constrain solutions during various phases of processing, including, for example, speech recognition, natural language processing, task flow processing, and dialog generation.

Using context information to facilitate processing of commands in a virtual assistant

A mobile terminal and a method of controlling a mobile terminal may be provided. The mobile terminal may include a display to display one of a plurality of wallpapers including at least one icon; and a controller to display at least two of the plurality of wallpapers and a plurality of preview screens corresponding to the plurality of wallpapers on the display upon reception of an input of moving at least one icon, moving of the at least one icon being displayed on the displayed wallpapers and preview screens. The mobile terminal can display a movement of icon being displayed on the displayed wallpapers and preview screens. Accordingly, a user may intuitively recognize a location of icon and effectively move a location of icon.

Mobile terminal and method of controlling the same

Apparatuses and methods to sense proximity of an object and operate a proximity sensor of a portable device. In some embodiments, a method includes receiving an ambient light sensor (ALS) output, and altering, based on the ALS output, an effect of a proximity sensor output on control of a proximity determination. The ALS sensor and the proximity sensor may be located adjacent to an earpiece of a portable device. In some cases, the proximity determination may be a proximity of an object to the proximity sensor, and altering the effect may include changing the proximity of the object from a proximity greater than a first threshold to a proximity less than the first threshold. Other apparatuses and methods and data processing systems and machine readable media are also described.

Using ambient light sensor to augment proximity sensor output

A device that provides an audio output includes a speaker array mechanically fixed to the device. The speaker array includes at least three speakers. An orientation sensor detects an orientation of the speaker array and provides an orientation signal. An audio receiver receives a number of audio signals that include spatial position information. An audio processor is coupled to the speakers, the orientation sensor, and the audio receiver. The audio processor receives the audio signals and the orientation signal, and selectively routes the audio signals to the speakers according to the spatial position information and the orientation signal such that the spatial position information is perceptible to a listener. The orientation signal may be provided by a compass, an accelerometer, an inertial sensor, or other device. The orientation signal may be provided according to selection of display orientation, shape of touch input, image recognition of the listener, or the like.

Audio Channel Assignment for Audio Output in a Movable Device

Apparatuses and methods to operate a display device of an electronic device. In some embodiments, a method includes receiving a user setting of a display control parameter, and altering, based on the user setting, an effect of an ambient light sensor value (ALS) on control of the display control parameter. Also, according to embodiments of the inventions, a method of operating a display of an electronic device includes receiving a change to one of a display brightness output level and an ambient light sensor output level, and altering, according to the change, a display contrast output level. In some embodiments, a method of operating a proximity sensor of an electronic device includes receiving a light sensor output, and altering, according to the output, an on/off setting of a proximity sensor. Other apparatuses and methods and data processing systems and machine readable media are also described.

Backlight and ambient light sensor system

Multi-event input systems, methods, and devices for use in connection with touch-sensitive electronic devices are disclosed. In accordance with certain embodiments of the present disclosure, a third state called “hover” can be achieved on a touch-base user interface device in addition to the states of pointer down and pointer up. In an embodiment involving a capacitive touch-sensing surface, one way to achieve the third state is for the user to contact the touchpad or touch screen with a non-flesh part of a finger, such as a fingernail, rather than the fleshy part of a finger. In other embodiments, the non-flesh part may comprise an electrically insulative layer covering a portion of a finger. The third state enables an adjunct system's user interface to achieve active navigation around the screen in a pointer-up (or left-up) input tool condition. One result is that mouseover pop-ups can be used on touch screen devices. Another result is that tooltips can be used on touch screen devices. Another result is that text can be selected using touch screen devices.

Multi-event input system

An accessory for use with a portable computing device is provided. The accessory includes a keypad and a pedestal to house the control circuitry and provide mechanical stability for the accessory. The accessory includes a metal mass that performs dual functions of providing the mass for stability as well as acting as a ground connection for the keypad and other control circuitry. The accessory includes a connector for interfacing with a portable computing device and an additional connector for interfacing with an additional accessory.

Roberto G. Yepez

Papers

Using ambient light sensor to augment proximity sensor output

Audio Channel Assignment for Audio Output in a Movable Device

Backlight and ambient light sensor system

Multi-event input system

Accessory for a portable computing device