Methods and systems for processing touch inputs are disclosed. The invention in one respect includes reading data from a multipoint sensing device such as a multipoint touch screen where the data pertains to touch input with respect to the multipoint sensing device, and identifying at least one multipoint gesture based on the data from the multipoint sensing device.

Gestures for touch sensitive input devices

A computer-implemented method for use in conjunction with a computing device with a touch screen display comprises: detecting one or more finger contacts with the touch screen display, applying one or more heuristics to the one or more finger contacts to determine a command for the device, and processing the command. The one or more heuristics comprise: a heuristic for determining that the one or more finger contacts correspond to a one- dimensional vertical screen scrolling command, a heuristic for determining that the one or more finger contacts correspond to a two-dimensional screen translation command, and a heuristic for determining that the one or more finger contacts correspond to a command to transition from displaying a respective item in a set of items to displaying a next item in the set of items.

Touch screen device, method, and graphical user interface for determining commands by applying heuristics

Newness and distinctiveness is claimed in the features of ornamentation as shown inside the broken line circle in the accompanying representation.

Display screen or portion thereof with graphical user interface

An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

A mobile terminal including a body; a touchscreen provided to a front and extending to side of the body and configured to display content; and a controller configured to detect one side of the body comes into contact with one side of an external terminal, display a first area on the touchscreen corresponding to a contact area of the body and the external terminal and a second area including the content, receive an input of moving the content displayed in the second area to the first area, display the content in the first area, and share the content in the first area with the external terminal.

Mobile terminal and method for controlling the same

The invention relates to a user interface for managing a controllable external device. The invention provides an electronic device, having a display, a touch-sensitive surface, one or more processors,and a memory, and the electronic device displays an indication of location on a first user interface screen. The device displays a representation of the controllable external device on the location on the first user interface screen. The device detects a first user input corresponding to the selection of the controllable external device, and in response to the detected first user input, displaysa user interface object indicating a plurality of possible states of the controllable external device. When displaying the user interface object indicating the plurality of possible states of the controllable external device, the device detects a second user input corresponding to the selection of the specified state of the controllable external device. In response to the detected second user input, the device sends an instruction to set the controllable external device to the specified state.

User interface for managing controllable external device

디스플레이 및 터치 감응형 표면을 갖는 전자 디바이스가 애플리케이션의 사용자 인터페이스를 디스플레이한다. 디바이스는 터치 감응형 표면 상의 접촉을 포함하는 입력의 제1 부분을 검출하고, 이어서 터치 감응형 표면을 가로지른 접촉의 이동을 포함하는 입력의 제2 부분을 검출한다. 디바이스는, 이동 동안, 애플리케이션의 사용자 인터페이스에 대응하는 애플리케이션 뷰 및 상이한 애플리케이션의 상이한 사용자 인터페이스에 대응하는 다른 애플리케이션 뷰를 포함하는 애플리케이션 뷰들을 디스플레이한다. 이어서, 디바이스는 터치 감응형 표면으로부터의 접촉의 리프트오프를 포함하는 입력의 제3 부분을 검출한다. 이에 응답하여, 디바이스는, 애플리케이션 스위처 디스플레이 기준들이 충족된다고 결정할 시에, 애플리케이션 스위처 사용자 인터페이스를 디스플레이하고, 홈 디스플레이 기준들이 충족된다고 결정할 시에, 디바이스는 애플리케이션 개시 아이콘들을 포함하는 홈 화면 사용자 인터페이스를 디스플레이한다.

사용자 인터페이스들 사이에 내비게이팅하고 제어 객체들과 상호작용하기 위한 디바이스, 방법, 및 그래픽 사용자 인터페이스

The present invention relates to a device and a method for measuring by using augmented reality. An electronic device displays a representation of a physical space, receives a first set of inputs, andadds a first virtual annotation to the representation of the physical space, the first virtual annotation being linked to a portion of the representation of the physical space. The electronic devicethen receives a second set of inputs. If the second set of inputs corresponds to a request to create a virtual annotation within a threshold distance from the first virtual annotation, the electronicdevice creates a second virtual annotation in the representation of the physical space while maintaining the first virtual annotation. If the second set of inputs corresponds to a request to create avirtual annotation outside of the threshold distance from the first virtual annotation, the electronic device creates a second virtual annotation in the representation of the physical space and removes the first virtual annotation.

Device and method for measuring by using augmented reality

An electronic device with a touch-sensitive surface and display can execute a messaging application. While displaying a plurality of message affordances, an action to compose a new message is received, and in response a first composition interface is displayed in a first position. In response to detection of a first gesture, the first composition interface is slid to a second position on the display. After detecting completion of the first gesture, in accordance with a determination that the movement of the first contact meets or exceeds a threshold criterion, the first composition interface is slid to a third position wherein at least a portion of the first composition interface is not displayed. In accordance with a determination that the movement of the first contact does not meet or exceed the threshold criterion, the first composition interface is slid to the first position on the display.

Displaying options for an electronic message in a messaging application

전자 디바이스는, 제1 사용자 인터페이스에서, 이미지들의 시퀀스에 대응하는 미디어 아이템을 미디어 아이템에 대한 복수의 사용자-선택가능 디스플레이 모드들 중 하나인 제1 디스플레이 모드에서 디스플레이한다. 디바이스는, 입력을 검출하는 것에 응답하여, 제2 디스플레이 모드에 대응하는 미디어 아이템의 제2 표현을 포함하는, 미디어 아이템의 표현들을 동시에 디스플레이하는 디스플레이-모드 선택 사용자 인터페이스를 디스플레이한다. 디바이스는 미디어 아이템의 복수의 표현들 중 제2 표현 상에서 입력을 검출한다. 이에 응답하여, 디바이스는 미디어 아이템에 대한 복수의 사용자-선택가능 디스플레이 모드들 중 제2 디스플레이 모드를 선택하며, 이는 미디어 아이템의 복수의 표현들 중 제2 표현에 대응한다.

Stephen O. Lemay

Papers

User interface for managing controllable external device

사용자 인터페이스들 사이에 내비게이팅하고 제어 객체들과 상호작용하기 위한 디바이스, 방법, 및 그래픽 사용자 인터페이스

Device and method for measuring by using augmented reality

Displaying options for an electronic message in a messaging application

다수의 디스플레이 모드를 갖는 미디어 아이템들을 탐색, 디스플레이, 및 편집하기 위한 디바이스, 방법, 및 그래픽 사용자 인터페이스