Paul Milgram received the BASc degree from the University of Toronto in 1970, the MSEE degree from the Technion (Israel) in 1973 and the PhD degree from the University of Toronto in 1980 From 1980 to 1982 he was a ZWO Visiting Scientist and a NATO Postdoctoral in the Netherlands, researching automobile driving behaviour From 1982 to 1984 he was a Senior Research Engineer in Human Engineering at the National Aerospace Laboratory (NLR) in Amsterdam, where his work involved the modelling of aircraft flight crew activity, advanced display concepts and control loops with human operators in space teleoperation Since 1986 he has worked at the Industrial Engineering Department of the University of Toronto, where he is currently an Associate Professor and Coordinator of the Human Factors Engineering group He is also cross appointed to the Department of Psychology In 1993-94 he was an invited researcher at the ATR Communication Systems Research Laboratories, in Kyoto, Japan His research interests include display and control issues in telerobotics and virtual environments, stereoscopic video and computer graphics, cognitive engineering, and human factors issues in medicine He is also President of Translucent Technologies, a company which produces "Plato" liquid crystal visual occlusion spectacles (of which he is the inventor), for visual and psychomotor research

/pdf/a-taxonomy-of-mixed-reality-visual-displays-54v3x9pjl3.pdf

A Taxonomy of Mixed Reality Visual Displays

Methods and systems for processing touch inputs are disclosed. The invention in one respect includes reading data from a multipoint sensing device such as a multipoint touch screen where the data pertains to touch input with respect to the multipoint sensing device, and identifying at least one multipoint gesture based on the data from the multipoint sensing device.

Gestures for touch sensitive input devices

In this paper we discuss augmented reality (AR) displays in a general sense, within the context of a reality-virtuality (RV) continuum, encompassing a large class of `mixed reality' (MR) displays, which also includes augmented virtuality (AV). MR displays are defined by means of seven examples of existing display concepts in which real objects and virtual objects are juxtaposed. Essential factors which distinguish different MR display systems from each other are presented, first by means of a table in which the nature of the underlying scene, how it is viewed, and the observer's reference to it are compared, and then by means of a three dimensional taxonomic framework comprising: extent of world knowledge, reproduction fidelity, and extent of presence metaphor. A principal objective of the taxonomy is to clarify terminology issues and to provide a framework for classifying research across different disciplines.

/pdf/augmented-reality-a-class-of-displays-on-the-reality-3h6y5kudax.pdf

Augmented Reality : A class of displays on the reality-virtuality continuum

An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

A user interface method is disclosed. The method includes detecting a touch and then determining a user interface mode when a touch is detected. The method further includes activating one or more GUI elements based on the user interface mode and in response to the detected touch.

Mode-based graphical user interfaces for touch sensitive input devices

In a remote operation monitoring system and the like, it is a video processing apparatus capable of intuitively grasping an object operated by an operator and an operation result. The video processing apparatus includes a unit (310, 320, 2104, 2202) for storing information about at least one object displayed on a screen of a display unit; a unit (12, 2105) for designating information about the object; a unit (300, 2201) for searching the store unit based upon the designated information, and for obtaining information within the store unit corresponding to the designated information; and also a unit (20, 2103) for performing a process related to the object based on the obtained information. An operator can readily grasp an object to be operated and a result.

Video or information processing method and processing apparatus, and monitoring method and monitoring apparatus using the same

An information terminal system including a process control computer and a portable terminal device for inputting information to said process control computer and gaining information from said process control, includes component information storing means for storing information for distinguishing each one of plural components composing a plant and component identifying means for identifying a component from plural components composing a plant and existing in the direction indicated by and at the location of the portable terminal device, by using information for distinguishing each one of the plural components stored in the component information storing means

Information terminal system getting information based on a location and a direction of a portable terminal device

A maintenance service system for home electric appliances is disclosed which comprises a home electric appliance, a portable terminal which can communicate with said home electric appliance and an information providing server which can communicate with said portable terminal.

Maintenance service system for home electric appliances

PURPOSE:To designate the part to be observed in details and its resolution by deciding automatically the resolution of each part of an image depending on the allowable transmission quantity when the image data are sent while being compressed. CONSTITUTION:A transmission system 100 or a reception system 120 is provided with area designation means 123, 125 to designate an optional area in a moving image to designate a part that is desired to be observed in details by the user. Accordingly, image processing means 103,104 of the transmission system set the resolution of the designated area higher than that of the other areas to reduce the image data quantity. Or the resolution may be set by the user. The traffic of the communication network is measured and the resolution other than the designated area is decided to satisfy automatically the allowable transmission quantity.

Moving image communication system

When presentation is made while displaying presentation information on both of audience-site and presenter-site screens, presenter-site additional information for supporting the progress of presentation is not displayed on the audience-site screen but displayed on the presenter-site screen When drawing information displayed on the audience-site screen is to be displayed also on the presenter-site screen, the drawing information is displayed after abridged When presentation is made by using a plurality of screens and when presentation information is to be displayed on any one of the screens, the presentation information is automatically assigned to any one of the screens by assignment deciding functions As a result, the progress of presentation by the presenter can be smoothened

Masayuki Tani

Papers

Video or information processing method and processing apparatus, and monitoring method and monitoring apparatus using the same

Information terminal system getting information based on a location and a direction of a portable terminal device

Maintenance service system for home electric appliances

Moving image communication system

Presentation supporting method and apparatus therefor