Newness and distinctiveness is claimed in the features of ornamentation as shown inside the broken line circle in the accompanying representation.

Display screen or portion thereof with graphical user interface

A method is provided for modifying an image. The method comprises displaying an image, the image comprising a portion of an object; and determining if an edge of the object is in a location within the portion. The method further comprises detecting movement, in a member direction, of an operating member with respect to the edge. The method still further comprises moving, if the edge is not in the location, the object in an object direction corresponding to the detected movement; and modifying, if the edge is in the location, the image in response to the detected movement, the modified image comprising the edge in the location.

Information processing apparatus, information processing method and program

There is provided an information processing device including a display section configured to display a first object in a virtual three-dimensional space having a depth direction of a display screen, an operation section configured to acquire an operation for moving the first object in at least the depth direction, and a controller configured to move the first object on the display screen in accordance with the acquired operation, to execute, when a region of the first object overlaps a first overlap determination region, a first process to one or both of the first and second objects, and to execute, when the region of the first object overlaps a second overlap determination region, a second process to one or both of the first and second objects. The first overlap determination region may be a region obtained by extending the second overlap determination region in at least the depth direction.

Information processing device, information processing method, and program

In many complex tasks, a remote subject-matter expert may need to assist a local user to guide actions on objects in the local user's environment. However, effective spatial referencing and action demonstration in a remote physical environment can be challenging. We introduce two approaches that use Virtual Reality (VR) or Augmented Reality (AR) for the remote expert, and AR for the local user, each wearing a stereo head-worn display. Both approaches allow the expert to create and manipulate virtual replicas of physical objects in the local environment to refer to parts of those physical objects and to indicate actions on them. This can be especially useful for parts that are occluded or difficult to access. In one approach, the expert points in 3D to portions of virtual replicas to annotate them. In another approach, the expert demonstrates actions in 3D by manipulating virtual replicas, supported by constraints and annotations. We performed a user study of a 6DOF alignment task, a key operation in many physical task domains, comparing both approaches to an approach in which the expert uses a 2D tablet-based drawing system similar to ones developed for prior work on remote assistance. The study showed the 3D demonstration approach to be faster than the others. In addition, the 3D pointing approach was faster than the 2D tablet in the case of a highly trained expert.

https://dl.acm.org/doi/pdf/10.1145/2807442.2807497

Virtual Replicas for Remote Assistance in Virtual and Augmented Reality

An application on a mobile device provides for the initiation and submission of an insurance claim by capturing information and images of documents using an image capture capability, then processing the images to extract content which is transmitted to an insurance company for processing of the claim. Documents such as an automobile insurance card (AIC), driver's license, vehicle identification number (VIN), license plate, police report, damage estimate and repair invoice may all be captured and processed by image processing techniques on the mobile device or an image processing unit in order to extract relevant content. Other features and capabilities of the mobile device—such as video and image capture, location-based services, accelerometers and tracking—may automatically populate relevant fields of a claim report and permit the user to upload photographic and video evidence of an accident and related damage.

Systems and methods for filing insurance claims using mobile imaging

This paper presents an instructional support system based on augmented reality (AR). This system helps a user to work intuitively by overlaying visual information in the same way of a navigation system. In usual AR systems, the contents to be overlaid onto real space are created with 3D Computer Graphics. In most cases, such contents are newly created according to applications. However, there are many 2D videos that show how to take apart or build electric appliances and PCs, how to cook, etc. Therefore, our system employs such existing 2D videos as instructional videos. By transforming an instructional video to display, according to the user's view, and by overlaying the video onto the user's view space, the proposed system intuitively provides the user with visual guidance. In order to avoid the problem that the display of the instructional video and the user's view may be visually confused, we add various visual effects to the instructional video, such as transparency and enhancement of contours. By dividing the instructional video into sections according to the operations to be carried out in order to complete a certain task, we ensure that the user can interactively move to the next step in the instructional video after a certain operation is completed. Therefore, the user can carry on with the task at his/her own pace. In the usability test, users evaluated the use of the instructional video in our system through two tasks: a task involving building blocks and an origami task. As a result, we found that a user's visibility improves when the instructional video is transformed to display according to his/her view. Further, for the evaluation of visual effects, we can classify these effects according to the task and obtain the guideline for the use of our system as an instructional support system for performing various other tasks.

/pdf/task-support-system-by-displaying-instructional-video-onto-st9m405ome.pdf

Task support system by displaying instructional video onto AR workspace

A character input device for inputting a character by extracting and recognizing a character from an image of a document photographed by a photographing device includes the photographing device. The device stores a recognition result of the extracted and recognized character and reliability indicative of sureness of recognition. Character recognition results of images obtained by repeatedly photographing a whole or part of the document are compared in order to input the character based on a character recognition result whose reliability is highest. A character input method includes adding reliability indicative of sureness of recognition to a recognition result of the character, comparing character recognition results of images obtained by repeatedly photographing the whole or part of the document, and selecting a character recognition result whose reliability is highest. A computer-readable medium encoded with a character input program for inputting a character by extracting and recognizing a character is also disclosed.

Character input device, character input method and character input program

A difference region extracting section 122 extracts differential regions based on screen data of a previous screen stored in transmission screen data storage section 124 and a current screen stored in a screen data storage section 121. A priority determining section 123 calculates change data density indicating a degree of a change of pixel values for every differential region. For example, when a user operates an icon on the screen, the change data density of the differential region corresponding to the icon becomes larger than the change data density of the differential region corresponding to the background portion of a video image. An encoding section 125 writes screen code data of each differential region in a transmission buffer 141 in descending order of the change data density.

Screen data transmitting system, screen data transmitting server, screen data transmitting method and program recording medium

An automatic projection image correction system ( 1 ) includes: a projection image frame detection unit ( 101 ) that detects straight lines forming a frame of a screen-projected image which is projected onto a screen by a projector from a captured image obtained by capturing the screen-projected image using a camera; and a projector plane parameter estimation unit ( 102 ) that sets coordinate axes to a projector image, which is an original image of the screen-projected image, and the captured image and estimates at least one of a distance between the screen and the projector, an inclination of the screen with reference to an optical axis of the projector, and a zoom ratio of the projector, using an inclination of the optical axes of the projector and the camera, a distance between the optical centers of the projector and the camera, an intrinsic parameter of the camera, coordinate data of the detected straight lines at coordinates of the captured image, and coordinate data of straight lines corresponding to the frame at coordinates of the projector image.

Automatic projection image correction system, automatic projection image correction method, and non-transitory storage medium

The present invention generates a highly-accurate restored image while reducing computation costs by obtaining a similar effect to when the adjacent similarity of restoration patches is taken into consideration. This image processing device is provided with: a provisional restoration image generation means that uses a dictionary for storing at least two sets of data having associated therein a blurred patch and a restoration patch, and that generates a provisional restoration image from restoration patches selected on the basis of a value indicating the degree of similarity between blurred patches and a plurality of input patches generated by partitioning an externally-received input image; a provisional patch generation means that generates provisional patches by partitioning the provisional restoration image; and a restoration means that generates a restored image from restoration patches selected on the basis of the combined value of a value indicating the degree of similarity between the input patches and the blurred patches, and a value indicating the degree of similarity between the provisional patches and the restoration patches.

Shuji Senda

Papers

Task support system by displaying instructional video onto AR workspace

Character input device, character input method and character input program

Screen data transmitting system, screen data transmitting server, screen data transmitting method and program recording medium

Automatic projection image correction system, automatic projection image correction method, and non-transitory storage medium

Image processing device, and image processing method