Special skills are required in portrait painting, such as imagining geometric structures and facial detail for final portrait designs. This makes it a difficult task for users, especially novices without prior artistic training, to draw freehand portraits with high-quality details. In this paper, we propose dualFace, a portrait drawing interface to assist users with different levels of drawing skills to complete recognizable and authentic face sketches. Inspired by traditional artist workflows for portrait drawing, dualFace gives two-stages of drawing assistance to provide global and local visual guidance. The former helps users draw contour lines for portraits (i.e., geometric structure), and the latter helps users draw details of facial parts, which conform to the user-drawn contour lines. In the global guidance stage, the user draws several contour lines, and dualFace then searches for several relevant images from an internal database and displays the suggested face contour lines on the background of the canvas. In the local guidance stage, we synthesize detailed portrait images with a deep generative model from user-drawn contour lines, and then use the synthesized results as detailed drawing guidance. We conducted a user study to verify the effectiveness of dualFace, which confirms that dualFace significantly helps users to produce a detailed portrait sketch.

/pdf/dualface-two-stage-drawing-guidance-for-freehand-portrait-4513mqaek3.pdf

DualFace: Two-stage drawing guidance for freehand portrait sketching

In this work, we propose an interactive general instruction framework SketchMeHow to guidance the common users to complete the daily tasks in real-time. In contrast to the conventional augmented reality-based instruction systems, the proposed framework utilizes the user sketches as system inputs to acquire the users’ production intentions from the drawing interfaces. Given the user sketches, the designated task instruction can be analyzed based on the subtask division and spatial localization for each task. The projector-camera system is adopted in the projection guidance to the end-users with the spatial augmented reality technology. To verify the proposed framework, we conducted two case studies of domino arrangement and bento production. From our user studies, the proposed systems can help novice users complete the tasks efficiently with user satisfaction. We believe the proposed SketchMeHow can broaden the research topics in sketch-based real-world applications in human-computer interaction.

SketchMeHow: Interactive Projection Guided Task Instruction with User Sketches

In this study, we propose an interactive dance training support system to promote an individual's motivation for practicing dance. In order to motivate the user, we designe a scenario of dancing with friends (virtual characters) by adopting a projection-mapping technique to create a large-scale augmented reality space. We project the dancing scene on a three-sided wall-type transparent screen to improve the sense of immersion. The proposed system assigns scores by comparison of the user's movement to a target dance movement in real-time. The reactions of the projected characters provide feedback to the user interactively according to the calculated score. The advisor character can verbally encourage the user when the scores are low. Finally, we conduct a user study to verify the usefulness of the proposed system.

Interactive Dance Support System Using Spatial Augmented Reality

In this work, we propose a large-scale fabrication technique that uses newspapers with accessible and tractable properties. The system utilizes an interactive guidance system allowing common users to achieve large-scale newspaper sculptures from target 3D models. To maintain the fabrication shape, the proposed system provides an automatic design approach to create skeleton structures, which are formed from multiple chopsticks using the specialized connectors with 3D printing. Our system can support users in building complex newspaper sculptures. The interactive projection guidance is provided to visualize the differences between the depth maps of the target model and the current work so that the users can overlap the newspapers where needed. We evaluate the usefulness of the guidance system for fabrication support and the fabrication process with the proposed skeleton structure in our user study.

Skeleton-Based Interactive Fabrication for Large-Scale Newspaper Sculpture

In this paper, we propose dualFace, a portrait drawing interface to assist users with different levels of drawing skills to complete recognizable and authentic face sketches. dualFace consists of two-stage drawing assistance to provide global and local visual guidance: global guidance, which helps users draw contour lines of portraits (i.e., geometric structure), and local guidance, which helps users draws details of facial parts (which conform to user-drawn contour lines), inspired by traditional artist workflows in portrait drawing. In the stage of global guidance, the user draws several contour lines, and dualFace then searches several relevant images from an internal database and displays the suggested face contour lines over the background of the canvas. In the stage of local guidance, we synthesize detailed portrait images with a deep generative model from user-drawn contour lines, but use the synthesized results as detailed drawing guidance. We conducted a user study to verify the effectiveness of dualFace, and we confirmed that dualFace significantly helps achieve a detailed portrait sketch. see this http URL

dualFace:Two-Stage Drawing Guidance for Freehand Portrait Sketching

It is a challenging task for common users to design and arrange the chain reaction with domino blocks In this paper, we propose, Sketch2Domino, an interactive chain reaction design and guidance system with the input of the user freeform sketches The proposed design system converts the captured user sketch into an arrangement graph of domino blocks Then, the system formats the graph into a valid chain reaction and provides visual guidance with interactive projection mapping The guidance system notices the user of the differences among the current blocks and the calculated results This system can support multi-users to complete the chain-reaction design in group collaboration It is verified that Sketch2Domino is convenient and helpful from our case studies

Sketch2Domino: Interactive Chain Reaction Design and Guidance

Constructing stroke correspondences between keyframes is one of the most important processes in the production pipeline of hand-drawn inbetweening frames. This process requires time-consuming manual work imposing a tremendous burden on the animators. We propose a method to estimate stroke correspondences between raster character images (keyframes) without vectorization processes. First, the proposed system separates the closed areas in each keyframe and estimates the correspondences between closed areas by using the characteristics of shape, depth, and closed area connection. Second, the proposed system estimates stroke correspondences from the estimated closed area correspondences. We demonstrate the effectiveness of our method by performing a user study and comparing the proposed system with conventional approaches.

Ryoma Miyauchi

Papers

Sketch2Domino: Interactive Chain Reaction Design and Guidance

Stroke Correspondence by Labeling Closed Areas

Stroke Correspondence by Labeling Closed Areas