[서평]「Digital Video Processing」

Deep learning in video multi-object tracking: A survey

The evolving field of persuasive and behavior change technology is increasingly targeted at influencing behavior in the area of health and wellness. This paper provides an empirical review of 16 years (85 papers) of literature on persuasive technology for health and wellness to: (1.) answer important questions regarding the effectiveness of persuasive technology for health and wellness, (2.) summarize and highlight trends in the technology design, research methods, motivational strategies, theories, and health behaviors targeted by research to date, (3.) uncover pitfalls of existing persuasive technological interventions for health and wellness, and (4.) suggest directions for future research.

https://journals.sagepub.com/doi/pdf/10.1177/1460458216650979

Persuasive technology for health and wellness: State-of-the-art and emerging trends.

Microsoft Kinect, a low-cost motion sensing device, enables users to interact with computers or game consoles naturally through gestures and spoken commands without any other peripheral equipment. As such, it has commanded intense interests in research and development on the Kinect technology. In this paper, we present, a comprehensive survey on Kinect applications, and the latest research and development on motion recognition using data captured by the Kinect sensor. On the applications front, we review the applications of the Kinect technology in a variety of areas, including healthcare, education and performing arts, robotics, sign language recognition, retail services, workplace safety training, as well as 3D reconstructions. On the technology front, we provide an overview of the main features of both versions of the Kinect sensor together with the depth sensing technologies used, and review literatures on human motion recognition techniques used in Kinect applications. We provide a classification of motion recognition techniques to highlight the different approaches used in human motion recognition. Furthermore, we compile a list of publicly available Kinect datasets. These datasets are valuable resources for researchers to investigate better methods for human motion recognition and lower-level computer vision tasks such as segmentation, object detection and human pose estimation.

/pdf/a-survey-of-applications-and-human-motion-recognition-with-hags1y076t.pdf

A Survey of Applications and Human Motion Recognition with Microsoft Kinect

Sphere is a multi-user, multi-touch-sensitive spherical display in which an infrared camera used for touch sensing shares the same optical path with the projector used for the display. This novel configuration permits: (1) the enclosure of both the projection and the sensing mechanism in the base of the device, and (2) easy 360-degree access for multiple users, with a high degree of interactivity without shadowing or occlusion. In addition to the hardware and software solution, we present a set of multi-touch interaction techniques and interface concepts that facilitate collaborative interactions around Sphere. We designed four spherical application concepts and report on several important observations of collaborative activity from our initial Sphere installation in three high-traffic locations.

https://www.microsoft.com/en-us/research/wp-content/uploads/2016/10/Benko_Sphere_UIST2008.pdf

Sphere: multi-touch interactions on a spherical display

In this paper, we explore the challenges in applying and investigate methodologies to improve direct-touch interaction on intangible displays. Direct-touch interaction simplifies object manipulation, because it combines the input and display into a single integrated interface. While traditional tangible display-based direct-touch technology is commonplace, similar direct-touch interaction within an intangible display paradigm presents many challenges. Given the lack of tactile feedback, direct-touch interaction on an intangible display may show poor performance even on the simplest of target acquisition tasks. In order to study this problem, we have created a prototype of an intangible display. In the initial study, we collected user discrepancy data corresponding to the interpretation of 3D location of targets shown on our intangible display. The result showed that participants performed poorly in determining the z-coordinate of the targets and were imprecise in their execution of screen touches within the system. Thirty percent of positioning operations showed errors larger than 30mm from the actual surface. This finding triggered our interest to design a second study, in which we quantified task time in the presence of visual and audio feedback. The pseudo-shadow visual feedback was shown to be helpful both in improving user performance and satisfaction.

http://dmrussell.net/CHI2010/docs/p2625.pdf

Touching the void: direct-touch interaction for intangible displays

Images/videos captured from optical devices are usually degraded by turbid media such as haze, smoke, fog, rain and snow. Haze is the most common problem in outdoor scenes because of the atmosphere conditions. This paper proposes a novel single image-based dehazing framework to remove haze artifacts from images, where we propose two novel image priors, called the pixel-based dark channel prior and the pixel-based bright channel prior. Based on the two priors with the haze optical model, we propose to estimate atmospheric light via haze density analysis. We can then estimate transmission map, followed by refining it via the bilateral filter. As a result, high-quality haze-free images can be recovered with lower computational complexity compared with the state-of-the-art approach based on patch-based dark channel prior.

Haze effect removal from image via haze density estimation in optical model

In this study, a system is developed to measure human chest wall motion for respiratory volume estimation without any physical contact. Based on depth image sensing technique, respiratory volume is estimated by measuring morphological changes of the chest wall. We evaluated the system and compared with a standard reference device, and the results show strong agreement in respiratory volume measurement [correlation coefficient: r=0.966]. The isovolume test presents small variations of the total respiratory volume during the isovolume maneuver (standard deviation&#60;107 ml). Then, a regional pulmonary measurement test is evaluated by a patient, and the results show visibly difference of pulmonary functional between the diseased and the contralateral sides of the thorax after the thoracotomy. This study has big potential for personal health care and preventive medicine as it provides a novel, low-cost, and convenient way to measure user's respiration volume.

Noncontact respiratory measurement of volume change using depth camera

This paper presents a new method for accessing the aesthetic quality of videos. It consists of two processes: aesthetic features construction and temporal integration. First, our method combines both photo-based and motion-based visual clues to extract the aesthetic features for each frame in a video. We introduce new motion-based features built from optical flow and salient region extraction, and show their effectiveness to enhance the estimation of aesthetic values. Then, a temporal-order-aware framework that integrates the frame-based features is presented to further improve the evaluation accuracy by taking the time-varying properties into consideration. The experimental results demonstrate that our approach can accomplish remarkable improvement for aesthetic quality assessment of videos.

/pdf/video-aesthetic-quality-assessment-by-temporal-integration-4ilty0mgeh.pdf

Video Aesthetic Quality Assessment by Temporal Integration of Photo- and Motion-Based Features

In this study, a depth analysis technique was developed to monitor user’s breathing rate, sleep position, and body movement while sleeping without any physical contact. A cross-section method was proposed to detect user’s head and torso from the sequence of depth images. In the experiment, eight participants were asked to change the sleep positions (supine and side-lying) every fifteen breathing cycles on the bed. The results showed that the proposed method is promising to detect the head and torso with various sleeping postures and body shapes. In addition, a realistic over-night sleep monitoring experiment was conducted. The results demonstrated that this system is promising to monitor the sleep conditions in realistic sleep conditions and the measurement accuracy was better than the first experiment. This study is important for providing a non-contact technology to measure multiple sleep conditions and assist users in better understanding of his sleep quality.

Ming-Sui Lee

Papers

Touching the void: direct-touch interaction for intangible displays

Haze effect removal from image via haze density estimation in optical model

Noncontact respiratory measurement of volume change using depth camera

Video Aesthetic Quality Assessment by Temporal Integration of Photo- and Motion-Based Features

Multiparameter Sleep Monitoring Using a Depth Camera