https://www.cse.unr.edu/~mircea/Publications/mn_cviu07.pdf

Vision-based hand pose estimation: A review

A method is presented for robust tracking in highly cluttered environments. The method makes effective use of 3D depth sensing technology, resulting in illumination-invariant tracking. A few applications using tracking are presented including face tracking and hand tracking.

Visual Tracking Using Depth Data

We present a multi-PC/camera system that can perform 3D reconstruction and ellipsoid fitting of moving humans in real time. The system consists of five cameras. Each camera is connected to a PC which locally extracts the silhouettes of the moving person in the image captured by the camera. The five silhouette images are then sent, via local network, to a host computer to perform 3D voxel-based reconstruction by an algorithm called SPOT. Ellipsoids are then used to fit the reconstructed data. By using a simple and user-friendly interface, the user can display and observe, in real time and from any view-point, the 3D models of the moving human body. With a rate of higher than 15 frames per second, the system is able to capture non-intrusively, a sequence of human motions.

A real time system for robust 3D voxel reconstruction of human motions

Enhanced image viewing, in which a user's gesture is recognized from first and second images, an interaction command corresponding to the recognized user's gesture is determined, and, based on the determined interaction command, an image object displayed in a user interface is manipulated.

Enhanced gesture-based image manipulation

This paper presents the Visual Touchpad, a low-cost vision-based input device that allows for fluid two-handed interactions with desktop PCs, laptops, public kiosks, or large wall displays. Two downward-pointing cameras are attached above a planar surface, and a stereo hand tracking system provides the 3D positions of a user's fingertips on and above the plane. Thus the planar surface can be used as a multi-point touch-sensitive device, but with the added ability to also detect hand gestures hovering above the surface. Additionally, the hand tracker not only provides positional information for the fingertips but also finger orientations. A variety of one and two-handed multi-finger gestural interaction techniques are then presented that exploit the affordances of the hand tracker. Further, by segmenting the hand regions from the video images and then augmenting them transparently into a graphical interface, our system provides a compelling direct manipulation experience without the need for more expensive tabletop displays or touch-screens, and with significantly less self-occlusion.

http://www.dgp.toronto.edu/~jflaszlo/papers/icmi-pui-2004/malik_2004_ICMI_visual_touchpad.pdf

兼司岡

Papers

適応的拡散制御を伴うパーティクルフィルタを用いた頭部姿勢推定システム(顔・身体動作認識, 画像の認識・理解論文)

兼司 岡

Papers

適応的拡散制御を伴うパーティクルフィルタを用いた頭部姿勢推定システム(顔・身体動作認識, 画像の認識・理解論文)

兼司岡