Data Mining Practical Machine Learning Tools and Techniques

IEEE Transactions on Pattern Analysis and Machine Intelligence

Newness and distinctiveness is claimed in the features of ornamentation as shown inside the broken line circle in the accompanying representation.

Display screen or portion thereof with graphical user interface

This paper presents WiSee, a novel gesture recognition system that leverages wireless signals (e.g., Wi-Fi) to enable whole-home sensing and recognition of human gestures. Since wireless signals do not require line-of-sight and can traverse through walls, WiSee can enable whole-home gesture recognition using few wireless sources. Further, it achieves this goal without requiring instrumentation of the human body with sensing devices. We implement a proof-of-concept prototype of WiSee using USRP-N210s and evaluate it in both an office environment and a two- bedroom apartment. Our results show that WiSee can identify and classify a set of nine gestures with an average accuracy of 94%.

/pdf/whole-home-gesture-recognition-using-wireless-signals-4tosup7gjr.pdf

Whole-home gesture recognition using wireless signals

Thin-film electronics in its myriad forms has underpinned much of the technological innovation in the fields of displays, sensors, and energy conversion over the past four decades. This technology also forms the basis of flexible electronics. Here we review the current status of flexible electronics and attempt to predict the future promise of these pervading technologies in healthcare, environmental monitoring, displays and human-machine interactivity, energy conversion, management and storage, and communication and wireless networks.

Flexible Electronics: The Next Ubiquitous Platform

An electronic device includes a touch-sensitive surface, for example a touch pad or touch screen. The user interacts with the touch-sensitive surface, producing touch interactions. The resulting actions taken depend at least in part on the touch type. For example, the same touch interactions performed by three different touch types of a finger pad, a finger nail and a knuckle, may result in the execution of different actions.

Using Finger Touch Types to Interact with Electronic Devices

Compact, worn computers with projected, on-skin touch interfaces have been a long-standing yet elusive goal, largely written off as science fiction. Such devices offer the potential to mitigate the significant human input/output bottleneck inherent in worn devices with small screens. In this work, we present the first fully functional and self-contained projection smartwatch implementation, containing the requisite compute, power, projection and touch-sensing capabilities. Our watch offers roughly 40 sq. cm of interactive surface area -- more than five times that of a typical smartwatch display. We demonstrate continuous 2D finger tracking with interactive, rectified graphics, transforming the arm into a touchscreen. We discuss our hardware and software implementation, as well as evaluation results regarding touch accuracy and projection visibility.

LumiWatch: On-Arm Projected Graphics and Touch Input

We present Lumitrack, a novel motion tracking technology that uses projected structured patterns and linear optical sensors. Each sensor unit is capable of recovering 2D location within the projection area, while multiple sensors can be combined for up to six degree of freedom (DOF) tracking. Our structured light approach is based on special patterns, called m-sequences, in which any consecutive sub-sequence of m bits is unique. Lumitrack can utilize both digital and static projectors, as well as scalable embedded sensing configurations. The resulting system enables high-speed, high precision, and low-cost motion tracking for a wide range of interactive applications. We detail the hardware, operation, and performance characteristics of our approach, as well as a series of example applications that highlight its immediate feasibility and utility.

Lumitrack: low cost, high precision, high speed tracking with projected m -sequences

Smart and responsive environments rely on the ability to detect physical events, such as appliance use and human activities. Currently, to sense these types of events, one must either upgrade to "smart" appliances, or attach aftermarket sensors to existing objects. These approaches can be expensive, intrusive and inflexible. In this work, we present Vibrosight, a new approach to sense activities across entire rooms using long-range laser vibrometry. Unlike a microphone, our approach can sense physical vibrations at one specific point, making it robust to interference from other activities and noisy environments. This property enables detection of simultaneous activities, which has proven challenging in prior work. Through a series of evaluations, we show that Vibrosight can offer high accuracies at long range, allowing our sensor to be placed in an inconspicuous location. We also explore a range of additional uses, including data transmission, sensing user input and modes of appliance operation, and detecting human movement and activities on work surfaces.

Vibrosight: Long-Range Vibrometry for Smart Environment Sensing

An apparatus classifies touch events. The apparatus includes a touch sensitive surface configured to generate a touch event when an object touches the touch sensitive surface. The touch event entails a mechanical vibration upon contact with the surface. The apparatus includes a touch event detector configured to detect the onset of a touch, and a touch event classifier configured to classify the touch event to identify the object used for the touch event. The mechanical vibration is created via any one of finger parts including a tip, a pad, a fingernail, and a knuckle, each of which has a unique feature different from each other.

Chris Harrison

Papers

Using Finger Touch Types to Interact with Electronic Devices

LumiWatch: On-Arm Projected Graphics and Touch Input

Lumitrack: low cost, high precision, high speed tracking with projected m -sequences

Vibrosight: Long-Range Vibrometry for Smart Environment Sensing

Method and apparatus for classifying touch events on a touch sensitive surface