The last 20 years have seen ever-increasing research activity in the field of human activity recognition. With activity recognition having considerably matured, so has the number of challenges in designing, implementing, and evaluating activity recognition systems. This tutorial aims to provide a comprehensive hands-on introduction for newcomers to the field of human activity recognition. It specifically focuses on activity recognition using on-body inertial sensors. We first discuss the key research challenges that human activity recognition shares with general pattern recognition and identify those challenges that are specific to human activity recognition. We then describe the concept of an Activity Recognition Chain (ARC) as a general-purpose framework for designing and evaluating activity recognition systems. We detail each component of the framework, provide references to related research, and introduce the best practice methods developed by the activity recognition research community. We conclude with the educational example problem of recognizing different hand gestures from inertial sensors attached to the upper and lower arm. We illustrate how each component of this framework can be implemented for this specific activity recognition problem and demonstrate how different implementations compare and how they impact overall recognition performance.

A tutorial on human activity recognition using body-worn inertial sensors

A Tutorial on Human Activity Recognition Using Body-Worn

Research on sensor-based activity recognition has, recently, made significant progress and is attracting growing attention in a number of disciplines and application domains. However, there is a lack of high-level overview on this topic that can inform related communities of the research state of the art. In this paper, we present a comprehensive survey to examine the development and current status of various aspects of sensor-based activity recognition. We first discuss the general rationale and distinctions of vision-based and sensor-based activity recognition. Then, we review the major approaches and methods associated with sensor-based activity monitoring, modeling, and recognition from which strengths and weaknesses of those approaches are highlighted. We make a primary distinction in this paper between data-driven and knowledge-driven approaches, and use this distinction to structure our survey. We also discuss some promising directions for future research.

Sensor-Based Activity Recognition

Ambient Intelligence (AmI) is a new paradigm in information technology aimed at empowering people's capabilities by means of digital environments that are sensitive, adaptive, and responsive to human needs, habits, gestures, and emotions. This futuristic vision of daily environment will enable innovative human-machine interactions characterized by pervasive, unobtrusive, and anticipatory communications. Such innovative interaction paradigms make AmI technology a suitable candidate for developing various real life solutions, including in the healthcare domain. This survey will discuss the emergence of AmI techniques in the healthcare domain, in order to provide the research community with the necessary background. We will examine the infrastructure and technology required for achieving the vision of AmI, such as smart environments and wearable medical devices. We will summarize the state-of-the-art artificial intelligence (AI) methodologies used for developing AmI system in the healthcare domain, including various learning techniques (for learning from user interaction), reasoning techniques (for reasoning about users' goals and intensions), and planning techniques (for planning activities and interactions). We will also discuss how AmI technology might support people affected by various physical or mental disabilities or chronic disease. Finally, we will point to some of the successful case studies in the area and we will look at the current and future challenges to draw upon the possible future research paths.

/pdf/a-survey-on-ambient-intelligence-in-healthcare-wkvwfodws9.pdf

A Survey on Ambient Intelligence in Healthcare

RF-powered computers are small devices that compute and communicate using only the power that they harvest from RF signals. While existing technologies have harvested power from ambient RF sources (e.g., TV broadcasts), they require a dedicated gateway (like an RFID reader) for Internet connectivity. We present Wi-Fi Backscatter, a novel communication system that bridges RF-powered devices with the Internet. Specifically, we show that it is possible to reuse existing Wi-Fi infrastructure to provide Internet connectivity to RF-powered devices. To show Wi-Fi Backscatter's feasibility, we build a hardware prototype and demonstrate the first communication link between an RF-powered device and commodity Wi-Fi devices. We use off-the-shelf Wi-Fi devices including Intel Wi-Fi cards, Linksys Routers, and our organization's Wi-Fi infrastructure, and achieve communication rates of up to 1 kbps and ranges of up to 2.1 meters. We believe that this new capability can pave the way for the rapid deployment and adoption of RF-powered devices and achieve ubiquitous connectivity via nearby mobile devices that are Wi-Fi enabled.

/pdf/wi-fi-backscatter-internet-connectivity-for-rf-powered-4nynz6f8gp.pdf

Wi-fi backscatter: internet connectivity for RF-powered devices

We explore a dense sensing approach that uses RFID sensor network technology to recognize human activities. In our setting, everyday objects are instrumented with UHF RFID tags called WISPs that are equipped with accelerometers. RFID readers detect when the objects are used by examining this sensor data, and daily activities are then inferred from the traces of object use via a Hidden Markov Model. In a study of 10 participants performing 14 activities in a model apartment, our approach yielded recognition rates with precision and recall both in the 90% range. This compares well to recognition with a more intrusive short-range RFID bracelet that detects objects in the proximity of the user; this approach saw roughly 95% precision and 60% recall in the same study. We conclude that RFID sensor networks are a promising approach for indoor activity monitoring.

/pdf/recognizing-daily-activities-with-rfid-based-sensors-263hdr1q13.pdf

Recognizing daily activities with RFID-based sensors

We present the WISP passive data logger (PDL), an RFID sensor data logging platform that relies on a new, wirelessly-charged power model. A PDL has no battery yet (unlike a passive sensor tag) is able to collect data while away from an RFID reader. A PDL senses and logs data using energy stored in a capacitor; the capacitor can be wirelessly recharged (unlike active tags), and data can be uploaded whenever the PDL is near a reader. Standard EPC generation 2 readers are used for WISP-PDL charging, ID-reading, and sensor data transfer. This allows WISP-PDLs to operate using commercial RFID readers as the only support infrastructure (for both data and power), and allows WISP-PDLs to co-exist with standard RFID tags. We describe the design and implementation of a prototype WISP-PDL, and report results from a short demonstration study that shows it can monitor the temperature and fullness of a milk carton as it is used over the course of a day.

Wirelessly-Charged UHF Tags for Sensor Data Collection

We present the NeuralWISP, a wireless neural interface operating from far-field radio-frequency RF energy The NeuralWISP is compatible with commercial RF identification readers and operates at a range up to 1 m It includes a custom low-noise, low-power amplifier integrated circuit for processing the neural signal and an analog spike detection circuit for reducing digital computational requirements and communications bandwidth Our system monitors the neural signal and periodically transmits the spike density in a user-programmable time window The entire system draws an average 20 muA from the harvested 18-V supply

NeuralWISP: A Wirelessly Powered Neural Interface With 1-m Range

We demonstrate a simple RFID sensor network comprised of an Intel WISP and a commodity UHF RFID reader. WISPs are devices that gather their operating energy from RFID reader transmissions, in the manner of passive RFID tags, and further include sensors, e.g., accelerometers, and provide a very small-scale computing platform. We believe that the small form factor and lack of battery makes the WISP an attractive alternative to motes for many of the original smart dust applications that require very small or long-lived sensors. The Intel WISP that we demonstrate has an ultra-low-power microcontroller, 32K of program space, 8K of flash, and accelerometer and temperature sensors. It harvests power from and communicates sensor data to standard (EPC Class 1 Gen 2) UHF RFID readers with a range of roughly 10 feet. This combination of RFID technology and sensor networks raises many research challenges, such as how to function with intermittent power and how to modify RFID protocols to support sensor queries.

RFID sensor networks with the Intel WISP

We present the NeuralWISP, a wireless neural interface operating from harvested RF energy. The NeuralWISP is compatible with commercial RFID readers and operates at a range up to 1m. It includes a custom low-noise, low power amplifier IC for processing the neural signal and an analog spike detection circuit for reducing digital computational requirements and communications bandwidth. Our system monitors the neural signal and periodically transmits the spike density in a user-programmable time window. The entire system draws an average 20 muA from the harvested 1.8V supply.

Richa Prasad

Papers

Recognizing daily activities with RFID-based sensors

Wirelessly-Charged UHF Tags for Sensor Data Collection

NeuralWISP: A Wirelessly Powered Neural Interface With 1-m Range

RFID sensor networks with the Intel WISP

NeuralWISP: An energy-harvesting wireless neural interface with 1-m range