The spatial features of emitted wireless signals are the basis of location distinction and determination for wireless indoor localization. Available in mainstream wireless signal measurements, the Received Signal Strength Indicator (RSSI) has been adopted in vast indoor localization systems. However, it suffers from dramatic performance degradation in complex situations due to multipath fading and temporal dynamics. Break-through techniques resort to finer-grained wireless channel measurement than RSSI. Different from RSSI, the PHY layer power feature, channel response, is able to discriminate multipath characteristics, and thus holds the potential for the convergence of accurate and pervasive indoor localization. Channel State Information (CSI, reflecting channel response in 802.11 a/g/n) has attracted many research efforts and some pioneer works have demonstrated submeter or even centimeter-level accuracy. In this article, we survey this new trend of channel response in localization. The differences between CSI and RSSI are highlighted with respect to network layering, time resolution, frequency resolution, stability, and accessibility. Furthermore, we investigate a large body of recent works and classify them overall into three categories according to how to use CSI. For each category, we emphasize the basic principles and address future directions of research in this new and largely open area.

From RSSI to CSI: Indoor Localization via Channel Response, A survey on indoor localization using PHY-layer information

The past years have witnessed the rapid conceptualization and development of wireless sensing based on Channel State Information (CSI) with commodity WiFi devices. Recent studies have demonstrated the vast potential of WiFi sensing in detection, recognition, and estimation applications. However, the widespread deployment of WiFi sensing systems still faces a significant challenge: how to ensure the sensing performance when exposing a pre-trained sensing system to new domains, such as new environments, different configurations, and unseen users, without data collection and system retraining. This survey provides a comprehensive review of recent research efforts on cross-domain WiFi Sensing. We first introduce the mathematical model of CSI and explore the impact of different domains on CSI. Then we present a general workflow of cross-domain WiFi sensing systems, which consists of signal processing and cross-domain sensing. Five cross-domain sensing algorithms, including domain-invariant feature extraction, virtual sample generation, transfer learning, few-shot learning and big data solution, are summarized to show how they achieve high sensing accuracy when encountering new domains. The advantages and limitations of each algorithm are also summarized and the performance comparison is made based on different applications. Finally, we discuss the remaining challenges to further promote the practical usability of cross-domain WiFi sensing systems.

Cross-Domain WiFi Sensing with Channel State Information: A Survey

Recently, device-free human behavior recognition has become a hot research topic and has achieved significant progress in the field of ubiquitous computing. Among various implementation, behavior recognition based on WiFi CSI (channel state information) has drawn wide attention due to its major advantages. This paper investigates more than 100 latest CSI based behavior recognition applications within the last 6 years and presents a comprehensive survey from every aspect of human behavior recognition. Firstly, this paper reviews general behavior recognition applications using the WiFi signal and presents the basic concept of CSI and the fundamental principle of CSI-based behavior recognition. This paper analyzes the key components and core characteristics of the system architecture of human behavior recognition using CSI. Afterward, we divide the sensing procedures into many steps and summarize the typical studies from these steps, including base signal selection, signal preprocessing, and identification approaches. Next, based on the recognition technique, we classify the applications into three groups, including pattern-based, model-based, and deep learning-based approach. In every group, we categorize the state-of-the-art applications into three groups, including coarse-grained specific behavior recognition, fine-grained specific behavior recognition, and activity inference. It elaborates the typical behavior recognition applications from five aspects, including experimental equipment, experimental scenario, behavior, classifier, and system performance. Then, this paper presents comprehensive discussions about representative applications from the implementation view and outlines the major consideration when developing a recognition system. Finally, this article concludes by analyzing the open issues of CSI-based behavior recognition applications and pointing out future research directions.

/pdf/a-survey-on-human-behavior-recognition-using-channel-state-17xs5detky.pdf

A Survey on Human Behavior Recognition Using Channel State Information

Existing fingerprint-based indoor localization uses either fine-grained channel state information (CSI) from the physical layer or coarse-grained received signal strength indicator (RSSI) measurements. In this paper, we propose to use a mid-grained intermediate-level channel measurement - spatial beam signal-to-noise ratios (SNRs) that are inherently available and defined in the IEEE 802.11ad/ay standards - to construct the fingerprinting database. These intermediate channel measurements are further utilized by a deep learning approach for multiple purposes: 1) location-only classification; 2) simultaneous location-and-orientation classification; and 3) direct coordinate estimation. Furthermore, the effectiveness of the framework is thoroughly validated by an in-house experimental platform consisting of 3 access points using commercial-off-the-shelf millimeter-wave WiFi routers. The results show a 100% accuracy if the location is only interested, about 99% for simultaneous location-and-orientations classification, and an averaged root mean-square error (RMSE) of 11.1 cm and an average median error of 9.5 cm for direct coordinate estimate, greater than 2-fold improvements over the RMSE of 28.7 cm and median error of 23.6 cm for RSSI-like single SNR-based localization.

/pdf/fingerprinting-based-indoor-localization-with-commercial-qb9vf6g67o.pdf

Fingerprinting-Based Indoor Localization With Commercial MMWave WiFi: A Deep Learning Approach

Wireless networks have been widely deployed with a high demand for wireless data traffic. The ubiquitous availability of wireless signals brings new opportunities for non-intrusive human activity sensing. To enhance a thorough understanding of existing wireless sensing techniques and provide insights for future directions, this survey conducts a review of the existing research on human activity sensing with wireless signals. We review and compare existing research of wireless human activity sensing from seven perspectives, including the types of wireless signals, theoretical models, signal preprocessing techniques, activity segmentation, feature extraction, classification, and application. With the development and deployment of new wireless technology, there will be more sensing opportunities in human activities. Based on the analysis of existing research, the survey points out seven challenges on wireless human activity sensing research: robustness, non-coexistence of sensing and communications, privacy, multiple user activity sensing, limited sensing range, complex deep learning, and lack of standard datasets. Finally, this survey presents four possible future research trends, including new theoretical models, the coexistence of sensing and communications, awareness of sensing on receivers, and constructing open datasets to enable new wireless sensing opportunities on human activities.

Human Activity Sensing with Wireless Signals: A Survey.

Recent years have witnessed increasing research interest in human behavior recognition as it provides attractive applications in various sensing scenarios. Among these encouraging implementations, device-free behavior recognition based on WiFi channel state information (CSI) has attracted significant attention due to the popularity of WiFi devices and abundant channel characteristics from CSI. Meanwhile, the CSI signal provides us with additional benefits because it can propagate through a wall. This through-the-wall and device-free scheme not only enables us to identify specific human actions but also to infer person activities by collecting the data from different rooms. This paper presents a survey on the state-of-art progresses in device-free through-the-wall human behavior recognition based on CSI. Specifically, this paper first introduces the basic concept of CSI and describes the signal variation caused by human behavior. Then, it illustrates that different human behaviors can cause signal transformation. Therefore, the unique map relationship between action and signal variation can be leveraged to recognize human behavior. Next, it provides the general architecture of through-the-wall behavior recognition and highlights its core characteristic. It investigates the state-of-art applications in various scenarios and analyzes specific design schemes and implementations. Afterward, it discusses the various across wall applications and makes a detailed comparison between non-through-the-wall and through-the-wall applications. Meanwhile, it analyzes many factors that affect recognition accuracy and emphasizes performance differences under across wall scenarios. Finally, this paper concludes by summarizing the issues and challenges faced and providing insights into the possible solution and future research trend.

A Survey on CSI-Based Human Behavior Recognition in Through-the-Wall Scenario

With the rapid development of Internet of Things, hand gesture recognition has drawn wide attention in the field of ubiquitous computing because it provides us with simple and natural human-computer interaction mode. Among these various implementations, hand gesture recognition using ultrasonic signals of smartphone has become a hot research topic due to its various advantages. In this paper, we consider the smartphone as an active sonar sensing system to identify hand movements. Specifically, the speakers emit ultrasonic signal and the microphone on the same phone receives the changed echo affected by hand movements. This paper investigates the state-of-the-art hand gesture applications and presents a comprehensive survey on the characteristics of studies using the active sonar sensing system. Firstly, we review the existing research of hand gesture recognition based on acoustic signals. After that, we introduce the characteristics of ultrasonic signal and describe the fundamental principle of hand gesture recognition. Then, we focus on the typical methods used in these studies and present a detailed analysis on signal generation, feature extraction, preprocessing, and recognition methods. Next, we investigate the state-of-the-art ultrasonic-based applications of hand gesture recognition using smartphone and analyze them in detail from dynamic gesture recognition and hand tracking. Afterwards, we make a discussion about these systems from signal acquisition, signal processing, and performance evaluation to obtain some insight into development of the ultrasonic hand gesture recognition system. Finally, we conclude by discussing the challenges, insight, and open issues involved in hand gesture recognition based on ultrasonic signal of the smartphone.

/pdf/hand-gesture-recognition-based-on-active-ultrasonic-sensing-4idte9pxe3.pdf

Hand Gesture Recognition Based on Active Ultrasonic Sensing of Smartphone: A Survey

With the rapid progress of the Internet of Things (IoT) technology, human behavior recognition has become an important research topic in the field of ubiquitous computing and has obtained quite a number of research achievements. Accurate human behavior recognition can enhance the quality of human-computer interaction and facilitate the development of various sensing applications. With the popularity of smartphones and the improved performance of sensors such as speakers and microphones built in smartphones, the behavior recognition technique based on ultrasound signal of the smartphone has gained more attention and achieved several research results. In this paper, we first review the common behavior recognition techniques including light, video, sound, and frequency radio and outline their main characteristics. Then, we introduce the fundamental principle of human behavior recognition based on ultrasound signals. Specifically, these systems treat speakers and microphones embedded in smartphones as the transceiver and leverage the received signal changes caused by human movement including phase differences, frequency shift, and time of flight (ToF) to recognize human behavior. Next, we investigate the state-of-the-art studies and applications and analyze the signal processing techniques such as data collection, signal preprocessing, feature description, and behavior recognition approach. Afterward, according to the purpose of these applications, we classify them into five groups and compare them in detail including hand gesture recognition, activity recognition, hand trajectory tracking, vital sign monitoring, and lip reading. Finally, we conclude by discussing the limitations, challenges, and open issues involved in behavior recognition based on ultrasound signal of smartphone.

/pdf/a-survey-on-human-behavior-recognition-using-smartphone-1p0jumhmrk.pdf

Zehua Huang

Papers

A Survey on Human Behavior Recognition Using Channel State Information

A Survey on CSI-Based Human Behavior Recognition in Through-the-Wall Scenario

Hand Gesture Recognition Based on Active Ultrasonic Sensing of Smartphone: A Survey

A Survey on Human Behavior Recognition Using Smartphone-Based Ultrasonic Signal

CSI-based human sensing using model-based approaches: a survey