Street view imagery in urban analytics and GIS: A review

Urban physical environments are the physical settings and built environments in neighbourhoods and cities which provide places for human activities. Evidence suggests that there are substantial ass...

https://www.tandfonline.com/doi/pdf/10.1080/19475683.2020.1791954

A review of urban physical environment sensing using street view imagery in public health studies

Artificial intelligence and smart vision for building and construction 4.0: Machine and deep learning methods and applications

Measuring human perceptions of streetscapes to better inform urban renewal: A perspective of scene semantic parsing

Face anti-spoofing (FAS) plays a vital role in securing face recognition systems from the presentation attacks (PAs). As more and more realistic PAs with novel types spring up, it is necessary to develop robust algorithms for detecting unknown attacks even in unseen scenarios. However, deep models supervised by traditional binary loss (e.g., ‘0’ for bonafide vs. ‘1’ for PAs) are weak in describing intrinsic and discriminative spoofing patterns. Recently, pixel-wise supervision has been proposed for the FAS task, intending to provide more fine-grained pixel/patch-level cues. In this paper, we firstly give a comprehensive review and analysis about the existing pixel-wise supervision methods for FAS. Then we propose a novel pyramid supervision, which guides deep models to learn both local details and global semantics from multi-scale spatial context. Extensive experiments are performed on five FAS benchmark datasets to show that, without bells and whistles, the proposed pyramid supervision could not only improve the performance beyond existing pixel-wise supervision frameworks, but also enhance the model’s interpretability (i.e., locating the patch-level positions of PAs more reasonably). Furthermore, elaborate studies are conducted for exploring the efficacy of different architecture configurations with two kinds of pixel-wise supervisions (binary mask and depth map supervisions), which provides inspirable insights for future architecture/supervision design.

Revisiting Pixel-Wise Supervision for Face Anti-Spoofing

Classification and mapping of urban canyon geometry using Google Street View images and deep multitask learning

We have witnessed rapid advances in both face presentation attack models and presentation attack detection (PAD) in recent years. When compared with widely studied 2D face presentation attacks, 3D face spoofing attacks are more challenging because face recognition systems are more easily confused by the 3D characteristics of materials similar to real faces. In this work, we tackle the problem of detecting these realistic 3D face presentation attacks and propose a novel anti-spoofing method from the perspective of fine-grained classification. Our method, based on factorized bilinear coding of multiple color channels (namely MC_FBC), targets at learning subtle fine-grained differences between real and fake images. By extracting discriminative and fusing complementary information from RGB and YCbCr spaces, we have developed a principled solution to 3D face spoofing detection. A large-scale wax figure face database (WFFD) with both images and videos has also been collected as super realistic attacks to facilitate the study of 3D face presentation attack detection. Extensive experimental results show that our proposed method achieves the state-of-the-art performance on both our own WFFD and other face spoofing databases under various intra-database and inter-database testing scenarios.

3D Face Anti-Spoofing With Factorized Bilinear Coding

The smart city has become a popular topic of investigation. How to focus large amounts of distributed information resources to efficiently cope with public emergencies and provide support for personalized decision-making is a vitally important issue in the construction of smart cities. In this paper, an event-driven focusing service (EDFS) method that uses cyber-physical infrastructures for emergency response in smart cities is proposed. The method consists of a focusing service model at the top level, an informational representation of the model and a focusing service process to operate the service model in emergency response. The focusing service method follows an event-driven mechanism that allows the focusing service process to be triggered by public emergencies sensed by wireless sensor networks (WSNs) and mobile crowd sensing, and it integrates the requirements of different societal entities with regard to response to emergencies and information resources, thereby providing comprehensive and personalized support for decision-making. Furthermore, an EDFS prototype system is designed and implemented based on the proposed method. An experiment using a real-world scenario—the gas leakage in August 2014 in Taiyuan, China—is presented demonstrating the feasibility of the proposed method for assisting various societal entities in coping with and efficiently responding to public emergencies.

Event-Driven Distributed Information Resource-Focusing Service for Emergency Response in Smart City with Cyber-Physical Infrastructures

Compared to 2D face presentation attacks (e.g. printed photos and video replays), 3D type attacks are more challenging to face recognition systems (FRS) by presenting 3D characteristics or materials similar to real faces. Existing 3D face spoofing databases, however, mostly based on 3D masks, are restricted to small data size or poor authenticity due to the production difficulty and high cost. In this work, we introduce the first wax figure face database, WFFD, as one type of super-realistic 3D presentation attacks to spoof the FRS. This database consists of 2200 images with both real and wax figure faces (totally 4400 faces) with a high diversity from online collections. Experiments on this database first investigate the vulnerability of three popular FRS to this kind of new attack. Further, we evaluate the performance of several face presentation attack detection methods to show the attack abilities of this super-realistic face spoofing database.

A Database for Face Presentation Attack Using Wax Figure Faces

Facial expressions of emotion play an important role in human social interactions. However, posed expressions of emotion are not always the same as genuine feelings. Recent research has found that facial expressions are increasingly used as a tool for understanding social interactions instead of personal emotions. Therefore, the credibility assessment of facial expressions, namely, the discrimination of genuine (spontaneous) expressions from posed (deliberate/volitional/deceptive) ones, is a crucial yet challenging task in facial expression understanding. With recent advances in computer vision and machine learning techniques, rapid progress has been made in recent years for automatic detection of genuine and posed facial expressions. This paper presents a general review of the relevant research, including several spontaneous vs. posed (SVP) facial expression databases and various computer vision based detection methods. In addition, a variety of factors that will influence the performance of SVP detection methods are discussed along with open issues and technical challenges in this nascent field.

/pdf/detection-of-genuine-and-posed-facial-expressions-of-emotion-2k4zy9e1vr.pdf

Chuanbo Hu

Papers

Classification and mapping of urban canyon geometry using Google Street View images and deep multitask learning

3D Face Anti-Spoofing With Factorized Bilinear Coding

Event-Driven Distributed Information Resource-Focusing Service for Emergency Response in Smart City with Cyber-Physical Infrastructures

A Database for Face Presentation Attack Using Wax Figure Faces

Detection of Genuine and Posed Facial Expressions of Emotion: Databases and Methods.