“Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告

In the era of the Internet of Things (IoT), an enormous amount of sensing devices collect and/or generate various sensory data over time for a wide range of fields and applications. Based on the nature of the application, these devices will result in big or fast/real-time data streams. Applying analytics over such data streams to discover new information, predict future insights, and make control decisions is a crucial process that makes IoT a worthy paradigm for businesses and a quality-of-life improving technology. In this paper, we provide a thorough overview on using a class of advanced machine learning techniques, namely deep learning (DL), to facilitate the analytics and learning in the IoT domain. We start by articulating IoT data characteristics and identifying two major treatments for IoT data from a machine learning perspective, namely IoT big data analytics and IoT streaming data analytics. We also discuss why DL is a promising approach to achieve the desired analytics in these types of data and applications. The potential of using emerging DL techniques for IoT data analytics are then discussed, and its promises and challenges are introduced. We present a comprehensive background on different DL architectures and algorithms. We also analyze and summarize major reported research attempts that leveraged DL in the IoT domain. The smart IoT devices that have incorporated DL in their intelligence background are also discussed. DL implementation approaches on the fog and cloud centers in support of IoT applications are also surveyed. Finally, we shed light on some challenges and potential directions for future research. At the end of each section, we highlight the lessons learned based on our experiments and review of the recent literature.

Deep Learning for IoT Big Data and Streaming Analytics: A Survey

In this paper, we provide a survey of the traffic sign detection literature, detailing detection systems for traffic sign recognition (TSR) for driver assistance. We separately describe the contributions of recent works to the various stages inherent in traffic sign detection: segmentation, feature extraction, and final sign detection. While TSR is a well-established research area, we highlight open research issues in the literature, including a dearth of use of publicly available image databases and the over-representation of European traffic signs. Furthermore, we discuss future directions of TSR research, including the integration of context and localization. We also introduce a new public database containing U.S. traffic signs.

/pdf/vision-based-traffic-sign-detection-and-analysis-for-5mamysz2ii.pdf

Vision-Based Traffic Sign Detection and Analysis for Intelligent Driver Assistance Systems: Perspectives and Survey

In the last decades, 3D city models appear to have been predominantly used for visualisation; however, today they are being increasingly employed in a number of domains and for a large range of tasks beyond visualisation. In this paper, we seek to understand and document the state of the art regarding the utilisation of 3D city models across multiple domains based on a comprehensive literature study including hundreds of research papers, technical reports and online resources. A challenge in a study such as ours is that the ways in which 3D city models are used cannot be readily listed due to fuzziness, terminological ambiguity, unclear added-value of 3D geoinformation in some instances, and absence of technical information. To address this challenge, we delineate a hierarchical terminology (spatial operations, use cases, applications), and develop a theoretical reasoning to segment and categorise the diverse uses of 3D city models. Following this framework, we provide a list of identified use cases of 3D city models (with a description of each), and their applications. Our study demonstrates that 3D city models are employed in at least 29 use cases that are a part of more than 100 applications. The classified inventory could be useful for scientists as well as stakeholders in the geospatial industry, such as companies and national mapping agencies, as it may serve as a reference document to better position their operations, design product portfolios, and to better understand the market.

/pdf/applications-of-3d-city-models-state-of-the-art-review-3yewcl5e4i.pdf

Applications of 3D City Models: State of the Art Review

With growing numbers of intelligent autonomous systems in human environments, the ability of such systems to perceive, understand, and anticipate human behavior becomes increasingly important. Spec...

Human motion trajectory prediction: a survey:

The current low-cost global navigation satellite systems (GNSS) receiver cannot calculate satisfactory positioning results for pedestrian applications in urban areas with dense buildings due to multipath and non-line-of-sight effects. We develop a rectified positioning method using a basic three-dimensional city building model and ray-tracing simulation to mitigate the signal reflection effects. This proposed method is achieved by implementing a particle filter to distribute possible position candidates. The likelihood of each candidate is evaluated based on the similarity between the pseudorange measurement and simulated pseudorange of the candidate. Finally, the expectation of all the candidates is the rectified positioning of the proposed map method. The proposed method will serve as one sensor of an integrated system in the future. For this purpose, we successfully define a positioning accuracy based on the distribution of the candidates and their pseudorange similarity. The real data are recorded at an urban canyon environment in the Chiyoda district of Tokyo using a commercial grade u-blox GNSS receiver. Both static and dynamic tests were performed. With the aid of GLONASS and QZSS, it is shown that the proposed method can achieve a 4.4-m 1ź positioning error in the tested urban canyon area.

3D building model-based pedestrian positioning method using GPS/GLONASS/QZSS and its reliability calculation

Lane-level vehicle self-localization is a challenging and significant issue arising in autonomous driving and driver-assistance systems. The Global Navigation Satellite System (GNSS) and onboard inertial sensor integration are among the solutions for vehicle self-localization. However, as the main source in the integration, GNSS positioning performance is severely degraded in urban canyons because of the effects of multipath and non-line-of-sight (NLOS) propagations. These GNSS positioning errors also decrease the performance of the integration. To reduce the negative effects caused by GNSS positioning error, this paper proposes to employ an innovative GNSS positioning technique with the aid of a 3-D building map in the integration. The GNSS positioning result is used as an observation, and this is integrated with the information from the onboard inertial sensor and vehicle speedometer in a Kalman filter framework. To achieve stable performance, this paper proposes to evaluate and consider the accuracy of the employed GNSS positioning method in dynamic integration. A series of experiments in different scenarios is conducted in an urban canyon, which can demonstrate the effectiveness of the proposed method using various evaluation and comparison processes.

GNSS/Onboard Inertial Sensor Integration With the Aid of 3-D Building Map for Lane-Level Vehicle Self-Localization in Urban Canyon

Currently, global navigation satellite system (GNSS) receivers can provide accurate and reliable positioning service in open-field areas. However, their performance in the downtown areas of cities is still affected by the multipath and none-line-of-sight (NLOS) receptions. This paper proposes a new positioning method using 3D building models and the receiver autonomous integrity monitoring (RAIM) satellite selection method to achieve satisfactory positioning performance in urban area. The 3D building model uses a ray-tracing technique to simulate the line-of-sight (LOS) and NLOS signal travel distance, which is well-known as pseudorange, between the satellite and receiver. The proposed RAIM fault detection and exclusion (FDE) is able to compare the similarity between the raw pseudorange measurement and the simulated pseudorange. The measurement of the satellite will be excluded if the simulated and raw pseudoranges are inconsistent. Because of the assumption of the single reflection in the ray-tracing technique, an inconsistent case indicates it is a double or multiple reflected NLOS signal. According to the experimental results, the RAIM satellite selection technique can reduce by about 8.4% and 36.2% the positioning solutions with large errors (solutions estimated on the wrong side of the road) for the 3D building model method in the middle and deep urban canyon environment, respectively.

NLOS Correction/Exclusion for GNSS Measurement Using RAIM and City Building Models.

Sensors play important roles for autonomous driving. Localization is definitely a key one. Undoubtedly, global positioning system (GPS) sensor will provide absolute localization for almost all the future land vehicles. In terms of driverless car, 1.5 m of positioning accuracy is the minimum requirement, since the vehicle has to keep in a driving lane that usually wider than 3 m. However, the skyscrapers in highly-urbanized cities, such as Tokyo and Hong Kong, dramatically deteriorate GPS localization performance, leading more than 50 m of error. GPS signals are reflected at modern glassy buildings, which caused the notorious multipath effect. Fortunately, the number of navigation satellite is rapidly increasing in a global scale, since the rise of multi-global navigation satellite system. It provides an excellent opportunity for positioning algorithm developer of GPS sensor. More satellites in the sky imply more measurements to be received. Novelty, this paper proposes to take advantage of the fact that clean measurements (refers to line-of-sight measurement) are consistent and multipath measurements are inconsistent. Based on this consistency check, the faulty measurements can be detected and excluded to obtain better localization accuracy. Experimental results indicate that the proposed method can achieve less than 1-m lateral positioning error in middle urban canyons.

/pdf/multiple-faulty-gnss-measurement-exclusion-based-on-je7ac9wo99.pdf

Multiple Faulty GNSS Measurement Exclusion Based on Consistency Check in Urban Canyons

This paper focuses on the pedestrian navigation in highly urbanized area, where a current smartphone and a commercial global navigation satellite system (GNSS) receiver perform poorly because of the reflection and blockage of GNSS signal by buildings and foliage. A 3-D map-aided pedestrian positioning method is previously developed to mitigate and correct the multipath GNSS signal. However, it still suffers from the low availability due to the insufficient number of satellites. We develop a smartphone-based pedestrian dead reckoning (PDR) algorithm, which is carried in the pedestrian’s trousers. This PDR is capable of not only providing continues solutions but also indicating the pedestrian motions. A closed-loop Kalman filter with adaptive tuning is proposed to integrate the 3-D map-aided GNSS method with the smartphone-based PDR system. According to the experiment results, the proposed integration system can achieve $\sim 1.5$ - and 5.5-m of positioning errors in a middle-class and deep urban canyon, respectively.

Yanlei Gu

Papers

3D building model-based pedestrian positioning method using GPS/GLONASS/QZSS and its reliability calculation

GNSS/Onboard Inertial Sensor Integration With the Aid of 3-D Building Map for Lane-Level Vehicle Self-Localization in Urban Canyon

NLOS Correction/Exclusion for GNSS Measurement Using RAIM and City Building Models.

Multiple Faulty GNSS Measurement Exclusion Based on Consistency Check in Urban Canyons

Urban Pedestrian Navigation Using Smartphone-Based Dead Reckoning and 3-D Map-Aided GNSS