A Tensor Based Method for Missing Traffic Data Completion
TLDR
A tensor pattern which is an extension of matrix is introduced into modeling the traffic data for the first time, which can give full play to traffic spatial–temporal information and preserve the multi-way nature of traffic data.Abstract:
Missing and suspicious traffic data are inevitable due to detector and communication malfunctions, which adversely affect the transportation management system (TMS). In this paper, a tensor pattern which is an extension of matrix is introduced into modeling the traffic data for the first time, which can give full play to traffic spatial–temporal information and preserve the multi-way nature of traffic data. To estimate the missing value, a tensor decomposition based Imputation method has been developed. This approach not only inherits the advantages of imputation methods based on matrix pattern for estimating missing points, but also well mines the multi-dimensional inherent correlation of traffic data. Experiments demonstrate that the proposed method achieves a better imputation performance than the state-of-the-art imputation approach even when the missing ratio is up to 90%. Furthermore, the experimental results show that the proposed method can address the extreme case where the data of one or several days are completely missing, and additionally it can be employed to recover the missing traffic data in adverse weather as well.read more
Citations
More filters
Journal ArticleDOI
Short-term traffic forecasting: Where we are and where we’re going
TL;DR: In this article, the authors present a review of the existing literature on short-term traffic forecasting and offer suggestions for future work, focusing on 10 challenging, yet relatively under researched, directions.
Journal ArticleDOI
Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm
Zaiwen Wen,Wotao Yin,Yin Zhang +2 more
TL;DR: A low-rank factorization model is proposed and a nonlinear successive over-relaxation (SOR) algorithm is constructed that only requires solving a linear least squares problem per iteration to improve the capacity of solving large-scale problems.
Journal ArticleDOI
A hybrid deep learning based traffic flow prediction method and its understanding
TL;DR: A DNN based traffic flow prediction model (DNN-BTF) to improve the prediction accuracy and presents a challenge to conventional thinking about neural networks in the transportation field that neural networks is purely a “black-box” model.
Journal Article
Iterative reweighted algorithms for matrix rank minimization
Karthik Mohan,Maryam Fazel +1 more
TL;DR: This paper proposes a family of Iterative Reweighted Least Squares algorithms IRLS-p, and gives theoretical guarantees similar to those for nuclear norm minimization, that is, recovery of low-rank matrices under certain assumptions on the operator defining the constraints.
Journal ArticleDOI
Traffic state estimation on highway: A comprehensive survey
TL;DR: A survey of highway TSE methods is conducted, and the recent usage of detailed disaggregated mobile data for the purpose of TSE is summarized, showing two possibilities in order to solve this problem: improvement of theoretical models and the use of data-driven or streaming-data-driven approaches, which recent studies have begun to consider.
References
More filters
Journal ArticleDOI
Maximum likelihood from incomplete data via the EM algorithm
Book
Matrix Analysis
Roger A. Horn,Charles R. Johnson +1 more
TL;DR: In this article, the authors present results of both classic and recent matrix analyses using canonical forms as a unifying theme, and demonstrate their importance in a variety of applications, such as linear algebra and matrix theory.
Book
Numerical Optimization
Jorge Nocedal,Stephen J. Wright +1 more
TL;DR: Numerical Optimization presents a comprehensive and up-to-date description of the most effective methods in continuous optimization, responding to the growing interest in optimization in engineering, science, and business by focusing on the methods that are best suited to practical problems.
Journal ArticleDOI
Tensor Decompositions and Applications
Tamara G. Kolda,Brett W. Bader +1 more
TL;DR: This survey provides an overview of higher-order tensor decompositions, their applications, and available software.
Journal ArticleDOI
A Singular Value Thresholding Algorithm for Matrix Completion
TL;DR: This paper develops a simple first-order and easy-to-implement algorithm that is extremely efficient at addressing problems in which the optimal solution has low rank, and develops a framework in which one can understand these algorithms in terms of well-known Lagrange multiplier algorithms.
Related Papers (5)
PPCA-Based Missing Data Imputation for Traffic Flow Volume: A Systematical Approach
Li Qu,Jianming Hu,Li Li,Yi Zhang +3 more
Efficient missing data imputing for traffic flow by considering temporal and spatial dependence
Li Li,Yuebiao Li,Zhiheng Li +2 more