Traffic flow analysis, prediction and management are keystones for building smart cities in the new era. With the help of deep neural networks and big traffic data, we can better understand the latent patterns hidden in the complex transportation networks. The dynamic of the traffic flow on one road not only depends on the sequential patterns in the temporal dimension but also relies on other roads in the spatial dimension. Although there are existing works on predicting the future traffic flow, the majority of them have certain limitations on modeling spatial and temporal dependencies. In this paper, we propose a novel spatial temporal graph neural network for traffic flow prediction, which can comprehensively capture spatial and temporal patterns. In particular, the framework offers a learnable positional attention mechanism to effectively aggregate information from adjacent roads. Meanwhile, it provides a sequential component to model the traffic flow dynamics which can exploit both local and global temporal dependencies. Experimental results on various real traffic datasets demonstrate the effectiveness of the proposed framework.

Traffic Flow Prediction via Spatial Temporal Graph Neural Network

Graph Convolutional Networks~(GCNs) are state-of-the-art graph based representation learning models by iteratively stacking multiple layers of convolution aggregation operations and non-linear activation operations. Recently, in Collaborative Filtering~(CF) based Recommender Systems~(RS), by treating the user-item interaction behavior as a bipartite graph, some researchers model higher-layer collaborative signals with GCNs. These GCN based recommender models show superior performance compared to traditional works. However, these models suffer from training difficulty with non-linear activations for large user-item graphs. Besides, most GCN based models could not model deeper layers due to the over smoothing effect with the graph convolution operation. In this paper, we revisit GCN based CF models from two aspects. First, we empirically show that removing non-linearities would enhance recommendation performance, which is consistent with the theories in simple graph convolutional networks. Second, we propose a residual network structure that is specifically designed for CF with user-item interaction modeling, which alleviates the over smoothing problem in graph convolution aggregation operation with sparse user-item interaction data. The proposed model is a linear model and it is easy to train, scale to large datasets, and yield better efficiency and effectiveness on two real datasets. We publish the source code at https://github.com/newlei/LR-GCCF.

/pdf/revisiting-graph-based-collaborative-filtering-a-linear-1dl05dtccc.pdf

Revisiting Graph Based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approach

Spatial Temporal Incidence Dynamic Graph Neural Networks for Traffic Flow Forecasting

Graph Convolutional Networks (GCNs) are state-of-the-art graph based representation learning models by iteratively stacking multiple layers of convolution aggregation operations and non-linear activation operations. Recently, in Collaborative Filtering (CF) based Recommender Systems (RS), by treating the user-item interaction behavior as a bipartite graph, some researchers model higher-layer collaborative signals with GCNs. These GCN based recommender models show superior performance compared to traditional works. However, these models suffer from training difficulty with non-linear activations for large user-item graphs. Besides, most GCN based models could not model deeper layers due to the over smoothing effect with the graph convolution operation. In this paper, we revisit GCN based CF models from two aspects. First, we empirically show that removing non-linearities would enhance recommendation performance, which is consistent with the theories in simple graph convolutional networks. Second, we propose a residual network structure that is specifically designed for CF with user-item interaction modeling, which alleviates the over smoothing problem in graph convolution aggregation operation with sparse user-item interaction data. The proposed model is a linear model and it is easy to train, scale to large datasets, and yield better efficiency and effectiveness on two real datasets. We publish the source code at this https URL.

Revisiting Graph based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approach

In this modern era, traffic congestion has become a major source of negative economic and environmental impact for urban areas worldwide. One of the most efficient ways to mitigate traffic congestion is through future traffic prediction. The field of traffic prediction has evolved greatly ever since its inception in the late 70s. Earlier studies mainly use classical statistical models such as ARIMA and its variants. Then, researchers started to focus on machine learning models due to their power and flexibility. As theoretical and technological advances emerge, we enter the era of deep neural network, which gained popularity due to its sheer prediction power which can be attributed to the complex and deep structure. Despite the popularity of deep neural network models in the field of traffic prediction, literature surveys of them are rare. In this work, we present an up-to-date survey of deep neural network for traffic prediction. We will provide a detailed explanation of popular deep neural network architectures commonly used in the traffic flow prediction literatures, categorize and describe the literatures themselves, present an overview of the commonalities and differences between the different work, and finally provide a discussion regarding the challenges and future directions for this field.

https://ink.library.smu.edu.sg/cgi/viewcontent.cgi?article=6998&context=sis_research

A Survey on Modern Deep Neural Network for Traffic Prediction: Trends, Methods and Challenges

Accurate and real-time traffic forecasting plays an important role in the intelligent traffic system and is of great significance for urban traffic planning, traffic management, and traffic control. However, traffic forecasting has always been considered an “open” scientific issue, owing to the constraints of urban road network topological structure and the law of dynamic change with time. To capture the spatial and temporal dependences simultaneously, we propose a novel neural network-based traffic forecasting method, the temporal graph convolutional network (T-GCN) model, which is combined with the graph convolutional network (GCN) and the gated recurrent unit (GRU). Specifically, the GCN is used to learn complex topological structures for capturing spatial dependence and the gated recurrent unit is used to learn dynamic changes of traffic data for capturing temporal dependence. Then, the T-GCN model is employed to traffic forecasting based on the urban road network. Experiments demonstrate that our T-GCN model can obtain the spatio-temporal correlation from traffic data and the predictions outperform state-of-art baselines on real-world traffic datasets. Our tensorflow implementation of the T-GCN is available at https://www.github.com/lehaifeng/T-GCN .

T-GCN: A Temporal Graph Convolutional Network for Traffic Prediction

Accurate and real-time traffic forecasting plays an important role in the Intelligent Traffic System and is of great significance for urban traffic planning, traffic management, and traffic control. However, traffic forecasting has always been considered an open scientific issue, owing to the constraints of urban road network topological structure and the law of dynamic change with time, namely, spatial dependence and temporal dependence. To capture the spatial and temporal dependence simultaneously, we propose a novel neural network-based traffic forecasting method, the temporal graph convolutional network (T-GCN) model, which is in combination with the graph convolutional network (GCN) and gated recurrent unit (GRU). Specifically, the GCN is used to learn complex topological structures to capture spatial dependence and the gated recurrent unit is used to learn dynamic changes of traffic data to capture temporal dependence. Then, the T-GCN model is employed to traffic forecasting based on the urban road network. Experiments demonstrate that our T-GCN model can obtain the spatio-temporal correlation from traffic data and the predictions outperform state-of-art baselines on real-world traffic datasets. Our tensorflow implementation of the T-GCN is available at this https URL.

Temporal Graph Convolutional Network for Urban Traffic Flow Prediction Method.

Accurate real-time traffic forecasting is a core technological problem against the implementation of the intelligent transportation system However, it remains challenging considering the complex spatial and temporal dependencies among traffic flows In the spatial dimension, due to the connectivity of the road network, the traffic flows between linked roads are closely related In terms of the temporal factor, although there exists a tendency among adjacent time points in general, the importance of distant past points is not necessarily smaller than that of recent past points since traffic flows are also affected by external factors In this study, an attention temporal graph convolutional network (A3T-GCN) traffic forecasting method was proposed to simultaneously capture global temporal dynamics and spatial correlations The A3T-GCN model learns the short-time trend in time series by using the gated recurrent units and learns the spatial dependence based on the topology of the road network through the graph convolutional network Moreover, the attention mechanism was introduced to adjust the importance of different time points and assemble global temporal information to improve prediction accuracy Experimental results in real-world datasets demonstrate the effectiveness and robustness of proposed A3T-GCN The source code can be visited at this https URL

A3T-GCN: Attention Temporal Graph Convolutional Network for Traffic Forecasting

Accurate real-time traffic forecasting is a core technological problem against the implementation of the intelligent transportation system. However, it remains challenging considering the complex spatial and temporal dependencies among traffic flows. In the spatial dimension, due to the connectivity of the road network, the traffic flows between linked roads are closely related. In the temporal dimension, although there exists a tendency among adjacent time points, the importance of distant time points is not necessarily less than that of recent ones, since traffic flows are also affected by external factors. In this study, an attention temporal graph convolutional network (A3T-GCN) was proposed to simultaneously capture global temporal dynamics and spatial correlations in traffic flows. The A3T-GCN model learns the short-term trend by using the gated recurrent units and learns the spatial dependence based on the topology of the road network through the graph convolutional network. Moreover, the attention mechanism was introduced to adjust the importance of different time points and assemble global temporal information to improve prediction accuracy. Experimental results in real-world datasets demonstrate the effectiveness and robustness of the proposed A3T-GCN. We observe the improvements in RMSE of 2.51–46.15% and 2.45–49.32% over baselines for the SZ-taxi and Los-loop, respectively. Meanwhile, the Accuracies are 0.95–89.91% and 0.26–10.37% higher than the baselines for the SZ-taxi and Los-loop, respectively.

Abstract Since the first outbreak in December 2019, SARS-CoV-2 has been constantly evolving and five variants have been classified as Variant of Concern (VOC) by the World Health Organization (WHO). These VOCs were found to enhance transmission and/or decrease neutralization capabilities of monoclonal antibodies and vaccine-induced antibodies. Here, we successfully designed and produced a recombinant COVID-19 vaccine in CHO cells at a high yield. The vaccine antigen contains four hot spot substitutions, K417N, E484K, N501Y and D614G, based on a prefusion-stabilized spike trimer of SARS-CoV-2 (S-6P) and formulated with an Alum/CpG 7909 dual adjuvant system. Results of immunogenicity studies showed that the variant vaccine elicited robust cross-neutralizing antibody responses against SARS-CoV-2 prototype (Wuhan) strain and all 5 VOCs. It further, stimulated a T H 1 (T Helper type 1) cytokine profile and substantial CD4 + T cell responses in BALB/c mice and rhesus macaques were recorded. Protective efficacy of the vaccine candidate was evaluated in hamster and rhesus macaque models of SARS-CoV-2. In Golden Syrian hamsters challenged with Beta or Delta strains, the vaccine candidate reduced the viral loads in nasal turbinates and lung tissues, accompanied by significant weight gain and relieved inflammation in the lungs. In rhesus macaque challenged with prototype SARS-CoV-2, the vaccine candidate decreased viral shedding in throat, anal, blood swabs over time, reduced viral loads of bronchus and lung tissue, and effectively relieved the lung pathological inflammatory response. Together, our data demonstrated the broadly neutralizing activity and efficacy of the variant vaccine against both prototype and current VOCs of SARS-CoV-2, justifying further clinical development. 

/pdf/a-potent-broadly-protective-vaccine-against-sars-cov-2-6c4p6cnh.pdf

Yujiao Song

Papers

T-GCN: A Temporal Graph Convolutional Network for Traffic Prediction

Temporal Graph Convolutional Network for Urban Traffic Flow Prediction Method.

A3T-GCN: Attention Temporal Graph Convolutional Network for Traffic Forecasting

A3T-GCN: Attention Temporal Graph Convolutional Network for Traffic Forecasting

A potent, broadly protective vaccine against SARS-CoV-2 variants of concern