Machine Learning is the study of methods for programming computers to learn. Computers are applied to a wide range of tasks, and for most of these it is relatively easy for programmers to design and implement the necessary software. However, there are many tasks for which this is difficult or impossible. These can be divided into four general categories. First, there are problems for which there exist no human experts. For example, in modern automated manufacturing facilities, there is a need to predict machine failures before they occur by analyzing sensor readings. Because the machines are new, there are no human experts who can be interviewed by a programmer to provide the knowledge necessary to build a computer system. A machine learning system can study recorded data and subsequent machine failures and learn prediction rules. Second, there are problems where human experts exist, but where they are unable to explain their expertise. This is the case in many perceptual tasks, such as speech recognition, hand-writing recognition, and natural language understanding. Virtually all humans exhibit expert-level abilities on these tasks, but none of them can describe the detailed steps that they follow as they perform them. Fortunately, humans can provide machines with examples of the inputs and correct outputs for these tasks, so machine learning algorithms can learn to map the inputs to the outputs. Third, there are problems where phenomena are changing rapidly. In finance, for example, people would like to predict the future behavior of the stock market, of consumer purchases, or of exchange rates. These behaviors change frequently, so that even if a programmer could construct a good predictive computer program, it would need to be rewritten frequently. A learning program can relieve the programmer of this burden by constantly modifying and tuning a set of learned prediction rules. Fourth, there are applications that need to be customized for each computer user separately. Consider, for example, a program to filter unwanted electronic mail messages. Different users will need different filters. It is unreasonable to expect each user to program his or her own rules, and it is infeasible to provide every user with a software engineer to keep the rules up-to-date. A machine learning system can learn which mail messages the user rejects and maintain the filtering rules automatically. Machine learning addresses many of the same research questions as the fields of statistics, data mining, and psychology, but with differences of emphasis. Statistics focuses on understanding the phenomena that have generated the data, often with the goal of testing different hypotheses about those phenomena. Data mining seeks to find patterns in the data that are understandable by people. Psychological studies of human learning aspire to understand the mechanisms underlying the various learning behaviors exhibited by people (concept learning, skill acquisition, strategy change, etc.).

Machine learning

计量经济分析 = Econometric analysis

An overview of the self-organizing map algorithm, on which the papers in this issue are based, is presented in this article.

The Self-Organizing Map

The Environmental Protection Agency (EPA) provides access to information on a variety of topics related to the environment and strives to inform citizens of health risks. The EPA also has an extensive library network that consists of 26 libraries throughout the United States, which provide access to a plethora of information to EPA employees, scientists, and researchers. The EPA implemented a reorganization project to digitize their materials so they would be more accessible to a wider range of users, but this plan was drastically accelerated when the EPA was threatened with a budget cut. It chose to close and reduce the hours and services of some of their libraries. As a result, the agency was accused of denying users the “right to know” by making information unavailable, not providing an adequate strategic plan, and discarding vital materials. This case study explores the background of the digitization project, the practices implemented, and the critiques of the project.

/pdf/the-environmental-protection-agency-3gx4opzrjm.pdf

The Environmental Protection Agency

The science of the total environment

This paper proposes a convolutional neural network (CNN)-based method that learns traffic as images and predicts large-scale, network-wide traffic speed with a high accuracy. Spatiotemporal traffic dynamics are converted to images describing the time and space relations of traffic flow via a two-dimensional time-space matrix. A CNN is applied to the image following two consecutive steps: abstract traffic feature extraction and network-wide traffic speed prediction. The effectiveness of the proposed method is evaluated by taking two real-world transportation networks, the second ring road and north-east transportation network in Beijing, as examples, and comparing the method with four prevailing algorithms, namely, ordinary least squares, k-nearest neighbors, artificial neural network, and random forest, and three deep learning architectures, namely, stacked autoencoder, recurrent neural network, and long-short-term memory network. The results show that the proposed method outperforms other algorithms by an average accuracy improvement of 42.91% within an acceptable execution time. The CNN can train the model in a reasonable time and, thus, is suitable for large-scale transportation networks.

Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction.

Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction

This study proposes a novel Graph Convolutional Neural Network with Data-driven Graph Filter (GCNN-DDGF) model that can learn hidden heterogeneous pairwise correlations between stations to predict station-level hourly demand in a large-scale bike-sharing network. Two architectures of the GCNN-DDGF model are explored; GCNNreg-DDGF is a regular GCNN-DDGF model which contains the convolution and feedforward blocks, and GCNNrec-DDGF additionally contains a recurrent block from the Long Short-term Memory neural network architecture to capture temporal dependencies in the bike-sharing demand series. Furthermore, four types of GCNN models are proposed whose adjacency matrices are based on various bike-sharing system data, including Spatial Distance matrix (SD), Demand matrix (DE), Average Trip Duration matrix (ATD), and Demand Correlation matrix (DC). These six types of GCNN models and seven other benchmark models are built and compared on a Citi Bike dataset from New York City which includes 272 stations and over 28 million transactions from 2013 to 2016. Results show that the GCNNrec-DDGF performs the best in terms of the Root Mean Square Error, the Mean Absolute Error and the coefficient of determination (R2), followed by the GCNNreg-DDGF. They outperform the other models. Through a more detailed graph network analysis based on the learned DDGF, insights are obtained on the “black box” of the GCNN-DDGF model. It is found to capture some information similar to details embedded in the SD, DE and DC matrices. More importantly, it also uncovers hidden heterogeneous pairwise correlations between stations that are not revealed by any of those matrices.

Predicting station-level hourly demand in a large-scale bike-sharing network: A graph convolutional neural network approach

Lane-changing (LC), which is one of the basic driving behavior, largely impacts on traffic efficiency and safety. Modeling an LC process is challenging due to the complexity and uncertainty of driving behavior. To address this issue, this paper proposes a data-driven LC model based on deep learning models. Deep belief network (DBN) and long short-term memory (LSTM) neural network are employed to model the LC process that is composed of LC decisions (LCD) and LC implementation (LCI). The empirical LC data provided by Next Generation Simulation project (NGSIM) is utilized to train and test the proposed DBN-based LCD model and LSTM-based LCI model. The results indicate that the proposed data-driven model is able to accurately predict the LC process of a vehicle. The sensitivity analysis shows that the most important factor associated with LCD is the relative position of the preceding vehicle in the target lane. This may be the first work that comprehensively models LC using deep learning approaches.

A data-driven lane-changing model based on deep learning

In this paper, we review trajectory data-based traffic flow studies that have been conducted over the last 15 years. Our purpose is to provide a roadmap for readers who have an interest in the latest developments of traffic flow theory that have been stimulated by the availability of trajectory data. We first highlight the critical role of trajectory data (especially the next generation simulation (NGSIM) trajectory dataset) in the recent history of traffic flow studies. Then, we summarize new traffic phenomena/models at the microscopic/mesoscopic/macroscopic levels and provide a unified view of these achievements perceived from different directions of traffic flow studies. Finally, we discuss some future research directions.

Zhengbing He

Papers

Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction.

Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction

Predicting station-level hourly demand in a large-scale bike-sharing network: A graph convolutional neural network approach

A data-driven lane-changing model based on deep learning

Trajectory data-based traffic flow studies: A revisit