“Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告

비만아 부모의 돌봄 경험: q 방법론

Artificial neural networks (ANNs) constitute a class of flexible nonlinear models designed to mimic biological neural systems. In this entry, we introduce ANN using familiar econometric terminology and provide an overview of ANN modeling approach and its implementation methods. † Correspondence: Chung-Ming Kuan, Institute of Economics, Academia Sinica, 128 Academia Road, Sec. 2, Taipei 115, Taiwan; ckuan@econ.sinica.edu.tw. †† I would like to express my sincere gratitude to the editor, Professor Steven Durlauf, for his patience and constructive comments on early drafts of this entry. I also thank Shih-Hsun Hsu and Yu-Lieh Huang for very helpful suggestions. The remaining errors are all mine.

Artificial neural networks

Ensemble methods are considered the state‐of‐the art solution for many machine learning challenges. Such methods improve the predictive performance of a single model by training multiple models and combining their predictions. This paper introduce the concept of ensemble learning, reviews traditional, novel and state‐of‐the‐art ensemble methods and discusses current challenges and trends in the field.

Ensemble learning: A survey

The need for appropriate ways to measure the distance or similarity between data is ubiquitous in machine learning, pattern recognition and data mining, but handcrafting such good metrics for specific problems is generally difficult. This has led to the emergence of metric learning, which aims at automatically learning a metric from data and has attracted a lot of interest in machine learning and related fields for the past ten years. This survey paper proposes a systematic review of the metric learning literature, highlighting the pros and cons of each approach. We pay particular attention to Mahalanobis distance metric learning, a well-studied and successful framework, but additionally present a wide range of methods that have recently emerged as powerful alternatives, including nonlinear metric learning, similarity learning and local metric learning. Recent trends and extensions, such as semi-supervised metric learning, metric learning for histogram data and the derivation of generalization guarantees, are also covered. Finally, this survey addresses metric learning for structured data, in particular edit distance learning, and attempts to give an overview of the remaining challenges in metric learning for the years to come.

A Survey on Metric Learning for Feature Vectors and Structured Data

Ocean fronts have an important influence on global ocean-atmosphere interactions and marine fishery. Hence, it is of great significance to obtain the positions of the ocean fronts. However, current ocean front detection research confronts two challenges: scarcity of labeled data and limitations of ocean front detection algorithms. To address these two problems, we have collected and labeled an ocean front data set and proposed a new deep learning model for ocean front detection. For concreteness, due to the weak edge property of the ocean fronts, we formulate ocean front detection as a weak edge identification problem and propose the weak edge identification network (WEIN) for ocean front detection. WEIN consists of four convolutional blocks. Each block has a side output layer used to detect front edges at a specific image representation level. The side outputs are then fused to predict (detect) the locations of the ocean fronts. In this work, we adopt two metrics to measure the experimental results, i.e., the F₁-score and intersection over union (IoU). The experimental results with comparison to traditional and deep learning approaches demonstrate the superiority of WEIN for ocean front detection.

Weak Edge Identification Network for Ocean Front Detection

Sea Surface Temperature (SST) plays an important role in marine ecology. SST prediction raises considerable attention in ocean-related fields. Recently, deep learning models are widely used in SST prediction, but it is not easy to obtain optimal prediction results using historical observation data directly. More than temporal information, SST data also contains other features, such as trend, periodicity and disturbance. In this paper, we proposed a Multi-Channel LSTM (MC-LSTM) model to improve SST prediction. Firstly, a wavelet transform is used to decompose time-sequence data into multiple sequences representing trend, period and disturbance respectively. Secondly, we use multiple LSTM channels to train these data in parallel, and then obtain the combined prediction results. MC-LSTM can predict Sea surface temperature only by historical SST data, without the help of other spatial and climatic information, so it is easy to get the data. Compared with the direct use of LSTM for prediction, MC-LSTM can improve the prediction accuracy by 26%.

A Multi-Channel LSTM Model for Sea Surface Temperature Prediction

In recent years, research on image generation methods has been developing fast. The auto-encoding variational Bayes method (VAEs) was proposed in 2013, which uses variational inference to learn a latent space from the image database and then generates images using the decoder. The generative adversarial networks (GANs) came out as a promising framework, which uses adversarial training to improve the generative ability of the generator. However, the generated pictures by GANs are generally blurry. The deep convolutional generative adversarial networks (DCGANs) were then proposed to leverage the quality of generated images. Since the input noise vectors are randomly sampled from a Gaussian distribution, the generator has to map from a whole normal distribution to the images. This makes DCGANs unable to reflect the inherent structure of the training data. In this paper, we propose a novel deep model, called generative adversarial networks with decoder-encoder output noise (DE-GANs), which takes advantage of both the adversarial training and the variational Bayesain inference to improve the performance of image generation. DE-GANs use a pre-trained decoder-encoder architecture to map the random Gaussian noise vectors to informative ones and pass them to the generator of the adversarial networks. Since the decoder-encoder architecture is trained by the same images as the generators, the output vectors could carry the intrinsic distribution information of the original images. Moreover, the loss function of DE-GANs is different from GANs and DCGANs. A hidden-space loss function is added to the adversarial loss function to enhance the robustness of the model. Extensive empirical results show that DE-GANs can accelerate the convergence of the adversarial training process and improve the quality of the generated images.

Guoqiang Zhong

Papers

Weak Edge Identification Network for Ocean Front Detection

A Multi-Channel LSTM Model for Sea Surface Temperature Prediction

Generative Adversarial Networks with Decoder-Encoder Output Noise

Adaptive Gabor convolutional networks

Text Classification with Attention Gated Graph Neural Network