“Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告

From the Publisher: 
The accessible presentation of this book gives both a general view of the entire computer vision enterprise and also offers sufficient detail to be able to build useful applications. Users learn techniques that have proven to be useful by first-hand experience and a wide range of mathematical methods. A CD-ROM with every copy of the text contains source code for programming practice, color images, and illustrative movies. Comprehensive and up-to-date, this book includes essential topics that either reflect practical significance or are of theoretical importance. Topics are discussed in substantial and increasing depth. Application surveys describe numerous important application areas such as image based rendering and digital libraries. Many important algorithms broken down and illustrated in pseudo code. Appropriate for use by engineers as a comprehensive reference to the computer vision enterprise.

Computer vision : a modern approach = 计算机视觉 : 一种现代的方法

MUCKE aims to mine a large volume of images, to structure them conceptually and to use this conceptual structuring in order to improve large-scale image retrieval. The last decade witnessed important progress concerning low-level image representations. However, there are a number problems which need to be solved in order to unleash the full potential of image mining in applications. The central problem with low-level representations is the mismatch between them and the human interpretation of image content. This problem can be instantiated, for instance, by the incapability of existing descriptors to capture spatial relationships between the concepts represented or by their incapability to convey an explanation of why two images are similar in a content-based image retrieval framework. We start by assessing existing local descriptors for image classification and by proposing to use co-occurrence matrices to better capture spatial relationships in images. The main focus in MUCKE is on cleaning large scale Web image corpora and on proposing image representations which are closer to the human interpretation of images. Consequently, we introduce methods which tackle these two problems and compare results to state of the art methods. Note: some aspects of this deliverable are withheld at this time as they are pending review. Please contact the authors for a preview.

http://ieeexplore.ieee.org/iel2/4524/12820/00592460.pdf

Image Processing

A scheme is developed for classifying the types of motion perceived by a humanlike robot. It is assumed that the robot receives visual images of the scene using a perspective system model. Equations, theorems, concepts, clues, etc., relating the objects, their positions, and their motion to their images on the focal plane are presented. >

http://ieeexplore.ieee.org/iel2/815/3148/00100651.pdf

Robot vision

The outline of this chapter is as follows. Section 2 reviews various types of existing finite impulse response (FIR) and infinite impulse response (IIR) two-channel filter banks. The basic operations of these filter banks are considered and the requirements are stated for alias-free, perfect-reconstruction (PR), and nearly perfect-reconstruction (NPR) filter banks. Also some efficient synthesis techniques are referred to. Furthermore, examples are included to compare various two-channel filter banks with each other. Section 3 concentrates on the design of multi-channel (M-channel) uniform filter banks. The main emphasis is laid on designing these banks using tree-structured filter banks with the aid of two-channel filter banks and on generating the overall bank with the aid of a single prototype filter and a proper cosine-modulation or MDFT technique. In Section 4, it is shown how octave filter banks can be generated using a single two-channel filter bank as the basic building block. Also, the relations between the frequency-selective octave filter banks and discrete-time wavelet banks are briefly discussed. Finally, concluding remarks are given in Section 5.

/pdf/multirate-systems-and-filter-banks-3w4ni7zeza.pdf

Multirate Systems and Filter Banks

In this paper, the theory, structure, design, and implementation of a new class of linear-phase paraunitary filter banks (LPPUFBs) are investigated. The novel filter banks with filters of different lengths can be viewed as the generalized lapped orthogonal transforms (GenLOTs) with variable-length basis functions. Our main motivation is the application in block-transform-based image coding. Besides having all of the attractive properties of other lapped orthogonal transforms, the new transform takes advantage of its long, overlapping basis functions to represent smooth signals in order to reduce blocking artifacts, whereas it reserves short basis functions for high-frequency signal components like edges and texture, thereby limiting ringing artifacts. Two design methods are presented, each with its own set of advantages: the first is based on a direct lattice factorization, and the second enforces certain relationships between the lattice coefficients to obtain variable length filters. Various necessary conditions for the existence of meaningful solutions are derived and discussed in both cases. Finally, several design and image coding examples are presented to confirm the validity of the theory.

/pdf/linear-phase-paraunitary-filter-bank-with-filters-of-451hscrx4h.pdf

Linear phase paraunitary filter bank with filters of different lengths and its application in image compression

A discrete cosine transform (DCT) can be easily implemented in software and hardware for the JPEG and MPEG formats. However, even though some integer DCTs (IntDCTs) for lossless-to-lossy image coding have been proposed, such transform requires redesigned devices. This paper proposes a hardware-friendly IntDCT that can be applied to both lossless and lossy coding. Our IntDCT is implemented by direct-lifting of DCT and inverse DCT (IDCT). Consequently, any existing DCT device can be directly applied to every lifting block. Although our method requires a small side information block (SIB), it is validated by its application to lossless-to-lossy image coding.

Integer DCT Based on Direct-Lifting of DCT-IDCT for Lossless-to-Lossy Image Coding

In this paper, a novel method of the surface reconstruction from a single monocular image is proposed. Our proposed approach (called shape from knowledge) is based on the knowledge of objects, which is acquired by learning from a number of samples. To achieve this, we investigate making use of the hidden Markov model (HMM) framework, which models the correspondence between an intensity image an its depth information. We have applied our algorithm to the 3-D face and 3-D hand reconstruction from single images, and the results show the effectiveness of the proposed method.

HMM-based surface reconstruction from single images

In this paper, effective multiresolution image representations using a combination of 2-D filter bank (FB) and directional wavelet transform (WT) are presented. The proposed methods yield simple implementation and low computation costs compared to previous 1-D and 2-D FB combinations or adaptive directional WT methods. Furthermore, they are nonredundant transforms and realize quad-tree like multiresolution representations. In applications on nonlinear approximation, image coding, and denoising, the proposed filter banks show visual quality improvements and have higher PSNR than the conventional separable WT or the contourlet.

Multiresolution Image Representation Using Combined 2-D and 1-D Directional Filter Banks

A new method for designing complex all-pass digital filters is introduced. Phase error is regarded as the amplitude of complex error between the designed and the desired all-pass function. Then the Remez exchange algorithm is applied to the amplitude of complex error, and it is approximated to be equiripple. Although equiripple solutions to phase approximation problems are not necessarily optimum in the Chebyshev sense, considerable design experience shows that equiripple approximations are often quite satisfactory results. Such cases are considered, and it is shown that the best uniform phase approximation to an arbitrarily specified phase response can be found. In this algorithm, a satisfactory solution is obtained through a few iterations without any initial guess of the solution. Furthermore, as one of the complex all-pass digital filter applications, a large class of real coefficient doubly complementary IIR digital filter pairs is introduced by using a single complex all-pass digital filter, which has approximately linear phase. >

Masaaki Ikehara

Papers

Linear phase paraunitary filter bank with filters of different lengths and its application in image compression

Integer DCT Based on Direct-Lifting of DCT-IDCT for Lossless-to-Lossy Image Coding

HMM-based surface reconstruction from single images

Multiresolution Image Representation Using Combined 2-D and 1-D Directional Filter Banks

Design of complex all-pass networks using Remez algorithm