This chapter provides an in-depth description of the LBP operator in spatial image domain. The generic LBP operator, and its rotation-invariant and multiscale versions are introduced. The use of complementary contrast information is also discussed. The success of LBP methods in various computer vision problems and applications has inspired much new research on different variants. The basic LBP has also some problems that need to be addressed. Therefore, several extensions and modifications of LBP have been proposed to increase its robustness and discriminative power.

Local Binary Patterns for Still Images

A new image retrieval technique using local neighborhood difference pattern (LNDP) has been proposed for local features. The conventional local binary pattern (LBP) transforms every pixel of image into a binary pattern based on their relationship with neighboring pixels. The proposed feature descriptor differs from local binary pattern as it transforms the mutual relationship of all neighboring pixels in a binary pattern. Both LBP and LNDP are complementary to each other as they extract different information using local pixel intensity. In the proposed work, both LBP and LNDP features are combined to extract the most of the information that can be captured using local intensity differences. To prove the excellence of the proposed method, experiments have been conducted on four different databases of texture images and natural images. The performance has been observed using well-known evaluation measures, precision and recall and compared with some state-of-art local patterns. Comparison shows a significant improvement in the proposed method over existing methods.

Local neighborhood difference pattern: A new feature descriptor for natural and texture image retrieval

A physical process and machine learning combined hydrological model for daily streamflow simulations of large watersheds with limited observation data

In this paper, a new texture descriptor based on the local neighborhood intensity difference is proposed for content based image retrieval (CBIR). For computation of texture features like Local Binary Pattern (LBP), the center pixel in a 3 × 3 window of an image is compared with all the remaining neighbors, one pixel at a time to generate a binary bit pattern. It ignores the effect of the adjacent neighbors of a particular pixel for its binary encoding and also for texture description. The proposed method is based on the concept that neighbors of a particular pixel hold significant amount of texture information that can be considered for efficient texture representation for CBIR. The main impact of utilizing the mutual relationship among adjacent neighbors is that we do not rely on the sign of the intensity difference between central pixel and one of its neighbors (Ii) only, rather we take into account the sign of difference values between Ii and its adjacent neighbors along with the central pixels and same set of neighbors of Ii. This makes our pattern more resistant to illumination changes. Moreover, most of the local patterns including LBP concentrates mainly on the sign information and thus ignores the magnitude. The magnitude information which plays an auxiliary role to supply complementary information of texture descriptor, is integrated in our approach by considering the mean of absolute deviation about each pixel Ii from its adjacent neighbors. Taking this into account, we develop a new texture descriptor, named as Local Neighborhood Intensity Pattern (LNIP) which considers the relative intensity difference between a particular pixel and the center pixel by considering its adjacent neighbors and generate a sign and a magnitude pattern. Finally, the sign pattern (LNIPS) and the magnitude pattern (LNIPM) are concatenated into a single feature descriptor to generate a more effective feature descriptor. The proposed descriptor has been tested for image retrieval on four databases, including three texture image databases - Brodatz texture image database, MIT VisTex database and Salzburg texture database and one face database - AT&T face database. The precision and recall values observed on these databases are compared with some state-of-art local patterns. The proposed method showed a significant improvement over many other existing methods.

Local Neighborhood Intensity Pattern–A new texture feature descriptor for image retrieval

Texture is an important characteristic for many types of images. In recent years, very discriminative and computationally efficient local texture descriptors based on local binary patterns (LBPs) have been developed, which has led to significant progress in applying texture methods to different problems and applications. Due to this progress, the division between texture descriptors and more generic image or video descriptors has been disappearing. A large number of different variants of LBP have been developed to improve its robustness and to increase its discriminative power and applicability to different types of problems. In this chapter, the most recent and important variants of LBP in 2-D, spatiotemporal, 3-D, and 4-D domains are surveyed. Interesting new developments of LBP in 1-D signal analysis are also considered. Finally, some future challenges for research are presented.

Two decades of local binary patterns: A survey

Recently, the local binary pattern (LBP) has been widely used in texture classification. The conventional LBP methods only describe micro structures of texture images, such as edges, corners, spots and so on, although many of them show a good performance on texture classification. This situation still could not be changed, even though the multiresolution analysis technique is used in methods of local binary pattern. In this paper, we investigate the drawback of conventional LBP operators in describing some textures that has the same small structures but differential large structures. And a multi-structure local binary pattern operator is achieved by executing the LBP method on different layers of image pyramid. The proposed method is simple yet efficient to extract not only the micro structures but also the macro structures of texture images. We demonstrate the performance of our method on the task of rotation invariant texture classification. The experimental results on Outex database show advantages of the proposed method.

Pyramid-based multi-structure local binary pattern for texture classification

Recently, the local binary patterns (LBP) have been widely used in the texture classification. The LBP methods obtain the binary pattern by comparing the gray scales of pixels on a small circular region with the gray scale of their central pixel. The conventional LBP methods only describe microstructures of texture images, such as edges, corners, spots and so on, although many of them show good performances on the texture classification. This situation still could not be changed, even though the multi-resolution analysis technique is adopted by LBP methods. Moreover, the circular sampling region limits the ability of the conventional LBP methods in describing anisotropic features. In this paper, we change the shape of sampling region and get an extended LBP operator. And a multi-structure local binary pattern (Ms-LBP) operator is achieved by executing the extended LBP operator on different layers of an image pyramid. Thus, the proposed method is simple yet efficient to describe four types of structures: isotropic microstructure, isotropic macrostructure, anisotropic microstructure and anisotropic macrostructure. We demonstrate the performance of our method on two public texture databases: the Outex and the CUReT. The experimental results show the advantages of the proposed method.

Multi-structure local binary patterns for texture classification

Local Binary Pattern (LBP) and Texton are both widely used texture analysis techniques. In this paper we propose a patch-based texture classification method that takes advantage of both LBP and Texton. Unlike the traditional LBP methods that describe a texture with the occurrence of local binary patterns in the entire image, we compute the LBP histogram in a small region around each pixel to capture the local structure information. The texton learning method is then performed on these LBP histograms, resulting in a texture classification algorithm that outperforms the traditional LBP-based methods due to its preservation of local structure information. It also outperforms the traditional filtering-based texton methods due to its robustness to orientation and illumination. Experimental results on two benchmark databases validate the advantages of the proposed method.

Local Binary Pattern histogram based Texton learning for texture classification

The local binary pattern (LBP) approach has been widely used in texture description. In this paper, we build a new framework to extract the binary patterns and propose a robust texture descriptor: multi-ring local binary pattern (MrLBP). The MrLBP algorithm creates patterns from several ringed areas and mainly contains two parts. One is the extra-ring local binary pattern operator that gets patterns from the mean values of different ringed areas. The other is the intra-ring local binary pattern operator that obtains patterns by counting the majority of binary values in every single ringed area. Moreover, the binary formation of each part of the MrLBP is obtained from two different aspects. The MrLBP method not only considers the binary relationship among pixels in a local region, but also focuses on the relationship between pixels in a local region and the whole image. This is a little different from the conventional LBP methods that only get the binary formation from the local gray scales differences. The experimental results on two public databases have validated the effectiveness of the proposed method.

Yonggang He

Papers

Pyramid-based multi-structure local binary pattern for texture classification

Multi-structure local binary patterns for texture classification

Local Binary Pattern histogram based Texton learning for texture classification

Multi-ring local binary patterns for rotation invariant texture classification