A fuzzy theoretic approach for video segmentation using syntactic features
TL;DR: Experimental results have shown that the proposed scheme for fuzzification of the frame-to-frame property difference values using the Rayleigh distribution can detect changes reliably.
Abstract: This paper is concerned with the development of a fuzzy-logic-based framework for segmentation of video sequences. We have proposed a scheme for fuzzification of the frame-to-frame property difference values using the Rayleigh distribution. The difference values have been characterized by fuzzy terms like small, significant, large, etc. These terms have been used to design fuzzy rules for detecting abrupt changes and gradual changes. Fuzzy rules have provided a mechanism for integrating evidences based on different properties. The decompositional inference strategy has been used for fuzzy reasoning over the set of fuzzy rules. Gradual changes have been further classified as fade-in, fade-out and others (including dissolves, wipes, etc). Experimental results have shown that the proposed scheme can detect changes reliably.
Citations
More filters
01 May 2008
TL;DR: This paper surveys the video classification literature and finds that features are drawn from three modalities - text, audio, and visual - and that a large variety of combinations of features and classification have been explored.
Abstract: There is much video available today. To help viewers find video of interest, work has begun on methods of automatic video classification. In this paper, we survey the video classification literature. We find that features are drawn from three modalities - text, audio, and visual - and that a large variety of combinations of features and classification have been explored. We describe the general features chosen and summarize the research in this area. We conclude with ideas for further research.
329 citations
Cites background or methods from "A fuzzy theoretic approach for vide..."
...[63] detect shot changes as well as shot transition types using a fuzzy-logic-based approach [58]....
[...]
...videos, and even within the same video, no particular value may correctly identify all shot changes [58]....
[...]
TL;DR: Experimental results show that the proposed fuzzy color histogram-based shot-boundary detection algorithm effectively detects shot boundaries and reduces false alarms as compared to the state-of-the-art shot- boundary detection algorithms.
Abstract: We present a fuzzy color histogram-based shot-boundary detection algorithm specialized for content-based copy detection applications The proposed method aims to detect both cuts and gradual transitions (fade, dissolve) effectively in videos where heavy transformations (such as cam-cording, insertions of patterns, strong re-encoding) occur Along with the color histogram generated with the fuzzy linking method on L*a*b* color space, the system extracts a mask for still regions and the window of picture-in-picture transformation for each detected shot, which will be useful in a content-based copy detection system Experimental results show that our method effectively detects shot boundaries and reduces false alarms as compared to the state-of-the-art shot-boundary detection algorithms
88 citations
Cites methods from "A fuzzy theoretic approach for vide..."
...A scene-break detection approach based on linear prediction model is proposed in [4]....
[...]
TL;DR: A fuzzy logic approach to integrate hybrid features for detecting shot boundaries inside general videos by using publicly available test data set from Carleton University and demonstrating that the proposed algorithm outperforms the representative existing algorithms in terms of the precision and recall rates.
Abstract: Video temporal segmentation is normally the first and important step for content-based video applications. Many features including the pixel difference, colour histogram, motion, and edge information etc. have been widely used and reported in the literature to detect shot cuts inside videos. Although existing research on shot cut detection is active and extensive, it still remains a challenge to achieve accurate detection of all types of shot boundaries with one single algorithm. In this paper, we propose a fuzzy logic approach to integrate hybrid features for detecting shot boundaries inside general videos. The fuzzy logic approach contains two processing modes, where one is dedicated to detection of abrupt shot cuts including those short dissolved shots, and the other for detection of gradual shot cuts. These two modes are unified by a mode-selector to decide which mode the scheme should work on in order to achieve the best possible detection performances. By using the publicly available test data set from Carleton University, extensive experiments were carried out and the test results illustrate that the proposed algorithm outperforms the representative existing algorithms in terms of the precision and recall rates.
76 citations
Cites background or methods from "A fuzzy theoretic approach for vide..."
...Previous research [4] reveals that the value of HIi varies within [0, 1], and the closer to 1, the larger the difference between the two adjacent frames....
[...]
...[4], the feature of edge pixel count is proposed for shot cut detection, where Sobel edge detector is used....
[...]
ETSI1
TL;DR: This work proposes a new approach to the background subtraction method which operates in the colour space and manages the colour information in the segmentation process to detect and eliminate noise.
Abstract: Variants of the background subtraction method are broadly used for the detection of moving objects in video sequences in different applications. In this work we propose a new approach to the background subtraction method which operates in the colour space and manages the colour information in the segmentation process to detect and eliminate noise. This new method is combined with blob-level knowledge associated with different types of blobs that may appear in the foreground. The idea is to process each pixel differently according to the category to which it belongs: real moving objects, shadows, ghosts, reflections, fluctuation or background noise. Thus, the foreground resulting from processing each image frame is refined selectively, applying at each instant the appropriate operator according to the type of noise blob we wish to eliminate. The approach proposed is adaptive, because it allows both the background model and threshold model to be updated. On the one hand, the results obtained confirm the robustness of the method proposed in a wide range of different sequences and, on the other hand, these results underline the importance of handling three colour components in the segmentation process rather than just the one grey-level component.
67 citations
Cites methods from "A fuzzy theoretic approach for vide..."
...The approach proposed is adaptive, because it allows both the background model and threshold model to be updated....
[...]
...…detecting moving objects based, for example, on statistical methods (Horprasert et al., 1999; Lee, 2005; Stauffer and Grimson, 1999), fuzzy logic (Jadon et al., 2001), the subtraction of consecutive frames (Lipton et al., 1998), optical flow (Wang et al., 2003), genetic algorithms (Kim and Park,…...
[...]
01 Jan 2015
TL;DR: This paper presents different approaches to shot boundary detection problem, and shows how segmentation plays an important role in digital media processing, pattern recognition, and computer vision.
Abstract: Video image processing is a technique to handle the video data in an effective and efficient way. It is one of the most popular aspects in the video and image based technologies such as surveillance. Shot change boundary detection is also one of the major research areas in video signal processing. Previous works have developed various algorithms in this domain. In this paper, a brief literature survey is presented that establishes an overview of the works that has been done previously. In this paper we have discussed few algorithms that were proposed previously which also includes histogram based, DCT based and motion vector based algorithms as well as their advantages and their limitations.
47 citations
References
More filters
17 Apr 1995
TL;DR: This paper proposes a method that achieves automatic video segmentation based on camera movements and defines a camera operations model for this method, which allows to achieve semantic coding for very low bitrate video compression.
Abstract: Several works have been carried out to achieve automatic video segmentation into meaningful parts. Video shots usually correspond to these meaningful parts. Many techniques have already been proposed1'2'3'4'5. Currently, finer segmentation ofvideos based on camera movements is sought. Figure 1 shows a video segmented as usual and in a finer way. Cameraoperation based segmentation allows us to better describe video contents for video-database applications5. It also allows to achieve semantic coding for very low bitrate video compression. In this paper, we propose a method that achieves automatic video segmentation based on camera movements. In section 2, we define a camera operations model. Using this model, we present in section 3 our video segmentation method. Experimental results are presented in section 4. Finally, we make a quick comparison of our method with the one presented in 6.
12 citations
01 Jan 1999
TL;DR: A general framework to evaluate and compare several temporal video segmentation algorithms and some solutions to these problems are given in this study and are applied for evaluating di erent methods developed in various contexts.
Abstract: This paper proposes a general framework to evaluate and compare several temporal video segmentation algorithms. The problems that must be solved to confront di erent methods summarise as gathering a common content set to test the methods, building a reference segmentation, establishing the rules to match the results with the reference, and providing a quality measure. Some solutions to these problems are given in this study and are applied for evaluating di erent methods developed in various contexts. The paper concludes by presenting results obtained on practical tests.
5 citations