A fuzzy theoretic approach for video segmentation using syntactic features
TL;DR: Experimental results have shown that the proposed scheme for fuzzification of the frame-to-frame property difference values using the Rayleigh distribution can detect changes reliably.
Abstract: This paper is concerned with the development of a fuzzy-logic-based framework for segmentation of video sequences. We have proposed a scheme for fuzzification of the frame-to-frame property difference values using the Rayleigh distribution. The difference values have been characterized by fuzzy terms like small, significant, large, etc. These terms have been used to design fuzzy rules for detecting abrupt changes and gradual changes. Fuzzy rules have provided a mechanism for integrating evidences based on different properties. The decompositional inference strategy has been used for fuzzy reasoning over the set of fuzzy rules. Gradual changes have been further classified as fade-in, fade-out and others (including dissolves, wipes, etc). Experimental results have shown that the proposed scheme can detect changes reliably.
Citations
More filters
TL;DR: The proposed shot boundary detection approach using Genetic Algorithm and Fuzzy Logic is compared to latest techniques and yields better result in terms of F1score parameter.
Abstract: This paper proposed a shot boundary detection approach using Genetic Algorithm and Fuzzy Logic. In this, the membership functions of the fuzzy system are calculated using Genetic Algorithm by taking preobserved actual values for shot boundaries. The classification of the types of shot transitions is done by the fuzzy system. Experimental results show that the accuracy of the shot boundary detection increases with the increase in iterations or generations of the GA optimization process. The proposed system is compared to latest techniques and yields better result in terms of F1score parameter.
45 citations
Cites background or methods from "A fuzzy theoretic approach for vide..."
...The rule base consists of 28 rules of the form as in [6]....
[...]
...In this paper, we introduced a method of shot boundary detection using Fuzzy Logic system optimized by GA. Fuzzy system is used to classify the video frames into different types of transitions (cut and gradual) using normalized Color Histogram Difference....
[...]
...In [6], the normalized color histogram between two frames, say ith and (i + 1)th frames, in a video is defined as follows:...
[...]
...Genetic Algorithm [12, 13] and Fuzzy Logic [6, 14, 15] have been used for shot boundary detection....
[...]
...Global feature extraction considers the whole feature of the frame such as the pixel value [6]....
[...]
01 Sep 2016
TL;DR: This article is targeted to focus on the relevant hybrid soft computing techniques which are in practice for content-based image and video retrieval, which serve to enhance the overall performance and robustness of the system with reduced human interference.
Abstract: Graphical abstractDisplay Omitted There has been an unrestrained growth of videos on the Internet due to proliferation of multimedia devices. These videos are mostly stored in unstructured repositories which pose enormous challenges for the task of both image and video retrieval. Users aim to retrieve videos of interest having content which is relevant to their need. Traditionally, low-level visual features have been used for content based video retrieval (CBVR). Consequently, a gap existed between these low-level features and the high level semantic content. The semantic differential was partially bridged by proliferation of research on interest point detectors and descriptors, which represented mid-level features of the content. The computational time and human interaction involved in the classical approaches for CBVR are quite cumbersome. In order to increase the accuracy, efficiency and effectiveness of the retrieval process, researchers resorted to soft computing paradigms. The entire retrieval task was automated to a great extent using individual soft computing components. Due to voluminous growth in the size of multimedia databases, augmented by an exponential rise in the number of users, integration of two or more soft computing techniques was desirable for enhanced efficiency and accuracy of the retrieval process. The hybrid approaches serve to enhance the overall performance and robustness of the system with reduced human interference. This article is targeted to focus on the relevant hybrid soft computing techniques which are in practice for content-based image and video retrieval.
41 citations
01 Jun 2016
TL;DR: A new method for SBD using a three-stage approach based on the Multilevel Difference of Colour Histograms to achieve high detection accuracy with low computational cost is proposed.
Abstract: Shot boundary detection (SBD) is a fundamental step in video retrieval and analysis. Although the existing methods have achieved a lot on this field, this problem has not been sufficiently resolved, especially for the gradual boundary. This paper proposed a new method for SBD using a three-stage approach based on the Multilevel Difference of Colour Histograms. In the first stage, we detect the cut candidate boundaries and gradual candidate boundaries using two self-adapted thresholds. In this stage, we transform the candidate gradual change to cut change so that the cut change and gradual change can be dealt in a same way. It helps to keep a high recall rate. The second stage detects the local maximum difference of the MDCH generated by shot boundaries to filter the noises incurred by object motion, flash and camera zoom. A voting mechanism is used to make a final detection in the third stage. The second and the third stage contribute to a high precision rate. We evaluated the proposed method on TRECVID datasets and compared it with other methods. Experiment results demonstrate that the proposed method achieves high detection accuracy with low computational cost.
29 citations
Cites methods from "A fuzzy theoretic approach for vide..."
...Edge based methods extract object edges in each frame, if the edges from continuous frames differ significantly, then a shot boundary may probably occurs [11]....
[...]
TL;DR: A novel shot boundary detection method which combines the Advantages of Particle Swarm Optimization (PSO) and Gravitational Search Algorithm (GSA) to optimize the weights of the Feed-Forward Neural Network (FNN).
Abstract: This paper proposes a novel shot boundary detection method which combines the Advantages of Particle Swarm Optimization (PSO) and Gravitational Search Algorithm (GSA) to optimize the weights of the Feed-Forward Neural Network (FNN). To increase the performance of the system, the output of the hybrid technique is again analyzed by forming a Continuity matrix (ϕ). Then an Outlier along with a Continuity matrix is used for extracting a possible set of transition frames. A set of thresholds δ1 and δ2 is selected for classifying abrupt and gradual transitions from the available set of possible transition frames. Experimental results using TRECVid 2001 depicts that PSOGSA outperforms GSA and PSO in-terms of training the feed forward neural network and generating a higher overall F1 score. The proposed system also gives better performance when compared with other latest techniques in-terms of F1 score.
22 citations
01 Jan 2014
TL;DR: This paper presents a short survey on video segmentation, which highlights the need for an effective video indexing and video retrieval of high-quality videos when effective segmentation tools and algorithms are available.
Abstract: This paper presents a short survey on video segmentation. Due to the growth in multimedia information, an effective video indexing and video retrieval is necessary. This can be achieved when an effective video segmentation tools and algorithms are available. MPEG-compressed videos are mostly used by researchers for video segmentation. Shot boundary detection, color histogram characteristics, DC-images, motion vector and motion compensation, threshold-based detector, etc. are mostly used for video segmentation.
20 citations
References
More filters
Book•
[...]
01 Aug 1996
TL;DR: A separation theorem for convex fuzzy sets is proved without requiring that the fuzzy sets be disjoint.
Abstract: A fuzzy set is a class of objects with a continuum of grades of membership. Such a set is characterized by a membership (characteristic) function which assigns to each object a grade of membership ranging between zero and one. The notions of inclusion, union, intersection, complement, relation, convexity, etc., are extended to such sets, and various properties of these notions in the context of fuzzy sets are established. In particular, a separation theorem for convex fuzzy sets is proved without requiring that the fuzzy sets be disjoint.
52,705 citations
Book•
01 Jan 1978
TL;DR: This best-selling, easy to read book offers the most complete discussion on the theories and principles behind today's most advanced communications systems.
Abstract: This best-selling, easy to read book offers the most complete discussion on the theories and principles behind today's most advanced communications systems. Throughout, Haykin emphasizes the statistical underpinnings of communication theory in a complete and detailed manner. Readers are guided though topics ranging from pulse modulation and passband digital transmission to random processes and error-control coding. The fifth edition has also been revised to include an extensive treatment of digital communications.
3,055 citations
TL;DR: In this article, a fuzzy logic is used to synthesize linguistic control protocol of a skilled operator for industrial plants, which has been applied to pilot scale plants as well as in practical situations.
Abstract: This paper describes an application of fuzzy logic in designing controllers for industrial plants. A fuzzy logic is used to synthesize linguistic control protocol of a skilled operator. The method has been applied to pilot scale plants as well as in practical situations. The merits of this method and its usefulness to control engineering are discussed. An avenue for further work in this area is described where the need is to go beyond a purely descriptive approach, and means for implementing a prescriptive or a self-organizing system are explored.
2,011 citations
TL;DR: A twin-comparison approach has been developed to solve the problem of detecting transitions implemented by special effects, and a motion analysis algorithm is applied to determine whether an actual transition has occurred.
Abstract: Partitioning a video source into meaningful segments is an important step for video indexing. We present a comprehensive study of a partitioning system that detects segment boundaries. The system is based on a set of difference metrics and it measures the content changes between video frames. A twin-comparison approach has been developed to solve the problem of detecting transitions implemented by special effects. To eliminate the false interpretation of camera movements as transitions, a motion analysis algorithm is applied to determine whether an actual transition has occurred. A technique for determining the threshold for a difference metric and a multi-pass approach to improve the computation speed and accuracy have also been developed.
1,360 citations
Journal Article•
744 citations