A fuzzy theoretic approach for video segmentation using syntactic features
TL;DR: Experimental results have shown that the proposed scheme for fuzzification of the frame-to-frame property difference values using the Rayleigh distribution can detect changes reliably.
Abstract: This paper is concerned with the development of a fuzzy-logic-based framework for segmentation of video sequences. We have proposed a scheme for fuzzification of the frame-to-frame property difference values using the Rayleigh distribution. The difference values have been characterized by fuzzy terms like small, significant, large, etc. These terms have been used to design fuzzy rules for detecting abrupt changes and gradual changes. Fuzzy rules have provided a mechanism for integrating evidences based on different properties. The decompositional inference strategy has been used for fuzzy reasoning over the set of fuzzy rules. Gradual changes have been further classified as fade-in, fade-out and others (including dissolves, wipes, etc). Experimental results have shown that the proposed scheme can detect changes reliably.
Citations
More filters
TL;DR: The proposed system shows an activity-based shot boundary detection where only the possible transition regions of a video are considered for shot detection, which reduces the computational complexity by processing the transition regions only.
Abstract: The paper proposes a shot boundary detection system using Gist and local descriptor. Gist provides the perceptual and conceptual information of a scene. The proposed system can be roughly divided into three steps. The first step consists of forming of groups of frames by calculating the correlation of the Gist features between consecutive frames of the video. Secondly, abrupt transitions are found out using the group (G), MSER and a threshold (for abrupt separately, $$th_{cut}$$
). And lastly, gradual transitions of the video are found using triangular pattern matching. We have performed the experiment on TRECVid 2001 and 2007 dataset. The novel contribution of this paper is that the proposed system shows an activity-based shot boundary detection where only the possible transition regions of a video are considered for shot detection. This approach reduces the computational complexity by processing the transition regions only. We have achieved better results in terms of F1, precision and recall, when compared to previously published approaches.
14Â citations
TL;DR: An approach to identifying a viewer's video preferences uses hidden Markov models by combining visual features and closed captions.
Abstract: An approach to identifying a viewer's video preferences uses hidden Markov models by combining visual features and closed captions.
13Â citations
TL;DR: A new algorithm is put forward for shot boundary detection, which can distinguish the gradual transition if there are quickly moving objects in the frames, and the experimental results show that the improved algorithm can detect the shot boundary more accurately than some existing researches.
Abstract: Shot boundary detection is an important research topic in the field of video processing technology, which has a wide range of applications in video indexing, pattern recognition, video summarization, video classification, video retrieval, etc. Shot boundary detection includes both abrupt (cut) and gradual transition detection. In this paper, a new method is proposed for extracting the feature from frames of a video. We name the proposed method as fuzzy color distribution chart (FCDC). FCDC can be used to describe the spatial distribution of colors and avoid the influences of noise, slight illumination and insertions such as words and logos. Based on the FCDC, a new algorithm is put forward for shot boundary detection, which can distinguish the gradual transition if there are quickly moving objects in the frames. Our proposed algorithm can be employed to suppress some defects of shot boundary detection that cannot be solved completely, and the experimental results show that the improved algorithm can detect the shot boundary more accurately than some existing researches.
12Â citations
TL;DR: The proposed method for amalgamating several distance features extracted from video frames is proved to be effective by means of the results obtained, which show that multiple feature amalgamation can lead to a hybrid distance feature which performs better than the best feature incorporated for SBD.
Abstract: Shot boundary detection (SBD) is the preliminary and most significant step in Content Based Video Retrieval (CBVR). As such the effectiveness of a CBVR system depends heavily on reliable detection of shot boundaries. In this work, a simple yet effective technique for amalgamating several distance features extracted from video frames has been proposed. The aim here is to develop a technique which is able to produce a better distance feature from the existing ones by hybridizing several distance metrics. In the proposed model, any number of distance features can be incorporated and fused together. The resultant feature is not only more robust but also immune to features which are inefficient. Robustness of the proposed method is tested by combining several low performing features with the more efficient ones. Several statistical amalgamation functions are also tested for determining the most efficient one in terms of F1 score. The power of vague sets has been harnessed to detect the shot boundaries effectively using the resultant distance feature. The proposed method is proved to be effective by means of the results obtained, which show that multiple feature amalgamation can lead to a hybrid distance feature which performs better than the best feature incorporated for SBD. The proposed technique is analyzed using ANOVA. A comparison with the other existing methods portray the efficacy of the proposed approach. This method can also be applied for other research problems where several features are to be fused together for producing superior results than the ones obtained by individual methods.
12Â citations
05 Mar 2015
TL;DR: In this paper, the authors present different approaches to shot boundary detection problem in video segmentation, which is necessary to partition the video into shots for easy indexing and retrieval of video.
Abstract: Due to huge growth in multimedia and technology, it is very important to go through the point of interest rather than accessing the entire video. For efficient indexing and retrieving the interest points, content based video retrieval is used. The first step toward CBVR is shot boundary detection. It is necessary to partition the video into shots for easy indexing and retrieval of video. Therefore, segmentation plays an important role in digital media processing, pattern recognition, and computer vision. In this paper, we present different approaches to shot boundary detection problem.
11Â citations
References
More filters
Book•
[...]
01 Aug 1996
TL;DR: A separation theorem for convex fuzzy sets is proved without requiring that the fuzzy sets be disjoint.
Abstract: A fuzzy set is a class of objects with a continuum of grades of membership. Such a set is characterized by a membership (characteristic) function which assigns to each object a grade of membership ranging between zero and one. The notions of inclusion, union, intersection, complement, relation, convexity, etc., are extended to such sets, and various properties of these notions in the context of fuzzy sets are established. In particular, a separation theorem for convex fuzzy sets is proved without requiring that the fuzzy sets be disjoint.
52,705Â citations
Book•
01 Jan 1978
TL;DR: This best-selling, easy to read book offers the most complete discussion on the theories and principles behind today's most advanced communications systems.
Abstract: This best-selling, easy to read book offers the most complete discussion on the theories and principles behind today's most advanced communications systems. Throughout, Haykin emphasizes the statistical underpinnings of communication theory in a complete and detailed manner. Readers are guided though topics ranging from pulse modulation and passband digital transmission to random processes and error-control coding. The fifth edition has also been revised to include an extensive treatment of digital communications.
3,055Â citations
TL;DR: In this article, a fuzzy logic is used to synthesize linguistic control protocol of a skilled operator for industrial plants, which has been applied to pilot scale plants as well as in practical situations.
Abstract: This paper describes an application of fuzzy logic in designing controllers for industrial plants. A fuzzy logic is used to synthesize linguistic control protocol of a skilled operator. The method has been applied to pilot scale plants as well as in practical situations. The merits of this method and its usefulness to control engineering are discussed. An avenue for further work in this area is described where the need is to go beyond a purely descriptive approach, and means for implementing a prescriptive or a self-organizing system are explored.
2,011Â citations
TL;DR: A twin-comparison approach has been developed to solve the problem of detecting transitions implemented by special effects, and a motion analysis algorithm is applied to determine whether an actual transition has occurred.
Abstract: Partitioning a video source into meaningful segments is an important step for video indexing. We present a comprehensive study of a partitioning system that detects segment boundaries. The system is based on a set of difference metrics and it measures the content changes between video frames. A twin-comparison approach has been developed to solve the problem of detecting transitions implemented by special effects. To eliminate the false interpretation of camera movements as transitions, a motion analysis algorithm is applied to determine whether an actual transition has occurred. A technique for determining the threshold for a difference metric and a multi-pass approach to improve the computation speed and accuracy have also been developed.
1,360Â citations
Journal Article•
744Â citations