A fuzzy theoretic approach for video segmentation using syntactic features
TL;DR: Experimental results have shown that the proposed scheme for fuzzification of the frame-to-frame property difference values using the Rayleigh distribution can detect changes reliably.
Abstract: This paper is concerned with the development of a fuzzy-logic-based framework for segmentation of video sequences. We have proposed a scheme for fuzzification of the frame-to-frame property difference values using the Rayleigh distribution. The difference values have been characterized by fuzzy terms like small, significant, large, etc. These terms have been used to design fuzzy rules for detecting abrupt changes and gradual changes. Fuzzy rules have provided a mechanism for integrating evidences based on different properties. The decompositional inference strategy has been used for fuzzy reasoning over the set of fuzzy rules. Gradual changes have been further classified as fade-in, fade-out and others (including dissolves, wipes, etc). Experimental results have shown that the proposed scheme can detect changes reliably.
Citations
More filters
TL;DR: An old and reliable method based on local histogram has been used to implement shot cut detector for real-time applications and this work has used an FPGA-based platform.
Abstract: With the enormous growth in digital audiovisual (AV) information in our life, there is an important need for tools which enable describing the AV content information. In this context, the MPEG-7 standard was developed in order to provide a set of standardized description tools which generate metadata about AV content. However, before any content-based manipulations, the hierarchical structure of video must be determined. This process is known as shot boundary detection or in other case scene change detection. In this paper, an old and reliable method based on local histogram has been used to implement shot cut detector for real-time applications. Since software implementation on PC is not suitable for this algorithm due to the sequential treatments of the processor, we have used an FPGA-based platform.
11 citations
Cites background from "A fuzzy theoretic approach for vide..."
...Ecole Nationale d'Ingénieurs de Sfax: Unité de recherche CES, France....
[...]
27 May 2008
TL;DR: Experimental results show that the approach can accurately and efficiently segment the news videos into the desired parts mentioned above and users can quickly browse or retrieve segments of interest from the news video.
Abstract: The objective of this research is to develop an automatic and efficient news video indexing and management system based on the characteristics of the structure of a complete TV news video in Taiwan. We first employed two features which include the Normalized Color Histogram Intersection of Quantized Hue and Edge Exchanging Ratio to detect the shot boundaries and to segment the corresponding shots within a news video. Next we performed human face detection on the key frames which were extracted from each shot by using harr-like features. After detecting the shots containing the human face, we classified these shots into anchorperson and non-anchorperson shots using “Anchorperson Recognition” procedure. Lastly, according to the programming and structure of a news video, we divided a complete news video into six sections listed as follows: opening animation, anchorperson greeting, headlines preview, news stories, weather forecast and the closing. Experimental results show that our approach can accurately and efficiently segment the news videos into the desired parts mentioned above. As a result, users can quickly browse or retrieve segments of interest from the news videos.
8 citations
17 Nov 2009
TL;DR: This paper presents a fast, adaptive and non-parametric approach for detecting shot boundaries, which uses an asymmetric region of support that automatically adapts to the shot boundaries.
Abstract: Detection of shot boundaries in a video has been an active for quite a long time, till the TRECVID community almost declared it as a solved problem. A problem is assumed to be solved when there is no significant improvement being achieved from that of the state-of-the art methodologies. However, certain aspects can still be researched and improved. For instance, finding appropriate parameters instead of empirical thresholds to detect the shot boundaries is very challenging and is still being researched. In this paper, we present a fast, adaptive and non-parametric approach for detecting shot boundaries. Appearance based model is used to compute the difference between two subsequent frames. These frame distances, are then used to locate the shot boundaries. The proposed shot boundary detection algorithm uses an asymmetric region of support that automatically adapts to the shot boundaries. Experiments have been conducted to verify the effectiveness and applicability of the proposed method for adaptive shot segmentation.
8 citations
TL;DR: The proposed system can detect abrupt transitions effectively with less false detection in the uncompressed domain with an average F1 score of 93.51%, which is achieve due to the reduced false detection.
Abstract: Objectives : The objective of this paper is to find out the abrupt transitions between consecutive shots in a video with less false detection and high F1 score. Method/Analysis: This paper presents a video shot boundary detection approach using Gray Level Cooccurrence Matrix (GLCM). The proposed system can roughly be divided into feature extraction using GLCM and the application of the abrupt shot boundary detection. In the first step, the frames are converted into gray level and GLCM is calculated from each frame in the video. Secondly, correlation coefficient is calculated from the GLCM of two consecutive frames of the video. A threshold is set to identify the shot boundaries of the video. The proposed system can detect abrupt transitions effectively with less false detection in the uncompressed domain. Findings: The proposed system can able to achieve an average F1 score of 93.51%, which is achieve due to the reduced false detection. Novelty/Improvement: The proposed system uses the GLCM matrix directly instead of calculating the contrast, entropy,etc, i.e., the proposed system is purely based on the correlation of the pixel's co-occurrence .The proposed system also reduced the false detection there by increasing the precision and F1 score.
6 citations
Cites background from "A fuzzy theoretic approach for vide..."
...Recall Precision F1 2 Recall Precision ́ = ́ + (7)...
[...]
...Indian Journal of Science and Technology, Vol 9(7), DOI: 10....
[...]
TL;DR: A novel method for dynamically updating the covariance matrix is also proposed, which greatly reduces the computational time compared to conventional method of calculating the covariances matrix.
Abstract: In this paper, a new technique for keyframe extraction and shot boundary detection is proposed. The proposed technique uses Eigen values for measuring the dissimilarity between the consecutive frames. The behavior of the Eigen values of covariance matrix over certain frames is analyzed to detect the shot boundary and subsequently extract the keyframe. In this paper a novel method for dynamically updating the covariance matrix is also proposed. This greatly reduces the computational time compared to conventional method of calculating the covariance matrix. The proposed technique is tested on a large variety of videos and also works on live videos. The recall and precision of simulation results reveal that the proposed technique is highly efficient and accurate in detecting the abrupt cuts.
6 citations
References
More filters
Book•
[...]
01 Aug 1996
TL;DR: A separation theorem for convex fuzzy sets is proved without requiring that the fuzzy sets be disjoint.
Abstract: A fuzzy set is a class of objects with a continuum of grades of membership. Such a set is characterized by a membership (characteristic) function which assigns to each object a grade of membership ranging between zero and one. The notions of inclusion, union, intersection, complement, relation, convexity, etc., are extended to such sets, and various properties of these notions in the context of fuzzy sets are established. In particular, a separation theorem for convex fuzzy sets is proved without requiring that the fuzzy sets be disjoint.
52,705 citations
Book•
01 Jan 1978
TL;DR: This best-selling, easy to read book offers the most complete discussion on the theories and principles behind today's most advanced communications systems.
Abstract: This best-selling, easy to read book offers the most complete discussion on the theories and principles behind today's most advanced communications systems. Throughout, Haykin emphasizes the statistical underpinnings of communication theory in a complete and detailed manner. Readers are guided though topics ranging from pulse modulation and passband digital transmission to random processes and error-control coding. The fifth edition has also been revised to include an extensive treatment of digital communications.
3,055 citations
TL;DR: In this article, a fuzzy logic is used to synthesize linguistic control protocol of a skilled operator for industrial plants, which has been applied to pilot scale plants as well as in practical situations.
Abstract: This paper describes an application of fuzzy logic in designing controllers for industrial plants. A fuzzy logic is used to synthesize linguistic control protocol of a skilled operator. The method has been applied to pilot scale plants as well as in practical situations. The merits of this method and its usefulness to control engineering are discussed. An avenue for further work in this area is described where the need is to go beyond a purely descriptive approach, and means for implementing a prescriptive or a self-organizing system are explored.
2,011 citations
TL;DR: A twin-comparison approach has been developed to solve the problem of detecting transitions implemented by special effects, and a motion analysis algorithm is applied to determine whether an actual transition has occurred.
Abstract: Partitioning a video source into meaningful segments is an important step for video indexing. We present a comprehensive study of a partitioning system that detects segment boundaries. The system is based on a set of difference metrics and it measures the content changes between video frames. A twin-comparison approach has been developed to solve the problem of detecting transitions implemented by special effects. To eliminate the false interpretation of camera movements as transitions, a motion analysis algorithm is applied to determine whether an actual transition has occurred. A technique for determining the threshold for a difference metric and a multi-pass approach to improve the computation speed and accuracy have also been developed.
1,360 citations
Journal Article•
744 citations