Automatic detection and recognition of traffic signs plays a crucial role in management of the traffic-sign inventory. It provides an accurate and timely way to manage traffic-sign inventory with a minimal human effort. In the computer vision community, the recognition and detection of traffic signs are a well-researched problem. A vast majority of existing approaches perform well on traffic signs needed for advanced driver-assistance and autonomous systems. However, this represents a relatively small number of all traffic signs (around 50 categories out of several hundred) and performance on the remaining set of traffic signs, which are required to eliminate the manual labor in traffic-sign inventory management, remains an open question. In this paper, we address the issue of detecting and recognizing a large number of traffic-sign categories suitable for automating traffic-sign inventory management. We adopt a convolutional neural network (CNN) approach, the mask R-CNN, to address the full pipeline of detection and recognition with automatic end-to-end learning. We propose several improvements that are evaluated on the detection of traffic signs and result in an improved overall performance. This approach is applied to detection of 200 traffic-sign categories represented in our novel dataset. The results are reported on highly challenging traffic-sign categories that have not yet been considered in previous works. We provide comprehensive analysis of the deep learning method for the detection of traffic signs with a large intra-category appearance variation and show below 3% error rates with the proposed approach, which is sufficient for deployment in practical applications of the traffic-sign inventory management.

Deep Learning for Large-Scale Traffic-Sign Detection and Recognition

Detection of abnormalities in wireless capsule endoscopy (WCE) images is a challenging task. Typically, these images suffer from low contrast, complex background, variations in lesion shape and color, which affect the accuracy of their segmentation and subsequent classification. This research proposes an automated system for detection and classification of ulcers in WCE images, based on state-of-the-art deep learning networks. Deep learning techniques, and in particular, convolutional neural networks (CNNs), have recently become popular in the analysis and recognition of medical images. The medical image datasets used in this study were obtained from WCE video frames. In this work, two milestone CNN architectures, namely the AlexNet and the GoogLeNet are extensively evaluated in object classification into ulcer or non-ulcer. Furthermore, we examine and analyze the images identified as containing ulcer objects to evaluate the efficiency of the utilized CNNs. Extensive experiments show that CNNs deliver superior performance, surpassing traditional machine learning methods by large margins, which supports their effectiveness as automated diagnosis tools.

Application of Convolutional Neural Networks for Automated Ulcer Detection in Wireless Capsule Endoscopy Images.

The continuous improvements in the area of medical imaging, makes the patient monitoring a crucial concern. The internet of things (IoT) embedded in a medical technologies to collect data from human body through sensors, wireless connectivity etc. The junction of medicine and IT like medical informatics will transform healthcare, curbing cost, make more efficient, and saving lives. Various computerized techniques are implemented in the area of Artificial Intelligence (AI) for the application of medical imaging to diagnose the infected regions in the images and videos such as WCE and pathology. The famous stomach infections are ulcer, polyp, and bleeding. Stomach cancer is the most common infection and a leading cause of human deaths worldwide. In the USA, since 2019, a total of 27,510 new cases are reported including 17,230 men and 10,230 women. While the number of deaths is 11,140 consists of 6,800 men and 4,340 women. The manual diagnosis of these stomach infections is a difficult and agitated process therefore it is required to design a fully automated system using AI. In this article, we presented a fully automated system for stomach infection recognition based on deep learning features fusion and selection. In this design, ulcer images are assigned manually and support to a saliency-based method for ulcer detection. Later, pre-trained deep learning model named VGG16 is employing and re-trained using transfer learning. Features of re-trained model are extracted from two consecutive fully connected layers and fused by array-based approach. Besides, the best individuals are selected through the metaheuristic approach name PSO along mean value-based fitness function. The selected individuals are finally recognized through Cubic SVM. The experiments are conducted on Private collected dataset and achieved an accuracy of 98.4%, which is best as compared to existing state-of-the-art techniques.

/pdf/computer-aided-gastrointestinal-diseases-analysis-from-5fqu69e3xp.pdf

Computer-Aided Gastrointestinal Diseases Analysis From Wireless Capsule Endoscopy: A Framework of Best Features Selection

Gastrointestinal tract (GIT) infections such as ulcers, bleeding, polyps, Crohn’s disease and cancer are quite familiar today worldwide. Wireless capsule endoscopy (WCE) is an efficient means of in...

Deep CNN and geometric features-based gastrointestinal tract diseases detection and classification from wireless capsule endoscopy images

Automated detection and classification of gastric infections (i.e., ulcer, polyp, esophagitis, and bleeding) through wireless capsule endoscopy (WCE) is still a key challenge. Doctors can identify these endoscopic diseases by using the computer?aided diagnostic (CAD) systems. In this article, a new fully automated system is proposed for the recognition of gastric infections through multi?type features extraction, fusion, and robust features selection. Five key steps are performed—database creation, handcrafted and convolutional neural network (CNN) deep features extraction, a fusion of extracted features, selection of best features using a genetic algorithm (GA), and recognition. In the features extraction step, discrete cosine transform, discrete wavelet transform strong color feature, and VGG16?based CNN features are extracted. Later, these features are fused by simple array concatenation and GA is performed through which best features are selected based on K?Nearest Neighbor fitness function. In the last, best selected features are provided to Ensemble classifier for recognition of gastric diseases. A database is prepared using four datasets—Kvasir, CVC?ClinicDB, Private, and ETIS?LaribPolypDB with four types of gastric infections such as ulcer, polyp, esophagitis, and bleeding. Using this database, proposed technique performs better as compared to existing methods and achieves an accuracy of 96.5%.

Classification of stomach infections: A paradigm of convolutional neural network along with classical features fusion and selection

Wireless capsule endoscopy (WCE) is a novel imaging technique that can travel through human body and image the small bowel entirely. Therefore, it has been gradually adopted compared with traditional endoscopies for gastrointestinal diseases. However, the big number of the produced images by a WCE test makes their review exhaustive for the physicians. It is helpful for clinicians if we can develop a computer-aided diagnosis system for the task of identifying the images with potential problems. The aim of this paper is to automatize the process of WCE images abnormalities detection by presenting a new texture extraction scheme for pathological inflammation, polyp, and bleeding regions discrimination in WCE images. A new approach based on local binary pattern variance and discrete wavelet transform is proposed. The new textural features scheme has many advantages, e.g., it detects multi-directional characteristics and overcomes the illuminations changes in WCE images. Intensive experiments are conducted on two datasets constructed from several WCE exams. The promising results make the presented method suitable for abnormalities detection in WCE images.

Computer-aided diagnosis system for colon abnormalities detection in wireless capsule endoscopy images

In this paper, we present a computer vision based system for fast robust Traffic Sign Detection and Recognition (TSDR), consisting of three steps. The first step consists on image enhancement and thresholding using the three components of the Hue Saturation and Value (HSV) space. Then we refer to distance to border feature and Random Forests classifier to detect circular, triangular and rectangular shapes on the segmented images. The last step consists on identifying the information included in the detected traffic signs. We compare four features descriptors which include Histogram of Oriented Gradients (HOG), Gabor, Local Binary Pattern (LBP), and Local Self-Similarity (LSS). We also compare their different combinations. For the classifiers we have carried out a comparison between Random Forests and Support Vector Machines (SVMs). The best results are given by the combination HOG with LSS together with the Random Forest classifier. The proposed method has been tested on the Swedish Traffic Signs Data set and gives satisfactory results.

/pdf/traffic-sign-detection-and-recognition-using-features-3ydtwaaquc.pdf

Traffic Sign Detection and Recognition using Features Combination and Random Forests

Wireless capsule endoscopy (WCE) has revolutionised the diagnosis and treatment of gastrointestinal tract, especially the small intestine which is unreachable by traditional endoscopies. The drawback of the WCE is that it produces a large number of images to be inspected by the clinicians. Hence, the design of a computer-aided diagnosis (CAD) system will have a great potential to help reduce the diagnosis time and improve the detection accuracy. To address this problem, the authors propose a CAD system for automatic detection of ulcer in WCE images. Firstly, they enhance the input images to be better exploited in the main steps of the proposed method. Afterward, segmentation using saliency map-based texture and colour is applied to the WCE images in order to highlight ulcerous regions. Then, inspired by the existing feature extraction approaches, a new one has been proposed for the recognition of the segmented regions. Finally, a new recognition scheme is proposed based on hidden Markov model using the classification scores of the conventional methods (support vector machine, multilayer perceptron and random forest) as observations. Experimental results with two different datasets show that the proposed method gives promising results.

/pdf/computer-aided-diagnosis-system-for-ulcer-detection-in-26uyqwnmhk.pdf

Computer-aided diagnosis system for ulcer detection in wireless capsule endoscopy images

In this paper, we present a new feature descriptor for automatic recognition of frames with ulcer in Wireless Capsule Endoscopy (WCE) images. The new approach is based on the fact that the ulcer disease exhibits various features that can not be detected with a single descriptor. Hence, we have combined two stages of the art descriptors in order to get more powerful one. Complete Local Binary Pattern (CLBP) descriptor is used to detect the texture information in the image. In parallel, the Global Local Oriented Edge Magnitude Pattern (Global LOEMP) descriptor is employed to extract the color features. Finally, we combine the feature vectors to get a more discriminating one. Experiments were conducted and the results are satisfactory.

Computer-aided diagnosis system for ulcer detection in wireless capsule endoscopy videos

Wireless capsule endoscopy (WCE) is a device that can move through human body and capture the small bowel entirely. Thus, it is presented as an excellent diagnostic tool for evaluation of gastrointestinal diseases compared with traditional endoscopies. However, the diagnosis by the physicians is tedious since it requires reviewing the video extracted from the capsule and analysing all of its frames. This tedious task has fuelled the efforts of researchers to provide automated diagnostic techniques for WCE frameworks to detect symptoms of gastrointestinal illness. In this paper, a new computer-aided diagnosis method for abnormalities detection in WCE images is proposed. After a preprocessing step, we extract from these images the descriptor we feed to a kernel extreme learning machine to perform the classification process. The descriptor used in this work is a combination between the histogram of oriented gradients (HOG) that were extracted using the hue component of the HSV colour space, and a modified rotation-invariant local binary pattern. The proposed approach has been tested on different datasets, and the results obtained are satisfactory when compared to the state-of-the-art works.

Said Charfi

Papers

Computer-aided diagnosis system for colon abnormalities detection in wireless capsule endoscopy images

Traffic Sign Detection and Recognition using Features Combination and Random Forests

Computer-aided diagnosis system for ulcer detection in wireless capsule endoscopy images

Computer-aided diagnosis system for ulcer detection in wireless capsule endoscopy videos

Detection of abnormalities in wireless capsule endoscopy based on extreme learning machine