Open AccessPosted Content
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
TLDR
Faster R-CNN as discussed by the authors proposes a Region Proposal Network (RPN) to generate high-quality region proposals, which are used by Fast R-NN for detection.Abstract:
State-of-the-art object detection networks depend on region proposal algorithms to hypothesize object locations. Advances like SPPnet and Fast R-CNN have reduced the running time of these detection networks, exposing region proposal computation as a bottleneck. In this work, we introduce a Region Proposal Network (RPN) that shares full-image convolutional features with the detection network, thus enabling nearly cost-free region proposals. An RPN is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained end-to-end to generate high-quality region proposals, which are used by Fast R-CNN for detection. We further merge RPN and Fast R-CNN into a single network by sharing their convolutional features---using the recently popular terminology of neural networks with 'attention' mechanisms, the RPN component tells the unified network where to look. For the very deep VGG-16 model, our detection system has a frame rate of 5fps (including all steps) on a GPU, while achieving state-of-the-art object detection accuracy on PASCAL VOC 2007, 2012, and MS COCO datasets with only 300 proposals per image. In ILSVRC and COCO 2015 competitions, Faster R-CNN and RPN are the foundations of the 1st-place winning entries in several tracks. Code has been made publicly available.read more
Citations
More filters
Journal ArticleDOI
Evaluation of Combined Artificial Intelligence and Radiologist Assessment to Interpret Screening Mammograms
Thomas Schaffter,Diana S. M. Buist,Christoph I. Lee,Yaroslav Nikulin,Dezső Ribli,Yuanfang Guan,William Lotter,Zequn Jie,Hao Du,Sijia Wang,Jiashi Feng,Mengling Feng,Hyo-Eun Kim,F. Albiol,Alberto Albiol,Stephen Morrell,Zbigniew Wojna,Mehmet Eren Ahsen,Umar Asif,Antonio Jimeno Yepes,Shivanthan A.C. Yohanandan,Simona Rabinovici-Cohen,Darvin Yi,Bruce Hoff,Thomas Yu,Elias Chaibub Neto,Daniel L. Rubin,Peter Lindholm,Laurie R. Margolies,Russell B. McBride,Joseph H. Rothstein,Weiva Sieh,Rami Ben-Ari,Stefan Harrer,Andrew D. Trister,Stephen H. Friend,Thea Norman,Berkman Sahiner,Fredrik Strand,Fredrik Strand,Justin Guinney,Gustavo Stolovitzky,Lester Mackey,Joyce Cahoon,Li Shen,Jae Ho Sohn,Hari Trivedi,Yiqiu Shen,Ljubomir Buturovic,Jose Costa Pereira,Jaime S. Cardoso,Eduardo Castro,Karl Trygve Kalleberg,Obioma Pelka,Imane Nedjar,Krzysztof J. Geras,Felix Nensa,Ethan Goan,Sven Koitka,Sven Koitka,Luis Caballero,David D. Cox,Pavitra Krishnaswamy,Gaurav Pandey,Christoph M. Friedrich,Dimitri Perrin,Clinton Fookes,Bibo Shi,Gerard Cardoso Negrie,Michael Kawczynski,Kyunghyun Cho,Can Son Khoo,Joseph Y. Lo,A. Gregory Sorensen,Hwejin Jung +74 more
TL;DR: This diagnostic accuracy study evaluates whether artificial intelligence can overcome human mammography interpretation limits with a rigorous, unbiased evaluation of machine learning algorithms.
Journal ArticleDOI
From Deterministic to Generative: Multimodal Stochastic RNNs for Video Captioning
TL;DR: Wang et al. as mentioned in this paper proposed a generative approach, referred to as multimodal stochastic recurrent neural networks (MS-RNNs), which models the uncertainty observed in the data using latent variables.
Posted Content
You Only Look Twice: Rapid Multi-Scale Object Detection In Satellite Imagery
TL;DR: This work proposes a pipeline (You Only Look Twice, or YOLT) that evaluates satellite images of arbitrary size at a rate of >0.5 km2/s, and concludes that objects only ~5 pixels in size can still be localized with high confidence.
Journal ArticleDOI
Visual question answering: Datasets, algorithms, and future challenges
Kushal Kafle,Christopher Kanan +1 more
TL;DR: This review critically examine the current state of VQA in terms of problem formulation, existing datasets, evaluation metrics, and algorithms, and exhaustively review existing algorithms for V QA.
Journal ArticleDOI
Deep learning in bioinformatics: Introduction, application, and perspective in the big data era.
TL;DR: This review provides both the exoteric introduction of deep learning, and concrete examples and implementations of its representative applications in bioinformatics, and introduces deep learning in an easy-to-understand fashion.
References
More filters
Proceedings ArticleDOI
Deep Residual Learning for Image Recognition
TL;DR: In this article, the authors proposed a residual learning framework to ease the training of networks that are substantially deeper than those used previously, which won the 1st place on the ILSVRC 2015 classification task.
Proceedings Article
ImageNet Classification with Deep Convolutional Neural Networks
TL;DR: The state-of-the-art performance of CNNs was achieved by Deep Convolutional Neural Networks (DCNNs) as discussed by the authors, which consists of five convolutional layers, some of which are followed by max-pooling layers, and three fully-connected layers with a final 1000-way softmax.
Proceedings Article
Very Deep Convolutional Networks for Large-Scale Image Recognition
Karen Simonyan,Andrew Zisserman +1 more
TL;DR: In this paper, the authors investigated the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting and showed that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 layers.
Proceedings ArticleDOI
Going deeper with convolutions
Christian Szegedy,Wei Liu,Yangqing Jia,Pierre Sermanet,Scott Reed,Dragomir Anguelov,Dumitru Erhan,Vincent Vanhoucke,Andrew Rabinovich +8 more
TL;DR: Inception as mentioned in this paper is a deep convolutional neural network architecture that achieves the new state of the art for classification and detection in the ImageNet Large-Scale Visual Recognition Challenge 2014 (ILSVRC14).
Journal ArticleDOI
ImageNet Large Scale Visual Recognition Challenge
Olga Russakovsky,Jia Deng,Hao Su,Jonathan Krause,Sanjeev Satheesh,Sean Ma,Zhiheng Huang,Andrej Karpathy,Aditya Khosla,Michael S. Bernstein,Alexander C. Berg,Li Fei-Fei +11 more
TL;DR: The ImageNet Large Scale Visual Recognition Challenge (ILSVRC) as mentioned in this paper is a benchmark in object category classification and detection on hundreds of object categories and millions of images, which has been run annually from 2010 to present, attracting participation from more than fifty institutions.