scispace - formally typeset
Proceedings ArticleDOI

Mask R-CNN

Reads0
Chats0
TLDR
This work presents a conceptually simple, flexible, and general framework for object instance segmentation, which extends Faster R-CNN by adding a branch for predicting an object mask in parallel with the existing branch for bounding box recognition.
Abstract
We present a conceptually simple, flexible, and general framework for object instance segmentation. Our approach efficiently detects objects in an image while simultaneously generating a high-quality segmentation mask for each instance. The method, called Mask R-CNN, extends Faster R-CNN by adding a branch for predicting an object mask in parallel with the existing branch for bounding box recognition. Mask R-CNN is simple to train and adds only a small overhead to Faster R-CNN, running at 5 fps. Moreover, Mask R-CNN is easy to generalize to other tasks, e.g., allowing us to estimate human poses in the same framework. We show top results in all three tracks of the COCO suite of challenges, including instance segmentation, bounding-box object detection, and person keypoint detection. Without tricks, Mask R-CNN outperforms all existing, single-model entries on every task, including the COCO 2016 challenge winners. We hope our simple and effective approach will serve as a solid baseline and help ease future research in instance-level recognition. Code will be made available.

read more

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI

Clinically applicable deep learning framework for organs at risk delineation in CT images

TL;DR: A new deep learning-based method for delineating organs in the area of head and neck performs faster and more accurately than human experts, significantly outperforming human experts and the previous state-of-the-art method.
Proceedings ArticleDOI

Overcoming Classifier Imbalance for Long-Tail Object Detection With Balanced Group Softmax

TL;DR: Li et al. as mentioned in this paper proposed a balanced group softmax (BAGS) module for balancing the classifiers within the detection frameworks through group-wise training, which implicitly modulates the training process for the head and tail classes and ensures they are both sufficiently trained.
Posted Content

TrackFormer: Multi-Object Tracking with Transformers.

TL;DR: Trackformer as discussed by the authors proposes an end-to-end MOT approach based on an encoder-decoder Transformer architecture, which achieves data association between frames via attention by evolving a set of track predictions through a video sequence.
Journal ArticleDOI

Deep learning for chest X-ray analysis: A survey.

TL;DR: In this article, a review of deep learning on chest X-ray images is presented, focusing on image-level prediction (classification and regression), segmentation, localization, image generation and domain adaptation.
Journal ArticleDOI

Applications of deep learning in fundus images: A review.

TL;DR: In this paper, a review of the recent developments in deep learning for fundus images with a review paper is presented, where the authors introduce 143 application papers with a carefully designed hierarchy.
References
More filters
Proceedings ArticleDOI

Deep Residual Learning for Image Recognition

TL;DR: In this article, the authors proposed a residual learning framework to ease the training of networks that are substantially deeper than those used previously, which won the 1st place on the ILSVRC 2015 classification task.
Proceedings Article

ImageNet Classification with Deep Convolutional Neural Networks

TL;DR: The state-of-the-art performance of CNNs was achieved by Deep Convolutional Neural Networks (DCNNs) as discussed by the authors, which consists of five convolutional layers, some of which are followed by max-pooling layers, and three fully-connected layers with a final 1000-way softmax.
Book ChapterDOI

Microsoft COCO: Common Objects in Context

TL;DR: A new dataset with the goal of advancing the state-of-the-art in object recognition by placing the question of object recognition in the context of the broader question of scene understanding by gathering images of complex everyday scenes containing common objects in their natural context.
Proceedings ArticleDOI

Fully convolutional networks for semantic segmentation

TL;DR: The key insight is to build “fully convolutional” networks that take input of arbitrary size and produce correspondingly-sized output with efficient inference and learning.
Posted Content

Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks

TL;DR: Faster R-CNN as discussed by the authors proposes a Region Proposal Network (RPN) to generate high-quality region proposals, which are used by Fast R-NN for detection.
Related Papers (5)