Carnegie Mellon University

About: Carnegie Mellon University is a education organization based out in Pittsburgh, Pennsylvania, United States. It is known for research contribution in the topics: Computer science & Robot. The organization has 36317 authors who have published 104359 publications receiving 5975734 citations. The organization is also known as: CMU & Carnegie Mellon.

Zero-shot Learning with Semantic Output Codes

Abstract: We consider the problem of zero-shot learning, where the goal is to learn a classifier f : X → Y that must predict novel values of Y that were omitted from the training set. To achieve this, we define the notion of a semantic output code classifier (SOC) which utilizes a knowledge base of semantic properties of Y to extrapolate to novel classes. We provide a formalism for this type of classifier and study its theoretical properties in a PAC framework, showing conditions under which the classifier can accurately predict novel classes. As a case study, we build a SOC classifier for a neural decoding task and show that it can often predict words that people are thinking about from functional magnetic resonance images (fMRI) of their neural activity, even without training examples for those words.

OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields

Abstract: Realtime multi-person 2D pose estimation is a key component in enabling machines to have an understanding of people in images and videos. In this work, we present a realtime approach to detect the 2D pose of multiple people in an image. The proposed method uses a nonparametric representation, which we refer to as Part Affinity Fields (PAFs), to learn to associate body parts with individuals in the image. This bottom-up system achieves high accuracy and realtime performance, regardless of the number of people in the image. In previous work, PAFs and body part location estimation were refined simultaneously across training stages. We demonstrate that a PAF-only refinement rather than both PAF and body part location refinement results in a substantial increase in both runtime performance and accuracy. We also present the first combined body and foot keypoint detector, based on an internal annotated foot dataset that we have publicly released. We show that the combined detector not only reduces the inference time compared to running them sequentially, but also maintains the accuracy of each component individually. This work has culminated in the release of OpenPose, the first open-source realtime system for multi-person 2D pose detection, including body, foot, hand, and facial keypoints.

Continuum Robots for Medical Applications: A Survey

Abstract: In this paper, we describe the state of the art in continuum robot manipulators and systems intended for application to interventional medicine. Inspired by biological trunks, tentacles, and snakes, continuum robot designs can traverse confined spaces, manipulate objects in complex environments, and conform to curvilinear paths in space. In addition, many designs offer inherent structural compliance and ease of miniaturization. After decades of pioneering research, a host of designs have now been investigated and have demonstrated capabilities beyond the scope of conventional rigid-link robots. Recently, we have seen increasing efforts aimed at leveraging these qualities to improve the frontiers of minimally invasive surgical interventions. Several concepts have now been commercialized, which are inspiring and enabling a current paradigm shift in surgical approaches toward flexible access routes, e.g., through natural orifices such as the nose. In this paper, we provide an overview of the current state of this field from the perspectives of both robotics science and medical applications. We discuss relevant research in design, modeling, control, and sensing for continuum manipulators, and we highlight how this work is being used to build robotic systems for specific surgical procedures. We provide perspective for the future by discussing current limitations, open questions, and challenges.