A method of controlling an operation of a robotically-controlled surgical instrument can include receiving a first input signal at a controller indicative of a user's readiness to actuate the surgical instrument to perform a surgical procedure, outputting an output signal from the controller to provide feedback to the user in response to the received first input signal, receiving a second input signal at the controller confirming the user's readiness to actuate the surgical instrument, outputting an actuation signal from the controller in response to receiving the second input signal, and actuating the surgical instrument to perform the surgical procedure based on the actuation signal.

Positive control of robotic surgical instrument end effector

A mobile robot that includes a drive system, a controller in communication with the drive system, and a volumetric point cloud imaging device supported above the drive system at a height of greater than about one feet above the ground and directed to be capable of obtaining a point cloud from a volume of space that includes a floor plane in a direction of movement of the mobile robot. The controller receives point cloud signals from the imaging device and issues drive commands to the drive system based at least in part on the received point cloud signals.

Mobile human interface robot

A telepresence robot may include a drive system, a control system, an imaging system, and a mapping module. The mapping module may access a plan view map of an area and tags associated with the area. In various embodiments, each tag may include tag coordinates and tag information, which may include a tag annotation. A tag identification system may identify tags within a predetermined range of the current position and the control system may execute an action based on an identified tag whose tag information comprises a telepresence robot action modifier. The telepresence robot may rotate an upper portion independent from a lower portion. A remote terminal may allow an operator to control the telepresence robot using any combination of control methods, including by selecting a destination in a live video feed, by selecting a destination on a plan view map, or by using a joystick or other peripheral device.

Interfacing with a mobile telepresence robot

A mobile terminal including a display configured to display information; a short range communication module configured to exchange a signal with an external control device; and a controller configured to receive the signal from the external control device, determine a context at a timing point of receiving the signal, and control an operation corresponding to the signal to be performed in the determined context. Further, the operation includes at least one of activation/deactivation of the display, an activation/deactivation of a lock mode of the mobile terminal, a volume operation and a camera operation.

Mobile terminal and controlling method thereof

Time-dependent navigation of telepresence robots

A method is provided for initiating a telepresence session with a person, using a robot. The method includes receiving a request to host a telepresence session at the robot and receiving an identification for a target person for the telepresence session by the robot. The robot then searches a current location for a person. If a person is found, a determination is made regarding whether the person is the target person. If the person found is not the target person, the person is prompted for a location for the target person. The robot moves to the location given by the person in response to the prompt.

Finding a called party

A robot tracks objects using sensory data, and follows an object selected by a user. The object can be designated by a user from a set of objects recognized by the robot. The relative positions and orientations of the robot and object are determined. The position and orientation of the robot can be used so as to maintain a desired relationship between the object and the robot. Using the navigation system of the robot, during its movement, obstacles can be avoided. If the robot loses contact with the object being tracked, the robot can continue to navigate and search the environment until the object is reacquired.

Tracking and following of moving objects by a mobile robot

Initial interaction between a mobile robot and at least one user is described herein. The mobile robot captures several images of its surroundings, and identifies existence of a user in at least one of the several images. The robot then orients itself to face the user, and outputs an instruction to the user with regard to the orientation of the user with respect to the mobile robot. The mobile robot captures images of the face of the user responsive to detecting that the user has followed the instruction. Information captured by the robot is uploaded to a cloud-storage system, where information is included in a profile of the user and is shareable with others.

Interactive robot initialization

Described herein are technologies pertaining to robot navigation. The robot includes a video camera that is configured to transmit a live video feed to a remotely located computing device. A user interacts with the live video feed, and the robot navigates in its environment based upon the user interaction. In a first navigation mode, the user selects a location, and the robot autonomously navigates to the selected location. In a second navigation mode, the user causes the point of view of the video camera on the robot to change, and thereafter causes the robot to semi-autonomously drive in a direction corresponding to the new point of view of the video camera. In a third navigation mode, the user causes the robot to navigate to a selected location in the live video feed.

Semi-autonomous robot that supports multiple modes of navigation

The subject disclosure is directed towards controlling a robot based upon sensing a user's natural and intuitive movements and expressions. User movements and/or facial expressions are captured by an image and depth camera, resulting in skeletal data and/or image data that is used to control a robot's operation, e.g., in a real time, remote (e.g., over the Internet) telepresence session. Robot components that may be controlled include robot “expressions” (e.g., audiovisual data output by the robot), robot head movements, robot mobility drive operations (e.g., to propel and/or turn the robot), and robot manipulator operations, e.g., an arm-like mechanism and/or hand-like mechanism.

Jean Sebastien Fouillade

Papers

Finding a called party

Tracking and following of moving objects by a mobile robot

Interactive robot initialization

Semi-autonomous robot that supports multiple modes of navigation

Natural human to robot remote control