A remote controlled robot system that includes a robot and a remote control station. The robot includes a binaural microphone system that is coupled to a speaker system of the remote control station. The binaural microphone system may include a pair of microphones located at opposite sides of a robot head. the location of the microphones roughly coincides with the location of ears on a human body. Such microphone location creates a mobile robot that more effectively simulates the tele-presence of an operator of the system. The robot may include two different microphone systems and the ability to switch between systems. For example, the robot may also include a zoom camera system and a directional microphone. The directional microphone may be utilized to capture sound from a direction that corresponds to an object zoomed upon by the camera system.

Mobile tele-presence system with a microphone system

A remote controlled robot with a head that supports a monitor and is coupled to a mobile platform. The mobile robot also includes an auxiliary camera coupled to the mobile platform by a boom. The mobile robot is controlled by a remote control station. By way of example, the robot can be remotely moved about an operating room. The auxiliary camera extends from the boom so that it provides a relatively close view of a patient or other item in the room. An assistant in the operating room may move the boom and the camera. The boom may be connected to a robot head that can be remotely moved by the remote control station.

Telepresence robot with a camera boom

A mobile robot that includes a drive system, a controller in communication with the drive system, and a volumetric point cloud imaging device supported above the drive system at a height of greater than about one feet above the ground and directed to be capable of obtaining a point cloud from a volume of space that includes a floor plane in a direction of movement of the mobile robot. The controller receives point cloud signals from the imaging device and issues drive commands to the drive system based at least in part on the received point cloud signals.

Mobile human interface robot

Methods can include using a doorbell to wirelessly communicate with a remotely located computing device. Doorbells can include a speaker, a microphone, a camera, and a button to sound a chime. A doorbell shipping mode can detect whether the doorbell is electrically coupled to an external power source. Methods can include entering a setup mode or a standby mode in response to detecting electricity from the external power source.

Doorbell communication systems and methods

A telepresence robot may include a drive system, a control system, an imaging system, and a mapping module. The mapping module may access a plan view map of an area and tags associated with the area. In various embodiments, each tag may include tag coordinates and tag information, which may include a tag annotation. A tag identification system may identify tags within a predetermined range of the current position and the control system may execute an action based on an identified tag whose tag information comprises a telepresence robot action modifier. The telepresence robot may rotate an upper portion independent from a lower portion. A remote terminal may allow an operator to control the telepresence robot using any combination of control methods, including by selecting a destination in a live video feed, by selecting a destination on a plan view map, or by using a joystick or other peripheral device.

Interfacing with a mobile telepresence robot

There is described a method and apparatus or telepresence between a field user wearing telepresence equipment and a remote user, the method comprising: providing the telepresence equipment including a global camera, a handheld detail camera for obtaining image close-ups, and an audio link for communication between the field user and the remote user; mounting the global camera on the field user's head to obtain an image of the field user's viewpoint; transmitting images from the global camera to a remote display for the remote user to view; receiving instructions from the remote user through the audio link on where to point the detail camera; pointing the detail camera to specified objects; and transmitting images from the detail camera to the remote display for the remote user to view.

Method and apparatus for telepresence

A head set is disclosed comprising a head band having a first and a second end; a pad-like support means attached to said first end of said head band to rest on a first side of a head; a mounting to support a camera; and an earpiece attached to said second end of said head band comprising: an ear-shaped, resilient wire formed so as to leave an anterior notch of an ear unobstructed; and an elastomeric covering that can pivot with respect to the wire having a broader flattened surface on one side to rest on a second side of said head.

Headset for camera

An experiment was conducted to investigate the potential benefits of a visual-FM system for speechreading. Two speakers took part in the study. They were recorded while they spoke 36 sentences at a distance of 1.83, 3.66, and 7.32 m from a stationary Hi8 video camera. Under each experimental condition, the signal available from the camera of a visual-FM system was recorded simultaneously. A speechreading test consisting of a randomization of 432 recorded sentences was administered to a group of 16 subjects with normal hearing and normal (or corrected normal) visual acuity. The results revealed that for the recordings obtained with the Hi8 mm camera speechreading performance decreased as a function of distance. Specifically, there were no differences between the recordings made at 1.83 and 3.66 m. However, there was a significant difference between those two recordings distances and the recordings made at 7.32 m. For the recordings obtained with the visual-FM camera, speechreading performance did not vary significantly as a function of distance. Those findings indicate that the visual-FM system constitutes an effective method of providing visual-speech cues in environmental conditions where the distance between the speaker and the speechreader is not optimal for livespeechreading.

/pdf/evaluation-of-a-visual-fm-system-to-enhance-speechreading-154b3tj9mz.pdf

Marie Lapalme

Papers

Method and apparatus for telepresence

Headset for camera

Evaluation of A Visual-FM System To Enhance Speechreading.