Showing papers on "Haptic technology published in 2009"

Haptic perception: a tutorial.

Abstract: This tutorial focuses on the sense of touch within the context of a fully active human observer. It is intended for graduate students and researchers outside the discipline who seek an introduction to the rapidly evolving field of human haptics. The tutorial begins with a review of peripheral sensory receptors in skin, muscles, tendons, and joints. We then describe an extensive body of research on “what” and “where” channels, the former dealing with haptic perception of objects, surfaces, and their properties, and the latter with perception of spatial layout on the skin and in external space relative to the perceiver. We conclude with a brief discussion of other significant issues in the field, including vision-touch interactions, affective touch, neural plasticity, and applications.

Haptic Feedback in Robot-Assisted Minimally Invasive Surgery

Abstract: Purpose of Review Robot-assisted minimally invasive surgery (RMIS) holds great promise for improving the accuracy and dexterity of a surgeon while minimizing trauma to the patient. However, widespread clinical success with RMIS has been marginal. It is hypothesized that the lack of haptic (force and tactile) feedback presented to the surgeon is a limiting factor. This review explains the technical challenges of creating haptic feedback for robot-assisted surgery and provides recent results that evaluate the effectiveness of haptic feedback in mock surgical tasks.

The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current review

Abstract: Background Virtual reality (VR) as surgical training tool has become a state-of-the-art technique in training and teaching skills for minimally invasive surgery (MIS). Although intuitively appealing, the true benefits of haptic (VR training) platforms are unknown. Many questions about haptic feedback in the different areas of surgical skills (training) need to be answered before adding costly haptic feedback in VR simulation for MIS training. This study was designed to review the current status and value of haptic feedback in conventional and robot-assisted MIS and training by using virtual reality simulation.

Computer-aided system for 360º heads up display of safety/mission critical data

Abstract: A safety critical, time sensitive data system for projecting safety/mission critical data onto a display pair of Commercial Off The Shelf (COTS) light weight projection glasses or monocular creating an immersive omnidirectional HUD (Heads Up Display) system with 6 degrees of freedom movement with user immersion and user inputs & outputs. The system includes the display, haptic glove, haptic suit, vestibular interface, temperature emulation, smell emulation, and omnidirectional sound, the workstation, the application software, and inputs containing the safety/mission critical information (Current User Position, Total Collision Avoidance System—TCAS, Global Positioning System—GPS, Magnetic Resonance Imaging—MRI Images, CAT scan images. Weather data. Military troop data, real-time space type markings etc.). The workstation software processes the incoming safety/mission critical data and converts it into a three dimensional space for the user to immerse into the environment. Selecting any of the images may display available information about the selected item or may enhance the image, or moving hand or body will generate enhanced environmental perception & awareness, as well as inputs and outputs. Predicted position vectors may be displayed as well as 3D terrain.

Multi Touch with Multi Haptics

Abstract: Methods and systems for processing touch inputs are disclosed. The invention in one respect includes reading data from a multi-touch sensing device such as a multi-touch touch screen where the data pertains to touch input with respect to the multi-touch sensing device, and identifying at least one multi-touch gesture based on the data from the multi-touch sensing device and providing an appropriate multi-haptic response.

Simulating haptic feedback using vision: A survey of research and applications of pseudo-haptic feedback

Abstract: This paper presents a survey of the main results obtained in the field of “pseudo-haptic feedback”: a technique meant to simulate haptic sensations in virtual environments using visual feedback and properties of human visuo-haptic perception. Pseudo-haptic feedback uses vision to distort haptic perception and verges on haptic illusions. Pseudo-haptic feedback has been used to simulate various haptic properties such as the stiffness of a virtual spring, the texture of an image, or the mass of a virtual object. This paper describes the several experiments in which these haptic properties were simulated. It assesses the definition and the properties of pseudo-haptic feedback. It also describes several virtual reality applications in which pseudo-haptic feedback has been successfully implemented, such as a virtual environment for vocational training of milling machine operations, or a medical simulator for training in regional anesthesia procedures.

Haptic Glove With MR Brakes for Virtual Reality

Abstract: Haptic gloves open up the world of force feedback by allowing the user to pick up and feel virtual objects in a natural way. In most of the existing gloves, a remote box houses a large number of actuators and sensors. Power to the glove is transmitted via cables. If the haptic gloves were smaller, lighter, and easier to use and control, they could become more common as human-machine interfaces. Recent developments show that actuators based on active fluids, such as the magnetorheological (MR) fluids, can be viable alternatives in haptics. But these devices are desk- or floor-mounted and use relatively large MR brakes. In this research, we developed a compact MR brake that is about 25 mm in diameter, weighs 84 g, and can apply up to 899 Nmiddotmm torque. The compact size was achieved by stacking steel and aluminum rings to create a serpentine flux path through the fluid. Six brakes were used to build a force feedback glove called MR glove. The glove weighs 640 g and does not require any remote actuators. Results of usability experiments showed that the MR glove improved task completion times in grasping virtual objects and could convey stiffness information to the user.

Providing dynamically changeable physical buttons on a visual display

Abstract: Physical buttons have the unique ability to provide low-attention and vision-free interactions through their intuitive tactile clues. Unfortunately, the physicality of these interfaces makes them static, limiting the number and types of user interfaces they can support. On the other hand, touch screen technologies provide the ultimate interface flexibility, but offer no inherent tactile qualities. In this paper, we describe a technique that seeks to occupy the space between these two extremes - offering some of the flexibility of touch screens, while retaining the beneficial tactile properties of physical interfaces. The outcome of our investigations is a visual display that contains deformable areas, able to produce physical buttons and other interface elements. These tactile features can be dynamically brought into and out of the interface, and otherwise manipulated under program control. The surfaces we describe provide the full dynamics of a visual display (through rear projection) as well as allowing for multitouch input (though an infrared lighting and camera setup behind the display). To illustrate the tactile capabilities of the surfaces, we describe a number of variations we uncovered in our exploration and prototyping. These go beyond simple on/off actuation and can be combined to provide a range of different possible tactile expressions. A preliminary user study indicates that our dynamic buttons perform much like physical buttons in tactile search tasks.

Tactile Feedback Induces Reduced Grasping Force in Robot-Assisted Surgery

Abstract: Robot-assisted minimally invasive surgery has gained widespread use over the past decade, but the technique is currently operated in the absence of haptic feedback during tissue manipulation. We have developed a complete tactile feedback system, consisting of a piezoresistive force sensor, control system, and pneumatic balloon tactile display, and mounted directly onto a da Vinci surgical robotic system. To evaluate the effect of tactile feedback on robotic manipulation, a group of novices (n = 16) and experts ( n = 4) were asked to perform three blocks of peg transfer tasks with the tactile feedback system in place. Force generated at the end-effectors was measured in all three blocks, but tactile feedback was active only during the middle block. All subjects used higher force when the feedback system was inactive. When active, subjects immediately used substantially less force and still maintained appropriate grip during the task. After the system was again turned off, grip force increased significantly to prefeedback levels. These results demonstrate that robotic manipulations without tactile feedback are done with more force than needed to grasp objects. Therefore, the addition of tactile feedback allows the surgeon to grasp with less force, and may improve control of the robotic system and handling of tissues and other objects.

Artificial Force Field for Haptic Feedback in UAV Teleoperation

Abstract: The feedback upon which operators in teleoperation tasks base their control actions differs substantially from the feedback to the driver of a vehicle. On the one hand, there is often a lack of sensory information; on the other hand, there is additional status information presented via the visual channel. Haptic feedback could be used to unload the visual channel and to compensate for the lack of feedback in other modalities. For collision avoidance, haptic feedback could provide repulsive forces via the control inceptor. Haptic feedback allows operators to interpret the repulsive forces as impedance to their control deflections when a potential for collision exists. Haptic information can be generated from an artificial force field (AFF) that maps environment constraints to repulsive forces. This paper describes the design and theoretical evaluation of a novel AFF, i.e., the parametric risk field, for teleoperation of an uninhabited aerial vehicle (UAV). The field allows adjustments of the size, shape, and force gradient by means of parameter settings, which determine the sensitivity of the field. Computer simulations were conducted to evaluate the effectiveness of the field for collision avoidance for various parameter settings. Results indicate that the novel AFF more effectively performs the collision avoidance function than potential fields known from literature. Because of its smaller size, the field yields lower repulsive forces, results in less force cancellation effects, and allows for larger UAV velocities. This indicates less operator control demand and more effective UAV operations, both expected to lead to lower operator workload, while, at the same time, increasing safety.

What is going on in augmented reality simulation in laparoscopic surgery

Abstract: Background To prevent unnecessary errors and adverse results of laparoscopic surgery, proper training is of paramount importance. A safe way to train surgeons for laparoscopic skills is simulation. For this purpose traditional box trainers are often used, however they lack objective assessment of performance. Virtual reality laparoscopic simulators assess performance, but lack realistic haptic feedback. Augmented reality (AR) combines a virtual reality (VR) setting with real physical materials, instruments, and feedback. This article presents the current developments in augmented reality laparoscopic simulation.

System and method for automatically producing haptic events from a digital audio signal

Abstract: In an embodiment, a system and method for automatically converting a plurality of events in a plurality of channels in a structured representation sequence into haptic events. The method comprises calculating an event score for each event of the sequence in one or more channels. The method also comprises calculating a cumulative score based on the event scores in the one or more channels. The method includes selectively designating haptic events to the events based on the event scores in one or more selected channels, wherein the haptic events are output by a haptic actuator. This may be done by the system by calculating properties of the sound or by taking already existing values associated with those properties to efficiently produce haptic events.

Method and Apparatus for Providing Multi-Point Haptic Feedback Texture Systems

Abstract: A method and apparatus for generating haptic surface texture with a deformable surface layer are disclosed. The haptic device includes a flexible surface layer, a haptic substrate, and a deforming mechanism. The flexible surface layer is made of elastic materials and is capable of reconfiguring its surface characteristics. The haptic substrate, in one embodiment, provides a first pattern in response to a first activating signal. Alternatively, the haptic substrate is capable of providing a second pattern in accordance with a second activating signal. The deforming mechanism is configured to change the flexible surface from a first surface characteristic to a second surface characteristic in accordance with the first pattern.

PHANToM OMNI Haptic Device: Kinematic and Manipulability

Abstract: The haptic device kinematics (position and its derivates) allows evaluate the virtual representation of the human operator in a virtual visualization at the same form defines the interaction with virtual objects programs across of a contact and deformation algorithm. The PHANToM OMNI haptic device, allows the kinematicinteraction with complex virtual environments, and the potentials ofapplication require of the available of its mathematical models. In this paper we present the kinematic results and the experimental proofs across of knowledge trajectories, such as the evaluation of the kinematic manipulability allows verify the limits of inherent admissible operation at admissible configuration space or workspace, and to this end allows the free architecture to more applications ondifferent engineering fields.

Haptic effect provisioning for a mobile communication terminal

Abstract: A mobile terminal and a method of controlling the mobile terminal are provided. The method includes displaying at least one object, which is divided into a plurality of haptic regions, on a touch screen; receiving a touch signal for any one of the haptic regions of the object; and outputting a control signal for controlling a haptic module to generate a haptic effect. Therefore, it is possible for a user to easily determine which of the haptic regions of the object has been touched with the sense of touch.

A body-conforming tactile jacket to enrich movie viewing

Abstract: Adding haptic stimulation to movies is a promising step in creating more emotionally immersive experiences. To explore the potential of this concept, we have created a wearable tactile jacket that is used to deliver movie-specific tactile stimuli to the viewer's body that are specifically targeted to influence the viewer's emotions. Immersion was evaluated in a user test using questionnaires and physiological measurements. The findings show promising effects of the haptic stimuli that need to be substantiated in further more refined user tests.

Characterisation of the Novint Falcon Haptic Device for Application as a Robot Manipulator

Abstract: The Falcon is a relatively inexpensive 3-DOF haptic device made by Novint for the gaming industry. The controller uses a form similar to that of the delta-robot conguration and because of this form, makes an interesting apparatus for research into control and estimation problems for robots involving parallel linkages. This paper presents the results of work conducted by the Autonomous Systems Lab at CSIRO in characterising the Falcon’s geometric, inertial and actuation properties for application to future model-based robotic algorithm development. Some comments are made towards assessing the Falcon’s suitability as an easily accessible research platform for these tasks. The aim of the paper is the presentation of the key kinematic and dynamic parameters for the device.

Haptic feedback using composite piezoelectric actuator

Abstract: Human-computer interface devices are described in the present disclosure. In one embodiment, among several embodiments, a human-computer interface includes a display device configured to visually display images to a user and a touch sensitive device configured to sense contact with the user. Furthermore, the human-computer interface includes a composite piezoelectric layer positioned between the display device and the touch sensitive device. The composite piezoelectric layer is configured to provide haptic feedback to the user.

Homotopy switching model for dyad haptic interaction in physical collaborative tasks

Abstract: The main result of this paper is a new model based on homotopy switching between intrinsically distinct controllers that encompass most behaviors encountered in dyadic haptic collaborative tasks. The basic idea is to switch continuously between two distinct extreme behaviors (leader and follower) for each individual, which creates an implicit bilateral coupling within the dyad. The physical collaborative interaction is then described only with two distinct homotopy time-functions that vary independently. These functions can likely describe the signature of a collaborative task. A virtual reality haptic set-up is used to assess the proposed theory.

An HMM approach to realistic haptic human-robot interaction

Abstract: A robot controller is developed for human-robot handshaking. The focus of the work is to provide realistic experiences for the human participant in haptic interactions with a robot. To achieve this goal, a position-based admittance controller is implemented. By using haptic data as inputs, a Hidden Markov Model-based high-level controller is used to estimate human intentions and modify the reference trajectory accordingly. The overall control framework is implemented onto a robot with validation experiments carried out with human participants.

Development of an exoskeleton haptic interface for virtual task training

Abstract: An exoskeleton haptic interface is developed for functional training in virtual environments. A composite control scheme enables a variety of tasks to be implemented, and a “Qt” graphics library is used to generate the virtual environment for the haptic interface at the hand and graphical user interfaces for input and telemetry. Inter-process communications convert telemetry from the exoskeleton into motion commands for objects in the virtual environment. A second haptic interface at the upper arm is used to control the elbow orbit self-motion of the arm during tasks. Preliminary results are reviewed for a wall-painting task in which the virtual wall stiffness and viscosity are generated using an admittance controller.

Mobile computer device binding feedback

Abstract: In embodiments of mobile computer device binding feedback, an application interface for a device application is displayed on a first display that is integrated in a dual-display mobile device. The application interface can also be displayed on a second display that is integrated in the dual-display mobile device. Binding position data is received from a binding system that movably couples the first display to the second display. Application context data that is associated with the device application is also received. Feedback can then be generated based on the binding position data and the application context data, where the feedback can be generated as audio feedback, video feedback, display feedback, and/or haptic feedback.

Haptically enabled user interface

Abstract: A device has a user interface that generates a haptic effect in response to user inputs or gestures. In one embodiment, the device receives an indication that the user is scrolling through a list of elements and an indication that an element is selected. The device determines the scroll rate and generates a haptic effect that has a magnitude that is based on the scroll rate.

Computerized Planning Tool For Spine Surgery and Method and Device for Creating a Customized Guide for Implantations

Abstract: A system for planning a spine surgery, comprising a haptic interface capable of providing force feedback to the user and a computer adapted to simulate a surgical procedure by responding to inputs from the haptic interface and outputting haptic feedback to the haptic interface is provided. The system further comprising a rapid prototyping unit including a unit that is adapted to create models of the anatomical region where the surgical procedure will be performed in its current unoperated condition and in the predicted postoperative condition. Further the rapid prototyping unit is adapted to create a three dimensional guide to be used in the surgical procedure as well as suggest revisions to the surgical procedure. The system further comprises a computer that simulates loading of the spine and planned implanted hardware using finite element software.

Mechanical design of a novel Hand Exoskeleton for accurate force displaying

Abstract: This paper deals with the mechanical design of a novel haptic Hand Exoskeleton (HE) that allows exerting controlled forces on the fingertip of the index and thumb of the operator. The proposed device includes several design solutions for optimizing the accuracy and mechanical performances. Remote Centers of Motion mechanisms have been adopted for delocalizing the encumbrance of linkages of the structure away from the operator's fingers. An improved stiffness of the transmission and reduced requirements for the actuators have been achieved thanks to a novel Patent Pending principle for integrating speed reduction ratio with the transmission system.

Systems and methods for transmitting haptic messages

Abstract: Systems and methods for transmitting haptic messages are disclosed. For example, one disclosed method includes the steps of: receiving at least one sensor signal from at least one sensor of a mobile device, the at least one sensor signal associated with a movement of the mobile device, determining a message to be displayed in a user interface based at least in part on the at least one sensor signal, and causing the message to be displayed.

Method and apparatus for generating mood-based haptic feedback

Abstract: A method and apparatus of generating mood-based haptic feedback are disclosed. A haptic system includes a sensing device, a digital processing unit, and a haptic generator. The sensing device, in one embodiment, is configured to detect user's modalities in accordance with mood information collected by one or more sensors and capable of issuing a sensing signal in response to the user's modalities. The digital processing unit is capable of identifying a user's condition in accordance with the sensing signal and providing a haptic signal in response to the user's condition. The user's condition, in one aspect, indicates user's mood and/or user's psychological conditions. The haptic generator generates haptic feedback in accordance with the haptic signal.

Haptically enabled dental modeling system

Abstract: The invention provides a digital dentistry system that utilizes a haptic interface and features a computer-based design application configured to allow the intuitive construction of irregular, amorphous three-dimensional structures typically seen in dental restorations, utilizing, where appropriate, the design skills of a user. In certain embodiments, the system provides a comprehensive digital solution for dental labs in the business of creating dental restorations such as partial frameworks, crowns, copings, bridge frameworks, implants and the like, with a sense of touch provided by a haptic interface device.

Projected field haptic actuation

Abstract: An electronic device includes a touch surface that can be physically engaged by a user. The touch surface is operably connected to an actuator arm which, in turn, is connected to an actuator array. Drive electronics sense a user's movement relative to the touch surface and, responsively, drive the actuator array effective to move the actuator arm and, in turn, provide haptic feedback to the user through the touch surface.