Active tactile exploration using a brain–machine–brain interface
Joseph E. O'Doherty,Mikhail A. Lebedev,Peter J. Ifft,Katie Z. Zhuang,Solaiman Shokur,Hannes Bleuler,Miguel A. L. Nicolelis +6 more
Reads0
Chats0
TLDR
The operation of a brain–machine–brain interface (BMBI) that both controls the exploratory reaching movements of an actuator and allows signalling of artificial tactile feedback through intracortical microstimulation of the primary somatosensory cortex is reported.Abstract:
Brain–machine interfaces 1,2 use neuronal activity recorded from the brain to establish direct communication with external actuators, such as prosthetic arms. It is hoped that brain–machine interfaces can be used to restore the normal sensorimotor functions of the limbs, but so far they have lacked tactile sensation. Here we report the operation of a brain–machine–brain interface (BMBI) that both controls the exploratory reaching movements of an actuator and allows signalling of artificial tactile feedback through intracortical microstimulation (ICMS) of the primary somatosensory cortex. Monkeys performed an active exploration task in which an actuator (a computer cursor or a virtual-reality arm) was moved using a BMBI that derived motor commands from neuronal ensemble activity recorded in the primary motor cortex. ICMS feedback occurred whenever the actuator touched virtual objects. Temporal patterns of ICMS encoded the artificial tactile properties of each object. Neuronal recordings and ICMS epochs were temporally multiplexed to avoid interference. Two monkeys operated this BMBI to search for and distinguish one of three visually identical objects, using the virtual-reality arm to identify the unique artificial texture associated with each. These results suggest that clinical motor neuroprostheses might benefit from the addition of ICMS feedback to generate artificial somatic perceptions associated withread more
Citations
More filters
Journal ArticleDOI
Enhancing Our Lives with Immersive Virtual Reality
Journal ArticleDOI
A skin-inspired organic digital mechanoreceptor
Benjamin C. K. Tee,Alex Chortos,Andre Berndt,Amanda Kim Nguyen,Ariane Tom,Allister F. McGuire,Ziliang Carter Lin,Kevin Tien,Won-Gyu Bae,Huiliang Wang,Ping Mei,Ho-Hsiu Chou,Bianxiao Cui,Karl Deisseroth,Tse Nga Ng,Zhenan Bao +15 more
TL;DR: This work presents a power-efficient skin-inspired mechanoreceptor with a flexible organic transistor circuit that transduces pressure into digital frequency signals directly, and represents a step toward the design and use of large-area organic electronic skins with neural-integrated touch feedback for replacement limbs.
Journal ArticleDOI
Intracortical microstimulation of human somatosensory cortex
Sharlene N Flesher,Jennifer L. Collinger,Stephen T. Foldes,Stephen T. Foldes,Jeffrey M Weiss,John E. Downey,Elizabeth C. Tyler-Kabara,Sliman J. Bensmaia,Andrew B. Schwartz,Michael L. Boninger,Robert A. Gaunt +10 more
TL;DR: It is shown that microstimulation within the hand area of the somatosensory cortex of a person with long-term spinal cord injury evokes tactile sensations perceived as originating from locations on the hand and that cortical stimulation sites are organized according to expected somatotopic principles.
Journal ArticleDOI
Nature-Inspired Structural Materials for Flexible Electronic Devices
TL;DR: This review covers the smart designs of structural materials inspired by natural materials and their utility in the construction of flexible devices, and summarizes structural materials that accommodate mechanical deformations, which is the fundamental requirement for flexible devices to work properly in complex environments.
Journal ArticleDOI
Why primate models matter
Kimberley A. Phillips,Karen L. Bales,Karen L. Bales,John P. Capitanio,John P. Capitanio,Alan J Conley,Paul W. Czoty,Bert A. 't Hart,William D. Hopkins,William D. Hopkins,Shiu Lok Hu,Lisa A. Miller,Lisa A. Miller,Michael A. Nader,Peter W. Nathanielsz,Jeffrey Rogers,Jeffrey Rogers,Carol A. Shively,Mary Lou Voytko +18 more
TL;DR: Key areas in biomedicine where primate models have been, and continue to be, essential for advancing fundamental knowledge in biomedical and biological research are reviewed.
References
More filters
Journal ArticleDOI
Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates
Jose M. Carmena,Mikhail A. Lebedev,Roy E. Crist,Joseph E. O'Doherty,David M. Santucci,Dragan F. Dimitrov,Parag G. Patil,Craig S. Henriquez,Miguel A. L. Nicolelis +8 more
TL;DR: It is demonstrated that primates can learn to reach and grasp virtual objects by controlling a robot arm through a closed-loop brain–machine interface (BMIc) that uses multiple mathematical models to extract several motor parameters from the electrical activity of frontoparietal neuronal ensembles.
Journal ArticleDOI
Hand movements: a window into haptic object recognition.
TL;DR: Two experiments establish links between desired knowledge about objects and hand movements during haptic object exploration, and establish that in free exploration, a procedure is generally used to acquire information about an object property, not because it is merely sufficient, butBecause it is optimal or even necessary.
Journal ArticleDOI
Brain–machine interfaces: past, present and future
TL;DR: This paper discusses designing a fully implantable biocompatible recording device, further developing real-time computational algorithms, introducing a method for providing the brain with sensory feedback from the actuators, and designing and building artificial prostheses that can be controlled directly by brain-derived signals.
PatentDOI
Direct cortical control of 3d neuroprosthetic devices
TL;DR: In this paper, a co-adaptive algorithm uses the firing rate of the sensed neurons or neuron groupings to help develop the control signals for an object is developed from the neuron-originating electrical impulses detected by electrode arrays implanted in a subject's cerebral cortex at the pre-motor locations known to have association with arm movements.
Journal ArticleDOI
Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects
Roland S. Johansson,G. Westling +1 more
TL;DR: The present paper deals quantitatively with the regulation of the coordination between the grip force and the vertical lifting force, denoted as the load force, while small objects were lifted, positioned in space and replaced by human subjects using the pinch grip.