Unlike previous studies on the Metaverse based on Second Life, the current Metaverse is based on the social value of Generation Z that online and offline selves are not different. With the technological development of deep learning-based high-precision recognition models and natural generation models, Metaverse is being strengthened with various factors, from mobile-based always-on access to connectivity with reality using virtual currency. The integration of enhanced social activities and neural-net methods requires a new definition of Metaverse suitable for the present, different from the previous Metaverse. This paper divides the concepts and essential techniques necessary for realizing the Metaverse into three components (i.e., hardware, software, and contents) and three approaches (i.e., user interaction, implementation, and application) rather than marketing or hardware approach to conduct a comprehensive analysis. Furthermore, we describe essential methods based on three components and techniques to Metaverse&#x2019;s representative Ready Player One, Roblox, and Facebook research in the domain of films, games, and studies. Finally, we summarize the limitations and directions for implementing the immersive Metaverse as social influences, constraints, and open challenges. 

/pdf/a-metaverse-taxonomy-components-applications-and-open-1ix4u7e7.pdf

A Metaverse: Taxonomy, Components, Applications, and Open Challenges

Unlike previous studies on the Metaverse based on Second Life, the current Metaverse is based on the social value of Generation Z that online and offline selves are not different. With the technological development of deep learning-based high-precision recognition models and natural generation models, Metaverse is being strengthened with various factors, from mobile-based always-on access to connectivity with reality using virtual currency. The integration of enhanced social activities and neural-net methods requires a new definition of Metaverse suitable for the present, different from the previous Metaverse. This paper divides the concepts and essential techniques necessary for realizing the Metaverse into three components (i.e., hardware, software, and contents) and three approaches (i.e., user interaction, implementation, and application) rather than marketing or hardware approach to conduct a comprehensive analysis. Furthermore, we describe essential methods based on three components and techniques to Metaverse’s representative Ready Player One, Roblox, and Facebook research in the domain of films, games, and studies. Finally, we summarize the limitations and directions for implementing the immersive Metaverse as social influences, constraints, and open challenges.

https://ieeexplore.ieee.org/ielx7/6287639/9668973/09667507.pdf

Medical robots are invaluable players in non-pharmaceutical treatment of disabilities. Particularly, using prosthetic and rehabilitation devices with human–machine interfaces can greatly improve the quality of life for impaired patients. In recent years, flexible electronic interfaces and soft robotics have attracted tremendous attention in this field due to their high biocompatibility, functionality, conformability, and low-cost. Flexible human–machine interfaces on soft robotics will make a promising alternative to conventional rigid devices, which can potentially revolutionize the paradigm and future direction of medical robotics in terms of rehabilitation feedback and user experience. In this review, the fundamental components of the materials, structures, and mechanisms in flexible human-machine interfaces are summarized by recent and renowned applications in five primary areas: physical and chemical sensing, physiological recording, information processing and communication, soft robotic actuation, and feedback stimulation. This review further concludes by discussing the outlook and current challenges of these technologies as a human–machine interface in medical robotics. 

/pdf/flexible-electronics-and-devices-as-human-machine-interfaces-j6u4yjxd.pdf

Flexible Electronics and Devices as Human–Machine Interfaces for Medical Robotics

Augmented and virtual reality are poised to deliver the next generation of computing interfaces. To fully immerse users, it will become increasingly important to couple visual information with tactile feedback for interactions with the virtual world. Small wearable devices which approximate or substitute for sensations in the hands offer an attractive path forward. In this work, we present Tasbi, a multisensory haptic wristband capable of delivering squeeze and vibrotactile feedback. The device features a novel mechanism for generating evenly distributed and purely normal squeeze forces around the wrist. Our approach ensures that Tasbi’s six radially spaced vibrotactors maintain position and exhibit consistent skin coupling. In addition to experimental device characterization, we present early explorations into Tasbi’s utility as a sensory substitution device for hand interactions, employing squeeze, vibration, and pseudo-haptic effects to render a highly believable virtual button.

Tasbi: Multisensory Squeeze and Vibrotactile Wrist Haptics for Augmented and Virtual Reality

Bioelectrical or electrophysiological signals generated by living cells or tissues during daily physiological activities are closely related to the state of the body and organ functions, and therefore are widely used in clinical diagnosis, health monitoring, intelligent control and human-computer interaction Ag/AgCl electrodes with wet conductive gels are widely used to pick up these bioelectrical signals using electrodes and record them in the form of electroencephalograms, electrocardiograms, electromyography, electrooculograms, etc However, the inconvenience, instability and infection problems resulting from the use of gel with Ag/AgCl wet electrodes can't meet the needs of long-term signal acquisition, especially in wearable applications Hence, focus has shifted toward the study of dry electrodes that can work without gels or adhesives In this paper, a retrospective overview of the development of dry electrodes used for monitoring bioelectrical signals is provided, including the sensing principles, material selection, device preparation, and measurement performance In addition, the challenges regarding the limitations of materials, fabrication technologies and wearable performance of dry electrodes are discussed Finally, the development obstacles and application advantages of different dry electrodes are analyzed to make a comparison and reveal research directions for future studies

Dry Electrodes for Human Bioelectrical Signal Monitoring.

Any implant or prosthesis replacing a function or functions of an organ or group of organs should be biologically and sensorily integrated with the human body in order to increase their acceptance with their user. If this replacement is for a human hand, which is an important interface between humans and their environment, the acceptance issue and developing sensory-motor embodiment will be more challenging. Despite progress in prosthesis technologies, 50–60% of hand amputees wear a prosthetic device. One primary reason for the rejection of the prosthetic hands is that there is no or negligibly small feedback or tactile sensation from the hand to the user, making the hands less functional. In fact, the loss of a hand means interrupting the closed-loop sensory feedback between the brain (motor control) and the hand (sensory feedback through the nerves). The lack of feedback requires significant cognitive efforts from the user in order to do basic gestures and daily activities. To this aim, recently, there has been significant development in the provision of sensory feedback from transradial prosthetic hands, to enable the user take part in the control loop and improve user embodiment. Sensory feedback to the hand users can be provided via invasive and non-invasive methods. The latter includes the use of temperature, vibration, mechanical pressure and skin stretching, electrotactile stimulation, phantom limb stimulation, audio feedback, and augmented reality. This paper provides a comprehensive review of the non-invasive methods, performs their critical evaluation, and presents challenges and opportunities associated with the non-invasive sensory feedback methods.

/pdf/a-review-of-non-invasive-sensory-feedback-methods-for-59bvxitgc0.pdf

A Review of Non-Invasive Sensory Feedback Methods for Transradial Prosthetic Hands

There has been a growing interest in machine-based recognition of emotions from body gait and its combination with other modalities. In order to highlight the major trends and state of the art in this area, the literature dealing with machine-based human emotion perception through gait and posture is explored. Initially the effectiveness of human intellect and intuition in perceiving emotions in a range of cultures is examined. Subsequently, major studies in machine-based affect recognition are reviewed and their performance is compared. The survey concludes by critically analysing some of the issues raised in affect recognition using gait and posture, and identifying gaps in the current understanding in this area.

/pdf/automatic-affect-perception-based-on-body-gait-and-posture-a-2rjegcajna.pdf

Automatic Affect Perception Based on Body Gait and Posture: A Survey

Purpose: Upper limb prostheses are part of a rapidly changing market place. Despite development in device design, surveys report low levels of uptake and dissatisfaction with current prosthetic design. In this study, we present the results of a survey conducted with people with upper limb difference in Australia on their use of current prostheses and preferences in a prosthetic in order to inform future prosthetic hand design.Methods: An online survey was conducted on upper limb amputees, with 27 respondents that completed the survey. The survey was a mixture of open-ended questions, ranking design features and quantitative questions on problems experienced and desired attributes of future prosthesis designs.Results: Common key issues and concerns were isolated in the survey related to the weight, manipulation and dexterity, aesthetics, sensory feedback and financial cost; each of which could be addressed by additive manufacturing and soft robotics techniques.Conclusions: The adaptability of additive manufacturing and soft robotics to the highlighted concerns of participants shows that further research into these techniques is a feasible method to improve patient satisfaction and acceptance in prosthetic hands.Implications for rehabilitationEven with recent developments and advances in prosthetic design, the needs and desires of prosthetic users are not being met with current products.The desires and needs of those with upper limb difference are diverse.Using additive manufacturing to produce prosthetics allows for mass customization of prosthetics to meet these diverse needs while reducing costs.A soft robotic approach to prosthetics can help meet the desires of reducing weight and costs, while maintaining functionality.

/pdf/a-survey-on-what-australians-with-upper-limb-difference-want-3kw6mbgdjp.pdf

A survey on what Australians with upper limb difference want in a prosthesis: justification for using soft robotics and additive manufacturing for customized prosthetic hands

Electrotactile stimulation is a highly promising technique for providing sensory feedback information for prosthetics. To this aim, disposable electrodes which are predominantly used result in a high environmental and financial cost when used over a long period of time. In addition, disposable electrodes are limited in their size and configurations. This paper presents an alternative approach based on a 3D printed reusable flexible concentric electrode coated with a conductive graphene ink. Here, we have characterised the electrode and demonstrated its effective performance in electrotactile stimulation and sensory feedback for robotic prosthetic hands.

/pdf/reusable-flexible-concentric-electrodes-coated-with-a-1pdk61ijja.pdf

Reusable Flexible Concentric Electrodes Coated With a Conductive Graphene Ink for Electrotactile Stimulation

It has been reported in the literature that sensory information is a valuable and desired form of feedback for prosthetic users. Communication of how the arm moves can reduce cognitive load, reduce the need for visual attention and help the user predict the initial grasping force. In this paper, a new method of communicating movement sensations is presented through the application of tactile apparent movement. By overlapping vibration created by arrays of linear resonant actuators, a stroking movement can be felt on the user's arm. The results show potential for a low cost and light weight system that can communicate stimulations for up to three degrees of actuation in a prosthetic.

/pdf/using-vibration-motors-to-create-tactile-apparent-movement-15d12cmg35.pdf

Benjamin Stephens-Fripp

Papers

A Review of Non-Invasive Sensory Feedback Methods for Transradial Prosthetic Hands

Automatic Affect Perception Based on Body Gait and Posture: A Survey

A survey on what Australians with upper limb difference want in a prosthesis: justification for using soft robotics and additive manufacturing for customized prosthetic hands

Reusable Flexible Concentric Electrodes Coated With a Conductive Graphene Ink for Electrotactile Stimulation

Using Vibration Motors to Create Tactile Apparent Movement for Transradial Prosthetic Sensory Feedback