The long-term ambition of the Tactile Internet is to enable a democratization of skill, and how it is being delivered globally. An integral part of this is to be able to transmit touch in perceived real-time, which is enabled by suitable robotics and haptics equipment at the edges, along with an unprecedented communications network. The fifth generation (5G) mobile communications systems will underpin this emerging Internet at the wireless edge. This paper presents the most important technology concepts, which lay at the intersection of the larger Tactile Internet and the emerging 5G systems. The paper outlines the key technical requirements and architectural approaches for the Tactile Internet, pertaining to wireless access protocols, radio resource management aspects, next generation core networking capabilities, edge-cloud, and edge-AI capabilities. The paper also highlights the economic impact of the Tactile Internet as well as a major shift in business models for the traditional telecommunications ecosystem.

/pdf/5g-enabled-tactile-internet-3gy5sptvza.pdf

5G-Enabled Tactile Internet

3D object recognition in cluttered scenes is a rapidly growing research area. Based on the used types of features, 3D object recognition methods can broadly be divided into two categories-global or local feature based methods. Intensive research has been done on local surface feature based methods as they are more robust to occlusion and clutter which are frequently present in a real-world scene. This paper presents a comprehensive survey of existing local surface feature based 3D object recognition methods. These methods generally comprise three phases: 3D keypoint detection, local surface feature description, and surface matching. This paper covers an extensive literature survey of each phase of the process. It also enlists a number of popular and contemporary databases together with their relevant attributes.

3D Object Recognition in Cluttered Scenes with Local Surface Features: A Survey

Mobile communications have been undergoing a generational change every ten years or so. However, the time difference between the so-called “G’s” is also decreasing. While fifth-generation (5G) systems are becoming a commercial reality, there is already significant interest in systems beyond 5G, which we refer to as the sixth generation (6G) of wireless systems. In contrast to the already published papers on the topic, we take a top-down approach to 6G. More precisely, we present a holistic discussion of 6G systems beginning with lifestyle and societal changes driving the need for next-generation networks. This is followed by a discussion into the technical requirements needed to enable 6G applications, based on which we dissect key challenges and possibilities for practically realizable system solutions across all layers of the Open Systems Interconnection stack (i.e., from applications to the physical layer). Since many of the 6G applications will need access to an order-of-magnitude more spectrum, utilization of frequencies between 100 GHz and 1 THz becomes of paramount importance. As such, the 6G ecosystem will feature a diverse range of frequency bands, ranging from below 6 GHz up to 1 THz. We comprehensively characterize the limitations that must be overcome to realize working systems in these bands and provide a unique perspective on the physical and higher layer challenges relating to the design of next-generation core networks, new modulation and coding methods, novel multiple-access techniques, antenna arrays, wave propagation, radio frequency transceiver design, and real-time signal processing. We rigorously discuss the fundamental changes required in the core networks of the future, such as the redesign or significant reduction of the transport architecture that serves as a major source of latency for time-sensitive applications. This is in sharp contrast to the present hierarchical network architectures that are not suitable to realize many of the anticipated 6G services. While evaluating the strengths and weaknesses of key candidate 6G technologies, we differentiate what may be practically achievable over the next decade, relative to what is possible in theory. Keeping this in mind, we present concrete research challenges for each of the discussed system aspects, providing inspiration for what follows.

6G Wireless Systems: Vision, Requirements, Challenges, Insights, and Opportunities

Open Dynamics Engine を用いたスノーボードロボットシミュレータの開発

The impact of the Internet of Things (IoT) on the advancement of the healthcare industry is immense. The ushering of the Medicine 4.0 has resulted in an increased effort to develop platforms, both at the hardware level as well as the underlying software level. This vision has led to the development of Healthcare IoT (H-IoT) systems. The basic enabling technologies include the communication systems between the sensing nodes and the processors; and the processing algorithms for generating an output from the data collected by the sensors. However, at present, these enabling technologies are also supported by several new technologies. The use of Artificial Intelligence (AI) has transformed the H-IoT systems at almost every level. The fog/edge paradigm is bringing the computing power close to the deployed network and hence mitigating many challenges in the process. While the big data allows handling an enormous amount of data. Additionally, the Software Defined Networks (SDNs) bring flexibility to the system while the blockchains are finding the most novel use cases in H-IoT systems. The Internet of Nano Things (IoNT) and Tactile Internet (TI) are driving the innovation in the H-IoT applications. This paper delves into the ways these technologies are transforming the H-IoT systems and also identifies the future course for improving the Quality of Service (QoS) using these new technologies.

The Future of Healthcare Internet of Things: A Survey of Emerging Technologies

Touch is currently seen as the modality that will complement audition and vision as a third media stream over the Internet in a variety of future haptic applications which will allow full immersion and that will, in many ways, impact society. Nevertheless, the high requirements of these applications demand networks which allow ultra-reliable and low-latency communication for the challenging task of applying the required quality of service for maintaining the user’s quality of experience at optimum levels. In this survey, we enlist, discuss, and evaluate methodologies and technologies of the necessary infrastructure for haptic communication. Furthermore, we focus on how the fifth generation of mobile networks will allow haptic applications to take life, in combination with the haptic data communication protocols, bilateral teleoperation control schemes and haptic data processing needed. Finally, we state the lessons learned throughout the surveyed research material along with the future challenges and infer our conclusions.

/pdf/toward-haptic-communications-over-the-5g-tactile-internet-1ye12g467d.pdf

Toward Haptic Communications Over the 5G Tactile Internet

Bilateral teleoperation systems with haptic feedback allow human users to interact with objects or perform complex tasks in remote or inaccessible environments. Communication delays in teleoperation systems jeopardize system stability and transparency, leading to degraded system performance and poor user experience. In this paper, we provide a survey of the model-mediated teleoperation (MMT) approach, which has been developed to guarantee both system stability and transparency in the presence of arbitrary communication delays. This survey focuses on two major parts: 1) the historical development of the MMT approach from the late 1980s to the present and 2) the main challenges facing the design of a reliable MMT system. Along with the discussion of the MMT challenges and the proposed solutions, a series of experiments has been conducted to compare the performance between the existing techniques and to supply data that were missing in the previous studies on the MMT approach.

Model-Mediated Teleoperation: Toward Stable and Transparent Teleoperation Systems

In this paper, we extend the concept of model-mediated teleoperation for complex environments and six degrees of freedom interaction using point cloud surface models. In our system, a time-of-flight camera is used to capture a high-resolution point cloud model of the object surface. The point cloud model and the physical properties of the object (stiffness and surface friction coefficient) are estimated at the slave side in real-time and transmitted to the master side using the modeling and updating algorithm proposed in this paper. The proposed algorithm adaptively controls the updating of the point cloud model and the object properties according to the slave movements and by exploiting known limitations of human haptic perception. As a result, perceptually irrelevant transmissions are avoided, and thus the packet rate in the communication channel is substantially reduced. In addition, a simple point cloud-based haptic rendering algorithm is adopted to generate the force feedback signals directly from the point cloud model without first converting it into a 3-D mesh. In the experimental evaluation, the system stability and transparency are verified in the presence of a round-trip communication delay of up to 1000 ms. Furthermore, by exploiting the limits of human haptic perception, the presented system allows for a significant haptic data reduction of about 90% for teleoperation systems with time delay.

Point Cloud-Based Model-Mediated Teleoperation With Dynamic and Perception-Based Model Updating

This article proposes an application-layer multiplexing scheme for teleoperation systems with multimodal feedback (video, audio, and haptics). The available transmission resources are carefully allocated to avoid delay-jitter for the haptic signal potentially caused by the size and arrival time of the video and audio data. The multiplexing scheme gives high priority to the haptic signal and applies a preemptive-resume scheduling strategy to stream the audio and video data. The proposed approach estimates the available transmission rate in real time and adapts the video bitrate, data throughput, and force buffer size accordingly. Furthermore, the proposed scheme detects sudden transmission rate drops and applies congestion control to avoid abrupt delay increases and converge promptly to the altered transmission rate. The performance of the proposed scheme is measured objectively in terms of end-to-end signal latencies, packet rates, and peak signal-to-noise ratio (PSNR) for visual quality. Moreover, peak-delay and convergence time measurements are carried out to investigate the performance of the congestion control mode of the system.

/pdf/a-multiplexing-scheme-for-multimodal-teleoperation-32xzgt789n.pdf

A Multiplexing Scheme for Multimodal Teleoperation

We study the combination of the perceptual deadband (PD)-based haptic packet rate reduction scheme with the time domain passivity approach (TDPA) for time-delayed teleoperation and propose a novel energy prediction (EP) scheme that deals with the conservative behavior of the resulting controller. The PD approach leads to irregular packet transmission, resulting in degraded system transparency and reduced teleoperation quality when the PD approach is combined with the TDPA. The proposed method (PD+TDPA+EP) adaptively predicts the system energy during communication interruptions and allows for larger energy output. This achieves less conservative control and improves the teleoperation quality. Evaluation of the displayed impedance shows that the PD+TDPA+EP method achieves improved system transparency, both objectively and subjectively, when compared with related approaches from literature. According to a subjective user study, the PD+TDPA+EP method allows for a high packet rate reduction (up to 80 percent) without noticeably distorting the perceived interaction quality. We also show that the PD+TDPA+EP method is preferred over related approaches from literature in a direct comparison test. Thus, with the proposed PD+TDPA+EP method, a high data reduction and a high teleoperation quality are simultaneously achieved for time-delayed teleoperation.

Xiao Xu

Papers

Toward Haptic Communications Over the 5G Tactile Internet

Model-Mediated Teleoperation: Toward Stable and Transparent Teleoperation Systems

Point Cloud-Based Model-Mediated Teleoperation With Dynamic and Perception-Based Model Updating

A Multiplexing Scheme for Multimodal Teleoperation

Energy Prediction for Teleoperation Systems That Combine the Time Domain Passivity Approach with Perceptual Deadband-Based Haptic Data Reduction