scispace - formally typeset
Search or ask a question
Journal ArticleDOI

Toward Haptic Communications Over the 5G Tactile Internet

TL;DR: This survey focuses on how the fifth generation of mobile networks will allow haptic applications to take life, in combination with the haptic data communication protocols, bilateral teleoperation control schemes and hapticData processing needed.
Abstract: Touch is currently seen as the modality that will complement audition and vision as a third media stream over the Internet in a variety of future haptic applications which will allow full immersion and that will, in many ways, impact society. Nevertheless, the high requirements of these applications demand networks which allow ultra-reliable and low-latency communication for the challenging task of applying the required quality of service for maintaining the user’s quality of experience at optimum levels. In this survey, we enlist, discuss, and evaluate methodologies and technologies of the necessary infrastructure for haptic communication. Furthermore, we focus on how the fifth generation of mobile networks will allow haptic applications to take life, in combination with the haptic data communication protocols, bilateral teleoperation control schemes and haptic data processing needed. Finally, we state the lessons learned throughout the surveyed research material along with the future challenges and infer our conclusions.

Summary (3 min read)

Introduction

  • And where the final published version is provided on the Research Portal, if citing you are again advised to check the publisher's website for any subsequent corrections.
  • Applications which can tolerate delays over 1ms are within the scope of teleoperation ; a broad range of applications that can be divided into three categories of teleoperation, wherein each scenario is associated to a level of dynamics of the remote environment the user is interacting with and the corresponding delay tolerance.
  • On the other hand, in this survey the authors focus on the efforts for haptic communication in networked teleoperation systems over the Tactile Internet and examine in detail the advancements in teleoperation over long distances.
  • Moreover, Section VI presents the latest developments on 5G mobile infrastructure and technologies with focus on ultra-reliable low-latency communication as well as the main KPIs of various 5G use cases.

II. TELEOPERATION

  • Multi-modal telepresence and teleaction (TPTA) systems for haptic telemanipulation, also known as telehaptic systems [10], usually consist of one human operator using a haptic interface (master device) on one end, a communication channel and one teleoperator (slave actuator) on the other end .
  • The hardware design parameters of haptic devices (e.g. sampling frequency) and the number and type of sensors and actuators determine the amount of data the device will output or needs as input.
  • Second, teleoperation systems are very sensitive to data loss and latency [6].
  • An important question can be raised concerning the amount of latency compared to the amount of data loss that a system can tolerate.
  • Summing up, the authors detail three main solution spaces to improve haptic communication: .

III. HAPTIC COMMUNICATION OVER THE INTERNET

  • With the increase of mobile Internet-enabled machines and devices over the world, mobile networks play an important role as the medium for the transmission and reception of data.
  • Nonetheless, according to [38] the effects of packet loss can be managed by using mechanism which increase the communication reliability, but, as a result these mechanisms will increase the total latency.
  • Again, based on the client-server scheme, in [54] haptic communication is achieved by employing the Session Initiation Protocol (SIP) on the application layer in order to establish a teleoperation session and to manage haptic transport streams that use Real-Time Transport Protocol (RTP) which encapsulates the haptic data in UDP packets.
  • Last but not least, there are two application layer protocols with a focus on security which is a major concern for e.g. telesurgery applications.
  • Hence, flexible traffic management while simultaneously supporting strict and dynamic QoS requirements is yet critical and challenging in the Internet.

IV. HAPTIC DATA REDUCTION AND COMPRESSION

  • Haptic sensor readings, especially when reading the kinesthetic signals, as previously mentioned in Section II-C, have a sampling rate of 1 kHz or even higher.
  • In comparison to other sampling methods such as the level crossings method (that incorporates absolute differences instead of percentages between samples), the perceptual-based kinesthetic data reduction schemes are proven to have good but similar accuracy [90].
  • Otherwise, the input sample is transmitted to the other side and the transmitted sample is used for updating the prediction model.
  • The necessary step before compressing the vibrotactile signals is to model them.
  • Therefore, for encoding the texture signals, the bitrate should be allocated more in the low-energy frequency bands compared than to the high-energy ones.

V. HAPTIC CONTROL SYSTEM APPROACHES

  • As the network infrastructure and mechanisms keep improving there are physical barriers, as in the case of long distance communications, that can introduce a minimum latency which can make certain teleoperation applications impossible.
  • A detailed description of the theoretical base of passivity-based control has been made in [131].
  • As previously discussed, stability and transparency are conflicting objectives in passivity-based teleoperation design.
  • The estimated model parameters on the master side are transmitted to the slave to guide the slaves motion.
  • Another well known but closed loop control scheme, the Smith predictor, is using a plant model transfer function and a time delay model to compensate for the network delays in the communication.

VI. HAPTIC COMMUNICATION OVER 5G MOBILE NETWORKS

  • Providing the services mentioned above in remote geographical areas and in an on-demand manner, where high bandwidth and dedicated networking infrastructure is not available, is yet another crucial aspect, which can be addressed by mobile networks.
  • While earlier generations of mobile networks focused on mobile broadband services (targeting services for people), it has already been identified that 5G should, in addition, address the two new areas of massive machine-type communication (M-MTC) and critical machine-type communication (C-MTC), where services are provided to things and objects.
  • The speed at which the user is requesting services from the network provider.
  • The virtualization and softwarization of network functions drastically decreases the dependency on hardware and therefore increases the scalability and reliability of the network.
  • Since teleoperation with force feedback can be classified as a latency-sensitive application, the aforementioned technologies will be used to provide low-latency connectivity to users of various types of applications with low latency requirements.

VII. LESSONS LEARNED AND FUTURE CHALLENGES

  • Without a doubt, teleoperation is an ever-evolving field mainly combining robotics, telecommunications and data processing.
  • This includes the optimization of the communication channel by investigating the mobile network infrastructure and the development of new protocols and evaluation metrics based on precise traffic models.
  • Having a set of different control and communication approaches to implement teleoperation systems is important, because they vary in their robustness towards certain QoS parameters (e.g. delay, delay variation or packet loss).
  • Furthermore, their performance also varies between tasks (e.g. free space versus contact, soft objects versus rigid surface, etc.).
  • Figure 8 (a) illustrates a hypothetical performance measurement for three control schemes in different network conditions.

VIII. CONCLUSIONS

  • Haptic communication for bilateral teleoperation systems is among technologies which are starting to be adopted by an increasing number of immersive Internet applications.
  • It will gain great benefits from the development of communication infrastructures such as the fifth generation of mobile networks (5G).
  • Following the requirements of haptic communication over the Internet, this survey paper documents the fundamentals of haptic communication over the Internet and the latest advances which will allow the user to experience high quality immersion.
  • This paper also focuses on the three main research interests, namely data compression and reduction, robust stability control, and multi-modal data streaming over the Internet.
  • The authors also described the requirements and environment dynamics for teleoperation systems.

Did you find this useful? Give us your feedback

Figures (11)

Content maybe subject to copyright    Report

King’s Research Portal
DOI:
10.1109/COMST.2018.2851452
Document Version
Peer reviewed version
Link to publication record in King's Research Portal
Citation for published version (APA):
Antonakoglou, K., Xu, X., Steinbach, E., Mahmoodi, T., & Dohler, M. (2018). Towards Haptic Communications
over the 5G Tactile Internet. Ieee Communications Surveys And Tutorials, 1-27.
https://doi.org/10.1109/COMST.2018.2851452
Citing this paper
Please note that where the full-text provided on King's Research Portal is the Author Accepted Manuscript or Post-Print version this may
differ from the final Published version. If citing, it is advised that you check and use the publisher's definitive version for pagination,
volume/issue, and date of publication details. And where the final published version is provided on the Research Portal, if citing you are
again advised to check the publisher's website for any subsequent corrections.
General rights
Copyright and moral rights for the publications made accessible in the Research Portal are retained by the authors and/or other copyright
owners and it is a condition of accessing publications that users recognize and abide by the legal requirements associated with these rights.
•Users may download and print one copy of any publication from the Research Portal for the purpose of private study or research.
•You may not further distribute the material or use it for any profit-making activity or commercial gain
•You may freely distribute the URL identifying the publication in the Research Portal
Take down policy
If you believe that this document breaches copyright please contact librarypure@kcl.ac.uk providing details, and we will remove access to
the work immediately and investigate your claim.
Download date: 09. Aug. 2022

1
Towards Haptic Communications over the 5G Tactile Internet
Konstantinos Antonakoglou
1
, Xiao Xu
2
, Eckehard Steinbach
2
, Toktam Mahmoodi
1
, Mischa Dohler
1
1
Centre for Telecommunications Research, King’s College London
2
Chair of Media Technology, Technical University of Munich
Touch is currently seen as the modality that will complement audition and vision as a third media stream over the Internet in a
variety of future haptic applications which will allow full immersion and that will, in many ways, impact society. Nevertheless, the
high requirements of these applications demand networks which allow ultra-reliable and low-latency communication (URLLC) for
the challenging task of applying the required Quality of Service (QoS) for maintaining the user’s Quality of Experience (QoE) at
optimum levels. In this survey, we enlist, discuss and evaluate methodologies and technologies of the necessary infrastructure for
haptic communication. Furthermore, we focus on how the fifth generation (5G) of mobile networks will allow haptic applications
to take life, in combination with the haptic data communication protocols, bilateral teleoperation control schemes and haptic data
processing needed. Finally, we state the lessons learned throughout the surveyed research material along with the future challenges
and infer our conclusions.
Index Terms—Tactile Internet, 5G, haptic communication, bilateral teleoperation, haptic data reduction, multi-modal media
networks
I. INTRODUCTION
G
REAT part of ongoing research on the fifth generation
of mobile networks (5G) is focused on meeting the
requirements of the Tactile Internet [1]–[3]. A major design
challenge here is to provide ultra-low delay communication
over the network which would enable real-time interactions
across wireless networks. This, in turn, will empower people
to wirelessly control both real and virtual objects. It will
undoubtedly add a new dimension to human-machine inter-
action and lead to an unprecedented revolution in almost
every segment of society with applications and use cases
like mobile augmented video content, road traffic/autonomous
driving, healthcare, smart grid, remote education, and remote
immersion/interaction among others [1].
One specific application domain of the Tactile Internet is
teleoperation which allows for remote immersion, including
remote touch. Traditional remote interaction solutions such
as voice or video conferencing, remote teaching, etc., have
reached a high level of sophistication and widespread use
thanks to the growth and progress of audio-visual commu-
nications.
With the benefits of this technology, users experience an
improved virtual presence, immersing in a remote environ-
ment. With current advances in communication infrastructure,
it has been foreseen that in the near future, a complete remote
immersion can be realized with the ability of physical inter-
action with the remote environment. This is achieved by the
exchange of multi-modal information, such as the combination
of audio, video and haptic information, over the Internet.
Such immersion will be feasible for commercially acceptable
use, with real-time applications such as teleoperation with
haptic feedback (referred to as teleoperation) or haptic data
broadcasting in virtual environments [4].
Haptics refer to both kinesthetic perception (information of
forces, torques, position, velocity, etc. sensed by the muscles,
joints, and tendons of the body) and tactile perception (in-
formation of surface texture, friction, etc. sensed by different
types of mechanoreceptors in the skin) [5]. It must be noted
that the previously mentioned term ”tactile” refers to its literal
meaning, i.e. the human perception of touch. When used in
the term ”Tactile Internet”, it signifies the feature of ultra-low
delay communication over the Internet which is a necessity
for many 5G use cases including haptic communication. As
one of the applications of the Tactile Internet, haptic commu-
nication using networked teleoperation systems has specific
requirements, the most demanding being the efficient and
timely exchange of kinesthetic or tactile information while
synchronously providing the user with auditory and visual
information.
Different from the communication of audio and video
signals, haptic signals in bilateral teleoperation systems are
bidirectionally exchanged over the network. It involves human
users and closes a global control loop between the human
users and the actuators/teleoperators. Thus, system stability
and teleoperation quality are very sensitive to communication
delay [6].
Use cases of the Tactile Internet, which highlight its impor-
tance, can be found in the medical, industrial, education and
entertainment sectors. These include remote medical exami-
nation or surgery, industrial teleoperation in e.g. construction
sites, mines or factories, tele-mentoring and gaming to name a
few. The benefits of the realization of the Tactile Internet will
revolutionize our way of living and increase the safety and
efficiency of various tasks. Nonetheless, there are hindrances
to be overcome and the previously mentioned requirements to
be met.
Concepts and technologies around the Internet of Things
(IoT), 5G and the Tactile internet overlap each other, as
indicated in [7], requiring very low latency and high reliabil-
ity communication channels, high-bandwidth low-latency and
secure infrastructure as well as bringing the intelligence of the
network closer to the edge of the network.
As described in [8], one of the challenges in 5G mobile

2
networks development is the provision of low-latency com-
munications with acceptable Quality of Experince (QoE) for
the users. Since evaluating QoE in haptic-based applications
with force feedback over the Internet is a process that has only
recently taken its first steps, the way to resolve this open issue
is still under investigation.
The delay requirements of haptic communication for net-
worked teleoperation systems are heavily dependent on the
application scenarios. Taking into account the latest achieve-
ments on haptic communication, as illustrated in Figure 1, the
less dynamic the remote environment, the more the interaction
between a user and the remote environment is increased. Con-
sequently, different application scenarios arise in accordance
with each level of dynamics and the corresponding range
of time delay that is considered as acceptable for feasible
interaction.
Applications which can tolerate delays over 1ms are within
the scope of teleoperation (the blue circle of Figure 1); a
broad range of applications that can be divided into three
categories of teleoperation, wherein each scenario is associated
to a level of dynamics of the remote environment the user is
interacting with and the corresponding delay tolerance. This
leads to teleoperation applications with different degrees of
immersive perception that range from space teleoperation to
remote steering of automobiles, demonstrating different levels
of abstraction between the user and the remote environment.
The case of highly dynamic environments, where a latency
of under 1ms is needed, is out of the scope of teleoperation
as only control systems can undertake the completion of
tasks with such latency requirements because humans are
underqualified for this kind of interaction. Specifically, for
completing such tasks high Quality of Control (QoC) is
needed. Examples would be a magnetic levitation system that
keeps a running train floating in midair, a fully automatic
driving system that precisely platoons vehicles and zips the
vehicles through intersections without traffic lights, or a real-
time simultaneous localization and mapping (SLAM) with
autonomous-controlled cameras [9]. As a result, these cases
will not be examined in this survey.
On the other hand, in this survey we focus on the efforts for
haptic communication in networked teleoperation systems over
the Tactile Internet and examine in detail the advancements
in teleoperation over long distances. Three main domains
for enabling teleoperation over global connectivity are stud-
ied here, including: (i) the communication network from
the perspective of providing reliable (guaranteed) low-latency
communications, (ii) intelligent data processing to compensate
for the communication latency and for reducing bandwidth
usage, and finally (iii) stability control schemes implemented
at the teleoperation devices to reduce the impact of potential
latency. The focus of this study is on remote environments of
low and intermediate dynamics (red text in Figure 1). Within
this range of dynamics there is a variety of applications such
as remote surgery (low dynamics) or collaboration of users in
virtual or real environments (intermediate dynamics).
The structure of this survey is as follows: In Section
II we describe teleoperation systems in detail, classify and
describe the challenges behind bilateral teleoperation systems
and elaborate on a number of commercially popular haptic
devices. Section III is concerned with how network-based
teleoperation systems communicate over the Internet, data
stream management for the audio, video and haptic data
streams, with special interest to network protocols of the trans-
port and application layer. It also includes common network
performance parameters and elaborates on provisioning of
QoS in the network. Additionally, we briefly discuss network
security. Next, Section IV covers a range of methodologies
and frameworks for reducing the quantity of haptic data to
be transmitted through a communication channel. In Section
V we refer to the main and also most recent teleoperation
bilateral control approaches, mainly focusing on passivity-
based approaches but also mentioning other approaches not
based on passivity. The approaches we will focus on can be
combined with haptic data reduction methods to provide high
QoE to the user. Moreover, Section VI presents the latest
developments on 5G mobile infrastructure and technologies
with focus on ultra-reliable low-latency communication as
well as the main KPIs of various 5G use cases. Section VII
discusses the lessons learned from this survey and outlines
future research directions as well as the current challenges of
haptic communication over the 5G networking infrastructure.
Finally, in Section VIII we infer the conclusions.
Environment
dynamics (level)
10
0
10
1
10
2
10
5
Human in the loop
(QoE requirements)
Delay tolerance (ms)
Teleoperation
Stability & transparency
Teleoperation accross planets,
supervised control
QoC requirements
Very
Low
Low
Medium
High
Very
High
Figure 1. Delay requirements on different applications of immersive percep-
tion
II. TELEOPERATION
Multi-modal telepresence and teleaction (TPTA) systems for
haptic telemanipulation, also known as telehaptic systems [10],
usually consist of one human operator using a haptic interface
(master device) on one end, a communication channel and
one teleoperator (slave actuator) on the other end (Figure 2).
For short distance applications the communication channel can
be a direct wired or wireless communication channel without
the need for network infrastructure. On the other hand, long
distance applications benefit from packet-switched network
infrastructures, and transmit their data as packets. The scale of
long distance applications can range from teleoperation over
local area networks to teleoperation over the Internet.
The goal of TPTA systems, as implied by their name, is
to provide to the user the feeling of presence in the remote

3
environment where the teleoperator exists. It is a goal which
can be achieved due to the ongoing improvement of the
relevant hardware and software for providing the human users
with multi-modal (visual, auditory, and haptic) feedback.
Comm.
Channel
Video/Audio
Position/Velocity
Force/Position
Surface texture
Force/Position
Surface texture
Video/Audio
Position/Velocity
Figure 2. An example of a haptic communication system. In this case, the
master device (user) sends position and/or velocity data while the slave device
(robot) transmits the haptic feedback data, audio and video data streams.
A. Classification of teleoperation systems
Nowadays, extensive research has been made in bilateral
and multilateral telehaptic systems [11], [12]. An approach
for classifying teleoperation systems can be based on the
different communication delays and interaction levels a user
may experience and results in two main categories, Direct
control systems and Supervisory control systems as described
in [13]. As shown in Figure 3, we subdivide each of these
categories further into subcategories:
1) Direct control: The human operator interacts in real-time
with the environment while the master and slave devices
communicate using position/force signals.
a) Closed-loop with negligible delay: In this case, the
communication channel presents minimum delay and
therefore the user is restricted to be in close proximity
to the slave device.
b) Time-delayed closed loop: The most common form of
teleoperation for digital closed-loop control systems.
Similarly to the previous subcategory, the master de-
vice controls the slave actuator but the user is less
restricted in terms of distance from the device (e.g.
transatlantic teleoperation). The remote side is not
autonomous, however, an internal control loop which
processes the command signals from the master device
is included in the teleoperator. In this case, the com-
munication channel (e.g. the Internet), may introduce
variable delays [6].
2) Supervisory control: The teleoperator is a) autonomously
or b) semi-autonomously controlled and receives high-
level commands from the master. It is also referred to
as task-based teleoperation. Examples are teleoperation
across planets or teleoperated robots with autonomous
functionalities [14].
B. Master and slave subsystems
Typically, at the master subsystem of a haptic bilateral
communication system, a human operator interacts with a
haptic interface which uses sensors and transmits motion data
(position or velocity data which are previously packetized)
over a communication channel, to the slave subsystem. In
Teleoperation
systems
Direct
control
Closed-loop
(negligible
delay)
Time-delayed
closed-loop
Supervisory
control
Semi-
autonomous
Fully
autonomous
Figure 3. A classification of teleoperation systems
return, the latter will respond with the force reflection/feedback
of the remote environment, in the form of kinesthetic or
vibrotactile force feedback data [12] while in some cases, such
as in the concept of virtual fixture, position data may also be
transmitted.
Haptic devices which are used as master teleoperation
interfaces, also called haptic manipulators, are comprised of
actuators and sensors which form the kinesthetic and tactile de-
vice subsystems. Such haptic devices may be able to reproduce
and process kinesthetic (kinesthetic interfaces), tactile (tactile
interfaces) or both types of haptic data (haptic interfaces). Such
devices have been created either as commercially available
products or prototypes for academic research.
In [15] the authors discuss the topic of haptic devices and
haptic actuators in relation to haptic communication over the
Tactile Internet, making the important point that there is a need
for ungrounded haptic devices with which the user does not
need to stay in a specific area, contrary to the current state
of haptic devices which are grounded. A list of hand-held
kinesthetic devices as well as a performance evaluation was
presented in [16]. As stated the most popular haptic interface
is the Geomagic Touch (formerly known as Phantom Omni).
These devices present specific technical characteristics such as
the Degrees-of-Freedom (DoF) they support (either for sensing
position or exerting force), the maximum force or torque they
can output, the usable space they can operate in and their
rotation capabilities (if their DoF specification allows them).
Many haptic interfaces, such as CyberGrasp [17] (an ex-
oskeleton device), may also be entirely wearable or have
wearable components in order to provide tactile feedback more
effectively. It is possible to use more than one actuator for
each finger. A variety of such interfaces are called tactile
displays and make use of tactile actuator arrays using various
technologies. Examples of such tactile devices are TPad [18],
which is applied to the screen of mobile phones and Gloveone
[19], a glove that provides tactile feedback to the fingers and
palm.
The hardware design parameters of haptic devices (e.g.
sampling frequency) and the number and type of sensors and
actuators determine the amount of data the device will output
or needs as input. They also determine the limitations of the
interaction between a user or an object and the device. A recent
detailed review of tactile sensors has been made in [20].
The slave haptic subsystem can be either a physical device

4
which interacts with a physical remote environment or a virtual
pointer of any form (e.g. a virtual hand) that operates in
a virtual environment. A key difference between physical
and virtual environments is that the control laws that govern
a physical environment are of continuous nature whereas a
virtual is of discrete nature. Virtual environments, even though
it is not feasible to perfectly replicate a physical environment,
have the advantage of allowing, in some cases, the interaction
among multiple users to interact with each other in a virtual
space over a local network or the Internet. By employing
the tactile or kinesthetic modalities these systems are called
Collaborative-Haptic Virtual Environments (C-HAVE) [21].
C. Challenges of teleoperation systems
Communication of haptic information for teleoperation sys-
tems imposes strong demands on the communication network.
This presents two main challenges for designing a reliable
teleoperation system.
First, haptic sensor readings from kinesthetic devices are
typically sampled, packetized and transmitted at a rate of
1 kHz or even higher [6], [22], [23] to maintain stability and
transparency of the system (further discussed in V-B). It must
be noted that this is not a strict requirement, however, accord-
ing to the stability analysis in [24]–[26] there is a relationship
between the sampling rate, the maximum displayed stiffness
and the system damping for ensuring system stability. A
teleoperation system operating with lower values of sampling
rate may still work and the user may be able to complete
a task. Nonetheless, the maximum displayed stiffness, while
guaranteeing system stability, is smaller than that of a higher
sampling rate and therefore the system may require larger
damping for stabilizing a hard contact.
Communication of kinesthetic information for teleoperation
systems, hence, requires a thousand or more haptic data
packets per second to be transmitted between the master
and the slave devices. Such a high packet rate may lead to
the consumption of a large amount of network resources in
combination with the transmission of audio and video data
and leads to inefficient data communication (see Section IV).
Therefore, haptic data reduction, or packet rate reduction, is
required in teleoperation systems. Moreover, tactile informa-
tion, especially in the form of complicated texture surfaces,
requires data compression.
Second, teleoperation systems are very sensitive to data loss
and latency [6]. Concerning the latter, a haptic communication
system device usually needs to transmit and receive a packet
every millisecond, otherwise stability cannot be guaranteed.
Consequently, an important question can be raised concerning
the amount of latency compared to the amount of data loss
that a system can tolerate. As it has been shown in [27] a
90% reduction can be attained, whereas even a small amount
of delay can disrupt the stability of a bilateral teleoperation
system. Even for a small communication delay or packet loss
rate, teleoperation systems may show stability issues making
degradation of teleoperation quality and task performance.
With the introduction of a communication channel such as
the Internet over mobile networks, this issue is inevitable.
Therefore, to guarantee system stability and improve Qual-
ity of Task (QoT) performance is a key objective of telemanip-
ulation systems [28], [29]. Quality of Task, presents the quality
of task performance and is usually quantified by measuring
the task completion time due to simplicity. Additionally, other
performance measures are the sum of squared forces (SOSF),
peak forces, task error/failure rate, the haptic device trajectory,
range of motion and velocity [30].
On the other hand, this also implies that the network
infrastructure itself, if improved to the point of meeting all
requirements, should be able provide adequate resources and
quality of communication for the best possible QoE and
decrease the dependence to altering haptic information.
In addition, haptic communication systems usually need to
provide to the user visual and audio feedback from the slave
subsystem. High packet rate, packet loss and variable delay
can cause the management and synchronization of the data
streams to become a challenging problem. In this case, packet-
switched network frameworks and protocols are needed for
synchronizing the data streams [31], for measuring the network
conditions and managing the Quality of Service [32].
Summing up, we detail three main solution spaces to
improve haptic communication:
The communication network solution space covering both
aspects of the Internet and the mobile/wireless commu-
nication that enables the Tactile Internet.
Data processing solutions to reduce data transmission
using perceptual thresholds or prediction methods in
order to compensate the incurred delay by long distance
communications.
Stability control solutions to reduce the effect of extra
delay and provide stability for the control loop.
Improvements in all solution spaces of haptic communication
are under development and research. Main contributions to
these solution spaces will be presented in the next chapters.
Individual or joint improvement of the communication chan-
nel, control components and signal processing will guarantee
high teleoperation quality, system stability and scalability.
While current research studies address mainly these solution
spaces independently (few studies address two of these spaces
jointly), the ultimate solution for enabling the haptic commu-
nication should be based on joint optimization of these three
solution spaces. A discussion of future challenges on haptic
communication over 5G exists in Section VII.
III. HAPTIC COMMUNICATION OVER THE INTERNET
With the increase of mobile Internet-enabled machines and
devices over the world, mobile networks play an important
role as the medium for the transmission and reception of data.
In comparison to other networks, the more complex mobile
network infrastructure inevitably introduces latency into any
communication system.
Since using the Internet over a mobile network as a com-
munication channel can be responsible for most of the time
the transmitted information will be delayed, finding ways to
reduce this delay is inevitable. In this way, system stability
and transparency will be easier to maintain.

Citations
More filters
Journal ArticleDOI
TL;DR: In this article, the authors provide a comprehensive review/survey about the key enabling technologies for 6G networks, which include a discussion about the main operation principles of each technology, envisioned potential applications, current state-of-the-art research, and related technical challenges.
Abstract: The commercial fifth-generation (5G) wireless communications networks have already been deployed with the aim of providing high data rates. However, the rapid growth in the number of smart devices and the emergence of the Internet of Everything (IoE) applications, which require an ultra-reliable and low-latency communication, will result in a substantial burden on the 5G wireless networks. As such, the data rate that could be supplied by 5G networks will unlikely sustain the enormous ongoing data traffic explosion. This has motivated research into continuing to advance the existing wireless networks toward the future generation of cellular systems, known as sixth generation (6G). Therefore, it is essential to provide a prospective vision of the 6G and the key enabling technologies for realizing future networks. To this end, this paper presents a comprehensive review/survey of the future evolution of 6G networks. Specifically, the objective of the paper is to provide a comprehensive review/survey about the key enabling technologies for 6G networks, which include a discussion about the main operation principles of each technology, envisioned potential applications, current state-of-the-art research, and the related technical challenges. Overall, this paper provides useful information for industries and academic researchers and discusses the potentials for opening up new research directions.

79 citations

Journal ArticleDOI
TL;DR: This paper describes the Tactile Internet's human-in-the-loop-centric design principles and haptic communications models, and elaborate on the development of decentralized cooperative dynamic bandwidth allocation algorithms for end-to-end resource coordination in fiber-wireless (FiWi) access networks.
Abstract: Historically, research efforts in optical networks have focused on the goal of continuously increasing capacity rather than on lowering end-to-end latency. This slowly started to change in the access environment with post-Next-Generation Passive Optical Network 2 research. The emphasis on latency grew in importance with the introduction of 5G ultra-reliable and low-latency communication requirements. In this paper, we focus on the emerging Tactile Internet as one of the most interesting 5G low-latency applications enabling novel immersive experiences. After describing the Tactile Internet's human-in-the-loop-centric design principles and haptic communications models, we elaborate on the development of decentralized cooperative dynamic bandwidth allocation algorithms for end-to-end resource coordination in fiber-wireless (FiWi) access networks. We then use machine learning in the context of FiWi enhanced heterogeneous networks to decouple haptic feedback from the impact of extensive propagation delays. This enables humans to perceive remote task environments in time at a 1-ms granularity.

68 citations


Cites background from "Toward Haptic Communications Over t..."

  • ...As stated earlier, the Tactile Internet envisions the real-time transmission of haptic information for the remote control of physical and/or virtual objects through the Internet [31]....

    [...]

Journal ArticleDOI
TL;DR: This paper discusses the issues related to interference management for 5G network from the perspective of Heterogeneous Network and Device-to-Device communication, by using enabling techniques, such as Inter-cell Interference Coordination, Coordinated Multipoint, and Coordinated Scheduling.
Abstract: The future wireless Fifth Generation (5G) communication network required a higher bandwidth in order to achieve greater data rate. It will be largely characterized by small cell deployments, typically in the range of 200 meters of radius/cell, at most. The implementation of small size networks delivers various advantages such as high data rate and low signal delay. However, it also suffers from various issues such as inter-cell, intra-cell, and inter-user interferences. This paper discusses the issues related to interference management for 5G network from the perspective of Heterogeneous Network and Device-to-Device communication, by using enabling techniques, such as Inter-cell Interference Coordination, Coordinated Multipoint, and Coordinated Scheduling. Furthermore, several pertinent issues have been critically reviewed focusing on their methodologies, advantages and limitations along with the future work. Future directions proposed by the 3rd Generation Partnership Project for interference mitigation has also been outlined. This review will act as a guide for the researchers to comprehend various existing and emerging enabling interference mitigation techniques for further exploration and smooth implementation of 5G wireless network.

67 citations

Journal ArticleDOI
TL;DR: TILAA, a framework for Tactile Internet-based Ambient Assistance Living in fog environment provides a collaborative communication feedback to the patients and doctors with reduced delay and performance evaluation shows that it has superior performance for the back posture of all patients.

60 citations

Journal ArticleDOI
TL;DR: This work provides a comprehensive survey of the architectures and algorithms proposed to date for the Tactile Internet, using a well-defined set of requirements and discusses some of the lessons learned as well as the most promising research directions.
Abstract: The Internet has made several giant leaps over the years, from a fixed to a mobile Internet, then to the Internet of Things, and now to a Tactile Internet. The Tactile Internet goes far beyond data, audio and video delivery over fixed and mobile networks, and even beyond allowing communication and collaboration among things. It is expected to enable haptic communications and allow skill set delivery over networks. Some examples of potential applications are tele-surgery, vehicle fleets, augmented reality and industrial process automation. Several papers already cover many of the Tactile Internet-related concepts and technologies, such as haptic codecs, applications, and supporting technologies. However, none of them offers a comprehensive survey of the Tactile Internet, including its architectures and algorithms. Furthermore, none of them provides a systematic and critical review of the existing solutions. To address these lacunae, we provide a comprehensive survey of the architectures and algorithms proposed to date for the Tactile Internet. In addition, we critically review them using a well-defined set of requirements and discuss some of the lessons learned as well as the most promising research directions.

55 citations


Cites background or methods from "Toward Haptic Communications Over t..."

  • ...Haptic challenges are excluded, as they have already been exhaustively discussed in surveys such as [21]....

    [...]

  • ...Our survey reviews these algorithms while [21] does not....

    [...]

  • ...all extensively reviewed in [21], except for [110], which has been published after [21]....

    [...]

  • ...Table II briefly summarizes the comparison between the haptic aspects of the Tactile Internet teleoperation systems (for more detailed discussions, the interested reader is referred to [10], [20], [21])....

    [...]

  • ...Reference [21] provides a survey on haptic communications over the 5G Tactile Internet....

    [...]

References
More filters
Book
01 Jan 1991
TL;DR: Covers in a progressive fashion a number of analysis tools and design techniques directly applicable to nonlinear control problems in high performance systems (in aerospace, robotics and automotive areas).
Abstract: Covers in a progressive fashion a number of analysis tools and design techniques directly applicable to nonlinear control problems in high performance systems (in aerospace, robotics and automotive areas).

15,545 citations


"Toward Haptic Communications Over t..." refers background in this paper

  • ...A two-port element inside a teleoperation system can be characterized as passive when the energy (integral of power over time) of the output of the two-port element is greater than the energy of the input [129]....

    [...]

Journal ArticleDOI
01 Jan 2015
TL;DR: This paper presents an in-depth analysis of the hardware infrastructure, southbound and northbound application programming interfaces (APIs), network virtualization layers, network operating systems (SDN controllers), network programming languages, and network applications, and presents the key building blocks of an SDN infrastructure using a bottom-up, layered approach.
Abstract: The Internet has led to the creation of a digital society, where (almost) everything is connected and is accessible from anywhere. However, despite their widespread adoption, traditional IP networks are complex and very hard to manage. It is both difficult to configure the network according to predefined policies, and to reconfigure it to respond to faults, load, and changes. To make matters even more difficult, current networks are also vertically integrated: the control and data planes are bundled together. Software-defined networking (SDN) is an emerging paradigm that promises to change this state of affairs, by breaking vertical integration, separating the network's control logic from the underlying routers and switches, promoting (logical) centralization of network control, and introducing the ability to program the network. The separation of concerns, introduced between the definition of network policies, their implementation in switching hardware, and the forwarding of traffic, is key to the desired flexibility: by breaking the network control problem into tractable pieces, SDN makes it easier to create and introduce new abstractions in networking, simplifying network management and facilitating network evolution. In this paper, we present a comprehensive survey on SDN. We start by introducing the motivation for SDN, explain its main concepts and how it differs from traditional networking, its roots, and the standardization activities regarding this novel paradigm. Next, we present the key building blocks of an SDN infrastructure using a bottom-up, layered approach. We provide an in-depth analysis of the hardware infrastructure, southbound and northbound application programming interfaces (APIs), network virtualization layers, network operating systems (SDN controllers), network programming languages, and network applications. We also look at cross-layer problems such as debugging and troubleshooting. In an effort to anticipate the future evolution of this new paradigm, we discuss the main ongoing research efforts and challenges of SDN. In particular, we address the design of switches and control platforms—with a focus on aspects such as resiliency, scalability, performance, security, and dependability—as well as new opportunities for carrier transport networks and cloud providers. Last but not least, we analyze the position of SDN as a key enabler of a software-defined environment.

3,589 citations


"Toward Haptic Communications Over t..." refers background in this paper

  • ...A step forward in introducing flexibility in network management is represented by the Softwaredefined Networking (SDN), where control and data planes are decoupled and split into logically centralized network intelligence and an underlying abstracted infrastructure [68]....

    [...]

01 Jun 1994
TL;DR: This memo discusses a proposed extension to the Internet architecture and protocols to provide integrated services, i.e., to support real- time as well as the current non-real-time service of IP.
Abstract: This memo discusses a proposed extension to the Internet architecture and protocols to provide integrated services, i.e., to support real- time as well as the current non-real-time service of IP. This extension is necessary to meet the growing need for real-time service for a variety of new applications, including teleconferencing, remote seminars, telescience, and distributed simulation.

3,114 citations


"Toward Haptic Communications Over t..." refers background in this paper

  • ...The IntServ architecture [66] relies on the storage of information in all routers of the network in terms of flows that will pass through them....

    [...]

Journal ArticleDOI
TL;DR: This survey makes an exhaustive review of wireless evolution toward 5G networks, including the new architectural changes associated with the radio access network (RAN) design, including air interfaces, smart antennas, cloud and heterogeneous RAN, and underlying novel mm-wave physical layer technologies.
Abstract: The vision of next generation 5G wireless communications lies in providing very high data rates (typically of Gbps order), extremely low latency, manifold increase in base station capacity, and significant improvement in users’ perceived quality of service (QoS), compared to current 4G LTE networks. Ever increasing proliferation of smart devices, introduction of new emerging multimedia applications, together with an exponential rise in wireless data (multimedia) demand and usage is already creating a significant burden on existing cellular networks. 5G wireless systems, with improved data rates, capacity, latency, and QoS are expected to be the panacea of most of the current cellular networks’ problems. In this survey, we make an exhaustive review of wireless evolution toward 5G networks. We first discuss the new architectural changes associated with the radio access network (RAN) design, including air interfaces, smart antennas, cloud and heterogeneous RAN. Subsequently, we make an in-depth survey of underlying novel mm-wave physical layer technologies, encompassing new channel model estimation, directional antenna design, beamforming algorithms, and massive MIMO technologies. Next, the details of MAC layer protocols and multiplexing schemes needed to efficiently support this new physical layer are discussed. We also look into the killer applications, considered as the major driving force behind 5G. In order to understand the improved user experience, we provide highlights of new QoS, QoE, and SON features associated with the 5G evolution. For alleviating the increased network energy consumption and operating expenditure, we make a detail review on energy awareness and cost efficiency. As understanding the current status of 5G implementation is important for its eventual commercialization, we also discuss relevant field trials, drive tests, and simulation experiments. Finally, we point out major existing research issues and identify possible future research directions.

2,624 citations


"Toward Haptic Communications Over t..." refers background in this paper

  • ...As described in [8], one of the challenges in 5G mobile networks development is the provision of low-latency communications with acceptable Quality of Experience (QoE) for the users....

    [...]

Journal ArticleDOI
TL;DR: In this paper, a control law for teleoperators is presented which overcomes the instability caused by time delay by using passivity and scattering theory, a criterion is developed which shows why existing bilateral control systems are unstable for certain environments, and why the proposed bilateral control law is stable for any environment and any time delay.
Abstract: A control law for teleoperators is presented which overcomes the instability caused by time delay. By using passivity and scattering theory, a criterion is developed which shows why existing bilateral control systems are unstable for certain environments, and why the proposed bilateral control law is stable for any environment and any time delay. The control law has been implemented on a single-axis force-reflecting hand controller, and preliminary results are shown. To keep the presentation clear, a single-degree-of-freedom (DOF) linear time-invariant (LTI) teleoperator system is discussed. Nevertheless, results can be extended, without loss of generality, to an n-DOF nonlinear teleoperation system. >

2,131 citations

Frequently Asked Questions (2)
Q1. What are the contributions mentioned in the paper "Towards haptic communications over the 5g tactile internet" ?

Citing this paper Please note that where the full-text provided on King 's Research Portal is the Author Accepted Manuscript or Post-Print version this may differ from the final Published version. And where the final published version is provided on the Research Portal, if citing you are again advised to check the publisher 's website for any subsequent corrections. 

Therefore, it is essential to explore further how teleoperation systems can be optimally integrated into the next generation ( 5G ) mobile networks. One of the future challenges is to fill the gaps in Table III, by combining haptic data reduction with the existing control approaches for bilateral teleoperation. It is obvious that in the future generations of the Internet, operators will have a more active role in acquiring and processing user data, especially since prediction will play a major role in optimizing the QoS offered by the network [ 230 ]. Future work could focus on defining objective system performance metrics, which will allow us to analyze and to compare different control and communication approaches for bilateral teleoperation systems.