Deep Learning for Joint Source-Channel Coding of Text
Nariman Farsad,Milind Rao,Andrea Goldsmith +2 more
- pp 2326-2330
TLDR
This work preserves semantic information of sentences by first embedding sentences in a semantic space where sentences closer in meaning are located closer together, and then performing joint source and channel coding on these em-beddings.Abstract:
We consider the problem of joint source and channel coding of structured data such as natural language over a noisy channel. The typical approach to this problem in both theory and practice involves performing source coding to first compress the text and then channel coding to add robustness for the transmission across the channel. This approach is optimal in terms of minimizing end-to-end distortion with arbitrarily large block lengths of both the source and channel codes when transmission is over discrete memoryless channels. However, the optimality of this approach is no longer ensured for documents of finite length and limitations on the length of the encoding. We will show in this scenario that we can achieve lower word error rates by developing a deep learning based encoder and decoder. While the approach of separate source and channel coding would minimize bit error rates, our approach preserves semantic information of sentences by first embedding sentences in a semantic space where sentences closer in meaning are located closer together, and then performing joint source and channel coding on these em-beddings.read more
Citations
More filters
Journal ArticleDOI
Wireless Network Intelligence at the Edge
TL;DR: In this article, the key building blocks of edge ML, different neural network architectural splits and their inherent tradeoffs, as well as theoretical and technical enablers stemming from a wide range of mathematical disciplines are presented.
Posted Content
Wireless Network Intelligence at the Edge
TL;DR: In a first of its kind, this article explores the key building blocks of edge ML, different neural network architectural splits and their inherent tradeoffs, as well as theoretical and technical enablers stemming from a wide range of mathematical disciplines.
Journal ArticleDOI
Deep Learning in Physical Layer Communications
TL;DR: In this paper, the authors provide an overview of the recent advancements in DL-based physical layer communications and identify potential research directions to boost intelligent PLS communications. And they demonstrate the power of DL in signal compression and signal detection.
Posted Content
Deep Learning in Physical Layer Communications
TL;DR: The applications of DL in physical layer communications are categorized into systems with and without block structures, and the power ofDL in signal compression and signal detection is demonstrated.
Journal ArticleDOI
Deep Joint Source-Channel Coding for Wireless Image Transmission
TL;DR: In this paper, a joint source and channel coding (JSCC) technique was proposed for wireless image transmission that does not rely on explicit codes for either compression or error correction; instead, it directly maps the image pixel values to the complex-valued channel input symbols.