Journal ArticleDOI
Theory of communication. Part 1: The analysis of information
TLDR
New methods of analysis, which involve some of the mathematical apparatus of quantum theory, are illustrated by application to some problems of transmission theory, such as direct generation of single sidebands, signals transmitted in minimum time through limited frequency channels, frequency modulation and time-division multiplex telephony.Abstract:
Hitherto communication theory was based on two alternative methods of signal analysis. One is the description of the signal as a function of time; the other is Fourier analysis. Both are idealizations, as the first method operates with sharply defined instants of time, the second with infinite wave-trains of rigorously defined frequencies. But our everyday experiences?especially our auditory sensations?insist on a description in terms of both time and frequency. In the present paper this point of view is developed in quantitative language. Signals are represented in two dimensions, with time and frequency as co-ordinates. Such two-dimensional representations can be called ?information diagrams,? as areas in them are proportional to the number of independent data which they can convey. This is a consequence of the fact that the frequency of a signal which is not of infinite duration can be defined only with a certain inaccuracy, which is inversely proportional to the duration, and vice versa. This ?uncertainty relation? suggests a new method of description, intermediate between the two extremes of time analysis and spectral analysis. There are certain ?elementary signals? which occupy the smallest possible area in the information diagram. They are harmonic oscillations modulated by a ?probability pulse.? Each elementary signal can be considered as conveying exactly one datum, or one ?quantum of information.? Any signal can be expanded in terms of these by a process which includes time analysis and Fourier analysis as extreme cases. These new methods of analysis, which involve some of the mathematical apparatus of quantum theory, are illustrated by application to some problems of transmission theory, such as direct generation of single sidebands, signals transmitted in minimum time through limited frequency channels, frequency modulation and time-division multiplex telephony.read more
Citations
More filters
Journal ArticleDOI
Deep learning in neural networks
TL;DR: This historical survey compactly summarizes relevant work, much of it from the previous millennium, review deep supervised learning, unsupervised learning, reinforcement learning & evolutionary computation, and indirect search for short programs encoding deep and large networks.
Proceedings ArticleDOI
From learning models of natural image patches to whole image restoration
Daniel Zoran,Yair Weiss +1 more
TL;DR: A generic framework which allows for whole image restoration using any patch based prior for which a MAP (or approximate MAP) estimate can be calculated is proposed and a generic, surprisingly simple Gaussian Mixture prior is presented, learned from a set of natural images.
Journal ArticleDOI
Deep Learning for Electromyographic Hand Gesture Signal Classification Using Transfer Learning
Ulysse Côté-Allard,Cheikh Latyr Fall,Alexandre Drouin,Alexandre Campeau-Lecours,Clément Gosselin,Kyrre Glette,François Laviolette,Benoit Gosselin +7 more
TL;DR: The proposed transfer learning scheme is shown to systematically and significantly enhance the performance for all three networks on the two datasets, achieving an offline accuracy of 98.31% and real-time feedback allows users to adapt their muscle activation strategy which reduces the degradation in accuracy normally experienced over time.
Journal ArticleDOI
A Survey on Multicarrier Communications: Prototype Filters, Lattice Structures, and Implementation Aspects
TL;DR: In this article, the authors present a unified review of waveform design options for multicarrier schemes, and pave the way for the evolution of the multic-carrier schemes from the current state of the art to future technologies.
Journal ArticleDOI
Sketch-a-Net: A Deep Neural Network that Beats Humans
TL;DR: It is shown that state-of-the-art deep networks specifically engineered for photos of natural objects fail to perform well on sketch recognition, regardless whether they are trained using photos or sketches.
References
More filters
Journal ArticleDOI
Transmission of information
TL;DR: In this article, a quantitative measure of information is developed which is based on physical as contrasted with psychological considerations, and how the rate of transmission of this information over a system is limited by the distortion resulting from storage of energy is discussed from the transient viewpoint.
Journal ArticleDOI
Certain factors affecting telegraph speed
TL;DR: In this paper, it was shown that the wave shape depends somewhat on the type of circuit over which intelligence is to be transmitted and that for most cases the optimum wave is neither rectangular nor a half cycle sine wave as is frequently used but a wave of special form produced by sending a simple rectangular wave through a suitable network.
Journal ArticleDOI
Notes on the Theory of Modulation
TL;DR: In this article, the authors proved that the frequency modulation system using a spacing or compensating wave is inferior to the amplitude variation system both as to the width of the frequency band occupied and as to distortion of signal wave form.
Journal ArticleDOI
Time division multiplex systems
TL;DR: The idea of transmitting and receiving independent signals over a common line by means of synchronized switches at the terminals is quite old and has been used in multiplex telegraphy for many years as mentioned in this paper.