Open AccessProceedings Article
Gyrophone: recognizing speech from gyroscope signals
Yan Michalevsky,Dan Boneh,Gabi Nakibly +2 more
- pp 1053-1067
TLDR
It is shown that the MEMS gyroscopes found on modern smart phones are sufficiently sensitive to measure acoustic signals in the vicinity of the phone and that this information is sufficient to identify speaker information and even parse speech.Abstract:
We show that the MEMS gyroscopes found on modern smart phones are sufficiently sensitive to measure acoustic signals in the vicinity of the phone. The resulting signals contain only very low-frequency information (<200Hz). Nevertheless we show, using signal processing and machine learning, that this information is sufficient to identify speaker information and even parse speech. Since iOS and Android require no special permissions to access the gyro, our results show that apps and active web content that cannot access the microphone can nevertheless eavesdrop on speech in the vicinity of the phone.read more
Citations
More filters
Proceedings ArticleDOI
DolphinAttack: Inaudible Voice Commands
TL;DR: A totally inaudible attack, DolphinAttack, that modulates voice commands on ultrasonic carriers to achieve inaudibility and is validated on popular speech recognition systems, including Siri, Google Now, Samsung S Voice, Huawei HiVoice, Cortana and Alexa.
Journal ArticleDOI
A Survey on Mobile Crowdsensing Systems: Challenges, Solutions, and Opportunities
Andrea Capponi,Claudio Fiandrino,Burak Kantarci,Luca Foschini,Dzmitry Kliazovich,Pascal Bouvry +5 more
TL;DR: A survey on existing works in the MCS domain is presented and a detailed taxonomy is proposed to shed light on the current landscape and classify applications, methodologies, and architectures to outline potential future research directions and synergies with other research areas.
Proceedings Article
Rocking drones with intentional sound noise on gyroscopic sensors
Yunmok Son,Hocheol Shin,Dongkwan Kim,Youngseok Park,Juhwan Noh,Kibum Choi,Jung-Woo Choi,Yongdae Kim +7 more
TL;DR: This paper investigated whether an adversary could incapacitate drones equipped with Micro-Electro-Mechanical Systems (MEMS) gyroscopes using intentional sound noise to disrupt the operation of drones.
Proceedings ArticleDOI
MoLe: Motion Leaks through Smartwatch Sensors
TL;DR: It is found that when motion signal processing is combined with patterns in English language, the leakage is substantial and merits awareness, especially in light of various continuous sensing apps that are emerging in the app market.
Proceedings ArticleDOI
WALNUT: Waging Doubt on the Integrity of MEMS Accelerometers with Acoustic Injection Attacks
TL;DR: This work investigates how analog acoustic injection attacks can damage the digital integrity of a popular type of sensor: the capacitive MEMS accelerometer, and introduces two low-cost software defenses that mitigate output biasing attacks: randomized sampling and 180 degree out-of-phase sampling.
References
More filters
Journal ArticleDOI
A tutorial on hidden Markov models and selected applications in speech recognition
TL;DR: In this paper, the authors provide an overview of the basic theory of hidden Markov models (HMMs) as originated by L.E. Baum and T. Petrie (1966) and give practical details on methods of implementation of the theory along with a description of selected applications of HMMs to distinct problems in speech recognition.
Journal ArticleDOI
Communication in the presence of noise
TL;DR: A method is developed for representing any communication system geometrically and a number of results in communication theory are deduced concerning expansion and compression of bandwidth and the threshold effect.
Journal ArticleDOI
Robust text-independent speaker identification using Gaussian mixture speaker models
Douglas A. Reynolds,Richard Rose +1 more
TL;DR: The individual Gaussian components of a GMM are shown to represent some general speaker-dependent spectral shapes that are effective for modeling speaker identity and is shown to outperform the other speaker modeling techniques on an identical 16 speaker telephone speech task.
Book
Information Retrieval for Music and Motion
TL;DR: Analysis and Retrieval Techniques for Music Data, SyncPlayer: An Advanced Audio Player, and Relational Features and Adaptive Segmentation.
Journal ArticleDOI
Generalized sampling expansion
TL;DR: In this article, it was shown that a band-limited function f(t) is uniquely determined in terms of the samples g_k(nT) of the responses of m linear systems with input f (t), sampled at 1/m the Nyquist rate.