scispace - formally typeset
Open AccessProceedings Article

Gyrophone: recognizing speech from gyroscope signals

TLDR
It is shown that the MEMS gyroscopes found on modern smart phones are sufficiently sensitive to measure acoustic signals in the vicinity of the phone and that this information is sufficient to identify speaker information and even parse speech.
Abstract
We show that the MEMS gyroscopes found on modern smart phones are sufficiently sensitive to measure acoustic signals in the vicinity of the phone. The resulting signals contain only very low-frequency information (<200Hz). Nevertheless we show, using signal processing and machine learning, that this information is sufficient to identify speaker information and even parse speech. Since iOS and Android require no special permissions to access the gyro, our results show that apps and active web content that cannot access the microphone can nevertheless eavesdrop on speech in the vicinity of the phone.

read more

Content maybe subject to copyright    Report

Citations
More filters
Proceedings ArticleDOI

DolphinAttack: Inaudible Voice Commands

TL;DR: A totally inaudible attack, DolphinAttack, that modulates voice commands on ultrasonic carriers to achieve inaudibility and is validated on popular speech recognition systems, including Siri, Google Now, Samsung S Voice, Huawei HiVoice, Cortana and Alexa.
Journal ArticleDOI

A Survey on Mobile Crowdsensing Systems: Challenges, Solutions, and Opportunities

TL;DR: A survey on existing works in the MCS domain is presented and a detailed taxonomy is proposed to shed light on the current landscape and classify applications, methodologies, and architectures to outline potential future research directions and synergies with other research areas.
Proceedings Article

Rocking drones with intentional sound noise on gyroscopic sensors

TL;DR: This paper investigated whether an adversary could incapacitate drones equipped with Micro-Electro-Mechanical Systems (MEMS) gyroscopes using intentional sound noise to disrupt the operation of drones.
Proceedings ArticleDOI

MoLe: Motion Leaks through Smartwatch Sensors

TL;DR: It is found that when motion signal processing is combined with patterns in English language, the leakage is substantial and merits awareness, especially in light of various continuous sensing apps that are emerging in the app market.
Proceedings ArticleDOI

WALNUT: Waging Doubt on the Integrity of MEMS Accelerometers with Acoustic Injection Attacks

TL;DR: This work investigates how analog acoustic injection attacks can damage the digital integrity of a popular type of sensor: the capacitive MEMS accelerometer, and introduces two low-cost software defenses that mitigate output biasing attacks: randomized sampling and 180 degree out-of-phase sampling.
References
More filters
Journal ArticleDOI

A tutorial on hidden Markov models and selected applications in speech recognition

TL;DR: In this paper, the authors provide an overview of the basic theory of hidden Markov models (HMMs) as originated by L.E. Baum and T. Petrie (1966) and give practical details on methods of implementation of the theory along with a description of selected applications of HMMs to distinct problems in speech recognition.
Journal ArticleDOI

Communication in the presence of noise

TL;DR: A method is developed for representing any communication system geometrically and a number of results in communication theory are deduced concerning expansion and compression of bandwidth and the threshold effect.
Journal ArticleDOI

Robust text-independent speaker identification using Gaussian mixture speaker models

TL;DR: The individual Gaussian components of a GMM are shown to represent some general speaker-dependent spectral shapes that are effective for modeling speaker identity and is shown to outperform the other speaker modeling techniques on an identical 16 speaker telephone speech task.
Book

Information Retrieval for Music and Motion

TL;DR: Analysis and Retrieval Techniques for Music Data, SyncPlayer: An Advanced Audio Player, and Relational Features and Adaptive Segmentation.
Journal ArticleDOI

Generalized sampling expansion

TL;DR: In this article, it was shown that a band-limited function f(t) is uniquely determined in terms of the samples g_k(nT) of the responses of m linear systems with input f (t), sampled at 1/m the Nyquist rate.
Related Papers (5)