scispace - formally typeset
Proceedings ArticleDOI

SoundSense: scalable sound sensing for people-centric applications on mobile phones

TLDR
This paper proposes SoundSense, a scalable framework for modeling sound events on mobile phones that represents the first general purpose sound sensing system specifically designed to work on resource limited phones and demonstrates that SoundSense is capable of recognizing meaningful sound events that occur in users' everyday lives.
Abstract
Top end mobile phones include a number of specialized (e.g., accelerometer, compass, GPS) and general purpose sensors (e.g., microphone, camera) that enable new people-centric sensing applications. Perhaps the most ubiquitous and unexploited sensor on mobile phones is the microphone - a powerful sensor that is capable of making sophisticated inferences about human activity, location, and social events from sound. In this paper, we exploit this untapped sensor not in the context of human communications but as an enabler of new sensing applications. We propose SoundSense, a scalable framework for modeling sound events on mobile phones. SoundSense is implemented on the Apple iPhone and represents the first general purpose sound sensing system specifically designed to work on resource limited phones. The architecture and algorithms are designed for scalability and Soundsense uses a combination of supervised and unsupervised learning techniques to classify both general sound types (e.g., music, voice) and discover novel sound events specific to individual users. The system runs solely on the mobile phone with no back-end interactions. Through implementation and evaluation of two proof of concept people-centric sensing applications, we demostrate that SoundSense is capable of recognizing meaningful sound events that occur in users' everyday lives.

read more

Content maybe subject to copyright    Report

Citations
More filters

Adaptive Personalized Privacy in Participatory Sensing

TL;DR: This work proposes an adaptive privacy protection scheme, in order to meet personalized location privacy protection requirements and experimentally prove its effectiveness against static privacy-protection schemes.
Journal ArticleDOI

Epidemic Spreading Over Social Networks Using Large-scale Biosensors: A Survey

TL;DR: In this paper, a review of the systems applied to epidemic prediction can be found in this context. But the integration between large-scale sensor networks and these initiatives, required to achieve seamless epidemic detection and prediction, is yet to be achieved.
Proceedings ArticleDOI

An analytical study of GWAP-based geospatial tagging systems

TL;DR: This study designs three metrics to evaluate the system performance, develops five task assignment algorithms for a GWAP-based geotagging system, and finds that the Least-Throughput-First Assignment algorithm (LTFA) is the most effective approach because it can achieve competitive system utility, while its computational complexity remains moderate.

Event and state detection in time series by genetic programming

F Xie
TL;DR: This paper presents a probabilistic procedure for detecting time series event and state patterns to identify particular variations of user-interest in one or more channels of time.
Dissertation

An approach to pervasive monitoring in dynamic learning contexts : data sensing, communication support and awareness provision

TL;DR: A pervasive monitoring system that take advantage of the capabilities of modern smartphones to support the development of pervasive monitoring solutions and to bridge the gap between the challenges posed by modern learning requirements and the abilities of current technology.
References
More filters
Book

Pattern Recognition and Machine Learning

TL;DR: Probability Distributions, linear models for Regression, Linear Models for Classification, Neural Networks, Graphical Models, Mixture Models and EM, Sampling Methods, Continuous Latent Variables, Sequential Data are studied.

Pattern Recognition and Machine Learning

TL;DR: Probability distributions of linear models for regression and classification are given in this article, along with a discussion of combining models and combining models in the context of machine learning and classification.
Book

Pattern Recognition and Machine Learning (Information Science and Statistics)

TL;DR: Looking for competent reading resources?
Book

Fundamentals of speech recognition

TL;DR: This book presents a meta-modelling framework for speech recognition that automates the very labor-intensive and therefore time-heavy and therefore expensive and expensive process of manually modeling speech.
Journal ArticleDOI

On the use of windows for harmonic analysis with the discrete Fourier transform

F.J. Harris
TL;DR: A comprehensive catalog of data windows along with their significant performance parameters from which the different windows can be compared is included, and an example demonstrates the use and value of windows to resolve closely spaced harmonic signals characterized by large differences in amplitude.
Related Papers (5)