Pushing the boundaries of crowd-enabled databases with query-driven schema expansion
Joachim Selke,Christoph Lofi,Wolf-Tilo Balke +2 more
- Vol. 5, Iss: 6, pp 538-549
Reads0
Chats0
TLDR
This paper extends crowd-enabled databases by flexible query-driven schema expansion, allowing the addition of new attributes to the database at query time, and leverages the usergenerated data found in the Social Web to build perceptual spaces.Abstract:
By incorporating human workers into the query execution process crowd-enabled databases facilitate intelligent, social capabilities like completing missing data at query time or performing cognitive operators. But despite all their flexibility, crowd-enabled databases still maintain rigid schemas. In this paper, we extend crowd-enabled databases by flexible query-driven schema expansion, allowing the addition of new attributes to the database at query time. However, the number of crowd-sourced mini-tasks to fill in missing values may often be prohibitively large and the resulting data quality is doubtful. Instead of simple crowd-sourcing to obtain all values individually, we leverage the usergenerated data found in the Social Web: By exploiting user ratings we build perceptual spaces, i.e., highly-compressed representations of opinions, impressions, and perceptions of large numbers of users. Using few training samples obtained by expert crowd sourcing, we then can extract all missing data automatically from the perceptual space with high quality and at low costs. Extensive experiments show that our approach can boost both performance and quality of crowd-enabled databases, while also providing the flexibility to expand schemas in a query-driven fashion.read more
Citations
More filters
Patent
System and method for implementing an artificially intelligent virtual assistant using machine learning
TL;DR: In this paper, the authors propose a slot identification machine learning model to segment the text of a query and label each of the slots of the query, generating a slot value for each slot, and using the slot values to identify an external data source relevant to the user query, fetch user data from the external source, and apply one or more operations to the query to generate response data.
Proceedings ArticleDOI
CrowdSeed: query processing on microblogs
TL;DR: CrowdSeed is presented, a system that automatically integrates human input for processing queries imposed on microblogs, and the effectiveness and efficiency of the system using real world data, as well as presenting interesting results from a game called "Who is in the CrowdSeed?".
Closing Information Gaps with Need-driven Knowledge Sharing
TL;DR: This work describes a novel approach called need-driven knowledge sharing (NKS), which consists of three elements: indicators of information need, which are aggregated in order to derive continuous forecasts of organizational information needs, and inverse Search, a tool that identifies documents in the private information space of information providers, which may help closing organizational information gaps if moved to a shared information space.
Book ChapterDOI
Towards Mobile Sensor-Aware Crowdsourcing: Architecture, Opportunities and Challenges
TL;DR: Switching to mobile clients has the potential to radically change the way crowdsourcing is performed, and allows for a new breed of crowdsourcing tasks.
Proceedings Article
Just ask a human? - Controlling Quality in Relational Similarity and Analogy Processing using the Crowd.
TL;DR: This paper employs human workers via crowd-sourcing to establish a performance baseline and develops novel techniques paying respect to the intrinsic consensual nature of the task at hand, which will further pave the way for building true hybrid systems with human workers and heuristic algorithms combining their individual strength.
References
More filters
Journal ArticleDOI
Indexing by Latent Semantic Analysis
TL;DR: A new method for automatic indexing and retrieval to take advantage of implicit higher-order structure in the association of terms with documents (“semantic structure”) in order to improve the detection of relevant documents on the basis of terms found in queries.
Journal ArticleDOI
A tutorial on support vector regression
TL;DR: This tutorial gives an overview of the basic ideas underlying Support Vector (SV) machines for function estimation, and includes a summary of currently used algorithms for training SV machines, covering both the quadratic programming part and advanced methods for dealing with large datasets.
Journal ArticleDOI
Learning from Imbalanced Data
Haibo He,E.A. Garcia +1 more
TL;DR: A critical review of the nature of the problem, the state-of-the-art technologies, and the current assessment metrics used to evaluate learning performance under the imbalanced learning scenario is provided.
Proceedings Article
Support Vector Regression Machines
TL;DR: This work compares support vector regression (SVR) with a committee regression technique (bagging) based on regression trees and ridge regression done in feature space and expects that SVR will have advantages in high dimensionality space because SVR optimization does not depend on the dimensionality of the input space.
BookDOI
Semi-Supervised Learning
TL;DR: Semi-supervised learning (SSL) as discussed by the authors is the middle ground between supervised learning (in which all training examples are labeled) and unsupervised training (where no label data are given).