Proceedings ArticleDOI
On the resemblance and containment of documents
TLDR
The basic idea is to reduce these issues to set intersection problems that can be easily evaluated by a process of random sampling that could be done independently for each document.Abstract:
Given two documents A and B we define two mathematical notions: their resemblance r(A, B) and their containment c(A, B) that seem to capture well the informal notions of "roughly the same" and "roughly contained." The basic idea is to reduce these issues to set intersection problems that can be easily evaluated by a process of random sampling that can be done independently for each document. Furthermore, the resemblance can be evaluated using a fixed size sample for each document. This paper discusses the mathematical properties of these measures and the efficient implementation of the sampling process using Rabin (1981) fingerprints.read more
Citations
More filters
Journal ArticleDOI
PRESIDIO: A Framework for Efficient Archival Data Storage
TL;DR: In this paper, the authors present PRESIDIO, a framework that selects from different space-reduction efficent storage methods (ESMs) to detect similarity and reduce or eliminate redundancy when storing objects.
Proceedings ArticleDOI
R 2 SDH: Robust Rotated Supervised Discrete Hashing
TL;DR: In R 2 SDH, correntropy is adopted to replace the least square regression (LSR) model in SDH for achieving better robustness, and rotation is integrated into the original zero-one label matrix used inSDH, as additional freedom to promote flexibility without sacrificing accuracy.
Journal ArticleDOI
Community detection in social recommender systems: a survey
TL;DR: The purpose of this paper is to bring the novice or practitioner quickly up to date with the main outcomes and research directions in the field of social recommendation based on community detection.
Proceedings ArticleDOI
Cross-Pair Text Representations for Answer Sentence Selection.
TL;DR: This paper compute scalar products between vectors representing similarity between members of different pairs, in place of simply using a single vector for each pair, to obtain a representation specific to any pair of pairs, which delivers the state of the art in answer sentence selection.
Posted ContentDOI
PanACoTA: A modular tool for massive microbial comparative genomics
TL;DR: PanACoTa is an interesting addition to the current set of comparative genomics tools, since it will accelerate and standardize the more routine parts of the work, allowing microbial genomicists to more quickly tackle their specific questions.
References
More filters
Book
The Probabilistic Method
TL;DR: A particular set of problems - all dealing with “good” colorings of an underlying set of points relative to a given family of sets - is explored.
Journal ArticleDOI
Syntactic clustering of the Web
TL;DR: An efficient way to determine the syntactic similarity of files is developed and applied to every document on the World Wide Web, and a clustering of all the documents that are syntactically similar is built.
Journal ArticleDOI
Min-Wise Independent Permutations
TL;DR: This research was motivated by the fact that such a family of permutations is essential to the algorithm used in practice by the AltaVista web index software to detect and filter near-duplicate documents.
Proceedings Article
Finding similar files in a large file system
TL;DR: Application of sif can be found in file management, information collecting, program reuse, file synchronization, data compression, and maybe even plagiarism detection.
Proceedings ArticleDOI
Copy detection mechanisms for digital documents
TL;DR: This paper proposes a system for registering documents and then detecting copies, either complete copies or partial copies, and describes algorithms for such detection, and metrics required for evaluating detection mechanisms (covering accuracy, efficiency, and security).