scispace - formally typeset
Proceedings ArticleDOI

On the resemblance and containment of documents

Andrei Z. Broder
- 11 Jun 1997 - 
- pp 21-29
TLDR
The basic idea is to reduce these issues to set intersection problems that can be easily evaluated by a process of random sampling that could be done independently for each document.
Abstract
Given two documents A and B we define two mathematical notions: their resemblance r(A, B) and their containment c(A, B) that seem to capture well the informal notions of "roughly the same" and "roughly contained." The basic idea is to reduce these issues to set intersection problems that can be easily evaluated by a process of random sampling that can be done independently for each document. Furthermore, the resemblance can be evaluated using a fixed size sample for each document. This paper discusses the mathematical properties of these measures and the efficient implementation of the sampling process using Rabin (1981) fingerprints.

read more

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI

Information Leakage in Encrypted Deduplication via Frequency Analysis: Attacks and Defenses

TL;DR: This article targets backup workloads and proposes a new inference attack that exploits chunk locality to increase the coverage of inferred chunks, and combines the new attack with the knowledge of chunk sizes and shows its attack effectiveness against variable-size chunks.
Proceedings ArticleDOI

Enforcing k-anonymity in Web Mail Auditing

TL;DR: It is argued that it is critical to devise such algorithms that guarantee k-anonymity, and implement associated processes in order to restore the trust of mail users.
Patent

Vector transformation for indexing, similarity search and classification

TL;DR: In this paper, a feature vector is encoded into a sparse binary vector and the permuted feature vectors are truncated according to a selected window size, and the indexes representing the maximum values of the extracted feature vector are identified and encoded using one-hot encoding, producing one or more sparse binary vectors.
Dissertation

The circle of meaning: from translation to paraphrasing and back

TL;DR: The authors proposed a symbiotic relationship between phrase-based SMT and paraphrase generation, which they termed the "circle of meaning" and used to improve the performance of a bilingual SMT system.
Proceedings ArticleDOI

Information Leakage in Encrypted Deduplication via Frequency Analysis

TL;DR: In this paper, the authors study how frequency analysis practically affects information leakage in encrypted deduplication storage, from both attack and defense perspectives, and propose a new inference attack that exploits chunk locality to increase the coverage of inferred chunks.
References
More filters
Book

The Probabilistic Method

Joel Spencer
TL;DR: A particular set of problems - all dealing with “good” colorings of an underlying set of points relative to a given family of sets - is explored.
Journal ArticleDOI

Syntactic clustering of the Web

TL;DR: An efficient way to determine the syntactic similarity of files is developed and applied to every document on the World Wide Web, and a clustering of all the documents that are syntactically similar is built.
Journal ArticleDOI

Min-Wise Independent Permutations

TL;DR: This research was motivated by the fact that such a family of permutations is essential to the algorithm used in practice by the AltaVista web index software to detect and filter near-duplicate documents.
Proceedings Article

Finding similar files in a large file system

TL;DR: Application of sif can be found in file management, information collecting, program reuse, file synchronization, data compression, and maybe even plagiarism detection.
Proceedings ArticleDOI

Copy detection mechanisms for digital documents

TL;DR: This paper proposes a system for registering documents and then detecting copies, either complete copies or partial copies, and describes algorithms for such detection, and metrics required for evaluating detection mechanisms (covering accuracy, efficiency, and security).