Cited by 9Algorithms and Data CompressionFractal and DNA sequence analysisComputability, Logic, AI Algorithms

The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.

Detecting translations of the same text and data with common source

Open access
Koroutchev, Kostadin, Cebrián, Manuel·2006·Journal of Statistical Mechanics: Theory and Experiment

Abstract

Compression based similarity distances have the main drawback of needing the same coding scheme for the objects to be compared. In some situations, there exists significant similarity with no literal shared information: text translations, different coding schemes, etc. To overcome this problem, we present a similarity measure that compares the redundancy structure of the data extracted by means of a Lempel–Ziv compression scheme. Each text is represented as a graph in which vertices are text positions and edges represent shared information; with our measure, two texts are similar if they have the same referential topology when compressed. In this paper we give empirical evidence and a phenomenological explanation that this new measure is a robust indicator, detecting similarity between data coded in different languages. We also regard a textual data without any structure, but with a common source, and find that we can detect such data and distinguish this situation from the previous one.

Overview

Integrity signals

Registry

Crossref · 10.1088/1742-5468/2006/10/p10009

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 25 references

Research works printed but not linked: 12

  1. Cebrian M, J. Commun. Inf. Syst.
  2. Resnik P, 1999, Proc. 37th Annual Mtg of the ACL
  3. Ingle N C, The Incorporated Linguistic, 15, 98
  4. Chen J Nie J, 2000, Int. Conf. on Chinese Language Computing
  5. Ma X Liberman M, 1999, Machine Translation Summit VII
  6. Smith N, 2002, Proc. 2002 Conf. on Empirical Methods in Natural Language Processing
  7. de Cervantes M, Don Quijote
  8. de Cervantes M, Don Quixote
  9. de Cervantes M, Don Quichotte
  10. de Cervantes M, 1988, Don Kihot
  11. Arnason U, 1993, Mol. Biol. Evol., 10, 960
  12. Coble M D, 2004, Int. J. Legal Med.

Cited by

Sorted by citations

See all 9

Metadata

Authors
Koroutchev, K., & Cebrián, M.
Affiliations
Universidad Autónoma de Madrid (ES)
Venue
Journal of Statistical Mechanics: Theory and Experiment
Published
2006-10-18
Volume
2006
Issue
10
Pages
P10009-P10009
ISSN
1742-5468 (ISSN-L)
OpenAlex
W1988041031
Cited by
9
References
25
Citations by year
2020: 1 · 2017: 1 · 2016: 1 · 2015: 1 · 2013: 1 · 2012: 1
FWCI
0.38
Type
journal article
Language
en
Open access
Locations
Journal of Statistical Mechanics Theory and Experiment (publishedVersion)
Funders
Science and Engineering Research Board
Topics
  • Physical Sciences › Mathematics › Theoretical Computer Science › Algorithms and Data Compression
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Fractal and DNA sequence analysis
  • Physical Sciences › Computer Science › Computational Theory and Mathematics › Computability, Logic, AI Algorithms
Keywords
Lempel-Ziv compression, similarity measures, shared information, multilingual text comparison

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review