CoChat
Sign Up
Cited by 336

The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.

A Survey on Truth Discovery

Li, Yaliang, Gao, Jing, Meng, Chuishi, Li, Qi, Su, Lu, Zhao, Bo, Fan, Wei, Han, Jiawei·2016·ACM SIGKDD Explorations Newsletter
DOI 10.1145/2897350.2897352
Open this paper in CoChat — free account

Abstract

Thanks to information explosion, data for the objects of interest can be collected from increasingly more sources. However, for the same object, there usually exist conflicts among the collected multi-source information. To tackle this challenge, truth discovery, which integrates multi-source noisy information by estimating the reliability of each source, has emerged as a hot topic. Several truth discovery methods have been proposed for various scenarios, and they have been successfully applied in diverse application domains. In this survey, we focus on providing a comprehensive overview of truth discovery methods, and summarizing them from different aspects. We also discuss some future directions of truth discovery research. We hope that this survey will promote a better understanding of the current progress on truth discovery, and offer some guidelines on how to apply these approaches in application domains.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/2897350.2897352

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Show all 1 references

Research works printed but not linked: 77

  1. 10.1007/978-1-4614-6309-2_9 · DOI
  2. B. Aydin , Y. Yilmaz , Y. Li , Q. Li , J. Gao , and M. Demirbas . Crowdsourcing for multiple-choice question answering . In Proc. of the Conference on Innovative Applications of Artificial Intelligence (IAAI'14) , pages 2946 -- 2953 , 2014 . B. Aydin, Y. Yilmaz, Y. Li, Q. Li, J. Gao, and M. Demirbas. Crowdsourcing for multiple-choice question answering. In Proc. of the Conference on Innovative Applications of Artificial Intelligence (IAAI'14), pages 2946--2953, 2014.
  3. D. P. Bertsekas . Non-linear Programming. Athena Scientific , 2 nd edition, 1999 . D. P. Bertsekas. Non-linear Programming. Athena Scientific, 2nd edition, 1999.
  4. 10.5555/1032649.1033432 · DOI
  5. J. Bleiholder and F. Naumann . Conflict handling strategies in an integrated information system . In Proc. of the International Workshop on Information Integration on the Web (IIWeb'06) , 2006 . J. Bleiholder and F. Naumann. Conflict handling strategies in an integrated information system. In Proc. of the International Workshop on Information Integration on the Web (IIWeb'06), 2006.
  6. 10.1145/1456650.1456651 · DOI
  7. 10.1145/279943.279962 · DOI
  8. R. DerSimonian and N. Laird . Meta-analysis in clinical trials. Controlled clinical trials, 7(3):177--188 , 1986 . R. DerSimonian and N. Laird. Meta-analysis in clinical trials. Controlled clinical trials, 7(3):177--188, 1986.
  9. 10.14778/1920841.1921008 · DOI
  10. 10.14778/1687627.1687690 · DOI · Paper page
  11. 10.14778/1687627.1687691 · DOI · Paper page
  12. 10.1145/2623330.2623623 · DOI · Paper page
  13. 10.14778/2732951.2732962 · DOI
  14. 10.14778/2777598.2777603 · DOI · Paper page
  15. 10.14778/1687553.1687620 · DOI
  16. 10.14778/2535568.2448938 · DOI
  17. 10.1145/2488388.2488422 · DOI
  18. 10.1145/371920.372165 · DOI
  19. 10.1145/1718487.1718504 · DOI
  20. 10.1145/1963192.1963220 · DOI
  21. 10.1145/2070942.2071018 · DOI
  22. 10.1145/2623330.2623685 · DOI
  23. 10.1145/2566486.2568033 · DOI
  24. 10.14778/2735496.2735505 · DOI
  25. 10.1145/2588555.2610509 · DOI · Paper page
  26. 10.14778/2535568.2448943 · DOI
  27. 10.1145/2783258.2783277 · DOI · Paper page
  28. 10.1002/wics.111 · DOI
  29. M. W. Lipsey and D. B. Wilson . Practical metaanalysis , volume 49 . 2001 . M. W. Lipsey and D. B. Wilson. Practical metaanalysis, volume 49. 2001.
  30. 10.14778/3402707.3402731 · DOI
  31. 10.1109/JSEN.2002.1000251 · DOI
  32. 10.1145/2783258.2783314 · DOI
  33. A. Marian and M. Wu . Corroborating information from web sources . IEEE Data Engineering Bulletin , 34 ( 3 ): 11 -- 17 , 2011 . A. Marian and M. Wu. Corroborating information from web sources. IEEE Data Engineering Bulletin, 34(3):11--17, 2011.
  34. 10.1145/2809695.2809715 · DOI
  35. 10.1145/2809695.2809719 · DOI
  36. H. B. Mitchell . Multi-sensor data fusion: an introduction . Springer Science & Business Media , 2007 . H. B. Mitchell. Multi-sensor data fusion: an introduction. Springer Science & Business Media, 2007.
  37. 10.1145/2623330.2623714 · DOI
  38. 10.1109/ICDM.2009.115 · DOI
  39. 10.1145/1040830.1040870 · DOI · Paper page
  40. J. Pasternack and D. Roth . Comprehensive trust metrics for information networks . In Army Science Conference , 2010 . J. Pasternack and D. Roth. Comprehensive trust metrics for information networks. In Army Science Conference, 2010.
  41. J. Pasternack and D. Roth . Knowing what to believe (when you already know something) . In Proc. of the International Conference on Computational Linguistics (COLING'10) , pages 877 -- 885 , 2010 . J. Pasternack and D. Roth. Knowing what to believe (when you already know something). In Proc. of the International Conference on Computational Linguistics (COLING'10), pages 877--885, 2010.
  42. 10.5555/2283696.2283785 · DOI
  43. 10.1145/2488388.2488476 · DOI
  44. 10.1145/2588555.2593674 · DOI
  45. 10.1145/2488388.2488479 · DOI
  46. 10.1145/1553374.1553488 · DOI
  47. 10.1145/2588555.2610504 · DOI
  48. 10.1145/1951365.1951414 · DOI
  49. G. Seni and J. F. Elder . Ensemble methods in data mining: improving accuracy through combining predictions. nSynthesis Lectures on Data Mining and Knowledge Discovery, 2(1):1--126 , 2010 . G. Seni and J. F. Elder. Ensemble methods in data mining: improving accuracy through combining predictions. nSynthesis Lectures on Data Mining and Knowledge Discovery, 2(1):1--126, 2010.
  50. 10.1145/1401890.1401965 · DOI
  51. P. Smyth , U. Fayyad , M. Burl , P. Perona , and P. Baldi . Inferring ground truth from subjective labelling of venus images . In Advances in Neural Information Processing Systems (NIPS'95) , pages 1085 -- 1092 , 1995 . P. Smyth, U. Fayyad, M. Burl, P. Perona, and P. Baldi. Inferring ground truth from subjective labelling of venus images. In Advances in Neural Information Processing Systems (NIPS'95), pages 1085--1092, 1995.
  52. 10.5555/1613715.1613751 · DOI
  53. 10.1109/CVPRW.2008.4562953 · DOI
  54. 10.1007/978-3-540-88682-2_40 · DOI
  55. 10.1109/RTSS.2014.40 · DOI
  56. 10.1145/2567948.2577265 · DOI
  57. 10.1016/j.jcss.2012.09.012 · DOI
  58. 10.1007/978-0-387-85820-3_20 · DOI
  59. 10.1109/ICDCS.2013.54 · DOI
  60. 10.5555/2602339.2602344 · DOI
  61. 10.1145/2530289 · DOI
  62. 10.1145/2185677.2185737 · DOI
  63. 10.1145/2737095.2737114 · DOI
  64. 10.1109/RTSS.2014.19 · DOI
  65. P. Welinder , S. Branson , S. Belongie , and P. Perona . The multidimensional wisdom of crowds . In Advances in Neural Information Processing Systems (NIPS'10) , pages 2424 -- 2432 , 2010 . P. Welinder, S. Branson, S. Belongie, and P. Perona. The multidimensional wisdom of crowds. In Advances in Neural Information Processing Systems (NIPS'10), pages 2424--2432, 2010.
  66. J. Whitehill , P. Ruvolo , T. Wu , J. Bergsma , and J. Movellan . Whose vote should count more: Optimal integration of labelers of unknown expertise . In Advances in Neural Information Processing Systems (NIPS'09) , pages 2035 -- 2043 , 2009 . J. Whitehill, P. Ruvolo, T. Wu, J. Bergsma, and J. Movellan. Whose vote should count more: Optimal integration of labelers of unknown expertise. In Advances in Neural Information Processing Systems (NIPS'09), pages 2035--2043, 2009.
  67. 10.1016/j.is.2010.08.008 · DOI
  68. C. Xu , D. Tao , and C. Xu . A survey on multi-view learning. arXiv preprint arXiv:1304.5634 , 2013 . C. Xu, D. Tao, and C. Xu. A survey on multi-view learning. arXiv preprint arXiv:1304.5634, 2013. · arXiv
  69. 10.1145/1281192.1281309 · DOI
  70. 10.1145/1963405.1963439 · DOI
  71. D. Yu , H. Huang , T. Cassidy , H. Ji , C. Wang , S. Zhi , J. Han , C. Voss , and M. Magdon-Ismail . The wisdom of minority: Unsupervised slot filling validation based on multi-dimensional truth-finding . In Proc. of the International Conference on Computational Linguistics (COLING'14) , 2014 . D. Yu, H. Huang, T. Cassidy, H. Ji, C. Wang, S. Zhi, J. Han, C. Voss, and M. Magdon-Ismail. The wisdom of minority: Unsupervised slot filling validation based on multi-dimensional truth-finding. In Proc. of the International Conference on Computational Linguistics (COLING'14), 2014.
  72. B. Zhao and J. Han . A probabilistic model for estimating real-valued truth from conflicting sources . In Proc. of the VLDB workshop on Quality in Databases (QDB'12) , 2012 . B. Zhao and J. Han. A probabilistic model for estimating real-valued truth from conflicting sources. In Proc. of the VLDB workshop on Quality in Databases (QDB'12), 2012.
  73. 10.14778/2168651.2168656 · DOI
  74. 10.1145/2661829.2661892 · DOI
  75. 10.1145/2783258.2783339 · DOI
  76. D. Zhou , J. C. Platt , S. Basu , and Y. Mao . Learning from the wisdom of crowds by minimax entropy . In Advances in Neural Information Processing Systems (NIPS'12) , pages 2204 -- 2212 , 2012 . D. Zhou, J. C. Platt, S. Basu, and Y. Mao. Learning from the wisdom of crowds by minimax entropy. In Advances in Neural Information Processing Systems (NIPS'12), pages 2204--2212, 2012.
  77. Z.-H. Zhou . Ensemble methods : foundations and algorithms . Chapman & Hall/CRC Machine Learning & Pattern Recognition Series , 2012 . Z.-H. Zhou. Ensemble methods: foundations and algorithms. Chapman & Hall/CRC Machine Learning & Pattern Recognition Series, 2012.

Cited by

Sorted by citations

See all 336

Metadata

Authors
Li, Y., Gao, J., Meng, C., Li, Q., Su, L., Zhao, B., Fan, W., & Han, J.
Venue
ACM SIGKDD Explorations Newsletter
Publisher
Association for Computing Machinery (ACM)
Published
2016-02-25
Volume
17
Issue
2
Pages
1-16
ISSN
  • 1931-0145
  • 1931-0153
DOI
10.1145/2897350.2897352
Cited by
336
References
1
Language
en
Licence
www.acm.org/publications/policies/copyright_policy#Background (vor)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review