Cited by 1,306

The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.

Machine learning for medical diagnosis: history, state of the art and perspective

Kononenko, Igor·2001·Artificial Intelligence in Medicine

Abstract

The paper provides an overview of the development of intelligent data analysis in medicine from a machine learning perspective: a historical view, a state-of-the-art view, and a view on some future trends in this subfield of applied artificial intelligence. The paper is not intended to provide a comprehensive overview but rather describes some subareas and directions which from my personal point of view seem to be important for applying machine learning in medical diagnosis. In the historical overview, I emphasize the naive Bayesian classifier, neural networks and decision trees. I present a comparison of some state-of-the-art systems, representatives from each branch of machine learning, when applied to several medical diagnostic tasks. The future trends are illustrated by two case studies. The first describes a recently developed method for dealing with reliability of decisions of classifiers, which seems to be promising for intelligent data analysis in medicine. The second describes an approach to using machine learning in order to verify some unexplained phenomena from complementary medicine, which is not (yet) approved by the orthodox medical community but could in the future play an important role in overall medical diagnosis and treatment.

Overview

Integrity signals

Registry

Crossref · 10.1016/s0933-3657(01)00077-x

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Human-AI teams under-perform the AI alone in many tasks.

    “However, many studies have shown that human-AI teams under-perform the AI alone in tasks [3, 4, 6, 14, 18, 20, 21, 30].”

    From A Decision Theoretic Framework for Measuring AI Reliance (2024) · cites this paper as [20]

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 66

  1. Shavlik JW, Dietterich TG, editors. Readings in machine learning. Los Altos, CA: Morgan Kaufmann, 1990.
  2. Mitchell T. Machine learning. New York: McGraw-Hill, 1997.
  3. Michalski RS, Bratko I, Kubat M, editors. Machine learning, data mining and knowledge discovery: methods and applications. New York: Wiley, 1998.
  4. Hunt E, Martin J, Stone P. Experiments in induction. New York: Academic Press, 1966.
  5. Nilsson N. Learning machines. New York: McGraw-Hill, 1965.
  6. Kononenko I, Bratko I, Kukar M. Application of machine learning to medical diagnosis. In: Michalski RS, Bratko I, Kubat M, editors. Machine learning, data mining and knowledge discovery: methods and applications. New York: Wiley, 1998.
  7. Pompe U, Kononenko I. Probabilistic first-order classification. In: Lavrač N, Džeroski S, editors. Proceedings of the 7th International Workshop ILP-97 on Inductive Logic Programming. Berlin: Springer, 1997, pp. 235–42. · DOI
  8. Spiegelhalter, 1993, Bayesian analysis in expert systems, Stat. Sci., 8, 219, 10.1214/ss/1177010888 · DOI
  9. Good IJ. The estimation of probabilities — an essay on modern Bayesian methods. Cambridge: MIT Press, 1964.
  10. Kononenko I, Bratko I, Roškar E. Experiments in automatic learning of medical diagnostic rules. In: Proceedings of the International School for the Synthesis of Expert’s Knowledge Workshop, 1984 Aug; Bled, Slovenia.
  11. Cestnik B, Kononenko I, Bratko I. ASSISTANT 86: a knowledge elicitation tool for sophisticated users. In: Bratko I, Lavrac N, editors. Progress in machine learning. Wilmslow: Sigma Press, 1987.
  12. Kononenko I. Interpretation of neural networks decisions. In: Proceedings of the IASTED International Conference on Expert Systems and Applications, 1989 Jun 26–29; Zurich, pp. 224–7 (also Proceedings of the ISSEK Workshop, 1989 Sep; Udine).
  13. Kononenko, 1993, Inductive and Bayesian learning in medical diagnosis, Appl. Artif. Intell., 7, 317, 10.1080/08839519308949993 · DOI
  14. Cestnik B. Estimating probabilities: a crucial task in machine learning. In: Proceedings of the European Conference on Artificial Intelligence, 1990 Aug; Stockholm, pp. 147–9.
  15. Kononenko I. Semi-naive Bayesian classifier. In: Kodratoff Y, editor. Proceedings of the European Working Session on Learning-91, 1991 Mar 4–6; Porto. Berlin: Springer, pp. 206–19. · DOI
  16. Kononenko, 1992, Naive Bayesian classifier and continuous attributes, Informatica, 16, 1
  17. Langley P. Induction of recursive Bayesian classifiers. In: Proceedings of the European Conference on Machine Learning, 1993 Apr; Vienna. · DOI
  18. Pazzani M. Searching for dependencies in Bayesian classifiers. Artificial intelligence and statistics IV. Lecture notes in statistics. New York: Springer, 1997. · DOI
  19. Minsky M. In: Papert S, editor. Perceptrons. Cambridge, MA: MIT Press, 1969.
  20. Rumelhart DE, Hinton GE, Williams RJ. Learning internal representations by error propagation. In: Rumelhart DE, McClelland JL, editors. Parallel distributed processing, vol. 1: Foundations. Cambridge: MIT Press, 1986.
  21. Kononenko, 1989, Bayesian neural networks, Biol. Cybernetics J., 61, 361, 10.1007/BF00200801 · DOI
  22. Quinlan JR. Discovering rules from large collections of examples. In: Michie D, editor. Expert systems in the microelectronic age. Edinburgh: Edinburgh University Press, 1979.
  23. Michalski, 1980, Learning by being told and learning from examples: an experimental comparison of the two methods of knowledge acquisition in the context of developing an expert system for soybean disease diagnosis, Int. J. Policy Anal. Inform. Syst., 4, 125
  24. Bratko, 1980, An experiment in automatic learning of diagnostic rules, Informatica (Ljubljana), 4, 18
  25. Elomaa T, Holsti N. An experimental comparison of inducing decision trees and decision lists in noisy domains. In: Proceedings of the 4th European Working Session on Learning, 1989 Dec 4–6; Montpeiller, pp. 59–69.
  26. Horn, 1985, An expert system for the interpretation of thyroid assays in a clinical laboratory, Aust. Comput. J., 17, 7
  27. Hojker S, Kononenko I, Jauk A, Fidler V, Porenta M. Expert system’s development in the management of thyroid diseases. In: Proceedings of the European Congress for Nuclear Medicine, 1988 Sep; Milano.
  28. Quinlan R, Compton P, Horn KA, Lazarus L. Inductive knowledge acquisition: a case study. In: Quinlan JR, editor. Applications of expert systems. Reading, MA: Addison-Wesley, 1987 (also Proceedings of the 2nd Australian Conference on Applications of Expert Systems, 1986 May 14–16; Sydney).
  29. Kononenko I, Jauk A, Janc T. Induction of reliable decision rules. In: Proceedings of the International School for the Synthesis of Expert’s Knowledge Workshop, 1988 Sep 10–13; Udine, Italy.
  30. Karalič, 1991, Significance level based classification with multiple trees, Informatica (Ljubljana), 15, 54
  31. Kern J, Deželič G, Težak-Benčič M, Durrigl T. Medical decision making using inductive learning program [in Croatian]. In: Proceedings of the 1st Congress on Yugoslav Medical Informatics, 1990 Dec 6–8; Beograd, pp. 221–8.
  32. Baim, 1988, A method for attribute selection in inductive learning systems, IEEE Trans. PAMI, 10, 888, 10.1109/34.9110 · DOI
  33. Chan KCC, Wong AKC. Automatic construction of expert systems from data: a statistical approach. In: Proceedings of the IJCAI Workshop on Knowledge Discovery in Databases, 1989 Aug; Detroit, MI, pp. 37–48.
  34. Bratko I, Mozetič I, Lavrač N. KARDIO: a study in deep and qualitative knowledge for expert systems. Cambridge, MA: MIT Press, 1989.
  35. Clark P, Boswell R. Rule induction with CN2: some recent improvements. In: Proceedings of the European Working Session on Learning-91, 1991 Mar 4–6; Porto, Portugal, pp. 151–63. · DOI
  36. Catlett J. On changing continuous attributes into ordered discrete attributes. In: Proceedings of the European Working Session on Learning-91, 1991 Mar 4–6; Porto, Portugal, pp. 164–78. · DOI
  37. Muggleton S. Inductive acquisition of expert knowledge. Reading, MA: Addison-Wesley, 1990.
  38. Nunez M. Decision tree induction using domain knowledge. In: Wielinga B, et al., editors. Current trends in knowledge acquisition. Amsterdam: ISO Press, 1990.
  39. Kira K, Rendell L. A practical approach to feature selection. In: Sleeman D, Edwards P, editors. Proceedings of the International Conference on Machine Learning, 1992 Jul; Aberdeen. Los Altos, CA: Morgan Kaufmann, 1992, pp. 249–56. · DOI
  40. Kira K, Rendell L. The feature selection problem: traditional methods and new algorithm. In: Proceedings of the AAAI’92, 1992 Jul; San Jose, CA.
  41. Robnik-Šikonja M, Kononenko I. An adaptation of Relief for attribute estimation in regression. In: Proceedings of the International Conference on Machine Learning ICML-97, 1997 Jul; Nashville, pp. 296–304.
  42. Kukar, 1996, Machine learning in prognostics of the femoral neck fracture recovery, Artif. Intell. Med., 8, 431, 10.1016/S0933-3657(96)00351-X · DOI
  43. Kononenko I. Estimating attributes: analysis and extensions of RELIEF. In: De Raedt L, Bergadano F, editors. Proceedings of the European Conference on Machine Learning, 1994 Apr; Catania. Berlin: Springer, 1994, pp. 171–82. · DOI
  44. Ragavan H, Rendell L. Lookahead feature construction for learning hard concepts. In: Proceedings of the 10th International Conference on Machine Learning, 1993 Jun; Amherst, MA. Los Altos, CA: Morgan Kaufmann, 1993, pp. 252–9. · DOI
  45. Ragavan H, Rendell L, Shaw M, Tessmer A. Learning complex real-world concepts through feature construction. Technical report UIUC-BI-AI-93-03, The Beckman Institute, University of Illinois, 1993. · DOI
  46. Weigand S, Huberman A, Rumelhart DE. Predicting the future: a connectionist approach. Int. J. Neural Syst. 1990;1(3):101–117. · DOI
  47. Craven MW, Shavlik JW. Learning symbolic rules using artificial neural networks. In: Proceedings of the 10th International Conference on Machine Learning; Amherst, MA. Los Altos, CA: Morgan Kaufmann, 1993, pp. 73–80. · DOI
  48. Quinlan JR. C4.5: programs for machine learning. San Mateo, CA: Morgan Kaufmann, 1993.
  49. Pirnat V, Kononenko I, Janc T, Bratko I. Medical estimation of automatically induced decision rules. In: Proceedings of the of 2nd European Conference on Artificial Intelligence in Medicine, 1989 Aug 29–31; City University, London, pp. 24–36. · DOI
  50. Kononenko, 1991, Information based evaluation criterion for classifier’s performance, Machine Learning, 6, 67, 10.1007/BF00153760 · DOI
  51. Kukar, 1999, Analysing and improving the diagnosis of ishaemic heart disease with machine learning, Artif. Intell. Med., 16, 25, 10.1016/S0933-3657(98)00063-3 · DOI
  52. Kukar M. Estimating the reliability of classifications and cost-sensitive combining of different machine learning methods. Ph.D. Thesis [in Slovene], Faculty of Computer and Information Science, University of Ljubljana, Ljubljana, Slovenia, 2001.
  53. Pollock, 1983, Computer-assisted interpretation of noninvasive tests for diagnosis of coronary artery disease, Cardiovasc. Rev. Rep., 4, 367
  54. Kukar M, Grošelj C. Machine learning in stepwise diagnostic process. In: Proceedings of the Joint European Conference on Artificial Intelligence in Medicine and Medical Decision Making, 1999; Aalborg, Denmark, pp. 315–25. · DOI
  55. Korotkov K, Kouznetsov A. The theory of morfogenetic synergization of biological objects and the phantom leaf effect. In: Proceedings of the 3rd International Conference for Medical and Applied Bio-Electrography, 1997 Apr; Helsinki, Finland, pp. 55–7.
  56. Krashenuk A, Krashenuk S, Korotkov K, Buzian N, Lesiovskaya E, Bogaeva N. GDV analysis of hirudotherapy effect to rats. In: Proceedings of the International Scientific Conference Kirlionics, White Nights 98, 1998 Jun; Federal Technical University SPIFMO, St. Petersburg, Russia.
  57. Voeikov VL. Living blood outside an organism. In: Proceedings of the International Scientific Conference Kirlionics, White Nights 98, 1998 Jun; Federal Technical University SPIFMO, St. Petersburg, Russia.
  58. Gurvits, 1998, A new concept of the early diagnosis of cancer, Consciousness Phys. Reality, 1, 84
  59. Lee SD. The application of Kirlian photography in dentistry. In: Proceedings of the International Scientific Conference Kirlionics, White Nights 98, 1998 Jun; Federal Technical University SPIFMO, St. Petersburg, Russia.
  60. Hein M. Bio-synergetix: a new paradigm in subtle energy health care. In: Proceedings of the International Conference on Biology and Cognitive Sciences, 1999 Oct 12–14; Ljubljana, Slovenia, pp. 72–9.
  61. Kononenko I, Zrimec T, Prihavec B, Bevk M, Stanojević S. Machine learning and GDV images: diagnosis and therapy verification. In: Proceedings of the International Conference on Biology and Cognitive Sciences, 1999 Oct; Ljubljana, Slovenia, pp. 84–7.
  62. Kononenko I, Zrimec T, Sadikov A, Mele K, Milharčič T. Machine learning and GDV images: current research and results. In: Proceedings of the International Conference on Biology and Cognitive Science, 1999 Oct; Ljubljana, Slovenia, pp. 80–3.
  63. Bevk M, Kononenko I, Zrimec T. Relation between energetic diagnoses and GDV images. In: Proceedings of the New Science of Consciousness: 3rd International Conference on Cognitive Science, 2000 Oct; Ljubljana, Slovenia, pp. 54–7.
  64. Kononenko I, Zrimec T, Sadikov A, Skočaj D. GDV images: current research and results. In: Proceedings of the New Science of Consciousness: 3rd International Conference on Cognitive Science, 2000 Oct; Ljubljana, Slovenia, pp. 65–8.
  65. Trampuž, 2000, Experiental and biophysical effects of the art of living programme, Int. J. Psychol., 35, 12
  66. Kononenko I, Bosnič Z, Žgajnar B. The influence of mobile telephones on human bioelectromagnetic field. In: Proceedings of the New Science of Consciousness: 3rd International Conference on Cognitive Science, 2000 Oct; Ljubljana, Slovenia, pp. 69–72.

Cited by

Sorted by citations

Metadata

Authors
Kononenko, I.
Venue
Artificial Intelligence in Medicine
Publisher
Elsevier BV
Published
2001-08
Volume
23
Issue
1
Pages
89-109
ISSN
0933-3657
Cited by
1,306
References
5
Language
en

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review