The DOI matches its Crossref record; 99 of the 99 references it cites were found in a registry or an index.
Towards an explanatory and computational theory of scientific discovery
Open accessAbstract
We propose an explanatory and computational theory of transformative discoveries in science. The theory is derived from a recurring theme found in a diverse range of scientific change, scientific discovery, and knowledge diffusion theories in philosophy of science, sociology of science, social network analysis, and information science. The theory extends the concept of structural holes from social networks to a broader range of associative networks found in science studies, especially including networks that reflect underlying intellectual structures such as co-citation networks and collaboration networks. The central premise is that connecting otherwise disparate patches of knowledge is a valuable mechanism of creative thinking in general and transformative scientific discovery in particular. In addition, the premise consistently explains the value of connecting people from different disciplinary specialties. The theory not only explains the nature of transformative discoveries in terms of the brokerage mechanism but also characterizes the subsequent diffusion process as optimal information foraging in a problem space. Complementary to epidemiological models of diffusion, foraging-based conceptualizations offer a unified framework for arriving at insightful discoveries and optimizing subsequent pathways of search in a problem space. Structural and temporal properties of potentially high-impact scientific discoveries are derived from the theory to characterize the emergence and evolution of intellectual networks of a field. Two Nobel Prize winning discoveries, the discovery of Helicobacter pylori and gene targeting techniques, and a discovery in string theory demonstrated such properties. Connections to and differences from existing approaches are discussed. The primary value of the theory is that it provides not only a computational model of intellectual growth, but also concrete and constructive explanations of where one may find insightful inspirations for transformative scientific discoveries.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Structure of Scientific Revolutions
Kuhn, T. S., & Schlegel, R. (1963) · Physics Today · doi:10.1063/1.3050879 · Cited by 35,538
Statistical mechanics of complex networks
Albert, R., & Barabási, A.-L. (2002) · Reviews of Modern Physics · doi:10.1103/revmodphys.74.47 · Cited by 20,471
Social Network Analysis: Methods and Applications
Wasserman, S. S., & Faust, K. (1994) · Cited by 17,993
Community structure in social and biological networks
Girvan, M., & Newman, M. E. J. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.122653799 · Cited by 15,502 · cited 1×
“Co-author networks have also been studied in complex network analysis of community structures (Girvan & Newman, 2002).”
An index to quantify an individual’s scientific research output
Hirsch, J. E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507655102 · Cited by 11,669
A Set of Measures of Centrality Based on Betweenness
Freeman, L. C. (1977) · Sociometry · doi:10.2307/3033543 · Cited by 10,295
Establishment in culture of pluripotential cells from mouse embryos
Evans, M. J., & Kaufman, M. H. (1981) · Nature · doi:10.1038/292154a0 · Cited by 8,607
Ant colony system: a cooperative learning approach to the traveling salesman problem
Dorigo, M., & Gambardella, L. M. (1997) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.585892 · Cited by 8,081
Structural Holes: The Social Structure of Competition
Lazega, E., & Burt, R. S. (1995) · Revue Française de Sociologie · doi:10.2307/3322456 · Cited by 7,853
The Structure of Scientific Revolutions
Hall, M. B., & Kuhn, T. S. (1963) · The American Historical Review · doi:10.2307/1847040 · Cited by 7,479
Chen, C. (2006) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20317 · Cited by 6,433
Self-citationStructural Holes and Good Ideas
Burt, R. S. (2004) · American Journal of Sociology · doi:10.1086/421787 · Cited by 5,642
Unidentified curved bacilli in the stomach of patients with gastritis and peptic ulceration
Marshall, B., & Warren, J. R. (1984) · The Lancet · doi:10.1016/s0140-6736(84)91816-6 · Cited by 5,509
A faster algorithm for betweenness centrality*
Brandes, U. (2001) · The Journal of Mathematical Sociology · doi:10.1080/0022250x.2001.9990249 · Cited by 4,936
The structure of scientific collaboration networks
Newman, M. E. J. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.98.2.404 · Cited by 4,482
Structural Holes: The Social Structure of CompetitionPreprint
Burt, R. S. (1992) · SSRN Electronic Journal · Cited by 3,048
Searching for intellectual turning points: progressive knowledge domain visualization
Chen, C. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307513100 · Cited by 2,791
Self-citationThe Structure of Scientific Revolutions
Shapere, D. (1984) · Boston Studies in the Philosophy of Science · doi:10.1007/978-94-010-9731-4_3 · Cited by 2,129
Pasteur's Quadrant: Basic Science and Technological Innovation
Tierney, W. G., Stokes, D. E., & Abbott, A. (2005) · Academe · doi:10.2307/40253438 · Cited by 2,077
Evolution of the social network of scientific collaborations
Barabási, A. L., Jeong, H., Néda, Z., Ravasz, E., Schubert, A., & Vicsek, T. (2002) · Physica A: Statistical Mechanics and its Applications · doi:10.1016/s0378-4371(02)00736-7 · Cited by 1,972
Brokerage and Closure: An Introduction to Social Capital
Burt, R. S. (2005) · Cited by 1,926
Pasteur's Quadrant: Basic science and technological innovation
Brandl, J. E. (1998) · Journal of Policy Analysis and Management · doi:10.1002/(sici)1520-6688(199823)17:4<734::aid-pam10>3.0.co;2-g · Cited by 1,836
Bursty and hierarchical structure in streams
Kleinberg, J. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775061 · Cited by 1,337
Sociological methodology, 1981
W., T. D. (1982) · Social Science Information Studies · doi:10.1016/0143-6236(82)90022-9 · Cited by 1,307
Invisible colleges. Diffusion of knowledge in scientific communities
(1974) · Historia Mathematica · doi:10.1016/0315-0860(74)90054-8 · Cited by 1,300
The sociology of philosophies: a global theory of intellectual change
(1999) · Choice Reviews Online · doi:10.5860/choice.36-5015 · Cited by 1,292
Collaborative Brokerage, Generative Creativity, and Creative Success
Fleming, L., Mingo, S., & Chen, D. (2007) · Administrative Science Quarterly · doi:10.2189/asqu.52.3.443 · Cited by 1,252
That's Interesting!: Towards a Phenomenology of Sociology and a Sociology of Phenomenology
Davis, M. S. (1971) · Philosophy of the Social Sciences · doi:10.1177/004839317100100211 · Cited by 1,219
The Statistical Evaluation of Social Network Dynamics
Snijders, T. A. B. (2001) · Sociological Methodology · doi:10.1111/0081-1750.00099 · Cited by 1,203
Invisible Colleges: Diffusion of Knowledge in Scientific Communities.
Mason, K. O., & Crane, D. (1973) · Social Forces · doi:10.2307/2576444 · Cited by 1,151
Interestingness measures for data mining: A survey
Geng, L., & Hamilton, H. J. (2006) · ACM Computing Surveys · doi:10.1145/1132960.1132963 · Cited by 1,141
Social network thresholds in the diffusion of innovations
Valente, T. W. (1996) · Social Networks · doi:10.1016/0378-8733(95)00256-1 · Cited by 1,041
Fish Oil, Raynaud's Syndrome, and Undiscovered Public Knowledge
Swanson, D. R. (1986) · Perspectives in Biology and Medicine · doi:10.1353/pbm.1986.0087 · Cited by 866
Selecting the right interestingness measure for association patterns
Tan, P.-N., Kumar, V., & Srivastava, J. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775053 · Cited by 862
Connectivity in a citation network: The development of DNA theory
Hummon, N. P., & Dereian, P. (1989) · Social Networks · doi:10.1016/0378-8733(89)90017-8 · Cited by 821
Brokerage and Closure: An Introduction to Social Capital
Tweet, P. (2006) · Contemporary Sociology: A Journal of Reviews · doi:10.1177/009430610603500523 · Cited by 781
Creativity support tools: accelerating discovery and innovation
Shneiderman, B. (2007) · Communications of the ACM · doi:10.1145/1323688.1323689 · Cited by 765
What makes patterns interesting in knowledge discovery systems
Silberschatz, A., & Tuzhilin, A. (1996) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/69.553165 · Cited by 679
Elshout, J. (1996) · Acta Psychologica · doi:10.1016/0001-6918(96)00041-8 · Cited by 641
Betweenness centrality as an indicator of the interdisciplinarity of scientific journals
Leydesdorff, L. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20614 · Cited by 612
Pirolli, P. (2007) · Information Foraging Theory · doi:10.1093/acprof:oso/9780195173321.003.0001 · Cited by 483
Tracing information flow on a global scale using Internet chain-letter data
Liben-Nowell, D., & Kleinberg, J. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0708471105 · Cited by 422
Generalization of Epidemic Theory: An Application to the Transmission of Ideas
GOFFMAN, W., & NEWILL, V. A. (1964) · Nature · doi:10.1038/204225a0 · Cited by 392
Leonardo's laptop: Human needs and the new computing technologies
(2003) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(03)80128-1 · Cited by 382
Migraine and Magnesium: Eleven Neglected Connections
Swanson, D. R. (1988) · Perspectives in Biology and Medicine · doi:10.1353/pbm.1988.0009 · Cited by 382
Swanson, D. R. (1986) · The Library Quarterly · doi:10.1086/601720 · Cited by 370
The Craft of Information Visualization: Readings and Reflections
Bederson, B. B., & Shneiderman, B. (2003) · Cited by 365
Studies of scientific discovery: Complementary approaches and convergent findings.
Klahr, D., & Simon, H. A. (1999) · Psychological Bulletin · doi:10.1037/0033-2909.125.5.524 · Cited by 352 · cited 1×
“In (Klahr & Simon, 1999), four approaches to research on scientific discovery were identified; namely, historical accounts of scientific discoveries, psychological experiments with nonscientists working on tasks related to scientific discoveries, direct observation of ongoing scientific…”
Nobel Laureates in Science: Patterns of Productivity, Collaboration, and Authorship
Zuckerman, H. (1967) · American Sociological Review · doi:10.2307/2091086 · Cited by 330
The simultaneous evolution of author and paper networks
Börner, K., Maru, J. T., & Goldstone, R. L. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307625100 · Cited by 296
Tracking and predicting growth areas in science
Small, H. (2006) · Scientometrics · doi:10.1007/s11192-006-0132-y · Cited by 280
Morris, S. A., & Van der Veer Martens, B. (2008) · Annual Review of Information Science and Technology · doi:10.1002/aris.2008.1440420113 · Cited by 280
Mapping Scientific Frontiers: The Quest for Knowledge Visualization
Chen, C. (2003) · Springer eBooks · doi:10.1007/978-1-4471-0051-5 · Cited by 270
Self-citationConcept Discovery in a Scientific Domain
Dunbar, K. (1993) · Cognitive Science · doi:10.1207/s15516709cog1703_3 · Cited by 266
Scientific change: Philosophical models and historical research
Laudan, L., Donovan, A., Laudan, R., Barker, P., Brown, H., Leplin, J., Thagard, P., & Wykstra, S. (1986) · Synthese · doi:10.1007/bf00413981 · Cited by 220
Sandpiles of Opportunity: Success in the Art World
Giuffre, K. A. (1999) · Social Forces · doi:10.1093/sf/77.3.815 · Cited by 208
State of the Field The Conceptualization of Scientific Specialties
Chubin, D. E. (1976) · The Sociological Quarterly · doi:10.1111/j.1533-8525.1976.tb01715.x · Cited by 200
The Group Structure of Cocitation Clusters: A Comparative Study
Mullins, N. C., Hargens, L. L., Hecht, P. K., & Kick, E. L. (1977) · American Sociological Review · doi:10.2307/2094554 · Cited by 191
Two medical literatures that are logically but not bibliographically connected
Swanson, D. R. (1987) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(198707)38:4<228::aid-asi2>3.0.co;2-g · Cited by 189
Griffith, B. C., & Mullins, N. C. (1972) · Science · doi:10.1126/science.177.4053.959 · Cited by 185
The web of knowledge: a festschrift in honor of Eugene Garfield
Garfield, E., Cronin, B., & Atkins, H. (2000) · Medical Entomology and Zoology · Cited by 179
Gordon, M. D., & Lindsay, R. K. (1996) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199602)47:2<116::aid-asi3>3.0.co;2-1 · Cited by 173
Literature-based discovery by lexical statistics
Lindsay, R. K., & Gordon, M. D. (1999) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(1999)50:7<574::aid-asi3>3.0.co;2-q · Cited by 171
Of Nobel class: A citation perspective on high impact research authors
Garfield, E., & Welljams-Dorof, A. (1992) · Metamedicine · doi:10.1007/bf02163625 · Cited by 168
Scientific discovery as problem solving
Simon, H. A., Langley, P. W., & Bradshaw, G. L. (1981) · Synthese · doi:10.1007/bf01064262 · Cited by 167
Scientific discovery and topological transitions in collaboration networks
Bettencourt, L. M. A., Kaiser, D. I., & Kaur, J. (2009) · Journal of Informetrics · doi:10.1016/j.joi.2009.03.001 · Cited by 163
Information foraging theory: adaptive interaction with information
(2007) · Choice Reviews Online · doi:10.5860/choice.45-1497 · Cited by 154
Scale-Free Network Growth by Ranking
Fortunato, S., Flammini, A., & Menczer, F. (2006) · Physical Review Letters · doi:10.1103/physrevlett.96.218701 · Cited by 145
The Search for Insight: Grappling with Gestalt Psychology's Unanswered Questions
Mayer, R. E. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4879.003.0004 · Cited by 143
Small, H. G., & Crane, D. (1979) · Scientometrics · doi:10.1007/bf02016661 · Cited by 134
Leonardo’s Laptop: Human Needs and the New Computing Technologies
(2003) · The Electronic Library · doi:10.1108/02640470310470598 · Cited by 129
Population modeling of the emergence and development of scientific fields
Bettencourt, L. M. A., Kaiser, D. I., Kaur, J., Castillo-Chávez, C., & Wojick, D. E. (2008) · Scientometrics · doi:10.1007/s11192-007-1888-4 · Cited by 126
The web of knowledge: a festschrift in honor of Eugene Garfield
Aversa, E. S. (2001) · Library & Information Science Research · doi:10.1016/s0740-8188(01)00077-9 · Cited by 120
Studying Scientific Discovery by Computer Simulation
Bradshaw, G. F., Langley, P., & Simon, H. A. (1983) · Science · doi:10.1126/science.222.4627.971 · Cited by 114
Implicit Text Linkages between Medline Records: Using Arrowsmith as an Aid to Scientific Discovery.
Swanson, D. R., & Smalheiser, N. R. (1999) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 113
Citation Statistics From More Than a Century of Physical ReviewPreprint
Redner, S. (2004) · arXiv (Cornell University) · doi:10.48550/arxiv.physics/0407137 · Cited by 102
A Sociological Theory of Scientific Change
Fuchs, S. (1993) · Social Forces · doi:10.1093/sf/71.4.933 · Cited by 98
Topological analysis of citation networks to discover the future core articles
Shibata, N., Kajikawa, Y., & Matsushima, K. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20529 · Cited by 91
The growth of knowledge: Testing a theory of scientific revolutions with a formal model
Sterman, J. D. (1985) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(85)90009-5 · Cited by 89
Heinze, T., & Bauer, G. (2007) · Scientometrics · doi:10.1007/s11192-007-0313-3 · Cited by 77
Indomethacin and Alzheimer's disease
Smalheiser, N. R., & Swanson, D. R. (1996) · Neurology · doi:10.1212/wnl.46.2.583 · Cited by 74
Dynamics of Theory Change: The Role of Predictions
Brush, S. G. (1994) · PSA Proceedings of the Biennial Meeting of the Philosophy of Science Association · doi:10.1086/psaprocbienmeetp.1994.2.192924 · Cited by 74
An index to quantify an individual's scientific outputPreprint
Hirsch, J. E. (2005) · arXiv (Cornell University) · Cited by 73
Understanding rapid theoretical change in particle physics: A month-by-month co-citation analysis
Sullivan, D., Koester, D., White, D. H., & Kern, R. (1980) · Scientometrics · doi:10.1007/bf02016351 · Cited by 69
Quantifying Scholarly Impact: IQp Versus the Hirsch h
Antonakis, J., & Lalive, R. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20802 · Cited by 66
Heinze, T., Philip Shapira, A., Senker, J. M., & Kuhlmann, S. (2007) · Scientometrics · doi:10.1007/s11192-007-0108-6 · Cited by 65
The rising landscape: A visual exploration of superstring revolutions in physics
Chen, C., & Kuljis, J. (2003) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.10229 · Cited by 61
Self-citationNobel Prize winners Robin Warren and Barry Marshall
Pincock, S. (2005) · The Lancet · doi:10.1016/s0140-6736(05)67587-3 · Cited by 60
The application of evolution models in scientometrics
Bruckner, E., Ebeling, W., & Scharnhorst, A. (1990) · Scientometrics · doi:10.1007/bf02019160 · Cited by 55
Mathematical Approach to the Prediction of Scientific Discovery
Goffman, W., & Harmon, G. (1971) · Nature · doi:10.1038/229103a0 · Cited by 54
Historical Distributions of Multiple Discoveries and Theories of Scientific Change
Brannigan, A., & Wanner, R. A. (1983) · Social Studies of Science · doi:10.1177/030631283013003004 · Cited by 47
Citation histories of scientific publications. The data sources
Vlachý, J. (1985) · Scientometrics · doi:10.1007/bf02017164 · Cited by 46
How a Scientific Discovery Is Made: A Case History
Holton, G., Chang, H., & Jurkowitz, E. (1996) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 45
Literature-related discovery (LRD): Lessons learned, and future research directions
Kostoff, R. N., Block, J. A., Solka, J. L., Briggs, M. B., Rushenberg, R. L., Stump, J. A., Johnson, D., Lyons, T. J., & Wyatt, J. R. (2007) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2007.11.003 · Cited by 31
Modeling Evolving Innovation Networks
König, M., Battiston, S., & Schweitzer, F. (2009) · Understanding complex systems · doi:10.1007/978-3-540-92267-4_8 · Cited by 30
Glymour, C. (2004) · Daedalus · doi:10.1162/001152604772746710 · Cited by 27
Nowakowska, M. (1973) · Theory and Decision · doi:10.1007/bf00139506 · Cited by 14
Theory change in immunology part I: Extended theories and scientific progress
Schaffner, K. F. (1992) · Metamedicine · doi:10.1007/bf02163627 · Cited by 7
Lindahl, B. I. B. (1992) · Metamedicine · doi:10.1007/bf02163624 · Cited by 5
Cited by
Science Mapping: A Systematic Review of the Literature
Chen, C. (2017) · Journal of Data and Information Science · doi:10.1515/jdis-2017-0006 · Cited by 1,925
Self-citationThe structure and dynamics of cocitation clusters: A multiple‐perspective cocitation analysis
Chen, C., Ibekwe‐SanJuan, F., & Hou, J. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21309 · Cited by 1,585
Self-citationWagner, C. S., Roessner, J. D., Bobb, K., Klein, J. T., Boyack, K. W., Keyton, J., Rafols, I., & Börner, K. (2011) · Journal of Informetrics · doi:10.1016/j.joi.2010.06.004 · Cited by 769
Alginate hydrogel dressings for advanced wound management
Zhang, M., & Zhao, X. (2020) · International Journal of Biological Macromolecules · doi:10.1016/j.ijbiomac.2020.07.311 · Cited by 616
Tradition and Innovation in Scientists’ Research Strategies
Foster, J. G., Rzhetsky, A., & Evans, J. A. (2015) · American Sociological Review · doi:10.1177/0003122415601618 · Cited by 613
Metadata
- Authors
- Chen, C., Chen, Y., Horowitz, M., Hou, H., Liu, Z., & Pellegrino, D.
- Venue
- Journal of Informetrics
- Publisher
- Elsevier BV
- Published
- 2009-07
- Volume
- 3
- Issue
- 3
- Pages
- 191-209
- ISSN
- 1751-1577 (ISSN-L)
- OpenAlex
- W2031055067
- Cited by
- 426
- References
- 99
- FWCI
- 17.51
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.