CoChat
Sign Up
PreprintCited by 1scientometrics and bibliometrics researchResearch, Science, and AcademiaData Visualization and Analytics

Funding the Frontier: Visualizing the Broad Impact of Science and Science Funding

Open access
Wang, Yifang, Qian, Yifan, Qi, Xiaoyu, Yin, Yian, Dang, Shengqi, Qian, Ziqing, Jones, Benjamin F., Cao, Nan +1 more·2025·arXiv
DOI 10.48550/arxiv.2509.16323arXiv 2509.16323
Open this paper in CoChat — free accountOpen PDF

Abstract

Understanding the broad impact of science and science funding is critical to ensuring that science investments and policies align with societal needs. Existing research links science funding to the output of scientific publications but largely leaves out the downstream uses of science and the myriad ways in which investing in science may impact human society. As funders seek to allocate scarce funding resources across a complex research landscape, there is an urgent need for informative and transparent tools that allow for comprehensive assessments and visualization of the impact of funding. Here we present Funding the Frontier (FtF), a visual analysis system for researchers, funders, policymakers, university leaders, and the broad public to analyze multidimensional impacts of funding and make informed decisions regarding research investments and opportunities. The system is built on a massive data collection that connects 7M research grants to 140M scientific publications, 160M patents, 10.9M policy documents, 800K clinical trials, and 5.8M newsfeeds, with 1.8B citation linkages among these entities, systematically linking science funding to its downstream impacts. As such, Funding the Frontier is distinguished by its multifaceted impact analysis framework. The system incorporates diverse impact metrics and predictive models that forecast future investment opportunities into an array of coordinated views, allowing for easy exploration of funding and its outcomes. We evaluate the effectiveness and usability of the system using case studies and expert interviews. Feedback suggests that our system not only fulfills the primary analysis needs of its target users, but the rich datasets of the complex science ecosystem and the proposed analysis framework also open new avenues for both visualization and the science of science research.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2509.16323

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The federal funding process plays a central role in shaping the direction, diversity, and long-run impact of the US scientific enterprise and the global research landscape.

    “Thus, the federal funding process plays a central role in shaping the direction, diversity, and long-run impact of the US scientific enterprise and—given America’s scientific leadership—the global research landscape as well (3–10).”

    From The rise of large language models and the direction and impact of US federal research funding (2026) · cites this paper as [10]

    The Introduction (p. 2) links science funding to scientific and societal impact, and the Discussion (p. 19) says funding models can shape the trajectory of science and innovation. The paper discusses federal funding portfolios and global comparisons, but it does not establish that the US federal funding process shapes the diversity of US science or, through US scientific leadership, the global research landscape. (LLM, conf=0.83)

    Experimental — accuracy not yet measured

  • Decisions about allocation of taxpayer dollars influence which scientific ideas receive support, which fields advance, and which investigators are able to initiate and sustain research programs.

    “Through competitive grant programs at agencies such as the NSF and the NIH, decisions about the allocation of taxpayer dollars influence which scientific ideas receive support, which fields advance, and which investigators are able to initiate and sustain research programs (3–10).”

    From The rise of large language models and the direction and impact of US federal research funding (2026) · cites this paper as [10]

    The funding-agency discussion (p. 16) describes investment decisions as choices about ideas or people, and the scientific-investment section (p. 9) discusses selecting topics and principal investigators for future grants. These passages support the claim that funding decisions affect which ideas and investigators receive support. The paper does not establish the more specific claims that those decisions determine which fields advance or which investigators can initiate and sustain research programs. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 61

  1. [1][1] Williams, R. S., Lotia, S., Holloway, A. K. & Pico, A. R. From scientific discovery to cures: Bright stars within a galaxy. Cell 163 , 21-23 (2015). URL https://doi.org/10.1016/j.cell.2015. 09.007 . 2, 3 - · DOI
  2. [2][2] Wang, X., Zhang, S., Liu, Y., Du, J. & Huang, H. How pharmaceutical innovation evolves: The path from science to technological development to marketable drugs. Technological Forecasting and Social Change 167 , 120698 (2021). URL https://doi.org/10.1016/j.techfore.2021.120698 . 2, 3 - · DOI
  3. [3][3] Thelwall, M. & Kousha, K. Are citations from clinical trials evidence of higher impact research? An analysis of ClinicalTrials.gov. Scientometrics 109 , 1341-1351 (2016). URL https://doi.org/10. 1007/s11192-016-2112-1 . 2, 3 -
  4. [4][4] Ahmadpoor, M. & Jones, B. F. The dual frontier: Patented inventions and prior scientific advance. Science 357 , 583-587 (2017). URL https://doi.org/10.1126/science.aam9527 . 2, 3 - · DOI
  5. [6][6] Council, N. R. et al. Using science as evidence in public policy (National Academies Press, 2012). URL https://doi.org/10.17226/13460 . 2, 3 - · DOI
  6. [8][8] Bush, V. Science, the endless frontier (Princeton University Press, 2020). URL https://doi.org/ 10.1515/9780691201658 . 2 - · DOI
  7. [9][9] Azoulay, P., Graff Zivin, J. S. & Manso, G. Incentives and creativity: evidence from the academic life sciences. The RAND Journal of Economics 42 , 527-554 (2011). URL https://doi.org/10. 1111/j.1756-2171.2011.00140.x . 2, 3 -
  8. [10][10] Yin, Y., Dong, Y., Wang, K., Wang, D. & Jones, B. F. Public use and public funding of science. Nature Human Behaviour 6 , 1344-1350 (2022). URL https://doi.org/10.1038/ s41562-022-01397-5 . 2, 3, 4, 9 -
  9. [11][11] Jones, B. F. Science and innovation: The under-fueled engine of prosperity. Rebuilding the PostPandemic Economy, ed. Melissa S. Kearney and Amy Ganz (Washington DC: Aspen Institute Press, 2021) (2021). 2 -
  10. [13][13] Price, D. J. D. S. Little science, big science (Columbia University Press, 1963). URL https: //doi.org/10.7312/pric91844 . 2 - · DOI
  11. [14][14] Fortunato, S. et al. Science of science. Science 359 , eaao0185 (2018). URL https://doi.org/10. 1126/science.aao0185 . 2 -
  12. [15][15] Wang, D. & Barabási, A.-L. The science of science (Cambridge University Press, 2021). URL https://doi.org/10.1017/9781108610834 . 2 - · DOI
  13. [17][17] Molnar, A., McKenna, A. F., Liu, Q., Vorvoreanu, M. & Madhavan, K. Using visualization to derive insights from research funding portfolios. IEEE Computer Graphics and Applications 35 , 91-c3 (2015). URL https://doi.org/10.1109/MCG.2015.68 . 2, 5 - · DOI
  14. [18][18] Dou, W., Yu, L., Wang, X., Ma, Z. & Ribarsky, W. HierarchicalTopics: Visually exploring large text collections using topic hierarchies. IEEE Transactions on Visualization and Computer Graphics 19 , 2002-2011 (2013). URL https://doi.org/10.1109/TVCG.2013.162 . 2, 5 - · DOI
  15. [26][26] Forscher, P. S., Cox, W. T., Brauer, M. & Devine, P. G. Little race or gender bias in an experiment of initial review of NIH R01 grant proposals. Nature Human Behaviour 3 , 257-264 (2019). URL https://doi.org/10.1038/s41562-018-0517-y . 3 - · DOI
  16. [27][27] Ginther, D. K. et al. Race, ethnicity, and NIH research awards. Science 333 , 1015-1019 (2011). URL https://doi.org/10.1126/science.1196783 . 3 - · DOI
  17. [28][28] Li, D. & Agha, L. Big names or big ideas: Do peer-review panels select the best science proposals? Science 348 , 434-438 (2015). URL https://doi.org/10.1126/science.aaa0185 . 3 - · DOI · Paper page
  18. [29][29] Wang, J. & Shapira, P. Funding acknowledgement analysis: an enhanced tool to investigate research sponsorship impacts: the case of nanotechnology. Scientometrics 87 , 563-586 (2011). URL https: //doi.org/10.1007/s11192-011-0362-5 . 3 - · DOI
  19. [30][30] Miao, L., Larivière, V., Wang, F., Ahn, Y.-Y. & Sugimoto, C. R. Cooperation and interdependence in global science funding. arXiv preprint arXiv:2308.08630 (2023). URL https://doi.org/10. 48550/arXiv.2308.08630 . 3 - · arXiv
  20. [32][32] Wang, Y., Jones, B. F. & Wang, D. Early-career setback and future career impact. Nature communications 10 , 4331 (2019). URL https://doi.org/10.1038/s41467-019-12189-3 . 3 - · DOI
  21. [33][33] Bol, T., De Vaan, M. & van de Rijt, A. The Matthew effect in science funding. Proceedings of the National Academy of Sciences 115 , 4887-4890 (2018). URL https://doi.org/10.1073/pnas. 1719557115 . 3 - · DOI
  22. [34][34] Li, D., Azoulay, P. & Sampat, B. N. The applied value of public investments in biomedical research. Science 356 , 78-81 (2017). URL https://doi.org/10.1126/science.aal0010 . 4, 9 - · DOI · Paper page
  23. [35][35] Dörk, M., Riche, N. H., Ramos, G. & Dumais, S. PivotPaths: Strolling through faceted information spaces. IEEE Transactions on Visualization and Computer Graphics 18 , 2709-2718 (2012). URL https://doi.org/10.1109/TVCG.2012.252 . 4 - · DOI
  24. [36][36] Ye, Y., Huang, R. & Zeng, W. VISAtlas: An image-based exploration and query system for large visualization collections via neural image embedding. IEEE Transactions on Visualization and Computer Graphics 1-15 (2022). URL https://doi.org/10.1109/TVCG.2022.3229023 . 4 - · DOI
  25. [37][37] Wang, Y. et al. Seek for success: A visualization approach for understanding the dynamics of academic careers. IEEE Transactions on Visualization and Computer Graphics 28 , 475-485 (2022). URL https://doi.org/10.1109/TVCG.2021.3114790 . 4 - · DOI
  26. [38][38] Yan, X. & Ma, Y. Turing Galaxy: Visualizing turing award laureates. In IEEE VIS 2021 Posters (IEEE, 2021). 4 -
  27. [39][39] Nobre, C., Streit, M. & Lex, A. Juniper: A Tree+ Table approach to multivariate graph visualization. IEEE Transactions on Visualization and Computer Graphics 25 , 544-554 (2019). URL https: //doi.org/10.1109/TVCG.2018.2865149 . 4 - · DOI
  28. [40][40] Li, Z., Zhang, C., Jia, S. & Zhang, J. Galex: Exploring the evolution and intersection of disciplines. IEEE Transactions on Visualization and Computer Graphics 26 , 1182-1192 (2020). URL https: //doi.org/10.1109/TVCG.2019.2934667 . 4 - · DOI
  29. [41][41] Dong, A., Zeng, W., Chen, X. & Cheng, Z. VIStory: Interactive storyboard for exploring visual information in scientific publications. In Proceedings of the 12th International Symposium on Visual Information Communication and Interaction (2019). URL https://doi.org/10.1145/3356422. 3356430 . 4 - · DOI
  30. [42][42] Guo, Z., Tao, J., Chen, S., Chawla, N. & Wang, C. SD 2 : Slicing and dicing scholarly data for interactive evaluation of academic performance. IEEE Transactions on Visualization and Computer Graphics 29 , 3569-3585 (2023). URL https://doi.org/10.1109/TVCG.2022.3163727 . 4 - · DOI
  31. [43][43] Narechania, A., Karduni, A., Wesslen, R. & Wall, E. VITALITY: Promoting serendipitous discovery of academic literature with transformers & visual analytics. IEEE Transactions on Visualization and Computer Graphics 28 , 486-496 (2022). URL https://doi.org/10.1109/TVCG.2021.3114820 . 4 - · DOI
  32. [44][44] Chen, J. et al. VIS30K: A collection of figures and tables from IEEE Visualization conference publications. IEEE Transactions on Visualization and Computer Graphics 27 , 3826-3833 (2021). URL https://doi.org/10.1109/TVCG.2021.3054916 . 4 - · DOI
  33. [45][45] Deng, D. et al. VisImages: A Fine-Grained Expert-Annotated visualization dataset. IEEE Transactions on Visualization & Computer Graphics 1 , 1-1 (2023). URL https://doi.org/10.1109/TVCG. 2022.3155440 . 4 - · DOI
  34. [46][46] Isenberg, P. et al. Vispubdata.org: A metadata collection about IEEE Visualization (VIS) publications. IEEE Transactions on Visualization and Computer Graphics 23 , 2199-2206 (2017). URL https: //doi.org/10.1109/TVCG.2016.2615308 . 4 - · DOI
  35. [47][47] Cao, H., Lu, Y., Deng, Y., McFarland, D. A. & Bernstein, M. S. Breaking out of the ivory tower: A large-scale analysis of patent citations to HCI research. In Proceedings of the CHI Conference on Human Factors in Computing Systems (2023). URL https://doi.org/10.1145/3544548. 3581108 . 4 - · DOI · Paper page
  36. [48][48] Madhavan, K. et al. DIA2: Web-based cyberinfrastructure for visual analysis of funding portfolios. IEEE Transactions on Visualization and Computer Graphics 20 , 1823-1832 (2014). URL https: //doi.org/10.1109/TVCG.2014.2346747 . 4 - · DOI
  37. [49][49] Liu, S., Cao, N., Lv, H. & Su, H. The visual funding navigator: Analysis of the NSF funding information. In Proceedings of the 15th ACM International Conference on Information and Knowledge Management , 882-883 (2006). URL https://doi.org/10.1145/1183614.1183778 . 4 - · DOI
  38. [50][50] Liu, S., Cao, N. & Lv, H. Interactive visual analysis of the NSF funding information. In IEEE Pacific Visualization Symposium , 183-190 (IEEE, 2008). URL https://doi.org/10.1109/PACIFICVIS. 2008.4475475 . 4 - · DOI
  39. [51][51] Kwon, K., Majeti, D., Brian, U. & Pavlidis, I. Scholar Plot: Visualizing scientific careers at a glance. In Proceedings of the 2nd Annual International Conference on Computational Social Science (2016). URL https://doi.org/ . 4 -
  40. [53][53] Oppermann, L. et al. Finding and analysing energy research funding data: The EnArgus system. Energy and AI 5 , 100070 (2021). URL https://doi.org/10.1016/j.egyai.2021.100070 . 5 - · DOI
  41. [55][55] Hesselberth, J. et al. nihexporter: an R package for NIH funding data. bioRxiv 033456 (2015). URL https://doi.org/10.1101/033456 . 5 - · DOI
  42. [57][57] Ghani, S., Elmqvist, N. & Ebert, D. S. MultiNode-Explorer: A visual analytics framework for generating web-based multimodal graph visualizations. In EuroVA: International Workshop on Visual Analytics (2012). URL https://doi.org/10.2312/PE/EuroVAST/EuroVA12/067-071 . 5 - · DOI
  43. [58][58] Ghani, S., Kwon, B. C., Lee, S., Yi, J. S. & Elmqvist, N. Visual analytics for multimodal social network analysis: A design study with social scientists. IEEE Transactions on Visualization and Computer Graphics 19 , 2032-2041 (2013). URL https://doi.org/10.1109/TVCG.2013.223 . 5 - · DOI
  44. [59][59] Dou, W., Wang, X., Chang, R. & Ribarsky, W. ParallelTopics: A probabilistic approach to exploring document collections. In 2011 IEEE Conference on Visual Analytics Science and Technology (VAST) , 231-240 (IEEE, 2011). URL https://doi.org/10.1109/VAST.2011.6102461 . 5 - · DOI
  45. [60][60] Gilbert, J. E., Burnett, M., Ladner, R. E., Rosson, M. B. & Davis, J. Applying the NSF broader impacts criteria to HCI research. In CHI'11 Extended Abstracts on Human Factors in Computing Systems , 459-462 (Association for Computing Machinery, 2011). URL https://doi.org/10. 1145/1979742.1979534 . 5 -
  46. [61][61] Lazar, J. et al. Workshop on engaging the human-computer interaction community with public policymaking internationally. In CHI'13 Extended Abstracts on Human Factors in Computing Systems , 3279-3282 (Association for Computing Machinery, 2013). URL https://doi.org/10. 1145/2468356.2479666 . 5 -
  47. [62][62] Shi, C. et al. MedChemLens: An interactive visual tool to support direction selection in interdisciplinary experimental research of medicinal chemistry. IEEE Transactions on Visualization and Computer Graphics 29 , 63-73 (2023). URL https://doi.org/ . 5 -
  48. [63][63] Wang, Y., Qian, Y., Qi, X., Cao, N. & Wang, D. InnovationInsights: A visual analytics approach for understanding the dual frontiers of science and technology. IEEE Transactions on Visualization and Computer Graphics 30 , 518-528 (2024). URL https://doi.org/10.1109/TVCG.2023.3327387 . 5 - · DOI
  49. [64][64] Nobre, C., Meyer, M., Streit, M. & Lex, A. The state of the art in visualizing multivariate networks. In Computer Graphics Forum , vol. 38, 807-832 (2019). URL https://doi.org/10.1111/cgf. 13728 . 5 - · DOI
  50. [65][65] Vehlow, C., Beck, F. & Weiskopf, D. The state of the art in visualizing group structures in graphs. EuroVis (STARs) 21-40 (2015). URL https://doi.org/10.2312/eurovisstar.20151110 . 5 - · DOI
  51. [66][66] Beck, F., Burch, M., Diehl, S. & Weiskopf, D. A taxonomy and survey of dynamic graph visualization. In Computer Graphics Forum , vol. 36, 133-159 (2017). URL https://doi.org/10.1111/cgf. 12791 . 5 - · DOI
  52. [67][67] McGee, F., Ghoniem, M., Melançon, G., Otjacques, B. & Pinaud, B. The state of the art in multilayer network visualization. In Computer Graphics Forum , vol. 38, 125-149 (2019). URL https: //doi.org/10.1111/cgf.13610 . 5 - · DOI
  53. [68][68] Shi, L. et al. OnionGraph: Hierarchical topology+ attribute multivariate network visualization. Visual Informatics 4 , 43-57 (2020). URL https://doi.org/10.1016/j.visinf.2020.01.002 . 5 - · DOI
  54. [69][69] Holten, D. Hierarchical edge bundles: Visualization of adjacency relations in hierarchical data. IEEE Transactions on Visualization and Computer Graphics 12 , 741-748 (2006). URL https: //doi.org/10.1109/TVCG.2006.147 . 5 - · DOI
  55. [70][70] Sedlmair, M., Meyer, M. & Munzner, T. Design study methodology: Reflections from the trenches and the stacks. IEEE Transactions on Visualization and Computer Graphics 18 , 2431-2440 (2012). URL https://doi.org/10.1109/TVCG.2012.213 . 6 - · DOI
  56. [72][72] Wu, L., Wang, D. & Evans, J. A. Large teams develop and small teams disrupt science and technology. Nature 566 , 378-382 (2019). URL https://doi.org/10.1038/s41586-019-0941-9 . 8 - · DOI
  57. [73][73] Sinatra, R., Wang, D., Deville, P., Song, C. & Barabási, A.-L. Quantifying the evolution of individual scientific impact. Science 354 , aaf5239 (2016). URL https://doi.org/10.1126/science. aaf5239 . 9 - · DOI · Paper page
  58. [74][74] Beltagy, I., Lo, K. & Cohan, A. SciBERT: Pretrained language model for scientific text. In EMNLP (2019). URL https://doi.org/10.48550/arXiv.1903.10676 . arXiv:1903.10676 . 10 - · DOI · Paper page
  59. [75][75] Chen, T. & Guestrin, C. XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , 785-794 (2016). URL https://doi.org/10.1145/2939672.2939785 . 10, 15 - · DOI · Paper page
  60. [78][78] Görtler, J., Schulz, C., Weiskopf, D. & Deussen, O. Bubble treemaps for uncertainty visualization. IEEE transactions on visualization and computer graphics 24 , 719-728 (2017). 12 -
  61. [79][79] Park, M., Maity, S. K., Wuchty, S. & Wang, D. Interdisciplinary papers supported by disciplinary grants garner deep and broad scientific impact. arXiv preprint arXiv:2303.14732 (2023). URL https://doi.org/10.48550/arXiv.2303.14732 . 17 · DOI

Cited by

Sorted by citations

Authors
Wang, Y., Qian, Y., Qi, X., Yin, Y., Dang, S., Qian, Z., Jones, B. F., Cao, N., & Wang, D.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2025
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2509.16323
arXiv
2509.16323
OpenAlex
W4415250705
Cited by
0
References
1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
  • Social Sciences › Decision Sciences › Information Systems and Management › Research, Science, and Academia
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Data Visualization and Analytics
Keywords
research funding, research impact assessment, visual analytics, research grants, scientific publications, patents, clinical trials, policy documents, news media, impact indicators, science of science, research funding allocation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review