PreprintCited by 28Artificial Intelligence ApplicationsEthics and Social Impacts of AIArtificial Intelligence in Education

Scientists' Perspectives on the Potential for Generative AI in their Fields

Open access
Morris, Meredith Ringel·2023·arXiv

Abstract

Generative AI models, including large language models and multimodal models that include text and other media, are on the cusp of transforming many aspects of modern life, including entertainment, education, civic life, the arts, and a range of professions. There is potential for Generative AI to have a substantive impact on the methods and pace of discovery for a range of scientific disciplines. We interviewed twenty scientists from a range of fields (including the physical, life, and social sciences) to gain insight into whether or how Generative AI technologies might add value to the practice of their respective disciplines, including not only ways in which AI might accelerate scientific discovery (i.e., research), but also other aspects of their profession, including the education of future scholars and the communication of scientific findings. In addition to identifying opportunities for Generative AI to augment scientists' current practices, we also asked participants to reflect on concerns about AI. These findings can help guide the responsible development of models and interfaces for scientific education, inquiry, and communication.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2304.01420

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The identified uses of ChatGPT by students with disabilities are fairly similar to the ones for the general student population.

    “While the identified uses are fairly similar to the ones for the general student population (Chan & Hu, 2023;Jahic et al., 2023;Morris, 2023)”

    From Exploring the role of generative AI in higher education: Semi-structured interviews with students with disabilities (2025) · cites this paper as Morris, 2023

    Section 4.1.1 (page unavailable) describes potential uses of language models for students, including homework feedback, tutoring, answering questions, and writing assistance. It does not examine students with disabilities or compare their identified uses with those of other students; its examples are largely proposed uses rather than observed ChatGPT use. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • The concerns and challenges identified by students with disabilities reflected those identified in the literature for the general population.

    “The concerns and challenges identified by students with disabilities reflected those identified in the literature for the general population (Chan & Hu, 2023;Jahic et al., 2023;Morris, 2023).”

    From Exploring the role of generative AI in higher education: Semi-structured interviews with students with disabilities (2025) · cites this paper as Morris, 2023

    Section 4.1.2 (page unavailable) reports concerns about cheating, factual errors, bias, and loss of critical reflection in students’ use of generative AI. This supports the citation as an example of concerns found in the literature, but Morris reports scientists’ perspectives rather than findings about the general population. The comparison with students with disabilities is the citing authors’ own conclusion. (LLM, conf=0.78)

    Experimental — accuracy not yet measured
  • University teachers have recognized the potential of ChatGPT to facilitate the writing process and reduce the inequalities for students whose native language is not English.

    “University teachers have recognized the potential of ChatGPT to facilitate the writing process and reduce the inequalities for students whose native language is not English (Morris, 2023).”
  • ChatGPT can let students self-test their knowledge.

    “ChatGPT can also let students self-test their knowledge (Morris, 2023), which is a manner to engage with learning.”
  • Conversational agents such as ChatGPT can explain or simplify course content or give feedback to students who learn better through dialogue or through repetitive learning.

    “Conversational agents such as ChatGPT can explain or simplify course content or give feedback (Morris, 2023) to students who learn better through dialogue (Singh, 2023) or through repetitive learning (McMurtrie, 2023).”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

No citation lists for this paper

No citation lists for this paper yet — checked again daily.

Cited by 28

Research works printed but not linked: 53

  1. Andrea Agostinelli et al. MusicLM: Generating Music From Text. 2023. arXiv: 2301.11325 [cs.SD]. · arXiv
  2. Gati Aher, Rosa I. Arriaga, and Adam Tauman Kalai. Using Large Language Mod- els to Simulate Multiple Humans and Replicate Human Subject Studies. 2023. arXiv: 2208.10264 [cs.CL]. · arXiv
  3. Emily M. Bender et al. "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?" In: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. FAccT '21. Virtual Event, Canada: Association for Computing Machin- ery, 2021, pp. 610-623. ISBN: 9781450383097. DOI: 10.1145/3442188.3445922. URL: https://doi.org/10.1145/3442188.3445922. · DOI · Paper page
  4. Michael S. Bernstein et al. "Soylent: A Word Processor with a Crowd Inside". In: Pro- ceedings of the 23nd Annual ACM Symposium on User Interface Software and Tech- nology. UIST '10. New York, New York, USA: Association for Computing Machin- ery, 2010, pp. 313-322. ISBN: 9781450302715. DOI: 10.1145/1866029.1866078. URL: https://doi.org/10.1145/1866029.1866078. · DOI
  5. Christian Bird et al. "Taking Flight with Copilot: Early Insights and Opportunities of AI- Powered Pair-Programming Tools". In: Queue 20.6 (Jan. 2023), pp. 35-57. ISSN: 1542-7730. DOI: 10.1145/3582083. URL: https://doi.org/10.1145/3582083. · DOI · Paper page
  6. Rishi Bommasani et al. "On the Opportunities and Risks of Founda- tion Models". In: CoRR abs/2108.07258 (2021). arXiv: 2108.07258. URL: https://arxiv.org/abs/2108.07258. · arXiv
  7. Zalán Borsos et al. AudioLM: a Language Modeling Approach to Audio Generation. 2022. arXiv: 2209.03143 [cs.SD]. · arXiv
  8. Tom B. Brown et al. "Language Models are Few-Shot Learners". In: CoRR abs/2005.14165 (2020). arXiv: 2005.14165. URL: https://arxiv.org/abs/2005.14165. · arXiv
  9. Sébastien Bubeck et al. Sparks of Artificial General Intelligence: Early experiments with GPT-4. 2023. arXiv: 2303.12712 [cs.CL]. · arXiv
  10. Carrie J Cai et al. "Onboarding Materials as Cross-Functional Boundary Objects for De- veloping AI Assistants". In: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. CHI EA '21. Yokohama, Japan: Association for Com- puting Machinery, 2021. ISBN: 9781450380959. DOI: 10.1145/3411763.3443435. URL: https://doi.org/10.1145/3411763.3443435. · DOI
  11. Minsuk Chang et al. The Prompt Artists. 2023. arXiv: 2303.12253 [cs.HC]. · arXiv
  12. Kathy Charmaz. Constructing Grounded Theory: A Practical Guide through Qualitative Anal- ysis (Second Edition). Sage Publications, Ltd., 2014.
  13. Mark Chen et al. Evaluating Large Language Models Trained on Code. 2021. arXiv: 2107.03374 [cs.LG]. · arXiv
  14. Aakanksha Chowdhery et al. PaLM: Scaling Language Modeling with Pathways. 2022. arXiv: 2204.02311 [cs.CL]. · arXiv
  15. Alex Davies et al. "Advancing mathematics by guiding human intuition with AI". In: Nature 600.7887 (Dec. 2021), pp. 70-74. ISSN: 1476-4687. DOI: 10.1038/s41586-021-04086-x. URL: https://doi.org/10.1038/s41586-021-04086-x. · DOI
  16. Jonas Degrave et al. "Magnetic control of tokamak plasmas through deep reinforcement learning". In: Nature 602.7897 (Feb. 2022), pp. 414- 419. ISSN: 1476-4687. DOI: 10.1038/s41586-021-04301-9. URL: https://doi.org/10.1038/s41586-021-04301-9. · DOI · Paper page
  17. Victor Dibia et al. Aligning Offline Metrics and Human Judgments of Value of AI-Pair Pro- grammers. 2022. arXiv: 2210.16494 [cs.SE]. · arXiv
  18. Nouha Dziri et al. On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models? 2022. arXiv: 2204.07931 [cs.CL]. · arXiv
  19. Sean Ekins et al. "Exploiting machine learning for end-to-end drug discovery and development". In: Nature Materials 18.5 (May 2019), pp. 435-441. ISSN: 1476-4660. DOI: 10.1038/s41563-019-0338-z. URL: https://doi.org/10.1038/s41563-019-0338-z. · DOI · Paper page
  20. Lasse Espeholt et al. "Deep learning for twelve hour precipi- tation forecasts". In: Nature Communications 13.1 (Sept. 2022), p. 5145. ISSN: 2041-1723. DOI: 10.1038/s41467-022-32483-x. URL: https://doi.org/10.1038/s41467-022-32483-x. · DOI
  21. Alhussein Fawzi et al. "Discovering faster matrix multiplication algo- rithms with reinforcement learning". In: Nature 610.7930 (Oct. 2022), pp. 47-53. ISSN: 1476-4687. DOI: 10.1038/s41586-022-05172-4. URL: https://doi.org/10.1038/s41586-022-05172-4. · DOI · Paper page
  22. Jeremy Ginsberg et al. "Detecting influenza epidemics using search engine query data". In: Nature 457.7232 (Feb. 2009), pp. 1012-1014. ISSN: 1476-4687. DOI: 10.1038/nature07634. URL: https://doi.org/10.1038/nature07634. · DOI · Paper page
  23. Samuel Goldman et al. "Annotating metabolite mass spectra with domain-inspired chemical formula transformers". In: bioRxiv (2022). DOI: 10.1101/2022.12.30.522318. eprint: https://www.biorxiv.org/content/early/2022/12/31/2022.12.30.522318.full.pdf. URL: https://www.biorxiv.org/content/early/2022/12/31/2022.12.30.522318. · DOI
  24. Jonathan Ho et al. Imagen Video: High Definition Video Generation with Diffusion Models. 2022. arXiv: 2210.02303 [cs.CV]. · arXiv
  25. Wei-Ning Hsu et al. "Hierarchical Generative Modeling for Controllable Speech Synthesis". In: International Conference on Learning Representations. 2019. URL: https://arxiv.org/pdf/1810.07217. · arXiv
  26. Ellen Jiang et al. "Discovering the Syntax and Strategies of Natural Language Programming with Generative Language Models". In: Proceedings of the 2022 CHI Conference on Hu- man Factors in Computing Systems. CHI '22. New Orleans, LA, USA: Association for Com- puting Machinery, 2022. ISBN: 9781450391573. DOI: 10.1145/3491102.3501870. URL: https://doi.org/10.1145/3491102.3501870. · DOI · Paper page
  27. Yucheng Jin, Lanyi Yang, and Chia-En Chiang. "Identifying Exoplanets with Machine Learning Methods: A Preliminary Study". In: International Journal on Cybernetics & Informatics 11.2 (Apr. 2022), pp. 31-42. DOI: 10.5121/ijci.2022.110203. URL: https://doi.org/10.5121%2Fijci.2022.110203. · DOI
  28. John Jumper et al. "Highly accurate protein structure predic- tion with AlphaFold". In: Nature 596.7873 (Aug. 2021), pp. 583- 589. ISSN: 1476-4687. DOI: 10.1038/s41586-021-03819-2. URL: https://doi.org/10.1038/s41586-021-03819-2. · DOI · Paper page
  29. Hiroaki Kitano. "Nobel Turing Challenge: creating the engine for sci- entific discovery". In: npj Systems Biology and Applications 7.1 (June 2021), p. 29. ISSN: 2056-7189. DOI: 10.1038/s41540-021-00189-3. URL: https://doi.org/10.1038/s41540-021-00189-3. · DOI · Paper page
  30. Skanda Koppula et al. A Deep Learning Approach for Characterizing Major Galaxy Mergers. 2021. arXiv: 2102.05182 [astro-ph.GA]. · arXiv
  31. Chinmay Kulkarni et al. A Word is Worth a Thousand Pictures: Prompts as AI Design Mate- rial. 2023. arXiv: 2303.12647 [cs.HC]. · arXiv
  32. Aitor Lewkowycz et al. "Solving Quantitative Reasoning Problems with Language Models". In: NeurIPS. 2022. URL: https://arxiv.org/abs/2206.14858. · arXiv
  33. Marcelo C. R. Melo, Jacqueline R. M. A. Maasch, and Cesar de la Fuente-Nunez. "Ac- celerating antibiotic discovery through artificial intelligence". In: Communications Biology 4.1 (Sept. 2021), p. 1050. ISSN: 2399-3642. DOI: 10.1038/s42003-021-02586-0. URL: https://doi.org/10.1038/s42003-021-02586-0. · DOI · Paper page
  34. Meredith Ringel Morris et al. "The Design Space of Generative Models". In: NeurIps 2022 Human-Centered AI Workshop. 2022.
  35. Engineering National Academies of Sciences and Medicine. Automated Research Workflows for Accelerated Discovery: Closing the Knowledge Discovery Loop. Washington, DC: The National Academies Press, 2022. ISBN: 978-0-309-68652-5. DOI: 10.17226/26532. URL: https://nap.nationalacademies.org/catalog/26532/automated-research-workflows-for-accelerate · DOI
  36. Tung Nguyen et al. ClimaX: A foundation model for weather and climate. 2023. arXiv: 2301.10343 [cs.LG]. · arXiv
  37. Mohammad Sadegh Norouzzadeh et al. A deep active learning system for species identifica- tion and counting in camera trap images. 2019. arXiv: 1910.09716 [cs.LG]. · arXiv
  38. OpenAI. GPT-4 Technical Report. 2023. arXiv: 2303.08774 [cs.CL]. · arXiv
  39. Pranav Rajpurkar et al. CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning. 2017. arXiv: 1711.05225 [cs.CV]. · arXiv
  40. Aditya Ramesh et al. Hierarchical Text-Conditional Image Generation with CLIP Latents. 2022. DOI: 10.48550/ARXIV.2204.06125. URL: https://arxiv.org/abs/2204.06125. · DOI · Paper page
  41. Rajarshi Roy et al. "PrefixRL: Optimization of Parallel Prefix Circuits using Deep Rein- forcement Learning". In: 2021 58th ACM/IEEE Design Automation Conference (DAC). 2021, pp. 853-858. DOI: 10.1109/DAC18074.2021.9586094. · DOI
  42. Chitwan Saharia et al. Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding. 2022. DOI: 10.48550/ARXIV.2205.11487. URL: https://arxiv.org/abs/2205.11487. · DOI · Paper page
  43. Amir Shanehsazzadeh et al. "Unlocking de novo antibody design with generative ar- tificial intelligence". In: bioRxiv (2023). DOI: 10.1101/2023.01.08.523187. eprint: https://www.biorxiv.org/content/early/2023/01/09/2023.01.08.523187.full.pdf. URL: https://www.biorxiv.org/content/early/2023/01/09/2023.01.08.523187. · DOI
  44. David F. Steiner et al. "Evaluation of the Use of Combined Artificial In- telligence and Pathologist Assessment to Review and Grade Prostate Biop- sies". In: JAMA Network Open 3.11 (Nov. 2020), e2023267-e2023267. ISSN: 2574-3805. DOI: 10.1001/jamanetworkopen.2020.23267. eprint: https://jamanetwork.com/journals/jamanetworkopen/articlepdf/2772831/steiner\_2020\_oi\_20077 URL: https://doi.org/10.1001/jamanetworkopen.2020.23267. · DOI
  45. Minhyang (Mia) Suh et al. "AI as Social Glue: Uncovering the Roles of Deep Generative AI during Social Music Composition". In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. CHI '21. Yokohama, Japan: Association for Com- puting Machinery, 2021. ISBN: 9781450380966. DOI: 10.1145/3411764.3445219. URL: https://doi.org/10.1145/3411764.3445219. · DOI · Paper page
  46. Ross Taylor et al. Galactica: A Large Language Model for Science. 2022. arXiv: 2211.09085 [cs.CL]. · arXiv
  47. David R. Thomas. "A General Inductive Approach for Analyzing Qualitative Eval- uation Data". In: American Journal of Evaluation 27.2 (2006), pp. 237-246. DOI: 10.1177/1098214005283748. · DOI · Paper page
  48. Romal Thoppilan et al. LaMDA: Language Models for Dialog Applications. 2022. DOI: 10.48550/ARXIV.2201.08239. URL: https://arxiv.org/abs/2201.08239. · DOI · Paper page
  49. Ashish Vaswani et al. "Attention is All you Need". In: Advances in Neural Information Processing Systems. Ed. by I. Guyon et al. Vol. 30. Curran Associates, Inc., 2017. URL: https://proceedings.neurips.cc/paper_files/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-
  50. Ruben Villegas et al. Phenaki: Variable Length Video Generation From Open Domain Textual Description. 2022. arXiv: 2210.02399 [cs.CV]. · arXiv
  51. Laura Weidinger et al. "Ethical and social risks of harm from Language Models". In: CoRR abs/2112.04359 (2021). arXiv: 2112.04359. URL: https://arxiv.org/abs/2112.04359. · arXiv
  52. Jiahui Yu et al. Scaling Autoregressive Models for Content-Rich Text-to-Image Generation. 2022. arXiv: 2206.10789 [cs.CV]. · arXiv
  53. Maxim Zvyagin et al. "GenSLMs: Genome-scale language models reveal SARS-CoV-2 evolutionary dynamics". In: bioRxiv (2022). DOI: 10.1101/2022.10.10.511571. eprint: https://www.biorxiv.org/content/early/2022/10/11/2022.10.10.511571.full.pdf. URL: https://www.biorxiv.org/content/early/2022/10/11/2022.10.10.511571. · DOI · Paper page

Authors
Morris, M. R.
Affiliations
Google (United States) (US)
Corresponding author
Morris, Meredith Ringel
Venue
arXiv
Publisher
arXiv
Published
2023
ISSN
2331-8422 (ISSN-L)
OpenAlex
W4362655490
Cited by
28
References
0
Citations by year
2026: 1 · 2025: 11 · 2024: 11 · 2023: 5
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
Keywords
generative AI, large language models, multimodal models, scientists' perspectives, scientific discovery, science education, responsible AI development

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review