CoChat
Sign Up
Cited by 15

The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.

Enhancing Critical Thinking in Generative AI Search with Metacognitive Prompts

Singh, Anjali, Guan, Zhitong, Rieh, Soo Young·2025·Proceedings of the Association for Information Science and Technology
DOI 10.1002/pra2.1287
Open this paper in CoChat — free account

Abstract

The growing use of Generative AI (GenAI) conversational search tools has raised concerns about their effects on people's metacognitive engagement, critical thinking, and learning. As people increasingly rely on GenAI to perform tasks such as analyzing and applying information, they may become less actively engaged in thinking and learning. This study examines whether metacognitive prompts—designed to encourage people to pause, reflect, assess their understanding, and consider multiple perspectives—can support critical thinking during GenAI‐based search. We conducted a user study ( N = 40) with university students to investigate the impact of metacognitive prompts on their thought processes and search behaviors while searching with a GenAI tool. We found that these prompts led to more active engagement, leading students to explore a broader range of topics and engage in deeper inquiry through follow‐up queries. Students reported that the prompts were especially helpful for considering overlooked perspectives, promoting evaluation of AI responses, and identifying key takeaways. Additionally, the effectiveness of these prompts was influenced by students' metacognitive flexibility. Our findings highlight the potential of metacognitive prompts to foster critical thinking and provide insights for designing and implementing metacognitive support in human‐AI interactions.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/pra2.1287

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 7 references

Research works printed but not linked: 51

  1. Alberto P., 2013, Applied behavior analysis for teachers
  2. 10.1109/MIUCC62295.2024.10783559 · DOI
  3. 10.1145/2729094.2742607 · DOI
  4. 10.1007/978-1-4419-5546-3_12 · DOI
  5. 10.1037/0278-7393.21.1.205 · DOI
  6. Beyer B. K., 1984, Improving thinking skills‐‐defining the problem, Phi Delta Kappan, 65, 486
  7. 10.1080/14639220512331311599 · DOI
  8. 10.1145/2854946.2854972 · DOI
  9. 10.1037/10903-000 · DOI
  10. 10.1027/1016-9040.13.4.277 · DOI
  11. 10.1007/s10791-017-9315-9 · DOI
  12. 10.1145/1978942.1979116 · DOI
  13. 10.1111/bjet.13544 · DOI · Paper page
  14. 10.3390/soc15010006 · DOI · Paper page
  15. 10.1111/jcal.12650 · DOI · Paper page
  16. 10.4324/9781315885278 · DOI
  17. 10.1177/0165551515614473 · DOI
  18. 10.14742/ajet.971 · DOI
  19. 10.1016/j.ipm.2009.05.004 · DOI · Paper page
  20. 10.1145/1242572.1242768 · DOI
  21. 10.1126/science.adi0248 · DOI · Paper page
  22. 10.1007/s11409-010-9060-6 · DOI · Paper page
  23. 10.1016/j.acalib.2016.04.001 · DOI
  24. 10.1007/BF02504926 · DOI
  25. 10.1007/BF02299633 · DOI
  26. 10.1002/(SICI)1098-2736(199909)36:7<837::AID-TEA6>3.0.CO;2-U · DOI
  27. 10.1007/s11409-010-9054-4 · DOI
  28. 10.1111/j.1467-8535.2008.00906.x · DOI
  29. 10.1145/169059.169215 · DOI
  30. Mayer R. E., 1990, The critical thinker: Thinking and learning strategies for psychology students
  31. Nelson T. O., 1990, Psychology of learning and motivation, 125
  32. 10.1016/j.procs.2023.10.299 · DOI
  33. Oppenlaender J., 2024, Prompting AI art: An investigation into the creative skill of prompt engineering, International Journal of Human‐Computer Interaction, 1
  34. 10.1177/0956797616645672 · DOI
  35. 10.1002/meet.2014.14505101021 · DOI
  36. 10.1177/0165551515615841 · DOI
  37. 10.1145/3406522.3446025 · DOI
  38. 10.1006/ceps.1994.1033 · DOI · Paper page
  39. 10.1145/3649468 · DOI
  40. Sharma N., 2024, Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, 1
  41. Singh A., 2025, Tools for Thought Workshop at the 2025 CHI Conference on Human Factors in Computing Systems
  42. Solaiman I. Talat Z. Agnew W. Ahmad L. Baker D. Blodgett S. L. Chen C. Clark K. Curry A. Ecoffet A. Elkins K. Evans O. Ganguli D. Gerigk L. Hernandez D. Hilton J. Hume T. Jackson S. Jain N. …Wu S.(2023).Evaluating the social impact of generative AI systems in systems and society. arXiv preprint arXiv:2306.05949. · arXiv
  43. 10.1007/s11412-007-9015-3 · DOI
  44. 10.1016/j.chb.2007.01.023 · DOI
  45. 10.1561/1500000084 · DOI
  46. Venkit P. N. Laban P. Zhou Y. Mao Y. &Wu C.‐S.2024.Search engines in an AI era: The false promise of factual and verifiable source‐cited responses. arXiv preprint arXiv:2410.22349. · arXiv
  47. Weir J. P., 2005, Quantifying test‐retest reliability using the intraclass correlation coefficient and the SEM, The Journal of Strength and Conditioning Research, 19, 231
  48. Winne P. H., 2018, Handbook of self‐regulation of learning and performance, 36
  49. 10.1561/1500000081 · DOI
  50. 10.1007/s11423-019-09646-7 · DOI
  51. Zhou T., 2024, Understanding user switch of information seeking: From search engines to generative AI, Journal of Librarianship and Information Science, 1

Cited by

Sorted by citations

See all 15

Metadata

Authors
Singh, A., Guan, Z., & Rieh, S. Y.
Affiliations
The University of Texas at Austin USA
Venue
Proceedings of the Association for Information Science and Technology
Publisher
Wiley
Published
2025-10
Volume
62
Issue
1
Pages
672-684
ISSN
2373-9231
DOI
10.1002/pra2.1287
Cited by
15
References
7
Language
en
Licence
onlinelibrary.wiley.com/termsAndConditions#vor (vor, 15 d)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Enhancing Critical Thinking in Generative AI Search with Metacognitive Prompts. https://app.cochat.ai/papers/10.1002/pra2.1287
The paper
Singh, A., Guan, Z., & Rieh, S. Y. (2025). Enhancing Critical Thinking in Generative AI Search with Metacognitive Prompts. Proceedings of the Association for Information Science and Technology. https://doi.org/10.1002/pra2.1287