CoChat

Whose voice counts? The role of large language models in public commenting

Open access
Arsenault, Amelia C, Kreps, Sarah · 2026 · Big Data & Society

The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.

Abstract

The notice-and-comment period in US federal rulemaking fosters civic engagement but has long been dominated by well-resourced actors with specialized knowledge, creating an “accessibility gap.” Large language models (LLMs) may help bridge this divide by assisting citizens in understanding dense policy documents and drafting effective comments. However, these tools could also exacerbate existing disparities, as those actors already well-represented in the rulemaking process may be better positioned to use LLMs effectively. We employ two empirical tests to assess whether LLMs bridge or reinforce these disparities. First, we conducted a survey experiment where participants submitted mock comments on a policy proposal, with the treatment group using an LLM to assist their responses and the control group completing the task unaided. The LLM made comment-writing easier, as self-reported by participants across education levels, suggesting a potential to expand accessibility. However, it did not improve participants’ self-reported policy comprehension, indicating that LLMs are not a solution to knowledge gaps. Second, reviewers evaluated the quality of comments written with and without assistance. Comments written with LLM assistance consistently received higher ratings regardless of the commenter's education level. While assistance did not disproportionately benefit any particular educational group, the quality improvement may be especially meaningful for less-educated citizens, helping their submissions reach the threshold of serious consideration by policymakers. LLMs could therefore serve as an entry point for those who have traditionally been underrepresented in the rulemaking process.

Overview

Integrity signals

Registry

Crossref · 10.1177/20539517261419341

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 27 references

Research works printed but not linked: 24

  1. Balla SJ, Bull R, Dooling BCE, et al. (2022) Responding to mass, computer-generated, and malattributed comments. Administrative Law Review 74(1): 95–160.
  2. Bartels LM (2008) Unequal Democracy. Princeton, NJ, USA: Princeton University Press.
  3. Coglianese C (2006) Citizen participation in rulemaking: Past, present, and future. Duke Law Journal 55(5): 943–968.
  4. Dahl RA (1989) Democracy and Its Critics. New Haven: Yale University Press.
  5. Farina CR, Epstein D, Heidt J, et al. (2012) Knowledge in the people: Rethinking “value” in public rulemaking participation. Wake Forest Law Review 47(5): 1185–1242.
  6. Habermas J (1996) Between facts and norms: Contributions to a discourse theory of law and democracy (Rehg W, trans). In: Studies in Contemporary German Social Thought. Cambridge, MA: The MIT Press, 1–631.
  7. Hacker JS, Pierson PP (2014) Winner-Take-All Politics: How Washington Made the Rich Richer—and Turned Its Back on the Middle Class. New York: Simon & Schuster.
  8. Jacobs LR, Skocpol T (2005) Inequality and American Democracy: What We Know and What We Need to Learn. New York: Russell Sage.
  9. Johnson SM (2024) Rulemaking 3.0: Incorporating AI and ChatGPT into notice and comment rulemaking. Missouri Law Review 88(4): 1021–1076.
  10. Kim J (2011) For a good cause: Reforming the good cause exception to notice and comment rulemaking under the administrative procedure act. George Mason Law Review 18(4): 1045–1084.
  11. Mansbridge JJ (1983) Beyond Adversary Democracy. Chicago: University of Chicago Press.
  12. Mashaw JL (1997) Greed, Chaos, and Governance. New Haven, CT, USA: Yale University Press.
  13. Mendelson NA (2011) Rulemaking, democracy, and torrents of e-mail. George Washington Law Review 79(5): 1343–1380.
  14. Mendelson NA (2012) Should mass comments count? Michigan Journal of Environmental & Administrative Law 2(1): 173–184.
  15. Rochvarg A (1981) Adequacy of notice of rulemaking under the federal administrative procedure act—When should a second round of notice and comment be provided? American University Law Review 31(1): 1–24.
  16. Rossi J, Stack KM (2023) Representative rulemaking. Iowa Law Review 109(1): 1–50.
  17. Sant’Ambrogio M Staszewski G (2018) Public engagement with agency rulemaking: Final report for the administrative conference of the United States. Conference of the United States. Available at: https://www.acus.gov/sites/default/files/documents/Public%20Engagement%20in%20Rulemaking%20Final%20Report.pdf (accessed 12 December 2025).
  18. Savitz G (2021) Public comments run amok: Reforming the notice and comment process to help reduce the negative effects of mass and fake comments. Buffalo Law Review 69(3): 759.
  19. Skocpol T (2003) Diminished Democracy: From Membership to Management in American Civic Life. Norman: University of Oklahoma Press.
  20. 10.7208/chicago/9780226924564.001.0001 · doi:10.7208/chicago/9780226924564.001.0001
  21. United States Environmental Protection Agency (2015) Carbon pollution emission guidelines for existing stationary sources: Electric utility generating units. Federal Register 80(205): 64662–64964. Available at: https://www.govinfo.gov/content/pkg/FR-2015-10-23/pdf/2015-22842.pdf (accessed 12 December 2025).
  22. United States Environmental Protection Agency (2019) Emission guidelines for greenhouse gas emissions from existing electric utility generating units; revisions to emission guidelines implementing regulations. Federal Register 83(170): 44746–44813. Available at: https://www.govinfo.gov/content/pkg/FR-2018-08-31/pdf/2018-18755.pdf (accessed 12 December 2025).
  23. van Dijk JAGM (2006) Digital divide research, achievements and shortcomings. The Digital Divide in the Twenty-First Century 34(4): 221–235.
  24. Weiss M (2019) Deepfake bot submissions to federal public comment websites cannot be distinguished from human submissions. Technology Science 2019121801, 17 December. Available at: https://techscience.org/a/2019121801/ (accessed 12 December 2025).

Cited by

See all 2

Metadata

Authors
Arsenault, A. C., & Kreps, S.
Affiliations
Cornell University (US)
Corresponding author
Arsenault, Amelia C
Venue
Big Data & Society
Published
2026-02-04
Volume
13
Issue
1
ISSN
2053-9517 (ISSN-L)
OpenAlex
W7127615841
Cited by
2
References
21
Citations by year
2026: 2
FWCI
39.49
Type
journal article
Language
en
Open access
Licence
Locations
  • Big Data & Society (publishedVersion, cc-by-nc)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Political Science and International Relations › E-Government and Public Services
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Law › Artificial Intelligence in Law
Keywords
large language models, notice-and-comment rulemaking, federal rulemaking, citizen participation, accessibility gaps, educational inequality, comment quality, underrepresented voices

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Whose voice counts? The role of large language models in public commenting. https://app.cochat.ai/papers/10.1177/20539517261419341
The paper
Arsenault, A. C., & Kreps, S. (2026). Whose voice counts? The role of large language models in public commenting. Big Data & Society. https://doi.org/10.1177/20539517261419341

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.