Whose voice counts? The role of large language models in public commenting
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
The notice-and-comment period in US federal rulemaking fosters civic engagement but has long been dominated by well-resourced actors with specialized knowledge, creating an “accessibility gap.” Large language models (LLMs) may help bridge this divide by assisting citizens in understanding dense policy documents and drafting effective comments. However, these tools could also exacerbate existing disparities, as those actors already well-represented in the rulemaking process may be better positioned to use LLMs effectively. We employ two empirical tests to assess whether LLMs bridge or reinforce these disparities. First, we conducted a survey experiment where participants submitted mock comments on a policy proposal, with the treatment group using an LLM to assist their responses and the control group completing the task unaided. The LLM made comment-writing easier, as self-reported by participants across education levels, suggesting a potential to expand accessibility. However, it did not improve participants’ self-reported policy comprehension, indicating that LLMs are not a solution to knowledge gaps. Second, reviewers evaluated the quality of comments written with and without assistance. Comments written with LLM assistance consistently received higher ratings regardless of the commenter's education level. While assistance did not disproportionately benefit any particular educational group, the quality improvement may be especially meaningful for less-educated citizens, helping their submissions reach the threshold of serious consideration by policymakers. LLMs could therefore serve as an entry point for those who have traditionally been underrepresented in the rulemaking process.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
De Tocqueville, A. (2010) · The Two Narratives of Political Economy · doi:10.1002/9781118011690.ch12 · Cited by 6,286
Digital Divide: Civic Engagement, Information Poverty, and the Internet Worldwide
Norris, P. (2001) · doi:10.1017/cbo9781139164887 · Cited by 2,921
Varieties of Participation in Complex Governance
Fung, A. (2006) · Public Administration Review · doi:10.1111/j.1540-6210.2006.00667.x · Cited by 2,464 · cited 2×
“…perspective, these inequalities raise concerns about civic inclusion and legitimacy: if only some citizens can effectively use available channels to make their voices heard, the representative character of legislative processes may be diminished (Dahl, 1989; Fung, 2006; Mansbridge, 1983).”
Administrative Procedures as Instruments of Political Control
(1987) · The Journal of Law, Economics, and Organization · doi:10.1093/oxfordjournals.jleo.a036930 · Cited by 2,224
Why Johnny Can’t Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts
Zamfirescu-Pereira, J. D., Wong, R. Y., Hartmann, B., & Yang, Q. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581388 · Cited by 1,274
Civic engagement in American democracy
(2000) · Choice Reviews Online · doi:10.5860/choice.37-4156 · Cited by 654
A Bias Towards Business? Assessing Interest Group Influence on the U.S. Bureaucracy
Yackee, J. W., & Yackee, S. W. (2006) · The Journal of Politics · doi:10.1111/j.1468-2508.2006.00375.x · Cited by 515 · cited 1×
“Operationalizations of “ underrepresentation ” vary acrossliteratures,withmany studies emphasizing demographic or socioeconomic disparities (e.g. Balla, 1998; Feinstein, 2022; Rossi and Stack, 2023; Yackee and Yackee, 2006).”
Interest Groups in the Rule-Making Process: Who Participates? Whose Voices Get Heard?
Golden, M. M. (1998) · Journal of Public Administration Research and Theory · doi:10.1093/oxfordjournals.jpart.a024380 · Cited by 387 · cited 2×
“Indeed, empirical studies suggest that in many rulemaking processes, only a small fraction of the public participate — with most submissions coming from business groups, lawyers, or lobbyists (Coglianese, 2006; Golden, 1998; Kim, 2011; West, 2004).”
All the News That’s Fit to Fabricate: AI-Generated Text as a Tool of Media Misinformation
Kreps, S., McCain, R. M., & Brundage, M. (2022) · Journal of Experimental Political Science · doi:10.1017/xps.2020.37 · Cited by 360 · cited 1×
“Other scholars highlight more systemic threats, such as the possibility that malicious actors could exploit LLMs to generate mass comments at scale, overwhelming agencies and distorting perceptions of public opinion (Kreps et al., 2022; Weiss, 2019).”
Self-citationYackee, S. W. (2006) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/mui042 · Cited by 309 · cited 4×
“Second, in political science and public administration, the results align with evidence that participation is shaped less by apathy than by information costs, which restrict both who takes part and the weight agencies can reasonably assign to submissions (Coglianese, 2006; West, 2004; Yackee, 2006).”
Influential
Research works printed but not linked: 24
- Balla SJ, Bull R, Dooling BCE, et al. (2022) Responding to mass, computer-generated, and malattributed comments. Administrative Law Review 74(1): 95–160.
- Bartels LM (2008) Unequal Democracy. Princeton, NJ, USA: Princeton University Press.
- Coglianese C (2006) Citizen participation in rulemaking: Past, present, and future. Duke Law Journal 55(5): 943–968.
- Dahl RA (1989) Democracy and Its Critics. New Haven: Yale University Press.
- Farina CR, Epstein D, Heidt J, et al. (2012) Knowledge in the people: Rethinking “value” in public rulemaking participation. Wake Forest Law Review 47(5): 1185–1242.
- Habermas J (1996) Between facts and norms: Contributions to a discourse theory of law and democracy (Rehg W, trans). In: Studies in Contemporary German Social Thought. Cambridge, MA: The MIT Press, 1–631.
- Hacker JS, Pierson PP (2014) Winner-Take-All Politics: How Washington Made the Rich Richer—and Turned Its Back on the Middle Class. New York: Simon & Schuster.
- Jacobs LR, Skocpol T (2005) Inequality and American Democracy: What We Know and What We Need to Learn. New York: Russell Sage.
- Johnson SM (2024) Rulemaking 3.0: Incorporating AI and ChatGPT into notice and comment rulemaking. Missouri Law Review 88(4): 1021–1076.
- Kim J (2011) For a good cause: Reforming the good cause exception to notice and comment rulemaking under the administrative procedure act. George Mason Law Review 18(4): 1045–1084.
- Mansbridge JJ (1983) Beyond Adversary Democracy. Chicago: University of Chicago Press.
- Mashaw JL (1997) Greed, Chaos, and Governance. New Haven, CT, USA: Yale University Press.
- Mendelson NA (2011) Rulemaking, democracy, and torrents of e-mail. George Washington Law Review 79(5): 1343–1380.
- Mendelson NA (2012) Should mass comments count? Michigan Journal of Environmental & Administrative Law 2(1): 173–184.
- Rochvarg A (1981) Adequacy of notice of rulemaking under the federal administrative procedure act—When should a second round of notice and comment be provided? American University Law Review 31(1): 1–24.
- Rossi J, Stack KM (2023) Representative rulemaking. Iowa Law Review 109(1): 1–50.
- Sant’Ambrogio M Staszewski G (2018) Public engagement with agency rulemaking: Final report for the administrative conference of the United States. Conference of the United States. Available at: https://www.acus.gov/sites/default/files/documents/Public%20Engagement%20in%20Rulemaking%20Final%20Report.pdf (accessed 12 December 2025).
- Savitz G (2021) Public comments run amok: Reforming the notice and comment process to help reduce the negative effects of mass and fake comments. Buffalo Law Review 69(3): 759.
- Skocpol T (2003) Diminished Democracy: From Membership to Management in American Civic Life. Norman: University of Oklahoma Press.
- 10.7208/chicago/9780226924564.001.0001 · doi:10.7208/chicago/9780226924564.001.0001
- United States Environmental Protection Agency (2015) Carbon pollution emission guidelines for existing stationary sources: Electric utility generating units. Federal Register 80(205): 64662–64964. Available at: https://www.govinfo.gov/content/pkg/FR-2015-10-23/pdf/2015-22842.pdf (accessed 12 December 2025).
- United States Environmental Protection Agency (2019) Emission guidelines for greenhouse gas emissions from existing electric utility generating units; revisions to emission guidelines implementing regulations. Federal Register 83(170): 44746–44813. Available at: https://www.govinfo.gov/content/pkg/FR-2018-08-31/pdf/2018-18755.pdf (accessed 12 December 2025).
- van Dijk JAGM (2006) Digital divide research, achievements and shortcomings. The Digital Divide in the Twenty-First Century 34(4): 221–235.
- Weiss M (2019) Deepfake bot submissions to federal public comment websites cannot be distinguished from human submissions. Technology Science 2019121801, 17 December. Available at: https://techscience.org/a/2019121801/ (accessed 12 December 2025).
Cited by
Ju, X., Li, D., Zhu, Y. C., Li, Y., Wang, Q., Yang, Y., Xia, R., Ye, P., & Wang, S. (2026) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi15050201
“Recent studies highlight that large language models (LLMs) can assist in improving expression quality across diverse user backgrounds but do not necessarily enhance policy understanding [9].”
The accountability gap: Shadow digital labor and the crisis of accountability in automated welfare
Solís, V. P. D. L. (2026) · Social & Legal Studies · doi:10.1177/09646639261489494
Metadata
- Authors
- Arsenault, A. C., & Kreps, S.
- Affiliations
- Cornell University (US)
- Corresponding author
- Arsenault, Amelia C
- Venue
- Big Data & Society
- Publisher
- SAGE Publications
- Published
- 2026-02-04
- Volume
- 13
- Issue
- 1
- ISSN
- 2053-9517 (ISSN-L)
- OpenAlex
- W7127615841
- Cited by
- 2
- References
- 21
- Citations by year
- 2026: 2
- FWCI
- 39.49
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- creativecommons.org/licenses/by-nc/4.0/ (vor)
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Big Data & Society (publishedVersion, cc-by-nc)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Political Science and International Relations › E-Government and Public Services
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Artificial Intelligence in Law
- Keywords
- large language models, notice-and-comment rulemaking, federal rulemaking, citizen participation, accessibility gaps, educational inequality, comment quality, underrepresented voices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Whose voice counts? The role of large language models in public commenting. https://app.cochat.ai/papers/10.1177/20539517261419341
- The paper
- Arsenault, A. C., & Kreps, S. (2026). Whose voice counts? The role of large language models in public commenting. Big Data & Society. https://doi.org/10.1177/20539517261419341
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.