Toward inclusive tech policy design: a method for underrepresented voices to strengthen tech policy documents
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
To be successful, policy must anticipate a broad range of constituents. Yet, all too often, technology policy is written with primarily mainstream populations in mind. In this article, drawing on Value Sensitive Design and discount evaluation methods, we introduce a new method—Diverse Voices—for strengthening pre-publication technology policy documents from the perspective of underrepresented groups. Cost effective and high impact, the Diverse Voices method intervenes by soliciting input from “experiential” expert panels (i.e., members of a particular stakeholder group and/or those serving that group). We first describe the method. Then we report on two case studies demonstrating its use: one with a white paper on augmented reality technology with expert panels on people with disabilities, people who were formerly or currently incarcerated, and women; and the other with a strategy document on automated driving vehicle technologies with expert panels on youth, non-car drivers, and extremely low-income people. In both case studies, panels identified significant shortcomings in the pre-publication documents which, if addressed, would mitigate some of the disparate impact of the proposed policy recommendations on these particular stakeholder groups. Our discussion includes reflection on the method, evidence for its success, its limitations, and future directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fenichel Pitkin, H. (1967) · doi:10.1525/9780520340503 · Cited by 5,162 · cited 1×
“As Pitkin (1967) asserts, there can be critical differences between symbolic and substantive representation of a social or demographic group’s interests and needs.”
Nielsen, J. (1994) · Conference companion on Human factors in computing systems - CHI '94 · doi:10.1145/259963.260531 · Cited by 2,759
Technologies of Humility: Citizen Participation in Governing Science
Jasanoff, S. (2003) · Minerva · doi:10.1023/a:1025557512320 · Cited by 1,004
Design Things and Design Thinking: Contemporary Participatory Design Challenges
Bjögvinsson, E., Ehn, P., & Hillgren, P.-A. (2012) · Design Issues · doi:10.1162/desi_a_00165 · Cited by 784
Value Sensitive Design and Information Systems
Friedman, B., Kahn, P. H., Borning, A., & Huldtgren, A. (2013) · Philosophy of Engineering and Technology · doi:10.1007/978-94-007-7844-3_4 · Cited by 678
Self-citationRettig, M. (1994) · Communications of the ACM · doi:10.1145/175276.175288 · Cited by 440 · cited 1×
“Design research demonstrates that artifacts that appear less finished are more likely to elicit critique than those that look complete (Rettig 1994); facilitators may provide documents in a drafty-looking format to be more conducive to input.”
BackgroundEngineering and the Problem of Moral Overload
Van den Hoven, J., Lokhorst, G.-J., & Van de Poel, I. (2012) · Science and Engineering Ethics · doi:10.1007/s11948-011-9277-z · Cited by 194
Cited by
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligence
Mohamed, S., Png, M.-T., & Isaac, W. (2020) · Philosophy & Technology · doi:10.1007/s13347-020-00405-8 · Cited by 912
“Design There is now also a growing understanding of approaches for meaningful community-engaged research (Mikesell et al. 2013), using frameworks like the IEEE Ethically Aligned Design (IEEE Global Initiative 2016), technology policy design frameworks like Diverse Voices (Young et al. 2019) and mechanisms for the co-d…”
MethodCheong, B. C. (2024) · Frontiers in Human Dynamics · doi:10.3389/fhumd.2024.1421273 · Cited by 445
Socially Responsible AI Algorithms: Issues, Purposes, and Challenges
Cheng, L., Varshney, K. R., & Liu, H. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12814 · Cited by 261
The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice
Delgado, F., Yang, S., Madaio, M., & Yang, Q. (2023) · Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3617694.3623261 · Cited by 256
Metadata
- Authors
- Young, M., Magassa, L., & Friedman, B.
- Venue
- Ethics and Information Technology
- Published
- 2019-03-14
- Volume
- 21
- Issue
- 2
- Pages
- 89-103
- ISSN
- 1388-1957 (ISSN-L)
- 1572-8439
- OpenAlex
- W2922258799
- Cited by
- 71
- References
- 7
- FWCI
- 12.18
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Toward inclusive tech policy design: a method for underrepresented voices to strengthen tech policy documents. https://app.cochat.ai/papers/10.1007/s10676-019-09497-z
- The paper
- Young, M., Magassa, L., & Friedman, B. (2019). Toward inclusive tech policy design: a method for underrepresented voices to strengthen tech policy documents. Ethics and Information Technology. https://doi.org/10.1007/s10676-019-09497-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.