Artificial intelligence policy in India: a framework for engaging the limits of data-driven decision-making
Open accessAbstract
Artificial intelligence (AI) is an emerging focus area of policy development in India. The country's regional influence, burgeoning AI industry and ambitious governmental initiatives around AI make it an important jurisdiction to consider, regardless of where the reader of this article lives. Even as existing policy processes intend to encourage the rapid development of AI for economic growth and social good, an overarching trend persists in India, and several other jurisdictions: the limitations and risks of data-driven decisions still feature as retrospective considerations for development and deployment of AI applications. This article argues that the technical limitations of AI systems should be reckoned with at the time of developing policy, and the societal and ethical concerns that arise due to such limitations should be used to inform what policy processes aspire to achieve. It proposes a framework for such deliberation to occur, by analysing the three main stages of bringing machine learning (the most popular subset of AI techniques) to deployment—the data, model and application stage. It is written against the backdrop of India's current AI policy landscape, and applies the proposed framework to ongoing sectoral challenges in India. With a view to influence existing policy deliberation in the country, it focuses on potential risks that arise from data-driven decisions in general, and in the Indian context in particular. This article is part of the theme issue ‘Governing artificial intelligence: ethical, legal, and technical opportunities and challenges'.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Most fairness research examines racial and gender biases in models, the two dimensions that dominate American public discourse.
“The majority of fairness research looks at racial [46,57,121,125,183] and gender biases [42,46,197,219] in models-two dimensions that dominate the American public discourse.”
From Re-imagining Algorithmic Fairness in India and Beyond (2021) · cites this paper as [125]
Cites
The Black Box Society: The Secret Algorithms That Control Money and Information
Pasquale, F. (2015) · doi:10.4159/harvard.9780674736061 · Cited by 3,796 · see citing works
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501 · see citing works
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 3,432 · see citing works
A few useful things to know about machine learning
Domingos, P. (2012) · Communications of the ACM · doi:10.1145/2347736.2347755 · Cited by 3,326 · see citing works
Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor
Lebovits, H. (2018) · Public Integrity · doi:10.1080/10999922.2018.1511671 · Cited by 3,318 · see citing works
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196 · cited 1× · see citing works
“As Burrell points out, the opacity in machine learning systems can be considered an inherent property of the technology, or arising out of technical illiteracy or even as intentional secrecy [52].”
Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy
Doyle, T. (2017) · The Information Society · doi:10.1080/01972243.2017.1354593 · Cited by 3,110 · see citing works
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · see citing works
(2016) · Cited by 2,334 · see citing works
(2018) · Cited by 1,167 · see citing works
Gillespie, T. (2014) · Media Technologies · doi:10.7551/mitpress/9042.003.0013 · Cited by 1,016 · see citing works
Kusner, M. J., Loftus, J. R., Russell, C., & Silva, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06856 · Cited by 995 · see citing works
Veale, M., & Binns, R. (2017) · Big Data & Society · doi:10.1177/2053951717743530 · Cited by 512 · see citing works
Veale, M., Van Kleek, M., & Binns, R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174014 · Cited by 490 · cited 1× · see citing works
“As AI applications increasingly supplant decision-making in the public sector [45], transparency and accountability in these systems become particularly crucial in constitutional democracies all over the world, including India.”
Inherent Tradeoffs in the Fair Determination of Risk Scores
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603197 · Cited by 347 · see citing works
Moral crumple zones: cautionary tales in human–robot interaction
Elish, M. C. (2019) · Engaging Science, Technology, and Society · doi:10.17351/ests2019.260 · Cited by 321 · cited 1× · see citing works
“loop have a risk of simply turning into a moral crumple zone [66]?”
BackgroundBalkin, J. M. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3038939 · Cited by 289 · see citing works
Algorithmic Accountability Reporting: On the Investigation of Black Boxes
Diakopoulos, N. A. (2014) · Columbia Academic Commons (Columbia University) · doi:10.7916/d8zk5tw2 · Cited by 222 · see citing works
Artificial Intelligence Policy: A Primer and Roadmap
Calo, R. (2018) · University of Bologna Law Review · doi:10.6092/issn.2531-6133/8670 · Cited by 197 · see citing works
Artificial Intelligence Policy: A Roadmap
Calo, R. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3015350 · Cited by 191 · see citing works
The Oxford Handbook of the Indian Constitution
Choudry, S., Khosla, M., & Mehta, P. B. (2016) · Oxford University Press eBooks · doi:10.1093/law/9780198704898.001.0001 · Cited by 182 · see citing works
Surden, H. (2014) · Colorado Law Scholarly Commons (University of Colorado Colorado Springs) · Cited by 166 · see citing works
Big Data and Its ExclusionsPreprint
Lerman, J. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2293765 · Cited by 110 · see citing works
Prolegomena to a White Paper on an Ethical Framework for a Good AI Society
Cowls, J., & Floridi, L. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3198732 · Cited by 76 · see citing works
Nine Algorithms That Changed the Future
MacCormick, J. (2012) · Princeton University Press eBooks · doi:10.1515/9780691209050 · Cited by 47 · see citing works
The Transformative Constitution: A Radical Biography in Nine Acts
Suresh, S. (2020) · International Journal of Constitutional Law · doi:10.1093/icon/moaa046 · Cited by 35 · see citing works
Moral Crumple Zones: Cautionary Tales in Human-Robot Interaction (pre-print)Preprint
Elish, M. C. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2757236 · Cited by 32 · see citing works
Crawford, K. (2013) · Foreign Policy · Cited by 14 · see citing works
The Transformative Constitution: A Radical Biography in Nine Acts
Bhatia, G. (2019) · Cited by 6 · see citing works
Floridi, L. (2019) · PhilPapers (PhilPapers Foundation) · Cited by 4 · see citing works
Machine Learning and Transparency: A Scoping ExercisePreprint
Marda, V. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3236837 · Cited by 2 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Governing artificial intelligence: ethical, legal and technical opportunities and challenges
Cath, C. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2018.0080 · Cited by 745 · see citing works
Wieringa, M. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372833 · Cited by 321 · see citing works
Re-imagining Algorithmic Fairness in India and Beyond
Sambasivan, N., Arnesen, E., Hutchinson, B., Doshi, T., & Prabhakaran, V. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445896 · Cited by 228 · see citing works
“opportunities for AI in India [104], proposed policy deliberation frameworks that take into account the unique policy landscape of India [126], and questioned the intrusive data collection practices through Aadhaar (biometric-based unique identity for Indians) in India [158, 159].”
BackgroundInfluential”Because AI is 100% right and safe”: User Attitudes and Sources of AI Authority in India
Kapania, S., Siy, O., Clapper, G., SP, A. M., & Sambasivan, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517533 · Cited by 90 · see citing works
Collecting the Public Perception of AI and Robot Rights
Lima, G., Kim, C., Ryu, S., Jeon, C., & Cha, M. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415206 · Cited by 95 · see citing works
- Authors
- Marda, V.
- Affiliations
- Article 19 (BR)
- Corresponding author
- Marda, Vidushi
- ORCID
- Marda, Vidushi
- Venue
- Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
- Publisher
- The Royal Society
- Published
- 2018-10-15
- Volume
- 376
- Issue
- 2133
- ISSN
- 1364-503X (ISSN-L)
- 1471-2962
- OpenAlex
- W2895968895
- Cited by
- 161
- References
- 31
- Citations by year
- 2026: 14 · 2025: 42 · 2024: 34 · 2023: 26 · 2022: 14 · 2021: 14 · 2020: 11 · 2019: 5 · 2018: 1
- FWCI
- 15.41
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- Locations
- Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences (publishedVersion)
- SSRN Electronic Journal (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Social Sciences › Law › Digitalization, Law, and Regulation
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- AI policy, India, data-driven decision making, machine learning, AI risks, AI ethics, policy framework
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review