Algorithmic Government in a Decentralised State: Capacity, Accountability and the Procurement Gap

Authors

Keywords:

algorithmic decision-making, public accountability, government procurement, decentralisation, administrative discretion

Abstract

Governments increasingly delegate consequential administrative decisions to algorithmic systems, and the accountability mechanisms available to citizens have not kept pace. This study examines where in the life of such a system accountability can actually attach, and what follows for a decentralised state in which adoption occurs at subnational level. The method combines a structured review of research published between 2017 and 2024 with comparative analysis of two extensively documented failures and a lifecycle-based design analysis. Three findings emerge. First, accountability is effective mainly ex ante: analysis of the Dutch risk-indication case concludes that accountability configurations depend predominantly on the prior sensitivity and responsiveness of political forums, and that where these prove insufficient, mitigation during or after deployment is very difficult. Second, the decisions that matter most are made during procurement rather than during policymaking, since vendors embed optimisation targets, data selection and thresholds that agencies treat as technical rather than political. Third, the legal remedies commonly assumed to exist are weaker than supposed: no general right to explanation of automated decisions exists in European data protection law, and administrative law has no settled account of how judicial review applies to automated public decisions. The Australian and Dutch failures show what follows, including a settlement returning over one billion Australian dollars to approximately four hundred thousand people. For decentralised states the implication is structural: the forum that must act ex ante is dispersed across hundreds of subnational bodies with uneven capacity, which is where the safeguards proposed here are directed.

References

Bullock, J. B., Young, M. M., & Wang, Y.-F. (2020). Artificial intelligence, bureaucratic form, and discretion in public service. Information Polity, 25(4), 491-506. https://doi.org/10.3233/IP-200223

Busch, P. A., & Henriksen, H. Z. (2018). Digital discretion: A systematic literature review of ICT and streetlevel discretion. Information Polity, 23(1), 3-28. https://doi.org/10.3233/IP-170050

Busuioc, M. (2021). Accountable artificial intelligence: Holding algorithms to account. Public Administration Review, 81(5), 825-836. https://doi.org/10.1111/puar.13293

Calo, R., & Citron, D. K. (2021). The automated administrative state: A crisis of legitimacy. Emory Law Journal, 70(4), 797-844.

Cobbe, J. (2019). Administrative law and the machines of government: Judicial review of automated publicsector decision-making. Legal Studies, 39(4), 636-655. https://doi.org/10.1017/lst.2019.9

Cooper, A. F., Moss, E., Laufer, B., & Nissenbaum, H. (2022). Accountability in an algorithmic society: Relationality, responsibility, and robustness in machine learning. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency (pp. 864-876). https://doi.org/10.1145/3531146.3533150

Criado, J. I., Valero, J. M., & Villodre, J. (2020). Algorithmic transparency and bureaucratic discretion: The case of SALER early warning system. Information Polity, 25(4), 449-470. https://doi.org/10.3233/IP-200260

Grimmelikhuijsen, S. (2023). Explaining why the computer says no: Algorithmic transparency affects the perceived trustworthiness of automated decision-making. Public Administration Review, 83(2), 241-262. https://doi.org/10.1111/puar.13483

Ingrams, A., Kaufmann, W., & Jacobs, D. (2022). In AI we trust? Citizen perceptions of AI in government decision making. Policy & Internet, 14(2), 390-409. https://doi.org/10.1002/poi3.276

Kaminski, M. E., & Malgieri, G. (2021). Algorithmic impact assessments under the GDPR: Producing multilayered explanations. International Data Privacy Law, 11(2), 125-144. https://doi.org/10.1093/idpl/ipaa020

Kuziemski, M., & Misuraca, G. (2020). AI governance in the public sector: Three tales from the frontiers of automated decision-making in democratic settings. Telecommunications Policy, 44(6), 101976. https://doi.org/10.1016/j.telpol.2020.101976

Meijer, A., Lorenz, L., & Wessels, M. (2021). Algorithmization of bureaucratic organizations: Using a practice lens to study how context shapes predictive policing systems. Public Administration Review, 81(5), 837-846. https://doi.org/10.1111/puar.13391

Mulligan, D. K., & Bamberger, K. A. (2019). Procurement as policy: Administrative process for machine learning. Berkeley Technology Law Journal, 34(3), 773-850.

Rachovitsa, A., & Johann, N. (2022). The human rights implications of the use of AI in the digital welfare state: Lessons learned from the Dutch SyRI case. Human Rights Law Review, 22(2), ngac010. https://doi.org/10.1093/hrlr/ngac010

Schiff, D. S., Schiff, K. J., & Pierson, P. (2022). Assessing public value failure in government adoption of artificial intelligence. Public Administration, 100(3), 653-673. https://doi.org/10.1111/padm.12742

Sun, T. Q., & Medaglia, R. (2019). Mapping the challenges of artificial intelligence in the public sector: Evidence from public healthcare. Government Information Quarterly, 36(2), 368-383. https://doi.org/10.1016/j.giq.2018.09.008

van Bekkum, M., & Zuiderveen Borgesius, F. (2021). Digital welfare fraud detection and the Dutch SyRI judgment. European Journal of Social Security, 23(4), 323-340. https://doi.org/10.1177/13882627211031257

van Krieken, R. (2024). The organization of ignorance: The Australian 'Robodebt' affair, bureaucracy, law and politics. Critical Sociology, 50(7-8), 1379-1398. https://doi.org/10.1177/08969205241245257

Wachter, S., Mittelstadt, B., & Floridi, L. (2017). Why a right to explanation of automated decision-making does not exist in the General Data Protection Regulation. International Data Privacy Law, 7(2), 76-99. https://doi.org/10.1093/idpl/ipx005

Wadipalapa, R. P., Katharina, R., Nainggolan, P. P., Aminah, S., Apriani, T., Ma'rifah, D., & Anisah, A. L. (2024). An ambitious artificial intelligence policy in a decentralised governance system: Evidence from Indonesia. Journal of Current Southeast Asian Affairs, 43(1), 65-93. https://doi.org/10.1177/18681034231226393

Whiteford, P. (2021). Debt by design: The anatomy of a social policy fiasco - Or was it something worse? Australian Journal of Public Administration, 80(2), 340-360. https://doi.org/10.1111/1467-8500.12479

Wieringa, M. (2020). What to account for when accounting for algorithms: A systematic literature review on algorithmic accountability. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (pp. 1-18). https://doi.org/10.1145/3351095.3372833

Wieringa, M. (2023). 'Hey SyRI, tell me about algorithmic accountability': Lessons from a landmark case. Data & Policy, 5, e2. https://doi.org/10.1017/dap.2022.39

Young, M. M., Bullock, J. B., & Lecy, J. D. (2019). Artificial discretion as a tool of governance: A framework for understanding the impact of artificial intelligence on public administration. Perspectives on Public Management and Governance, 2(4), 301-313. https://doi.org/10.1093/ppmgov/gvz014

Zuiderwijk, A., Chen, Y.-C., & Salem, F. (2021). Implications of the use of artificial intelligence in public governance: A systematic literature review and a research agenda. Government Information Quarterly, 38(3), 101577. https://doi.org/10.1016/j.giq.2021.101577

Zulkifli, Nurhayatie, T., & Junaidi, M. (2019). Penelitian konseptual: Peningkatan kualitas strategis melalui penggunaan teknologi informasi dan komunikasi dalam meningkatkan kinerja pemerintah daerah. Jurnal Litbang Sukowati: Media Penelitian dan Pengembangan, 3(1), 8. https://doi.org/10.32630/sukowati.v3i1.113

Downloads

Published

2025-01-31

Issue

Section

Policy Analysis

How to Cite

Algorithmic Government in a Decentralised State: Capacity, Accountability and the Procurement Gap. (2025). Journal of Law, Public Policy and Public Finance, 1(1), 34–43. https://researchcenterprogresif.org/ojs/index.php/jlpf/article/view/algorithmic-government-in-a-decentralised-state