Algorithmic Government in a Decentralised State: Capacity, Accountability and the Procurement Gap
Keywords:
algorithmic decision-making, public accountability, government procurement, decentralisation, administrative discretionAbstract
Governments increasingly delegate consequential administrative decisions to algorithmic systems, and the accountability mechanisms available to citizens have not kept pace. This study examines where in the life of such a system accountability can actually attach, and what follows for a decentralised state in which adoption occurs at subnational level. The method combines a structured review of research published between 2017 and 2024 with comparative analysis of two extensively documented failures and a lifecycle-based design analysis. Three findings emerge. First, accountability is effective mainly ex ante: analysis of the Dutch risk-indication case concludes that accountability configurations depend predominantly on the prior sensitivity and responsiveness of political forums, and that where these prove insufficient, mitigation during or after deployment is very difficult. Second, the decisions that matter most are made during procurement rather than during policymaking, since vendors embed optimisation targets, data selection and thresholds that agencies treat as technical rather than political. Third, the legal remedies commonly assumed to exist are weaker than supposed: no general right to explanation of automated decisions exists in European data protection law, and administrative law has no settled account of how judicial review applies to automated public decisions. The Australian and Dutch failures show what follows, including a settlement returning over one billion Australian dollars to approximately four hundred thousand people. For decentralised states the implication is structural: the forum that must act ex ante is dispersed across hundreds of subnational bodies with uneven capacity, which is where the safeguards proposed here are directed.References
Bullock, J. B., Young, M. M., & Wang, Y.-F. (2020). Artificial intelligence, bureaucratic form, and discretion in public service. Information Polity, 25(4), 491-506. https://doi.org/10.3233/IP-200223
Busch, P. A., & Henriksen, H. Z. (2018). Digital discretion: A systematic literature review of ICT and streetlevel discretion. Information Polity, 23(1), 3-28. https://doi.org/10.3233/IP-170050
Busuioc, M. (2021). Accountable artificial intelligence: Holding algorithms to account. Public Administration Review, 81(5), 825-836. https://doi.org/10.1111/puar.13293
Calo, R., & Citron, D. K. (2021). The automated administrative state: A crisis of legitimacy. Emory Law Journal, 70(4), 797-844.
Cobbe, J. (2019). Administrative law and the machines of government: Judicial review of automated publicsector decision-making. Legal Studies, 39(4), 636-655. https://doi.org/10.1017/lst.2019.9
Cooper, A. F., Moss, E., Laufer, B., & Nissenbaum, H. (2022). Accountability in an algorithmic society: Relationality, responsibility, and robustness in machine learning. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency (pp. 864-876). https://doi.org/10.1145/3531146.3533150
Criado, J. I., Valero, J. M., & Villodre, J. (2020). Algorithmic transparency and bureaucratic discretion: The case of SALER early warning system. Information Polity, 25(4), 449-470. https://doi.org/10.3233/IP-200260
Grimmelikhuijsen, S. (2023). Explaining why the computer says no: Algorithmic transparency affects the perceived trustworthiness of automated decision-making. Public Administration Review, 83(2), 241-262. https://doi.org/10.1111/puar.13483
Ingrams, A., Kaufmann, W., & Jacobs, D. (2022). In AI we trust? Citizen perceptions of AI in government decision making. Policy & Internet, 14(2), 390-409. https://doi.org/10.1002/poi3.276
Kaminski, M. E., & Malgieri, G. (2021). Algorithmic impact assessments under the GDPR: Producing multilayered explanations. International Data Privacy Law, 11(2), 125-144. https://doi.org/10.1093/idpl/ipaa020
Kuziemski, M., & Misuraca, G. (2020). AI governance in the public sector: Three tales from the frontiers of automated decision-making in democratic settings. Telecommunications Policy, 44(6), 101976. https://doi.org/10.1016/j.telpol.2020.101976
Meijer, A., Lorenz, L., & Wessels, M. (2021). Algorithmization of bureaucratic organizations: Using a practice lens to study how context shapes predictive policing systems. Public Administration Review, 81(5), 837-846. https://doi.org/10.1111/puar.13391
Mulligan, D. K., & Bamberger, K. A. (2019). Procurement as policy: Administrative process for machine learning. Berkeley Technology Law Journal, 34(3), 773-850.
Rachovitsa, A., & Johann, N. (2022). The human rights implications of the use of AI in the digital welfare state: Lessons learned from the Dutch SyRI case. Human Rights Law Review, 22(2), ngac010. https://doi.org/10.1093/hrlr/ngac010
Schiff, D. S., Schiff, K. J., & Pierson, P. (2022). Assessing public value failure in government adoption of artificial intelligence. Public Administration, 100(3), 653-673. https://doi.org/10.1111/padm.12742
Sun, T. Q., & Medaglia, R. (2019). Mapping the challenges of artificial intelligence in the public sector: Evidence from public healthcare. Government Information Quarterly, 36(2), 368-383. https://doi.org/10.1016/j.giq.2018.09.008
van Bekkum, M., & Zuiderveen Borgesius, F. (2021). Digital welfare fraud detection and the Dutch SyRI judgment. European Journal of Social Security, 23(4), 323-340. https://doi.org/10.1177/13882627211031257
van Krieken, R. (2024). The organization of ignorance: The Australian 'Robodebt' affair, bureaucracy, law and politics. Critical Sociology, 50(7-8), 1379-1398. https://doi.org/10.1177/08969205241245257
Wachter, S., Mittelstadt, B., & Floridi, L. (2017). Why a right to explanation of automated decision-making does not exist in the General Data Protection Regulation. International Data Privacy Law, 7(2), 76-99. https://doi.org/10.1093/idpl/ipx005
Wadipalapa, R. P., Katharina, R., Nainggolan, P. P., Aminah, S., Apriani, T., Ma'rifah, D., & Anisah, A. L. (2024). An ambitious artificial intelligence policy in a decentralised governance system: Evidence from Indonesia. Journal of Current Southeast Asian Affairs, 43(1), 65-93. https://doi.org/10.1177/18681034231226393
Whiteford, P. (2021). Debt by design: The anatomy of a social policy fiasco - Or was it something worse? Australian Journal of Public Administration, 80(2), 340-360. https://doi.org/10.1111/1467-8500.12479
Wieringa, M. (2020). What to account for when accounting for algorithms: A systematic literature review on algorithmic accountability. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (pp. 1-18). https://doi.org/10.1145/3351095.3372833
Wieringa, M. (2023). 'Hey SyRI, tell me about algorithmic accountability': Lessons from a landmark case. Data & Policy, 5, e2. https://doi.org/10.1017/dap.2022.39
Young, M. M., Bullock, J. B., & Lecy, J. D. (2019). Artificial discretion as a tool of governance: A framework for understanding the impact of artificial intelligence on public administration. Perspectives on Public Management and Governance, 2(4), 301-313. https://doi.org/10.1093/ppmgov/gvz014
Zuiderwijk, A., Chen, Y.-C., & Salem, F. (2021). Implications of the use of artificial intelligence in public governance: A systematic literature review and a research agenda. Government Information Quarterly, 38(3), 101577. https://doi.org/10.1016/j.giq.2021.101577
Zulkifli, Nurhayatie, T., & Junaidi, M. (2019). Penelitian konseptual: Peningkatan kualitas strategis melalui penggunaan teknologi informasi dan komunikasi dalam meningkatkan kinerja pemerintah daerah. Jurnal Litbang Sukowati: Media Penelitian dan Pengembangan, 3(1), 8. https://doi.org/10.32630/sukowati.v3i1.113
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Farhan Qudratulloh Ginanjar

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International Licence (CC BY-SA 4.0).