On the Complexities of Testing for Compliance with Human Oversight Requirements in AI Regulation
Abstract
Human oversight requirements are a core component of the European AI Act and in AI governance. In this paper, we highlight key challenges in testing for compliance with these requirements. A central difficulty lies in balancing simple, but potentially ineffective checklist-based approaches with resource-intensive and context-sensitive empirical testing of the effectiveness of human oversight of AI. Questions regarding when to update compliance testing, the context-dependent nature of human oversight requirements, and difficult-to-operationalize standards further complicate compliance testing. We argue that these challenges illustrate broader challenges in the future of sociotechnical AI governance, i.e. a future that shifts from ensuring “good” technological products to “good” sociotechnical systems.
Cite
@inproceedings{langerOnTheComplexitiesOf2025,
author = {Markus Langer and Veronika Lazar and Kevin Baum},
booktitle = {International Conference on Bridging the Gap between AI and Reality. International Conference on Bridging the Gap between AI and Reality (AiSoLA-2025)},
pages = {160-169},
publisher = {Springer Nature Switzerland},
title = {On the Complexities of Testing for Compliance with Human Oversight Requirements in AI Regulation},
url = {https://www.dfki.de/fileadmin/user_upload/import/16858_978-3-032-07132-3.pdf},
year = {2025}
}