On the Complexities of Testing for Compliance with Human Oversight Requirements in AI Regulation

Abstract

Human oversight requirements are a core component of the European AI Act and in AI governance. In this paper, we highlight key challenges in testing for compliance with these requirements. A central difficulty lies in balancing simple, but potentially ineffective checklist-based approaches with resource-intensive and context-sensitive empirical testing of the effectiveness of human oversight of AI. Questions regarding when to update compliance testing, the context-dependent nature of human oversight requirements, and difficult-to-operationalize standards further complicate compliance testing. We argue that these challenges illustrate broader challenges in the future of sociotechnical AI governance, i.e. a future that shifts from ensuring “good” technological products to “good” sociotechnical systems.

Publication
International Conference on Bridging the Gap between AI and Reality. International Conference on Bridging the Gap between AI and Reality (AiSoLA-2025)

Cite

@inproceedings{langerOnTheComplexitiesOf2025,
 author = {Markus Langer and Veronika Lazar and Kevin Baum},
 booktitle = {International Conference on Bridging the Gap between AI and Reality. International Conference on Bridging the Gap between AI and Reality (AiSoLA-2025)},
 pages = {160-169},
 publisher = {Springer Nature Switzerland},
 title = {On the Complexities of Testing for Compliance with Human Oversight Requirements in AI Regulation},
 url = {https://www.dfki.de/fileadmin/user_upload/import/16858_978-3-032-07132-3.pdf},
 year = {2025}
}