ToCERTAIN

Towards a Centre for European
Research in Trusted
Artificial Intelligence

2023 – 2026

Laying the groundwork for the CERTAIN Centre—a Saarland-anchored, European-scale hub for Trusted AI that delivers functional guarantees and earns user trust even in safety-critical applications.

Leads
Funding
European Regional Development Fund Grant EFRE-AuF-0000942
Land Saarland

About

The ToCERTAIN project aims to strengthen the development of trustworthy artificial intelligence (AI) that offers guarantees about its functionality (Trusted AI) and thus creates the necessary trust among users for the widespread, secure and reliable use of AI, even in critical applications. The current state of research and application of AI systems is still very inadequate in this regard, although industry is actively demanding these characteristics and corresponding certification.

The multitude of aspects that contribute to trustworthy artificial intelligence are being developed in part at DFKI, but above all in close and intensive cooperation with partners from research and industry – at the site, in the greater region and throughout Europe. This collaboration is to be intensified and consolidated in the long term, with ToCERTAIN laying the foundation as an ambitious research project and establishing a highly visible beacon in Europe and beyond with the CERTAIN Centre and its closely networked partners.

Publications

2026

5 papers

Per-Domain Generalizing Policies: On Learning Efficient and Robust Q-Value Functions

2026 — Proceedings of the Thirty-Sixth International Conference on Automated Planning and Scheduling. International Conference on Automated Planning and Scheduling (ICAPS-2026), June 27 - July 2, Dublin, Ireland

@inproceedings{mullerPerDomainGeneralizingPoliciesOn2026,
 author = {Müller, Nicola J. and Oster, Moritz and Valera, Isabel and Hoffmann, Jörg and Gros, Timo P.},
 booktitle = {Proceedings of the Thirty-Sixth International Conference on Automated Planning and Scheduling. International Conference on Automated Planning and Scheduling (ICAPS-2026), June 27 - July 2, Dublin, Ireland},
 doi = {10.1609/icaps.v36i1.42889},
 isbn = {ISSN 2334-0843},
 month = {6},
 number = {1},
 pages = {703-707},
 publisher = {AAAI Press},
 title = {Per-Domain Generalizing Policies: On Learning Efficient and Robust Q-Value Functions},
 url = {https://ojs.aaai.org/index.php/ICAPS/article/view/42889},
 volume = {36},
 year = {2026}
}
DOI URL

AI CHAOS! 2nd Workshop on the Challenges for Human Oversight of AI Systems

2026 — CHI EA ‘26: Proceedings of the Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems. International Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA-26), April 13-17, Barcelona, Spain

@inproceedings{khadarAICHAOS2ndWorkshop2026,
 author = {Malik Khadar and Julia Cecil and Leon Van Der Neut and Nikola Banovic and Kevin Baum and Stevie Chancellor and Enrico Costanza and Motahhare Eslami and Anna Maria Feit and Susanne Gaube and Ujwal Gadiraju and Harmanpreet Kaur},
 booktitle = {CHI EA '26: Proceedings of the Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems. International Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA-26), April 13-17, Barcelona, Spain},
 doi = {10.1145/3772363.3778736},
 isbn = {979-8-4007-2281-3},
 month = {4},
 number = {article 919},
 pages = {1-6},
 publisher = {ACM, New York, NY, USA},
 title = {AI CHAOS! 2nd Workshop on the Challenges for Human Oversight of AI Systems},
 url = {https://dl.acm.org/doi/10.1145/3772363.3778736},
 year = {2026}
}
DOI URL

PGTG: Procedurally Generated Grid-Based Traffic Gym

2026 — Reinforcement Learning Journal

PDF
@article{meyerPGTGProcedurallyGeneratedGridBased2026,
 author = {Joshua Meyer and Felix Maurice Kuntz and Verena Wolf and Jörg Hoffmann and Timo P. Gros},
 journal = {Reinforcement Learning Journal},
 pages = {},
 title = {PGTG: Procedurally Generated Grid-Based Traffic Gym},
 url = {https://rlj.cs.umass.edu/2026/papers/Paper32.pdf},
 volume = {7},
 year = {2026}
}
Code Poster

Utilitarismus und das Problem kollektiven Handelns

2026 — Handbuch Utilitarismus

@inbook{baumUtilitarismusUndDasProblem2026,
 author = {Kevin Baum},
 booktitle = {Handbuch Utilitarismus},
 editor = {Vuko Andrić and Bernward Gesang},
 pages = {163-176},
 publisher = {Springer-Verlag},
 title = {Utilitarismus und das Problem kollektiven Handelns},
 url = {https://link.springer.com/chapter/10.1007/978-3-662-71326-6_16},
 year = {2026}
}
URL

What are AI systems? Rethinking the core definition in the EU AI Act

2026 — Computer Law & Security Review

PDF
@article{meinelWhatAreAISystems2026,
 author = {Philip Meinel and Kevin Baum and Holger Hermanns and Emily Pöppelmann and Markus Langer and Anne Lauber-Ronsberg},
 doi = {10.1016/j.clsr.2026.106373},
 journal = {Computer Law & Security Review},
 number = {106373},
 pages = {1-12},
 publisher = {Elsevier},
 title = {What are AI systems? Rethinking the core definition in the EU AI Act},
 url = {https://www.sciencedirect.com/science/article/pii/S2212473X26001148},
 volume = {62},
 year = {2026}
}
DOI URL

2025

12 papers

Learning Per-Domain Generalizing Policies Using Offline Reinforcement Learning

2025 — Proceedings of the Ninth Workshop on Bridging the Gap Between AI Planning and (Reinforcement) Learning (PRL @ ICAPS 2025). Workshop on Bridging the Gap Between AI Planning and Reinforcement Learning (PRL-2025), located at ICAPS'25, November 10, Melbourne, Australia

PDF
@inproceedings{mullerLearningPerDomainGeneralizingPolicies2025,
 author = {Nicola J. Müller and Moritz Oster and Timo P. Gros},
 booktitle = {Proceedings of the Ninth Workshop on Bridging the Gap Between AI Planning and (Reinforcement) Learning (PRL @ ICAPS 2025). Workshop on Bridging the Gap Between AI Planning and Reinforcement Learning (PRL-2025), located at ICAPS'25, November 10, Melbourne, Australia},
 month = {11},
 publisher = {AAAI Press},
 title = {Learning Per-Domain Generalizing Policies Using Offline Reinforcement Learning},
 url = {https://prl-theworkshop.github.io/prl2025-icaps/papers/11.pdf},
 year = {2025}
}

PyDSMC: Statistical Model Checking for Neural Agents Using the Gymnasium Interface

2025 — Quantitative Evaluation of Systems and Formal Modeling and Analysis of Timed Systems - Second International Joint Conference, Proceedings. International Joint Conference on Quantitative Evaluation of Systems and Formal Modeling and Analysis of Timed Systems (QEST+FORMATS-2025), August 26-28, Aarhus, Denmark

@inproceedings{grosPyDSMCStatisticalModelChecking2025,
 author = {Timo P. Gros and Arnd Hartmanns and Ivo Hoese and Joshua Meyer and Nicola J. Müller and Verena Wolf},
 booktitle = {Quantitative Evaluation of Systems and Formal Modeling and Analysis of Timed Systems - Second International Joint Conference, Proceedings. International Joint Conference on Quantitative Evaluation of Systems and Formal Modeling and Analysis of Timed Systems (QEST+FORMATS-2025), August 26-28, Aarhus, Denmark},
 doi = {10.1007/978-3-032-05792-1_8},
 editor = {Pavithra Prabhakar and Andrea Vandin},
 isbn = {978-3-032-05791-4},
 month = {10},
 pages = {134-156},
 publisher = {Springer Nature, Switzerland},
 series = {Lecture Notes in Computer Science, LNCS},
 title = {PyDSMC: Statistical Model Checking for Neural Agents Using the Gymnasium Interface},
 url = {https://link.springer.com/chapter/10.1007/978-3-032-05792-1_8},
 volume = {16143},
 year = {2025}
}
DOI URL

Sortability of Time Series Data

2025 — Transactions on Machine Learning Research (TMLR)

PDF
@article{lohseSortabilityOfTimeSeries2025,
 author = {Christopher Lohse and Jonas Wahl},
 editor = {Adam Arany},
 journal = {Transactions on Machine Learning Research (TMLR)},
 month = {7},
 pages = {---},
 publisher = {-},
 title = {Sortability of Time Series Data},
 url = {https://openreview.net/forum?id=OGvmCpcHdV},
 volume = {-},
 year = {2025}
}
URL

Structural Causal Bottleneck Models

2025 — UAI 2025 Workshop on Causal Abstractions and Representations. Causal Abstractions and Representations (CAR), located at UAI 2025, July 25, Rio de Janeiro, Brazil

@inproceedings{bingStructuralCausalBottleneckModels2025,
 author = {Simon Bing and Jonas Wahl and Jakob Runge},
 booktitle = {UAI 2025 Workshop on Causal Abstractions and Representations. Causal Abstractions and Representations (CAR), located at UAI 2025, July 25, Rio de Janeiro, Brazil},
 month = {6},
 publisher = {OpenReview},
 title = {Structural Causal Bottleneck Models},
 url = {https://openreview.net/forum?id=EFNvKMSITB},
 year = {2025}
}
URL

Per-Domain Generalizing Policies: On Validation Instances and Scaling Behavior

2025 — The 35th International Conference on Automated Planning and Scheduling. International Conference on Automated Planning and Scheduling (ICAPS-2025), November 9-14, Melbourne, Australia

PDF
@inproceedings{grosPerDomainGeneralizingPoliciesOn2025,
 author = {Timo P. Gros and Nicola J. Müller and Daniel Fiser and Isabel Valera and Verena Wolf and Jörg Hoffmann},
 booktitle = {The 35th International Conference on Automated Planning and Scheduling. International Conference on Automated Planning and Scheduling (ICAPS-2025), November 9-14, Melbourne, Australia},
 publisher = {AAAI Press},
 title = {Per-Domain Generalizing Policies: On Validation Instances and Scaling Behavior},
 url = {https://doi.org/10.5281/zenodo.15314878},
 year = {2025}
}
URL

A Roadmap for Responsible Robotics: Promoting Human Agency and Collaborative Efforts

2025 — IEEE Robotics & Automation Magazine

@article{araizaillanARoadmapForResponsible2025,
 author = {Dejanira Araiza-Illan and Kevin Baum and Helen Beebee and Raja Chatila and Sarah Moth-Lund Christensen and Simon Coghlan and Emily Collins and S.Kate Conroy and Alcino Cunha and Anna Dobrosovestnova and Hein Duijf and Vanessa Evers and Michael Fisher and Nico Hochgeschwender and Nadin Kökciyan and Séverin Lemaignan and Francisco Rodriguez-Lera and Sara Ljungblad and Martin Magnusson and Masoumeh Mansouri and Michael Milford and AJung Moon and Thomas M. Powers and Pericle Salvini and Teresa Scantamburlo and Nick Schuster and Marija Slavkovik and Ufuk Topcu and Daniel Vanegas and Andrzej Wasowski and Yi Yang},
 doi = {10.1109/MRA.2025.3620148},
 journal = {IEEE Robotics & Automation Magazine},
 number = {4},
 pages = {12-24},
 publisher = {IEEE},
 title = {A Roadmap for Responsible Robotics: Promoting Human Agency and Collaborative Efforts},
 url = {https://ieeexplore.ieee.org/abstract/document/11236462/authors#authors},
 volume = {32},
 year = {2025}
}
DOI URL

Aggregation Problems in Machine Ethics and AI Alignment

2025 — Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society. AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society (AIES-2025)

@inproceedings{baumAggregationProblemsInMachine2025,
 author = {Kevin Baum and Marija Slavkovik},
 booktitle = {Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society. AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society (AIES-2025)},
 doi = {10.1609/aies.v8i1.36554},
 publisher = {AAAI/ACM},
 title = {Aggregation Problems in Machine Ethics and AI Alignment},
 url = {https://ojs.aaai.org/index.php/AIES/article/view/36554},
 year = {2025}
}
DOI URL

Disentangling AI Alignment: A Structured Taxonomy Beyond Safety and Ethics

2025 — AISoLA 2024. International Conference on Bridging the Gap between AI and Reality (AiSoLA-2024)

@inproceedings{baumDisentanglingAIAlignmentA2025,
 author = {Kevin Baum},
 booktitle = {AISoLA 2024. International Conference on Bridging the Gap between AI and Reality (AiSoLA-2024)},
 doi = {10.48550/arXiv.2506.06286},
 publisher = {Springer NAture Switzerland},
 title = {Disentangling AI Alignment: A Structured Taxonomy Beyond Safety and Ethics},
 url = {https://link.springer.com/chapter/10.1007/978-3-032-01377-4_8},
 year = {2025}
}
DOI URL

How do we assess the trustworthiness of AI? Introducing the trustworthiness assessment model (TrAM)

2025 — Computers in Human Behavior

PDF
@article{schlickerHowDoWeAssess2025,
 author = {Nadine Schlicker and Kevin Baum and Alarith Ude and Sarah Sterz and Martin C. Hirsch and Markus Langer},
 editor = {Matthieu J. Guitton},
 journal = {Computers in Human Behavior},
 pages = {1-19},
 publisher = {Elsevier},
 title = {How do we assess the trustworthiness of AI? Introducing the trustworthiness assessment model (TrAM)},
 url = {https://www.sciencedirect.com/science/article/pii/S0747563225001189},
 volume = {170},
 year = {2025}
}
URL

Justifications for Democratizing AI Alignment and Their Prospects

2025 — AISoLA 2025. International Conference on Bridging the Gap between AI and Reality (AiSoLA-2025)

@inproceedings{baumJustificationsForDemocratizingAI2025,
 author = {Kevin Baum and Andre Steingrüber},
 booktitle = {AISoLA 2025. International Conference on Bridging the Gap between AI and Reality (AiSoLA-2025)},
 publisher = {Springer Nature Switzerland},
 title = {Justifications for Democratizing AI Alignment and Their Prospects},
 url = {https://arxiv.org/abs/2507.19548},
 year = {2025}
}
URL

On the Complexities of Testing for Compliance with Human Oversight Requirements in AI Regulation

2025 — International Conference on Bridging the Gap between AI and Reality. International Conference on Bridging the Gap between AI and Reality (AiSoLA-2025)

@inproceedings{langerOnTheComplexitiesOf2025,
 author = {Markus Langer and Veronika Lazar and Kevin Baum},
 booktitle = {International Conference on Bridging the Gap between AI and Reality. International Conference on Bridging the Gap between AI and Reality (AiSoLA-2025)},
 pages = {160-169},
 publisher = {Springer Nature Switzerland},
 title = {On the Complexities of Testing for Compliance with Human Oversight Requirements in AI Regulation},
 url = {https://www.dfki.de/fileadmin/user_upload/import/16858_978-3-032-07132-3.pdf},
 year = {2025}
}

Responsible and Trusted AI: An Interdisciplinary Perspective (2025)

2025 — International Conference on Bridging the Gap between AI and Reality. International Conference on Bridging the Gap between AI and Reality (AiSoLA-2025)

@inproceedings{kerstanResponsibleAndTrustedAI2025,
 author = {Sophia Kerstan and Kevin Baum and Thorsten Helfer and Markus Langer and Eva Schmidt and Andreas Sesing-Wagenpfeil and Timo Speith},
 booktitle = {International Conference on Bridging the Gap between AI and Reality. International Conference on Bridging the Gap between AI and Reality (AiSoLA-2025)},
 pages = {141-145},
 publisher = {Springer Nature Switzerland},
 title = {Responsible and Trusted AI: An Interdisciplinary Perspective (2025)},
 url = {https://www.dfki.de/fileadmin/user_upload/import/16856_978-3-032-07132-3.pdf},
 year = {2025}
}

2024

6 papers

Responsible and Trusted AI: An Interdisciplinary Perspective

2024 — Bridging the Gap Between AI and Reality - Second International Conference, Proceedings. International Conference on Bridging the Gap between AI and Reality (AiSoLA-2024), October 30 - November 3, Crete, Greece

@inproceedings{helferResponsibleAndTrustedAI2024,
 author = {Thorsten Helfer and Kevin Baum and Andreas Sesing-Wagenpfeil and Eva Schmidt and Markus Langer},
 booktitle = {Bridging the Gap Between AI and Reality - Second International Conference, Proceedings. International Conference on Bridging the Gap between AI and Reality (AiSoLA-2024), October 30 - November 3, Crete, Greece},
 doi = {10.1007/978-3-031-75434-0_3},
 edition = {1},
 editor = {Bernhard Steffen},
 isbn = {978-3-031-75433-3},
 month = {12},
 pages = {35-39},
 publisher = {Springer, Cham},
 series = {Lecture Notes in Computer Science, LNCS},
 title = {Responsible and Trusted AI: An Interdisciplinary Perspective},
 volume = {15217},
 year = {2024}
}
DOI

Transparent Transparency Developing a Scheme for Understanding Transparency Requirements

2024 — Bridging the Gap Between AI and Reality - Second International Conference, Proceedings. International Conference on Bridging the Gap between AI and Reality (AiSoLA-2024), October 30 - November 3, Crete, Greece

@inproceedings{baumTransparentTransparencyDevelopingA2024,
 author = {Deborah Baum and Kevin Baum and Sasha Zamani and Christian Bennoit and Dirk Werth},
 booktitle = {Bridging the Gap Between AI and Reality - Second International Conference, Proceedings. International Conference on Bridging the Gap between AI and Reality (AiSoLA-2024), October 30 - November 3, Crete, Greece},
 doi = {10.1007/978-3-031-75434-0_5},
 edition = {1},
 editor = {Bernhard Steffen},
 isbn = {978-3-031-75433-3},
 month = {12},
 pages = {55-73},
 publisher = {Springer, Cham},
 series = {Lecture Notes in Computer Science, LNCS},
 title = {Transparent Transparency Developing a Scheme for Understanding Transparency Requirements},
 volume = {15217},
 year = {2024}
}
DOI

Effective Human Oversight of AI-Based Systems: A Signal Detection Perspective on the Detection of Inaccurate and Unfair Outputs

2024 — Minds and Machines - Journal for Artificial Intelligence, Philosophy and Cognitive Science

@article{langerEffectiveHumanOversightOf2024,
 author = {Markus Langer and Kevin Baum and Nadine Schlicker},
 doi = {10.1007/s11023-024-09701-0},
 journal = {Minds and Machines - Journal for Artificial Intelligence, Philosophy and Cognitive Science},
 month = {11},
 number = {1},
 pages = {1-30},
 publisher = {Springer Nature},
 title = {Effective Human Oversight of AI-Based Systems: A Signal Detection Perspective on the Detection of Inaccurate and Unfair Outputs},
 volume = {35},
 year = {2024}
}
DOI

Taming the AI Monster: Monitoring of Individual Fairness for Effective Human Oversight

2024 — Model Checking Software - 30th International Symposium - Proceedings. International Symposium on Model Checking Software (SPIN-2024), April 8-9, Luxembourg City, Luxembourg

@inproceedings{baumTamingTheAIMonster2024,
 author = {Kevin Baum and Biewer Sebastian and Hermanns Holger and Hetmank Sven and Langer Markus and Lauber-Rönsberg Anne and Sterz Sarah},
 booktitle = {Model Checking Software - 30th International Symposium - Proceedings. International Symposium on Model Checking Software (SPIN-2024), April 8-9, Luxembourg City, Luxembourg},
 doi = {10.1007/978-3-031-66149-5_1},
 editor = {Thomas Neele and Anton Wijs},
 month = {10},
 pages = {3-25},
 publisher = {Springer Nature, Switzerland},
 series = {Lecture Notes in Computer Science, LNCS},
 title = {Taming the AI Monster: Monitoring of Individual Fairness for Effective Human Oversight},
 volume = {14624},
 year = {2024}
}
DOI

Software doping analysis for human oversight

2024 — Formal Methods in System Design

PDF
@article{biewerSoftwareDopingAnalysisFor2024,
 author = {Sebastian Biewer and Kevin Baum and Sarah Sterz and Holger Hermanns and Sven Hetmank and Markus Langer and Anne Lauber-Rönsberg and Franz Lehr},
 doi = {10.1007/s10703-024-00445-2},
 journal = {Formal Methods in System Design},
 month = {4},
 pages = {1-50},
 publisher = {Springer},
 title = {Software doping analysis for human oversight},
 url = {https://link.springer.com/article/10.1007/s10703-024-00445-2#Abs1},
 volume = {62},
 year = {2024}
}
DOI URL

On the Quest for Effectiveness in Human Oversight: Interdisciplinary Perspectives

2024 — Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency. ACM Conference on Fairness, Accountability, and Transparency (ACM FAccT-2024), June 3-6, Rio de Janeiro, Brazil

@inproceedings{sterzOnTheQuestFor2024,
 author = {Sarah Sterz and Kevin Baum and Sebastian Biewer and Holger Hermanns and Anne Lauber-Rönsberg and Philip Meinel and Markus Langer},
 booktitle = {Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency. ACM Conference on Fairness, Accountability, and Transparency (ACM FAccT-2024), June 3-6, Rio de Janeiro, Brazil},
 doi = {10.1145/3630106.3659051},
 isbn = {979-8-4007-0450-5},
 pages = {2495-2507},
 publisher = {Association for Computing Machinery, New York, NY, USA},
 title = {On the Quest for Effectiveness in Human Oversight: Interdisciplinary Perspectives},
 url = {https://arxiv.org/abs/2404.04059},
 year = {2024}
}
DOI URL