What is Agent Conformance Checking?

Agent Conformance Checking verifies whether an autonomously acting AI agent stayed within the process, role, and policy boundaries defined for it. The agent’s actual behavior is compared against a target model – analogous to classic Conformance Checking, but with the agent as the acting party. Deviations such as disallowed tool calls, skipped approvals, or actions outside its mandate become visible.

Why does this matter?

As autonomy increases, the accountability question shifts: not only humans but also agents must be able to demonstrate that they acted in compliance. Regulatory requirements such as the EU AI Act demand traceability and logging – Agent Conformance Checking provides the auditable basis for this.