MMODELYST
Papers/Learning Correct Behavior from Examples: Validating Sequential Execution in Autonomous Agents
PAP

Learning Correct Behavior from Examples: Validating Sequential Execution in Autonomous Agents

May 4, 2026

arXiv
Abstract

As autonomous agents become increasingly sophisticated, validating their sequential behavior presents a significant challenge. Traditional testing approaches require manual specification, exact sequence matching, or thousands of training examples. We present a novel algorithm that automatically learns correct behavior from just 2-10 passing execution traces and validates new executions against this learned model. Our approach combines dominator analysis from compiler theory with multimodal large language model-powered semantic understanding to identify essential states and handle non-deterministic behavior. The system constructs a generalized ground truth model using Prefix Tree Acceptors, merges traces through multi-tiered equivalence detection, and validates new executions via topological subsequence matching. In controlled experiments, our system achieved high accuracy in detecting product bugs and false successes using only 3 training traces. This approach provides explainable validation results with coverage metrics and works across diverse domains including UI testing, code generation, and robotic processes.

Select text to highlight · click a highlight to remove · saved in this browser only
Authors
Reshabh K Sharma, Gaurav Mittal, Yu Hu
Your notes (browser-local)
saved
arXiv:2605.03159