AgentOps Dispatch
Agent Evaluation
Latest research
Agent Evaluation
Human Evaluation Protocols for Open-Ended Agent Tasks
Evaluating agent systems requires inspecting their decision paths, not just their final answers.
- Counterfactual Testing for Agent Decision PointsIdentifying which agent decisions actually caused failures, not just where they appeared.
- Regression Testing Pipelines for Iterative Agent DevelopmentAutomated testing catches AI agents answering the wrong question while appearing to succeed.
- Eval Harness Design for Tool-Using AgentsHarness design choices shape agent performance as much as the underlying model weights do.
- Trajectory Annotation for Agentic Task DatasetsStructuring how AI systems label multi-step task data at scale.
Agent Evaluation
View all →- Human Evaluation Protocols for Open-Ended Agent TasksEvaluating agent systems requires inspecting their decision paths, not just their final answers.
- Counterfactual Testing for Agent Decision PointsIdentifying which agent decisions actually caused failures, not just where they appeared.
- Regression Testing Pipelines for Iterative Agent DevelopmentAutomated testing catches AI agents answering the wrong question while appearing to succeed.
- Eval Harness Design for Tool-Using AgentsHarness design choices shape agent performance as much as the underlying model weights do.