Ship your AI agents with confidence

Open source agent simulation framework. Point it at your policy, auto-generate adversarial scenarios, and verify every response — no hand-written test cases required.

pip install synkro

TRUSTED BY APPLIED AI TEAMS AT

DeepMindMetaPalo Alto NetworksAmazon... and many others

Why Simulate?

Catch policy violations before production.

Agent Simulation

Run auto-generated scenarios against your live agent with a simulated user. Multi-turn conversations, not just single prompts.

Policy Verification

Every conversation verified for rule compliance, contradictions, and hallucinations. Know exactly where your agent breaks.

Adversarial Testing

Simulated users push back, escalate, and try to break your agent's guardrails. Find failures before your users do.

Coverage Tracking

Track which policy rules are tested and identify gaps — like code coverage for agents.

Training Data

Generate Conversation, Instruction, Evaluation, and Tool Calling datasets from simulation results.

Any LLM

OpenAI, Anthropic, Google, Ollama, vLLM — use any model for simulation and verification.

How it works

Five steps. Policy in, verified agent out.

01

Extract Rules

Reads your policy, extracts structured rules into a Logic Map.

02

Generate Scenarios

Auto-generates diverse test cases: positive, negative, edge cases, adversarial.

03

Simulate Conversations

LLM-driven simulated user runs each scenario against your agent.

04

Verify Every Response

Separate verifier checks every response against extracted rules.

05

Get Results

Pass/fail per scenario, transcripts, rule violations, exportable datasets.

Blends Seamlessly Into Your Existing Stack

Works with any LLM provider or evaluation platform.

OpenAI OpenAI
Anthropic Anthropic
Gemini Gemini
Ollama Ollama
vLLM vLLM
LangSmith LangSmith
Langfuse Langfuse
OpenAI OpenAI
Anthropic Anthropic
Gemini Gemini
Ollama Ollama
vLLM vLLM
LangSmith LangSmith
Langfuse Langfuse
OpenAI OpenAI
Anthropic Anthropic
Gemini Gemini
Ollama Ollama
vLLM vLLM
LangSmith LangSmith
Langfuse Langfuse
OpenAI OpenAI
Anthropic Anthropic
Gemini Gemini
Ollama Ollama
vLLM vLLM
LangSmith LangSmith
Langfuse Langfuse