- Tool type
- Agent evaluation and replay tool
- Made for
- Developers improving AI agent reliability
- Runs on
- Local CLI and hosted review service
What it does
Kitaru is an open-source tool for reviewing agent traces, running evaluations and replaying changes against recorded sessions. It imports traces from existing observability systems or records runs through supported agent-framework adapters. Analyzers look across sessions for patterns such as failed or repeated tool calls; teams can turn a finding into an evaluation check and test a proposed fix.
Local sessions and replays run on the user’s machine with their chosen model keys. The hosted AI engineer adds guided review of traces and evaluations, asking users to judge examples and helping identify missing checks. Kitaru is useful for teams improving an agent from real usage rather than relying only on a static test set. Model calls during replay still incur provider usage and rate limits, and recorded tool responses do not reproduce every possible live-system change.
What it can do
- Trace import
- Cross-session analysis
- Evaluation checks
- Recorded-session replay
- Agent SDK adapters
- Local review
Works with
- Langfuse
- LangSmith
- Braintrust
- Phoenix
- OpenAI Agents SDK
- LangGraph
Before you choose
- Local operation uses your own model keys and provider limits.
- Hosted AI-engineer access is paid after the trial.
Listed under
Get started
- Install Kitaru and import traces or connect an agent adapter.
- Review patterns and run existing or new evaluators.
- Replay a change on recorded sessions and inspect the results.
Plans and prices
Prices in USDKitaru is Apache 2.0 software. Hosted Starter is $39/month with a 14-day trial; provider calls use your own model keys and can incur separate charges.
14-day free trial.
Source: zenml.io/pricing, checked 30 Oct 2026. Prices can change; check before you buy.
Sources for this overview
Product pages, documentation, and pricing checked 30 Oct 2026. Each source supports part of the overview; availability and prices can change.
- Kitaru: insights and evals from your agent's traces | ZenML Labs ↗www.zenml.io
- Pricing - ZenML ↗www.zenml.io
Ratings and reviews
No ratings for Kitaru yet.
What’s changed
Free accountSignals
Free accountData and security
Free accountCompare with similar tools
Free accountWhere this comes from
How we research- Company website
- zenml.io: product, pricing and policy pages
- Social accounts
- Accounts the company links, and its posts on X
- Human review
- Checked by a person
- knowledge_base
- manual_review
Last checked 30 Oct 2026. Every field keeps its source and date; unknown means we couldn’t confirm it.