NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “ai agent evaluation”

111 tools in this category · Updated

“ai agent evaluation”CodingBacked by Y CombinatorShowing 111 tools
  • AgentMailby AgentMailYC S25Email inboxes and an API for AI agents to send, receive, and manage email.Freemium
  • DeepEvalby Confident AIYC W25Open-source LLM evaluation framework for testing AI agents and appsUnknown
  • Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown
  • Credal.aiby Credal.aiYC W23Build governed MCP servers and agents around enterprise contextContact sales
  • Tiptap AI Toolkitby TiptapYC S23Lets AI agents read and edit rich-text Tiptap documents in placeContact sales
  • Rosebud AIby Rosebud AIYC S19AI-assisted game creation and game asset generation, with a CLI for coding agentsFreemium
  • UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
  • Cekuraby CekuraYC F24Testing, monitoring, and evaluation for voice and chat AI agents.Unknown
  • Hamming AIby Hamming AIYC S24Testing, red-teaming and production monitoring for voice and chat agentsContact sales
  • Zep AIby Zep AIYC W24Governed context layer for agents built from business data, documents, and conversationsFreemium
  • Covalby CovalYC S24Voice AI testing, evaluation, and quality monitoring$100+/moFree trial
  • Klavis MCPby Klavis AIYC X25Connect agents to application tools through open-source MCP integrationsFree
  • 21st AIby 21stYC W26Generate and compare several UI component designs from a promptPaid
  • Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
  • PostHog AI Observabilityby PostHogYC W20Trace, evaluate, and cost-track LLM calls inside PostHogFreemium
  • Laminarby LaminarYC S24Trace AI agents and find recurring failures across their runsFreemium
  • Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium
  • Mastraby MastraYC W25Open-source TypeScript framework for building AI agents and appsFreemium
  • Confident AIby Confident AIYC W25AI quality platform for evaluating, tracing, and monitoring LLM applications across teams.Freemium
  • Wallyby RunAnywhereYC W26Hosted open models behind one OpenAI-compatible API and a CLI for coding agentsPay as you go
  • Spline MCPby SplineYC W21Connect an AI agent to build and edit live 3D scenes in SplineFreemium
  • Exa Search APIby ExaYC S21Web search API that returns ranked results with page text, highlights, and AI summaries for AI agents and apps.Pay as you go
  • Graphitiby Zep AIYC W24Open-source framework for temporal context graphsFree
  • Tavus Conversational Video Interface (CVI)by TavusYC S21Real-time face-to-face AI video agents built on Tavus APIsUnknown
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “ai agent evaluation” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how