NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm-pipelines”

232 tools in this category · Updated

“llm-pipelines”CodingShowing 232 tools
  • Deepchecks LLM Evaluationby DeepchecksProduction-grade LLM evaluation, testing, and monitoring platformPaid
  • any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
  • vLLMby vLLMLLM inference and serving library.Free
  • Agent Observability (Datadog LLM Observability)by DatadogEvaluate, improve, and trace AI agents in one Datadog platformFreemium
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
  • .txt APIby .txtStructured outputs API that enforces JSON Schema, regex, and grammar constraints on LLM responses.Pay as you go
  • Haystackby deepsetOpen-source Python framework for building RAG, agent, and multimodal LLM applicationsFreemium
  • ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
  • DSPyby Stanford NLPOpen-source Python framework for programming and optimizing language-model pipelines.Unknown
  • DeepEvalby Confident AIYC W25Open-source LLM evaluation framework for testing AI agents and appsUnknown
  • Opikby CometOpen-source observability and evaluation for LLM and agent applicationsFreemium
  • Difyby DifyOpen-source platform for building agentic workflows, RAG pipelines, and AI apps.Freemium
  • Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown
  • Fabric Gatewayby PostmanGoverned gateway for LLMs, MCP servers, and internal APIsFreemium
  • Agora Conversational AI Engineby AgoraVoice AI agent engine that connects any LLM to real-time speech.Pay as you go
  • Nutrient DWS AI Gateway APIby NutrientOpenAI-compatible LLM gateway for document workflowsFreemium
  • Maia by Matillionby MatillionAI data automation platform for building and running data pipelinesPay as you go
  • Grafana Cloud Agent Observabilityby Grafana LabsMonitor, evaluate, and improve production LLM agents in Grafana CloudFreemium
  • Sentry Agent Tracingby SentryTraces AI agent runs and LLM calls inside Sentry application monitoringFreemium
  • Merge Gatewayby MergeOne API for every major LLM, with routing, spend controls, and observabilityFreemium
  • BrazeAI Agent Consoleby BrazeBraze's no-code dashboard for building custom LLM-powered agents that enrich data and personalize Canvas journeys.Contact sales
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm-pipelines” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how