ToolsCompaniesAbout

Results for “llm framework”

222 tools in this category · Updated

“llm framework”CodingRuns on APIShowing 222 tools
  • RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
  • Foundation Models frameworkby AppleNative Swift API for adding language models to Apple appsUnknown
  • any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
  • Deepchecks LLM Evaluationby DeepchecksProduction-grade LLM evaluation, testing, and monitoring platformPaid
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • Haystackby deepsetOpen-source Python framework for building RAG, agent, and multimodal LLM applicationsFreemium
  • vLLMby vLLMLLM inference and serving library.Free
  • Agent Observability (Datadog LLM Observability)by DatadogEvaluate, improve, and trace AI agents in one Datadog platformFreemium
  • DeepEvalby Confident AIYC W25Open-source LLM evaluation framework for testing AI agents and appsUnknown
  • Nebius Token Factoryby Nebius GroupHosted inference API for open LLMs, with playground, fine-tuning, and framework integrations.Pay as you go
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
  • Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium
  • Grafana Cloud Agent Observabilityby Grafana LabsMonitor, evaluate, and improve production LLM agents in Grafana CloudFreemium
  • Sentry Agent Tracingby SentryTraces AI agent runs and LLM calls inside Sentry application monitoringFreemium
  • Graphitiby Zep AIYC W24Open-source framework for temporal context graphsFree
  • DSPyby Stanford NLPOpen-source Python framework for programming and optimizing language-model pipelines.Unknown
  • Ragasby RagasOpen-source library for evaluating LLM applications with metrics and eval loopsUnknown
  • Pydantic AIby PydanticOpen source Python framework for typed AI agents with validation and durable runsFreemium
  • LiveKitby LiveKitOpen source framework and cloud platform for building voice, video and robotics AI agentsFreemium
  • CoreWeave Serverless RLby CoreWeaveManaged reinforcement learning training for LLM agents, with trained checkpoints hosted for inference.Unknown
  • AI SDKby VercelOpen-source TypeScript toolkit for adding LLMs and agents to apps through one provider-neutral API.Free
  • Rayby AnyscaleOpen-source Python framework for scaling AI and ML workloadsFree
  • Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown