ToolsCompaniesAbout

Results for “llm framework”

90 tools in this category · Updated

“llm framework”CodingRuns on Command lineShowing 90 tools
  • Foundation Models frameworkby AppleNative Swift API for adding language models to Apple appsUnknown
  • Haystackby deepsetOpen-source Python framework for building RAG, agent, and multimodal LLM applicationsFreemium
  • vLLMby vLLMLLM inference and serving library.Free
  • DeepEvalby Confident AIYC W25Open-source LLM evaluation framework for testing AI agents and appsUnknown
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • Graphitiby Zep AIYC W24Open-source framework for temporal context graphsFree
  • LiveKitby LiveKitOpen source framework and cloud platform for building voice, video and robotics AI agentsFreemium
  • AI SDKby VercelOpen-source TypeScript toolkit for adding LLMs and agents to apps through one provider-neutral API.Free
  • LangChainby LangChainOpen source framework for building agents that work with many models and toolsFree
  • Rayby AnyscaleOpen-source Python framework for scaling AI and ML workloadsFree
  • Google ADKby GoogleOpen-source framework for building, testing and deploying AI agents in codeFree
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • .txt APIby .txtStructured outputs API that enforces JSON Schema, regex, and grammar constraints on LLM responses.Pay as you go
  • Pipecatby PipecatOpen source framework for building real-time voice and multimodal AI agentsFreemium
  • OpenAI Agents SDKby OpenAIOpen-source Python framework for building multi-agent apps with tools, handoffs and guardrails.Pay as you go
  • AutoGenby MicrosoftArchived open-source Python and .NET framework for multi-agent AI applicationsFree
  • LiveKit Agentsby LiveKitOpen-source Python and TypeScript framework for building realtime voice and video AI agentsFreemium
  • Sakana AIby Sakana AISakana AI API for Fugu orchestration models and the Japanese-focused Sakana Namazu LLM.Pay as you go
  • Opikby CometOpen-source observability and evaluation for LLM and agent applicationsFreemium
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • MegEngineby MEGVIITrain and deploy deep-learning models with one frameworkFree
  • Langfuseby LangfuseYC W23Open-source platform for tracing, evaluating, and improving LLM and agent applicationsFreemium
  • Mastraby MastraYC W25Open-source TypeScript framework for building AI agents and appsFreemium