ToolsCompaniesAbout

Results for “llm framework”

49 tools in this category · Updated

“llm framework”CodingDownload or installShowing 49 tools
  • Foundation Models frameworkby AppleNative Swift API for adding language models to Apple appsUnknown
  • Haystackby deepsetOpen-source Python framework for building RAG, agent, and multimodal LLM applicationsFreemium
  • vLLMby vLLMLLM inference and serving library.Free
  • DeepEvalby Confident AIYC W25Open-source LLM evaluation framework for testing AI agents and appsUnknown
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
  • Ragasby RagasOpen-source library for evaluating LLM applications with metrics and eval loopsUnknown
  • Pydantic AIby PydanticOpen source Python framework for typed AI agents with validation and durable runsFreemium
  • AI SDKby VercelOpen-source TypeScript toolkit for adding LLMs and agents to apps through one provider-neutral API.Free
  • Rayby AnyscaleOpen-source Python framework for scaling AI and ML workloadsFree
  • PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
  • Google ADKby GoogleOpen-source framework for building, testing and deploying AI agents in codeFree
  • Towheeby ZillizOpen-source framework for building embedding pipelines over unstructured dataFree
  • Pipecatby PipecatOpen source framework for building real-time voice and multimodal AI agentsFreemium
  • OpenAI Agents SDKby OpenAIOpen-source Python framework for building multi-agent apps with tools, handoffs and guardrails.Pay as you go
  • Griptapeby GriptapePython framework for AI agents, retrieval and structured workflows.Unknown
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Mastraby MastraYC W25Open-source TypeScript framework for building AI agents and appsFreemium
  • OpenSpecby OpenSpecYC W26A lightweight, configurable framework for writing and managing software specs alongside AI coding toolsFree
  • ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free
  • LangMem SDKby LangChainPython library that gives agents long-term memory and prompt-based learningFree
  • smolagentsby Hugging FaceOpen-source Python library for building agents that write their actions as codeFree
  • OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
  • Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFree