NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm framework”

27 tools in the directory · Updated

“llm framework”Download or installUpdated: last 7 daysShowing 27 tools
  • vLLMby vLLMLLM inference and serving library.Free
  • Ragasby RagasOpen-source library for evaluating LLM applications with metrics and eval loopsUnknown
  • PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
  • Pipecatby PipecatOpen source framework for building real-time voice and multimodal AI agentsFreemium
  • Griptapeby GriptapePython framework for AI agents, retrieval and structured workflows.Unknown
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • OpenSpecby OpenSpecYC W26A lightweight, configurable framework for writing and managing software specs alongside AI coding toolsFree
  • ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free
  • Guardrails AIby Guardrails AIValidate model inputs and outputs with reusable Python guardsContact sales
  • OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
  • BAMLby BoundaryYC W23A typed programming language for AI agents and existing codebases.Free
  • A. (A Dot)by SK TelecomManage conversations, notes and daily plans with a Korean AI assistantUnknown
  • Coderby CoderSelf-hosted platform for governed AI coding agents and developer workspacesFreemium
  • Kilnby Kiln AIDesktop workbench and Python library for developing and evaluating AI systems.Freemium
  • DataLineby DataLineChat with data to generate tables, charts, and dashboards.Unknown
  • Vannaby Vanna AILet users ask questions across databases through an AI SQL agentFreemium
  • Archestraby ArchestraOpen-source AI infrastructure for controlling agent access, tools, and model spendFreemium
  • CARBON by Testers.aiby testers.aiAI-assisted software testing harness for coding agentsFree
  • ECA - Editor Code Assistantby ECAOpen-source AI coding assistant connecting language models with editors, a desktop app, or a terminal client.Free
  • Biomniby BiomniA biomedical AI agent that plans and executes research tasks using language-model reasoning, retrieval, and code-based tools.Unknown
  • AgileRLby AgileRLOpen-source Python library for reinforcement learning and language-model post-training.Contact sales
  • PandasAIby PandasAIYC W24A Python library for asking questions about data in natural language and generating analyses, charts, and data transformations.€29.99+/mo
  • Sourcebotby SourcebotYC F25Self-hosted code search and AI codebase understanding for people and agents.Freemium
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm framework” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how