NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm inference”

19 tools in the directory · Updated

“llm inference”Download or installWays to use: WebShowing 19 tools
  • AnythingLLMby AnythingLLMYC S22Private AI assistant that runs on your own computerFreemium
  • LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
  • AI SDKby VercelOpen-source TypeScript toolkit for adding LLMs and agents to apps through one provider-neutral API.Free
  • ChainForgeby ChainForgeOpen-source visual environment for prompt engineering and LLM evaluation.Free
  • A. (A Dot)by SK TelecomManage conversations, notes and daily plans with a Korean AI assistantUnknown
  • Coderby CoderSelf-hosted platform for governed AI coding agents and developer workspacesFreemium
  • DataLineby DataLineChat with data to generate tables, charts, and dashboards.Unknown
  • Codeflashby CodeflashCodeflash optimizes code and benchmarks changes while checking whether behavior is preserved.Freemium
  • Data Formulatorby MicrosoftOpen-source AI data exploration with branching visualization threadsFree
  • Archestraby ArchestraOpen-source AI infrastructure for controlling agent access, tools, and model spendFreemium
  • Pydantic AIby PydanticOpen source Python framework for typed AI agents with validation and durable runsFreemium
  • OpenHandsby OpenHandsOpen-source platform for running coding agents on engineering workFreemium
  • Biomniby BiomniA biomedical AI agent that plans and executes research tasks using language-model reasoning, retrieval, and code-based tools.Unknown
  • Elysiaby WeaviateOpen-source agentic platform that routes queries through a decision tree of tools.Free
  • Antonby MindsDBYC W20Open-source terminal agent that turns outcome-based requests into executed stepsFreemium
  • DeepSeekby DeepSeekFree official DeepSeek chat assistant for phone and desktop, with web search, Deep-Think mode and file upload.Free
  • OpenCodeby AnomalyYC W21Open source AI coding agent for terminal, desktop, and IDEFreemium
  • Sourcebotby SourcebotYC F25Self-hosted code search and AI codebase understanding for people and agents.Freemium
  • OpenWorkby OpenWorkYC X26Open-source AI workspace for working with models on your files.Freemium

That’s all 19 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm inference” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how