NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “inference infrastructure”

27 tools in the directory · Updated

“inference infrastructure”Ways to use: MacShowing 27 tools
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
  • Kilo Codeby Kilo CodeOpen-source AI coding agent for IDEs, terminal, cloud and SlackFreemium
  • MindsHubby MindsDBYC W20Shared AI model access, agents, and spending controls for teamsFreemium
  • Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
  • StepFun (阶跃星辰)by StepFunStepFun model API for language, speech, and image modelsPay as you go
  • LM Studio Bionicby LM StudioDesktop AI agent for coding and document work with open modelsFreemium
  • Warp Terminalby WarpAgentic terminal for shared, agent-assisted developmentFreemium
  • Interplayby Iterate.aiLow-code platform for building, running, and scaling agentic AI workflows across enterprise systems.Contact sales
  • Ampby AmpCoding agent and dev environment for building from anywhereFreemium
  • Codexby OpenAIOpenAI's coding agent for terminal, desktop, IDE and cloud repository workFreemium
  • Devin Desktopby CognitionDesktop IDE for managing local and cloud coding agentsFreemium
  • Cursorby AnysphereCoding agent for desktop, terminal, Slack and GitHubFreemium
  • Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium
  • RunAnywhereby RunAnywhereYC W26Hosted open models behind one OpenAI-compatible API key and CLIPay as you go
  • Nutrient DWS Data Extraction APIby NutrientParses PDFs, scans, images and Office files into Markdown or spatial JSON, with schema-based field extraction.Freemium
  • Snowflake CoCoby SnowflakeData-native AI coding agent for Snowflake workflowsPay as you go
  • Bifrostby Maxim AIAI gateway and laptop-level AI traffic governance for enterprisesFreemium
  • Nightfallby NightfallAI detection and policy controls for sensitive-data movementContact sales
  • Coderby CoderSelf-hosted platform for governed AI coding agents and developer workspacesFreemium
  • Msty Studioby MstyPrivate AI workspace for chatting with local and online modelsFreemium
  • TestFitby TestFitReal estate feasibility platform for AI-generated site plansPaid
  • Base44by WixDescribe an app, website or agent in plain language and get it built and hosted.Freemium
  • Claude Scienceby AnthropicAn AI research workbench that runs analyses and keeps results linked to code and data.$20+/mo
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “inference infrastructure” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how