NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “private inference”

45 tools in the directory · Updated

“private inference”Ways to use: APIUpdated: last 7 daysShowing 45 tools
  • Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
  • Makora Inferenceby MakoraAI inference service with agent-driven optimization across the serving stack$20+/mo
  • CompactifAIby Multiverse ComputingModel compression and access to compressed AI models through managed API or private deployment.Contact sales
  • io.intelligenceby io.netUse multiple AI models through one inference API and studioPaid
  • Vast.aiby Vast.aiProvision GPU compute for AI training and inferencePay as you go
  • Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • vLLMby vLLMLLM inference and serving library.Free
  • Inceptronby InceptronInference platform for deploying, optimizing, and scaling AI models.Pay as you go
  • AkashMLby AkashMLManaged AI inference for developers through a browser playground and compatible APIs.Pay as you go
  • VectorShiftby VectorShiftYC S23Analyze private-market deals using a firm’s connected knowledgeContact sales
  • Epsillaby EpsillaYC S23A no-code and configurable platform for building domain-specific AI agents with private knowledge.Freemium
  • Relaceby RelaceYC W23API access to open-weight inference models, with additional tools and infrastructure for coding agents.Pay as you go
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • llamafileby Mozilla.aiRun local language models from portable executable filesFree
  • Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
  • TabPFNby Prior LabsA tabular foundation model for predictions on structured data.Freemium
  • Mixedbreadby MixedbreadTurn files into searchable evidence for AI agentsFreemium
  • Guardrails AIby Guardrails AIValidate model inputs and outputs with reusable Python guardsContact sales
  • Interplayby Iterate.aiLow-code platform for building, running, and scaling agentic AI workflows across enterprise systems.Contact sales
  • FaceMe Platformby CyberLinkServe face-verification APIs from enterprise infrastructureContact sales
  • Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
  • encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
  • cqby Mozilla.aiShare reviewed operational knowledge across AI agentsFree
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “private inference” there, and it checks these same records.