NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “ml infrastructure”

9 tools in the directory · Updated

“ml infrastructure”Download or installWays to use: APIShowing 9 tools
  • Archestraby ArchestraOpen-source AI infrastructure for controlling agent access, tools, and model spendFreemium
  • vLLMby vLLMLLM inference and serving library.Free
  • Roboflow Inferenceby RoboflowYC S20Self-hosted computer vision inference server with WorkflowsFree
  • Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • Milvusby ZillizOpen-source vector database for large-scale AI search and retrievalFreemium
  • Cogneeby CogneeOpen-source memory engine for AI agents, with a hosted option.Freemium
  • LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
  • Sourcebotby SourcebotYC F25Self-hosted code search and AI codebase understanding for people and agents.Freemium

That’s all 9 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “ml infrastructure” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how