NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “inference infrastructure”

27 tools in the directory · Updated

“inference infrastructure”Ways to use: SDK / libraryUpdated: last 7 daysShowing 27 tools
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • vLLMby vLLMLLM inference and serving library.Free
  • Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
  • Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
  • Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
  • Notteby NotteYC S25Browser infrastructure and agent tools for web automation.Freemium
  • Tensorlake Sandboxesby TensorlakeIsolated cloud sandboxes for running AI agents, code, and workloads.Freemium
  • Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
  • TabPFNby Prior LabsA tabular foundation model for predictions on structured data.Freemium
  • SpeechBrainby SpeechBrainOpen-source Python toolkit for speech and conversational AI research and development.Free
  • Perseusby LettriaA graph-building platform for generating ontologies and knowledge graphs from domain data.Freemium
  • H Platformby H CompanyA platform for building, running, and monitoring computer-use agents across browser, desktop, and enterprise environments.Freemium
  • Nightfallby NightfallAI detection and policy controls for sensitive-data movementContact sales
  • Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium
  • Pruna AIby Pruna AIAPI access to performance-optimized image and video modelsPay as you go
  • mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.Free
  • MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
  • Maisa AIby Maisa AIMaisa AI provides Digital Workers for automating complex business processes.Contact sales
  • Mindbreeze InSpireby MindbreezeEnterprise knowledge and AI search platform that connects business information for contextual answers and AI-enabled workflows.Contact sales
  • Rhino Federated Computing Platformby Rhino Federated ComputingFederated computing platform for AI, analytics, and data workflows across distributed data environments.Contact sales
  • Griptapeby GriptapePython framework for AI agents, retrieval and structured workflows.Unknown
  • AgileRLby AgileRLOpen-source Python library for reinforcement learning and language-model post-training.Contact sales
  • UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
  • Superagentby SuperagentYC W24Security operations for repositories, applications, and AI agents.Freemium
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “inference infrastructure” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how