NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “inference”

15 tools in the directory · Updated

“inference”Ways to use: SDK / libraryUpdated: last 7 daysShowing 15 tools
  • Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
  • vLLMby vLLMLLM inference and serving library.Free
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Nightfallby NightfallAI detection and policy controls for sensitive-data movementContact sales
  • Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
  • Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium
  • Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
  • Pruna AIby Pruna AIAPI access to performance-optimized image and video modelsPay as you go
  • TabPFNby Prior LabsA tabular foundation model for predictions on structured data.Freemium
  • Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
  • mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.Free
  • Rhino Federated Computing Platformby Rhino Federated ComputingFederated computing platform for AI, analytics, and data workflows across distributed data environments.Contact sales
  • Griptapeby GriptapePython framework for AI agents, retrieval and structured workflows.Unknown
  • LIBSVMby LibSVMLIBSVM is a software library and command-line toolkit for support vector classification, regression, and one-class estimation.Free
  • Instructorby InstructorA developer library for extracting structured, validated data from language models.Unknown

That’s all 15 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “inference” there, and it checks these same records.