Results for “distributed inference”

15 tools in the directory · Updated 2 Nov 2026

“distributed inference”Ways to use: SDK / libraryUpdated: last 7 daysShowing 15 tools

Rhino Federated Computing Platformby Rhino Federated ComputingFederated computing platform for AI, analytics, and data workflows across distributed data environments.Contact sales
vLLMby vLLMLLM inference and serving library.Free
Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.Free
Nightfallby NightfallAI detection and policy controls for sensitive-data movementContact sales
Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium
Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
Pruna AIby Pruna AIAPI access to performance-optimized image and video modelsPay as you go
TabPFNby Prior LabsA tabular foundation model for predictions on structured data.Freemium
Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
Griptapeby GriptapePython framework for AI agents, retrieval and structured workflows.Unknown
LIBSVMby LibSVMLIBSVM is a software library and command-line toolkit for support vector classification, regression, and one-class estimation.Free
Instructorby InstructorA developer library for extracting structured, validated data from language models.Unknown