Results for “fast inference”

17 tools in the directory · Updated 2 Nov 2026

“fast inference”Ways to use: SDK / libraryUpdated: last 7 daysShowing 17 tools

Fast Simonby Fast Simon Inc.AI product discovery and shopping optimization for eCommerce stores.Contact sales
Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
vLLMby vLLMLLM inference and serving library.Free
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Nightfallby NightfallAI detection and policy controls for sensitive-data movementContact sales
Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium
Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
Pruna AIby Pruna AIAPI access to performance-optimized image and video modelsPay as you go
TabPFNby Prior LabsA tabular foundation model for predictions on structured data.Freemium
Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
Arcjetby ArcjetRuntime security for AI agents and applications$25+/moFree trial
mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.Free
Rhino Federated Computing Platformby Rhino Federated ComputingFederated computing platform for AI, analytics, and data workflows across distributed data environments.Contact sales
Griptapeby GriptapePython framework for AI agents, retrieval and structured workflows.Unknown
LIBSVMby LibSVMLIBSVM is a software library and command-line toolkit for support vector classification, regression, and one-class estimation.Free
Instructorby InstructorA developer library for extracting structured, validated data from language models.Unknown