Results for “gpu inference”

17 tools in the directory · Updated 2 Nov 2026

“gpu inference”Ways to use: SDK / libraryUpdated: last 7 daysShowing 17 tools

vLLMby vLLMLLM inference and serving library.Free
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
Tensorlake Sandboxesby TensorlakeIsolated cloud sandboxes for running AI agents, code, and workloads.Freemium
Nightfallby NightfallAI detection and policy controls for sensitive-data movementContact sales
Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium
Pruna AIby Pruna AIAPI access to performance-optimized image and video modelsPay as you go
TabPFNby Prior LabsA tabular foundation model for predictions on structured data.Freemium
mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.Free
Rhino Federated Computing Platformby Rhino Federated ComputingFederated computing platform for AI, analytics, and data workflows across distributed data environments.Contact sales
Griptapeby GriptapePython framework for AI agents, retrieval and structured workflows.Unknown
Tamarind Bioby Tamarind BioYC W24A computational platform for AI-assisted biotech research and development.Freemium
LIBSVMby LibSVMLIBSVM is a software library and command-line toolkit for support vector classification, regression, and one-class estimation.Free
Instructorby InstructorA developer library for extracting structured, validated data from language models.Unknown