Results for “inference optimization”

49 tools in the directory · Updated 2 Nov 2026

“inference optimization”Ways to use: SDK / libraryUpdated: last 7 daysShowing 49 tools

Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
Telnyx Inference APIby TelnyxServerless open-weight model inference behind an OpenAI-compatible API.Pay as you go
Superlinked Inference Engineby SuperlinkedManaged Superlinked Inference Engine API for embeddings, reranking, extraction and chat with small modelsPay as you go
Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
Fast Simonby Fast Simon Inc.AI product discovery and shopping optimization for eCommerce stores.Contact sales
Vast.aiby Vast.aiProvision GPU compute for AI training and inferencePay as you go
Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
Telnyx AI Agent Platformby TelnyxBuild and run voice AI agents on Telnyx-owned telephony, speech and inference infrastructurePay as you go
vLLMby vLLMLLM inference and serving library.Free
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Pruna AIby Pruna AIAPI access to performance-optimized image and video modelsPay as you go
Not Diamondby Not DiamondRoute coding-agent steps to suitable models and reasoning settingsPay as you go
encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
Nutrient DWS Data Extraction APIby NutrientParses PDFs, scans, images and Office files into Markdown or spatial JSON, with schema-based field extraction.Freemium
Telnyx AgentSDKby TelnyxA TypeScript base class for building durable AI agents on Telnyx edge compute.Unknown
Telnyx Embeddings APIby TelnyxVector embeddings for documents stored in Telnyx StoragePay as you go
PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
Runware APIby RunwareModel APIs, serverless GPUs and reserved compute for AI workloadsPay as you go
Nightfallby NightfallAI detection and policy controls for sensitive-data movementContact sales
Ravelinby RavelinMachine-learning fraud decisions for online merchantsContact sales
Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium