Results for “ml inference”

43 tools in the directory · Updated 2 Nov 2026

“ml inference”Ways to use: Command lineUpdated: last 7 daysShowing 43 tools

mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.Free
Tinfoil Inferenceby TinfoilYC X25Call AI models through an attested confidential-inference APIPaid
Unity ML-Agentsby UnityTrain intelligent agents inside Unity games and simulationsFree
MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
BigMLby BigMLBuild and deploy predictive machine-learning models from dataFreemium
ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
BAMLby BoundaryYC W23A typed programming language for AI agents and existing codebases.Free
Kitaruby ZenmlFind gaps in agent evaluations and replay proposed fixesFreemium
Helixby HelixMLOrchestrates fleets of AI agents in isolated desktop environments, with human review of their work.$199+/yrFree trial
LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
Vast.aiby Vast.aiProvision GPU compute for AI training and inferencePay as you go
Doublewordby DoublewordHosted inference API for open-weight models, with real-time, async, batch and dedicated-capacity options.Pay as you go
Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
vLLMby vLLMLLM inference and serving library.Free
Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
Union.aiby Union.aiOperate durable AI workflows in your own cloudFreemium
Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
Codeflashby CodeflashCodeflash optimizes code and benchmarks changes while checking whether behavior is preserved.Freemium
Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
llamafileby Mozilla.aiRun local language models from portable executable filesFree
encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
21st AIby 21stYC W26Generate and compare several UI component designs from a promptPaid
Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
Wallyby RunAnywhereYC W26Hosted open models behind one OpenAI-compatible API and a CLI for coding agentsPay as you go