Results for “inference infrastructure”

20 tools in the directory · Updated 2 Nov 2026

“inference infrastructure”Open sourceUpdated: last 7 daysShowing 20 tools

llamafileby Mozilla.aiRun local language models from portable executable filesFree
encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
MegEngineby MEGVIITrain and deploy deep-learning models with one frameworkFree
MLJAR AutoMLby MLJARTrain and compare predictive models for tabular dataFree
any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
Unity ML-Agentsby UnityTrain intelligent agents inside Unity games and simulationsFree
Kubeflowby KubeflowOpen source Kubernetes-native platform for AI and ML workloadsFree
SpeechBrainby SpeechBrainOpen-source Python toolkit for speech and conversational AI research and development.Free
Flowerby FlowerYC W23Build federated AI systems across distributed datasetsFreemium
Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium
Klavis MCPby Klavis AIYC X25Connect agents to application tools through open-source MCP integrationsFree
Arthur Engineby ArthurAIRun AI evaluations and experiments in your own environmentFree
Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
AG2by AG2Build cooperating AI agents with a Python frameworkFree
MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
pgvectorscaleby TimescaleOpen-source PostgreSQL extension adding disk-based vector search to pgvectorFree
Bytebotby BytebotYC S21An open-source AI agent that controls a self-hosted Linux desktop to carry out computer tasks.Unknown
Inkeepby InkeepYC W23Build customer-experience agents in a visual editor or TypeScriptContact sales