Results for “llm inference”

17 tools in this category · Updated 2 Nov 2026

“llm inference”CodingWays to use: MacShowing 17 tools

Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium
Interplayby Iterate.aiLow-code platform for building, running, and scaling agentic AI workflows across enterprise systems.Contact sales
MindsHubby MindsDBYC W20Shared AI model access, agents, and spending controls for teamsFreemium
Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
RunAnywhereby RunAnywhereYC W26Hosted open models behind one OpenAI-compatible API key and CLIPay as you go
Snowflake CoCoby SnowflakeData-native AI coding agent for Snowflake workflowsPay as you go
Bifrostby Maxim AIAI gateway and laptop-level AI traffic governance for enterprisesFreemium
Coderby CoderSelf-hosted platform for governed AI coding agents and developer workspacesFreemium
Kilnby Kiln AIDesktop workbench and Python library for developing and evaluating AI systems.Freemium
ECA - Editor Code Assistantby ECAOpen-source AI coding assistant connecting language models with editors, a desktop app, or a terminal client.Free
IBM Langflowby IBMVisual builder for AI agent workflows, extensible in PythonUnknown
OpenHandsby OpenHandsOpen-source platform for running coding agents on engineering workFreemium
Kilo Codeby Kilo CodeOpen-source AI coding agent for IDEs, terminal, cloud and SlackFreemium
gooseby BlockOpen source general-purpose AI agent for desktop, terminal, and APIFree
OpenCodeby AnomalyYC W21Open source AI coding agent for terminal, desktop, and IDEFreemium