ToolsCompaniesAbout

Results for “inference api”

61 tools in this category · Updated

“inference api”CodingDownload or installShowing 61 tools
  • Roboflow Inferenceby RoboflowYC S20Self-hosted computer vision inference server with WorkflowsFree
  • vLLMby vLLMLLM inference and serving library.Free
  • OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • AI SDKby VercelOpen-source TypeScript toolkit for adding LLMs and agents to apps through one provider-neutral API.Free
  • Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFree
  • gooseby BlockOpen source general-purpose AI agent for desktop, terminal, and APIFree
  • Foundation Models frameworkby AppleNative Swift API for adding language models to Apple appsUnknown
  • LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
  • smolagentsby Hugging FaceOpen-source Python library for building agents that write their actions as codeFree
  • Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
  • Phrase MCP Serverby PhraseUse an AI assistant to inspect and manage Phrase localization workUnknown
  • Help Scout MCPby Help ScoutSearch Help Scout conversations and knowledge from an AI assistantPaid
  • Lokalise MCP Serverby LokaliseManage localization tasks from compatible AI toolsUnknown
  • Grok Buildby xAITerminal coding agent with headless and ACP modesUnknown
  • PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
  • Gradioby Hugging FaceOpen-source Python library for turning functions and models into web appsFree
  • Coderby CoderSelf-hosted platform for governed AI coding agents and developer workspacesFreemium
  • Towheeby ZillizOpen-source framework for building embedding pipelines over unstructured dataFree
  • LibreChatby LibreChatOpen-source, self-hosted chat interface for many AI model providers.Free
  • Kilnby Kiln AIDesktop workbench and Python library for developing and evaluating AI systems.Freemium
  • Fairlearnby FairlearnAn open-source Python toolkit and learning resources for assessing and mitigating fairness issues in AI systems.Free
  • Codeflashby CodeflashCodeflash optimizes code and benchmarks changes while checking whether behavior is preserved.Freemium