ToolsCompaniesAbout

Results for “inference api”

46 tools in the directory · Updated

“inference api”Download or installRuns on Command lineShowing 46 tools
  • vLLMby vLLMLLM inference and serving library.Free
  • OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • AI SDKby VercelOpen-source TypeScript toolkit for adding LLMs and agents to apps through one provider-neutral API.Free
  • Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFree
  • gooseby BlockOpen source general-purpose AI agent for desktop, terminal, and APIFree
  • Foundation Models frameworkby AppleNative Swift API for adding language models to Apple appsUnknown
  • mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.Free
  • smolagentsby Hugging FaceOpen-source Python library for building agents that write their actions as codeFree
  • Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
  • Bespoke Curatorby Bespoke LabsPython library for bulk synthetic data generation and structured extractionFree
  • Grok Buildby xAITerminal coding agent with headless and ACP modesUnknown
  • Gradioby Hugging FaceOpen-source Python library for turning functions and models into web appsFree
  • Coderby CoderSelf-hosted platform for governed AI coding agents and developer workspacesFreemium
  • Codeflashby CodeflashCodeflash optimizes code and benchmarks changes while checking whether behavior is preserved.Freemium
  • ASReviewby ASReviewOpen-source AI software for systematic text screening and review.Free
  • Retriever AIby Retriever AIAI browser agent for web research and task automationFreemium
  • OpenClawby OpenClaw FoundationSelf-hosted open-source AI assistant you message from your existing chat apps.Free
  • Archestraby ArchestraOpen-source AI infrastructure for controlling agent access, tools, and model spendFreemium
  • LlamaIndexby LlamaIndexOpen-source Python toolkit for building RAG pipelines and LLM agents over your own data.Free
  • Pipecatby PipecatOpen source framework for building real-time voice and multimodal AI agentsFreemium
  • OpenAI Agents SDKby OpenAIOpen-source Python framework for building multi-agent apps with tools, handoffs and guardrails.Pay as you go
  • MacWhisperby MacWhisperMac app for transcribing files, meetings, dictation and audio, with local or cloud models.Freemium