ToolsCompaniesAbout

Results for “llm api”

51 tools in the directory · Updated

“llm api”Download or installRuns on Command lineShowing 51 tools
  • vLLMby vLLMLLM inference and serving library.Free
  • AI SDKby VercelOpen-source TypeScript toolkit for adding LLMs and agents to apps through one provider-neutral API.Free
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • LlamaIndexby LlamaIndexOpen-source Python toolkit for building RAG pipelines and LLM agents over your own data.Free
  • DeepEvalby Confident AIYC W25Open-source LLM evaluation framework for testing AI agents and appsUnknown
  • gooseby BlockOpen source general-purpose AI agent for desktop, terminal, and APIFree
  • Foundation Models frameworkby AppleNative Swift API for adding language models to Apple appsUnknown
  • Haystackby deepsetOpen-source Python framework for building RAG, agent, and multimodal LLM applicationsFreemium
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Coderby CoderSelf-hosted platform for governed AI coding agents and developer workspacesFreemium
  • Archestraby ArchestraOpen-source AI infrastructure for controlling agent access, tools, and model spendFreemium
  • smolagentsby Hugging FaceOpen-source Python library for building agents that write their actions as codeFree
  • ECA - Editor Code Assistantby ECAOpen-source AI coding assistant connecting language models with editors, a desktop app, or a terminal client.Free
  • Aiderby AiderAI pair programming in your terminalUnknown
  • OpenHandsby OpenHandsOpen-source platform for running coding agents on engineering workFreemium
  • Stripe Agent Toolkitby StripeGive AI agents access to Stripe tools and data, and charge for AI featuresUnknown
  • Antonby MindsDBYC W20Open-source terminal agent that turns outcome-based requests into executed stepsFreemium
  • OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
  • Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • Bespoke Curatorby Bespoke LabsPython library for bulk synthetic data generation and structured extractionFree
  • Grok Buildby xAITerminal coding agent with headless and ACP modesUnknown
  • Gradioby Hugging FaceOpen-source Python library for turning functions and models into web appsFree
  • mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.Free