ToolsCompaniesAbout

Results for “gpu infrastructure”

19 tools in the directory · Updated

“gpu infrastructure”Download or installRuns on APIShowing 19 tools
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Archestraby ArchestraOpen-source AI infrastructure for controlling agent access, tools, and model spendFreemium
  • vLLMby vLLMLLM inference and serving library.Free
  • FastEmbedby QdrantLightweight Python library for generating text, sparse, image and reranking embeddingsFree
  • Rayby AnyscaleOpen-source Python framework for scaling AI and ML workloadsFree
  • PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
  • Strands Agentsby AmazonOpen source toolkit for building AI agent harnesses in Python and TypeScriptFree
  • Warp Terminalby WarpAgentic terminal for shared, agent-assisted developmentFreemium
  • Roboflow Inferenceby RoboflowYC S20Self-hosted computer vision inference server with WorkflowsFree
  • Codexby OpenAIOpenAI's coding agent for terminal, desktop, IDE and cloud repository workFreemium
  • Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • Coderby CoderSelf-hosted platform for governed AI coding agents and developer workspacesFreemium
  • LibreChatby LibreChatOpen-source, self-hosted chat interface for many AI model providers.Free
  • Pydantic AIby PydanticOpen source Python framework for typed AI agents with validation and durable runsFreemium
  • Milvusby ZillizOpen-source vector database for large-scale AI search and retrievalFreemium
  • Cogneeby CogneeOpen-source memory engine for AI agents, with a hosted option.Freemium
  • LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
  • Sourcebotby SourcebotYC F25Self-hosted code search and AI codebase understanding for people and agents.Freemium

That’s all 19 tools.