ToolsCompaniesAbout

Results for “gpu inference”

25 tools in the directory · Updated

“gpu inference”Download or installShowing 25 tools
  • Roboflow Inferenceby RoboflowYC S20Self-hosted computer vision inference server with WorkflowsFree
  • vLLMby vLLMLLM inference and serving library.Free
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFree
  • NVIDIA AI Workbenchby NVIDIADesktop app for building and managing GPU-backed AI projects across local and remote machinesFreemium
  • OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • Rayby AnyscaleOpen-source Python framework for scaling AI and ML workloadsFree
  • PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
  • mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.Free
  • Pinokioby PinokioA hub for installing and running local AI and creative appsUnknown
  • Guardrails AIby Guardrails AIValidate model inputs and outputs with reusable Python guardsContact sales
  • Codeflashby CodeflashCodeflash optimizes code and benchmarks changes while checking whether behavior is preserved.Freemium
  • smolagentsby Hugging FaceOpen-source Python library for building agents that write their actions as codeFree
  • Griptapeby GriptapePython framework for AI agents, retrieval and structured workflows.Unknown
  • Upscaylby UpscaylFree, open-source AI image upscaler with a cloud optionFreemium
  • FastEmbedby QdrantLightweight Python library for generating text, sparse, image and reranking embeddingsFree
  • NVIDIA Broadcastby NVIDIAAI voice and video effects for webcams and microphones on RTX PCsFree
  • Lambda Stackby LambdaCurated Ubuntu software stack for machine learning and deep learningUnknown
  • LeRobotby Hugging FaceOpen-source Python library for training and running robot policies from demonstrationsFree
  • Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
  • OpenWorkby OpenWorkYC X26Open-source AI workspace for working with models on your files.Freemium
  • LIBSVMby LibSVMLIBSVM is a software library and command-line toolkit for support vector classification, regression, and one-class estimation.Free