ToolsCompaniesAbout

Results for “inference optimization”

14 tools in the directory · Updated

“inference optimization”Download or installRuns on APIShowing 14 tools
  • Roboflow Inferenceby RoboflowYC S20Self-hosted computer vision inference server with WorkflowsFree
  • OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
  • vLLMby vLLMLLM inference and serving library.Free
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFree
  • Kilnby Kiln AIDesktop workbench and Python library for developing and evaluating AI systems.Freemium
  • LangMem SDKby LangChainPython library that gives agents long-term memory and prompt-based learningFree
  • smolagentsby Hugging FaceOpen-source Python library for building agents that write their actions as codeFree
  • Griptapeby GriptapePython framework for AI agents, retrieval and structured workflows.Unknown
  • Akkaby AkkaAgentic AI platform for building resilient, governed AI servicesUnknown
  • Rayby AnyscaleOpen-source Python framework for scaling AI and ML workloadsFree
  • Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
  • Instructorby InstructorA developer library for extracting structured, validated data from language models.Unknown

That’s all 14 tools.