NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “gpu optimization”

12 tools in the directory · Updated

“gpu optimization”Download or installWays to use: SDK / libraryShowing 12 tools
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • Kilnby Kiln AIDesktop workbench and Python library for developing and evaluating AI systems.Freemium
  • LangMem SDKby LangChainPython library that gives agents long-term memory and prompt-based learningFree
  • vLLMby vLLMLLM inference and serving library.Free
  • Akkaby AkkaAgentic AI platform for building resilient, governed AI servicesUnknown
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • AgileRLby AgileRLOpen-source Python library for reinforcement learning and language-model post-training.Contact sales
  • FastEmbedby QdrantLightweight Python library for generating text, sparse, image and reranking embeddingsFree
  • OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFree
  • LeRobotby Hugging FaceOpen-source Python library for training and running robot policies from demonstrationsFree
  • Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFree
  • Rayby AnyscaleOpen-source Python framework for scaling AI and ML workloadsFree

That’s all 12 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “gpu optimization” there, and it checks these same records.