NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “gpu acceleration”

8 tools in the directory · Updated

“gpu acceleration”Download or installWays to use: SDK / libraryShowing 8 tools
  • vLLMby vLLMLLM inference and serving library.Free
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Roboflow Inferenceby RoboflowYC S20Self-hosted computer vision inference server with WorkflowsFree
  • FastEmbedby QdrantLightweight Python library for generating text, sparse, image and reranking embeddingsFree
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • LeRobotby Hugging FaceOpen-source Python library for training and running robot policies from demonstrationsFree
  • Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFree
  • Rayby AnyscaleOpen-source Python framework for scaling AI and ML workloadsFree

That’s all 8 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “gpu acceleration” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how