NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “gpu inference”

9 tools in the directory · Updated

“gpu inference”Open sourceUpdated: last 30 daysShowing 9 tools
  • NVIDIA Run:aiby NVIDIAOpen source GPU scheduling and workload governance for shared Kubernetes AI clustersFree
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • Spacesby Hugging FaceHosted ML demos and apps on Hugging Face, with optional GPU hardwareFreemium
  • MegEngineby MEGVIITrain and deploy deep-learning models with one frameworkFree
  • llamafileby Mozilla.aiRun local language models from portable executable filesFree
  • encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
  • Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
  • NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
  • AudioCraftby MetaOpen-source PyTorch library for generating music and sound effects from textFree

That’s all 9 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “gpu inference” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how