NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “fast inference”

9 tools in the directory · Updated

“fast inference”Download or installUpdated: last 7 daysShowing 9 tools
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • vLLMby vLLMLLM inference and serving library.Free
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.Free
  • Codeflashby CodeflashCodeflash optimizes code and benchmarks changes while checking whether behavior is preserved.Freemium
  • Griptapeby GriptapePython framework for AI agents, retrieval and structured workflows.Unknown
  • OpenWorkby OpenWorkYC X26Open-source AI workspace for working with models on your files.Freemium
  • LIBSVMby LibSVMLIBSVM is a software library and command-line toolkit for support vector classification, regression, and one-class estimation.Free
  • Instructorby InstructorA developer library for extracting structured, validated data from language models.Unknown

That’s all 9 tools.

Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “fast inference” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how