NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “local inference”

34 tools in the directory · Updated

“local inference”Download or installUpdated: last 7 daysShowing 34 tools
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Quillby QuillA local-first meeting assistant for recording, transcribing, and organizing conversations.Freemium
  • PyGPTby PyGPTAn open-source desktop assistant for working with cloud and local AI models.Free
  • CodeCrabby CodeCrabA desktop AI code reviewer that uses local AI command-line tools to review pull requests and local changes.Unknown
  • vLLMby vLLMLLM inference and serving library.Free
  • Conductorby ConductorYC S24Run coding agents in parallel in isolated local or cloud workspaces.Freemium
  • OpenWorkby OpenWorkYC X26Open-source AI workspace for working with models on your files.Freemium
  • Instructorby InstructorA developer library for extracting structured, validated data from language models.Unknown
  • Emdashby General ActionYC W26Open-source desktop environment for coordinating coding agents.Free
  • AURIby Endor LabsSecurity controls and scanning for AI-assisted software development.Freemium
  • Bibliomeby BibliomeAn on-device document library for organizing, searching, and asking questions about your files.$29.99 one-time
  • Decodeby DecodeA spatial whiteboard for directing coding agents building user interfaces.Unknown
  • mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.Free
  • DataLineby DataLineChat with data to generate tables, charts, and dashboards.Unknown
  • Codeflashby CodeflashCodeflash optimizes code and benchmarks changes while checking whether behavior is preserved.Freemium
  • ASReviewby ASReviewOpen-source AI software for systematic text screening and review.Free
  • Summit AI Notesby Summit AI NotesA native Mac app for recording meetings and turning them into searchable transcripts and summaries.$89.99+/yr
  • CARBON by Testers.aiby testers.aiAI-assisted software testing harness for coding agentsFree
  • Tonefoldby TonefoldDesktop AI music composer for creating and editing songs as layered piano-roll parts.Free
  • AgentOneby Iterate.aiAI coding assistant with an IDE extension for enterprise development.Unknown
  • Griptapeby GriptapePython framework for AI agents, retrieval and structured workflows.Unknown
  • FaceAppby FaceAppMobile photo editor that applies realistic AI face, hair and makeup edits in one tap.Unknown
  • Biomniby BiomniA biomedical AI agent that plans and executes research tasks using language-model reasoning, retrieval, and code-based tools.Unknown
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “local inference” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how