NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “local inference”

52 tools in the directory · Updated

“local inference”Download or installWays to use: Desktop appShowing 52 tools
  • Roboflow Inferenceby RoboflowYC S20Self-hosted computer vision inference server with WorkflowsFree
  • Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.Free
  • Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemium
  • NVIDIA AI Workbenchby NVIDIADesktop app for building and managing GPU-backed AI projects across local and remote machinesFreemium
  • Quillby QuillA local-first meeting assistant for recording, transcribing, and organizing conversations.Freemium
  • OpenWhisprby OpenWhisprDictation and meeting notes with local or cloud speech modelsFreemium
  • PyGPTby PyGPTAn open-source desktop assistant for working with cloud and local AI models.Free
  • Pinokioby PinokioA hub for installing and running local AI and creative appsUnknown
  • Jan Desktopby JanDesktop app for chatting with local and cloud AI modelsUnknown
  • CodeCrabby CodeCrabA desktop AI code reviewer that uses local AI command-line tools to review pull requests and local changes.Unknown
  • MacWhisperby MacWhisperMac app for transcribing files, meetings, dictation and audio, with local or cloud models.Freemium
  • Dyadby DyadLocal, open-source desktop AI app builderFreemium
  • Devin Desktopby CognitionDesktop IDE for managing local and cloud coding agentsFreemium
  • Conductorby ConductorYC S24Run coding agents in parallel in isolated local or cloud workspaces.Freemium
  • BrowserOS neoby BrowserOSYC S24Give external AI agents a local browser with sessions and replayFree
  • Screenpipeby ScreenpipeYC S26Local screen and audio history your AI tools can searchFreemium
  • OpenWorkby OpenWorkYC X26Open-source AI workspace for working with models on your files.Freemium
  • Promeoby CyberLinkGenerate product visuals, campaign designs and video adsFreemium
  • AG2 Spaceby AG2Coordinate people and AI agents in shared team roomsFree
  • BrowserOSby BrowserOSYC S24An open-source browser with built-in AI agentsPay as you go
  • DeepSeek Harnessby DeepSeekOpen-source agent harness with a desktop app and plugin system for work and coding tasksFree
  • Emdashby General ActionYC W26Open-source desktop environment for coordinating coding agents.Free
  • Hermes Agentby Nous ResearchOpen-source, self-improving AI agent that keeps memory and skills across sessionsFreemium
  • Bibliomeby BibliomeAn on-device document library for organizing, searching, and asking questions about your files.$29.99 one-time
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “local inference” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how