NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “local inference”

26 tools in the directory · Updated

“local inference”Ways to use: SDK / libraryUpdated: last 7 daysShowing 26 tools
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
  • vLLMby vLLMLLM inference and serving library.Free
  • Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
  • TabPFNby Prior LabsA tabular foundation model for predictions on structured data.Freemium
  • Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
  • Instructorby InstructorA developer library for extracting structured, validated data from language models.Unknown
  • Nightfallby NightfallAI detection and policy controls for sensitive-data movementContact sales
  • Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium
  • Simplismartby SimplismartDeploy, serve, and optimize AI models on shared or dedicated infrastructure.Pay as you go
  • Pruna AIby Pruna AIAPI access to performance-optimized image and video modelsPay as you go
  • mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.Free
  • Tiledeskby TiledeskA visual platform for building and deploying AI agents and automated conversations.€149+/moFree trial
  • MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
  • ASReviewby ASReviewOpen-source AI software for systematic text screening and review.Free
  • PageIndexby VectifyAIDocument retrieval and question-answering tools for long, complex documents.Freemium
  • CaptionHubby CaptionHubAI-assisted platform for multilingual captions, subtitles, transcription and voiceover across recorded and live media.Pay as you go
  • Vijilby VijilA platform for discovering, evaluating, and protecting AI agents.Freemium
  • Rhino Federated Computing Platformby Rhino Federated ComputingFederated computing platform for AI, analytics, and data workflows across distributed data environments.Contact sales
  • Griptapeby GriptapePython framework for AI agents, retrieval and structured workflows.Unknown
  • Biomniby BiomniA biomedical AI agent that plans and executes research tasks using language-model reasoning, retrieval, and code-based tools.Unknown
  • Vogentby VogentYC S21A platform for building, testing, and deploying conversational voice AI agents.Unknown
  • UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
  • Airweaveby AirweaveYC X25A context retrieval layer connecting AI systems to synced app and database data.Unknown
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “local inference” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how