NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm serving”

26 tools in the directory · Updated

“llm serving”Ways to use: SDK / libraryUpdated: last 7 daysShowing 26 tools
  • vLLMby vLLMLLM inference and serving library.Free
  • Orq.aiby Orq.aiAI gateway and platform for routing, governing and observing LLM and agent traffic across 500+ models.Freemium
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
  • UpTrainby UpTrainYC W23Open-source platform for evaluating and improving LLM applications.Freemium
  • Forefrontby ForefrontA platform for fine-tuning and running open-source language models.Freemium
  • Sensayby SensayAI-led offboarding interviews and knowledge transfer for organizations$500+/yr
  • H Platformby H CompanyA platform for building, running, and monitoring computer-use agents across browser, desktop, and enterprise environments.Freemium
  • Quail Voice Focusby ai-cousticsReal-time isolation of a primary speaker from background speech and noise for voice AI.$135+/mo
  • Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
  • Tiledeskby TiledeskA visual platform for building and deploying AI agents and automated conversations.€149+/moFree trial
  • MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
  • Kilnby Kiln AIDesktop workbench and Python library for developing and evaluating AI systems.Freemium
  • Tonic Textualby Tonic.aiTonic Textual detects sensitive information in unstructured data and redacts it or replaces it with synthetic values.Contact sales
  • PageIndexby VectifyAIDocument retrieval and question-answering tools for long, complex documents.Freemium
  • TestSavant.AIby TestSavant.AIAI testing and assurance platform for evaluating applications and tracking release risks.Freemium
  • Mindbreeze InSpireby MindbreezeEnterprise knowledge and AI search platform that connects business information for contextual answers and AI-enabled workflows.Contact sales
  • DSPyby Stanford NLPOpen-source Python framework for programming and optimizing language-model pipelines.Unknown
  • Rhino Federated Computing Platformby Rhino Federated ComputingFederated computing platform for AI, analytics, and data workflows across distributed data environments.Contact sales
  • Biomniby BiomniA biomedical AI agent that plans and executes research tasks using language-model reasoning, retrieval, and code-based tools.Unknown
  • AgileRLby AgileRLOpen-source Python library for reinforcement learning and language-model post-training.Contact sales
  • Veriff Biometric Authenticationby VeriffVeriff Biometric Authentication checks returning users with selfie-based facial matching and liveness detection.Unknown
  • Epsillaby EpsillaYC S23A no-code and configurable platform for building domain-specific AI agents with private knowledge.Freemium
  • PandasAIby PandasAIYC W24A Python library for asking questions about data in natural language and generating analyses, charts, and data transformations.€29.99+/mo
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm serving” there, and it checks these same records.

Add to ClaudeOpens Claude · Continue, then AddAdd to ChatGPTNot in ChatGPT’s plugin directory yet · see how