NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm-api”

225 tools in the directory · Updated

“llm-api”Runs on Self-hostedShowing 225 tools
  • .txt APIby .txtStructured outputs API that enforces JSON Schema, regex, and grammar constraints on LLM responses.Pay as you go
  • Deepgram Voice Agent APIby DeepgramSpeech-to-text, LLM orchestration and text-to-speech in one WebSocket API.Pay as you go
  • LiteLLMby LiteLLMYC W23Open-source AI gateway that puts many LLM providers behind one API with spend caps and routingFreemium
  • LLMWhispererby UnstractPrepare layout-preserved document text for language-model pipelinesFreemium
  • Manifest LLM Gatewayby ManifestAn open-source gateway for routing LLM requests, handling provider failures, and tracking inference use.Freemium
  • RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
  • vLLMby vLLMLLM inference and serving library.Free
  • AnythingLLMby AnythingLLMYC S22Private AI assistant that runs on your own computerFreemium
  • any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
  • Fabric Gatewayby PostmanGoverned gateway for LLMs, MCP servers, and internal APIsFreemium
  • Bria APIby BriaDeveloper platform for generating and editing images and video via API, SDKs and MCP.Freemium
  • Gemini APIby GoogleDeveloper API for Gemini models, agents, and multimodal generationFreemium
  • ElevenAPIby ElevenLabsDeveloper API for text to speech, transcription, music, sound effects, dubbing and voice agents.Freemium
  • Deepchecks LLM Evaluationby DeepchecksProduction-grade LLM evaluation, testing, and monitoring platformPaid
  • Hume APIby Hume AIDeveloper voice APIs for emotionally expressive speech, with EVI and TTS being sunset on November 13, 2026.Unknown
  • Napier Continuumby Napier AIAML and financial crime compliance platform with AI-assisted detectionContact sales
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • Deepgram Speech-to-Text APIby DeepgramSpeech-to-text API for transcription and real-time voice agents.Pay as you go
  • Deepgram Text-to-Speech APIby DeepgramText-to-speech API for real-time voice agents, with streaming audio as low as 80msPay as you go
  • Agora Conversational AI Engineby AgoraVoice AI agent engine that connects any LLM to real-time speech.Pay as you go
  • Superlinked Inference Engineby SuperlinkedManaged Superlinked Inference Engine API for embeddings, reranking, extraction and chat with small modelsPay as you go
  • CompactifAIby Multiverse ComputingModel compression and access to compressed AI models through managed API or private deployment.Contact sales
  • LlamaIndexby LlamaIndexOpen-source Python toolkit for building RAG pipelines and LLM agents over your own data.Free
  • Prisma AIRS AI Gatewayby PortkeyAI gateway for routing, observing and governing LLM and agent trafficFreemium
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm-api” there, and it checks these same records.