NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “local inference”

90 tools in the directory · Updated

“local inference”Sign up onlineWays to use: SDK / libraryShowing 90 tools
  • Telnyx Inference APIby TelnyxServerless open-weight model inference behind an OpenAI-compatible API.Pay as you go
  • Superlinked Inference Engineby SuperlinkedManaged Superlinked Inference Engine API for embeddings, reranking, extraction and chat with small modelsPay as you go
  • Inference.netby inference.netInference infrastructure for serving, monitoring, and training LLMsFreemium
  • Inference Endpointsby Hugging FaceManaged hosting for deploying AI models on dedicated, autoscaling infrastructurePay as you go
  • Inference Providersby Hugging FaceModel inference through multiple third-party providers, listed alongside pricing and performance metrics.Pay as you go
  • Fireworks AI Inference Platformby Fireworks AIRun, ensemble and fine-tune open AI models through one API platform.Pay as you go
  • Cerebras Inferenceby Cerebras SystemsHosted inference API for running open-weight language models on Cerebras hardware.Pay as you go
  • Telnyx AI Agent Platformby TelnyxBuild and run voice AI agents on Telnyx-owned telephony, speech and inference infrastructurePay as you go
  • Vast.aiby Vast.aiProvision GPU compute for AI training and inferencePay as you go
  • SambaCloudby SambaNovaHosted inference API for large open-source models on SambaNova RDU hardwarePay as you go
  • Runpodby RunpodGPU cloud for AI training, inference, and deploymentPay as you go
  • Argmax SDKby ArgmaxA developer SDK for running speech and other foundation-model inference on supported devices.Freemium
  • FriendliAIby FriendliAIInference cloud for open-weight and custom AI modelsPay as you go
  • Basetenby BasetenHosted model APIs and dedicated GPU inference for production AI appsPay as you go
  • CoreWeave Serverless RLby CoreWeaveManaged reinforcement learning training for LLM agents, with trained checkpoints hosted for inference.Unknown
  • Rask AIby Rask AIAI video dubbing and localization in 135+ languages with editable transcripts.Freemium
  • Modalby ModalServerless cloud compute for AI inference, training, and sandboxed code.Freemium
  • ElevenCreativeby ElevenLabsA browser workspace for generating, editing and localizing audio, image and video content.Freemium
  • Overmindby OvermindA platform for tracing AI applications, preparing data, evaluating models, and training and serving specialized models.Freemium
  • Oumiby OumiA platform for evaluating, training, and deploying custom AI models.Freemium
  • Lightning AIby Lightning AICloud GPUs, Studios, and training tools for building and deploying your own AI models.Freemium
  • LiveKit Agentsby LiveKitOpen-source Python and TypeScript framework for building realtime voice and video AI agentsFreemium
  • Anyscale Platformby AnyscaleManaged platform for running Ray-based AI workloads at scalePay as you go
  • Amazon SageMaker AIby AmazonAWS service for customizing, training, deploying, and governing machine learning and generative AI models.Pay as you go
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “local inference” there, and it checks these same records.