NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm testing”

68 tools in Coding · Updated

“llm testing”Coding › Sandboxes and infrastructureShowing 68 tools
  • any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
  • vLLMby vLLMLLM inference and serving library.Free
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • Crusoe Serverless Fine-Tuningby CrusoeManaged LoRA fine-tuning of open LLMs on Crusoe CloudPay as you go
  • Sakana AIby Sakana AISakana AI API for Fugu orchestration models and the Japanese-focused Sakana Namazu LLM.Pay as you go
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • Cogitoby DecartUltra-fast LLM inference API for open-weight modelsPay as you go
  • SiliconFlowby SiliconFlowHosted inference API for open and commercial LLM and multimodal modelsPay as you go
  • Inferactby InferactProduction LLM inference platform from the creators of vLLMContact sales
  • CoreWeave Serverless RLby CoreWeaveManaged reinforcement learning training for LLM agents, with trained checkpoints hosted for inference.Unknown
  • Nebius Token Factoryby Nebius GroupHosted inference API for open LLMs, with playground, fine-tuning, and framework integrations.Pay as you go
  • Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium
  • Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
  • AWS DevOps Agentby AmazonAWS's autonomous agent for incident investigation, release review, and SRE tasksPay as you go
  • Strands Agentsby AmazonOpen source toolkit for building AI agent harnesses in Python and TypeScriptFree
  • Warp Terminalby WarpAgentic terminal for shared, agent-assisted developmentFreemium
  • Kilo Codeby Kilo CodeOpen-source AI coding agent for IDEs, terminal, cloud and SlackFreemium
  • Browserbaseby BrowserbaseCloud browsers, search, and fetch APIs for AI agentsFreemium
  • Codexby OpenAIOpenAI's coding agent for terminal, desktop, IDE and cloud repository workFreemium
  • Inference Endpointsby Hugging FaceManaged hosting for deploying AI models on dedicated, autoscaling infrastructurePay as you go
  • Devin Desktopby CognitionDesktop IDE for managing local and cloud coding agentsFreemium
  • Cerebras Inferenceby Cerebras SystemsHosted inference API for running open-weight language models on Cerebras hardware.Pay as you go
  • Cursorby AnysphereCoding agent for desktop, terminal, Slack and GitHubFreemium
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm testing” there, and it checks these same records.