NewAsk Claude or ChatGPT about AI tools, and they can check Orca.Add Orca to your AI assistant
ToolsCompaniesAbout

Results for “llm context”

62 tools in Coding · Updated

“llm context”Coding › Sandboxes and infrastructureShowing 62 tools
  • any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
  • vLLMby vLLMLLM inference and serving library.Free
  • LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFree
  • Cogitoby DecartUltra-fast LLM inference API for open-weight modelsPay as you go
  • Crusoe Serverless Fine-Tuningby CrusoeManaged LoRA fine-tuning of open LLMs on Crusoe CloudPay as you go
  • Sakana AIby Sakana AISakana AI API for Fugu orchestration models and the Japanese-focused Sakana Namazu LLM.Pay as you go
  • LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.Free
  • SiliconFlowby SiliconFlowHosted inference API for open and commercial LLM and multimodal modelsPay as you go
  • Inferactby InferactProduction LLM inference platform from the creators of vLLMContact sales
  • CoreWeave Serverless RLby CoreWeaveManaged reinforcement learning training for LLM agents, with trained checkpoints hosted for inference.Unknown
  • Nebius Token Factoryby Nebius GroupHosted inference API for open LLMs, with playground, fine-tuning, and framework integrations.Pay as you go
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium
  • Red Hat AI Inferenceby IBMSelf-managed vLLM and llm-d inference stack for running open models on your own acceleratorsContact sales
  • Liquid AIby Liquid AIEfficient foundation models for on-device and edge deployment.Freemium
  • Meta Model APIby MetaInference API for Meta's Muse text, image, speech and segmentation modelsPay as you go
  • Inference Providersby Hugging FaceModel inference through multiple third-party providers, listed alongside pricing and performance metrics.Pay as you go
  • Cerebras Inferenceby Cerebras SystemsHosted inference API for running open-weight language models on Cerebras hardware.Pay as you go
  • Claude Developer Platformby AnthropicUse Claude models and agent tools in your own applications through an API.Pay as you go
  • Mem0by Mem0YC S24Persistent memory layer for AI agents and appsFreemium
  • Otariby Mozilla.aiControl model routing, budgets and access through one AI gatewayUnknown
  • NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
  • Pydantic Logfireby PydanticFull-stack observability and evaluation for AI appsFreemium
  • Runware APIby RunwareModel APIs, serverless GPUs and reserved compute for AI workloadsPay as you go
Ask this in Claude or ChatGPT next time

Add Orca to your assistant once. Then ask “llm context” there, and it checks these same records.