ToolsCompaniesAbout

Results for “local inference”

17 tools in this category · Updated

“local inference”CodingOpen sourceShowing 17 tools
  • llamafileby Mozilla.aiRun local language models from portable executable filesFree
  • encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
  • Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • mcp-useby ManufactYC S25Build MCP servers and interactive apps for AI clientsFree
  • Cognizant Neuro Sanby CognizantBuild and coordinate networks of specialized AI agentsFree
  • Kitaruby ZenmlFind gaps in agent evaluations and replay proposed fixesFreemium
  • NVIDIA Run:aiby NVIDIAOpen source GPU scheduling and workload governance for shared Kubernetes AI clustersFree
  • Repomixby RepomixPackage repository context for an AI assistantFree
  • MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
  • LMQLby LMQLProgram language-model prompts with types and constraintsUnknown
  • RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
  • Graphitiby Zep AIYC W24Open-source framework for temporal context graphsFree
  • ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
  • MegEngineby MEGVIITrain and deploy deep-learning models with one frameworkFree
  • Chromaby ChromaOpen-source search infrastructure for AI apps, with the managed Cloud service being wound downFreemium
  • Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium

That’s all 17 tools.