ToolsCompaniesAbout

Results for “local inference”

24 tools in the directory · Updated

“local inference”Open sourceShowing 24 tools
  • llamafileby Mozilla.aiRun local language models from portable executable filesFree
  • encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
  • Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • Thunderboltby MozillaDeploy an AI client with your own models and agent connectionsFree
  • mcp-useby ManufactYC S25Build MCP servers and interactive apps for AI clientsFree
  • Eigentby CAMEL-AIWork alongside a desktop AI agent or a coordinated agent teamFreemium
  • Cognizant Neuro Sanby CognizantBuild and coordinate networks of specialized AI agentsFree
  • Kitaruby ZenmlFind gaps in agent evaluations and replay proposed fixesFreemium
  • PaperQA2by FutureHouseOpen-source RAG library for answering questions from scientific PDFs with citationsFree
  • NVIDIA Run:aiby NVIDIAOpen source GPU scheduling and workload governance for shared Kubernetes AI clustersFree
  • Obot AI Control Planeby ObotGovern AI agents’ access to models, tools and company systemsFree
  • Repomixby RepomixPackage repository context for an AI assistantFree
  • MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
  • LMQLby LMQLProgram language-model prompts with types and constraintsUnknown
  • InterpretMLby MicrosoftOpen-source Python toolkit for training interpretable models and explaining black-box onesFree
  • AudioCraftby MetaOpen-source PyTorch library for generating music and sound effects from textFree
  • RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
  • Graphitiby Zep AIYC W24Open-source framework for temporal context graphsFree
  • ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
  • MegEngineby MEGVIITrain and deploy deep-learning models with one frameworkFree
  • Chromaby ChromaOpen-source search infrastructure for AI apps, with the managed Cloud service being wound downFreemium
  • Bytebotby BytebotYC S21An open-source AI agent that controls a self-hosted Linux desktop to carry out computer tasks.Unknown
  • Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium

That’s all 24 tools.