ToolsCompaniesAbout

Results for “llm inference”

26 tools in the directory · Updated

“llm inference”Open sourceShowing 26 tools
  • any-llmby Mozilla.aiSwitch LLM providers through a common Python interfaceFree
  • RubyLLMby RubyLLMBuild model-powered applications and agents in RubyFree
  • NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFree
  • Evidently AIby Evidently AIYC S21Open-source AI evaluation and observability for LLMs and ML modelsUnknown
  • Unsloth AIby Unsloth AIYC S24Open-source framework for fine-tuning and reinforcement learning of LLMsFreemium
  • llamafileby Mozilla.aiRun local language models from portable executable filesFree
  • encoderfileby Mozilla.aiPackage embedding and classification models as portable executablesFree
  • Flower Agentby FlowerYC W23Build and run agent applications with managed context and toolsUnknown
  • PaperQA2by FutureHouseOpen-source RAG library for answering questions from scientific PDFs with citationsFree
  • FalkorDB GraphRAG SDKby FalkorDBOpen-source toolkit for building GraphRAG systems on knowledge graphsFreemium
  • FalkorDB QueryWeaverby FalkorDBOpen-source, graph-powered text-to-SQL for plain-English database queriesFree
  • NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.Free
  • NVIDIA Run:aiby NVIDIAOpen source GPU scheduling and workload governance for shared Kubernetes AI clustersFree
  • Obot AI Control Planeby ObotGovern AI agents’ access to models, tools and company systemsFree
  • Repomixby RepomixPackage repository context for an AI assistantFree
  • MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.Free
  • LMQLby LMQLProgram language-model prompts with types and constraintsUnknown
  • AudioCraftby MetaOpen-source PyTorch library for generating music and sound effects from textFree
  • Graphitiby Zep AIYC W24Open-source framework for temporal context graphsFree
  • ZenMLby ZenmlRun reproducible AI pipelines and agents on your chosen infrastructureFreemium
  • DSPyby Stanford NLPOpen-source Python framework for programming and optimizing language-model pipelines.Unknown
  • Kubeflowby KubeflowOpen source Kubernetes-native platform for AI and ML workloadsFree
  • MegEngineby MEGVIITrain and deploy deep-learning models with one frameworkFree
  • LangGraphby LangChainOpen-source Python library for orchestrating stateful, long-running AI agentsFree