Results for “llm serving”

• NVIDIA Dynamoby NVIDIAOpen-source framework for serving LLMs across multi-GPU, multi-node clustersFreeWatch
• NVIDIA Cosmosby NVIDIAOpen world foundation models, datasets and tools for building physical AI.FreeWatch
• llamafileby Mozilla.aiRun local language models from portable executable filesFreeWatch
• PaperQA2by FutureHouseOpen-source RAG library for answering questions from scientific PDFs with citationsFreeWatch
• TensorFlow.jsby GoogleJavaScript library for running, retraining and building machine learning models in the browser or Node.jsFreeWatch
• MLflowby MLflowOpen-source platform for tracing, evaluating, and managing AI applications and machine-learning models.FreeWatch
• Graphitiby Zep AIYC W24Open-source framework for temporal context graphsFreeWatch
• LangChainby LangChainOpen source framework for building agents that work with many models and toolsFreeWatch

That’s all 8 tools.