Results for “batch inference”

• Roboflow Inferenceby RoboflowYC S20Self-hosted computer vision inference server with WorkflowsFreeWatch
• vLLMby vLLMLLM inference and serving library.FreeWatch
• LMCacheby LMCacheOpen-source KV-cache infrastructure for storing and reusing LLM inference cache.FreeWatch
• OpenVINOby IntelOpen source AI inference toolkit for deploying models across Intel hardwareFreeWatch
• Transformersby Hugging FaceOpen-source Python library defining state-of-the-art ML models for inference and trainingFreeWatch
• Magnitudeby MagnitudeYC S25Local open-model inference engine with hardware-tuned kernels, desktop app, and CLI.FreeWatch
• Bespoke Curatorby Bespoke LabsPython library for bulk synthetic data generation and structured extractionFreeWatch
• DeepSeek Harnessby DeepSeekOpen-source agent harness with a desktop app and plugin system for work and coding tasksFreeWatch
• PyTorchby PyTorch FoundationOpen source machine learning framework for building and training deep learning modelsFreeWatch
• mlpackby mlpackOpen-source C++ machine-learning library with Python, Julia, R, Go and command-line interfaces.FreeWatch
• Guardrails AIby Guardrails AIValidate model inputs and outputs with reusable Python guardsContact salesWatch
• Codeflashby CodeflashCodeflash optimizes code and benchmarks changes while checking whether behavior is preserved.FreemiumWatch
• MacWhisperby MacWhisperMac app for transcribing files, meetings, dictation and audio, with local or cloud models.FreemiumWatch
• smolagentsby Hugging FaceOpen-source Python library for building agents that write their actions as codeFreeWatch
• Griptapeby GriptapePython framework for AI agents, retrieval and structured workflows.UnknownWatch
• Upscaylby UpscaylFree, open-source AI image upscaler with a cloud optionFreemiumWatch
• LLM Compressorby IBMOpen-source Python library for quantizing and pruning LLMs to run faster in vLLMFreeWatch
• Rayby AnyscaleOpen-source Python framework for scaling AI and ML workloadsFreeWatch
• Ollamaby OllamaYC W21Run and build with open AI models locally or in the cloudFreemiumWatch
• LanceDBby LanceDBYC W22AI-native multimodal lakehouse for training data, features, and retrievalFreemiumWatch
• BAMLby BoundaryYC W23A typed programming language for AI agents and existing codebases.FreeWatch
• OpenWorkby OpenWorkYC X26Open-source AI workspace for working with models on your files.FreemiumWatch
• LLIBSVMby LibSVMLIBSVM is a software library and command-line toolkit for support vector classification, regression, and one-class estimation.FreeWatch
• IInstructorby InstructorA developer library for extracting structured, validated data from language models.UnknownWatch

That’s all 24 tools.