Awesome Data Analysis
Section: Tools · Framework for building, shipping, and scaling ML applications.
FreshScore 80
Entry
BentoML
Appears in 7 awesome lists
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Open github.combentoml/bentoml
Found in these lists
Awesome LLMOps
Section: Frameworks/Servers for Serving · The Unified Model Serving Framework
ActiveScore 75
Awesome Machine Learning
Section: Python · Toolkit for package and deploy machine learning models for serving in production
FreshScore 93
Awesome MLOps
Section: Model Serving · Open-source platform for high-performance ML model serving.
FreshScore 80
Awesome Open Source AI
Section: 8. MLOps / LLMOps & Production · Unified framework to build, ship, and scale AI apps.
FreshScore 89
Awesome Production Machine Learning
Section: Deployment and Serving · BentoML is an open source framework for high performance ML model serving.
FreshScore 92
awesome-python
Section: Machine Learning Frameworks · The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
FreshScore 81
Often listed next to it
TensorFlow
How to use the Hexagon Delegate to speed up model inference on mobile and edge devices. Also see blog post Accelerating TensorFlow Lite on Qualcomm Hexagon DSPs.
In 23 listsDetails
PyTorch
(label: good first issue) PyTorch is an open source machine learning library based on the Torch library, used for applications such as computer vision and natural language processing.
In 16 listsDetails
LiteLLM
Unified proxy and SDK that routes to 100+ LLM providers behind a single OpenAI-compatible interface, with a Router handling retry/fallback across deployments, per-project cost and rate-limit tracking, and OTEL callback integrations. The right infrastructure layer when your harness needs provider…
In 16 listsDetails
Opik
Comet's open-source AI observability and evaluation platform: deep tracing of LLM calls, conversation logging, and agent activity, plus built-in eval metrics, prompt versioning, guardrails, and the Opik Agent Optimizer. Worth including because it unifies observability, verification, and…
In 16 listsDetails
transformers
(formerly known as pytorch-transformers and pytorch-pretrained-bert) provides state-of-the-art general-purpose architectures (BERT, GPT-2, RoBERTa, XLM, DistilBert, XLNet, CTRL...) for Natural Language Understanding (NLU) and Natural Language Generation (NLG) with over 32+ pretrained models in…
In 14 listsDetails
Colossal-AI
(from Hpcaitech) - A Unified Deep Learning System for Large-Scale Parallel Training (1D, 2D, 2.5D, 3D and sequence parallelism, and ZeRO protocol).
In 14 listsDetails
Ray
A fast and simple framework for building and running distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library. ray.io
In 13 listsDetails
Haystack
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search,…
In 13 listsDetails