Skip to content

Entry

Seldon Core

Appears in 6 awesome lists

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models on Kubernetes.

Open github.comseldonio/seldon-core

Found in these lists

Awesome Argo

Section: Ecosystem Projects · is an MLOps framework to package, deploy, monitor and manage thousands of production machine learning models.

FreshScore 83

Awesome Cloud Native

Section: AI & Machine Learning Platforms · A framework to deploy, manage and scale your production machine learning to thousands of models.

FreshScore 87

Awesome Data Analysis

Section: Tools · Open source platform for deploying and monitoring machine learning models in production.

FreshScore 80

Awesome LLMOps

Section: ML Platforms · An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

ActiveScore 75

Awesome Production Machine Learning

Section: Deployment and Serving · Open source platform for deploying and machine learning models in Kubernetes - (Video).

FreshScore 92

Awesome Software Engineering for Machine Learning

Section: Tooling · An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models on Kubernetes.

StaleScore 51

TensorFlow

How to use the Hexagon Delegate to speed up model inference on mobile and edge devices. Also see blog post Accelerating TensorFlow Lite on Qualcomm Hexagon DSPs.

In 23 listsDetails

PyTorch

(label: good first issue) PyTorch is an open source machine learning library based on the Torch library, used for applications such as computer vision and natural language processing.

In 16 listsDetails

LiteLLM

Unified proxy and SDK that routes to 100+ LLM providers behind a single OpenAI-compatible interface, with a Router handling retry/fallback across deployments, per-project cost and rate-limit tracking, and OTEL callback integrations. The right infrastructure layer when your harness needs provider…

In 16 listsDetails

Opik

Comet's open-source AI observability and evaluation platform: deep tracing of LLM calls, conversation logging, and agent activity, plus built-in eval metrics, prompt versioning, guardrails, and the Opik Agent Optimizer. Worth including because it unifies observability, verification, and…

In 16 listsDetails

Colossal-AI

(from Hpcaitech) - A Unified Deep Learning System for Large-Scale Parallel Training (1D, 2D, 2.5D, 3D and sequence parallelism, and ZeRO protocol).

In 14 listsDetails

Haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search,…

In 13 listsDetails

KubeStellar Console

Multi-cluster Kubernetes MCP server bridging Gemini CLI to kubeconfig and Kubernetes APIs. Manage clusters, policies, and 20+ CNCF project integrations across edge and cloud. Install via brew tap kubestellar/tap && brew install kc-agent.

In 13 listsDetails

vLLM

State-of-the-art serving engine with PagedAttention and continuous batching. Currently the fastest production-grade LLM server.

In 11 listsDetails