Alpaca
Code and documentation to train Stanford's Alpaca models, and generate the data.
In 5 listsDetails
Code and documentation to train Stanford's Alpaca models, and generate the data.
Awesome LLMOps
An awesome & curated list of best LLMOps tools for developers
This page lists names, links and short descriptions. The original list on GitHub is the source and belongs to its authors.
Model >Large Language Model
BELLE
A 7B Large Language Model fine-tune by 34B Chinese Character Corpus, based on LLaMA and Alpaca.
In 3 lists
Bloom
BigScience Large Open-science Open-access Multilingual Language Model
dolly
Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform
In 4 listsDetails
Falcon 40B
Falcon-40B-Instruct is a 40B parameters causal decoder-only model built by TII based on Falcon-40B and finetuned on a mixture of Baize. It is made available under the Apache 2.0 license.
FastChat (Vicuna)
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and FastChat-T5.
In 12 listsDetails
Gemma
Gemma is a family of lightweight, open models built from the research and technology that Google used to create the Gemini models.
GLM-6B (ChatGLM)
An Open Bilingual Pre-Trained Model, quantization of ChatGLM-130B, can run on consumer-level GPUs.
In 3 lists
ChatGLM2-6B
ChatGLM2-6B is the second-generation version of the open-source bilingual (Chinese-English) chat model ChatGLM-6B.
In 2 lists
GLM-130B (ChatGLM)
An Open Bilingual Pre-Trained Model (ICLR 2023)
In 4 listsDetails
GPT-NeoX
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
In 3 lists
Luotuo
A Chinese LLM, Based on LLaMA and fine tune by Stanford Alpaca, Alpaca LoRA, Japanese-Alpaca-LoRA.
Mixtral-8x7B-v0.1
The Mixtral-8x7B Large Language Model (LLM) is a pretrained generative Sparse Mixture of Experts.
Model >CV Foundation Model
disco-diffusion
A frankensteinian amalgamation of notebooks, models and techniques for the generation of AI Art and Animations.
In 3 lists
midjourney
Midjourney is an independent research lab exploring new mediums of thought and expanding the imaginative powers of the human species.
In 2 lists
segment-anything (SAM)
produces high quality object masks from input prompts such as points or boxes, and it can be used to generate masks for all objects in an image.
In 2 lists
stable-diffusion
A latent text-to-image diffusion model
In 2 lists
Model >Audio Foundation Model
Model >Robotics Foundation Model
DiVLA
A continuous diffusion-based Vision-Language-Action model that integrates diffusion policies into autoregressive VLMs for robust and precise continuous robotic control.
LeRobot
A central community library by Hugging Face for AI in robotics — end-to-end learning tools, data pipelines, and support for training/deploying VLA models.
In 6 listsDetails
Octo
A transformer-based generalist robot policy pretrained on 800K+ robot trajectories from the Open X-Embodiment dataset. Supports language instructions, goal images, and fine-tuning to new embodiments.
OpenPI
Open-source VLA models from Physical Intelligence, including π₀ and π₀.5 — flow-based vision-language-action models pretrained on large-scale robot data with fine-tuning support.
In 2 lists
OpenVLA
A 7B-parameter open-source Vision-Language-Action model trained on 970K+ robot demonstrations from the Open X-Embodiment dataset for generalist robotic manipulation.
RoboMamba
An efficient VLA model leveraging State Space Models (Mamba) instead of standard self-attention, offering linear inference complexity for efficient, recurrent robotic reasoning.
SmolVLA
A compact ~450M parameter VLA by Hugging Face, designed to be computationally efficient and accessible, running on consumer GPUs or CPUs. Part of the LeRobot ecosystem.
Serving >Large Model Serving
Alpaca-LoRA-Serve
Alpaca-LoRA as Chatbot service
OneComp
Fujitsu Research's post-training quantization pipeline for LLMs (QEP, AutoBit, JointQ, rotation) with vLLM plugin (arXiv:2603.28845).
In 2 lists
CTranslate2
fast inference engine for Transformer models in C++
In 3 lists
Clip-as-a-service
serving the OpenAI CLIP model
In 2 lists
DeepSpeed-MII
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
Faster Whisper
fast inference engine for whisper in C++ using CTranslate2.
In 3 lists
FlexGen
Running large language models on a single GPU for throughput-oriented scenarios. (Archived)
In 2 lists
LLMKube
Kubernetes operator for LLM inference with pluggable runtimes (llama.cpp, PersonaPlex/Moshi, generic), multi-GPU sharding, NVIDIA CUDA and Apple Silicon Metal support, and GGUF/MLX/SafeTensors model formats.
Shimmy
Python-free Rust inference server with OpenAI API compatibility and hot model swapping
In 7 listsDetails
Infinity
Rest API server for serving text-embeddings
In 2 lists
Modelz-LLM
OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
Off Grid
Open-source iOS/Android app running LLMs on-device via llama.cpp. Voice (Whisper), vision, image gen, tool calling — fully offline.
In 2 lists
Ollama
Serve Llama 2 and other large language models locally from command line or through a browser interface.
In 5 listsDetails
Rapid-MLX
OpenAI-compatible LLM inference server for Apple Silicon using MLX. 2-4x faster than Ollama with tool calling and prompt caching.
In 4 listsDetails
TensorRT-LLM
Inference engine for TensorRT on Nvidia GPUs
In 7 listsDetails
text-generation-inference
Large Language Model Text Generation Inference
In 3 lists
text-embeddings-inference
Inference for text-embedding models
In 2 lists
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
In 6 listsDetails
whisper-ctranslate2
is a 4x faster and low-memory usage drop-in cli replacement that supports word-level timestamps and VAD filter
In 4 listsDetails
whisper.cpp
Port of OpenAI's Whisper model in C/C++
In 6 listsDetails
x-stable-diffusion
Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. (Archived)
Serving >Frameworks/Servers for Serving
Jina
Build multimodal AI services via cloud native technologies · Model Serving · Generative AI · Neural Search · Cloud Native
In 3 lists
Mosec
A machine learning model serving framework with dynamic batching and pipelined stages, provides an easy-to-use Python interface.
In 2 lists
mcpproxy-go
Open-source MCP proxy with BM25 tool filtering, quarantine security, activity logging, and web UI. Routes multiple MCP servers through single endpoint, reducing context bloat by ~97%.
TFServing
A flexible, high-performance serving system for machine learning models.
In 3 lists
Torchserve
Serve, optimize and scale PyTorch models in production (Archived)
In 2 lists
Triton Server (TRTIS)
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
In 5 listsDetails
langchain-serve
Serverless LLM apps on Production with Jina AI Cloud (Archived)
lanarky
FastAPI framework to build production-grade LLM applications
ray-llm
LLMs on Ray - RayLLM (Archived)
Xinference
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the…
In 5 listsDetails
KubeAI
Deploy and scale machine learning models on Kubernetes. Built for LLMs, embeddings, and speech-to-text.
Kaito
A Kubernetes operator that simplifies serving and tuning large AI models (e.g. Falcon or phi-3) using container images and GPU auto-provisioning. Includes an OpenAI-compatible server for inference and preset configurations for popular runtimes such as vLLM and transformers.
Open Responses
Serverless open-source platform for building long-running LLM agents with tool use.
KubeStellar Console
AI-powered multi-cluster Kubernetes dashboard for hybrid edge and cloud. GPU monitoring, LLM inference cluster management, benchmark streaming, and 20+ CNCF integrations. CNCF Sandbox (Apache 2.0).
In 13 listsDetails
Security >Frameworks for LLM security
Cordum
Safety-first agent orchestration platform with pre-dispatch policy evaluation, output scanning (PII, secrets, injection), job scheduling, workflow engine, and full audit trail.
In 2 lists
brood-box
CLI tool for running coding agents inside hardware-isolated microVMs with snapshot isolation, egress control, and MCP authorization.
In 6 listsDetails
dstack
Open-source confidential AI framework for secure LLM deployment with data privacy, providing hardware-enforced isolation using Intel TDX and NVIDIA Confidential Computing.
In 2 lists
Plexiglass
A Python Machine Learning Pentesting Toolbox for Adversarial Attacks. Works with LLMs, DNNs, and other machine learning algorithms.
In 2 lists
Security >Observability
Azure OpenAI Logger
"Batteries included" logging solution for your Azure OpenAI instance.
ClevAgent
Runtime monitoring for AI agents — heartbeat watchdog, loop detection, cost tracking, auto-restart. Python SDK or HTTP API.
Deepchecks
Tests for Continuous Validation of ML Models & Data. Deepchecks is a Python package for comprehensively validating your machine learning models and data with minimal effort.
In 8 listsDetails
Evidently
An open-source framework to evaluate, test and monitor ML and LLM-powered systems.
In 8 listsDetails
EvalView
Regression testing for AI agents. Snapshot behavior, detect tool-call and output regressions, with golden-baseline diffing and LLM-as-judge scoring. Supports LangGraph, CrewAI, OpenAI, Claude, and any HTTP API.
Fiddler AI
Evaluate, monitor, analyze, and improve machine learning and generative models from pre-production to production. Ship more ML and LLMs into production, and monitor ML and LLM metrics like hallucination, PII, and toxicity.
Giskard
Testing framework dedicated to ML models, from tabular to LLMs. Detect risks of biases, performance issues and errors in 4 lines of code.
In 2 lists
QWED
Deterministic verification protocol for LLM outputs using 8 formal verification engines (SymPy, Z3, AST, SQLGlot). Prevents hallucinations through mathematical proofs rather than statistical methods.
Great Expectations
Always know what to expect from your data.
In 5 listsDetails
Helicone
Open source LLM observability platform. One line of code to monitor, evaluate, and experiment with features like prompt management, agent tracing, and evaluations.
In 8 listsDetails
Traceloop OpenLLMetry
OpenTelemetry-based observability and monitoring for LLM and agents workflows.
In 7 listsDetails
Langfuse 🪢
Open-source LLM observability platform that helps teams collaboratively debug, analyze, and iterate on their LLM applications.
In 10 listsDetails
whylogs
The open standard for data logging
In 2 lists
onWatch
Lightweight Go CLI that tracks AI API quota usage across 7 providers (Anthropic, OpenAI, GitHub Copilot, MiniMax, and more). Background daemon, <50MB RAM, zero telemetry, SQLite storage.
In 6 listsDetails
RagTune
CLI tool for debugging and benchmarking RAG retrieval. EXPLAIN ANALYZE for your retrieval layer.
traceAI
Open-source AI tracing framework built on OpenTelemetry for deep observability across agentic and LLM workflows.
In 3 lists
Future AGI
Production-grade SDK for observability, automated evaluations and prompt management with sub-100ms guardrails for LLM/agent workflows.
semantic-coverage
Visualizes RAG knowledge gaps and "blind spots" using 2D UMAP clustering and density detection.
Weco Observe
Observability and debugging tool for AI research agents. Trace multi-step LLM agent runs, visualize decision trees, and identify failure modes in autonomous research workflows. Cloud hosted with open-source agent integration.
In 2 lists
LLMOps
agenta
The LLMOps platform to build robust LLM apps. Easily experiment and evaluate different prompts, models, and workflows to build robust apps.
In 6 listsDetails
AgentMark
Type-Safe Markdown-based Agents
AgentField
Open-source control plane for building and operating AI agents like APIs at scale, with routing, memory, observability, identity, auth, and policy controls.
In 3 lists
AI studio
A Reliable Open Source AI studio to build core infrastructure stack for your LLM Applications. It allows you to gain visibility, make your application reliable, and prepare it for production with features such as caching, rate limiting, exponential retry, model fallback, and more.
Arize-Phoenix
ML observability for LLMs, vision, language, and tabular models.
In 10 listsDetails
BudgetML
Deploy a ML inference service on a budget in less than 10 lines of code.
In 2 lists
Cheshire Cat AI
Web framework to create vertical AI agents. FastAPI based, plugin system inspired to WordPress, admin panel, vector DB included
In 3 lists
Contexto
Self-hosted context engine for AI agents with persistent conversation memory and recall. Works as a drop-in OpenAI-compatible proxy, OpenClaw plugin, or memory SDK — no code changes required.
Dataoorts
Enjoy unlimited API calls with Serverless AI Workers/LLMs for just $25 per month. No rate or concurrency limits.
deeplake
Stream large multimodal datasets to achieve near 100% GPU utilization. Query, visualize, & version control data. Access data w/o the need to recompute the embeddings for the model finetuning.
In 6 listsDetails
Dify
Open-source framework aims to enable developers (and even non-developers) to quickly build useful applications based on large language models, ensuring they are visual, operable, and improvable.
In 14 listsDetails
Embedchain
Framework to create ChatGPT like bots over your dataset.
In 9 listsDetails
Epsilla
An all-in-one platform to create vertical AI agents powered by your private data and knowledge.
Evidently
An open-source framework to evaluate, test and monitor ML and LLM-powered systems.
In 8 listsDetails
Fiddler AI
Evaluate, monitor, analyze, and improve MLOps and LLMOps from pre-production to production.
Glide
Cloud-Native LLM Routing Engine. Improve LLM app resilience and speed.
gotoHuman
Bring a human into the loop in your LLM-based and agentic workflows. Prompt users to approve actions, select next steps, or review and validate generated results.
Haystack
Quickly compose applications with LLM Agents, semantic search, question-answering and more.
In 13 listsDetails
Hive
Open-source AI agent framework for building goal-driven, self-improving autonomous agents with auto-generated graphs, evolution loops, and MCP integration.
In 5 listsDetails
Helicone
Open source LLM observability platform. One line of code to monitor, evaluate, and experiment with features like prompt management, agent tracing, and evaluations.
In 8 listsDetails
Humanloop
The LLM evals platform for enterprises, providing tools to develop, evaluate, and observe AI systems.
In 2 lists
Hypersigil
Open-source prompt lifecycle management and gateway with a Web UI.
Izlo
Prompt management tools for teams. Store, improve, test, and deploy your prompts in one unified workspace.
Keywords AI
A unified DevOps platform for AI software. Keywords AI makes it easy for developers to build LLM applications.
In 2 lists
MLflow
An open-source framework for the end-to-end machine learning lifecycle, helping developers track experiments, evaluate models/prompts, deploy models, and add observability with tracing.
In 7 listsDetails
Laminar
Open-source all-in-one platform for engineering AI products. Traces, Evals, Datasets, Labels.
In 2 lists
LangFlow
An effortless way to experiment and prototype LangChain flows with drag-and-drop components and a chat interface.
In 4 listsDetails
Langfuse
Open Source LLM Engineering Platform: Traces, evals, prompt management and metrics to debug and improve your LLM application.
In 10 listsDetails
LangKit
Out-of-the-box LLM telemetry collection library that extracts features and profiles prompts, responses and metadata about how your LLM is performing over time to find problems at scale.
In 4 listsDetails
LangWatch
LLM Ops platform with Analytics, Monitoring, Evaluations and an LLM Optimization Studio powered by DSPy
In 4 listsDetails
LiteLLM 🚅
A simple & light 100 line package to standardize LLM API calls across OpenAI, Azure, Cohere, Anthropic, Replicate API Endpoints
In 16 listsDetails
Literal AI
Multi-modal LLM observability and evaluation platform. Create prompt templates, deploy prompts versions, debug LLM runs, create datasets, run evaluations, monitor LLM metrics and collect human feedback.
LlamaIndex
Provides a central interface to connect your LLMs with external data.
In 2 lists
LLMApp
LLM App is a Python library that helps you build real-time LLM-enabled data pipelines with few lines of code.
In 5 listsDetails
LLMFlows
LLMFlows is a framework for building simple, explicit, and transparent LLM applications such as chatbots, question-answering systems, and agents.
In 2 lists
LRM
CLI/TUI tool for managing localization files (.resx, JSON, Android, iOS) with LLM-powered translation via Ollama, validation, and code scanning for unused/missing keys.
In 2 lists
Lunary
Observability and prompt management for LLM chabots and agents. Debug agents with powerful tracing and logging. Usage analytics and dive deep into the history of your requests. Developer friendly modules with plug-and-play integration into LangChain.
In 2 lists
Mengram
Open-source memory infrastructure for AI agents. Provides semantic (entities/facts), episodic (conversations), and procedural (learned behaviors) memory with auto-reflection. Python SDK, JS SDK, MCP server, and REST API.
magentic
Seamlessly integrate LLMs as Python functions. Use type annotations to specify structured output. Mix LLM queries and function calling with regular Python code to create complex LLM-powered functionality.
In 4 listsDetails
Manag.ai
Your all-in-one prompt management and observability platform. Craft, track, and perfect your LLM prompts with ease.
Mirascope
Intuitive convenience tooling for lightning-fast, efficient development and ensuring quality in LLM-based applications
In 3 lists
Neurolink
Multi-provider AI agent framework that unifies 12+ LLM providers (OpenAI, Google, Anthropic, AWS, Azure, Groq, etc.) with workflow orchestration. Production-grade platform for building LLM applications with streaming, tool calling, caching, and enterprise features. Battle-tested at 15M+…
In 7 listsDetails
OpenLIT
OpenLIT is an OpenTelemetry-native GenAI and LLM Application Observability tool and provides OpenTelmetry Auto-instrumentation for monitoring LLMs, VectorDBs and Frameworks. It provides valuable insights into token & cost usage, user interaction, and performance related metrics.
In 5 listsDetails
Opik
Confidently evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.
In 16 listsDetails
Parea AI
Platform and SDK for AI Engineers providing tools for LLM evaluation, observability, and a version-controlled enhanced prompt playground.
Pezzo 🕹️
Pezzo is the open-source LLMOps platform built for developers and teams. In just two lines of code, you can seamlessly troubleshoot your AI operations, collaborate and manage your prompts in one place, and instantly deploy changes to any environment.
In 4 listsDetails
PraisonAI
Production-ready Multi-AI Agents framework with self-reflection. Fastest agent instantiation (3.77μs), 100+ LLM support via LiteLLM, MCP integration, agentic workflows (route/parallel/loop/repeat), built-in memory, Python & JS SDKs.
In 9 listsDetails
PromptDX
A declarative, extensible, and composable approach for developing LLM prompts using Markdown and JSX.
PromptHub
Full stack prompt management tool designed to be usable by technical and non-technical team members. Test, version, collaborate, deploy, and monitor, all from one place.
In 2 lists
promptfoo
Open-source tool for testing & evaluating prompt quality. Create test cases, automatically check output quality and catch regressions, and reduce evaluation cost.
PromptFoundry
The simple prompt engineering and evaluation tool designed for developers building AI applications.
PromptLayer 🍰
Prompt Engineering platform. Collaborate, test, evaluate, and monitor your LLM applications
PromptMage
Open-source tool to simplify the process of creating and managing LLM workflows and prompts as a self-hosted solution.
PromptSite
A lightweight Python library for prompt lifecycle management that helps you version control, track, experiment and debug with your LLM prompts with ease. Minimal setup, no servers, databases, or API keys required - works directly with your local filesystem, ideal for data scientists and engineers…
Prompteams
Prompt management system. Version, test, collaborate, and retrieve prompts through real-time APIs. Have GitHub style with repos, branches, and commits (and commit history).
prompttools
Open-source tools for testing and experimenting with prompts. The core idea is to enable developers to evaluate prompts using familiar interfaces like code and notebooks. In just a few lines of codes, you can test your prompts and parameters across different models (whether you are using OpenAI,…
Puzzlet AI
The Git-Based LLM Engineering Platform. Achieve more from GenAI: Manage, evaluate, and improve your full-stack LLM application - with version control, type-safety, and local development built-in.
systemprompt.io
Systemprompt.io is a Rest API with quality tooling to enable the creation, use and observability of prompts in any AI system. Control every detail of your prompt for a SOTA prompt management experience.
TeamoRouter
LLM routing gateway for OpenClaw. One API key to access Claude, GPT-4o, Gemini, DeepSeek, Kimi, MiniMax. Smart routing modes (teamo-best, teamo-balanced, teamo-eco) auto-pick the optimal model. Up to 50% off official prices. 2-second install via skill.md.
TreeScale
All In One Dev Platform For LLM Apps. Deploy LLM-enhanced APIs seamlessly using tools for prompt optimization, semantic querying, version management, statistical evaluation, and performance tracking. As a part of the developer friendly API implementation TreeScale offers Elastic LLM product, which…
TrueFoundry
Deploy LLMOps tools like Vector DBs, Embedding server etc on your own Kubernetes (EKS,AKS,GKE,On-prem) Infra including deploying, Fine-tuning, tracking Prompts and serving Open Source LLM Models with full Data Security and Optimal GPU Management. Train and Launch your LLM Application at Production…
In 2 lists
ReliableGPT 💪
Handle OpenAI Errors (overloaded OpenAI servers, rotated keys, or context window errors) for your production LLM Applications.
In 2 lists
Registry Broker
Universal index and routing layer for AI agents. Aggregates agent metadata from multiple registries (NANDA, MCP, Virtuals, OpenRouter, A2A, X402 Bazaar) across web2 and web3, normalizes profiles, and provides protocol translation between agent ecosystems.
In 2 lists
Rhesis
Open-source testing infrastructure for LLM and agentic applications. Collaborative platform enabling teams to define quality metrics, run evaluations, and ship confidently with version control and peer review workflows built for AI engineering.
In 3 lists
Roundtable
Zero-configuration unified AI assistant management built on the FastMCP framework. Provides seamless integration with Claude, ChatGPT, and other AI assistants through a single MCP interface with session management, logging, and production-ready operations.
In 2 lists
Portkey
Control Panel with an observability suite & an AI gateway — to ship fast, reliable, and cost-efficient apps.
In 3 lists
Semantic Cache Router
Distributed semantic cache and stateful routing system that cuts LLM API costs by returning cached responses for semantically similar queries. Uses ANN vector search (cosine ≥ 0.8) and consistent hashing to pin requests to the same worker, achieving ~7× latency reduction on cache hits while…
Statewave
Open-source memory runtime for AI agents. Compiles events into deterministic, provenance-tagged context bundles instead of query-time retrieval. Apache-2.0, self-hostable on Postgres + pgvector.
TensorZero
TensorZero is an open-source framework for building production-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluations, and experimentation.
In 3 lists
Vellum
An AI product development platform to experiment with, evaluate, and deploy advanced LLM apps.
Weights & Biases (Prompts)
A suite of LLMOps tools within the developer-first W&B MLOps platform. Utilize W&B Prompts for visualizing and inspecting LLM execution flow, tracking inputs and outputs, viewing intermediate results, securely managing prompts and LLM chain configurations.
Wordware
A web-hosted IDE where non-technical domain experts work with AI Engineers to build task-specific AI agents. It approaches prompting as a new programming language rather than low/no-code blocks.
In 4 listsDetails
xTuring
Build and control your personal LLMs with fast and efficient fine-tuning.
In 2 lists
ZenML
Open-source framework for orchestrating, experimenting and deploying production-grade ML solutions, with built-in langchain & llama_index integrations.
In 5 listsDetails
SwarmClaw
Self-hosted multi-agent AI runtime with 23+ LLM providers, persistent memory, skills, schedules, sub-agent spawning, and MCP client + server support. Ships as desktop app, CLI, or Docker.
In 3 lists
ai-evaluation
Evaluation framework for automated, reproducible scoring of LLM, agent, and workflow performance.
In 2 lists
future-agi
Open-source self-hostable end-to-end agent engineering and optimization platform unifying tracing, evals, simulations, datasets, gateway, and guardrails for LLM and AI agent applications.
In 6 listsDetails
Search >Hybrid search
Airweave
An easy way to turn any app into searchable data for LLMs.
In 2 lists
Search >Vector search
AquilaDB
An easy to use Neural Search Engine. Index latent vectors along with JSON metadata and do efficient k-NN search.
In 2 lists
Awadb
AI Native database for embedding vectors
Epsilla
A 10x faster, cheaper, and better vector database
In 3 lists
Infinity
The AI-native database built for LLM applications, providing incredibly fast vector and full-text search
In 9 listsDetails
Lancedb
Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!
In 4 listsDetails
Omnigraph
Typed graph database where agents branch and merge like Git. S3-native, Rust, traversal + vector + BM25 in one runtime.
In 5 listsDetails
Pinecone
The Pinecone vector database makes it easy to build high-performance vector search applications. Developer-friendly, fully managed, and easily scalable without infrastructure hassles.
In 8 listsDetails
Rivestack
Managed PostgreSQL with pgvector for AI workloads. Built-in SQL editor lets you query your database with natural language (auto-converted to vector embeddings). Free tier includes 2GB storage.
In 3 lists
VectorChord
Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.
In 2 lists
pgvecto.rs
Vector database plugin for Postgres, written in Rust, specifically designed for LLM.
In 2 lists
Qdrant
Vector Search Engine and Database for the next generation of AI applications. Also available in the cloud
In 8 listsDetails
Vald
A Highly Scalable Distributed Vector Search Engine
In 3 lists
Vearch
A distributed system for embedding-based vector retrieval
In 3 lists
VectorDB
A Python vector database you just need - no more, no less.
Vellum
A managed service for ingesting documents and performing hybrid semantic/keyword search across them. Comes with out-of-box support for OCR, text chunking, embedding model experimentation, metadata filtering, and production-grade APIs.
Weaviate
Weaviate is an open source vector search engine that stores both objects and vectors, allowing for combining vector search with structured filtering with the fault-tolerance and scalability of a cloud-native database, all accessible through GraphQL, REST, and various language clients.
In 2 lists
Code AI
AgentsMesh
Self-hostable AI Agent Workforce Platform. Multi-agent orchestration with remote AI workstations (AgentPods), PTY sandbox + git worktree isolation, built-in Kanban, and per-pod MCP server. Supports Claude Code, Codex CLI, Gemini CLI, Aider, OpenCode.
In 4 listsDetails
Bernstein
Deterministic Python orchestrator for 37 CLI coding agents (Claude Code, Codex CLI, Gemini CLI, GitHub Copilot CLI, Cursor, Aider, OpenHands, OpenCode, Goose, Qwen, Ollama, ...) running in parallel git worktrees. First-class MCP server, quality gates, cost tracking with budgets.
In 6 listsDetails
CodeGeeX
CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)
In 2 lists
CodeGen
CodeGen is an open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.
In 4 listsDetails
CodeT5
Open Code LLMs for Code Understanding and Generation.
In 2 lists
Continue
⏩ the open-source autopilot for software development—bring the power of ChatGPT to VS Code
In 10 listsDetails
fauxpilot
An open-source alternative to GitHub Copilot server
In 2 lists
promptext
Smart code context extractor for AI assistants with accurate token counting and budget management
Training >IDEs and Workspaces
code server
Run VS Code on any machine anywhere and access it in the browser.
In 5 listsDetails
Docker
Moby is an open-source project created by Docker to enable and accelerate software containerization.
In 9 listsDetails
Jupyter Notebooks
The Jupyter notebook is a web-based notebook environment for interactive computing.
In 5 listsDetails
Kurtosis
A build, packaging, and run system for ephemeral multi-container environments.
In 2 lists
Training >Foundation Model Fine Tuning
alpaca-lora
Instruct-tune LLaMA on consumer hardware
In 4 listsDetails
finetuning-scheduler
A PyTorch Lightning extension that accelerates and enhances foundation model experimentation with flexible fine-tuning schedules.
Flyflow
Open source, high performance fine tuning as a service for GPT4 quality models with 5x lower latency and 3x lower cost
LMFlow
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models
In 4 listsDetails
Lora
Using Low-rank adaptation to quickly fine-tune diffusion models.
p-tuning-v2
An optimized prompt tuning strategy achieving comparable performance to fine-tuning on small/medium-sized models and sequence tagging challenges. (ACL 2022)
QLoRA
Efficient finetuning approach that reduces memory usage enough to finetune a 65B parameter model on a single 48GB GPU while preserving full 16-bit finetuning task performance.
In 2 lists
Training >Frameworks for Training
Accelerate
🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision.
In 6 listsDetails
Apache MXNet
Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler.
In 2 lists
axolotl
A tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures.
ColossalAI
An integrated large-scale model training system with efficient parallelization techniques.
In 14 listsDetails
DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
In 7 listsDetails
Horovod
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
In 4 lists
Kedro
Kedro is an open-source Python framework for creating reproducible, maintainable and modular data science code.
In 7 listsDetails
Keras
Keras is a deep learning API written in Python, running on top of the machine learning platform TensorFlow.
In 9 listsDetails
LightGBM
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
In 8 listsDetails
MegEngine
MegEngine is a fast, scalable and easy-to-use deep learning framework, with auto-differentiation.
In 2 lists
metric-learn
Metric Learning Algorithms in Python.
In 2 lists
MindSpore
MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
In 2 lists
Oneflow
OneFlow is a performance-centered and open-source deep learning framework.
In 2 lists
PaddlePaddle
Machine Learning Framework from Industrial Practice.
In 6 listsDetails
PyTorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration.
In 16 listsDetails
PyTorch Lightning
Deep learning framework to train, deploy, and ship AI products Lightning fast.
In 3 lists
XGBoost
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library.
In 11 listsDetails
scikit-learn
Machine Learning in Python.
In 10 listsDetails
TensorFlow
An Open Source Machine Learning Framework for Everyone.
In 23 listsDetails
VectorFlow
A minimalist neural network library optimized for sparse data and single machine environments.
In 2 lists
Training >Experiment Tracking
ClearML
Auto-Magical CI/CD to streamline your ML workflow. Experiment Manager, MLOps and Data-Management
In 3 lists
Comet
Comet is an MLOps platform that offers experiment tracking, model production management, a model registry, and full data lineage from training straight through to production. Comet plays nicely with all your favorite tools, so you don't have to change your existing workflow. Comet Opik to…
In 4 listsDetails
Guild AI
Experiment tracking, ML developer tools.
Kedro-Viz
Kedro-Viz is an interactive development tool for building data science pipelines with Kedro. Kedro-Viz also allows users to view and compare different runs in the Kedro project.
In 2 lists
LabNotebook
LabNotebook is a tool that allows you to flexibly monitor, record, save, and query all your machine learning experiments.
Sacred
Sacred is a tool to help you configure, organize, log and reproduce experiments.
In 6 listsDetails
Weights & Biases
A developer first, lightweight, user-friendly experiment tracking and visualization tool for machine learning projects, streamlining collaboration and simplifying MLOps. W&B excels at tracking LLM-powered applications, featuring W&B Prompts for LLM execution flow visualization, input and output…
In 5 listsDetails
Training >Visualization
Fiddler AI
Rich dashboards, reports, and UMAP to perform root cause analysis, pinpoint problem areas, like correctness, safety, and privacy issues, and improve LLM outcomes.
LangWatch
LLM Ops platform with Analytics, Monitoring, Evaluations and an LLM Optimization Studio powered by DSPy
In 4 listsDetails
Maniford
A model-agnostic visual debugging tool for machine learning.
In 3 lists
OpenOps
Bring multiple data streams into one dashboard.
TensorBoard
TensorFlow's Visualization Toolkit.
In 3 lists
TensorSpace
Neural network 3D visualization framework, build interactive and intuitive model in browsers, support pre-trained deep learning models from TensorFlow, Keras, TensorFlow.js.
dtreeviz
A python library for decision tree visualization and model interpretation.
Zetane Viewer
ML models and internal tensors 3D visualizer.
Zeno
AI evaluation platform for interactively exploring data and model outputs.
Training >Model Editing
FastEdit
FastEdit aims to assist developers with injecting fresh and customized knowledge into large language models efficiently using one single command.
Data >Data Management
ArtiVC
A version control system to manage large files. Lake is a dataset format with a simple API for creating, storing, and collaborating on AI datasets of any size.
Delta-Lake
Storage layer that brings scalable, ACID transactions to Apache Spark and other engines.
In 6 listsDetails
Quilt
A self-organizing data hub for S3.
In 3 lists
Data >Data Storage
Data >Data Tracking
Data >Feature Engineering
Featureform
The Virtual Feature Store. Turn your existing data infrastructure into a feature store.
In 3 lists
FeatureTools
An open source python framework for automated feature engineering
In 3 lists
Data >Data/Feature enrichment
Upgini
Free automated data & feature enrichment library for machine learning: automatically searches through thousands of ready-to-use features from public and community shared data sources and enriches your training dataset with only the accuracy improving features
In 4 listsDetails
distilabel
⚗️ distilabel is a framework for synthetic data and AI feedback for AI engineers that require high-quality outputs, full data ownership, and overall efficiency.
In 3 lists
FastDatasets
A powerful tool for creating high-quality training datasets for Large Language Models.
Large Scale Deployment >ML Platforms
Comet
Comet is an MLOps platform that offers experiment tracking, model production management, a model registry, and full data lineage from training straight through to production. Comet plays nicely with all your favorite tools, so you don't have to change your existing workflow. Comet Opik to…
In 4 listsDetails
ClearML
Auto-Magical CI/CD to streamline your ML workflow. Experiment Manager, MLOps and Data-Management
In 3 lists
dstack
Open-source confidential AI framework for secure LLM deployment with data privacy, providing hardware-enforced isolation using Intel TDX and NVIDIA Confidential Computing.
In 2 lists
Hopsworks
Hopsworks is a MLOps platform for training and operating large and small ML systems, including fine-tuning and serving LLMs. Hopsworks includes both a feature store and vector database for RAG.
In 5 listsDetails
OpenLLM
An open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease.
In 10 listsDetails
MLflow
An open-source framework for the end-to-end machine learning lifecycle, helping developers track experiments, evaluate models/prompts, deploy models, and add observability with tracing.
In 7 listsDetails
ModelFox
ModelFox is a platform for managing and deploying machine learning models.
KubeStellar Console
Open source AI-powered multi-cluster Kubernetes dashboard for managing LLM workloads across hybrid edge and cloud environments. GPU monitoring, benchmark streaming, real-time observability with 20+ CNCF integrations, and AI-guided cluster operations. CNCF Sandbox project.
In 3 lists
PAI
Resource scheduling and cluster management for AI.
Primehub
An effortless infrastructure for machine learning built on the top of Kubernetes.
OpenModelZ
One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or even a single machine).
Seldon-core
An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
In 6 listsDetails
Starwhale
An MLOps/LLMOps platform for model building, evaluation, and fine-tuning.
In 2 lists
TrueFoundry
A PaaS to deploy, Fine-tune and serve LLM Models on a company’s own Infrastructure with Data Security and Optimal GPU and Cost Management. Launch your LLM Application at Production scale with best DevSecOps practices.
Weights & Biases
A developer first, lightweight, user-friendly experiment tracking and visualization tool for machine learning projects, streamlining collaboration and simplifying MLOps. W&B excels at tracking LLM-powered applications, featuring W&B Prompts for LLM execution flow visualization, input and output…
In 5 listsDetails
Large Scale Deployment >Workflow
aqueduct
An Open-Source Platform for Production Data Science
In 2 lists
Argo Workflows
Workflow engine for Kubernetes.
In 10 listsDetails
Flyte
Kubernetes-native workflow automation platform for complex, mission-critical data and ML processes at scale.
In 5 listsDetails
Hamilton
A lightweight framework to represent ML/language model pipelines as a series of python functions.
In 10 listsDetails
Kitaru
Durable execution layer for AI agents. Checkpoints, replay, resume, and observability primitives that make agent workflows persistent and replayable — no graph DSL required.
In 2 lists
Kubeflow Pipelines
Machine Learning Pipelines for Kubeflow.
In 3 lists
LangFlow
An effortless way to experiment and prototype LangChain flows with drag-and-drop components and a chat interface.
In 4 listsDetails
Ploomber
The fastest way to build data pipelines. Develop iteratively, deploy anywhere.
In 5 listsDetails
VDP
An open-source unstructured data ETL tool to streamline the end-to-end unstructured data processing pipeline.
In 3 lists
ZenML
Open-source framework for orchestrating, experimenting and deploying production-grade ML solutions, with built-in langchain & llama_index integrations.
In 5 listsDetails
simulate-sdk
Enterprise-grade Voice AI simulation SDK for scenario-driven stress testing of multimodal and agentic systems.
Large Scale Deployment >Scheduling
Large Scale Deployment >Model Management
Comet
Comet is an MLOps platform that offers experiment tracking, model production management, a model registry, and full data lineage from training straight through to production. Comet plays nicely with all your favorite tools, so you don't have to change your existing workflow. Comet Opik to…
In 4 listsDetails
ModelDB
Open Source ML Model Versioning, Metadata, and Experiment Management
In 2 lists
ormb
Docker for Your ML/DL Models Based on OCI Artifacts
Performance >ML Compiler
ONNX-MLIR
Compiler technology to transform a valid Open Neural Network Exchange (ONNX) graph into code that implements the graph with minimum runtime support.
bitsandbytes
Accessible large language models via k-bit quantization for PyTorch.
In 4 listsDetails
TVM
Open deep learning compiler stack for cpu, gpu and specialized accelerators
In 3 lists
Performance >Profiling
octoml-profile
octoml-profile is a python library and cloud service designed to provide the simplest experience for assessing and optimizing the performance of PyTorch models on cloud hardware with state-of-the-art ML acceleration technology.
AutoML
Archai
a platform for Neural Network Search (NAS) that allows you to generate efficient deep networks for your applications.
In 2 lists
autoai
A framework to find the best performing AI/ML model for any AI problem.
AutoGL
An autoML framework & toolkit for machine learning on graphs
In 2 lists
automl-gs
Provide an input CSV and a target field to predict, generate a model + code to run it.
Auto-PyTorch
Automatic architecture search and hyperparameter optimization for PyTorch.
In 4 lists
auto-sklearn
an automated machine learning toolkit and a drop-in replacement for a scikit-learn estimator.
In 4 listsDetails
Dragonfly
An open source python library for scalable Bayesian optimisation.
Determined
scalable deep learning training platform with integrated hyperparameter tuning support; includes Hyperband, PBT, and other search methods.
In 5 listsDetails
DEvol (DeepEvolution)
a basic proof of concept for genetic architecture search in Keras.
EvalML
An open source python library for AutoML.
In 3 lists
FEDOT
AutoML framework for the design of composite pipelines.
In 2 lists
Goptuna
A hyperparameter optimization framework, inspired by Optuna.
In 3 lists
HpBandSter
a framework for distributed hyperparameter optimization.
HPOlib2
a library for hyperparameter optimization and black box optimization benchmarks.
Hyperband
open source code for tuning hyperparams with Hyperband.
Hypernets
A General Automated Machine Learning Framework.
Hyperopt
Distributed Asynchronous Hyperparameter Optimization in Python.
In 4 lists
hyperunity
A toolset for black-box hyperparameter optimisation.
Intelli
A framework to connect a flow of ML models by applying graph theory.
Keras Tuner
Hyperparameter tuning for humans.
In 4 listsDetails
learn2learn
PyTorch Meta-learning Framework for Researchers.
In 2 lists
Ludwig
a toolbox built on top of TensorFlow that allows to train and test deep learning models without the need to write code.
In 3 lists
MOE
a global, black box optimization engine for real world metric optimization by Yelp.
Model Search
a framework that implements AutoML algorithms for model architecture search at scale.
In 2 lists
NASGym
a proof-of-concept OpenAI Gym environment for Neural Architecture Search (NAS).
NNI
An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
In 5 listsDetails
Pycaret
An open-source, low-code machine learning library in Python that automates machine learning workflows.
In 5 listsDetails
REMBO
Bayesian optimization in high-dimensions via random embedding.
In 2 lists
RoBO
a Robust Bayesian Optimization framework.
scikit-optimize(skopt)
Sequential model-based optimization with a scipy.optimize interface.
In 3 lists
Spearmint
a software package to perform Bayesian optimization.
In 3 lists
TPOT
one of the very first AutoML methods and open-source software packages.
Torchmeta
A Meta-Learning library for PyTorch.
In 2 lists
Vegas
an AutoML algorithm tool chain by Huawei Noah's Arb Lab.
Optimizations
Entroly
Information-theoretic context optimization proxy. Cuts LLM token costs by 70–95% with zero accuracy loss using greedy submodular knapsack maximization.
In 5 listsDetails
FeatherCNN
FeatherCNN is a high performance inference engine for convolutional neural networks.
In 2 lists
Forward
A library for high performance deep learning inference on NVIDIA GPUs.
LangWatch
LLM Ops platform with Analytics, Monitoring, Evaluations and an LLM Optimization Studio powered by DSPy
In 4 listsDetails
lean-ctx
Context runtime and MCP server that reduces AI coding agent token costs via session caching, AST-aware compression, and shell output patterns. Website
In 4 listsDetails
NCNN
ncnn is a high-performance neural network inference framework optimized for the mobile platform.
In 6 listsDetails
PocketFlow
use AutoML to do model compression.
TensorFlow Model Optimization
A suite of tools that users, both novice and advanced, can use to optimize machine learning models for deployment and execution.
TNN
A uniform deep learning inference framework for mobile, desktop and server.
In 2 lists
optimum-tpu
Google TPU optimizations for transformers models
agent-opt
Automated optimization engine for improving agent workflows using feedback-driven iterative refinements.
Federated ML
EasyFL
An Easy-to-use Federated Learning Platform
FATE
An Industrial Grade Federated Learning Framework
In 2 lists
FedML
The federated learning and analytics library enabling secure and collaborative machine learning on decentralized data anywhere at any scale. Supporting large-scale cross-silo federated learning, cross-device federated learning on smartphones/IoTs, and research simulation.
In 2 lists
Flower
A Friendly Federated Learning Framework
In 2 lists
Harmonia
Harmonia is an open-source project aiming at developing systems/infrastructures and libraries to ease the adoption of federated learning (abbreviated to FL) for researches and production usage.
TensorFlow Federated
A framework for implementing federated learning
In 3 lists
Related lists in Computer Science
See category94
Table of Contents
hesreallyhim/awesome-claude-code
A hand-picked collection of the finest of resources for the most awesome of agents, Claude Code, the undisputed champion of coding companions, from the unstoppable team…
94
Awesome Agent Skills
VoltAgent/awesome-agent-skills
A curated collection of 1000+ agent skills from official dev teams and the community, compatible with Claude Code, Codex, Gemini CLI, Cursor, and more.
93
Awesome Machine Learning
josephmisiti/awesome-machine-learning
A curated list of awesome Machine Learning frameworks, libraries and software.
92
Awesome Production Machine Learning
EthicalML/awesome-production-machine-learning
A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
92
AWESOME DATA SCIENCE
academic/awesome-datascience
:memo: An awesome Data Science repository to learn and apply for real world problems.
91
Static Analysis
analysis-tools-dev/static-analysis
⚙️ A curated list of static analysis (SAST) tools and linters for all programming languages, config files, build tools, and more. The focus is on tools which improve…