Skip to content

Entry

FastChat

Appears in 12 awesome lists

Open platform for training, serving, and evaluating large language model chatbots. Powers Chatbot Arena (lmarena.ai) serving 10M+ requests for 70+ LLMs. Includes training code for Vicuna, MT-Bench evaluation, and distributed multi-model serving with OpenAI-compatible APIs. Apache 2.0 licensed.

Open github.comlm-sys/fastchat

Found in these lists

awesome-ChatGPT-repositories

Section: Chatbots · The release repo for "Vicuna: An Open Chatbot Impressing GPT-4"

FreshScore 87

Awesome Generative AI

Section: Large Language Models (LLMs) · The release repo for "Vicuna: An Open Chatbot Impressing GPT-4" [demo]

SlowScore 62

Awesome-ChatGPT

Section: Python · An open platform for training, serving, and evaluating large language model based chatbots

FreshScore 84

Awesome LLMOps

Section: Large Language Model · An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and FastChat-T5.

ActiveScore 75

Awesome Open Gpt

Section: GPT开源平替机器人 · 1.斯坦福联手CMU、UC伯克利等机构的学者再次发布了130亿参数模型骆马(Vicuna),仅需300美元就能实现ChatGPT 90%的性能。

SlowScore 56

Awesome Open Source AI

Section: 7. Training & Fine-tuning Ecosystem · Open platform for training, serving, and evaluating large language model chatbots. Powers Chatbot Arena (lmarena.ai) serving 10M+ requests for 70+ LLMs. Includes training code for Vicuna, MT-Bench evaluation, and distributed multi-model serving with OpenAI-compatible APIs. Apache 2.0 licensed.

FreshScore 89

Awesome Production Machine Learning

Section: Industry Strength Natural Language Processing · FastChat is an open platform for training, serving, and evaluating large language model based chatbots.

FreshScore 92

awesome-python

Section: Other · An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

FreshScore 81

Table of Contents

Section: Other LLaMA-derived projects: · An open platform for training, serving, and evaluating large language model based chatbots.

StaleScore 52

Sponsors

Section: Python · An open platform for training, serving, and evaluating large language model based chatbots.

ActiveScore 78

Awesome AI Agents: Tools, Resources, and Projects

Section: Repositories · FastChat is a platform for training, serving, and evaluating large language model chatbots, featuring an open-source distributed multi-model system, API compatibility, and a dataset for LLM conversations github | demo | discord | twitter

SlowScore 68

Awesome Chatgpt

Section: Hosted and self-hosted · An open platform for training, serving, and evaluating large language model based chatbots.

SlowScore 69

Opik

Comet's open-source AI observability and evaluation platform: deep tracing of LLM calls, conversation logging, and agent activity, plus built-in eval metrics, prompt versioning, guardrails, and the Opik Agent Optimizer. Worth including because it unifies observability, verification, and…

In 16 listsDetails

LocalAI

robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video,…

In 14 listsDetails

Colossal-AI

(from Hpcaitech) - A Unified Deep Learning System for Large-Scale Parallel Training (1D, 2D, 2.5D, 3D and sequence parallelism, and ZeRO protocol).

In 14 listsDetails

Haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search,…

In 13 listsDetails

AutoGen

Microsoft's multi-agent conversation framework with a complete AgentChat layer covering agent loop, tool integration, termination conditions, and human-in-the-loop. The most comprehensive open-source reference for large-scale multi-agent harness design.

In 14 listsDetails

DSPy

(MIT) is a framework for algorithmically optimizing LM prompts and weights. DSPy introduced typed predictor and signatures to leverage Pydantic for enforcing type constraints on inputs and outputs, improving upon string-based fields.

In 11 listsDetails

Semantic Kernel

Semantic Kernel is an SDK that integrates Large Language Models (LLMs) like OpenAI, Azure OpenAI, and Hugging Face with conventional programming languages like C#, Python, and Java. Semantic Kernel achieves this by allowing you to define plugins that can be chained together in just a few lines of…

In 11 listsDetails

Langfuse

LLM engineering platform for model tracing, prompt management, and application evaluation. Langfuse helps teams collaboratively debug, analyze, and iterate on their LLM applications such as chatbots or AI agents. (Demo, Source Code, Clients) MIT Docker

In 10 listsDetails