Awesome Generative AI Data Scientist
Section: Fine-tuning · 20+ high-performance LLMs with recipes to pretrain, finetune, and deploy at scale.
SlowScore 52
Entry
LitGPT
Appears in 4 awesome lists
Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.
Open github.comlightning-ai/litgpt
Found in these lists
Awesome LLM Resources
Section: 微调 Fine-Tuning · Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.
FreshScore 87
Awesome Open Source AI
Section: 7. Training & Fine-tuning Ecosystem · Clean from-scratch implementations of 20+ LLMs.
FreshScore 89
awesome-python
Section: Other · 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
FreshScore 81
Often listed next to it
Colossal-AI
(from Hpcaitech) - A Unified Deep Learning System for Large-Scale Parallel Training (1D, 2D, 2.5D, 3D and sequence parallelism, and ZeRO protocol).
In 14 listsDetails
Ray
A fast and simple framework for building and running distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library. ray.io
In 13 listsDetails
FastChat
Open platform for training, serving, and evaluating large language model chatbots. Powers Chatbot Arena (lmarena.ai) serving 10M+ requests for 70+ LLMs. Includes training code for Vicuna, MT-Bench evaluation, and distributed multi-model serving with OpenAI-compatible APIs. Apache 2.0 licensed.
In 12 listsDetails
unsloth
Fine-tuning & Reinforcement Learning for LLMs. Train OpenAI gpt-oss, DeepSeek-R1, Qwen3, Gemma 3, TTS 2x faster with 70% less VRAM.
In 8 listsDetails
PEFT
Parameter-Efficient Fine-Tuning (PEFT) methods enable efficient adaptation of pre-trained language models (PLMs) to various downstream applications without fine-tuning all the model's parameters.
In 7 listsDetails
LeRobot
Making AI for robotics more accessible with end-to-end learning. State-of-the-art approaches for imitation learning and reinforcement learning with pretrained models, datasets, and simulated environments. Apache 2.0 licensed.
In 6 listsDetails
Ludwig
Low-code framework for building custom LLMs and deep neural networks. Declarative YAML configuration for training state-of-the-art models with PEFT/LoRA, 4-bit quantization, distributed training via Hugging Face Accelerate, and native Kubernetes support. Linux Foundation AI project. Apache 2.0…
In 6 listsDetails