Awesome Open Source AI
Section: 7. Training & Fine-tuning Ecosystem · Distributed training framework and reference codebase for large transformer models at scale.
FreshScore 89
Entry
Megatron-LM
Appears in 4 awesome lists
Distributed training framework and reference codebase for large transformer models at scale.
Open github.comnvidia/megatron-lm
Found in these lists
Awesome Production Machine Learning
Section: Industry Strength Natural Language Processing · Megatron-LM is a highly optimized and efficient library for training large language models.
FreshScore 92
awesome-python
Section: Other · Ongoing research training transformer models at scale
FreshScore 81
Awesome Transformer & Transfer Learning in NLP
Section: PyTorch · Ongoing research training transformer language models at scale, including: BERT.
StaleScore 52
Often listed next to it
Awesome Machine Learning
The definitive curated list of machine learning frameworks, libraries and software organized by language. Covers Python, C++, Java, JavaScript, and more with comprehensive coverage of the ML ecosystem. CC0-1.0 licensed.
In 15 listsDetails
Free Programming Books
books: Freely available programming books
In 7 listsDetails
LangChain
Langchain integrates various providers like Anthropic, AWS, and OpenAI, and offers tools for components such as LLMs, chat models, and data analysis, supporting functionalities from Alpha Vantage to YouTube github | docs
In 20 listsDetails
Awesome Artificial Intelligence
Curated list of artificial intelligence courses, books, video lectures, and papers for developers and researchers. MIT licensed.
In 7 listsDetails
Opik
Comet's open-source AI observability and evaluation platform: deep tracing of LLM calls, conversation logging, and agent activity, plus built-in eval metrics, prompt versioning, guardrails, and the Opik Agent Optimizer. Worth including because it unifies observability, verification, and…
In 16 listsDetails
transformers
(formerly known as pytorch-transformers and pytorch-pretrained-bert) provides state-of-the-art general-purpose architectures (BERT, GPT-2, RoBERTa, XLM, DistilBert, XLNet, CTRL...) for Natural Language Understanding (NLU) and Natural Language Generation (NLG) with over 32+ pretrained models in…
In 14 listsDetails
LlamaIndex
(MIT) provides modules for structured outputs at different levels of abstraction, including output parsers for text completion endpoints, Pydantic programs for mapping prompts to structured outputs using function calling or output parsing, and pre-defined Pydantic programs for specific output types.
In 14 listsDetails
Awesome Math
🟪 - Another awesome list for mathematics, useful generally but often applicable to programming.
In 6 listsDetails