Top Transformers repositories on GitHub

21 Lessons, Get Started Building with Generative AI

• ai
• chatgpt
• dall-e
• generativeai
• gpt
• azure

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

• gpt
• large-language-models
• llm
• python
• pytorch
• ai

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

• fine-tuning
• llama
• llm
• peft
• transformers
• rlhf

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

• deep-learning
• deep-learning-tutorial
• pytorch
• gan
• transformers
• reinforcement-learning

Learn it. Build it. Ship it for others.

• agents
• ai
• ai-agents
• ai-engineering
• computer-vision
• course

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

• artificial-intelligence
• attention-mechanism
• transformers
• computer-vision
• image-classification

CVPR 2026 论文和开源项目合集

• cvpr
• cvpr2020
• computer-vision
• deep-learning
• machine-learning
• object-detection

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

• adapter
• diffusion
• llm
• parameter-efficient-learning
• python
• pytorch

Machine Learning Engineering Open Book

• pytorch
• slurm
• large-language-models
• llm
• machine-learning
• scalability

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

• ai
• python
• natural-language-processing
• react
• chatgpt
• docsgpt

Ongoing research training transformer models at scale

• large-language-models
• model-para
• transformers

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

• browser
• javascript
• transformers
• webml

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

• attention-mechanism
• deep-learning
• gpt
• gpt-2
• gpt-3
• language-model

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

• nlp
• embedding
• bert
• ernie
• paddlenlp
• pretrained-models

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

• python
• search
• nlp
• semantic-search
• vector-search
• txtai

A PyTorch-based Speech Toolkit

• speech-recognition
• speech-toolkit
• speaker-recognition
• speech-to-text
• speech-enhancement
• speech-separation

This repository contains demos I made with the Transformers library by HuggingFace.

• transformers
• pytorch
• bert
• vision-transformer
• layoutlm
• gpt-2

Semantic segmentation models with 500+ pretrained convolutional and transformer-based backbones.

• segmentation
• image-processing
• pspnet
• unet
• unet-pytorch
• pytorch

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

• nlp
• natural-language-processing
• natural-language-understanding
• language-model
• transformers
• bert