Top Transformers repositories on GitHub

21 Lessons, Get Started Building with Generative AI

• ai
• chatgpt
• dall-e
• generativeai
• gpt
• azure

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

• chatgpt
• gpt
• large-language-models
• llm
• python
• pytorch

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

• fine-tuning
• llama
• llm
• peft
• transformers
• rlhf

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

• deep-learning
• deep-learning-tutorial
• pytorch
• gan
• transformers
• reinforcement-learning

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

• artificial-intelligence
• attention-mechanism
• transformers
• computer-vision
• image-classification

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

• nlp
• question-answering
• pytorch
• semantic-search
• information-retrieval
• summarization

CVPR 2026 论文和开源项目合集

• cvpr
• cvpr2020
• computer-vision
• deep-learning
• machine-learning
• object-detection

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

• adapter
• diffusion
• llm
• parameter-efficient-learning
• python
• pytorch

Machine Learning Engineering Open Book

• pytorch
• slurm
• large-language-models
• llm
• machine-learning
• scalability

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

• ai
• python
• natural-language-processing
• react
• chatgpt
• docsgpt

Ongoing research training transformer models at scale

• large-language-models
• model-para
• transformers

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

• browser
• javascript
• transformers
• webml

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

• attention-mechanism
• deep-learning
• gpt
• gpt-2
• gpt-3
• language-model

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

• nlp
• embedding
• bert
• ernie
• paddlenlp
• pretrained-models

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

• python
• search
• nlp
• semantic-search
• vector-search
• txtai

This repository contains demos I made with the Transformers library by HuggingFace.

• transformers
• pytorch
• bert
• vision-transformer
• layoutlm
• gpt-2

Semantic segmentation models with 500+ pretrained convolutional and transformer-based backbones.

• segmentation
• image-processing
• pspnet
• unet
• unet-pytorch
• pytorch

A PyTorch-based Speech Toolkit

• speech-recognition
• speech-toolkit
• speaker-recognition
• speech-to-text
• speech-enhancement
• speech-separation

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

• nlp
• natural-language-processing
• natural-language-understanding
• language-model
• transformers
• bert

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

• inference
• deep-learning
• openvino
• ai
• computer-vision
• diffusion-models

Open source real-time translation app for Android that runs locally

• translator
• bluetooth-le
• realtime-translator
• android-app
• onnx
• onnxruntime

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

• transformers
• vllm
• large-language-models
• raylib
• reinforcement-learning-from-human-feedback
• reinforcement-learning

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

• pytorch
• llm
• transformers
• gpu

[NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

• auto-regressive-model
• diffusion-models
• image-generation
• transformers
• autoregressive-models
• generative-ai

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

• language-model
• transformers
• gpt
• gpt-2
• gpt-3