Top Python Transformers repositories on GitHub

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

• fine-tuning
• llama
• llm
• peft
• transformers
• rlhf

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

• deep-learning
• deep-learning-tutorial
• pytorch
• gan
• transformers
• reinforcement-learning

Learn it. Build it. Ship it for others.

• agents
• ai
• ai-agents
• ai-engineering
• computer-vision
• course

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

• artificial-intelligence
• attention-mechanism
• transformers
• computer-vision
• image-classification

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

• adapter
• diffusion
• llm
• parameter-efficient-learning
• python
• pytorch

Machine Learning Engineering Open Book

• pytorch
• slurm
• large-language-models
• llm
• machine-learning
• scalability

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

• ai
• python
• natural-language-processing
• react
• chatgpt
• docsgpt

Ongoing research training transformer models at scale

• large-language-models
• model-para
• transformers

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

• attention-mechanism
• deep-learning
• gpt
• gpt-2
• gpt-3
• language-model

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

• nlp
• embedding
• bert
• ernie
• paddlenlp
• pretrained-models

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

• python
• search
• nlp
• semantic-search
• vector-search
• txtai

A PyTorch-based Speech Toolkit

• speech-recognition
• speech-toolkit
• speaker-recognition
• speech-to-text
• speech-enhancement
• speech-separation

Semantic segmentation models with 500+ pretrained convolutional and transformer-based backbones.

• segmentation
• image-processing
• pspnet
• unet
• unet-pytorch
• pytorch

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

• transformers
• vllm
• large-language-models
• raylib
• reinforcement-learning-from-human-feedback
• reinforcement-learning

An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

• python
• pii
• privacy
• data-anonymization
• de-identification
• data-masking

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

• pytorch
• llm
• transformers
• gpu

SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer

• diffusion
• dit
• pytorch
• sana
• text-to-image-generation
• transformers

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

• language-model
• transformers
• gpt
• gpt-2
• gpt-3

BertViz: Visualize Attention in Transformer Models

• natural-language-processing
• machine-learning
• visualization
• neural-network
• pytorch
• nlp

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

• artificial-intelligence
• attention-mechanisms
• deep-learning
• reinforcement-learning
• transformers
• human-feedback

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

• bert
• transformers
• topic-modeling
• sentence-embeddings
• nlp
• machine-learning

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

• deepspeed-library
• gpt-3
• transformers
• language-model

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

• apple-silicon
• audio-processing
• mlx
• multimodal
• speech-recognition
• speech-synthesis

SD.Next: All-in-one WebUI for AI generative image and video creation, captioning and processing

• sdnext
• ai-art
• caption
• diffusers
• generative-art
• python

A straightforward method for training your LLM, from downloading data to generating text.

• gemini
• large-language-models
• llm
• openai
• training
• transformers