Top Speech recognition repositories on GitHub

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

• nlp
• natural-language-processing
• pytorch
• pytorch-transformers
• transformer
• model-hub

Port of OpenAI's Whisper model in C/C++

• openai
• speech-to-text
• transformer
• whisper
• inference
• speech-recognition

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

• deep-learning
• machine-learning
• neural-networks
• tensorflow
• speech-recognition
• speech-to-text

Faster Whisper transcription with CTranslate2

• deep-learning
• inference
• quantization
• speech-recognition
• speech-to-text
• transformer

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

• asr
• speech
• speech-recognition
• speech-to-text
• whisper

Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

• pytorch
• speech-recognition
• paraformer
• punctuation
• speaker-diarization
• voice-activity-detection

🧠 Leon is your open-source personal assistant.

• leon
• personal-assistant
• nodejs
• python
• ai
• artificial-intelligence

kaldi-asr/kaldi is the official location of the Kaldi project.

• kaldi
• c-plus-plus
• cuda
• shell
• speech-recognition
• speech-to-text

Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node

• speech-recognition
• asr
• voice-recognition
• speech-to-text
• android
• ios

State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.

• computer-vision
• deep-learning
• drug-discovery
• forecasting
• large-language-models
• mxnet

Drench yourself in Deep Learning, Reinforcement Learning, Machine Learning, Computer Vision, and NLP by learning from these exciting lectures!!

• machine-learning
• deep-learning
• deep-neural-networks
• pattern-recognition
• computer-vision
• optimization

Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube download, Demucs vocal isolation, and multilingual translation.

• faster-whisper
• tts
• whisper
• gradio
• subtitles
• transcription

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

• transformer
• conformer
• speech-translation
• streaming-asr
• speech-alignment
• punctuation-restoration

A PyTorch-based Speech Toolkit

• speech-recognition
• speech-toolkit
• speaker-recognition
• speech-to-text
• speech-enhancement
• speech-separation

Real-time, local speech-to-text with streaming ASR, speaker diarization, translation, and OpenAI/Deepgram-compatible APIs.

• python
• real-time
• speaker-diarization
• speech-recognition
• speech-to-text
• streaming

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

• inference
• deep-learning
• openvino
• ai
• computer-vision
• diffusion-models

End-to-End Speech Processing Toolkit

• deep-learning
• end-to-end
• chainer
• pytorch
• kaldi
• speech-recognition

Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.

• asr
• speech-recognition
• speech-to-text
• cross-lingual
• pytorch
• speech-emotion-recognition

Speech recognition module for Python, supporting several engines and APIs, online and offline.

• python
• audio
• speech-recognition
• speech-to-text