Top Python Speech recognition repositories on GitHub

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

• nlp
• natural-language-processing
• pytorch
• pytorch-transformers
• transformer
• model-hub

Faster Whisper transcription with CTranslate2

• deep-learning
• inference
• quantization
• speech-recognition
• speech-to-text
• transformer

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

• asr
• speech
• speech-recognition
• speech-to-text
• whisper

Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

• pytorch
• speech-recognition
• paraformer
• punctuation
• speaker-diarization
• voice-activity-detection

Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube download, Demucs vocal isolation, and multilingual translation.

• faster-whisper
• tts
• whisper
• gradio
• subtitles
• transcription

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

• transformer
• conformer
• speech-translation
• streaming-asr
• speech-alignment
• punctuation-restoration

A PyTorch-based Speech Toolkit

• speech-recognition
• speech-toolkit
• speaker-recognition
• speech-to-text
• speech-enhancement
• speech-separation

Real-time, local speech-to-text with streaming ASR, speaker diarization, translation, and OpenAI/Deepgram-compatible APIs.

• python
• real-time
• speaker-diarization
• speech-recognition
• speech-to-text
• streaming

End-to-End Speech Processing Toolkit

• deep-learning
• end-to-end
• chainer
• pytorch
• kaldi
• speech-recognition

Speech recognition module for Python, supporting several engines and APIs, online and offline.

• python
• audio
• speech-recognition
• speech-to-text

A Deep-Learning-Based Chinese Speech Recognition System 基于深度学习的中文语音识别系统

• tensorflow
• cnn
• ctc
• python
• keras
• speech-recognition

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

• apple-silicon
• audio-processing
• mlx
• multimodal
• speech-recognition
• speech-synthesis

All-in-One Development Tool based on PaddlePaddle

• classification
• segmentation
• deployment
• ocr
• time-series
• pp-chatocr

FunASR-powered video transcription, subtitle generation, and LLM-assisted clipping tool with a local Gradio UI.

• speech-recognition
• video-subtitles
• subtitles-generator
• speech-to-text
• gradio
• llm

Production First and Production Ready End-to-End Speech Recognition Toolkit

• e2e-models
• pytorch
• asr
• transformer
• conformer
• production-ready

On-device wake word detection powered by deep learning

• wake-word-detection
• hotword
• keyword-spotting
• keyword-spotter
• wake-word
• wake-word-engine

Machine Learning and Agentic AI Resources, Practice and Research

• machine-learning
• deep-learning
• nlp
• computer-vision
• speech-recognition
• tensorflow

Voice Recognition to Text Tool / 一个离线运行的本地音视频转字幕工具，输出json、srt字幕、纯文字格式

• speech
• speech-recognition
• speech-to-text
• stt

Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.

• audio
• speech-recognition
• whisper