Top Speech recognition repositories on GitHub

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

• nlp
• natural-language-processing
• pytorch
• pytorch-transformers
• transformer
• model-hub

Port of OpenAI's Whisper model in C/C++

• openai
• speech-to-text
• transformer
• whisper
• inference
• speech-recognition

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

• deep-learning
• machine-learning
• neural-networks
• tensorflow
• speech-recognition
• speech-to-text

Faster Whisper transcription with CTranslate2

• deep-learning
• inference
• quantization
• speech-recognition
• speech-to-text
• transformer

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

• asr
• speech
• speech-recognition
• speech-to-text
• whisper

Industrial-grade speech recognition toolkit: 170x realtime, 50+ languages, speaker diarization, emotion detection, streaming, and OpenAI-compatible API.

• pytorch
• speech-recognition
• paraformer
• punctuation
• speaker-diarization
• voice-activity-detection

🧠 Leon is your open-source personal assistant.

• leon
• personal-assistant
• nodejs
• python
• ai
• artificial-intelligence

kaldi-asr/kaldi is the official location of the Kaldi project.

• kaldi
• c-plus-plus
• cuda
• shell
• speech-recognition
• speech-to-text

Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node

• speech-recognition
• asr
• voice-recognition
• speech-to-text
• android
• ios

State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.

• computer-vision
• deep-learning
• drug-discovery
• forecasting
• large-language-models
• mxnet

Drench yourself in Deep Learning, Reinforcement Learning, Machine Learning, Computer Vision, and NLP by learning from these exciting lectures!!

• machine-learning
• deep-learning
• deep-neural-networks
• pattern-recognition
• computer-vision
• optimization

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

• transformer
• conformer
• speech-translation
• streaming-asr
• speech-alignment
• punctuation-restoration

A PyTorch-based Speech Toolkit

• speech-recognition
• speech-toolkit
• speaker-recognition
• speech-to-text
• speech-enhancement
• speech-separation

Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube download, Demucs vocal isolation, and multilingual translation.

• faster-whisper
• tts
• whisper
• gradio
• subtitles
• transcription

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

• inference
• deep-learning
• openvino
• ai
• computer-vision
• diffusion-models

End-to-End Speech Processing Toolkit

• deep-learning
• end-to-end
• chainer
• pytorch
• kaldi
• speech-recognition

Speech recognition module for Python, supporting several engines and APIs, online and offline.

• python
• audio
• speech-recognition
• speech-to-text

Multilingual speech understanding: ASR + emotion recognition + audio event detection. 50+ languages, 15x faster than Whisper, non-autoregressive.

• asr
• speech-recognition
• speech-to-text
• cross-lingual
• llm
• python

A Deep-Learning-Based Chinese Speech Recognition System 基于深度学习的中文语音识别系统

• tensorflow
• cnn
• ctc
• python
• keras
• speech-recognition

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

• apple-silicon
• audio-processing
• mlx
• multimodal
• speech-recognition
• speech-synthesis

The open-source ElevenLabs alternative for local voice cloning, design, create, dubbing and dictation Desktop App

• tts
• voice-cloning
• voice-generation
• voice-ai
• asr
• elevenlabs

💬 Speech recognition for your site

• speech-recognition
• speech
• speech-to-text
• voice

Facebook AI Research's Automatic Speech Recognition Toolkit

• wav2letter
• speech-recognition
• end-to-end
• deep-learning
• cpp

On-device Speech AI for Apple Silicon

• inference
• ios
• speech-recognition
• swift
• whisper
• transformers

All-in-One Development Tool based on PaddlePaddle

• classification
• segmentation
• deployment
• ocr
• time-series
• pp-chatocr