Top Rust LLM repositories on GitHub
Large language model frameworks, agents, runtimes, and inference servers. Filtered to projects whose primary language is Rust.
Ranked by stars across 484 Rust repositories tagged llm. Refreshed daily.
- 1rtk-ai/rtk★ 80,867 · ⑂ 5,129
CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
- agentic-coding
- ai-coding
- anthropic
- claude-code
- cli
- command-line-tool
- 2tinyhumansai/openhuman★ 39,866 · ⑂ 3,931
OpenHuman is an open source agent harness with local-first memory, agent orchestration, and workflows
- ai-agents
- llm
- local-first
- rust
- agent-orchestration
- ai-assistant
- 3AlexsJones/llmfit★ 36,745 · ⑂ 2,329
Hundreds of models & providers. One command to find what runs on your hardware.
- llm
- skill
- localai
- gguf
- mlx
- unsloth
- 4Zackriya-Solutions/meetily★ 30,899 · ⑂ 3,345
Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows. Understand How to write meeting minutes
- meeting-minutes
- meeting-notes
- llm
- mac
- windows
- rust
- Live search
Find the people behind these repos
Stars rank the projects. I can rank the engineers - maintainers, top contributors, and the people they work with. Fire one of these to see how it works.
500 free credits on sign-up, no card needed.
- 5
- 6RightNow-AI/openfang★ 18,199 · ⑂ 2,289
Open-source Agent Operating System
- agent-framework
- ai-agents
- llm
- mcp
- open-source
- openclaw
- 7memvid/memvid★ 16,546 · ⑂ 1,419
Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.
- ai
- context
- embedded
- faiss
- knowledge-base
- knowledge-graph
- 8tensorzero/tensorzero★ 11,720 · ⑂ 971
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
- ai
- artificial-intelligence
- deep-learning
- gpt
- llm
- llmops
- 9cocoindex-io/cocoindex★ 11,575 · ⑂ 900
Incremental engine for long horizon agents 🌟 Star if you like it!
- ai
- change-data-capture
- data-indexing
- etl
- indexing
- python
- 10sigoden/aichat★ 10,452 · ⑂ 743
All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.
- claude
- gemini
- ollama
- openai
- function-calling
- cli
- Live search
Who is hiring in this space?
I read hiring signals across LinkedIn, GitHub, and the open web - so a topic list becomes a warm outreach list. Try one live.
500 free credits on sign-up, no card needed.
- 11astrid-runtime/astrid★ 10,276 · ⑂ 138
Astrid is a portable, capability-secure operating system for composable software.
- agent-runtime
- ai-agents
- capability-security
- llm
- mcp
- microkernel
- 12BoundaryML/baml★ 9,193 · ⑂ 493
The programming language for agents
- llm
- boundaryml
- guardrails
- structured-data
- programming-language
- 130xPlaygrounds/rig★ 8,659 · ⑂ 969
⚙️🦀 Build modular and scalable LLM Applications in Rust
- ai
- llm
- agent
- artificial-intelligence
- automation
- large-language-model
- 14qualcomm/GenieX★ 8,378 · ⑂ 1,053
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
- llm
- on-device-ai
- sdk
- vlm
- go
- gpt-oss
- 15deeplethe/utopia★ 7,975 · ⑂ 1,025
World's first open-source enterprise world model.
- agent-memory
- knowledge-base
- knowledge-graph
- llm
- pgvector
- postgresql
- 16
- Live search
Turn any brief into a list like this
I run natural-language searches across GitHub, LinkedIn, and the open web. Describe who you want and I'll build the shortlist.
500 free credits on sign-up, no card needed.
- 17mufeedvh/code2prompt★ 7,656 · ⑂ 438
A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.
- ai
- chatgpt
- claude
- cli
- command-line
- command-line-tool
- 18tailcallhq/forgecode★ 7,634 · ⑂ 1,465
AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models
- ai-workflows
- artifical-intelligense
- claude-3-7-sonnet
- command-line
- multi-agent-reinforcement-learning
- shell
- 19postgresml/postgresml★ 6,823 · ⑂ 364
Postgres with GPUs for ML/AI apps.
- ml
- machine-learning
- ai
- ann
- artificial-intelligence
- classification
Find Rust engineers shipping LLM
The list above ranks the most-starred public Rust repositories tagged with the LLM topic, drawn from the public GitHub graph. Across 484 matching repositories, the contributors are a tight cluster of engineers with both Rust chops and real LLM experience.
That overlap is rare. Most Rust engineers haven’t shipped LLM, and most LLM maintainers don’t write Rust. The people on this list’s contributor graph are the ones who do both.
Refolk turns this list into a search. Ask for “Rust LLM maintainers hiring” or “Rust engineers shipping LLM in 2025” and Refolk returns a ranked shortlist with the commits, profiles, and projects behind each name.
How this list is built
Last refreshed: Fri, 18 Sep 2026 07:54:47 GMT
Need a more specific search?
Refolk runs natural-language searches across GitHub, LinkedIn, and the open web. Try one of these:
500 free credits on sign-up, no card needed.
Related lists
- Rust · CLI
- Rust · Terminal UI
- Rust · Blockchain
- Rust · Compilers
- Rust · Operating systems
- Rust · Web frameworks
- Rust · Embeddings
- Rust · Vector databases
See all repository lists.
Or zoom out
Common questions
How are these repositories ranked?
By stars, with forks and recent activity as tiebreakers, read from the public GitHub API. The methodology section above has the details.
How fresh is the data?
The ranking re-renders at least daily. Last refreshed: Fri, 18 Sep 2026 07:54:47 GMT.
Can I find the maintainers and contributors behind these repos?
Yes. Stars rank the projects; I can rank the engineers - maintainers, top contributors, and the people they work with. You start with 500 free credits, no card required.
Can I use this list for hiring?
That's the point. I read hiring signals across GitHub, LinkedIn, and the open web, so a repo list turns into a shortlist of engineers worth talking to.
Try it on the search you came here for
Stop building boolean strings. Just describe the person.
Type one sentence. I plan the search, read GitHub, public LinkedIn and Crunchbase records, and the open web as it is right now, and hand back a ranked list with the reason next to every name.
01Describe them
One plain sentence. Role, city, stack, stage, whatever matters to you.
02I read the web live
GitHub, public LinkedIn and Crunchbase records, the open web. Not a database that went stale last quarter.
03You read the shortlist
Ranked, with the reasoning under every name. Open a profile, ask a follow-up, narrow it down.
- Staff backend engineers in NYC who shipped Rust in production
- Series A fintechs in SF under 50 people, growing headcount this year
- Maintainers of fast-growing Rust web frameworks on GitHub
- No boolean, no filters, no seat to buy. One box.
- Read at search time, so a profile updated yesterday counts today.
- Every step visible as it runs, every name with its reason.
500 free credits on sign-up. No card, no demo call. See real searches.