Top Rust LLM repositories on GitHub
Large language model frameworks, agents, runtimes, and inference servers. Filtered to projects whose primary language is Rust.
Ranked by stars across 589 Rust repositories tagged llm. Refreshed daily.
- 1rtk-ai/rtk★ 85,567 · ⑂ 5,477
CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
- agentic-coding
- ai-coding
- anthropic
- claude-code
- cli
- command-line-tool
- 2janhq/jan★ 45,449 · ⑂ 3,148
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
- llamacpp
- localai
- self-hosted
- gpt
- tauri
- chatgpt
- 3tinyhumansai/openhuman★ 42,540 · ⑂ 4,208
The fastest, cheapest, most efficient open-source agent harness. Run more than 500 agents on a $10 VPS.
- ai-agents
- llm
- local-first
- rust
- agent-orchestration
- ai-assistant
- 4AlexsJones/llmfit★ 38,652 · ⑂ 2,498
Hundreds of models & providers. One command to find what runs on your hardware.
- llm
- skill
- localai
- gguf
- mlx
- unsloth
- Live search
Find the people behind these repos
Stars rank the projects. I can rank the engineers - maintainers, top contributors, and the people they work with. Fire one of these to see how it works.
500 free credits on sign-up, no card needed.
- 5Zackriya-Solutions/meetily★ 32,447 · ⑂ 3,571
Privacy-first AI meeting note taker for Windows and macOS. Free, open source (MIT). On-device Whisper/Parakeet transcription and speaker diarization, no meeting bot. Open-source alternative to Granola, Otter and Fireflies. https://meetily.ai
- meeting-minutes
- meeting-notes
- llm
- mac
- windows
- rust
- 6screenpipe/screenpipe★ 22,237 · ⑂ 2,266
YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context
- ai
- computer-vision
- llm
- machine-learning
- multimodal
- agents
- 71jehuang/jcode★ 21,483 · ⑂ 2,506
High performance coding agent harness written in Rust, built for heavy multi-agent dev workflows
- ai
- claude
- cli
- coding-agent
- llm
- mcp
- 8RightNow-AI/openfang★ 18,246 · ⑂ 2,286
Open-source Agent Operating System
- agent-framework
- ai-agents
- llm
- mcp
- open-source
- openclaw
- 9memvid/memvid★ 17,365 · ⑂ 1,470
Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.
- ai
- context
- embedded
- faiss
- knowledge-base
- knowledge-graph
- 10cocoindex-io/cocoindex★ 11,824 · ⑂ 926
Incremental engine for long horizon agents 🌟 Star if you like it!
- ai
- change-data-capture
- data-indexing
- etl
- indexing
- python
- Live search
Who is hiring in this space?
I read hiring signals across LinkedIn, GitHub, and the open web - so a topic list becomes a warm outreach list. Try one live.
500 free credits on sign-up, no card needed.
- 11tensorzero/tensorzero★ 11,707 · ⑂ 967
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
- ai
- artificial-intelligence
- deep-learning
- gpt
- llm
- llmops
- 12sigoden/aichat★ 10,545 · ⑂ 750
All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.
- claude
- gemini
- ollama
- openai
- function-calling
- cli
- 13astrid-runtime/astrid★ 10,290 · ⑂ 144
Astrid is a portable, capability-secure operating system for composable software.
- agent-runtime
- ai-agents
- capability-security
- llm
- mcp
- microkernel
- 14BoundaryML/baml★ 9,476 · ⑂ 511
The programming language for agents
- llm
- boundaryml
- guardrails
- structured-data
- programming-language
- 150xPlaygrounds/rig★ 9,064 · ⑂ 1,010
⚙️🦀 Build modular and scalable LLM Applications in Rust
- ai
- llm
- agent
- artificial-intelligence
- automation
- large-language-model
- 16deeplethe/utopia★ 8,673 · ⑂ 1,185
World's first open-source enterprise world model.
- agent-memory
- knowledge-base
- knowledge-graph
- llm
- pgvector
- postgresql
- Live search
Turn any brief into a list like this
I run natural-language searches across GitHub, LinkedIn, and the open web. Describe who you want and I'll build the shortlist.
500 free credits on sign-up, no card needed.
- 17
- 18mufeedvh/code2prompt★ 7,748 · ⑂ 458
A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.
- ai
- chatgpt
- claude
- cli
- command-line
- command-line-tool
- 19tailcallhq/forgecode★ 7,631 · ⑂ 1,455
AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models
- ai-workflows
- artifical-intelligense
- claude-3-7-sonnet
- command-line
- multi-agent-reinforcement-learning
- shell
Find Rust engineers shipping LLM
The list above ranks the most-starred public Rust repositories tagged with the LLM topic, drawn from the public GitHub graph. Across 589 matching repositories, the contributors are a tight cluster of engineers with both Rust chops and real LLM experience.
That overlap is rare. Most Rust engineers haven’t shipped LLM, and most LLM maintainers don’t write Rust. The people on this list’s contributor graph are the ones who do both.
Refolk turns this list into a search. Ask for “Rust LLM maintainers hiring” or “Rust engineers shipping LLM in 2025” and Refolk returns a ranked shortlist with the commits, profiles, and projects behind each name.
How this list is built
Last refreshed: Wed, 04 Nov 2026 22:16:15 GMT
Need a more specific search?
Refolk runs natural-language searches across GitHub, LinkedIn, and the open web. Try one of these:
500 free credits on sign-up, no card needed.
Related lists
- Rust · CLI
- Rust · Terminal UI
- Rust · Blockchain
- Rust · Compilers
- Rust · Operating systems
- Rust · Web frameworks
- Rust · Embeddings
- Rust · Vector databases
See all repository lists.
Or zoom out
Common questions
How are these repositories ranked?
By stars, with forks and recent activity as tiebreakers, read from the public GitHub API. The methodology section above has the details.
How fresh is the data?
The ranking re-renders at least daily. Last refreshed: Wed, 04 Nov 2026 22:16:15 GMT.
Can I find the maintainers and contributors behind these repos?
Yes. Stars rank the projects; I can rank the engineers - maintainers, top contributors, and the people they work with. You start with 500 free credits, no card required.
Can I use this list for hiring?
That's the point. I read hiring signals across GitHub, LinkedIn, and the open web, so a repo list turns into a shortlist of engineers worth talking to.
Try it on the search you came here for
Stop building boolean strings. Just describe the person.
Type one sentence. I plan the search, read GitHub, public LinkedIn and Crunchbase records, and the open web as it is right now, and hand back a ranked list with the reason next to every name.
01Describe them
One plain sentence. Role, city, stack, stage, whatever matters to you.
02I read the web live
GitHub, public LinkedIn and Crunchbase records, the open web. Not a database that went stale last quarter.
03You read the shortlist
Ranked, with the reasoning under every name. Open a profile, ask a follow-up, narrow it down.
- Staff backend engineers in NYC who shipped Rust in production
- Series A fintechs in SF under 50 people, growing headcount this year
- Maintainers of fast-growing Rust web frameworks on GitHub
- No boolean, no filters, no seat to buy. One box.
- Read at search time, so a profile updated yesterday counts today.
- Every step visible as it runs, every name with its reason.
500 free credits on sign-up. No card, no demo call. See real searches.