Top Rust LLM repositories on GitHub
Large language model frameworks, agents, runtimes, and inference servers. Filtered to projects whose primary language is Rust.
Ranked by stars across 521 Rust repositories tagged llm. Refreshed daily.
- 1rtk-ai/rtk★ 82,665 · ⑂ 5,252
CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
- agentic-coding
- ai-coding
- anthropic
- claude-code
- cli
- command-line-tool
- 2janhq/jan★ 44,851 · ⑂ 3,073
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
- llamacpp
- localai
- self-hosted
- gpt
- tauri
- chatgpt
- 3tinyhumansai/openhuman★ 41,637 · ⑂ 4,098
OpenHuman is the fastest, cheapest, most efficient open-source agent harness. Written in Rust
- ai-agents
- llm
- local-first
- rust
- agent-orchestration
- ai-assistant
- 4AlexsJones/llmfit★ 37,703 · ⑂ 2,419
Hundreds of models & providers. One command to find what runs on your hardware.
- llm
- skill
- localai
- gguf
- mlx
- unsloth
- Live search
Find the people behind these repos
Stars rank the projects. I can rank the engineers - maintainers, top contributors, and the people they work with. Fire one of these to see how it works.
500 free credits on sign-up, no card needed.
- 5Zackriya-Solutions/meetily★ 31,528 · ⑂ 3,442
Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows. Understand How to write meeting minutes
- meeting-minutes
- meeting-notes
- llm
- mac
- windows
- rust
- 6screenpipe/screenpipe★ 21,862 · ⑂ 2,237
YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context
- ai
- computer-vision
- llm
- machine-learning
- multimodal
- agents
- 71jehuang/jcode★ 20,346 · ⑂ 2,364
High performance coding agent harness written in rust
- ai
- claude
- cli
- coding-agent
- llm
- mcp
- 8RightNow-AI/openfang★ 18,213 · ⑂ 2,291
Open-source Agent Operating System
- agent-framework
- ai-agents
- llm
- mcp
- open-source
- openclaw
- 9memvid/memvid★ 16,583 · ⑂ 1,421
Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.
- ai
- context
- embedded
- faiss
- knowledge-base
- knowledge-graph
- 10tensorzero/tensorzero★ 11,710 · ⑂ 974
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
- ai
- artificial-intelligence
- deep-learning
- gpt
- llm
- llmops
- Live search
Who is hiring in this space?
I read hiring signals across LinkedIn, GitHub, and the open web - so a topic list becomes a warm outreach list. Try one live.
500 free credits on sign-up, no card needed.
- 11cocoindex-io/cocoindex★ 11,649 · ⑂ 911
Incremental engine for long horizon agents 🌟 Star if you like it!
- ai
- change-data-capture
- data-indexing
- etl
- indexing
- python
- 12sigoden/aichat★ 10,491 · ⑂ 748
All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.
- claude
- gemini
- ollama
- openai
- function-calling
- cli
- 13astrid-runtime/astrid★ 10,278 · ⑂ 141
Astrid is a portable, capability-secure operating system for composable software.
- agent-runtime
- ai-agents
- capability-security
- llm
- mcp
- microkernel
- 14BoundaryML/baml★ 9,385 · ⑂ 494
The programming language for agents
- llm
- boundaryml
- guardrails
- structured-data
- programming-language
- 150xPlaygrounds/rig★ 8,830 · ⑂ 987
⚙️🦀 Build modular and scalable LLM Applications in Rust
- ai
- llm
- agent
- artificial-intelligence
- automation
- large-language-model
- 16qualcomm/GenieX★ 8,419 · ⑂ 1,068
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
- llm
- on-device-ai
- sdk
- vlm
- go
- gpt-oss
- Live search
Turn any brief into a list like this
I run natural-language searches across GitHub, LinkedIn, and the open web. Describe who you want and I'll build the shortlist.
500 free credits on sign-up, no card needed.
- 17deeplethe/utopia★ 8,154 · ⑂ 1,130
World's first open-source enterprise world model.
- agent-memory
- knowledge-base
- knowledge-graph
- llm
- pgvector
- postgresql
- 18
- 19mufeedvh/code2prompt★ 7,721 · ⑂ 457
A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.
- ai
- chatgpt
- claude
- cli
- command-line
- command-line-tool
Find Rust engineers shipping LLM
The list above ranks the most-starred public Rust repositories tagged with the LLM topic, drawn from the public GitHub graph. Across 521 matching repositories, the contributors are a tight cluster of engineers with both Rust chops and real LLM experience.
That overlap is rare. Most Rust engineers haven’t shipped LLM, and most LLM maintainers don’t write Rust. The people on this list’s contributor graph are the ones who do both.
Refolk turns this list into a search. Ask for “Rust LLM maintainers hiring” or “Rust engineers shipping LLM in 2025” and Refolk returns a ranked shortlist with the commits, profiles, and projects behind each name.
How this list is built
Last refreshed: Thu, 08 Oct 2026 08:12:26 GMT
Need a more specific search?
Refolk runs natural-language searches across GitHub, LinkedIn, and the open web. Try one of these:
500 free credits on sign-up, no card needed.
Related lists
- Rust · CLI
- Rust · Terminal UI
- Rust · Blockchain
- Rust · Compilers
- Rust · Operating systems
- Rust · Web frameworks
- Rust · Embeddings
- Rust · Vector databases
See all repository lists.
Or zoom out
Common questions
How are these repositories ranked?
By stars, with forks and recent activity as tiebreakers, read from the public GitHub API. The methodology section above has the details.
How fresh is the data?
The ranking re-renders at least daily. Last refreshed: Thu, 08 Oct 2026 08:12:26 GMT.
Can I find the maintainers and contributors behind these repos?
Yes. Stars rank the projects; I can rank the engineers - maintainers, top contributors, and the people they work with. You start with 500 free credits, no card required.
Can I use this list for hiring?
That's the point. I read hiring signals across GitHub, LinkedIn, and the open web, so a repo list turns into a shortlist of engineers worth talking to.
Try it on the search you came here for
Stop building boolean strings. Just describe the person.
Type one sentence. I plan the search, read GitHub, public LinkedIn and Crunchbase records, and the open web as it is right now, and hand back a ranked list with the reason next to every name.
01Describe them
One plain sentence. Role, city, stack, stage, whatever matters to you.
02I read the web live
GitHub, public LinkedIn and Crunchbase records, the open web. Not a database that went stale last quarter.
03You read the shortlist
Ranked, with the reasoning under every name. Open a profile, ask a follow-up, narrow it down.
- Staff backend engineers in NYC who shipped Rust in production
- Series A fintechs in SF under 50 people, growing headcount this year
- Maintainers of fast-growing Rust web frameworks on GitHub
- No boolean, no filters, no seat to buy. One box.
- Read at search time, so a profile updated yesterday counts today.
- Every step visible as it runs, every name with its reason.
500 free credits on sign-up. No card, no demo call. See real searches.