Top Data engineering repositories on GitHub
Pipelines, orchestrators, and ELT/ETL tooling.
Ranked by stars across 384 repositories tagged data-engineering. Refreshed daily.
- 1apache/superset★ 74,848 · ⑂ 18,354
Apache Superset is a Data Visualization and Data Exploration Platform
- superset
- apache
- apache-superset
- data-visualization
- data-viz
- analytics
- 2GokuMohandas/Made-With-ML★ 49,547 · ⑂ 7,778
Learn how to develop, deploy and iterate on production-grade ML applications.
- machine-learning
- deep-learning
- pytorch
- natural-language-processing
- data-science
- python
- 3apache/airflow★ 46,913 · ⑂ 17,873
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
- airflow
- apache
- apache-airflow
- python
- scheduler
- workflow
- 4DataTalksClub/data-engineering-zoomcamp★ 45,659 · ⑂ 8,892
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼
- data-engineering
- kafka
- spark
- dbt
- docker
- kestra
- Live search
Find the people behind these repos
Stars rank the projects. I can rank the engineers - maintainers, top contributors, and the people they work with. Fire one of these to see how it works.
500 free credits on sign-up, no card needed.
- 5eugeneyan/applied-ml★ 30,355 · ⑂ 3,996
📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.
- applied-machine-learning
- production
- applied-data-science
- machine-learning
- data-science
- reinforcement-learning
- 6kestra-io/kestra★ 28,181 · ⑂ 3,005
Event Driven Orchestration & Scheduling Platform for Mission Critical Applications
- orchestration
- data-orchestration
- high-availability
- infrastructure-as-code
- automation
- devops
- 7PrefectHQ/prefect★ 23,882 · ⑂ 2,528
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
- python
- workflow
- data-engineering
- data-science
- workflow-engine
- prefect
- 8airbytehq/airbyte★ 22,093 · ⑂ 5,353
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
- data
- pipeline
- data-analysis
- data-engineering
- java
- python
- 9Avaiga/taipy★ 19,436 · ⑂ 1,993
Turns Data and AI algorithms into production-ready web applications in no time.
- automation
- data-engineering
- data-ops
- data-visualization
- datascience
- developer-tools
- 10argoproj/argo-workflows★ 16,993 · ⑂ 3,661
Workflow Engine for Kubernetes
- workflow
- kubernetes
- argo
- dag
- knative
- airflow
- Live search
Who is hiring in this space?
I read hiring signals across LinkedIn, GitHub, and the open web - so a topic list becomes a warm outreach list. Try one live.
500 free credits on sign-up, no card needed.
- 11dagster-io/dagster★ 16,183 · ⑂ 2,296
An orchestration platform for the development, production, and observation of data assets.
- data-pipelines
- dagster
- workflow
- data-science
- workflow-automation
- python
- 12andkret/Cookbook★ 15,427 · ⑂ 2,757
The Data Engineering Cookbook
- data-engineer
- data-engineering
- big-data
- best-practices
- cookbook
- 13semantica-agi/semantica★ 13,283 · ⑂ 1,491
Graph-Native Infrastructure for Context and Accountable AI Systems
- ai
- ai-governance
- artificial-intelligence
- context-engineering
- context-graphs
- decision-intelligence
- 14datastacktv/data-engineer-roadmap★ 12,755 · ⑂ 1,337
Roadmap to becoming a data engineer in 2021
- data-engineer-roadmap
- data-engineering
- cloud
- roadmap
- 15fivetran/great_expectations★ 11,816 · ⑂ 1,850
Always know what to expect from your data.
- pipeline-tests
- dataquality
- datacleaning
- datacleaner
- data-science
- data-profiling
- 16cocoindex-io/cocoindex★ 11,577 · ⑂ 901
Incremental engine for long horizon agents 🌟 Star if you like it!
- ai
- change-data-capture
- data-indexing
- etl
- indexing
- python
- Live search
Turn any brief into a list like this
I run natural-language searches across GitHub, LinkedIn, and the open web. Describe who you want and I'll build the shortlist.
500 free credits on sign-up, no card needed.
- 17xonsh/xonsh★ 9,644 · ⑂ 741
🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.
- xonsh
- devops
- iterm2
- data-engineering
- security-automation
- raspberry-pi
- 18risingwavelabs/risingwave★ 9,334 · ⑂ 840
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
- database
- stream-processing
- rust
- postgresql
- kafka
- materialized-view
- 19mage-ai/mage-ai★ 8,825 · ⑂ 990
🧙 Build, run, and manage data pipelines for integrating and transforming data.
- machine-learning
- artificial-intelligence
- data
- data-engineering
- data-science
- python
Find engineers shipping Data engineering
The list above ranks the most-starred public repositories tagged with the Data engineering topic, drawn from the public GitHub graph. Across 384 repositories tagged this way, the maintainers and top contributors are a tight cluster of the people actually building Data engineering.
Looking for engineers who’ve worked on Data engineering for real, not just listed it on LinkedIn? The fastest path is the contributor list of these repos. Their commits, issues, and READMEs are public proof of depth.
Refolk turns this list into a search. Ask for “maintainers of top Data engineering repos who are hiring”, “Data engineering engineers in San Francisco”, or “founders shipping Data engineering” and Refolk returns a ranked shortlist with sources.
How this list is built
Last refreshed: Sun, 20 Sep 2026 05:51:12 GMT
Need a list like this for any search?
Refolk runs natural-language searches across GitHub, LinkedIn, and the open web. Try one of these:
- Data engineering maintainers hiringRun
- Data engineering engineers in San FranciscoRun
- Companies shipping Data engineeringRun
500 free credits on sign-up, no card needed.
Browse other topics
- Top Cryptography repos
- Top RAG repos
- Top Deep learning repos
- Top Text-to-speech repos
- Top Fine-tuning repos
- Top Computer vision repos
- Top Observability repos
- Top DevOps repos
See all repository lists.
Data engineering by language
Common questions
How are these repositories ranked?
By stars, with forks and recent activity as tiebreakers, read from the public GitHub API. The methodology section above has the details.
How fresh is the data?
The ranking re-renders at least daily. Last refreshed: Sun, 20 Sep 2026 05:51:12 GMT.
Can I find the maintainers and contributors behind these repos?
Yes. Stars rank the projects; I can rank the engineers - maintainers, top contributors, and the people they work with. You start with 500 free credits, no card required.
Can I use this list for hiring?
That's the point. I read hiring signals across GitHub, LinkedIn, and the open web, so a repo list turns into a shortlist of engineers worth talking to.
Try it on the search you came here for
Stop building boolean strings. Just describe the person.
Type one sentence. I plan the search, read GitHub, public LinkedIn and Crunchbase records, and the open web as it is right now, and hand back a ranked list with the reason next to every name.
01Describe them
One plain sentence. Role, city, stack, stage, whatever matters to you.
02I read the web live
GitHub, public LinkedIn and Crunchbase records, the open web. Not a database that went stale last quarter.
03You read the shortlist
Ranked, with the reasoning under every name. Open a profile, ask a follow-up, narrow it down.
- Staff backend engineers in NYC who shipped Rust in production
- Series A fintechs in SF under 50 people, growing headcount this year
- Maintainers of fast-growing Rust web frameworks on GitHub
- No boolean, no filters, no seat to buy. One box.
- Read at search time, so a profile updated yesterday counts today.
- Every step visible as it runs, every name with its reason.
500 free credits on sign-up. No card, no demo call. See real searches.