Engineer, Supercomputing & Distributed Systems
krea.ai · San Francisco, California
- Location
- San Francisco, California, United States
- Workplace
- Remote
- Employment
- Full time
- Level
- Mid level
- Posted
- 3 April
About this role
About Krea
At Krea, we are building next-generation AI creative tools.
We are dedicated to making AI intuitive and controllable for creatives. Our mission is to build tools that empower human creativity, not replace it.
We believe AI is a new medium that allows us to express ourselves through various formats - text, images, video, sound, and even 3D. We're building better, smarter, and more controllable tools to harness this medium.
Supercomputing / AI Infra at Krea
We build and operate the infrastructure for Krea's research and inference. Distributed training, 1000+ K8s GPU clusters, petabyte scale data pipelines, etc. We build a lot of this from scratch - custom distributed datastores, job orchestration systems, and streaming pipelines that replace tools like Kafka and Ray for modern AI workloads at scale.
Example projects:
Distributed data systems
Design multi-stage pipelines that turn petabytes of raw data into clean, annotated datasets
Run classification models on billions of images
Deploy and combine LLMs to caption massive multimedia data
GPU infrastructure
Manage distributed training and inference on 1000+ GPU Kubernetes clusters
Solve orchestration and scaling for large-scale GPU job processing
Scale workloads and research between clusters in multiple datacenters
Distributed training
Profile and optimize dataloaders streaming thousands of images per second
Profile and debug InfiniBand networking on huge training runs
Build fault tolerance systems for large-scale pretraining
Collaborate with researchers on evolving RL infrastructure
Applied ML pipelines
Find clean scenes in millions of videos using distributed shot-boundary detection
Customize and train models to filter billions of images for questions like "is this a screenshot?"
Build the systems that bridge raw cluster capacity and research output
Who we're looking for:
Systems people. If you've read a blog post about InfiniBand debugging or building a custom distributed database and thought "I want to do that" - this is that team.
You'll spend your time working heavily with Python, Kubernetes, Torch, and data tools like DuckDB, Arrow, etc. It's OK if you don't have K8s or ML experience - the main thing we hire for is an intuition for distributed systems, and a great mental model of how systems interact and function under different conditions.
Strong candidates may have experience with…
Python, PyArrow, DuckDB, SQL, massive relational databases, PyTorch, Pandas, NumPy…
Kubernetes
Designing and implementing large-scale ETL systems
Fundamental knowledge of containerization, operating systems, file-systems, and networking
Distributed systems design
Distributed training systems (NCCL, InfiniBand, RDMA)
Streaming and event processing systems (Kafka, Pulsar, or similar)
PyTorch internals, custom dataloaders, and training infrastructure
As published by krea.ai. Applications are handled on their site.
Skills this posting mentions
About krea.ai
a real-time ai image generator and editor built for designers to create, remix, and iterate visually
All 13 openings at krea.aiOne click, then it is written
Apply to krea.ai with a resume written for this role.
Queue Engineer, Supercomputing & Distributed Systems and I read the posting, rewrite your resume against it, draft the cover letter, and score the fit. Then you press send, or press one button and I fill in krea.ai’s form for you.
01Drop your resume
A PDF or a LinkedIn URL. About a minute, once.
02I rank the openings
Every weekday morning, the live catalog scored against your history. Up to 20 worth your time, not two hundred links.
03Each one is written up
Resume rewritten for the posting, a cover letter, a fit score. Press send, or let me fill in the form.
- 25 sent a week, free
- No card
- Nothing sent until you say so
More roles at krea.ai
See all- 30 October
- 29 September
Creative
San Francisco, CaliforniaRemote
- 29 September
- 1 September
ML Researcher - Image / Video Diffusion
San Francisco, California
$140k - $200k/yrMid levelScience and research - 1 September
- 31 August
Similar roles elsewhere
See more- 31 October
Software Engineer, ML Infrastructure (MDX)
DoorDashSan Francisco, CA +2
CA$120k - CA$150k/yrEngineering - 31 October
- 31 October
- 31 October
Put this to work
Paste your career in once. Every application after that is written for you.
Drop a resume or a LinkedIn URL. I rank the live openings against it, rewrite the resume and write a cover letter for the best of them, and fill in the employer's form when you press the button. You read, you decide what goes out.
01Drop your resume
A PDF or a LinkedIn URL. About a minute, once.
02I rank the openings
Every weekday morning, the live catalog scored against your history. Up to 20 worth your time, not two hundred links.
03Each one is written up
Resume rewritten for the posting, a cover letter, a fit score. Press send, or let me fill in the form.
- New matches ranked and written before you are up.
- Every bullet stays inside what your history supports. Nothing invented.
- Queued, submitted, interviewing, offer: one screen, not a spreadsheet.
Free, no card. Up to 25 applications sent a week, and nothing is sent until you say so.
Listed from the job board krea.ai publishes. Refolk is not the employer and does not handle their hiring. Applications go to krea.ai directly.
Hiring at krea.ai? Post this role to the Refolk talent pool for $299, once. No commission, refunded if I find nobody. Post a role for $299