Refolk
Open nowEngineering

Member of Technical Staff, Research Engineer, Infrastructure

Fleet AI · San Francisco Bay Area

Location
San Francisco Bay Area
Employment
Full time
Level
Staff
Posted
28 October

About this role

About Fleet

Fleet studies how environments produce intelligence. We believe intelligence is an emergent property of environmental pressures: the environment determines what capabilities develop, what behaviors survive, and what "good" looks like. We work with frontier labs on post-training across modalities, building benchmarks that expose where frontier models break, training recipes that close those gaps, and scalable oversight for long-horizon agents. Backed by Sequoia Capital, Menlo Ventures, BCV, and SV Angel.

About the Role

Fleet runs a large GPU cluster. As a Research Engineer, you own the infrastructure our research runs on: the training stack, the inference stack, the research codebase that ties them together, the cluster itself, and the kernels at the bottom. Your job is to keep all of it fast and reliable as the research moves.

You work close to the researchers and fix what is actually slow, where the fix belongs. Sometimes that is a Triton kernel. Sometimes it is a parallelism config change. Sometimes it is deleting a library nobody is using anymore.

The research codebase is under active development and most of the bottlenecks are not obvious from outside it. We want someone who can profile a stalled collective, write a fused kernel, and refactor research code without breaking the science. This is hire #1 for the role.

What You'll Do

  • Own the cluster. Capacity, failover, fault tolerance, and on-call when training stalls.
  • Drive utilization. Profile training runs, find the bottleneck (NCCL, KV cache, dataloader, allgather), and fix it. Write kernels when the profiler points there.
  • Maintain training and inference. Distributed training (FSDP, TP, PP), rollout generation, async training, and the inference stack the training loop depends on.
  • Maintain the research codebase. Keep it fast and reliable as researchers extend it. Refactor without breaking the science.

How We Work

  • Small, technical team.
  • Speed with rigor.
  • Truth over comfort.
  • On-site in SF.

What We're Looking For

  • Distributed training depth. Hands-on experience with multi-node training (tens of GPUs at minimum, ideally hundreds) and the major parallelism strategies (DP, TP, PP, FSDP).
  • Performance and kernels. You can profile a slow training run and land the fix. You write CUDA and Triton, and have shipped a fused op or attention variant in a real training run.
  • Inference systems. You have built or maintained a high-throughput inference stack (vLLM, SGLang). KV cache, continuous batching, speculative decoding, and quantization are tools you have used in production.
  • Research-codebase taste. You have walked into a sprawling, half-documented research repo and made it measurably faster or more reliable without breaking the science. RL post-training methods (PPO, GRPO, RLHF) and their failure modes are familiar enough that you can triage a training failure from a log line.

Especially Exciting

  • Contributions to PyTorch, vLLM, SGLang, Megatron, DeepSpeed, FSDP, NCCL, flash-attention, or other open-source ML systems.
  • Experience operating GPU fleets at scale.
  • Experience with RoCE / InfiniBand, GPUDirect, or similar high-performance networking.
  • Prior work on RL rollout systems, async training, or off-policy training infra.

Compensation

On-site in San Francisco.

Salary range: $200,000 - $600,000 USD annually, plus meaningful equity.

As published by Fleet AI. Applications are handled on their site.

Skills this posting mentions

Networking TechnologiesOpen Source SoftwarePyTorch

About Fleet AI

Gym Environments for Frontier Agents

All 12 openings at Fleet AI

One click, then it is written

Apply to Fleet AI with a resume written for this role.

Queue Member of Technical Staff, Research Engineer, Infrastructure and I read the posting, rewrite your resume against it, draft the cover letter, and score the fit. Then you press send, or press one button and I fill in Fleet AI’s form for you.

  1. 01Drop your resume

    A PDF or a LinkedIn URL. About a minute, once.

  2. 02I rank the openings

    Every weekday morning, the live catalog scored against your history. Up to 20 worth your time, not two hundred links.

  3. 03Each one is written up

    Resume rewritten for the posting, a cover letter, a fit score. Press send, or let me fill in the form.

  • 25 sent a week, free
  • No card
  • Nothing sent until you say so

More roles at Fleet AI

See all

Similar roles elsewhere

See more

Put this to work

Paste your career in once. Every application after that is written for you.

Drop a resume or a LinkedIn URL. I rank the live openings against it, rewrite the resume and write a cover letter for the best of them, and fill in the employer's form when you press the button. You read, you decide what goes out.

  1. 01Drop your resume

    A PDF or a LinkedIn URL. About a minute, once.

  2. 02I rank the openings

    Every weekday morning, the live catalog scored against your history. Up to 20 worth your time, not two hundred links.

  3. 03Each one is written up

    Resume rewritten for the posting, a cover letter, a fit score. Press send, or let me fill in the form.

  • New matches ranked and written before you are up.
  • Every bullet stays inside what your history supports. Nothing invented.
  • Queued, submitted, interviewing, offer: one screen, not a spreadsheet.

Free, no card. Up to 25 applications sent a week, and nothing is sent until you say so.

Listed from the job board Fleet AI publishes. Refolk is not the employer and does not handle their hiring. Applications go to Fleet AI directly.

Hiring at Fleet AI? Post this role to the Refolk talent pool for $299, once. No commission, refunded if I find nobody. Post a role for $299