Senior/Staff AI Infrastructure Engineer
Echelon · San Francisco, California
- Location
- San Francisco, California, United States
- Employment
- Full time
- Level
- Staff
- Posted
- 30 September
About this role
About Echelon
Echelon is building the AI platform for Business Operations. Our goal is to automate the knowledge work of BizOps so one exceptional operator can deliver the leverage of an entire team, as Ramp and Rippling have done for Finance and HR.
Our platform combines passive process mining with a living ontology that maps how work happens across people, systems, documents, decisions, and outcomes. It connects structured and unstructured data trapped in fragmented, duplicative, and legacy enterprise systems, then turns that context into automated workflows and AI agents.
We are an early-stage company tackling a difficult technical problem at high speed. Engineers work directly with founders and customers, make decisions with incomplete information, ship production systems, and own the results. The pace, rate of change, and standards are high.
The mandate
Build the secure execution substrate for Echelon's agents. You will scale ephemeral sandboxes, optimize filesystem and startup performance, and make long-running agent work durable under load without weakening tenant isolation or operational control.
What you'll own
Design and operate sandbox lifecycle systems for agent code execution, browser work, document processing, and tool use.
Improve sandbox startup time, density, scheduling, warm pools, caching, and resource utilization.
Build fast, reliable filesystem primitives for ephemeral and persistent agent state, large artifacts, and concurrent workloads.
Enforce tenant isolation, network policy, secrets boundaries, quotas, and least-privilege access.
Make long-running agent jobs durable through checkpointing, retries, idempotency, cancellation, and recovery.
Scale orchestration and control-plane services through rapid workload growth and unpredictable bursts.
Build observability for resource pressure, execution failures, queue health, noisy neighbors, cost, and end-to-end latency.
Run load tests, capacity plans, failure drills, and incident reviews; fix root causes rather than adding fragile workarounds.
What you bring
5+ years building production infrastructure, distributed systems, developer platforms, or execution runtimes.
Hands-on ownership of containerized or virtualized workloads in a multi-tenant production environment.
Strong Linux systems knowledge across processes, filesystems, networking, resource isolation, and performance debugging.
Experience with Kubernetes or a comparable scheduler, infrastructure as code, and cloud primitives on AWS or Azure.
Strong programming ability in Go, Rust, TypeScript, Python, or another systems-oriented language.
Experience designing for retries, idempotency, backpressure, load shedding, observability, and safe rollouts.
Security instincts appropriate for executing untrusted or model-generated work.
Useful experience
Firecracker, gVisor, Kata Containers, namespaces/cgroups, seccomp, or eBPF.
Sandbox products such as E2B, Modal, Fly Machines, or custom ephemeral compute platforms.
FUSE, overlay filesystems, content-addressed storage, snapshotting, distributed caches, or object storage.
Agent runtimes, code interpreters, browser automation, remote development environments, or CI execution systems.
BYOC, private networking, customer-managed deployments, or enterprise security reviews.
Inngest, Temporal, Kafka, NATS, or other durable workflow and event systems.
Benefits
Team lunches and dinners in the office.
On-site Gym access for all employees.
Fully covered health, dental, and vision insurance.
401(k) plan.
Access to AI Tooling of your choice.
Unlimited PTO.
As published by Echelon. Applications are handled on their site.
Skills this posting mentions
About Echelon
The AI Platform for Business Operations
All 4 openings at EchelonOne click, then it is written
Apply to Echelon with a resume written for this role.
Queue Senior/Staff AI Infrastructure Engineer and I read the posting, rewrite your resume against it, draft the cover letter, and score the fit. Then you press send, or press one button and I fill in Echelon’s form for you.
01Drop your resume
A PDF or a LinkedIn URL. About a minute, once.
02I rank the openings
Every weekday morning, the live catalog scored against your history. Up to 20 worth your time, not two hundred links.
03Each one is written up
Resume rewritten for the posting, a cover letter, a fit score. Press send, or let me fill in the form.
- 25 sent a week, free
- No card
- Nothing sent until you say so
More roles at Echelon
See all- 29 October
- 30 September
- 30 September
Similar roles elsewhere
See more- 29 October
- 29 October
- 29 October
Staff Software Engineer, Service Configuration Deployments
PinterestSan Francisco, CA +1Remote
StaffEngineering - 29 October
Sr. Software Engineer, AI Platform & Infrastructure
OktaSan Francisco, California
$165k - $227k/yrSeniorEngineering
Put this to work
Paste your career in once. Every application after that is written for you.
Drop a resume or a LinkedIn URL. I rank the live openings against it, rewrite the resume and write a cover letter for the best of them, and fill in the employer's form when you press the button. You read, you decide what goes out.
01Drop your resume
A PDF or a LinkedIn URL. About a minute, once.
02I rank the openings
Every weekday morning, the live catalog scored against your history. Up to 20 worth your time, not two hundred links.
03Each one is written up
Resume rewritten for the posting, a cover letter, a fit score. Press send, or let me fill in the form.
- New matches ranked and written before you are up.
- Every bullet stays inside what your history supports. Nothing invented.
- Queued, submitted, interviewing, offer: one screen, not a spreadsheet.
Free, no card. Up to 25 applications sent a week, and nothing is sent until you say so.
Listed from the job board Echelon publishes. Refolk is not the employer and does not handle their hiring. Applications go to Echelon directly.
Hiring at Echelon? Post this role to the Refolk talent pool for $299, once. No commission, refunded if I find nobody. Post a role for $299