- Location
- San Francisco
- Level
- Director
- Posted
- 6 days ago
About this role
About the Role
Together AI is scaling its physical AI infrastructure rapidly - and we're looking for a Director of Data Center Operations to help us build it right. This is a ground-floor opportunity to own the operational foundation of Together's growing data center portfolio across the US and Asia.
You'll be responsible for designing and commissioning white space deployments - taking pre-built environments and fitting them out with the power distribution, cooling distribution, and systems infrastructure needed to run high-density GPU workloads at scale. At the same time, you'll be building the break-fix and smart hands team from scratch: hiring, defining the playbook, and standing up the function that keeps our sites running around the clock.
This is not a steady-state operations role. It's a builder role. You'll be joining a small but fast-moving team, with real ownership over outcomes and the autonomy to shape how Together AI operates its physical infrastructure for years to come. If you've scaled data center infrastructure through hypergrowth before and want to do it again with more ownership - this is that opportunity.
Responsibilities
- Own the design, fit-out, and commissioning of white space sites across the US and Asia, with a focus on power distribution (PDUs), cooling distribution (CDUs), and IT-adjacent infrastructure
- Build and lead a ~20-person break-fix and smart hands team from scratch - define the operating model, hire the initial team, and establish the processes and playbooks that keep sites running
- Manage a portfolio of 5+ sites across two regions in various stages of deployment and live operation
- Partner with vendors, contractors, and equipment suppliers to drive site deployments to schedule and quality
- Establish operational standards, runbooks, and escalation processes for a nascent but rapidly growing infrastructure function
- Serve as the technical authority on data center infrastructure decisions - from white space evaluation through to live production operation
- Travel to Asia periodically to oversee regional site deployments and support the local team
Requirements
- Deep, hands-on technical knowledge of data center power and cooling systems at the IT-adjacent layer - PDUs, CDUs, power distribution, and white space fit-out
- Proven experience designing and commissioning data center infrastructure, from evaluation through to live operation
- Experience operating data center infrastructure at meaningful scale, supporting large production workloads
- People leadership experience - you've hired, developed, and led technical operations teams
- A builder's instinct - you're comfortable standing up teams and functions from scratch, writing the playbook where none exists, and operating with ambiguity
- Strong vendor and contractor management skills - you know how to hold external partners accountable to timeline and quality
- Nice to have: experience with GPU or AI infrastructure deployments, multi-site or multi-region portfolio management, or familiarity with Asian markets
About Together AI
Together AI is a research-driven AI infrastructure company on a mission to dramatically lower the cost of modern AI by co-designing software, hardware, algorithms, and models. We believe open and transparent AI systems create the best outcomes for society - and we're building the physical and computational foundation to make that real. Our team has been behind landmark advances including FlashAttention, Hyena, FlexGen, and RedPajama.
Compensation
We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $250,000 - $300,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Please see our privacy policy at https://www.together.ai/privacy
As published by Together AI. Applications are handled on their site.
Skills this posting mentions
About Together AI
Together AI is the AI Native Cloud, purpose-built for AI engineers and researchers with a full suite of tooling across inference, model shaping, and pre-training. AI natives can use Together AI as a full-stack AI platform - from a high- performance inference engine built for reliable and fast scaling to on-demand GPU clusters and massive-scale AI factories. Together AI continuously pushes the frontier forward by productizing cutting-edge research from our world-leading AI systems research team. By combining research velocity with production-grade infrastructure, we enable companies to reliably scale AI-native applications as fast as the field evolves. Trusted by leading AI natives like Cursor, Decagon, Eleven Labs, AI21, Hedra, and Cartesia, as well as SaaS innovators such as Salesforce, Zoom, and Zomato, Together AI powers the next generation of AI-native applications.
All 65 openings at Together AIOne click, then it is written
Apply to Together AI with a resume written for this role.
Queue Director, Data Center Operations and I read the posting, rewrite your resume against it, draft the cover letter, and score the fit. Then you press send, or press one button and I fill in Together AI’s form for you.
01Drop your resume
A PDF or a LinkedIn URL. About a minute, once.
02I rank the openings
Every weekday morning, the live catalog scored against your history. Up to 20 worth your time, not two hundred links.
03Each one is written up
Resume rewritten for the posting, a cover letter, a fit score. Press send, or let me fill in the form.
- 25 sent a week, free
- No card
- Nothing sent until you say so
More roles at Together AI
See all- Yesterday
- Yesterday
- 4 days ago
- 4 days ago
Staff Engineer, Distributed Storage and HPC & AI Infrastructure
Bangalore IndiaRemote
2 locationsStaffEngineering - 4 days ago
- 4 days ago
Similar roles elsewhere
See more- Yesterday
Associate, Dasher Tasks, Strategy & Operations
DoorDashSan Francisco, CA +5
$75k - $110k/yrEntry levelOperations - Yesterday
Senior Associate, New Verticals - Fulfilment Strategy & Operations
DoorDashSan Francisco, CA +10
$87k - $128k/yrSeniorOperations
Put this to work
Paste your career in once. Every application after that is written for you.
Drop a resume or a LinkedIn URL. I rank the live openings against it, rewrite the resume and write a cover letter for the best of them, and fill in the employer's form when you press the button. You read, you decide what goes out.
01Drop your resume
A PDF or a LinkedIn URL. About a minute, once.
02I rank the openings
Every weekday morning, the live catalog scored against your history. Up to 20 worth your time, not two hundred links.
03Each one is written up
Resume rewritten for the posting, a cover letter, a fit score. Press send, or let me fill in the form.
- New matches ranked and written before you are up.
- Every bullet stays inside what your history supports. Nothing invented.
- Queued, submitted, interviewing, offer: one screen, not a spreadsheet.
500 free credits on sign-up. No card. Nothing is sent until you say so.
Listed from the job board Together AI publishes. Refolk is not the employer and does not handle their hiring. Applications go to Together AI directly.