RefolkCandidates
JobsBuild my resume

Member of Technical Staff (AI Infrastructure Engineer)

Perplexity · London

$65k - $170k/yrRemoteStaffEngineeringAI Research & SystemsAI Research & SystemsPosted 3 months ago
Apply with a tailored resumeView the original posting

About this role

We are looking for an AI Infra engineer to join our growing team. We work with Kubernetes, Slurm, Python, C++, PyTorch, and primarily on AWS. As an AI Infrastructure Engineer, you will be partnering closely with our Inference and Research teams to build, deploy, and optimize our large-scale AI training and inference clusters. RESPONSIBILITIES - Design, deploy, and maintain scalable Kubernetes clusters for AI model inference and training workloads - Manage and optimize Slurm-based HPC environments for distributed training of large language models - Develop robust APIs and orchestration systems for both training pipelines and inference services - Implement resource scheduling and job management systems across heterogeneous compute environments - Benchmark system performance, diagnose bottlenecks, and implement improvements across both training and inference infrastructure - Build monitoring, alerting, and observability solutions tailored to ML workloads running on Kubernetes and Slurm - Respond swiftly to system outages and collaborate across teams to maintain high uptime for critical training runs and inference services - Optimize cluster utilization and implement autoscaling strategies for dynamic workload demands QUALIFICATIONS - Strong expertise in Kubernetes administration, including custom resource definitions, operators, and cluster management - Hands-on experience with Slurm workload management, including job scheduling, resource allocation, and cluster optimization - Experience with deploying and managing distributed training systems at scale - Deep understanding of container orchestration and distributed systems architecture - High level familiarity with LLM architecture and training processes (Multi-Head Attention, Multi/Grouped-Query, distributed training strategies) - Experience managing GPU clusters and optimizing compute resource utilization REQUIRED SKILLS - Expert-level Kubernetes administration and YAML configuration management - Proficiency with Slu

Excerpt from the posting Perplexity published. Read the full description on their site before applying.

Skills this posting mentions

OrchestrationResource AllocationNetworking Technologies

About Perplexity AI

Perplexity AI builds AI native search tools. Perplexity Ask, a new search interface that uses OpenAI GPT 3.5 and Microsoft Bing to directly answer any question you ask.

All 87 openings at Perplexity AI

Apply to this role, tailored

Queue Member of Technical Staff (AI Infrastructure Engineer) at Perplexity and I will read the posting, rewrite your resume against it, draft the cover letter, and score the fit before you send anything.

Applications finish as drafts. Nothing is sent until you read it and press send. New accounts start with 500 free credits.

Tailor my applicationHow it works

More roles at Perplexity

See all

Similar roles elsewhere

See more

Listed from the job board Perplexity publishes. Refolk is not the employer and does not handle their hiring. Applications go to Perplexity directly.