RefolkCandidates
JobsBuild my resume

Member of Technical Staff (Software Engineer, Data Platform)

Perplexity · San Francisco

$220k - $405k/yrStaffData and MLPlatform & InfrastructurePlatform & InfrastructurePosted 8 weeks ago
Apply with a tailored resumeView the original posting

About this role

ABOUT THE ROLE The Data Platform team owns the end-to-end data lifecycle at Perplexity, from ingestion through processing, storage, and serving, powering product features, analytics, experimentation, AI workloads, and the company’s data lake. The team defines the architecture for batch and streaming systems, the orchestration and observability stack, and a self-serve data platform, while thoughtfully combining platforms such as Databricks and Snowflake with open-source technologies including Spark, Kafka, Flink, Airflow, Dagster, dbt, Iceberg, Delta Lake, and ClickHouse. In this senior/staff role, you will shape architecture, set standards, and drive the long-term technical direction of Perplexity’s data ecosystem. KEY RESPONSIBILITIES - Design and operate large-scale batch and streaming data pipelines that directly power Perplexity product features, AI training and evaluation workflows, analytics, and experimentation. - Build event-driven and streaming systems (Kafka, Kinesis, PubSub, or similar) for real-time ingestion, transformation, and delivery, alongside batch frameworks for backfills, aggregations, and offline computation. - Lead the architecture of data orchestration using tools like Airflow or Dagster, owning scheduling, dependency management, retries, SLAs, and end-to-end observability for critical data flows. - Set and enforce guarantees for data correctness, freshness, lineage, and recoverability, designing systems that handle rapid scale growth, partial failures, and evolving schemas without disrupting AI workloads or product experiences. - Build self-serve data platforms that let engineers, data scientists, and analysts safely discover data, define contracts, and create and operate their own pipelines with minimal friction. - Improve developer experience through better abstractions, opinionated paved paths, and standards for data modeling, testing, validation, and deployment, treating the data platform as a product used by many teams. - Drive architec

Excerpt from the posting Perplexity published. Read the full description on their site before applying.

Skills this posting mentions

Developer ExperienceData ProcessingDatabase Arch/Design

About Perplexity AI

Perplexity AI builds AI native search tools. Perplexity Ask, a new search interface that uses OpenAI GPT 3.5 and Microsoft Bing to directly answer any question you ask.

All 87 openings at Perplexity AI

Apply to this role, tailored

Queue Member of Technical Staff (Software Engineer, Data Platform) at Perplexity and I will read the posting, rewrite your resume against it, draft the cover letter, and score the fit before you send anything.

Applications finish as drafts. Nothing is sent until you read it and press send. New accounts start with 500 free credits.

Tailor my applicationHow it works

More roles at Perplexity

See all

Similar roles elsewhere

See more

Listed from the job board Perplexity publishes. Refolk is not the employer and does not handle their hiring. Applications go to Perplexity directly.