Principal Product Security Engineer

Join the company that’s building the telemetry infrastructure for the AI era. At Cribl, we partner with IT and Security teams at many of the world’s biggest enterprises, including half of the Fortune 100, to bridge the gap between AI ambition and infrastructure reality. As the AI Platform for Telemetry, we give customers the choice, control, and flexibility to manage and analyze telemetry for both humans and agents, so they can build what’s next.

We’re one of the fastest‑growing private companies and a leading player in a massive, fast‑moving market. With a global workforce, we’re remote‑first and grounded in a simple idea: software is a people business. Cribl is the place where curious, collaborative people can do their best work, grow fast, and bring their full selves to the herd.

Why You’ll Love This Role

Cribl is looking for a Principal Product Security Engineer to serve as a hands-on technical authority at the intersection of application, cloud, and FedRAMP environment security. You will help secure Cribl’s cloud-native, customer-managed, and hybrid products as they process high-volume data for some of the world’s largest organizations.

As a Principal engineer, impact is defined by reach. You will set long-term direction across teams, resolve critical and ambiguous security problems, advise Engineering and Product leaders, and turn security requirements into secure designs, production-ready patterns, automation, and verified outcomes. This is not a documentation-only compliance role: you will work with Engineering, SRE, Cloud Operations, Compliance, and Product Security Incident Response Team (PSIRT) partners to make regulatory commitments real in product architecture and day-to-day operations.

This is a remote, hands-on individual-contributor role within Engineering. You will lead through expertise and influence, mentor engineers and security partners, and create durable systems that reduce risk while making the secure path easier.

As An Active Member Of Our Team, You Will…

• Set long-term product and cloud security direction across multiple teams, shaping roadmaps, standards, secure-by-default patterns, and risk-informed design and release decisions.
• Lead Product Security Reviews for distributed, multi-tenant SaaS and customer-managed products, including architecture and design review, threat modeling, abuse-case analysis, targeted secure code review, and security test planning.
• Translate risk into concrete engineering requirements, mitigations, tests, and secure defaults; stay engaged through implementation and independently verify that the intended risk reduction was achieved.
• Serve as a principal cloud security authority across IAM and workload identity, organization and account boundaries, network exposure, KMS and encryption, secrets, logging and detection, containers and Kubernetes, serverless services, infrastructure as code, hardening, and data isolation.
• Lead the Product Security component of FedRAMP engineering. Translate FedRAMP Moderate and NIST SP 800-53 control intent into sustainable technical controls and defensible evidence, and partner on authorization-boundary and significant-change decisions, continuous monitoring, vulnerability and change management, POA&M and deviation remediation, incident response, vendor assessments, and 3PAO or assessor interactions.
• Investigate ambiguous signals and vulnerabilities from bug bounty, application and supply-chain scanners, penetration tests, cloud detections, and internal reports; determine exploitability, exposure, and impact; coordinate remediation; validate fixes and bypasses; and hunt for variants and root causes.
• Evolve scalable, risk-adaptive vulnerability management using exposure, exploitability, CISA Known Exploited Vulnerabilities signals, asset criticality, customer impact, and regulatory timelines,not CVSS alone.
• Build and operate durable security capabilities and developer paved roads across CI/CD, SAST, SCA, secrets, infrastructure as code, containers, cloud posture, and testing. Automate repeatable work while preserving explicit human judgment for consequential security decisions.
• Scope and oversee external penetration tests, purple-team exercises, and relevant security vendors; ensure findings become owned, verified engineering outcomes; and provide evidence-based input to build, retain, replace, or retire decisions.
• Lead multi-team work through uncertainty and high-stakes situations, making clear tradeoffs among security, reliability, delivery, customer impact, and compliance while acting with appropriate urgency.
• Communicate complex risks, options, uncertainty, and recommendations in direct, audience-appropriate terms for engineers, senior leaders, customers, assessors, and external partners; represent Cribl credibly when needed.
• Multiply the team by mentoring Product Security engineers, security champions, and engineering partners; create standards, runbooks, automation, and continuity plans that prevent critical capabilities from depending on one person.
• Evaluate and responsibly apply emerging technologies, including AI-assisted security engineering, with measurable outcomes, rigorous verification, secure operating boundaries, and clear human accountability.
• This position will require stand-by, on-call, or off-hours duties.

If You’ve Got It - We Want It

• Typically 10+ years of relevant software security, security engineering, or software engineering experience,or equivalent demonstrated scope and impact,including substantial hands-on Application Security or Product Security and cloud security work.
• Experience securing AI or agentic systems and applying AI responsibly to security engineering workflows.
• A Principal-level track record of setting technical direction across teams, leading multi-quarter initiatives, resolving ambiguous critical problems, and influencing senior Engineering and Product leaders without direct authority.
• Deep, hands-on AWS and Azure security experience in production SaaS or cloud-native systems, including identity and authorization, network controls, encryption and key management, secrets, logging and detection, containers or Kubernetes, serverless services, infrastructure as code, and multi-tenant data isolation.
• Direct experience implementing or operating product and cloud security controls in a FedRAMP-authorized or FedRAMP-bound environment. You understand NIST SP 800-53 control intent and have supported technical control implementation and evidence, continuous monitoring, vulnerability and change management, POA&M or deviation remediation, and assessor interactions.
• Expertise leading security design reviews and threat models for complex applications, APIs, distributed systems, and cloud architectures, with the judgment to turn findings into practical countermeasures and risk-informed release recommendations.
• Strong knowledge of web and application vulnerabilities, exploit techniques, OWASP guidance, authentication and authorization protocols, cryptography, common network protocols, and secure cloud operating models.
• Ability to read production code and build maintainable automation in JavaScript or TypeScript, Python, Go, or a comparable language; willingness to work directly with Engineering to implement and verify security improvements.
• Hands-on vulnerability-response experience, including exploitability analysis, root-cause and variant analysis, remediation design, fix and bypass validation, stakeholder coordination, and incident support.
• Exceptional written and verbal communication, with the ability to make complex risk and tradeoffs clear to engineers, executives, customers, assessors, and external partners.
• A bachelor’s degree in computer science, cybersecurity, or a related field - or equivalent practical experience.
• Preferred qualifications
• Experience securing enterprise data platforms, observability systems, high-volume data pipelines, agents, or customer-managed and hybrid software.
• Experience with AWS GovCloud, FedRAMP Moderate/High, NIST 800-53.
• Experience building developer security platforms, secure-by-default libraries, policy-as-code, or automated guardrails across SAST, SCA, DAST, software supply chain, containers, and cloud posture.
• Public security contributions such as open-source work, published research, CVE credits, standards participation, conference talks, or other demonstrated thought leadership.
• Relevant credentials such as AWS Certified Security - Specialty, CISSP, CCSP, CSSLP, GIAC, or OSCP; demonstrated practical impact matters more than certifications.

#LI-AM1
#LI-Remote

The salary for this role is dependent on geographic location and will be based on the individual candidate's job-related knowledge, skills, and experience.

In addition to base salary, for sales and some sales-adjacent roles, employees are eligible to earn incentive compensation (commission). For all other roles, employees are eligible to participate in the Cribl Corporate Bonus Program.

In addition to a competitive salary, Cribl also offers a generous benefits package which includes health, dental, vision, short-term disability, and life insurance, paid holidays and paid time off, a fertility treatment benefit, 401(k), and equity.

Base Salary Range$265,000-$320,000 USD

Bring Your Whole Self

Diversity drives innovation, enables better decisions to support our customers, and inspires change for the better. We’re building a culture where differences are valued and welcomed, and we work together to bring out the best in each other. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or any other applicable legally protected characteristics in the location in which the candidate is applying.

Interested in joining the Cribl herd? Learn more about the smartest, funniest, most passionate goats you’ll ever meet at cribl.io/about-us.