Machine Learning Engineer - Moderation
Black Forest Labs · San Francisco, CA
- Location
- San Francisco, CA, United States
- Employment
- Full time
- Level
- Mid level
- Posted
- 15 November
About this role
About Black Forest Labs
We’re the team building the foundational layer for visual intelligence: multimodal models trained jointly on images, video, audio, and action to see, generate, and understand the world.
Our founding team pioneered latent diffusion and Stable Diffusion, the breakthroughs that made generative AI accessible to millions. With FLUX, we're pushing into generative media at scale, machines that act in the physical world, and emerging applications in computer use.
Our FLUX models top public benchmarks and run in production in some of the world's biggest platforms. We're a small, fast growing research lab competing with the largest companies in the world. From our labs in Freiburg to San Francisco, we're building what comes next.
Why This Role
Black Forest Labs’ products arm individuals with great creative power to produce novel media across a range of modalities. The quality of our models inevitably also gives bad actors the opportunity to create harmful, copyright-infringing, or illegal content.
In this role you will develop and improve our moderation system: a multilayered stack of detection models. Succeeding in this role requires creativity and familiarity with a large range of ML techniques. An effective solution that balances accuracy, cost, latency, and scalability will vary case-by-case, from classical ML fine-tuning, to RAG-based agents, to simple, lightweight semantic embeddings.
This is a Senior / Staff IC role. Our ideal candidate is able to work across the full stack of ML engineering, collaborate cross-functionally with many teams, including legal, policy, go-to market, and infra, and has a real interest in the domains of AI safety and integrity.
What You’ll Work On
Develop ML models and systems to detect harmful and/or illegal content across a variety of classes and modalities
Collaborate with our core infrastructure team to integrate these models into a large-scale production serving pipeline
Handle customer requests and feedback on our moderation behavior, and make quick adjustments in response
Collaborate with our legal, policy, and product teams to design moderation policies that are technically feasible and effective while preserving a positive user experience
What We’re Looking For
Experience deploying VLMs at scale for the classification of multimodal content
Experience building AI systems around state-of-the-art open-source VLMs
Experience tuning models for classification tasks, including building eval sets, reasoning about precision/recall at threshold, and monitoring for drift
Comfort with the full stack of ML engineering: from research and experimentation to large-scale deployment
Nice to have:
Comfort with the adversarial nature of generative AI moderation: prompt obfuscation, jailbreaks, output laundering, and evasion generally
Experience in moderation/safety space, preferably across a range of modalities (text, image, video, audio)
Experience optimizing VLM inference latency at scale
Experience with non-VLM solutions for safety classification (e.g., classical ML)
Domain knowledge and experience with content copyright and/or child safety moderation systems
How We Work Together
We’re a distributed team with real offices that people actually use. This role is based in San Francisco, and you’ll join us in the office at least 2 days a week, or one full week every other week.
Everything we do is grounded in four values:
Obsessed. We are a frontier research lab. The science has to be right, the understanding deep, the product beautiful.
Low Ego. The work speaks. The best idea wins, no matter who said it. Credit is shared. Nobody is above any task.
Bold. We take the ambitious bet. We ship, we do not wait for conditions to be perfect.
Kind. People over politics. We treat each other with genuine warmth. Agency without empathy creates chaos.
If this sounds like work you’d enjoy, we’d love to hear from you.
Base Annual Salary:
US $220,000 - $280,000 USD + Equity
Note: We may use AI-assisted tools to help organize applications. All hiring decisions are always made by our team.
As published by Black Forest Labs. Applications are handled on their site.
Skills this posting mentions
About Black Forest Labs
We’re the leading frontier AI research lab, continuously building the most advanced technology that shapes the visual understanding of the world. Our team pioneered Stable Diffusion, Stable Video Diffusion, and FLUX.1 and 2 - benchmarks in the evolution of generative AI. Today, these foundations power millions of creations worldwide, from individual artists to enterprise applications. Our most recent models power a wide range of products - turning imagination into reality with precision, speed, and creative control.
All 16 openings at Black Forest LabsOne click, then it is written
Apply to Black Forest Labs with a resume written for this role.
Queue Machine Learning Engineer - Moderation and I read the posting, rewrite your resume against it, draft the cover letter, and score the fit. Then you press send, or press one button and I fill in Black Forest Labs’s form for you.
01Drop your resume
A PDF or a LinkedIn URL. About a minute, once.
02I rank the openings
Every weekday morning, the live catalog scored against your history. Up to 20 worth your time, not two hundred links.
03Each one is written up
Resume rewritten for the posting, a cover letter, a fit score. Press send, or let me fill in the form.
- 25 sent a week, free
- No card
- Nothing sent until you say so
More roles at Black Forest Labs
See all- 15 November
- 15 November
Member of Technical Staff - Infrastructure Security
San Francisco, CARemote
$220k - $280k/yrStaffEngineering - 2 November
- 2 November
- 29 October
- 28 October
Similar roles elsewhere
See more- 14 November
- 14 November
- 13 November
- 13 November
- 13 November
Staff Machine Learning Engineer, Content Visual AI
PinterestSan Francisco, CA +3Remote
StaffData and ML - 13 November
Put this to work
Paste your career in once. Every application after that is written for you.
Drop a resume or a LinkedIn URL. I rank the live openings against it, rewrite the resume and write a cover letter for the best of them, and fill in the employer's form when you press the button. You read, you decide what goes out.
01Drop your resume
A PDF or a LinkedIn URL. About a minute, once.
02I rank the openings
Every weekday morning, the live catalog scored against your history. Up to 20 worth your time, not two hundred links.
03Each one is written up
Resume rewritten for the posting, a cover letter, a fit score. Press send, or let me fill in the form.
- New matches ranked and written before you are up.
- Every bullet stays inside what your history supports. Nothing invented.
- Queued, submitted, interviewing, offer: one screen, not a spreadsheet.
Free, no card. Up to 25 applications sent a week, and nothing is sent until you say so.
Listed from the job board Black Forest Labs publishes. Refolk is not the employer and does not handle their hiring. Applications go to Black Forest Labs directly.
Hiring at Black Forest Labs? Post this role to the Refolk talent pool for $299, once. No commission, refunded if I find nobody. Post a role for $299