Refolk
Open nowEngineeringCustomer Engineering

Forward Deployed Engineer (German speaking)

deepset · Berlin, Germany

Location
Berlin, Germany
Workplace
Remote
Employment
Full time
Level
Mid level
Posted
16 November

About this role

TL;DR

As a Forward Deployed Engineer at deepset, you work embedded inside our most strategic Enterprise and Public Sector customers, as part of their team. You will transform their problems and challenges into production grade solutions and you stay with the customer until those solutions are adopted at scale and delivering measurable value. You are the technical partner the customer relies on day to day, and the bridge between their teams and deepset’s Customer Engineering, Product and Engineering teams.

Why deepset

At deepset, we're on a mission to make custom AI solutions accessible to every organization. With Haystack, thousands of developers build advanced LLM applications every day, while our enterprise-ready AI Platform helps companies turn large language models into business value. We're remote-first, flexible, and built on a culture of trust and ownership. You'll collaborate with top-tier tech talent, tackle meaningful challenges, and help transform complex AI into solutions that are simple, powerful, and ready for the real world.

What you will do

Embed and partner

  • Work inside the customer’s team, aligned with their delivery and governance models, ways of working and environments.

  • Act as the customer’s trusted AI advisor on use case prioritization, architecture and roadmap, connecting their goals with the Haystack Enterprise Platform (HEP).

  • Translate business problems into well-scoped solutions with clear success metrics and a baseline, together with the Value Engineer.

  • Anticipate upcoming needs and maintain a customer-specific AI roadmap.

Build and run in production

  • Own technical outcomes from PoC to production: agents and orchestration, workflows, RAG pipelines, indexing and embeddings, model optimization, evaluations, cost management, and API and system integrations.

  • Bring state-of-the-art approaches to the customer’s hardest problems and turn them into reliable, secure, production-grade systems inside the customer’s environment.

  • Monitor solution performance with the customer and resolve issues in the AI layer quickly.

  • Reuse and contribute reference architectures and reusable components that make every new engagement faster.

Drive adoption and impact

  • Make sure what you build is actually used, with measurable quality and business impact.

  • Run structured evaluations and continuously improve retrieval quality, prompts and model behavior based on real usage and feedback.

  • Enable the customer team to operate and extend solutions independently: documentation, runbooks, knowledge transfer and training.

Grow the account and the product

  • Surface new use cases, teams and stakeholders, and bring them to the account team.

  • Prepare the evidence for the contract renewal: value delivered against the baseline agreed at kick-off.

  • Share field insights with Product and Engineering to shape HEP.

What you bring to the team

  • Native German language skills

  • Hands-on experience shipping AI applications to production: RAG, agents, data preprocessing, retrieval and embeddings.

  • A track record of building trusted, long-term relationships with technical and business stakeholders, communicating clearly at every level.

  • Experience designing and running agent evaluations and improving quality from real usage data.

  • Familiarity with agent frameworks and vector databases.

  • Strong Python and production engineering practices: testing, CI/CD, code review and observability.

  • Experience operating AI solutions in production in enterprise environments: monitoring, troubleshooting and incident handling.

  • Solid understanding of enterprise integration: APIs, authentication (OIDC/SAML), security and compliance.

  • Close awareness of the state of the art in LLMs and agentic systems, and the judgment to know when it is ready for production.

  • Experience scoping and estimating work within long-running engagements: effort, assumptions, risks and deliverables.

Nice to have

  • Haystack experience is a big plus

  • Forward-deployed or consulting experience on long, embedded engagements

  • Basic frontend skills (React, TypeScript) for user-facing workflows

  • Fine-tuning experience (PEFT, LoRA)

Benefits

  • Remote-first setup with flexible hours & tech of your choice

  • 30 days vacation + extra days for family sick leave

  • Competitive salary & stock options for every team member

  • Monthly sports & mental health support allowance with Oliva

  • Annual learning & development budget

  • Monthly team socials & in-person meetups

  • Dog-friendly Berlin HQ

About us

Founded in 2018, deepset builds open and enterprise-grade tools that help teams build AI with purpose. From Haystack, our open-source framework, to the Haystack Enterprise Platform, we give developers and organizations the building blocks to solve complex, high impact challenges with AI with full control, transparency, and sovereignty. Backed by GV and Balderton, we’re growing the world’s production AI community and customer base solving challenges too critical to get wrong.

‍Visit us to learn more: deepset Website | Haystack Website | GitHub | Linkedin | X deepset (Twitter) | X haystack (Twitter)

As published by deepset. Applications are handled on their site.

Skills this posting mentions

Artificial IntelligenceGovernanceLanguage Models

About deepset

deepset is the creator of the open-source Haystack AI orchestration framework and the Haystack Enterprise Platform. We help organizations build, run, and govern custom AI agents and retrieval-augmented generation (RAG) applications across cloud and on-premise environments. Teams start with Haystack to build immediately, add optional enterprise support through Haystack Enterprise Starter, and scale with the Haystack Enterprise Platform, which provides tooling for advanced indexing and retrieval, testing and evaluation, and governance for production AI. Haystack is trusted in production by enterprise teams and organizations including the European Commission, The Economist, Airbus, and the German Armed Forces.

All 4 openings at deepset

One click, then it is written

Apply to deepset with a resume written for this role.

Queue Forward Deployed Engineer (German speaking) and I read the posting, rewrite your resume against it, draft the cover letter, and score the fit. Then you press send, or press one button and I fill in deepset’s form for you.

  1. 01Drop your resume

    A PDF or a LinkedIn URL. About a minute, once.

  2. 02I rank the openings

    Every weekday morning, the live catalog scored against your history. Up to 20 worth your time, not two hundred links.

  3. 03Each one is written up

    Resume rewritten for the posting, a cover letter, a fit score. Press send, or let me fill in the form.

  • 25 sent a week, free
  • No card
  • Nothing sent until you say so

More roles at deepset

See all

Similar roles elsewhere

See more

Put this to work

Paste your career in once. Every application after that is written for you.

Drop a resume or a LinkedIn URL. I rank the live openings against it, rewrite the resume and write a cover letter for the best of them, and fill in the employer's form when you press the button. You read, you decide what goes out.

  1. 01Drop your resume

    A PDF or a LinkedIn URL. About a minute, once.

  2. 02I rank the openings

    Every weekday morning, the live catalog scored against your history. Up to 20 worth your time, not two hundred links.

  3. 03Each one is written up

    Resume rewritten for the posting, a cover letter, a fit score. Press send, or let me fill in the form.

  • New matches ranked and written before you are up.
  • Every bullet stays inside what your history supports. Nothing invented.
  • Queued, submitted, interviewing, offer: one screen, not a spreadsheet.

Free, no card. Up to 25 applications sent a week, and nothing is sent until you say so.

Listed from the job board deepset publishes. Refolk is not the employer and does not handle their hiring. Applications go to deepset directly.

Hiring at deepset? Post this role to the Refolk talent pool for $299, once. No commission, refunded if I find nobody. Post a role for $299