Senior/Staff Software Engineer, Search & Retrieval Infrastructure
Pinecone · Tel Aviv
This role is closed. Pinecone stopped listing it, so the application form is gone. What they have open now is below, along with roles like this one elsewhere.
- Location
- Tel Aviv
- Workplace
- Remote
- Employment
- Full time
- Level
- Staff
- Posted
- 18 November
About this role
About Pinecone
Pinecone is the knowledge infrastructure for AI at scale. Its leading vector database and knowledge engine, Pinecone Nexus, power accurate, performant AI applications for more than 9,000 customers and 800,000 developers worldwide. Pinecone's mission is to make AI knowledgeable. Pinecone is based in New York and raised $138M in funding from Andreessen Horowitz, ICONIQ, Menlo Ventures, and Wing Venture Capital.
About the Team and Role:
We are hiring a senior/staff software engineer to help design and build core components of our next-generation knowledge retrieval system built for the AI era - search and retrieval infrastructure that powers high-quality, scalable, and enterprise-grade agentic systems. You’ll build the framework that allows our customers to connect knowledge - synthesized from structured and unstructured data - to modern LLM-powered applications, leveraging the world’s best-in-class vector DB supporting semantic search and hybrid retrieval. This role is ideal for someone who loves backend system architecture, distributed systems, and applied AI infrastructure. It is a high impact role with significant ownership across architecture, performance, and system reliability.
Responsibilities:
Design and build scalable platform components leveraging advanced retrieval via query planning, semantic and hybrid search, metadata-aware search, and LLM generation
Design and build optimized indexing pipelines for structured and unstructured data
Build backend services for semantic and hybrid retrieval, knowledge graph construction, and retrieval orchestration
Improve retrieval quality through evaluation and observability frameworks
Design APIs for internal and external user and agentic consumers
Optimize latency, throughput and cost across large-scale inference and retrieval workloads
Drive technical direction for reliability and security
What You’ll Bring to the Table:
To thrive in this role, you don't need to check every single box, but you should be deeply passionate about how to turn data into knowledge.
Systems Expertise
Architectural Depth: You have a proven track record (typically 6+ years) of shipping production-grade backends for large-scale systems. You don’t just write code; you design for high throughput, low latency, and long-term maintainability.
Data Engineering Savvy: You’re comfortable building high-throughput indexing pipelines that handle both the messy world of unstructured data and the rigid world of structured schemas.
AI & Retrieval
Retrieval Intuition: You understand that "search" is more than just a keyword match. You have direct experience (or deep theoretical knowledge) in semantic search, vector databases, hybrid retrieval strategies, or with traditional search engines like Elastic or OpenSearch.
RAG & Orchestration: You understand the nuances of Retrieval-Augmented Generation (RAG) patterns, from embedding pipelines and hybrid search techniques to how query planning and metadata filtering can make or break an LLM's performance.
Technical
Language Fluency: You are an expert in at least one major language like Go, Rust, C++, Java, or Python.
Infrastructure: Familiarity and experience with modern infrastructure tools, such as Kubernetes, cloud-native architectures, and observability frameworks, as well as infrastructure-as-code tools like Terraform or Pulumi.
Ownership & Impact
Product Thinking: You don't just build to spec; you build for the user. You can design clean, intuitive APIs that both human developers and autonomous agents will love.
Ambiguity Navigator: You’re comfortable in a high-growth environment. You prefer "owning a problem" over "executing a ticket."
Bonus Points
Experience building multi-tenant SaaS platforms.
Experience with retrieval evaluation frameworks - knowing how to actually measure "good" search results.
Experience with query planning or agentic reasoning loops (e.g., teaching a system how to break down a complex prompt into multiple specific steps).
As published by Pinecone. Applications are handled on their site.
About Pinecone
Pinecone is the knowledge infrastructure for AI at scale. Its leading vector database and knowledge engine, Pinecone Nexus, power accurate, performant AI applications for more than 9,000 customers and 800,000 developers worldwide. Pinecone's mission is to make AI knowledgeable.
All 8 openings at PineconeStop queueing links
Drop your resume once. I apply from it every morning.
Tell me once what you are looking for. Every weekday morning I rank the whole catalog against your history, pick the openings worth your time, and write each one up: tailored resume, cover letter, fit score. Send them yourself, or let me fill in the forms.
01Drop your resume
A PDF or a LinkedIn URL. About a minute, once.
02I rank the openings
Every weekday morning, the live catalog scored against your history. Up to 20 worth your time, not two hundred links.
03Each one is written up
Resume rewritten for the posting, a cover letter, a fit score. Press send, or let me fill in the form.
- 25 sent a week, free
- No card
- Nothing sent until you say so
More roles at Pinecone
See all- 19 November
Senior/Staff Software Engineer, Search & Retrieval Infrastructure
New York CityRemote
$190k - $270k/yr2 locationsStaffEngineering - 17 November
- 5 November
- 21 October
- 11 September
- 1 September
Similar roles elsewhere
See more- 17 November
Chief Architect, GPU Infrastructure & Rack-Scale Systems - Israel
Unconventional AITel Aviv
ExecutiveEngineering
Put this to work
Paste your career in once. Every application after that is written for you.
Drop a resume or a LinkedIn URL. I rank the live openings against it, rewrite the resume and write a cover letter for the best of them, and fill in the employer's form when you press the button. You read, you decide what goes out.
01Drop your resume
A PDF or a LinkedIn URL. About a minute, once.
02I rank the openings
Every weekday morning, the live catalog scored against your history. Up to 20 worth your time, not two hundred links.
03Each one is written up
Resume rewritten for the posting, a cover letter, a fit score. Press send, or let me fill in the form.
- New matches ranked and written before you are up.
- Every bullet stays inside what your history supports. Nothing invented.
- Queued, submitted, interviewing, offer: one screen, not a spreadsheet.
Free, no card. Up to 25 applications sent a week, and nothing is sent until you say so.
Listed from the job board Pinecone publishes. Refolk is not the employer and does not handle their hiring. Applications go to Pinecone directly.
Hiring at Pinecone? Post this role to the Refolk talent pool for $299, once. No commission, refunded if I find nobody. Post a role for $299