Senior/Staff Software Engineer (Search & Retrieval Infrastructure)

Company: Pinecone

Location: New York City, New York, USA {{REMOTE}}

Salary: $190k - $270k per year

Type: Full-time

Posted: 2026-08-09

About this role

  • We are hiring a senior/staff software engineer to help design and build core components of our next-generation knowledge retrieval system built for the AI era – search and retrieval infrastructure that powers high-quality, scalable, and enterprise-grade agentic systems
  • You’ll build the framework that allows our customers to connect knowledge–synthesized from structured and unstructured data–to modern LLM-powered applications, leveraging the world’s best-in-class vector DB supporting semantic search and hybrid retrieval
  • It is a high impact role with significant ownership across architecture, performance, and system reliability
  • Design and build scalable platform components leveraging advanced retrieval via query planning, semantic and hybrid search, metadata-aware search, and LLM generation
  • Design and build optimized indexing pipelines for structured and unstructured data
  • Build backend services for semantic and hybrid retrieval, knowledge graph construction, and retrieval orchestration
  • Improve retrieval quality through evaluation and observability frameworks
  • Design APIs for internal and external user and agentic consumers
  • Optimize latency, throughput and cost across large-scale inference and retrieval workloads
  • Drive technical direction for reliability and security

### Benefits

  • Health and Wellness: Medical, dental and vision plans, paid parental leave, and mental health resources offer holistic well-being coverage for you and your family.
  • Compensation and Financial Benefits: Pinecone offers competitive base salary and equity compensation, opportunity to build a savings and investment portfolio, and resources to protect your family from the unexpected.
  • Other Benefits: Pinecone is a hybrid in-office/remote workforce that offers Flexible PTO and WFH Equipment Stipend. Employees also enjoy attending our annual company retreat and occasional team offsites.- This role is ideal for someone who loves backend system architecture, distributed systems...

Create Your Job Alert

Other Senior/Staff Jobs

Other Jobs in New York City