AI Backend Engineer

Company: Haystack

Location: Location not specified (Remote)

Type: Full-time

Remote: Yes

Posted: 2026-07-26

About this role

We are working with a company at the forefront of leveraging artificial intelligence to drive decision-making, automation, and orchestration across its robust platform. This organisation is building the foundational systems that power next-generation AI solutions, impacting production experience through rigorous attention to latency, correctness, reliability, and cost.


The Role

  • Build and operate backend systems supporting AI-powered workflows in production
  • Design and implement AI orchestration layers connecting models, APIs, and business logic
  • Develop inference pipelines for LLM-based and AI-assisted automation systems
  • Optimise AI services for latency, throughput, and cost through various techniques
  • Design stable service boundaries between backend systems, ML components, and product APIs
  • Implement comprehensive observability, including logging, metrics, tracing, and incident response

What You'll Need

  • Strong experience in production backend engineering
  • Demonstrated experience with Artificial Intelligence (AI) concepts and applications
  • Proficiency in building or operating high-throughput, low-latency services
  • Familiarity with AI Systems such as LLMs, Embeddings, or AI Workflows
  • Experience with distributed systems and production debugging practices
  • Strong understanding of APIs, data flows, and system design principles

What's On Offer

  • Fully remote position within a global engineering team
  • Opportunity to work at the core of an advanced AI stack
  • Exposure to cutting-edge AI technologies and distributed systems
  • Competitive benefits package including medical, dental, vision, and savings plans

Apply via Haystack today!

Create Your Job Alert

Other AI Jobs

Other Jobs in Location not specified