AI Engineer
Company: Haystack
Location: New York City Metropolitan Area
Type: Full-time
Level: Junior
Posted: 2026-03-02
About this role
Senior, AI Platform Engineer | NYC | Hybrid | $141,100 - $194,000
We're working with a pioneering healthtech giant dedicated to putting health first through cutting-edge technology on this exciting opportunity.
In this high-impact role, you will architect the foundational infrastructure that powers mission-critical healthcare applications and sophisticated AI-driven solutions for millions of members. You’ll be at the forefront of cloud modernization, leveraging Kubernetes, GCP, and Python to build resilient, compliant, and highly scalable distributed systems where performance directly impacts patient well-being.
The Role
• Design and implement highly scalable platform services and shared infrastructure components to support growing volumes of healthcare data and advanced AI systems.
• Build and maintain robust CI/CD pipelines using Terraform and Pulumi to automate secure, compliant software delivery in a highly regulated environment.
• Architect and operate containerized services using Docker and Kubernetes, ensuring high availability through multi-zone deployments and auto-scaling patterns.
• Implement sophisticated observability solutions (monitoring, logging, tracing) and Site Reliability Engineering (SRE) practices including SLIs/SLOs and error budgets.
• Manage complex data storage ecosystems across PostgreSQL, MySQL, MongoDB, and Redis, ensuring optimal query performance and strict HIPAA governance.
What You'll Need
• 5+ years of professional experience in Software Engineering, Platform Engineering, or Backend Development with a focus on distributed systems.
• Mastery of modern programming languages, specifically Python or Java, to deliver production-grade services and maintainable architectures.
• Extensive hands-on experience with Public Cloud platforms, with a strong preference for Google Cloud Platform (GCP) and its core compute/networking services.
• Expert-level knowledge of Containerization (Docker) and Orchestration (Kubernetes...