Applied AI/ML Software Engineer

About this role

## Meet Ascertain

Ascertain is building AI agents to automate the administrative work that burdens care teams. We are in major health systems and large specialty groups, saving hundreds of staff hours every week.

Our backers include Northwell Health, New York’s largest health system, and Deerfield Management, a leading healthcare investment firm.

Together, we’re on a mission to restore time, trust, and focus to the people who keep healthcare running. Our work is urgent — not because of startup timelines, but because our customers rely on us to drive financial resilience and operational clarity in a system under strain.

## About the Job

As a Product Engineer in AI at Ascertain, you will own the development and optimization of agents that automate healthcare back-office workflows. This is a hands-on role: you'll configure and iterate on agentic systems, write production code when needed, and work directly with customers and our operations team to deeply understand user workflows and continuously improve performance.

You'll be responsible for building reliable agents to solve real problems, establishing QA processes and evals, analyzing call data, and using what you learn to optimize every aspect of how we deliver agentic software.

This role is based in our NYC office with a hybrid schedule.

## What You’ll Do

• Design, build, and optimize production-grade voice agents using third-party platforms and internal tooling
• Own end-to-end quality of agent performance, including QA processes, evaluation frameworks, and continuous monitoring
• Analyze call transcripts and interaction data to identify failure modes and drive systematic improvements
• Work directly with customers and internal operations teams to understand workflows and translate them into scalable product solutions
• Collaborate with engineering to build and improve reliability, observability, and deployment infrastructure
• Write and maintain production Python code for integrations, APIs, ...