Vice President, AI / Machine Learning Software Engineer
Company: BNY
Location: Jersey City, NJ, United States
Salary: $120k per year
Type: Full-time
Posted: 2026-07-17
About this role
At BNY, our culture allows us to run our company better and enables employees’ growth and success. As a leading global financial services company at the heart of the global financial system, we influence nearly 20% of the world’s investible assets. Every day, our teams harness cutting-edge AI and breakthrough technologies to collaborate with clients, driving transformative solutions that redefine industries and uplift communities worldwide.
Recognized as a top destination for innovators, BNY is where bold ideas meet advanced technology and exceptional talent. Together, we power the future of finance – and this is what #LifeAtBNY is all about. Join us and be part of something extraordinary.
Role Overview
We are seeking a senior‑level engineer to design, build, and operate production‑grade GenAI and Retrieval‑Augmented Generation (RAG) platforms at scale. This role focuses on industrializing LLM‑based systems with strong guardrails, observability, evaluation frameworks, and operational rigor, ensuring reliability, safety, and cost efficiency across the full AI lifecycle. This role is located in Jersey City, NJ.
Key Responsibilities
- Design and build **production**‑**ready RAG pipelines**, including retrieval, ranking, prompt orchestration, and response generation, with comprehensive **guardrails, tracing, and observability**.
- Implement **offline and online evaluation frameworks** for prompts, models, and datasets, including quality, safety, latency, and cost metrics.
- Own **end**‑**to**‑**end lifecycle management** for GenAI systems, covering prompt versions, model versions, datasets, and configurations.
- Establish and maintain **CI/CD pipelines** for prompts, models, and data, enabling safe, repeatable, and auditable releases.
- Implement **cost and performance monitoring**, including token usage, inference latency, throughput, and spend optimization.
- Build and enforce **safety mechanisms**, such as content filtering, policy enf...