Principal Software Engineer - AI/ML (Ireland)
Company: Red Hat
Location: Location not specified (Remote)
Type: Full-time
Remote: Yes
Posted: 2026-05-15
About this role
Principal Software Engineer to work on cutting-edge AI/ML applications and agent systems, leveraging modern inference platforms to build production-ready prototypes. You will contribute to upstream communities like vLLM, TGI, PyTorch, and OpenVINO while building innovative applications that demonstrate the capabilities of next-generation AI/ML systems. The ideal candidate is energized by working concurrently on a wide variety of projects, independently as well as within a team environment.
What You Will Do
- Build high-quality, high-performing AI/ML applications and agent systems using modern inference platforms for multi-modal and distributed model serving
- Apply and optimize inference techniques including KV cache management, model quantization, and distributed serving to production workloads
- Contribute to upstream inference runtime communities such as vLLM, TGI, PyTorch, OpenVINO, and related projects
- Build multi-modal AI applications integrating vision, language, and other modalities
- Provide technical leadership and coordination across multiple stakeholders and engineering teams
- Apply a growth mindset by staying current with rapid advancements in AI/ML inference technologies
- Benchmark and analyze inference performance at scale, driving data-driven optimization decisions
- Publicize innovations through blogs, presentations, conferences, and other technical venues
What You Will Bring
- Bachelor's degree in Computer Science, Engineering, or equivalent experience
- 5+ years of experience in AI/ML engineering with focus on production inference systems
- Deep expertise in PyTorch and modern deep learning frameworks
- Hands-on experience with inference runtime optimization (model serving, batching, KV cache management)
- Advanced programming skills in Python and C++
- Proven ability to contribute to and lead open source projects
- Strong self-motivation and organizational skills
- Ability to work concurrently on multiple projects, independen...