Staff Software Engineer - AI/ML Platform

About this role

At GEICO, we offer a rewarding career where your ambitions are met with endless possibilities.
Every day we honor our iconic brand by offering quality coverage to millions of customers and being there when they need us most. We thrive through relentless innovation to exceed our customers’ expectations while making a real impact for our company through our shared purpose.
When you join our company, we want you to feel valued, supported and proud to work here. That’s why we offer The GEICO Pledge: Great Company, Great Culture, Great Rewards and Great Careers.
GEICO AI platform and Infrastructure team is seeking an exceptional Senior ML Platform Engineer to build and scale our machine learning infrastructure with a focus on Large Language Models (LLMs) and AI applications. This role combines deep technical expertise in cloud platforms, container orchestration, and ML operations with strong leadership and mentoring capabilities. You will be responsible for designing, implementing, and maintaining scalable, reliable systems that enable our data science and engineering teams to deploy and operate LLMs efficiently at scale. The candidate must have excellent verbal and written communication skills with a proven ability to work independently and in a team environment.


Key Responsibilities
ML Platform & Infrastructure

• Design and implement scalable infrastructure for training, fine-tuning, and serving open source LLMs (Llama, Mistral, Gemma, etc.)
• Architect and manage Kubernetes clusters for ML workloads, including GPU scheduling, autoscaling, and resource optimization
• Design, implement, and maintain feature stores for ML model training and inference pipelines
• Build and optimize LLM inference systems using frameworks like vLLM, TensorRT-LLM, and custom serving solutions
• Ensure 99.9%+ uptime for ML platforms through robust monitoring, alerting, and incident response procedures
• Design and implement ML platforms using DataRobot, Azure Mach...