This position is no longer accepting applications. It closed on 2026-11-08. Similar open jobs are listed below.

Senior Software Engineer II (Data & AI Platform)

Company: StepStone Group

Location: London, England, United Kingdom

Work arrangement: Hybrid

Employment type: Full-time

Experience: 10+ years

Posted: 2026-11-02

Responsibilities

Define the Data Platform’s technical vision, roadmap, and architecture, and establish engineering standards and reusable patterns across data, platform, and infrastructure. Guide teams through complex technical challenges and delivery planning, improve engineering quality and reliability, and mentor engineers while promoting AI-assisted development and automation.

Requirements

Candidates should have senior-level experience as a software engineer, data engineer, or equivalent, with a strong background in data platforms, distributed systems, and cloud-native architecture. They should have experience shaping technical direction across teams and expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, modern lakehouse architectures, and data quality, governance, and observability.

Skills

  • Data Platform Architecture
  • Distributed Systems
  • Cloud-Native Architecture
  • AWS
  • Terraform
  • Kafka
  • Airflow
  • AWS Glue
  • Spark
  • Data Lakes
  • Lakehouse Architecture
  • Apache Iceberg
  • Batch Processing
  • Streaming Processing
  • Data Governance
  • Observability

Benefits

  • 29 Days Holiday Allowance Plus Bank Holidays
  • Private Medical and Dental Healthcare
  • Pension Contribution up to 10%
  • 24/7 Employee Assistance Programme
  • Life Assurance Cover
  • Cycle to Work Scheme
  • Hybrid Working Model
  • Volunteering Days
  • Dog-Friendly Office

About this role

Company Description
At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for jobseekers and companies around the world to find a perfect match in fair and equitable way. With over 20 brands across 30+ countries, we strive for fair and unbiased hiring. Join our team of 3,000+ employees and be part of reshaping the labour market and becoming the world’s leading job platform.
Job Description
Join our team and you’ll be responsible for providing technical leadership for our Data Platform team, defining technical direction and driving architectural decisions across data, platform and infrastructure domains.
Working in the Data Platform department you will build scalable, reliable and well-governed data platform capabilities that support analytics, AI and business-critical products, while collaborating closely with Engineering Managers, Product Managers and Enterprise Architects.
This is so important to us. By joining our team, you will be playing a vital role as together we reimagine the labour market to make it work for everybody.
Your responsibilities
Define and evolve the technical vision, roadmap and architecture of the Data Platform, driving decisions across data, platform and infrastructure domains
Establish engineering standards, best practices and reusable patterns while partnering with Enterprise Architecture and influencing technical direction
Drive engineering excellence by improving code quality, testing, observability, reliability and operational practices
Support end-to-end delivery by guiding teams through complex technical challenges, improving decision-making, and contributing to planning and risk management
Mentor engineers, grow senior technical capabilities and champion AI-assisted development and engineering automation
Qualifications
Your skills and qualifications
Proven experience as a Senior Software Engineer or Senior Data Engineer or in an equivalent senior individual contributor role
Strong background in data platforms, distributed systems and cloud-native architectures, with experience shaping technical direction across teams and stakeholders
Solid expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions
Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg or similar table formats, as well as batch and streaming processing
Knowledge of data quality, governance, cataloguing and observability tools (e.g. Datadog), with DBT or AI-assisted engineering practices as a plus
Additional Information
Your benefits
We’re a community here that cares as much about your life outside work as how you feel when you’re with us. Because your job shouldn’t take over your life, it should enrich it. Here are some of the benefits we offer:
29 days holiday allowance + bank holidays
Private medical and dental healthcare
Pension contribution up to 10%
24/7 Employee Assistance Programme
Life Assurance Cover
Cycle to work scheme
Hybrid working model
Volunteering days
and you can bring your dog to the office!
Our commitment
Equal opportunities are important to us. We believe that diversity and inclusion at The Stepstone Group are critical to our success as a global company, so we want to recruit, develop, and keep the best talent. We encourage applications from everyone, regardless of background, gender identity, sexual orientation, disability status, ethnicity, belief, age, family or parental status, and any other characteristic.

Legal Entity: The Stepstone Group Polska sp. z o.o.

About StepStone Group

Software Development · 1,001-5,000 employees · headquartered in Düsseldorf, North Rhine-Westphalia

See all my matches — 2 min, free

More Software Engineer Jobs

12 new Software Engineer jobs were posted this week in London.

All Remote Software Engineer Jobs →

Get new Software Engineer jobs by email — start free

Other Jobs in London

Before you apply, check your resume against ATS filters for free.