Senior Software Development Engineer - Big Data

About this role

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Development Engineer – Big Data based in the United States.

We are seeking a highly experienced Senior Software Development Engineer to design and build scalable data platforms that power analytics, machine learning, and AI-driven products. In this role, you will develop reliable, secure, and high-performance data pipelines and services that transform complex datasets into valuable business insights. You will also contribute to the development of a shared AI context layer and agent platform, enabling teams to build intelligent applications and deliver enhanced customer experiences. Working at the intersection of software engineering, distributed systems, and artificial intelligence, you will collaborate with cross-functional teams to turn business and technical requirements into production-ready solutions. You will help establish engineering best practices, improve platform reliability, and mentor other engineers. This fully remote opportunity offers the chance to solve complex data challenges at scale while shaping the future of AI-powered technology in a collaborative and innovative environment.

### Accountabilities

• Design and develop scalable data infrastructure: Architect, implement, and maintain secure, observable, and reliable data pipelines and services that collect, process, and store large, diverse datasets for analytics, machine learning, and product applications.
• Optimize data processing and storage: Develop efficient data models, storage strategies, and processing frameworks to support high-volume, real-time, and batch workloads while balancing performance, reliability, and infrastructure costs.
• Lead technical excellence: Drive technical design reviews, code reviews, and engineering best practices, providing guidance and mentorship to engineers on data quality, system resilience, and operational ex...