Senior, Data Engineer

Responsibilities

Develop and maintain scalable AWS-based PySpark data pipelines, optimize SQL and Python transformations, and manage data storage, cataloging, performance, and governance. Build automated deployments, testing, monitoring, and internal data applications, while translating client requests into technical tasks.

Requirements

Requires a master's degree in Computer Science, Information Technology, Engineering, or a related field, plus two years of relevant experience. Required experience includes AWS-based PySpark ETL, complex Greenplum/PostgreSQL SQL, AWS data services, CI/CD and infrastructure as code, observability, data quality, security controls, and GenAI-assisted data delivery.

Skills

• PySpark
• AWS
• SQL
• Python
• Greenplum
• PostgreSQL
• ETL
• Data Pipelines
• Amazon EMR
• AWS Glue
• Amazon S3
• Amazon Athena
• DynamoDB
• CloudFormation
• CI/CD
• Data Quality Testing

Benefits

• Flexible Time Off
• Paid Holidays
• Paid Sick Time
• Parental Leave
• Childcare Assistance
• Elder Care Assistance
• Adoption Assistance
• Health Coverage
• 401(k)
• Tuition Assistance
• Commuter Benefits
• Professional Development
• Employee Recognition
• Charitable Donation Matching
• Health Coaching
• Counseling

About this role

Company Description
See how Epsilon powers connected marketing by unlocking the full potential of data and identity.
Overview
This Notice is provided as a result of the filing of applications for permanent alien labor certification for the positions noted below. Any person may provide documentary evidence bearing on an application to the Certifying Officer, U.S. Department of Labor, Employment and Training Administration, Office of Foreign Labor Certification, 200 Constitution Avenue NW, Room N–5311, Washington, DC 20210
Employer: Epsilon Data Management LLC
Job Title: Senior, Data Engineer
Job Requisition: 6630.7950.6
Job Location: 35 West Wacker Drive, Chicago, IL 60601. Required to work from Company Office in Chicago IL certain days per week. Telecommuting allowed for balance of week.
Job Type: Full Time
Responsibilities
Duties: Develop and execute software tests to identify software problems and their causes. Write and optimize complex SQL Scripts and build Python scripts to execute large-scale transformations on Greenplum. Create test plans, run rigorous unit/integration tests, and deliver reproducible, well-documented results. Design and maintain AI-enabled, PySpark data pipelines on AWS primarily EMR, Glue, Athena, DynamoDB, and S3 to process large datasets at scale. Harden and tune jobs for performance, cost, and compliance, and manage data partitioning, cataloging, and lineage. Automate deployments and infrastructure with CloudFormation and parameterized configurations, and schedule batch workloads to keep pipelines timely and reliable. Build internal dashboards and data products (e.g., Amplify apps) and instrument monitoring/alerting to catch issues early. client tickets, translating ambiguous requests into clear technical tasks
Qualifications
Requirements: Employer will accept a Master’s degree in Computer Science, Information Technology, Engineering or related field and two years of experience in the job offered or two years in any occupation in which the required experience was gained.
Position requires two years in the following:
Build PySpark ETL on AWS EMR/Glue reading/writing S3 (partitioning, predicate pushdown, broadcast joins) to deliver analytics-ready fact/dimension tables on schedule.
Author and tune complex SQL on Greenplum/Postgres (window functions, ROW_NUMBER dedupe, distribution keys, AO/AOCO compression, VACUUM/ANALYZE) to process large datasets efficiently.
Manage AWS Glue Data Catalog and query curated layers with Athena; design S3 layouts (prefix/partition strategy, lifecycle policies) to cut query time and storage cost.
Implement CI/CD with CodeCommit, CodeBuild, and CodePipeline; parameterize environments and use CloudFormation for IaC to enable repeatable, auditable, and fast rollbacks.
Engineer observability with CloudWatch logs/metrics/alarms and job health checks, create SLA dashboards and alerting to detect failures early and reduce MTTR.
Enforce data quality via SQL/Python unit tests, reconciliation (row counts, sums, duplicates), referential-integrity checks, and documented UAT evidence for change control.
Apply security and data-governance controls: normalize and encrypt sensitive identifiers, use KMS-managed keys, and enforce IAM least privilege with audit logging.
Develop GenAI-assisted delivery integrates LLMs (AWS Bedrock) with PySpark/SQL to auto-suggest transformations, generate test cases, and summarize validation results.
Build lightweight internal data apps with AWS Amplify + DynamoDB/Athena to manage lookup keys/brand lists and enable stakeholder self-service with controlled access.
Required to work from Company Office in Chicago IL certain days per week. Telecommuting allowed for balance of week.
Contact: In order to be considered for this position, please apply at: https://careers-direct-publicisgroupe.icims.com/jobs/177613/senior-data-engineer/job. Must reference job 6630.7950.6
Additional Information
When you join Epsilon, we’ll create something EPIC together. We’re a global leader in data and identity, with deep expertise in digital media, clean rooms, customer data platforms, loyalty and marketing services. Positioned at the center of Publicis Groupe, Epsilon helps brands deliver personalized experiences at scale and build lasting customer relationships by unlocking the full potential of data and identity. Epsilon operates in 30+ countries across EMEA, the Americas and APAC, with more than 8,000 employees.
Check out a few of these resources to learn more about what makes Epsilon so EPIC:
Our Culture: https://www.epsilon.com/us/about-us/our-culture-epsilon
Life at Epsilon: https://www.epsilon.com/us/about-us/epic-blog
Epsilon has five values that define our culture and guide us as we create value for our clients, our people and consumers. We seek candidates who align with our company values, demonstrate them and make them meaningful in their day-to-day work:
Act with integrity. We are transparent and have the courage to do the right thing.
Work together to win together. We believe collaboration is the catalyst that unlocks our full potential.
Innovate with purpose. We shape the market with big ideas that drive big outcomes.
Respect all voices. We embrace differences and foster a culture of connection and belonging.
Empower with accountability. We trust each other to own and deliver on common goals.
Because You Matter
As an Epsilon employee, you deserve perks and benefits that put you, your family and your finances first. Our benefits encompass a wide range of offerings, including but not limited to:
Time to recharge: Flexible time off (FTO), 14 paid holidays, paid sick time
Family well-being: Parental/new child leave, childcare & elder care assistance, adoption assistance
Extra perks: Comprehensive health coverage, 401(k), tuition assistance, commuter benefits, professional development, employee recognition, charitable donation matching, health coaching and counseling
Epsilon benefits are subject to eligibility requirements and ot...

About Publicis Groupe Holdings B.V

Information Services · 11-50 employees · headquartered in AMSTELVEEN