Senior Data Engineer

About this role

*This role does not support C2C engagements or visa sponsorship.*

Role: Senior Data Engineer

Location: United States - Must live in USA now

Office: Fully remote

Salary: $150,000-170,000

Benefits: Medical, Dental, 401K

*This role does not support C2C engagements or visa sponsorship.*

Requirements: Coding Assessment and final onsite interview

*This role does not support C2C engagements or visa sponsorship.*

As a Senior Data Engineer, you will be working on our data systems and services with other data engineers to deliver projects and systems critical to Platform Ventures business. We expect our data engineers to be versatile, display leadership qualities and be enthusiastic about taking on new problems across our businesses as we continue to build great things for our customers.

Job Description

The candidate will design and develop data pipelines, data marts, and schemas to support our data warehousing environments and analytical requirements

Data Platform & Architecture

• Design and implement scalable data Lakehouse architectures using AWS S3, Delta Lake, and Redshift.
• Build and maintain high-performance data pipelines to ingest, transform, and curate large datasets.
• Define best practices for data modeling, partitioning, and storage optimization in a Lakehouse/medallion environment.
• Develop and maintain data cataloging and metadata management solutions.

Data Engineering & Processing

• Develop ETL/ELT pipelines using Python, PySpark, and AWS Glue.
• Build robust batch and streaming data pipelines.
• Implement transformation workflows using DBT.
• Optimize performance for Spark workloads and Redshift queries.

Workflow Orchestration

• Design and maintain workflow orchestration using Apache Airflow.
• Monitor pipeline performance and implement alerting and failure recovery.

Data Governance & Quality

• Implement data validation, lineage, and monitoring frameworks.
• Maintain data documentation and data catalog inte...