Senior Data Engineer - W2 only

About this role

Dice is the leading career destination for tech experts at every stage of their careers. Our client, Apidel Technologies, is seeking the following. Apply via Dice today!


*The second round interview will be an In-person Interview in Philadelphia, PA location.*
*MUST HAVE Experience working with FAANG, Hi-Tech or BIG4 companies.*
Job Description:
Team Info: Development of migration and Data warehousing components in the Data Engineering team in support of Salesforce Phase 2.


Areas of work:
The Senior Data Engineer will focus on high-impact activities to drive the Salesforce Phase 2 forward and support long-term success of the project.


Primary responsibilities and areas of work includes:
Development of ETL jobs bringing Data into Databricks, Data Migration and Integration between Salesforce and Databricks and Pipeline development (Mulesoft work), Documentation, Testing and Quality Assurance, Post-Delivery Support, Risk Mitigation/ address SPOF.


Work with the team to understand requirements and turn them into working data pipelines.


Build, test, and maintain pipelines on AWS + Databricks.


Use Terraform to spin up and manage infrastructure.


Set up and run CI/CD pipelines (Concourse or GitHub Actions) so our deployments are smooth and repeatable.


Troubleshoot issues, fix things quickly, and keep pipelines running reliably.


Collaborate with other engineers to share knowledge and improve best practices.


Required Skills & Qualifications:
7 9 years of experience in data engineering / data integration projects.


Strong hands-on experience with Python for ETL and data processing.


Mandatory expertise in Apache Spark and PySpark.


Proven experience working with Databricks.


Solid understanding of ETL processes, data pipelines, and data migration.


Experience handling large-scale data in distributed systems.