Senior Data Engineer

About this role

About Company

EQAIM Technology & Services is hiring a Senior Data Engineer for an enterprise analytics and optimization project.

Senior Data Engineer

Location:
India

Experience:
8+ Years

Employment Type:
Full-time

Requirements

• Strong experience with Databricks, PySpark, and SQL
• Hands-on experience with CI/CD pipelines
• Experience with GitHub Actions or similar tools
• Experience with serverless architectures
• Ability to work independently and take ownership
• Understanding of pricing or financial data domains

Tech Stack

• Databricks
• PySpark
• SQL
• GitHub / GitHub Actions
• Serverless Compute Clusters

Roles & Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks and PySpark
• Optimize existing pipelines for serverless environments to ensure performance and stability
• Build, maintain, and enhance CI/CD workflows for automated deployment and monitoring
• Review code, manage repositories, and ensure best practices in data engineering
• Collaborate with business and technical teams to understand data requirements and workflows
• Monitor pipeline performance, troubleshoot issues, and implement improvements
• Take ownership of end-to-end data engineering processes and delivery activities