Data Engineer – Airflow / SQL/Snowflake / Python

Responsibilities

Design, build, and maintain complex, production-grade data pipelines using Apache Airflow. Manage end-to-end data ingestion, transformation, monitoring, and performance tuning while collaborating with stakeholders.

Requirements

Requires a degree in Computer Science or related field with 5-7 years of practical engineering experience. Candidates must possess strong proficiency in Python, SQL, and data pipeline orchestration.

Skills

• Apache Airflow
• Python
• SQL
• Snowflake
• Data pipelines
• DAGs
• Data modeling
• Query optimization
• Error handling
• CI/CD
• Git
• Pandas
• PySpark
• Data quality
• API integration
• Performance tuning

Benefits

• Inclusive workplace
• Growth opportunities
• Well-being prioritization

About this role

We are looking for a hands-on Data Engineer who can independently design, build
and operate production-grade data pipelines using Apache Airflow. This is a
delivery-facing engineering role: you will own complex, multi-dependency DAGs
end to end from ingestion and transformation logic through to scheduling,
monitoring, failure recovery and performance tuning.

The ideal candidate writes production-quality Python, is genuinely strong in SQL
(including analytical functions, complex joins and query optimization), and has
debugged enough real pipeline failures to have opinions about idempotency,
backfills and retry strategy. You will work closely with data architects,
analysts and business stakeholders, and will be expected to raise the
engineering standard of the pipelines you touch.

RESPONSIBILITIES

Orchestration & Pipeline Engineering

* Design, develop and maintain complex Airflow DAGs involving multi-stage
dependencies, dynamic task generation, branching, sensors, task groups and
cross-DAG triggers.

* Build pipelines that are idempotent, restart able and backfill-safe, with
correct handling of scheduling intervals, catchup behavior, data intervals
and time zones.

* Implement robust error handling and recovery -retries with backoff, SLAs,
alerting, callbacks, dead-letter handling and clean partial-failure
semantics.

* Develop reusable components: custom operators, hooks, sensors and DAG factory
patterns that reduce duplication across the codebase.

* Manage Airflow configuration properly - connections, variables, pools,
priority weights, queues and concurrency/parallelism controls.

SQL Development

* Write and optimize complex SQL - multi-table joins, CTEs, window/analytical
functions, incremental and merge/upsert logic, slowly changing dimensions.

* Tune query performance: read execution plans, correct inefficient joins and
predicates, and apply appropriate partitioning, clustering and indexing
strategies.

* Implement data quality and reconciliation checks - row counts, null/duplicate
checks, referential integrity and business rule validations as first-class
pipeline steps.

* Contribute to dimensional and analytical data model design (star/snowflake
schemas, fact and dimension design, grain definition).

Python Development

* Write clean, modular, testable Python following sound engineering practice -
packaging, configuration management, logging, exception handling and type
hints.

* Build ingestion and transformation utilities: REST/SOAP API integrations,
pagination and rate-limit handling, file parsing (CSV, JSON, Parquet, XML)
and data frame processing (pandas / PySpark).

* Write unit and integration tests for pipeline logic, including DAG integrity
tests, and participate in code reviews.

Operations, Quality & Collaboration

* Monitor and support production pipelines - triage failures, perform root
cause analysis, drive permanent fixes, and reduce recurring incidents.

* Work within CI/CD practice: Git-based workflows, branching strategy,
automated deployment of DAGs, and environment promotion (Dev → QA → Prod).

* Translate requirements from analysts and business stakeholders into technical
designs, and document DAG logic, data lineage and operational runbooks.

QUALIFICATIONS

* B.E. / B.Tech / MCA / M.Sc. in Computer Science, Information Technology or a
related discipline.

* Equivalent practical experience will be considered for candidates with a
demonstrable engineering track record.

At Zensar, we’re “experience-led everything”. We are committed to
conceptualizing, designing, engineering, marketing, and managing digital
solutions and experiences for over 130 leading enterprises. We are a company
driven by a bold purpose: Together, we shape experiences for better futures.
Whether for our clients, our people, or the world around us, this belief powers
everything we do. At the heart of our culture is ONE with Client - a set of four
core values that reflect who we are and how we work: One Zensar, Nurturing,
Empowering, and Client Focus.

Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators
across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town,
London, Zurich, Singapore, and Mexico City. Explore Life at Zensar
[https://www.zensar.com/careers/] and join us to Grow. Own. Achieve. Learn.
[https://www.youtube.com/embed/i2NZsiQqVnU?autoplay=1&fs=1] to be the best
version of yourself.

We believe the best work happens when individuality is celebrated, growth is
encouraged, and well-being is prioritized. We are an equal employment
opportunity (EEO) and affirmative action employer, committed to creating an
inclusive workplace. All qualified applicants will be considered without regard
to race, creed, color, ancestry, religion, sex, national origin, citizenship,
age, sexual orientation, gender identity, disability, marital status, family
medical leave status, or protected veteran status.

About Zensar

IT Services and IT Consulting · 10,001+ employees · headquartered in Pune, Maharashtra · founded 2001