Data Engineer (Python)

Responsibilities

The Data Engineer will lead the development and optimization of data transformation pipelines using Dataform to create reliable, high-quality datasets. They are also responsible for conducting exploratory data analysis and writing performant SQL to support business intelligence reporting.

Requirements

Candidates must have expert-level mastery of Google BigQuery, Dataform, and Kimball dimensional modeling principles. Proficiency in advanced SQL and experience with version control systems like Git are also required.

Skills

• Google BigQuery
• Dataform
• Python
• SQL
• Kimball Methodology
• Data Modeling
• Data Warehousing
• Exploratory Data Analysis
• Git
• Business Intelligence
• Looker
• Tableau
• Power BI
• BigQuery ML
• Data Transformation

About this role

Overview
We are seeking a highly skilled Data Engineer to own the transformation and modeling layers of a new data warehouse project. This role is centered around an expert-level mastery of Google BigQuery (including Dataform). You will be responsible for taking raw data and architecting clean, reliable, and performant data models by applying Kimball methodology principles to power business intelligence and analytics. Your expertise in building sophisticated, scalable transformation pipelines with Dataform will be vital in transforming complex datasets into actionable insights and ensuring the analytical integrity of our dimensional data warehouse.
Responsibilities
Lead the development, maintenance, and optimization of the entire data transformation lifecycle using Dataform to produce high-quality, trusted datasets.
Build and manage scalable, well-documented, and tested data transformation pipelines that are critical for business reporting.
Conduct Exploratory Data Analysis (EDA) on new and existing datasets to identify quality issues, understand data structures, and unlock business value.Write highly performant BigQuery SQL for complex queries, aggregations, and data manipulation, with a focus on cost and speed optimization.
Implement rigorous data quality and validation checks within the transformation process to ensure accuracy and trust in our reporting datasets.
Qualifications
Kimball Methodology: Demonstrable, in-depth experience designing and building dimensional data warehouses using Kimball's principles.
Dataform Expertise: Mastery of Dataform for developing, testing, and deploying complex SQL-based data transformation workflows in a production environment.
Expert-Level SQL: Demonstrable mastery of advanced SQL, including window functions, CTEs, and complex joins.
Google BigQuery: Deep, hands-on experience with BigQuery, including performance tuning, cost optimization, and partitioning/clustering.
Database Schema Concepts: Strong, practical knowledge of data warehousing schemas (Star Schema, Snowflake Schema, Data Marts).
Exploratory Data Analysis (EDA): Ability to analyze and profile datasets to derive insights and assess quality.
Business Intelligence (BI) Tool Integration: Experience preparing data for consumption by BI tools like Looker, Tableau, or Power BI.
BigQuery ML (BQML): Experience with building and deploying machine learning models using BQML is a significant plus.
Version Control (Git): Proficiency in using Git for managing SQL and Dataform code.
Required Skills
Google BigQuery (2), Python (4), Gemini Enterprise (1), Artificial Intelligence (AI) (1)
Years of Experience Needed
4