Senior Data Engineer

Responsibilities

The Senior Data Engineer will design, build, and maintain scalable data platforms using Microsoft Fabric and Azure Databricks to support enterprise analytics. This role involves managing end-to-end data pipelines, performing migrations, and ensuring data quality and governance across the organization.

Requirements

Candidates must have 7-10+ years of professional experience in data engineering and a bachelor's degree in a relevant field. Deep expertise in the Microsoft data stack, including Fabric, Azure Databricks, and Power BI, is required.

Skills

• Microsoft Fabric
• Azure Databricks
• Data engineering
• Data architecture
• SQL
• Python
• Spark
• Power BI
• Azure Data Lake
• Azure Synapse
• Data modeling
• ETL/ELT
• CI/CD
• Azure DevOps
• Data governance
• Lakehouse architecture

Benefits

• Medical insurance
• Dental insurance
• Vision insurance
• 401k plan with employer match
• Flexible spending accounts
• Dependent care accounts
• Employee assistance program
• Calm subscription
• Mental health benefits
• Life insurance
• AD&D insurance
• Disability insurance
• Paid vacation
• Paid federal holidays
• Paid volunteer time off
• Online discount program
• Tuition reimbursement program

About this role

Senior Data Engineer

Location: United States
Job Type: Full-Time | Exempt | Hybrid/Remote Eligible
Salary Range: $135,000 – $170,000 per year

About Commercial Bank of California

Commercial Bank of California (CBC) is the largest Latino-owned bank in California and a certified Minority Depository Institution (MDI). Headquartered in Irvine and founded in 2003, CBC is one of the largest privately held banks in the state, with over $4 billion in assets as of November 2026.

We are a purpose-driven financial institution committed to building long-term relationships and delivering innovative, personalized banking solutions. Our leadership reflects the diverse communities we serve, and our mission is rooted in empowering entrepreneurs, business owners, and community leaders to thrive.

As a certified MDI, CBC is proud to play a vital role in advancing financial inclusion and economic opportunity. We believe in a higher vision for banking—one that prioritizes trust, collaboration, and community impact. Join us and be part of a team that’s redefining what it means to be a community-focused, relationship-driven bank that puts people over profits. 

Job Summary

The Senior Data Engineer is responsible for designing, building, and operating scalable, secure data platforms that power enterprise analytics, reporting, and advanced data use cases, including financial services and payments data. With 7-10+ years of hands-on data engineering experience, this role serves as a data engineer who can wear an architect hat, owning end-to-end data pipelines, data models, and analytical data stores across the Azure ecosystem.

You will lead the implementation of Microsoft Fabric, Azure Databricks, and modern lakehouse architectures, including the migration of Databricks workloads to Microsoft Fabric where it makes sense, while partnering closely with business intelligence, analytics, AI, and business stakeholders. This role emphasizes data reliability, governance, and performance at scale, supporting both operational and strategic decision-making.

Essential Duties and Responsibilities

Data Platform & Architecture

* Design, build, and maintain enterprise-grade data platforms using Microsoft Fabric, Azure Data Lake, Azure Synapse, and Azure Databricks.
* Architect and implement lakehouse and medallion architectures (Bronze/Silver/Gold) to support analytics and BI workloads.
* Define standards for data ingestion, transformation, storage, and access across structured and semi-structured data sources.
* Plan and execute Databricks-to-Fabric migrations, including workload assessment, Delta/OneLake data movement, notebook and pipeline conversion, semantic model re-pointing, validation, and cutover.

Data Engineering & Pipelines

* Develop and optimize batch and streaming data pipelines using Databricks, Fabric Data Pipelines, and Azure-native services.
* Implement robust ETL/ELT processes, ensuring data quality, accuracy, and consistency across systems.
* Monitor, tune, and optimize data pipelines for performance, scalability, and cost efficiency.
* Integrate and model data from FIS core banking and H360 systems into the lakehouse for analytics and reporting.
* Build and support data pipelines for payments data (e.g., ACH, wire, card, and real-time payments), including ingestion, reconciliation, and reporting.

Data Modeling & Analytics Enablement

* Design and maintain logical and physical data models optimized for analytics, reporting, and downstream consumption.
* Build semantic models and curated datasets to support Power BI and enterprise Business Intelligence use cases.
* Partner with BI developers, analysts, and business stakeholders to translate reporting requirements into scalable data solutions.

DevOps, CI/CD & Reliability

* Implement and manage CI/CD pipelines using Azure DevOps for data engineering workloads.
* Enforce best practices for source control, automated testing, deployment, and environment management.
* Ensure high availability, fault tolerance, and operational excellence for production data systems.

Governance, Security & Compliance

* Implement data governance, security, and access controls, including role-based access and data classification.
* Ensure compliance with enterprise data policies and regulatory requirements.
* Collaborate with security and infrastructure teams to enforce secure data handling and platform standards.

Data Quality Support

* Validate daily, weekly, and monthly data loads.
* Investigate data mismatches.
* Reconcile source-to-target records.
* Validate business-critical reporting datasets.
* Verify completeness, accuracy, and timeliness of data

Leadership & Collaboration

* Serve as a senior technical mentor for data engineers and analytics teams.
* Provide architectural guidance, code reviews, and best-practice leadership across data initiatives.
* Act as a trusted partner to business, analytics, and AI teams to enable data-driven decision making.

Minimum Qualifications

* 7-10+ years of professional experience in data engineering, data platform development, or analytics engineering.
* Bachelor's degree in Computer Science, Engineering, Information Systems, or related field 
* Deep hands-on experience with:
* Microsoft Fabric (Lakehouse, Data Pipelines, OneLake, Semantic Models)
* Azure Databricks (Spark, Delta Lake, performance tuning)
* Data modeling for analytics and BI 
* Azure DevOps (CI/CD, Git, automated deployments)
* Business Intelligence platforms, especially Power BI
* Microsoft expertise across the data and analytics stack (Fabric, Azure Data Lake, Synapse, Power BI, Microsoft Purview, Entra ID).
* Databricks expertise (Unity Catalog, Delta Live Tables / Lakeflow, Databricks Workflows, cluster and cost optimization).
* Advanced proficiency in SQL and strong experience with Python or Spark-based development.
* Proven experience building and supporting production-grade data pipelines at scale.

Benefit...

About Commercial Bank of California

Banking · 201-500 employees · headquartered in Irvine, CA · founded 2003