Lead Engineer, Big Data - Databricks/Power BI - Remote

About this role

JOB SUMMARY - Lead Data Engineer


A Lead Data Engineer collaborates with the Data Quality and Governance team to ensure data pipelines, data integrity, and compliance by defining data strategies, implementing Data Governance capabilities, creating self-service data assets, and integrating robust data quality and governance frameworks to support trustworthy AI solutions. Key responsibilities include designing scalable data architectures, establishing data quality standards and monitoring, managing data lineage, and ensuring adherence to regulatory requirements and privacy policies


KNOWLEDGE, SKILLS & ABILITIES (Occupational knowledge and specific technical and professional skills and abilities required to perform the essential duties of this job):


1. Data Quality & Governance Leadership


Define and enforce data quality standards, validation rules, and monitoring systems tailored to healthcare data.


Collaborate with data stewards, compliance officers, and business stakeholders to resolve data integrity issues and ensure consistent data across systems.


Develop and maintain metadata management, data dictionaries, and stewardship workflows.


2. Regulatory Compliance & Security


Ensure all data engineering practices align with healthcare regulations such as HIPAA, HITECH, and other privacy laws.


Implement data governance policies that support secure, ethical, and compliant data usage across the organization.


3. Data Architecture & Lifecycle Management


Design scalable data architectures that support healthcare analytics and AI/ML workflows.


Automate data lineage tracking, governance documentation, and audit trails to support transparency and traceability.


Establish data lifecycle policies for retention, archiving, and disposal in accordance with regulatory and operational requirements.


5. AI/ML Enablement


Collaborate with data scientists and ML engineers to ensure data pipelines meet mode...