Data Engineer

About this role

We're hiring on behalf of a Haystack partner!

The Role

• Lead and mentor data engineering tech leads across multiple build teams utilizing Databricks and a data engineering Center of Excellence.

• Guide teams through the full software development lifecycle, ensuring adherence to best practices and elevation of engineering maturity.

• Oversee the implementation of Databricks to replace legacy analytical platforms, driving new and better business outcomes.

• Drive Spark performance optimization and lead platform cost optimization initiatives within the Databricks environment.

• Manage production monitoring, troubleshooting, and defect resolution for data pipelines and analytical solutions.

• Expand expertise into AI, ML, Lakehouse, and other Databricks capabilities for their implementation.

What You'll Need

• 3-5 years of hands-on Databricks experience including data governance, reporting, and source system technologies.

• Proven experience in a Tech Lead role, with a track record of leading developers and distributing work effectively.

• Strong communication skills for mentoring, influencing, and aligning cross-functional stakeholders.

• Ability to proactively engage with business leaders to recommend strategic data solutions and support self-service capabilities.

• Solid understanding of general analytics, data warehousing, and modern data engineering practices.

• Experience working within Agile frameworks and writing high-quality user stories.

What's On Offer

• Competitive compensation package with a target incentive earning opportunity of 15% of base compensation.

• Comprehensive healthcare coverage and multiple 401(k) savings plan options.

• Generous paid time off, including holidays, volunteer time off, and paid family leave.

• Robust tuition reimbursement, student loan repayment, and training support.

Apply via Haystack today!