Databricks Data Engineer

About this role

E Source is seeking a Databricks Data Engineer to join the Machine Learning Engineering team. This role focuses on designing, building, and maintaining scalable, reliable, and secure data pipelines, infrastructure, and systems that support consulting services and software-as-a-service (SaaS) solutions.

You will work closely with machine learning engineers, software engineers, data scientists, and data analysts to deliver data products for clients and to support internal data practices.

E Source is a research, data/analytics, and technology focused professional services firm focused exclusively on the utility industry in the US and Canada. We help utilities target and serve their customers more effectively, enhance and optimize their grid, and leverage operating best practices and technologies to manage their business more effectively. Headquartered in Texas, we have 450+ employees across the US and Canada. Learn more at www.esource.com.

In this role, you will:

• Design, develop, and maintain data pipelines, infrastructure, and systems using AWS, Python, Databricks, Spark, and PostgreSQL
• Collaborate with cross-functional teams to translate business requirements into technical solutions
• Provide technical guidance and mentorship to junior data engineers
• Develop and implement data engineering standards and best practices
• Monitor and troubleshoot data pipelines to ensure data quality, integrity, and availability
• Research industry trends and evaluate new data technologies
• Build and maintain data lakes to support analytics and business intelligence
• Manage the software development life cycle and DevOps activities
• Partner with data scientists and analysts to deliver effective data solutions
• Develop data validation and data analysis tools

You’re likely a great fit if you:

• Bachelor’s degree in computer science, information technology, or a related field
• Five or more years of experience in data engineering or a related role
• Expert proficien...