REMOTE Data Engineer in MN

About this role

Lensa is a career site that helps job seekers find great jobs in the US. We are not a staffing firm or agency. Lensa does not hire directly for these jobs, but promotes jobs on LinkedIn on behalf of its direct clients, recruitment ad agencies, and marketing partners. Lensa partners with DirectEmployers to promote this job for Insight Global. Clicking "Apply Now" or "Read more" on Lensa redirects you to the job board/employer site. Any information collected there is subject to their terms and privacy notice.


Job Description
Insight Global is seeking 2 Sr. Data Engineers to join a Personal Campaign Operations team. This is a very known, visible and well-funded team bringing in millions of $s for the company. This team supports the entire enterprise (care delivery and health plan marketing), and works in a collaborative, cross-functional environment with both developers and campaign owners. This person must be flexible as they will be working with different people on different campaigns at one time, and have to pivot according to changing priorities.


This Person Will Overall Be Responsible To
 

• Design, develop, and implement end-to-end data solutions using Azure Databricks.

• Convert current SQL to Python code in Databricks.

• Modify and maintain data pipelines.

  ○ Write, test, and optimize PySpark and SQL scripts to transform and load high volumes of structured data.


  ○ Update or maintain existing data pipelines in a production setting.


 

• Ensure data quality and integrity by implementing data validation and cleansing processes.

• Demonstrate strong verbal communication and critical thinking skills, working well within a team environment and not being afraid to speak up.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone m...