Data Engineer (Data Bricks and AWS Cloud)

About this role

Description:

NOTE: This opportunity is open to W2, 1099 or C2C (no third parties, please). The candidate MUST be authorized to work in the U.S. without sponsorship and able to complete/pass/hold at minimum a public trust investigation. This is a remote opportunity; candidate must be based in the U.S.; have resided in the US for at least 3 years in the past 5 years; ET time zone work schedule.

Daily Responsibilities

• Play a critical role in ingesting, transforming, and managing data using AWS Cloud Services and Python Programming. Will work directly with senior data engineers o product owners to deliver data products in a collaborative and agile environment.
• Able to integrate code into a cloud production environment.
• Work with on-prem database and warehouse solutions such as Oracle or SQL Server or cloud based solutions.
• Collaborate on data engineering coding principles, standards, designs, frameworks, and chaos testing.
• Develop data engineering solutions using Python and/or Java.
• Seek to continuously develop deep AWS engineering skills that optimize code quality and performance.
• Build data pipelines and other custom automated solutions to speed the ingestion, analysis, and visualization of large volumes of data.
• Develop data transformation pipelines to clean, enrich, and structure the ingested data for storage in AWS Redshift platform services and storage services.
• Integrate data from disparate sources to enable seamless data access and analysis within the data management environment.
• Design and maintain data models within and implement data quality checks and validation processes to ensure data accuracy and integrity.
• Ensure data security and compliance with government regulations and industry standards.
• Optimize data pipelines and queries for efficient data processing and retrieval.
• Work closely with business analysts, data scientists, and other stakeholders to understand data requirements and deliver data solutions that mee...