Data Engineer III

Responsibilities

The Data Engineer III is responsible for developing, expanding, and optimizing data pipeline architecture and ETL processes to support cross-functional teams. They will build infrastructure for data extraction, transformation, and loading while providing actionable insights through analytical tools and data strategy recommendations.

Requirements

Candidates must have at least 8 years of experience in data engineering or software development, including 4 years with Python, Java, and cloud technologies. A bachelor's degree in a technical field is required, or 10 years of relevant IT experience, along with the ability to pass a U.S. Federal Government public trust clearance.

Skills

• Python
• Java
• Scala
• AWS
• SQL
• Spark
• Hadoop
• Apache Airflow
• Redshift
• Databricks
• Data engineering
• ETL
• Data pipeline architecture
• Agile methodology
• CI/CD
• Data governance

Benefits

• Medical coverage
• Dental coverage
• Vision coverage
• 401(k) retirement benefits
• Paid time off
• Paid holidays
• Life insurance
• Disability insurance
• Wellness programs

About this role

Description
About Us:
eSimplicity is a modern digital services company that partners with government agencies to improve the lives and protect the well-being of all Americans, from veterans and service members to children, families, and seniors. Our engineers, designers, and strategists cut through complexity to create intuitive products and services that equip federal agencies with solutions to courageously transform today for a better tomorrow.

Responsibilities:
Responsible for developing, expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.
Support software developers, database architects, data analysts and data scientists on data initiatives and ensure optimal data delivery architecture is consistent throughout ongoing projects.
Creates new pipeline and maintains existing pipeline, updates Extract, Transform, Load (ETL) process, creates new ETL feature , builds PoCs with Redshift Spectrum, Databricks, AWS EMR, SageMaker, etc.;
Implements, with support of project data specialists, large dataset engineering: data augmentation, data quality analysis, data analytics (anomalies and trends), data profiling, data algorithms, and (measure/develop) data maturity models and develop data strategy recommendations.
Operate large-scale data processing pipelines and resolve business and technical issues pertaining to the processing and data quality.
Assemble large, complex sets of data that meet non-functional and functional business requirements
Identify, design, and implement internal process improvements including re-designing data infrastructure for greater scalability, optimizing data delivery, and automating manual processes
Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies
Building analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition?
Working with stakeholders including data, design, product and government stakeholders and assisting them with data-related technical issues
Write unit and integration tests for all data processing code.
Work with DevOps engineers on CI, CD, and IaC.
Read specs and translate them into code and design documents.
Perform code reviews and develop processes for improving code quality.
Perform other duties as assigned.
Requirements
Required Qualifications:
All candidates must pass public trust clearance through the U.S. Federal Government. This requires candidates to either be U.S. citizens or pass clearance through the Foreign National Government System which will require that candidates have lived within the United States for at least 3 out of the previous 5 years, have a valid and non-expired passport from their country of birth and appropriate VISA/work permit documentation.
Minimum of 8 years of experience as a Data Engineer or in hands-on software development, including at least 4 years using Python, Java, and cloud technologies for building and maintaining data pipelines.
Bachelor’s degree in Computer Science, Information Systems, Engineering, Business, or a related scientific or technical discipline required; OR
In lieu of a degree, candidates may qualify with 10 years of general information technology experience, including at least 8 years of specialized experience.
Experience designing data architecture for shared services, scalability, and performance
Experience designing data services including API, meta data, and data catalogue.
Experience in data governance process to ingest (batch, stream), curate, and share data with upstream and downstream data users.
Excellent analytic skills associated with working on unstructured datasets
Experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.
Ability to work in a fast-paced, team-oriented environment.
Experience with Agile methodology, using test-driven development.
Experience with GitHub and Atlassian Jira/Confluence.
Excellent command of written and spoken English.
Desired Qualifications:
Federal Government contracting work experience.
Databricks Certification, Google’s Certified Professional-Data-Engineer certification, IBM Certified Data Engineer – Big Data certification, CCP Data Engineer for Cloudera
Centers for Medicare and Medicaid Services (CMS) or Health Care Industry experience
Experience with healthcare quality data including Medicaid and CHIP provider data, beneficiary data, claims data, and quality measure data.
Working Environment:
eSimplicity supports a remote work environment operating within the Eastern time zone so we can work with and respond to our government clients. Expected hours are 9:00 AM to 5:00 PM Eastern unless otherwise directed by manager.

Occasional travel for training and project meetings. It is estimated to be less than 5% per year.

Benefits:
eSimplicity offers a comprehensive benefits package, including medical, dental, and vision coverage, 401(k) retirement benefits, paid time off, paid holidays, life and disability insurance, and additional wellness and employee support programs. Eligibility may vary based on employment status and applicable plan terms.

Reasonable Accommodation:
eSimplicity is committed to providing reasonable accommodations to qualified individuals with disabilities during the application and hiring process. Applicants who need assistance or an accommodation should contact Human Resources.
Equal Employment Opportunity:
eSimplicity is an Equal Opportunity Employer, including disability and pr...

About eSimplicity

IT Services and IT Consulting · 201-500 employees · headquartered in Silver Spring, Maryland · founded 2016