Data Engineer

About this role

The Data Engineer is an integral part of the Information Technology Services department (ITS), reporting to the Director of Business Intelligence (BI). The role will be involved in efforts to ensure the accuracy, integrity, and security of data within the BI system that supports data processing and analysis needs.

Interaction with stakeholders such as data governance workgroups, machine learning engineers, integration data pipeline builders, and BI developers is a key aspect of the role. The role involves designing, building, and maintaining test pipelines, data transformation or systems performance logs, and metadata or data catalogs. The Data Engineer is responsible for ensuring accurate and complete data collection, per business requirements, KPIs, and SLAs or SLOs. Gaining a thorough understanding of the data maintained in the enterprise data warehouse is mandatory. Advocating for data quality across teams is essential.

This is a full-time role with at least two required days at the Excelsior home office in Albany, NY. The remaining days can be worked from home. The Data Engineer will play a significant role in shaping the data operations strategy and infrastructure of the University.

Duties and Responsibilities:

• Work with data analysts, data governance workgroups, and other stakeholders to understand their needs and translate them into technical requirements.
• Maintain a strong understanding of business workflows, processes, and events, and relate this understanding to how these are captured in transactional systems.
• Develop and implement strategies to ensure data is clean and reliable.
• Design and execute tests to validate data transformations, migrations, and storage within the data warehouse environment.
• Identify any errors or inconsistencies in the enterprise data warehouse.
• Write technical documentation and term definitions in the Data Governance Platform.
• Implement data governance and ensure data integrity across all BI initiatives.

Quali...