Senior Data Engineer

About this role

Overview
We are seeking an energetic and highly skilled Senior Data Engineer to join our dynamic data team. In this pivotal role, you will lead the design, development, and optimization of scalable data pipelines and architectures that empower data-driven decision-making across the organization. Your expertise will drive innovation in managing large-scale datasets, ensuring seamless integration of diverse data sources, and enabling advanced analytics and modeling. If you thrive in a fast-paced environment and are passionate about transforming complex data into actionable insights, this opportunity is for you!

Responsibilities

• Architect, develop, and maintain robust data pipelines using tools such as Apache Spark, Hadoop, Talend, Informatica, and Shell Scripting to process large volumes of structured and unstructured data.
• Design and implement scalable data warehouses and lakes utilizing AWS, Azure Data Lake, and related cloud services to support analytical needs.
• Collaborate with cross-functional teams to gather requirements, translate business needs into technical solutions, and ensure data quality and integrity.
• Develop ETL processes for extracting, transforming, and loading data from various sources including Oracle, Microsoft SQL Server, and Linked Data platforms.
• Optimize database performance through effective schema design, indexing strategies, and query tuning using SQL, Python, Java, and VBA.
• Build dashboards and reports using Looker to visualize key metrics and support strategic decision-making.
• Participate in Agile development cycles by contributing to sprint planning, code reviews, documentation, and continuous improvement initiatives.

Requirements

• Proven experience as a Data Engineer working with Big Data technologies such as Hadoop, Spark, Hive, and related ecosystems.
• Strong proficiency in SQL programming with extensive experience in database design for Data Warehouses using Oracle or Microsoft SQL Server.
• Hands-on...