Senior Data Engineer | DIUK-DIA-SDE-LO-0041

Responsibilities

You will be responsible for conceptualizing and building optimal data pipeline architectures while modernizing existing data environments for clients. Additionally, you will assist the sales team with pre-sales activities and collaborate with stakeholders to provide actionable insights through advanced analytics tools.

Requirements

The role requires a minimum of 5 years of experience in data engineering with advanced SQL knowledge and proficiency in relational databases. Candidates should have experience with Lakehouse architecture, cloud platforms like Azure, AWS, or GCP, and hold a relevant bachelor's degree.

Skills

• SQL
• Data Engineering
• Data Pipelines
• Lakehouse Architecture
• Microsoft Technologies
• Databricks
• Snowflake
• Azure
• AWS
• GCP
• Power BI
• Data Modeling
• Project Management
• Root Cause Analysis
• Data Transformation
• Cloud Infrastructure

About this role

We are seeking a dynamic and experienced Senior Consultant to join our Data, Information, and Analytics team. This is a client-facing, permanent position, ideal for someone passionate about data, technology solutions, and leading project teams to deliver successful business outcomes. The role offers exposure to a variety of industries, requiring a quick grasp of new business environments.
Who are we?
Decision Inc. is a global management and technology consulting organization. We help companies become Data Driven Businesses that are fit to take on the challenges of a digital world. Transforming their current operations and developing their new business platforms to scale innovation into the future. Our experience in leading technology and industry specialisations have enabled us to help companies to make better decisions, faster. We represent the leading technology brands and are experts in the implementation, support and execution of these technologies.
What Will You Do?
Key Responsibility:
You will be assigned a portfolio of project to:
Engage with clients to conceptualize data solutions
Modernising existing data environment
Assisting our sales team with Pre-Sales and POC’s
Create and maintain optimal data pipeline architecture
Assisting clients getting their data platforms AI ready
Assemble large, complex data sets that meet functional / non-functional business requirements
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Microsoft, Azure, Databricks, Snowflake, AWS, GCP, technologies etc.
Build analytics tools that utilise the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics
Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs
Work with data and analytics experts to strive for greater functionality in our data systems
Assists support desk where applicable.
Who do you need to be:
Minimum 5 years working experience in data engineering
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
Experience building data workloads and modelling in a Lakehouse Architecture (Medallion)
Experience building and optimising data pipelines, architectures, and data structures utilising Microsoft technologies
Knowledge and experience in data platforms such as Databricks and/or Snowflake is advantageous
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
Strong analytic skills related to working with unstructured datasets
Familiarity with data visualisation in Microsoft Power BI
Build processes supporting data transformation, data structures, metadata, dependency and workload management
A successful history of manipulating, processing and extracting value from large, disconnected datasets
Strong project management and organizational skills
Experience supporting and working with cross-functional teams in a dynamic environment
Familiarity with Finance concepts and data is advantageous
Qualifications
Bachelors degree in Computer Science, Information Systems, Information Technology, or related field.
Masters degree in a relevant field is advantageous.
Microsoft Certifications (Advantageous)
PL-300 – Power BI Data Analyst Associate
DP-600 – Fabric Analytics Engineer Associate
DP-700 – Fabric Data Engineer Associate
Databricks Certified Data Engineer Associate

About Decision Inc

Business Consulting and Services · 51-200 employees · headquartered in Sydney, NSW · founded 2013