Data Engineer - Web Scraping (3 months contract)

Responsibilities

The Data Engineer will manage and maintain web scraping configurations using Python while monitoring for errors and potential blockages. They will also develop data pipelines to ingest and transform data into the Datalake while reporting activities to stakeholders.

Requirements

Candidates must have at least 2 years of experience in data engineering with strong expertise in ETL, SQL, NoSQL, and cloud platforms like Azure. Proficiency in Python, Airflow, DBT, and version control systems such as Git is required.

Skills

• Python
• Data Engineering
• ETL
• Data Modeling
• Data Warehousing
• Airflow
• DBT
• SQL
• NoSQL
• Azure
• Data Security
• Automation
• Git
• Terraform
• Web Scraping

About this role

We are growing! We are currently looking to hire a Data Engineer - Web Scraping to work with us remotely on a 3 months contract.
Who we are:
Founded in 2006, CXG is a global customer experience company uniquely positioned at the intersection of data-driven retail performance, customer experience transformation, and operational execution across 200+ luxury brands worldwide.
The mission of our 270 collaborators is to help brands transform customer and employee experiences through tailored insights, strategy, and implementation.
We are passionate about delivering impact.
Our clients include the world’s most admired luxury houses, and our solutions combine research, technology, and human expertise to elevate every customer interaction.
What you will be doing:
Maintain and manage website scraping configurations using Python.
Monitor scraping configurations for errors and potential crashes.
Oversee retrieved data to detect potential issues and blockages.
Coordinate with stakeholders to understand scraping task requirements and report issues.
Prepare and share periodic reports on scraping activities with stakeholders.
Develop necessary pipelines to ingest data into the Datalake and perform required transformations.
What you will bring along:
Proven experience in data engineering with expertise in designing and implementing scalable data architectures.
Strong experience with ETL processes, data modeling, and data warehousing (Airflow & DBT preferred).
Expertise in database technologies, both relational (SQL) and NoSQL.
Knowledge of cloud platforms, particularly Azure.
Solid understanding of data security measures and compliance standards.
Excellent Python experience for data engineering and automation.
Strong collaboration skills to work closely with data scientists and analysts.
Ability to optimize data pipelines for performance and efficiency.
Ability to build, test, and maintain tasks and projects.
Experience with version control systems, such as Git.
Hands-on experience with Airflow and/or DBT.
Experience with Terraform for infrastructure management.
Minimum 2 years of experience in a similar role.
Strong academic background in a relevant field.
Fluent in English (French is a plus).

About CXG

Business Consulting and Services · 201-500 employees · headquartered in Dubai, Dubai · founded 2006