Data Engineer

About this role

Open Insights is a Global Data firm that specializes in strategizing and implementing Data-As-A-Service. Our Data Ninjas help organizations understand and generate value from their data, this leads to improved revenues whilst using open-source technologies reduces costs.


Open Insights operates across the world, with current operations in the United States, India, South Africa, Chile, United Kingdom, Middle East, and Europe. Open Insights was founded by Dr. Usama Fayyad to help change the world of Data and what it means for data to be an asset in an organization. Our team includes top experts in Analytics and Insights, Big Data Technology and Data Integration, Data Activation and Customer Retention and a team of data science and applied machine learning experts.


Open Insights is committed to providing all employees with engaging and challenging work, opportunity for growth, an equal voice to drive innovation, and an environment that cultivates authenticity. In return, we look for people who are inquisitive, enjoy solving complex problems, collaborate effectively, think creatively, and provide diverse insights to help us all think better and differently.


Responsibilities

• Understand a wide range of different types of data systems across the organization, including but not limited to SQL Server, Teradata, Azure SQL Data Warehouse and Snowflake environments
• Interpret data models both logical and physical
• Ingest data into data lake and data warehouses on technologies such as Snowflake, Teradata, and Azure Synapse
• Build scalable and reusable data cleansing algorithms
• Transform and merge data using data processing tools like Databricks, spark
• Understand, comply, and build security features (Encryption, masking, and tokenization) on data technology platforms
• Design simplified data access patterns for data consumers e.g. building API’s, enabling self-serve etc.
• Ensure continuous integration and continuous deployment practices are followe...