Data Engineer Advisor

About this role

The Data Engineer Advisor plays a pivotal role within FedEx, focused on creating and driving engineering innovation within Dataworks, helping define and build the organization and facilitate the delivery of key business initiatives. S/he acts as a “universal translator” between IT, business, software engineers and data scientists, collaborating with these multi-disciplinary teams. The Data Engineer Advisor will contribute to the creation of and adherence to technical standards for data engineering, including the selection and refinements of foundational technical components. S/he will work on those aspects of the platform that govern the ingestion, transformation, and pipelining of data assets, both to end users within FedEx and into data products and services that may be externally facing. Day-to-day, s/he will be deeply involved in code reviews and large-scale deployments. Under minimal supervision, supports the design, build, test and maintain data pipelines at big data scale. Assists with updating data from multiple data sources. Other functionalities under close supervision is to work on batch processing of collected data and match its format to the stored data, make sure that the data is ready to be processed and analyzed. Assists with keeping the ecosystem and the pipeline optimized and efficient, troubleshooting standard performance, data related problems and provide L3 support. Independently implements parsers, validators, transformers and correlators to reformat, update and enhance the data. Provides recommendations to highly complex problems. Provides guidance to those in less senior positions.


Essential Functions

• Advanced Data Pipeline Engineering: Design, build, and deploy highly scalable, fault-tolerant batch and real-time streaming data pipelines utilizing core GCP services such as Dataflow, Dataproc, Confluent Kafka and Pub/Sub.
• BigQuery & Data Warehouse Optimization: Develop complex ELT/ETL workflows and implement efficient physical d...