This is a remote position.
You will be working on NetOps data, specifically focused on Shipment, Customs Declaration, and Event data to enhance data quality for operational reporting. The data, primarily sourced in JSON format, is processed through Matillion and flattened into Snowflake tables. Your responsibilities include managing data quality checks, optimizing data pipelines, and supporting the onboarding of new countries into the DCM JSON data structure.
Key Responsibilities:
Manage and own the data pipeline for SDCM, ECM, and DCM, transforming JSON data into structured Snowflake tables.
Optimize data pipeline performance and resolve data quality issues.
Implement active monitoring and alerts for pipeline efficiency and data integrity.
Adapt the JSON flattening processes according to evolving business requirements.
Strong expertise in Data Engineering and hands-on experience with Snowflake.
Advanced Python skills, particularly in managing and flattening complex JSON structures.
Excellent SQL knowledge.
A proactive attitude with a willingness to adapt and learn within a dynamic project environment.
Experience with Matillion.
Familiarity with Agile methodologies.
Additional experience with Power BI.
M3 Wake Research
Close Brothers
Concentrix
Grupo TECDATA Engineering
Solita