Offer summary

Qualifications:

Proven experience with Microsoft Fabric and its components like Data Pipelines and Lakehouses., Strong proficiency in programming languages such as Python and SQL for data manipulation., Experience in designing and implementing ETL/ELT processes with large datasets., Familiarity with Microsoft Power BI and processing semi-structured data..

Key responsabilities:

Design, develop, and maintain scalable data pipelines for the project.

Convert large Excel datasets into refined data subsets for reporting.

Develop ETL/ELT processes to ensure data quality and consistency.

Monitor and optimize data processing workflows for performance and reliability.

Job description

Our Client is one of the TOP-5 global management consulting firms considered to be among the most prestigious ones in the world. Hundreds of customers from Fortune-500, including the largest global financial institutions, the world’s top media companies, technology companies and federal government agencies rely on our Client’s proven platform and services.

Project Description: This proprietary platform enhances interactions with external network service providers, allowing consultants to find and interview industry experts for research. The platform offers features such as querying vendors, reading transcripts from past calls, expert discovery, scheduling, conducting calls, and browsing current project transcripts. It aims to provide faster, higher quality insights in a secure environment.

Stack on the project: Python, SQL, AWS/Azure

Requirements:

Proven experience with Microsoft Fabric, including components such as Data Pipelines, Lakehouses, Notebooks, and Dataflows.
Strong proficiency in programming languages (e.g., Python, SQL) and data manipulation.
Proficiency with Microsoft Power BI and integration with Microsoft Fabric
Experience designing and implementing ETL/ELT processes with large, complex datasets.
Familiarity with Excel file formats and techniques for processing semi-structured data.

Responsibilities:

Design, develop, and maintain scalable data pipelines within the project.
Convert large Excel-based datasets into multiple, refined data subsets for analytical and business reporting purposes.
Develop ETL/ELT processes ensuring data quality, consistency, and lineage.
Work on scaling project's components to support growing data volumes and performance requirements.
Monitor, troubleshoot, and optimize the data processing workflows to ensure high performance and reliability.
Recommend and implement best practices for data pipeline design within a cloud environment.

English: Upper-Intermediate+

Locations: Poland

Required profile