Offer summary

Qualifications:

Bachelor's degree in Computer Science, Engineering, or a related field., Experience with GCP, BigQuery, and ETL processes., Proficiency in programming languages such as Python and familiarity with tools like Spark and Airflow., Strong analytical skills and a consultant mindset to guide clients through data projects..

Key responsibilities:

Design, develop, and maintain scalable data pipelines and ETL processes in GCP.

Collaborate with BI teams to create semantic models and visualizations in Looker.

Build orchestrated workflows for reliable data processing and manage data sources using ETL tools.

Contribute to data architecture and collaborate with teams to align data solutions with business needs.

Job description

Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. We partner with top-tier global enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. Our exclusive focus on AI and Big Data has earned us recognition by Forbes as one of the top 10 AI consulting companies.

As a Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging cutting-edge technologies. Here are some of the projects we are seeking talented individuals to join:

Building and development of a modern data warehouse for the US retail industry, enabling the client to make data-driven decisions and build foundations for future AI features. This role will require a consultant mindset to help and guide the client through the product's roadmap.
Development of an operational warehouse for a big automotive client supporting near real-time processing and building foundations for integrating AI into their business processes.
Development and maintenance of a large platform for processing automotive data. A significant amount of data is processed in both streaming and batch modes. The technology stack includes Spark, Cloudera, Airflow, Iceberg, Python, and AWS.

🚀 Your main responsibilities:

Design, develop, and maintain scalable data pipelines and ETL processes in GCP.
Collaborate with BI teams to develop semantic models and visualizations in Looker and Looker Studio.
Work with infrastructure as code using Terraform and Terragrunt.
Build orchestrated workflows with Dagster for reliable and repeatable data processing.
Integrate and manage data sources via Airbyte or similar ETL tools.
Optimize and maintain BigQuery datasets and compute resources.
Ensure high-quality data through testing, monitoring, and CI/CD using GitHub Actions.
Contribute to overall data architecture, best practices, and documentation.
Collaborate with cross-functional teams to understand business needs and translate them into effective data solutions that align with reporting and strategic goals.

Required profile