Offer summary

Qualifications:

Proficiency in Talend and data workflow development., Strong knowledge of SQL, including both basic and advanced skills., Experience with data engineering tools such as HDFS, Spark, and AWS., Excellent communication skills and a customer-centric mindset..

Key responsabilities:

Design and optimize data workflows using Talend for Campaign Data Management.

Collaborate with data architects and SQL engineers to gather requirements.

Develop and maintain data pipelines for efficient processing and scheduling.

Identify and resolve issues in data workflows, ensuring data accuracy and reliability.

Job description

About Brillio:

Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their capacity to seamlessly integrate cutting-edge digital and design thinking skills with an unwavering dedication to client satisfaction.

Brillio takes pride in its status as an employer of choice, consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary, groundbreaking technologies, and exclusive digital projects. Brillio's relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work® certification year after year.

Senior Lead Data Engineer

Primary Skills

HDFS, Spark - Pyspark, ETL Fundamentals, SOLR, Model Provisioning: Kubernetes, Kibana, SQL, SQL (Basic + Advanced), Spark - Scala, Talend, Python, AWS Elastic Cache, Spark - Java, Data Warehousing, PLSQL, T-SQL, Stored Procedures

Job requirements

Job Title: Sr Talend Engineer/Lead

Location: St. Louis, MO (Remote is fine)

JD:

We are seeking a talented Talend Engineer to join our data engineering team. The ideal candidate will be responsible for designing and optimizing data workflows using Talend to support the creation and editing of Campaign Data. This role requires collaboration with data architects, SQL engineers, and product owners to meet business requirements while ensuring scalability, efficiency, and high-quality outcomes.

Key Responsibilities

1. Data Workflow Development

o Maintain and optimize the data pipeline to Salesforce Marketing Cloud through a system of Talend jobs.

o Develop data views, with custom attributes, for automated campaigns o Collaborate with Data teams – Data architects, SQL engineers, and product owners to gather requirements.

o Design and develop scalable data workflows using Talend to create or edit Campaign Data Management effectively.

2. Job Optimization and Rule Engineering

o Optimize Talend jobs to address Campaign Data requirements.

o Enhance job performance and ensure efficient processing of large data volumes.

3. Pipeline Building and Scheduling

o Develop robust data pipelines for file creation and ensure accurate scheduling for timely delivery.

o Automate and monitor workflows to streamline operations and reduce manual intervention.

4. Problem Solving and Validation

o Identify and resolve issues in data workflows and processes.

o Build and implement validation checks to ensure data accuracy and reliability throughout the pipeline.

5. Softskills

o Customer Centericity, Communication and can do mindset/attitude are important for this role.

Know more about:

DAI: https://www.brillio.com/services-data-analytics/

Know what it’s like to work and grow at Brillio: https://www.brillio.com/join-us/

Equal Employment Opportunity Declaration

Brillio is an equal opportunity employer to all, regardless of age, ancestry, colour, disability (mental and physical), exercising the right to family care and medical leave, gender, gender expression, gender identity, genetic information, marital status, medical condition, military or veteran status, national origin, political affiliation, race, religious creed, sex (includes pregnancy, childbirth, breastfeeding, and related medical conditions), and sexual orientation.

#LI-SR1

Know what it’s like to work and grow at Brillio: Click here

Required profile