Offer summary

Qualifications:

1+ years of experience in Data Engineering or Software Engineering., Strong proficiency in Python for data processing and automation., Experience with AWS Cloud services and basic SQL., Familiarity with ETL workflows using Apache Airflow and CI/CD pipelines..

Key responsabilities:

Develop and optimize scalable data pipelines using Python and AWS services.

Manage ETL/ELT workflows to ensure data availability and integrity.

Collaborate with cross-functional teams to deliver high-quality data for decision-making.

Implement logging and monitoring mechanisms to ensure pipeline reliability.

Job description

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

Product Data Engineer

We are a product team responsible for maintaining and optimizing data pipelines hosted in AWS to support product analytics, KPIs, and data-driven decision-making. Our team ensures seamless data flow, high availability, and performance tuning while keeping costs optimized.

Key Responsibilities:

Develop, maintain, and optimize scalable data pipelines using Python and AWS-based services.
Manage and monitor ETL/ELT workflows with tools like Airflow, Lambda, and Glue to ensure data availability and integrity.
Work with large-scale datasets, improving storage efficiency and query performance.
Ensure pipeline reliability by implementing logging, monitoring, and alerting mechanisms.
Collaborate with cross-functional teams, including product managers, analysts, and engineers, to deliver high-quality data for decision-making.
Identify and resolve bottlenecks, ensuring efficient data transformation and processing.
Support cost optimization initiatives by evaluating and refining storage and compute resources.
Enhance data observability by implementing best practices for data quality, validation, and governance.

Required Skills & Experience:

1+ years of experience in Data Engineering or Software engineering or a related role.
Experience with AWS Cloud services
Strong proficiency in Python for data processing, and automation.
Experience with cloud services preferably AWS.
Hands-on experience with basic SQL and data modeling.
Experience with orchestrating ETL workflows using Apache Airflow or similar tools.
Familiarity with CI/CD pipelines (Terraform/Github Actions), and version control (Git).
Strong problem-solving skills and the ability to work in a fast-paced, agile environment.

Preferred Qualifications:

Experience with data lake architectures.
Knowledge of data governance, observability, and cost management best practices.
Prior experience working with IoT data pipelines.

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy

Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, “Orion,” “we” or “us”) are committed to protecting your privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) explains:

What information we collect during our application and recruitment process and why we collect it;
How we handle that information; and
How to access and update that information.

Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.

Required profile