Data Engineer

Description

Index Analytics, LLC, is a rapidly growing, Baltimore-based small business providing health-related consulting services to the federal government. At the center of our company culture is a commitment to instilling a dynamic and employee-friendly place to work. We place a priority on promoting a supportive and collegial team environment and enhancing staff experience through career development and educational opportunities.

Position Overview 

The Data Engineer is responsible for designing, building, and maintaining data pipelines and architectures to support data analytics and reporting needs across the organization. This role involves working closely with data scientists, analysts, and other stakeholders to ensure that data is clean, accessible, and ready for analysis. The Data Engineer will optimize data systems, develop data integration solutions, and ensure data security and governance. Key responsibilities include creating ETL processes, managing databases, and improving data infrastructure performance. The ideal candidate has strong programming and database skills and experience with cloud-based data platforms.

Responsibilities

• Leads design, implementation, and management of data pipelines 
• Develops and executes ETL (extract, transform, load) or ELT code 
• Supports design of robust Data Integration Architecture to support customers  
• Helps monitor and administer the systems and ensures applications and systems are always functioning properly 
• Analyzes the Data Integration and Engineering architecture to identify weaknesses and develops improvements such as enhancing business processes
• Identifies and analyzes business requirements, functional design, and translation of requirements to technical specifications
• Performs complex query design, developments, validation routine analysis, and streamlining processes
• Operates large data sets, delta data sets and querying efficiently
• Transforms, joins, and normalizes data in service of specific use cases. 
• Employs AWS data pipeline solutions such as Glue, Data Pipeline, Step functions, MWAA to orchestrate data movement
• Work with DevSecOps engineer to deploy continuous integration and continuous deployment (CI/CD) data pipelines
• Understand the technical architecture to design, build, optimize, and maintain scalable data solutions in a Big Data environment
• Work with Product Owners and/or business stakeholders to gather business requirements and translate to detailed technical specifications  

Qualifications

• US citizen or Authorized to Work and lived in the US for 3 of the last 5 years. Must be able to obtain a U.S. Federal government client badge and pass a government Public Trust.
• Bachelor’s degree or higher in IT or relevant discipline required
• 4+ years of IT experience
• Experience with setting up and operating data pipelines using Python or SQL
• Experience with Scala and PySpark
• 3+ years of experience working on AWS, GCP or Azure (AWS Preferred) cloud platforms
• Hands-on relational DB / NoSQL experience (PostgreSQL or similar) with specific implementation on cloud 
• Experience working with data warehouses such as Redshift to open source and proprietary cloud data pipeline tools such as Airflow, Glue, Data Pipeline, Step functions
• Experience working with relational databases that handle structured and semi-structured (JSON) datasets
• Experience with data serialization languages such as JSON, XML, YAML
• Experience with code management tools (e.g. Git, SVN) and DevOps tools (e.g. Jenkins, Docker, AWS Code Pipeline)
• Strong analytical problem-solving ability
• Working experience with Transactional and Dimensional data modeling methodologies (Eg: Normalization, Star Schema, Snowflake Schema) 
• Experience working with a distributed computing environment like AWS EMR or similar. 
• Ability to obtain Public Trust level clearance
• Ability to demonstrate excellent written and oral communication required
• Prior experience with Center for Medicare Medicaid Services or other Govt agencies is a plus

The salary range provided represents the estimated compensation for new hires in this position, applicable across all locations. Actual offers may vary based on factors such as the candidate's skills, qualifications, experience, and market conditions. Index complements its base salary offering with a competitive package that includes health and retirement benefits, discretionary bonuses, and reimbursement for professional development opportunities.

Index Analytics provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

Attention Candidates

We're dedicated to ensuring a safe and transparent recruitment process for all candidates and have implemented robust measures to protect your personal information. Please be aware that all employment-related communications will originate from a secure portal (NAME@msg.paycomonline.com) or a corporate email address (NAME@index-analytics.com). If you have any concerns, please don't hesitate to reach out to us at recruiting@index-analytics.com