Clinical Data Engineer - Informatics, Python, SQL

The data engineering team at Paradigm is dedicated to constructing the infrastructure for clinical care data. We ingest data from multiple data sources: Electronic Health Records, Lab providers, Health Information Exchanges (and more). We enrich, harmonize and make it available for multiple consumers and product verticals. As our population, research and health system footprint grows we will scale our architecture to support parallel data processing. 

We are seeking a Clinical Data Engineer to partner with our implementation and customer success team to build and manage our ingestions and integrations with our customers from project planning to go live. In this role, you’ll heavily focus on integrating clinical data into our data pipelines and ensuring the data is formatted correctly for use by our application and LLMs.  You’ll also build data quality tools to automate the process of translating the data into our data warehouse.

What you’ll do:

• Integrate data feeds from various healthcare data providers
• Analyze incoming healthcare data, ensure that the data meets clinical specifications
• Write new SQL based pipelines to bring patient data into our platform
• Troubleshoot existing pipelines using AWS services (Athena, Glue, S3), Databricks,  Datadog
• Improving pipelines to ensure they meet a high data quality standard.
• Use DBT to automate the transformation of clinical data
• Create tools and processes to facilitate data accessibility across products and data consumers
• Cultivate expertise on various datasets and tooling within the organization

What you’ll bring:

• 4+ Years of experience working with clinical data in various formats (HL7, FHIR, etc.)
• Understanding of standard clinical terminologies (ex. ICD10, ICD O-3, RxNorm, ATC, etc.)
• Curiosity about datasets and what makes high quality data
• General understanding of ETL best practices, data quality
• A strong knowledge of SQL 
• Experience working with python and pyspark
• Experience with DBT, airflow, dagster or similar technologies a plus
• Exposure to data warehouse systems.  We use Databricks at Paradigm
• Curious - you look at your work beyond the surface, and care about why and how things work
• Get Stuff Done - Say what you will do, and do that.  Deliver work timely and reliably.
• Growth Mindset - Believe in potential, embrace challenges, learn from mistakes.
• Teachable - Willing to learn from anyone and want to teach others
• Respectful - All viewpoints are valuable - we listen and provide appropriate feedback
• Collaborative - Prioritizes unblocking teammates, users, stakeholders
• Strong ability to learn new technologies