Senior Data Engineer (SQL/ ADF)

Calling All Upstarters!

SENIOR DATA ENGINEER WANTED!

We are Upstart 13. We are humble, hungry, and competent people who are radically changing the expectations and experience of outsourcing for all participants by challenging barriers that create inequality and by bringing down borders in technology for people everywhere. We’re all about delivering value and doing big things. We have become a game-changer for teams around the world who look to Upstart’s services as a differentiator.

Job Description:

We are looking for a Senior Data Engineer with technical skills in data engineering, a deep understanding of data management principles, and the ability to adapt to evolving technologies and industry best practices in data engineering and analytics.

Responsibilities:

• Code SQL for both on-premises and Azure SQL environments, including optimizing queries, data manipulation, and ensuring high performance.
• Design and build data pipelines from various data sources (mainly databases) to a target Data Warehouse / Lakehouse, using batch data load strategies, and leveraging Microsoft Azure technologies (Data Factory and Databricks).
• Implement data validation and quality assurance checks to maintain high data integrity standards, ensuring accurate and reliable data for analytical purposes.
• Collaborate with a cross-functional team of business analysts, architects, engineers, data analysts, and key stakeholders to formulate and implement data pipelines.
• Participate in architecture discussions, take ownership and responsibility over new projects or requirements, and perform audits to ensure data quality and integrity.
• Utilize programming languages, databases & cloud Data Warehouses / Lakehouses.
• Document database designs that include data models, metadata, ETL specifications, and process flows for business data project integrations.
• Monitor, maintain, and optimize production systems. Investigate and resolve incidents reported by users. Identify opportunities to automate, consolidate, and simplify data solutions at scale.
• Define best practices and create coding standards and patterns that can be reused by the rest of the data engineers.

Qualifications

Experience:

• 5+ years of work experience as a Data Engineer.
• Proven experience in maintaining legacy SQL environments and migrating to Databricks.

Technical skill

• Advanced working knowledge of SQL.
• Proficient in Python for data engineering tasks.
• Working knowledge of Azure Data Factory (ADF).
• Familiarity with NoSQL databases.
  
• Solid understanding of cloud technologies (Microsoft Azure).
• Experience with GitHub and CI/CD processes for data pipelines.
  
• Working knowledge and understanding of SDLC.
• Experience with Databricks or similar tools (Spark).
• English Proficiency (B2).
  
• LATAM Based.

Soft skills: 

• Able to work in a fast-paced, dynamically changing business environment with minimal supervision.
• Excellent communication and collaboration skills with a desire to learn and teach.
• Excellent understanding of development processes and agile methodologies.
• Enthusiastic, highly motivated, and able to learn quickly. 
  

Bonus skills: 

• Experience with / Understanding of unit testing approaches is a plus.
  
• Experience with data Visualization tools (Microsoft PowerBI) is a plus.
  

Why Upstart13?

• We put people first at Upstart 13! We believe the world is filled with amazing people and we are willing to go to great lengths to seek out others who share our values to join our cause of bringing down borders in technology for people everywhere.
• We develop leaders at Upstart 13, we focus on what matters to do meaningful work, we own our shit, we stay curious, and we understand responsibility leads to giving. We do big things, together!
  

Perks:

• Job type: long-term, full-time job.
• Fully remote.
• USD competitive salary.
• 20+ Paid time off days.

Are you ready to join our cause? Be sure to ask, “Why 13?”