Offer summary

Qualifications:

Bachelor’s degree in Computer Science, Management Information Systems, Software Engineering, or a related field, or equivalent experience., Five years of experience building data ingress frameworks, or three years with a Master’s degree., Proficiency in Python, Spark, and SQL scripting, along with experience in AWS or other cloud infrastructures., Experience with data formats such as JSON, XML, and CSV, and familiarity with version control tools like Git and Jira..

Key responsibilities:

Collaborate with business leaders and technology teams to design and implement data processes for analytics.

Develop frameworks and applications for large-scale data processing and data pipelines.

Gather and process various data types from multiple sources, ensuring data quality and governance.

Design and implement an end-to-end analytical platform that meets business needs and supports data-driven decision-making.

Job description

Description

Sr. Data Engineer (#LT-0124)

HQ- SAN JOSE, CA

FULL-TIME

Job Description:

As a part of the platform team, work closely with business leaders and other technology teams on designs and roadmaps to maximize data and data processes in support of business analytics.
Promote the benefits of existing data solutions and evaluate emerging technologies and approaches to push the technology of the data warehouse forward.
Develop frameworks and applications for large-scale data processing.
Partner with business and technology teams to extract, transform, and load data from a wide variety of data sources using Amazon Web Services (AWS).
Gather and process raw, structured, semi-structured, and unstructured data from internal and external data providers through databases, including Application Programming Interfaces (APIs),
File Transfer Protocol Secure (FTPs), and messaging services while using batch and real-time data processing frameworks.
Design, develop, and implement an end-to-end analytical platform that is flexible, componentized, scalable, secure, and meets business needs.
Design and develop data pipelines for business intelligence reporting and analytics, including data needed for data scientists and analysts.
Build data pipelines to support the use and expansion of data practices and data governance, including (metadata management, data quality, data modeling, master data management, data administration, security, and privacy.

Minimum Requirements:

Bachelor’s degree or equivalent in Computer Science, Management Information Systems, Software Engineering, or a related field.
Five years of progressive experience building data ingress frameworks.
Employer will accept a Master’s degree or equivalent in Computer Science, Management Information Systems, Software Engineering, or a related field and three years of experience building data ingress frameworks in lieu of a Bachelor’s degree and five years of experience.
Work experience to include: 1. Four years of experience building data ingress frameworks using at least 3 of the following data source formats: JSON, XML, relational, HTML, plain text, CSV, or spreadsheets. Three years of experience required with a Master’s degree. 2. Experience with Python, Spark, and SQL scripting. 3. Building data pipelines, including design, implementation, debugging, and support. 4. Performing data integration to support analytics. 5. Applying data structures and algorithms, to solve data integration problems. 6. Working in the AWS Services Ecosystem or Cloud Infrastructures (Google Cloud, Azure, or AWS). 7. Building, designing, developing, testing, deploying, maintaining, and enhancing full-stack data engineering solutions. 8. Utilizing Git and Jira version control tools.
Any and all experience may be gained concurrently.
40 hrs./wk.
Salary: $150,363 to $155,363 per year.
Address of employment: 100% telecommute position from anywhere in the U.S. reporting to Shutterfly LLC located at 11000 Viking Drive, Eden Prairie, MN 55344.
Individuals interested in applying for the position must email resume with Job Ref. #LT-0124 to Shutterfly, LLC at [email protected].