Senior Data Engineer
Offer summary
Qualifications:
Proficiency in Python, Spark, and Big Data technologies., Experience with cloud platforms such as Azure, AWS, and GCP., Strong understanding of DevOps practices and CI/CD pipelines., Ability to document technical processes and assist with data infrastructure optimization..Key responsabilities:
- Develop and integrate data pipelines from various sources.
- Test and maintain the data platform and facilitate code deployment.
- Participate in the architecture of end-to-end data solutions.
- Collaborate on feature deliverables and assist with technical issues.
Job description
This is a remote position.
Short Service Description:
- Development & integration of pipeline to integrate data from different data sources
- Testing and maintenance of the platform
- Facilitate deployment of code to stage and production environments
- Participation on architecture of end-to-end solutions
- Collaboration on feature deliverables
- Documentation of implemented logic in a structured manner
- Assistance with data-related technical issues and support their data infrastructure optimization
Technical knowledge
- Python, Spark, Streaming, Big Data, graphQL, devOps, CICD, git
- Azure cloud - Azure Data Factory, Databricks, Azure Functions, Azure DevOps
- AWS cloud - serverless, Amazon Neptune
- GCP cloud
Required profile
Experience
Other Skills
- Collaboration
Data Engineer Related jobs
Zapata Technology
- Remote: Arizona (USA), Georgia (USA)
- Full time
Stefanini LATAM
- Remote: Peru
- Full time
GFT Technologies
- Remote: Italy
- Full time
Executive Recruiting Agency
- Remote: United States
- Full time
AmeriSave Mortgage Corporation
- Remote: United States
- Full time