Data Pipeline: Build robust data pipelines: develop jobs to process, validate, transport, collate, aggregate, and distribute data Build workflows that empower analysts to efficiently use data Develop data virtualizations and actual data movement and transformation processes, using the appropriate technologies, tools and techniques to balance performance and cost objectives. Define and establish processes to maintain the integrity of data within our data pipeline and warehouse Develop tests to validate, and monitor data transfer integrity and efficiency. Work collaboratively across the organization to address and predict data performance issues Develop documentation for the tools and data products deployed
Required Skills
EDB
Talent Toppers
Penbrothers
Valenta
GFT Technologies