Test Yantra is a leader in Quality Engineering Services for Global Brands with our approach to Digital Engineering and we become your partner to conceptualize our test-to-fit solution in your business roadmap. With a focus on creating a superior experience throughout our journey for our customers, partners and people and to create and bring that value-creating for the whole eco-system We become your partner to align to your goals through our technology, operational and market leadership to have a seamless delivery in any type of testing transformation by optimal way of our best-proven people, process, practices and platforms. With the roots of having Quality engineering expertise in Test Automation Engineering, Testing as a Service and Crowd testing and now a trusted partner to Global brands from SaaS, Consumer Products, Finance, Telecom, Internet, Entertainment & Media and more. Visit www.testyantra.com for our offerings Join us on our Journey in Quality Engineering

Job description

Role: Data Engineer
Contract duration: 6+ Months

Role Overview:
We are looking for a highly skilled Data Engineer with expertise in Apache NiFi and experience in big data processing and pipeline orchestration. The ideal candidate should have a strong background in data engineering and be proficient in handling large-scale data workflows.

Key Responsibilities:
• Design, develop, and maintain data pipelines using Apache NiFi.
• Optimize data ingestion, transformation, and processing for high performance and scalability.
• Work with Kafka, Airflow, Impala, and Snowflake to streamline data workflows (desirable skills).
• Ensure data integrity, security, and governance across the data ecosystem.
• Collaborate with data scientists, analysts, and stakeholders to deliver high-quality data solutions.
• Troubleshoot and resolve issues in data pipelines, streaming, and ETL processes.

Required Skills & Experience:
• 8+ years of experience in Data Engineering.
• Expertise in Apache NiFi for data integration and pipeline orchestration.
• Experience with Kafka, Airflow, Impala, and Snowflake is a plus.
• Strong understanding of big data processing, ETL workflows, and cloud-based data platforms.
• Knowledge of SQL, Python, or Java for data manipulation and scripting.
• Ability to work with structured and unstructured data in large-scale environments.
• Strong problem-solving skills and experience in optimizing data performance.