Offer summary

Qualifications:

4+ years of experience in software development and data engineering., Proficiency in Python/PySpark, SCALA, SQL, and Spark/Spark Streaming., Experience with Databricks and familiarity with Big Data tools., Knowledge of Azure, Kafka, and Linux is preferred..

Key responsibilities:

Maintain and support the application and develop data ingestion pipelines.

Collaborate with Business Analysts, Architects, and Senior Developers to establish application frameworks.

Conduct thorough requirement analysis and ensure detailed unit testing is performed.

Work with QA and automation teams, and manage code merges and releases.

Job description

Job Description:

* Maintain and support the application. Development of data ingestion pipelines. Databricks background required.

* Develop and integrate software applications using suitable development methodologies and standards, applying standard architectural patterns, taking into account critical performance characteristics and security measures.

* Evaluate new features and refractors existing code.

* Must be willing to flex work hours accordingly to support application launches and manage production outages if necessary

* Ensures to understand the requirements thoroughly and in detail and identify gaps in requirements

* Ensures that detailed unit testing is done, handles negative scenarios and document the same

* Work with QA and automation team.

* Works on best practices and documenting the process

* code merges and releases (Bitbucket)

* Collaborate with Business Analysts, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments).

* Good data analysis skills

Must have following experience:

Python/PySpark

SCALA

SQL

Spark/Spark Streaming

Databricks

* Preferred to have following experience:

Java/ C #

Azure

Kafka

Azure Data Factory