Big Data Manager

What do you get out of this Role?

If you want to apply and enhance your expertise in Big Data, develop Scala Pipelines, offer Spark performance solutions interact with Elastic Search, Flume, Kibana, in an environment as vast as Deutsche Bank, this is the right time and job for you.

We use of the latest architectures and technologies in Big Data and Business Intelligence in order to offer relevant data analysis to financial departments and ensure regulatory commitments.

According to Deutsche Bank’s strategic approach – to work with latest innovative solutions, the initial prototypes started to become the norm for many projects.

Responsibilities:

• Lead a team of 10 developers and perform all people manager activities.
• Build distributed, reliable and scalable data pipelines to ingest and process data in real-time. Hadoop developer deals with fetching streams, transaction behaviors, clickstream data and other unstructured data.
• Load data from different datasets and deciding on which file format is efficient for a task. Hadoop developers source large volumes of data from diverse data platforms into Hadoop platform.
• Fine tune Hadoop applications for high performance and throughput.
• Configure and maintain enterprise Hadoop environment.
• Understand the requirements of input to output transformations.
• Defining Hadoop Job Flows/ Implement data workflows using Hadoop ecosystem.
• Design and implement column family schemas of Hive/Impala within HDFS.
• Assign schemas and create Hive/Impala tables.
• Develop efficient Hive/Impala scripts with joins on datasets using various techniques.
• Assess the quality of datasets for a Hadoop data lake.
• Troubleshoot and debug any Hadoop ecosystem run time issue.

Skills:

• At least 5 years of experience working with Hadoop and Scala.
• Good knowledge of concurrency and multi-threading concepts.
• Good knowledge of SQL, database structures, principles, and theories.
• Experience in working with complex data structures.
• People management skills
• Capable to meet deadlines and work within virtual teams in matrix organizations.

What we offer:

• A rewarding work: we offer a purpose, a competitive income and promotions based on performance
• Managers that empower your ideas and your decision-making abilities. You’re encouraged to show your good vibe, determination, and open mindedness
• A professional, passionate, driven, but at the same time fun workplace. It is also flexible, including Work from Home opportunities]
• Medical providers to choose from with premium benefits for you and your loved ones
• The better you feel, the better you work. We nurture you with highly modern office that includes plenty of fun and relaxing areas to boost your creativity. We also facilitate copiously retailer discounts, cultural and CSR activities, employee sport clubs, workshops & more. 

We strive for a culture in which we are empowered to excel together every day. This includes acting responsibly, thinking commercially, taking initiative and working collaboratively.