Data Lake Administrator/Architect

Codeworks is an IT Services firm headquartered in SE Wisconsin, known for our strong commitment to quality and for our direct client relationships.

Who We’re Looking For: A highly skilled Data Lake Administrator/Architect to join our Client's team. The ideal candidate will have significant experience in managing and maintaining Data Lake infrastructures both on-premises and in the cloud. This role requires expertise in Hadoop, cloud platforms, and various data management technologies, as well as a strong focus on performance optimization, security, and scalability.

Responsibilities:

Manage and maintain Data Lake cluster infrastructure on-premises and in the cloud, including installation, configuration, performance tuning, and monitoring of Hadoop clusters.

Work with Unix/Linux, Windows OS, cloud platforms (AWS, GCP), Kubernetes, OpenShift, and Docker.

Utilize cluster management tools such as Cloudera Manager, Cloudera Navigator, or similar technologies.

Collaborate with developers to support code implementation, monitor performance, and optimize resource utilization through automation.

Manage and optimize Hadoop-related services, including HDFS, Ranger/Sentry, Hive, Impala, Spark, HBase, Kudu, Kafka, Kafka Connect, Schema Registry, Ni-Fi, and Sqoop.

Work with Data Science collaborative tools such as Data Science Workbench, CML, and Anaconda.

Apply strong networking knowledge, including topology, proxy, F5, and firewall configurations.

Implement security best practices, including Active Directory, Kerberos, LDAP, SAML, SSL, and data encryption at rest.

Work with programming languages such as Java, Perl, Python, PySpark, and Unix shell scripting.

Perform cluster management tasks, including upgrades, migrations, and testing.

Keep clusters up to date by applying periodic updates and expanding storage as needed.

Manage application databases, application integration, user roles, and permissions within the cluster.

Collaborate with OpenShift, Unix, network, database, and security teams on cluster-related matters.

Monitor clusters to ensure maximum uptime, troubleshoot issues using logs, and proactively collaborate with support teams.

Qualifications:

8-10 years of experience working with advanced technologies, including at least 5+ years as a Data Lake Administrator/Architect.

Bachelor’s degree in Computer Science or a related field (or equivalent experience).

Strong communication skills and a collaborative mindset.

Minimum 5 years of experience working with Hadoop ecosystems (Horton HDP or Cloudera’s CDP).

Extensive experience managing Cloudera data lake environments both on-premises and in the cloud.

Expertise in data lake administration and security best practices.

Strong background in architecting and designing scalable data solutions.

Experience implementing robust logging and traceability for end-to-end system monitoring.

Familiarity with Cloudera’s BDR tool for backup and data restoration.

Hands-on experience in coding, troubleshooting, and performing proof-of-concept explorations.

Ability to work with technical teams to analyze, discuss, and understand business requirements, translating them into technical solutions.

Experience in optimizing Hadoop environments to ensure high availability and performance.

Deep knowledge of Hadoop ecosystem components, including HDFS, YARN, Hive, MapReduce, Pig, Sqoop, Oozie, Kafka, Spark, and Presto.

About Codeworks: Codeworks has over 25 years of experience serving Fortune 1000 companies in Wisconsin as well as our client's national locations. Our recruiting team excels at evaluating, advising, and connecting IT professionals with new opportunities that will satisfy their expectations regarding income and opportunity for growth. At Codeworks, we're committed to diversity, equity, and inclusion in our workforce and beyond. We believe in equal opportunities and value the unique perspectives that every individual brings to our team. Join us in creating an inclusive, innovative, and collaborative workplace where your talents can thrive.

Codeworks is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws.

Codeworks, LLC discloses that the anticipated hourly pay range for this position is between $60 and $90. This range is subject to change based on job-related factors, including client requirements where applicable.

All full time Codeworks employees are eligible to enroll in the company’s medical, dental, vision, and life insurance plans. Additionally, employees can participate in Codeworks’ 401(k) retirement plan.