5-8 years of experience in data engineering or related technical field., Strong programming skills in Python and Linux Bash for automation., Expertise in Hadoop ecosystem tools and SQL databases for data management., In-depth knowledge of AWS services like EC2, S3, and RDS..
Key responsibilities:
Lead projects that redefine urban living and drive innovation in various sectors.
Orchestrate complex data workflows using tools like Luigi.
Communicate with stakeholders and guide junior team members effectively.
Collaborate with cross-functional teams to align business goals with technical solutions.
Report This Job
Help us maintain the quality of our job listings. If you find any issues with this job post, please let us know.
Select the reason you're reporting this job:
PointAbout is now 3Pillar Global.
VIsit us at http://www.3pillarglobal.com. You can also follow us on http://www.linkedin.com/company/3pillar-global
The company creates iPhone, iPad, Android, Blackberry, and Windows Phone 7 applications for brands as well as enterprise internal use. We've designed and developed native applications for clients like the Social Security Administration, US Army, The Outdoor Channel, PBS, Arinc, the Washington Post, Intelsat, Carfax, Huffington Post, OnStar, Cars.com, and many others. We provide mobile strategy planning, advisory, ideation, mobile product concepting, and feature/release planning for consumer and enterprise mobile.
🌟 Distinguished Tech Innovator:3Pillar warmly extends an invitation for you to join an elite team of visionaries. Beyond software development, we are dedicated to engineering solutions that challenge conventional norms. Envision you: steering projects that redefine urban living, establish new media channels for enterprise companies, or drive innovation in healthcare. Your invaluable expertise will serve as the cornerstone in shaping the future direction of our endeavors.This role transcends the ordinary realms of coding; it's about orchestrating technological marvels that disrupt industries. Seize this extraordinary opportunity to lead a team that is actively shaping the tech landscape for our clients, and sets global standards along the way. 🌍🔥
Minimum Qualification
Experience: 5-8 years of experience in data engineering, DevOps, or a related technical field.
Programming & Scripting: Strong programming skills in Python and Linux Bash for automation and data workflows.
Framework Proficiency: Hands-on experience with Luigi for orchestrating complex data workflows.
Data Processing & Storage: Expertise in Hadoop ecosystem tools and managing SQL databases for data storage and query optimization.
AWS Cloud Services: In-depth knowledge of AWS EC2, S3, RDS, and EMR to deploy and manage data solutions.
Monitoring & Alerting Tools: Familiarity with monitoring solutions for real-time tracking and troubleshooting of data pipelines.
Communication & Leadership: Proven ability to lead projects, communicate with stakeholders, and guide junior team members.
Additional experience
Data Architecture: Experience designing or optimizing data lake solutions.
Security Practices: Understanding of data security practices, data governance, and compliance for secure data processing.
Automation & CI/CD: Familiarity with CI/CD tools to support automation of deployment and testing.
Big Data Technologies: Knowledge of big data processing tools like Spark, Hive, or related AWS services.
Advanced Analytics: Background in analytics or data science to contribute to more data-driven decision-making.
Cross-Functional Collaboration: Experience collaborating with non-technical teams on business goals and technical solutions.
Regards
Rajan
3Pillar Global
Required profile
Experience
Spoken language(s):
English
Check out the description to know which languages are mandatory.