Cloud DevOps Engineer

This role requires a Cloud DevOps Engineer responsible for managing infrastructure, deploying scalable AI workloads, and handling CI/CD pipelines. The candidate should be proficient in cloud architecture (AWS, GCP, Azure), containerization, and Kubernetes-based deployment. Additionally, they should be comfortable managing hybrid AI workloads, where training is done on-prem while inference is deployed in the cloud.

Key Responsibilities:

• Deploy and manage AI/ML workloads across AWS, GCP, and Azure.
• Optimize on-prem GPU-based training infrastructure (NVIDIA Inception setup).
• Implement and manage CI/CD pipelines for AI model deployment.
• Configure Docker/Kubernetes environments for scalable model inference.
• Maintain cloud security and compliance, as well as monitor best practices.
• Work with IaC (Terraform, CloudFormation, Pulumi) for cloud infrastructure management.
• Automate cloud scaling, cost optimization, and system reliability.
• Manage GitOps workflows, ensuring seamless deployments.
• Set up logging, monitoring, and alerting (Prometheus, Grafana, Datadog) for cloud-based and on-prem AI workloads.

Must-Have Skills & Experience:

• Strong hands-on experience with AWS, GCP, and Azure cloud environments.
  
• Proficiency in Docker and Kubernetes for deploying AI applications.
  
• Experience with IaC tools (Terraform, CloudFormation).
  
• Strong knowledge of CI/CD pipelines for automating deployments (Jenkins, GitHub Actions, ArgoCD).
  
• Familiarity with GPU-based infrastructure for AI training (NVIDIA CUDA, TensorRT).
  
• Knowledge of cloud networking, security, and compliance best practices.
  
• Experience in monitoring AI workloads and optimizing performance.

We Offer

• A dynamic and creative work environment with a team of passionate professionals.
• Opportunities for professional growth and development.
• Competitive salary and benefits package.
• Flexible working hours and the possibility for remote work.

Why working at Diffco?

• You will have the exciting opportunity to work on cutting-edge projects in the Silicon Valley for both US and European clients utilizing the latest technologies, methodologies, frameworks and approaches with the ability and time to learn and develop professionally.
• Our team is a second family, so you would enjoy spending the day working on nice projects with kind people with broad interests.
• Learn continuously, expand your skills and demonstrate your professional level and ability to take more responsibility to grow.
• We care about you and are interested in your personal professional goals, motivation and we build a perfect work/life balance.