Lead Data DevOps Engineer

We are hiring a Lead Data DevOps Engineer with strong Google Cloud Platform expertise to lead cloud data infrastructure initiatives. You will focus on automating and optimizing data workflows while maintaining high availability. Come join us to shape the future of our data platforms. **Responsibilities** * Architect scalable cloud data systems using GCP services such as DataFlow, GCS, BigQuery, Dataproc, and Cloud Composer * Utilize Infrastructure as Code tools like Terraform to deploy and monitor infrastructure * Collaborate with data engineering teams to automate data workflows leveraging Python * Build and maintain CI/CD pipelines with Jenkins, GitLab CI, or GitHub Actions for efficient deployments * Work with cross\-disciplinary teams to optimize data platform performance and reliability * Administer cloud\-based data tools including Apache Spark, Apache Kafka, and Apache Airflow * Identify and resolve issues to ensure the robustness and scalability of cloud data solutions **Requirements** * Over 5 years of experience in cloud platforms, mainly using GCP services such as BigQuery, Cloud Composer, and Dataproc * Proficient in Python programming and SQL for building data pipelines * Experience with Infrastructure as Code frameworks like Terraform or CloudFormation * Skill in constructing CI/CD pipelines using Jenkins, GitHub Actions, or GitLab CI * Experienced with Linux environments and scripting * Knowledge of network fundamentals including TCP/IP, DNS, and NAT * Competent in deploying tools like Apache Spark, Apache Airflow, or ELK Stack **Nice to have** * Familiarity with other cloud platforms like AWS or Azure, including ECS, S3, Data Lake, or Synapse * Ability to work with IaC tools such as Ansible * Background in various data workflow automation tools