Lead Data DevOps Engineer
Descrição da Vaga
We are seeking an experienced Lead Data DevOps Engineer proficient in Google Cloud Platform, especially BigQuery and Cloud Storage, to enhance our data infrastructure. You will lead efforts in automating data workflows and optimizing cloud environments. Join us to drive innovation and efficiency in our data operations. **Responsibilities** * Design and implement cloud data infrastructure using GCP services including DataFlow, GCS, BigQuery, Dataproc, and Cloud Composer * Deploy infrastructure through Infrastructure as Code (IaC) tools such as Terraform for provisioning and monitoring * Collaborate with data engineering teams to build automated and efficient data pipelines using Python * Establish CI/CD pipelines using Jenkins, GitLab CI, or GitHub Actions to support smooth deployments * Improve performance and increase reliability of data platforms by working closely with cross\-functional teams * Manage cloud\-based data tools like Apache Spark, Apache Kafka, and Apache Airflow * Troubleshoot and resolve issues to ensure scalability and dependability of cloud data systems **Requirements** * Extensive experience (5\+ years) in cloud environments focusing on GCP services like BigQuery, Cloud Composer, and Dataproc * Strong programming skills in Python and proficiency in SQL for data pipeline development * Familiarity with Infrastructure as Code tools such as Terraform or CloudFormation * Experience building CI/CD pipelines with tools like Jenkins, GitHub Actions, or GitLab CI * Solid knowledge of Linux operating systems and shell scripting * Understanding of network protocols and concepts including TCP/IP, DNS, and NAT * Experience with Apache Spark, Apache Airflow, or ELK Stack implementations **Nice to have** * Knowledge of AWS or Azure platforms, including services like ECS, S3, Data Lake, or Synapse * Ability to work with IaC tools such as Ansible * Experience with alternative data workflow automation tools
Vaga originalmente publicada em: indeed
Receba vagas como esta no seu email
Crie um alerta gratuito e seja o primeiro a saber de novas oportunidades
Alertas que entendem o que você quer
Não receba qualquer vaga. Receba apenas as que combinam exatamente com o que você busca.
Filtro:
Você recebe tudo isso:
Filtro:
Você recebe apenas:
Zero ruído. Só vagas relevantes para você.
Outros exemplos de filtros precisos:
Filtros Combinados
Combine linguagem + framework + nível + localização. Seja tão específico quanto quiser.
Email Diário
Receba um resumo diário apenas com vagas que passam nos seus filtros. Sem spam.
Kanban Visual
Organize suas candidaturas em um quadro Kanban. Acompanhe cada processo seletivo.
Planos simples, sem surpresas
Comece grátis e faça upgrade quando quiser
Premium
- Tudo do plano gratuito
- Vagas salvas ilimitadas
- Quadros Kanban ilimitados
- Alertas de vagas por email
- Suporte prioritário
Pronto para encontrar sua vaga ideal?
Junte-se a milhares de desenvolvedores que já usam o Job For Dev
Encontre as melhores oportunidades para desenvolvedores no Job For Dev