[Job-27195] Senior Data Engineer - Databricks, Brazil
Descrição da Vaga
We are **tech transformation** specialists, uniting human expertise with AI to create scalable tech solutions. With over 8,000 CI\&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality. We are looking for a Senior Data Engineer with strong knowledge in developing and maintaining data pipelines in Databricks, integrating and transforming data from various sources, such as APIs, relational databases, files, and many others! As a senior member of the team, you will also provide technical guidance, mentor peers, and collaborate with cross\-functional teams including data scientists, analysts, and platform engineers. **Position Overview** As a Senior Data Engineer, you will lead the design and development of robust data pipelines, integrating and transforming data from diverse data sources such as APIs, relational databases, and files. Collaborating closely with business and analytics teams, you will ensure high\-quality deliverables that meet the strategic needs of our organization. Your expertise will be pivotal in maintaining the quality, reliability, security and governance of the ingested data, therefore driving our mission of Collaboration, Innovation, \& Transformation. **Key Responsibilities:** Develop and maintain data pipelines. Integrate data from various sources (APIs, relational databases, files, etc.). Collaborate with business and analytics teams to understand data requirements. Ensure quality, reliability, security and governance of the ingested data. Follow modern DataOps practices such as Code Versioning, Data Tests and CI/CD Document processes and best practices in data engineering. **Required Skills and Qualifications:** **Must\-have Skills:** Proven experience in building and managing large\-scale data pipelines in Databricks (PySpark, Delta Lake, SQL). Strong programming skills in Python and SQL for data processing and transformation. Deep understanding of ETL/ELT frameworks, data warehousing, and distributed data processing. Hands\-on experience with modern DataOps practices: version control (Git), CI/CD pipelines, automated testing, infrastructure\-as\-code. Familiarity with cloud platforms (AWS, Azure, or GCP) and related data services. Strong problem\-solving skills with the ability to troubleshoot performance, scalability, and reliability issues. Proficiency in Git. Advanced English is essential. **Nice\-to\-have Skills:** Experience with data contracts, schema evolution, and ensuring compatibility across services. Expertise in data quality frameworks (e.g., Great Expectations, Soda, dbt tests, or custom\-built solutions). Familiarity with DBT, Atlan and Soda. Integration with Power BI Experience with Data Streaming. \#LI\-BM2 **Why join us?*** Competitive Salary * Generous paid vacation days * Generous sick time * 100% paid health \& dental benefits starting day one * Annual profit\-sharing distribution * Paid parental leave * Dedicated career advisor And so much more… Collaboration is our superpower, diversity unites us, and excellence is our standard. We value diverse identities and life experiences, fostering a diverse, inclusive, and safe work environment. We encourage applications from diverse and underrepresented groups to our job positions.
Vaga originalmente publicada em: indeed
Receba vagas como esta no seu email
Crie um alerta gratuito e seja o primeiro a saber de novas oportunidades
Alertas que entendem o que você quer
Não receba qualquer vaga. Receba apenas as que combinam exatamente com o que você busca.
Filtro:
Você recebe tudo isso:
Filtro:
Você recebe apenas:
Zero ruído. Só vagas relevantes para você.
Outros exemplos de filtros precisos:
Filtros Combinados
Combine linguagem + framework + nível + localização. Seja tão específico quanto quiser.
Email Diário
Receba um resumo diário apenas com vagas que passam nos seus filtros. Sem spam.
Kanban Visual
Organize suas candidaturas em um quadro Kanban. Acompanhe cada processo seletivo.
Planos simples, sem surpresas
Comece grátis e faça upgrade quando quiser
Premium
- Tudo do plano gratuito
- Vagas salvas ilimitadas
- Quadros Kanban ilimitados
- Alertas de vagas por email
- Suporte prioritário
Pronto para encontrar sua vaga ideal?
Junte-se a milhares de desenvolvedores que já usam o Job For Dev
Encontre as melhores oportunidades para desenvolvedores no Job For Dev