Lead Data Software Engineer

We are in search of a skilled **Lead Data Software Engineer** for a **remote** position, ready to contribute to our team's success and bolster our Data Science endeavors. As the Lead Data Software Engineer, you'll be instrumental in crafting and sustaining datamarts, ensuring the delivery of efficient and scalable data solutions that meet the unique needs of our clients. Your primary focus will revolve around constructing and maintaining data pipelines, offering on\-call support, and fostering collaboration with Data Science teams to deliver top\-tier solutions. Additionally, you'll be tasked with steering a group of proficient professionals, providing mentorship and guidance to empower them to produce cutting\-edge solutions for the industry. **Responsibilities** * Guide and nurture the Data Software Engineering team, cultivating a culture of continual learning and growth within the unit * Collaborate with interdisciplinary teams to furnish top\-notch data solutions aligning with project objectives and timelines * Forge and uphold robust Data Software Engineering processes and practices emphasizing automation, innovation, and efficiency * Ensure the realization and upkeep of streamlined and scalable data solutions utilizing AWS services * Supervise the fine\-tuning of data processing and workflow management through Apache Airflow and Apache Spark * Consistently assess industry trends and best practices to enhance and implement the most potent Data Software Engineering strategies * Provide on\-call assistance for data pipelines and datamarts * Direct the team in crafting and deploying REST APIs for seamless data integration and communication * Engage directly with clients to comprehend their requirements and deliver tailored, effective solutions * Steer the organization and structure of the team, guaranteeing the prompt and efficient delivery of projects * Collaborate with stakeholders, showcasing excellent communication and leadership skills **Requirements** * A minimum of 5 years of experience as a Data Software Engineer, engaged in substantial projects and intricate data infrastructures * At least 1 year of confirmed leadership experience, adeptly managing and motivating a team of Data Software Engineers * Proficiency in Amazon Web Services, encompassing the design and implementation of scalable and effective data solutions * Substantial expertise in Apache Airflow and Apache Spark, ensuring streamlined data processing and workflow management * Advanced familiarity with at least one CI/CD tool, preferably Jenkins, for the efficient delivery of data pipelines * Proficiency in Python and SQL, facilitating the creation and upkeep of data pipelines and ETL processes * Experience with Databricks and PySpark for data processing and analysis * Acquaintance with REST APIs for seamless data integration and communication * Robust analytical skills, empowering adept problem\-solving and decision\-making in intricate environments * Effective client\-facing skills, facilitating clear communication and collaboration to attain project objectives * Exceptional organizational and structuring abilities, championing the efficient delivery of projects * Upper\-intermediate proficiency in the English language, enabling clear collaboration, presentation, and discussion with the team and stakeholders **Nice to have** * Background with Redshift for data warehousing and analysis