Lead Data Software Engineer

We are seeking an experienced Lead Data Software Engineer for a remote position to support our team’s success and advance our Data Science initiatives. In this role, you will play a pivotal part in designing and maintaining datamarts while ensuring scalable and efficient data solutions tailored to meet client needs. You will focus on developing and managing data pipelines, providing on\-call support, and working closely with Data Science teams to deliver high\-quality results. Additionally, you will lead a team of skilled professionals, offering mentorship and guidance to drive innovation and excellence within the industry. **Responsibilities** * Lead and mentor the Data Software Engineering team, fostering a culture of continuous improvement and professional growth * Collaborate across disciplines to deliver high\-quality data solutions aligned with project goals and deadlines * Establish and maintain effective Data Software Engineering processes, emphasizing automation, efficiency, and innovation * Implement and sustain scalable data solutions using AWS services * Oversee optimization of workflows and data processing through Apache Airflow and Apache Spark * Continuously evaluate industry trends and best practices to refine and adopt advanced Data Software Engineering methodologies * Provide on\-call support for data pipelines and datamarts to ensure operational efficiency * Direct the creation and deployment of REST APIs to enable seamless data integration and communication * Engage with clients to understand their needs and deliver tailored solutions that meet their requirements * Manage team structure and organization to ensure timely and efficient delivery of projects * Work with stakeholders, demonstrating strong communication and leadership capabilities **Requirements** * At least 5 years of experience as a Data Software Engineer, working on complex projects and large\-scale data infrastructures * Minimum of 1 year of leadership experience, successfully managing and motivating a team of Data Software Engineers * Expertise in Amazon Web Services (AWS), including designing and implementing scalable data solutions * Extensive knowledge of Apache Airflow and Apache Spark for optimizing workflows and data processing * Advanced proficiency with one or more CI/CD tools, such as Jenkins, to streamline data pipeline delivery * Strong skills in Python and SQL for building and maintaining data pipelines and ETL processes * Experience with Databricks and PySpark for data analysis and processing * Familiarity with REST APIs for efficient data integration and communication * Excellent analytical skills for problem\-solving and decision\-making in complex environments * Strong client\-facing abilities, ensuring effective collaboration and clear communication to achieve project objectives * Exceptional organizational and team management skills for delivering projects efficiently * Upper\-intermediate English proficiency for effective communication, presentations, and discussions with stakeholders **Nice to have** * Experience with Redshift for data warehousing and analysis