Data Engineer ID43407

**About us** AgileEngine is an Inc. 5000 company that creates award\-winning software for Fortune 500 brands and trailblazing startups across 17\+ industries. We rank among the leaders in areas like application development and AI/ML, and our people\-first culture has earned us multiple Best Place to Work awards. If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! **About the role** As a **Senior Data Engineer**, you’ll play a key role in shaping high\-impact data solutions that power smarter decision\-making and support a global mission to connect people with meaningful work. You’ll collaborate with diverse teams to build secure, scalable pipelines and drive innovation in cloud\-based data infrastructure. This is a chance to grow technically, influence product evolution, and thrive in an open, collaborative culture that values learning and excellence. **What you will do** * Develop and maintain secure and efficient data pipelines using DBT, PySpark, and Python in an Indeed\-supported cloud environment, integrating all HR data sources to enable analytics and insights for HR COEs and HR leadership; * Build the infrastructure and tooling required for optimal extraction, transformation, and loading (ETL) of data from various sources using Python, DBT, Terraform, and AWS technologies such as Glue, EMR , and S3; * Identify, design, and implement internal process improvements, including automating manual workflows, debugging and optimizing data delivery, and re\-architecting infrastructure for enhanced scalability; * Apply the Data Quality Framework in the HRDM repository by developing unit tests, and creating both manual and automated test cases; * Monitor data pipelines to ensure a minimum of 99\.5% data availability; * Create and maintain data models that are intuitive and easily consumable by business partners; * Write and update project documentation (most data ingestion scripts are written in Python). **Must haves** * **5\+ years of experience** working as a Data Engineer; * Python for object\-oriented programming and data scripting; * Experience with **Snowflake**; * Strong **SQL** experience; * Experience using **DBT** for data transformations; * Experience with **Airflow**; * Experience with REST API for integration and data ingestion; * Experience with **Google BigQuery**; * Handling large\-scale and sensitive data securely; * Real\-time data processing (e.g., from Google Sheets or APIs); * Comprehensive documentation skills; * **Advanced English** communication. **Perks and benefits** * **Professional growth:** Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps. * **Competitive compensation:** We match your ever\-growing skills, talent, and contributions with competitive USD\-based compensation and budgets for education, fitness, and team activities. * **A selection of exciting projects:** Join projects with modern solutions development and top\-tier clients that include Fortune 500 enterprises and leading product brands. * **Flextime:** Tailor your schedule for an optimal work\-life balance, by having the options of working from home and going to the office, whatever makes you the happiest and most productive. Job Type: Full\-time