Role Overview
We are looking for an experienced Data Engineering Tech Lead with deep expertise in AWS , Python , and relational databases ( MySQL , PostgreSQL ). You will be responsible for designing, implementing, and maintaining scalable data solutions in the cloud, providing technical leadership to the team, and ensuring the highest standards of performance, security, and cost-efficiency.
Key Responsibilities
- Architect and implement scalable data solutions using AWS services such as Lambda , Glue , and Step Functions
- Develop robust solution architectures considering scalability, performance, security, and cost optimization
- Demonstrate proficiency in cloud networking (VPCs, subnets, security groups, routing tables)
- Design efficient data models for optimal query performance
- Write and optimize SQL queries , identifying and resolving performance bottlenecks
- Manage ETL processes and data integration into Redshift, MySQL, and PostgreSQL
- Create documentation and provide training to team members
- Set up and manage logging and tracing mechanisms using AWS CloudTrail and AWS X-Ray
- Implement orchestration solutions using Apache Airflow and AWS Step Functions
- Use Athena for interactive query analysis of large datasets in Amazon S3
- Provide technical leadership and guidance , acting as a subject matter expert in AWS and data engineering technologies
- Write comprehensive solution documents and technical documentation
- Stay up-to-date with emerging technologies and industry trends
- Challenge business requirements and propose innovative solutions for efficiency and performance improvement
Required Skills & Experience
Extensive hands-on experience with AWS services : Lambda, Glue, Step Functions, CloudTrail, X-Ray, AthenaStrong expertise in Python programmingAdvanced SQL skills and deep knowledge of MySQL and PostgreSQLSolid understanding of ETL processes , data modeling , and data integration into Redshift and other databasesExperience implementing orchestration solutions (Apache Airflow, AWS Step Functions)Ability to design and implement secure, scalable, and cost-efficient architecturesExcellent documentation and team training skillsProven ability to lead teams and act as a technical mentorGood to Have
Knowledge of Apache Flink , Kafka , and other streaming data technologiesExperience with cloud-native architectures and serverless computingCertifications in AWS, Azure, or other relevant technologies