Senior Data Engineer

Role Overview

We are looking for an experienced Data Engineering Tech Lead with deep expertise in AWS, Python, and relational databases (MySQL, PostgreSQL). You will be responsible for designing, implementing, and maintaining scalable data solutions in the cloud, providing technical leadership to the team, and ensuring the highest standards of performance, security, and cost-efficiency.

Key Responsibilities

• Architect and implement scalable data solutions using AWS services such as Lambda, Glue, and Step Functions
• Develop robust solution architectures considering scalability, performance, security, and cost optimization
• Demonstrate proficiency in cloud networking (VPCs, subnets, security groups, routing tables)
• Design efficient data models for optimal query performance
• Write and optimize SQL queries, identifying and resolving performance bottlenecks
• Manage ETL processes and data integration into Redshift, MySQL, and PostgreSQL
• Create documentation and provide training to team members
• Set up and manage logging and tracing mechanisms using AWS CloudTrail and AWS X-Ray
• Implement orchestration solutions using Apache Airflow and AWS Step Functions
• Use Athena for interactive query analysis of large datasets in Amazon S3
• Provide technical leadership and guidance, acting as a subject matter expert in AWS and data engineering technologies
• Write comprehensive solution documents and technical documentation
• Stay up-to-date with emerging technologies and industry trends
• Challenge business requirements and propose innovative solutions for efficiency and performance improvement

Required Skills & Experience

Good to Have