Position Description :
Tasks Description
Explore, clean, and analyse large and complex datasets to support business objectives
Design and implement scalable data processing to handle large volumes of data efficiently and effectively; optimize and fine-tune these pipelines for performance and reliability
Collaborate with other data engineers, data analysts, and business stakeholders to identify and define use cases, formulate hypotheses, and design solutions
Design high-performance data pipelines
Participate in project code reviews
Automate the end-to-end release of artifacts across environments
Conduct daily ETL job checks and take the necessary actions with production & functional support teams
Contribute to the integrity of the infrastructure setup (define priorities, efficiently create and track the progress of several issues)
Your future duties and responsibilities :
Skills
Fluent in English (level C1-C2)
Deep understanding of the software development cycle (development, deployment & support of large-scale data lake / warehouse / mesh)
Solid knowledge and hands-on experience with programming languages – Python, Scala / PySpark are a plus
Strong ability to manipulate, transform, and clean large and complex datasets
Experience with data wrangling, ETL processes, and reporting solutions – Alteryx is a plus
Knowledge of data mesh concepts / tools and implementation is preferred – e.g. Starburst and Trino
Strong problem-solving skills, with the ability to think critically, analyse complex problems, and derive actionable insights from data
Excellent written and verbal communication skills, with the ability to explain complex technical concepts to both technical and non-technical stakeholders
Demonstrated ability to work effectively in cross-functional teams and collaborate with individuals from diverse backgrounds; experience in international teams is a plus
Required qualifications to be successful in this role :
Experience
6+ years experience as a Data Engineer
LI-CP1
Skills :Senior Data Engineer • Lisbon, Portugal