Talent.com
A vaga não está disponível no seu país.
Senior Data Engineer

Senior Data Engineer

CGILisbon, Portugal
Há 9 dias
Descrição da vaga

Position Description :

Tasks Description

Explore, clean, and analyse large and complex datasets to support business objectives

Design and implement scalable data processing to handle large volumes of data efficiently and effectively; optimize and fine-tune these pipelines for performance and reliability

Collaborate with other data engineers, data analysts, and business stakeholders to identify and define use cases, formulate hypotheses, and design solutions

Design high-performance data pipelines

Participate in project code reviews

Automate the end-to-end release of artifacts across environments

Conduct daily ETL job checks and take the necessary actions with production & functional support teams

Contribute to the integrity of the infrastructure setup (define priorities, efficiently create and track the progress of several issues)

Your future duties and responsibilities :

Skills

Fluent in English (level C1-C2)

Deep understanding of the software development cycle (development, deployment & support of large-scale data lake / warehouse / mesh)

Solid knowledge and hands-on experience with programming languages – Python, Scala / PySpark are a plus

Strong ability to manipulate, transform, and clean large and complex datasets

Experience with data wrangling, ETL processes, and reporting solutions – Alteryx is a plus

Knowledge of data mesh concepts / tools and implementation is preferred – e.g. Starburst and Trino

Strong problem-solving skills, with the ability to think critically, analyse complex problems, and derive actionable insights from data

Excellent written and verbal communication skills, with the ability to explain complex technical concepts to both technical and non-technical stakeholders

Demonstrated ability to work effectively in cross-functional teams and collaborate with individuals from diverse backgrounds; experience in international teams is a plus

Required qualifications to be successful in this role :

Experience

6+ years experience as a Data Engineer

LI-CP1

Skills :
  • English
  • Data Engineering
  • MS SQL Server
  • Software Architecture
  • Criar um alerta de emprego para esta pesquisa

    Senior Data Engineer • Lisbon, Portugal