Talent.com
Esta oferta de trabalho já não está disponível no seu país.
Data Engineer

Data Engineer

Defined.aiLisboa, Portugal
Há 5 dias
Descrição do cargo

Description

What will you do?

  • Design and implement scalable PySpark-based data pipelines to process (clean, validate, package and deliver) multimodal AI training datasets (e.g., text, audio, video, images, etc.);
  • Develop ETL pipelines to fuel the Operations areas with data for their analytical dashboards;
  • Set software engineering tools, platforms, and best practices while performing trade-off analysis to best match engineering, product, and project constraints and expectations;
  • Operate data pipelines to ingest data from multiple sources, and deliver it to different destinations.
  • Help the Product Manager and stakeholders in structuring, breaking down, and prioritizing the product roadmap into backlog work items;
  • Collaborate with other software engineering teams such as SREs and DevOps to achieve your team’s goals;
  • Work together with Software Engineering teams so as to integrate the Data Platform with other tools and platforms.

Who are we looking for?

Do you have the drive to work in an innovative and ambitious environment?

We’re looking for someone with a determined and proactive mindset, someone inspired and passionate to help us achieve our goals. Our successful candidate is a strong critical thinker, reliable and transparent, with an ability to learn and communicate. We are looking for someone special to contribute to our unique culture.

  • BSc or MSc in Computer Science or similar background;
  • Experience in PySpark-based data pipelines and software quality best practices;
  • Worked with Azure services such as Synapse Analytics (mainly PySpark Jobs, Pipelines, and Notebooks), ADLS, Power BI, DevOps, and SQL and NoSQL databases;
  • Solid understanding of data-related architectures, concepts, technologies, and processes (e.g., Medallion, Data Lake, Data Lakehouse, Data Warehouse, ETL, etc.);
  • Comfortable with evaluating and applying software design and architectural patterns / principles;
  • Knowledge of RESTful APIs based on FastAPI, from the provider as well as the consumer point of view;
  • Problem Solving skills;
  • Proficient in both written and spoken English.

    • Benefits

    You spend a lot of your time at work, so it should be challenging, fun and interesting. At Defined.ai it will be all of those things and more. Here’s what we offer :

  • Flexible working schedule and hybrid model.  We know comfort can boost creativity and performance, so you can manage your schedule and work both from one of our modern office spaces or home.
  • Excellent career development opportunities in a high growth company.  With us, you can accomplish your career goals and follow a well-described career path with the support of your supervisor.
  • Culture of feedback and continuous improvement.  AI is a fast-paced area, so we keep track of tech trends, and we always ask for feedback.
  • An international and diverse team.  We have more than 30 nationalities at our 3 locations, and we provide language classes.
  • Continuous training opportunities.  You can choose from many options : leveraging hand-on workshops, unlimited access to Udemy and formal development opportunities.
  • We love to have fun together.  We joke a lot, and we can't imagine work without fun activities – we already surfed, raced carts and played soccer together.
    • Criar um alerta de emprego para esta pesquisa

    Data Engineer • Lisboa, Portugal