A vaga não está disponível no seu país.
Senior Data Engineer
DevexpertsPorto, PTHá +30 dias
Descrição da vagaContainerise applications using Docker for streamlined deployment and scaling, Orchestrate and manage containers effectively with Kubernetes in production environments, Implement infrastructure as code using Terraform for provisioning and managing AWS resources. Collaborate with cross-functional teams to understand data requirements and architect scalable solutions aligned with business goals, Ensure data quality and reliability through robust testing methodologies and monitoring solutions, Stay updated with emerging technologies and industry trends to continuously enhance the data engineering ecosystem. Bachelor's degree in Computer Science, Engineering, or related field, Minimum 5 years of hands-on experience in Java / Scala / Python development, emphasising object-oriented principles. Proficiency in Apache Spark or PySpark for large-scale data processing, Experience with Airflow for workflow orchestration in production environments, Familiarity with Docker for containerisation and Kubernetes for container orchestration, Experience managing AWS services such as S3, EMR, Glue, Athena, and Redshift, Strong background in SQL and relational databases. Excellent English language communication skills, both verbal and written, Ability to collaborate effectively with technical and non-technical stakeholders. Experience with streaming platforms such as Kafka for real-time data processing, Knowledge of Terraform for infrastructure as code implementation in AWS environments.
Company Description
Devexperts works with respected financial institutions, delivering products and tailor-made solutions for retail and brokerage houses, exchanges, and buy-side firms. The company focuses on trading platforms and brokerage automation, complex software development projects, market data products, and IT consulting services.
Job Description
We are looking for a Senior Data Engineer with a Java / Scala / Python background to join the Research & Development Team.
Our current project is for a Top-5 US retail broker (by the number of users). The project is devoted to trading experience, finance reports, and risk management.
You will join cross-functional team that excels in getting features done from zero to production.
We expect the Senior Data Engineer to :
1. Develop Data Pipeline :
- Design, develop, and maintain robust data pipelines using Java within AWS infrastructure,
- Implement scalable solutions for data analysis and transformation using Apache Spark and PySpark,
- Utilise Airflow for efficient workflow orchestration in complex data processing tasks,
- Ensure fast and interactive querying capabilities through the use of Presto.
2. Manage Infrastructure :
3. Collaborate and Communicate :
Qualifications
Must-have skills :
1. Education and Experience :
2. Technical Proficiency :
3. Communication Skills :
Nice-to-have skills :
Criar um alerta de emprego para esta pesquisa
Senior Data Engineer • Porto, PT
Vagas relacionadas
![Data Engineer [Medior / Senior] - Portugal](https://cdn-dynamic.talent.com/ajax/img/get-logo.php?empcode=deus-humanity-centered-ai&empname=DEUS%3A%20human(ity)-centered%20AI)
Noesis is looking for candidates with the following profile : .Degree in Computer Science, Management Informatics, Mathematics or similar.
.Minimum of 3 years of experience as Data Engineer;.Previous ...Mostre maisÚltima atualização: 19 dias atrás
- Promovida
Senior Data Engineer
PrimeITPorto, Distrito de Porto, Portugal PrimeIT is a leading company with 19 international offices, specialized in providing IT, Telecommunications, and Engineering services.
We drive our partners’ businesses through cutting-edge technolo...Mostre maisÚltima atualização: 11 dias atrás
Data Engineer [Medior / Senior] - Portugal
DEUS : human(ity)-centered AIPorto, Porto District Are you obsessed with the possibilities of the emerging fields of artificial intelligence? Do you believe we can design & develop our own futures? Are you proactive and passionate?.We’re looking fo...Mostre maisÚltima atualização: 23 dias atrás
- Promovida
Data Engineer
AffinityPorto, Distrito de Porto, Portugal A Job? Or a Lifetime Experience? Start Yours Here!.A nossa missão é ser uma parte significativa da carreira das nossas pessoas.
À medida que crescemos, cresce também a determinação em oferecer a mel...Mostre maisÚltima atualização: há mais de 30 dias
Senior Data Engineer
Adecco RecruitmentPorto, Portugal We are hiring Tech Lead / Senior Data Engineer (M / F).Tech Lead / Senior Data Engineer.As a key technical leader, you will contribute to the design and implementation of batch and real-time data pip...Mostre maisÚltima atualização: 24 dias atrás
Senior Data Analytics Engineer
Nitro SoftwarePorto, Portugal A global SaaS leader for seamless digital document workflows, Nitro offers a suite of solutions for PDF, eSigning, identity verification and analytics supported by a best-in-class customer success ...Mostre maisÚltima atualização: há mais de 30 dias
Senior Data Engineer (m / f / d)
Kuehne+NagelPorto, Porto, Portugal JOB DESCRIPTION As one of the world's leading logistics companies, we have opened a new IT Hub in Porto, Portugal.Our goal is to accelerate digital technologies for our global customers, focusing o...Mostre maisÚltima atualização: 23 dias atrás
Senior Data Engineer Python - Cyber Security
Client ServerPorto Senior Data Engineer (Python Spark ETL) Porto / WFH to €80,000.Are you a tech savvy Data Engineer keen to make an impact, delivering Greenfield systems?.
You could be progressing your career at a su...Mostre maisÚltima atualização: 10 dias atrás
- Promovida
Data Engineer
ALTENPorto, Distrito de Porto, Portugal At ALTEN, we are certain that the success of our projects is due to the people who make up our team.That’s why, if you have at least 3 years of experience as a.
Do you want to build the world of tom...Mostre maisÚltima atualização: 26 dias atrás
Data Engineer
NoesisPorto, PortugalQuick Apply
Senior Data Engineer
BJSSPorto BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services.
This role combines the discipline of software engineering with the kn...Mostre maisÚltima atualização: há mais de 30 dias
Senior Data Engineer
SWORD Health, IncPorto Sword Health is on a mission to free two billion people from pain.With 67% of members achieving a pain-free life and a 70% reduction in surgery intent, at Sword, we are using AI Care to change live...Mostre maisÚltima atualização: há mais de 30 dias
- Promovida
Senior Data Engineer
DecskillPorto, Porto, Portugal IT Consulting Company, places paramount importance on its greatest asset : its people.Our main mission is to deliver value through knowledge and talent, and we achieve this by fostering a culture of...Mostre maisÚltima atualização: há mais de 30 dias
Senior Software Engineer - Backend - Data
Five9Porto, Portugal (Hybrid) Be part of an agile team to develop and maintain our existing highly available reporting services.Collaborate with product managers, architects, engineering leaders and test engineers.Design, const...Mostre maisÚltima atualização: 23 dias atrás
Data Engineer
GRiT SolutionsPorto, PT Building Data Highways : Data Engineer Position Available!.There's no secret to become number-one, it takes willingness to improve and determination to pursue it.
At GRiT®, it’s all about the journey...Mostre maisÚltima atualização: 13 dias atrás
- Promovida
Senior Data Engineer
Match ProfilerPorto, Distrito de Porto, Portugal A Match Profiler é uma consultora de Sistemas de Informação que atua desde 1999 no mercado nacional e internacional.Temos competências multidisciplinares e know-how na área de IT que nos permite co...Mostre maisÚltima atualização: 4 dias atrás
- Promovida
Senior Data Engineer
Next EngineeringPorto, Distrito de Porto, Portugal Are you the NEX T Senior Data Engineer ?.Bachelor degree in Data Science, Computer Science (or equivalent);.Experience with technologies such as Spark / Scala / Python / Java;.Strong skills with CI / C...Mostre maisÚltima atualização: 7 dias atrás
Senior Data Engineer (all genders)
diconium dataPorto, PT Diconium ist Spezialist in den Gebieten Daten und Künstliche Intelligenz.Ob in den Bereichen Search, Social und Content, Personalisierung und Analytics, Data Engineering oder Data Science – unsere ...Mostre maisÚltima atualização: há mais de 30 dias
Senior Data Engineer (M / F / D)
HAYSPorto Join a leading global organisation at the forefront of digital transformador and AI innovation.Our client is dedicated to leveraging cutting-edge technology to drive business value and enhance oper...Mostre maisÚltima atualização: 24 dias atrás