Inscreva-se para aceder a todos os recursos do nosso serviço
  • Pesquisa de emprego
  • Favorito
  • Criar um CV
    Novo
  • Salários
  • Alertas de emprego

Senior Data Engineer | Real-Time & Streaming

Efetivo

Alongside

Alongside partners with organizations to drive digital transformation and build high-performing tech teams .

We are looking for a Senior Data Engineer to join a project with one of our clients operating in the financial markets industry .

You will design, build, and operate real-time data products on an enterprise data platform, taking ownership from event ingestion and stream processing to the APIs and services used by consumers. This is a hands-on role combining advanced streaming engineering, production ownership, and technical guidance.

Responsabilities:

  • Design and deliver end-to-end streaming data products using Apache Flink, Apache Kafka, and event-driven architectures.
  • Develop stateful stream-processing applications, including windowing, event-time handling, watermarks, checkpointing, and exactly-once processing guarantees.
  • Build and maintain resilient ingestion, transformation, and delivery pipelines for real-time and batch workloads.
  • Manage Kafka topics, partitioning, consumer groups, schemas, and schema evolution.
  • Design and develop REST APIs, streaming interfaces, and microservices with clear contracts, versioning, authentication, and rate limiting.
  • Deploy and operate services on AWS, using Infrastructure as Code with Terraform.
  • Embed data quality controls, automated testing, observability, and actionable alerting throughout the delivery lifecycle.
  • Build and improve CI/CD pipelines, including automated deployment, rollback, and safe release practices.
  • Monitor production services against agreed SLAs, investigate incidents, and optimise latency, throughput, reliability, and cost.
  • Apply security best practices across authentication, authorisation, encryption, secrets management, and least-privilege access.
  • Translate business requirements into technical designs, challenge assumptions, and propose practical solutions.
  • Review code and designs, mentor engineers, and contribute to engineering standards and technical documentation.

Requirements

  • 7+ years of professional experience in data engineering, including at least 3 years building and operating real-time or streaming systems in production.
  • Strong hands-on experience with Apache Flink in production, including DataStream APIs and Flink SQL.
  • Strong Java skills, with experience in Python/PyFlink or Scala also valued.
  • Solid experience with Apache Kafka, event-driven architectures, and schema management using Avro and Schema Registry.
  • Proven experience building APIs and microservices using REST and OpenAPI.
  • Strong AWS experience, including relevant services such as MSK, Kinesis, Managed Service for Apache Flink, Lambda, API Gateway, ECS/EKS, S3, and IAM.
  • Strong SQL and data modelling skills across streaming and batch workloads.
  • Experience with CI/CD tooling such as GitLab CI or GitHub Actions, alongside automated unit, integration, contract, and load testing.
  • Experience with observability tools such as CloudWatch, OpenTelemetry, Prometheus, and Grafana.
  • Fluency in English, both written and spoken.

Benefits

  • The opportunity to build production-grade real-time data products within the financial markets industry.
  • End-to-end ownership across streaming pipelines, APIs, and production operations.
  • Collaboration with platform engineers, product owners, and business stakeholders.
  • Scope to influence technical decisions, improve engineering practices, and mentor other engineers.
  • Hybrid working model in Porto.
Vaga publicada 12 dias atrás
Empregos semelhantes que podem ser interessantes para vocêCom base na vaga Senior Data Engineer | Real-Time & Streaming em Porto
  •  ...globally. Our Digital & AI team helps clients modernize their data estates, optimize data platforms, and deliver scalable...  ...business growth and transformation. We are looking for a Senior Data Engineer to join our growing Digital & AI practice in Portugal (Porto... 

    LGG Advisors

    Porto
    12 dias atrás
  •  ...Unleash the Power of Data — Shape the Future of Financial Innovation! Lisbon, Porto-based opportunity with hybrid work model. As a Senior Data Engineer, you will be working for our client, a leading banking group dedicated to pioneering innovative data solutions... 

    ITDS Portugal

    Porto
    5 dias atrás
  • A Noesis procura um(a) Senior Data Engineer com experiência em arquitetura de dados ou liderança técnica para integrar uma equipa de Data Engineering...  ...e processamento de grandes volumes de dados em batch e/ou streaming; * Conhecimento sólido de boas práticas de engenharia,... 

    Noesis

    Porto
    6 dias atrás
  •  ...At Nimber, we're looking for a Senior Data Engineer to join an international banking project, contributing to the development and optimisation of data solutions within a Business Intelligence (BI) team. You'll be part of a collaborative environment focused on building... 

    Nimber

    Porto
    6 dias atrás
  •  ...experience driven by an experienced and senior team that helps clients make the...  ...to join WIRE IT. Role: Data Engineer Tech Lead Location: Remote, Portugal...  ...experience leading the delivery of real-time data products and streaming solutions in production... 

    Wire IT

    Porto
    16 dias atrás
  •  ...Transform complex data into decisive insight — engineer scalable pipelines and analytics that power the future of banking! Lisbon or Porto-based opportunity...  ..., including up to 2 remote days per week. As a Senior Data Analyst & ETL Engineer , you will be working for... 

    ITDS Portugal

    Porto
    Um mês atrás
  •  ...people are the ones who can change the world: one code line at a time. We have several projects waiting for you all over Portugal...  ...take your career to the next level. Are you a savvy Data Engineer seeking a new challenge in a dynamic team of analytics experts... 

    Growin - Know to grow

    Porto
    6 dias atrás
  •  ...services in Information Technology and Engineering services. As part of the Netherlands-based...  ...most ambitious projects, at the right time. Our success comes from our investments...  ...Overview: We are looking for a  Data Engineer  to integrate our teams and contribute... 

    Neotalent Conclusion

    Porto
    6 dias atrás
  •  ...oportunidades na área de IT? Temos novidades para ti! Este pode ser o desafio perfeito, se tiveres: ~+5 anos de experiência como Data Engineer ~ Experiência sólida com Python, PySpark e SQL ~ Experiência com Azure Databricks e Azure Synapse ~ Conhecimentos de Azure... 

    Integer Consulting

    Porto
    2 dias atrás
  •  ...responsabilidades Definir a arquitetura e roadmap de uma solução Data Lakehouse. Desenvolver pipelines de dados com Databricks,...  ...que procuramos Mais de 5 anos de experiência sólida em Data Engineering e/ou Data Platform Architecture. Experiência sólida com... 

    Hays

    Porto
    6 dias atrás
  •  ...constante mudança. A Randstad Digital está a recrutar um(a) Data Engineer Lead para integração direta numa multinacional, com...  ...multifuncionais envolvidas em projetos de dados. Reportar à liderança sénior o progresso, o desempenho e o impacto das iniciativas de... 

    Randstad Portugal

    Porto
    10 dias atrás
  •  ...Estamos a reforçar a nossa equipa na Integer com um Data Engineer para integrar um projeto em regime híbrido no Porto. Se tens experiência em cloud (especialmente AWS), ferramentas IaC e ecosistemas BigData esta pode ser a oportunidade certa para o teu próximo desafio... 

    Integer Consulting

    Porto
    6 dias atrás
  •  ...services in Information Technology and Engineering services. As part of the Netherlands-...  ...ambitious projects, at the right time. Our success comes from our investments...  ...Overview: We are looking for a  Data Visualization Engineer to integrate our teams and support the... 

    Neotalent Conclusion

    Porto
    14 dias atrás
  •  ...Fyld is hiring: Data Engineer At Fyld, we believe the future is built with people, technology, and strong values. We are a Portuguese...  ...s growth. Here, every project is an opportunity to build real, lasting, and scalable solutions. Our philosophy? Code for... 

    Fyld

    Porto
    13 dias atrás
  •  ...At Celfocus, we make data actionable through Next...  ...We are looking for a Senior Data Scientist with strong...  ...machine-learning models for real-world business problems...  ...technical excellence, timely delivery, and alignment...  ...in Computer Science, Engineering, Mathematics,... 

    Celfocus

    Porto
    23 dias atrás
  •  ...Experiência na criação de arquiteturas baseadas em dados, de preferência em plataformas de nuvem pública; Experiência com Big Data e modelagem de dados; Familiaridade com ferramentas do ecossistema Big Data (como Hadoop, Cassandra, Apache Hive, Apache Spark,... 

    Integer Consulting

    Porto
    10 dias atrás
  •  ...medida. Descrição do perfil: - Licenciatura em Engenharia Informática ou similar; - Experiência de 5+ anos em funções de Data Science; - Experiência com a linguagem Python; - Conhecimentos de bibliotecas Pyhton (Pandas e/ou TensorFlow e/ou PyTorch,…);... 

    agap2IT

    Porto
    2 dias atrás
  •  ...: 5397 | Work Model : Full-Time | Contract Type : Permanent...  ...develop and maintain scaleable data pipelines Implement data...  ...specialists, data scientists and cloud engineers Qualifications...  ...collaborative work environment ~ Real opportunities for career... 

    DACHSER & FERCAM

    Porto
    2 meses atrás
  •  ...opportunity to create technology with impact. SENIOR DATA ANALYST What We Are Looking For We...  ...Run and monitor Python-based analytical engines on a regular basis. Collect, analyze,...  ..., innovation, and proximity to create real impact for organizations and society.... 

    Axians | Digital Solutions - Tech Talent

    Porto
    17 dias atrás
  •  ...consultants, Security experts, Engineers, Developers and other...  ...leaders on cloud, data and cyber security. Let’s...  ...experienced and dedicated GCP Data Engineer to join our team. You...  .... Experience with streaming data technologies and real-time processing within GCP.... 

    Devoteam

    Porto
    17 dias atrás
  •  ...ABOUT THE ROLE We are looking for a Senior Data Analyst to develop governed HR metrics,...  ...agentic workflows. - Work with Data Engineers to independently vet the accuracy of...  ...out unclear requirements, and deliver on time. MUST HAVES - 4+ years of experience... 

    AgileEngine

    Porto
    2 dias atrás
  •  ...consultants, Security experts, Engineers, Developers and other...  ...leaders on cloud, data and cyber security....  ...looking for a Data Engineer with expertise in AWS...  ...understanding for Kafka streaming; Familiarity with cloud...  ...learning initiatives, real-time data analytics, and... 

    Devoteam

    Porto
    17 dias atrás
  •  ...days on-site Contract: Full-time Salary: €50,000–€65,000...  ...the Role We are looking for a Senior Database Developer / Data Platform Engineer to design and evolve the data...  ...scalable database structures for real-time and analytical use cases Optimize... 

    Velenosi&Meredith

    Porto
    2 meses atrás
  •  ...! Descrição da vaga We are looking for an experienced Senior Data Analyst to join our team and play a key role in transforming...  ...and maintain Python-based analytical models and data processing engines. Collect, analyze, and interpret data from multiple... 

    Inetum Portugal

    Porto
    5 dias atrás
  •  ...Information Technology and Engineering services. As part of the Netherlands...  ...projects, at the right time. Our success comes from our...  ...We are looking for a  Data Engineer (AWS)to integrate one of our...  ...Sqoop, Flume, Impala, Kafka Streams and Connect, Druid, etc.;... 

    Neotalent Conclusion

    Porto
    2 meses atrás
  •  ...Information Technology and Engineering services. As part of the...  ...ambitious projects, at the right time. Our success comes from...  ...We are looking for Senior Digital Workplace Engineer to integrate our teams in...  ...operational devices), ensuring data protection and application... 

    Neotalent Conclusion

    Porto
    9 dias atrás
  •  ...driven by an experienced and senior team that helps clients make the...  ...IT. Role: Senior Data Architect Location: Hybrid...  ...4 years of experience in Data Engineering, Data Modelling or Data Architecture...  ...offer: ~ No-term full-time contract; ~ Health Insurance... 

    Wire IT

    Porto
    24 dias atrás
  •  ...position are welcome!   We are looking for an Amazing: Data Engineer Seniority: Mid-level (5+ years) Type of position:  Hybrid model...  ...Apache Spark. Experience with Apache Kafka or other event-streaming technologies.   Why should you become part of our... 

    KCS IT

    Porto
    2 meses atrás
  •  ...on the development of innovative solutions and support for all operations related to the business. We are looking for a  Data Engineer (Informatica PowerCenter) to work in this project in Porto or Lisbon (Hybrid). Required skills and experience: - 6+... 

    Dellent

    Porto
    5 dias atrás
  •  ...Luxclusif has pioneered the global luxury resale market, with advanced data-driven solutions to facilitate the buying and selling of high-...  ...and machine learning techniques. Working closely with our Engineers and Analysts in highly impactful and complex challenges. Design... 

    Farfetch

    Porto
    13 dias atrás

Deseja receber mais vagas?

Assine e receba vagas semelhantes a Senior Data Engineer | Real-Time & Streaming. Seja o primeiro a se candidatar!