Senior Data Engineer | Real-Time & Streaming
Alongside
Alongside partners with organizations to drive digital transformation and build high-performing tech teams .
We are looking for a Senior Data Engineer to join a project with one of our clients operating in the financial markets industry .
You will design, build, and operate real-time data products on an enterprise data platform, taking ownership from event ingestion and stream processing to the APIs and services used by consumers. This is a hands-on role combining advanced streaming engineering, production ownership, and technical guidance.
Responsabilities:
- Design and deliver end-to-end streaming data products using Apache Flink, Apache Kafka, and event-driven architectures.
- Develop stateful stream-processing applications, including windowing, event-time handling, watermarks, checkpointing, and exactly-once processing guarantees.
- Build and maintain resilient ingestion, transformation, and delivery pipelines for real-time and batch workloads.
- Manage Kafka topics, partitioning, consumer groups, schemas, and schema evolution.
- Design and develop REST APIs, streaming interfaces, and microservices with clear contracts, versioning, authentication, and rate limiting.
- Deploy and operate services on AWS, using Infrastructure as Code with Terraform.
- Embed data quality controls, automated testing, observability, and actionable alerting throughout the delivery lifecycle.
- Build and improve CI/CD pipelines, including automated deployment, rollback, and safe release practices.
- Monitor production services against agreed SLAs, investigate incidents, and optimise latency, throughput, reliability, and cost.
- Apply security best practices across authentication, authorisation, encryption, secrets management, and least-privilege access.
- Translate business requirements into technical designs, challenge assumptions, and propose practical solutions.
- Review code and designs, mentor engineers, and contribute to engineering standards and technical documentation.
Requirements
- 7+ years of professional experience in data engineering, including at least 3 years building and operating real-time or streaming systems in production.
- Strong hands-on experience with Apache Flink in production, including DataStream APIs and Flink SQL.
- Strong Java skills, with experience in Python/PyFlink or Scala also valued.
- Solid experience with Apache Kafka, event-driven architectures, and schema management using Avro and Schema Registry.
- Proven experience building APIs and microservices using REST and OpenAPI.
- Strong AWS experience, including relevant services such as MSK, Kinesis, Managed Service for Apache Flink, Lambda, API Gateway, ECS/EKS, S3, and IAM.
- Strong SQL and data modelling skills across streaming and batch workloads.
- Experience with CI/CD tooling such as GitLab CI or GitHub Actions, alongside automated unit, integration, contract, and load testing.
- Experience with observability tools such as CloudWatch, OpenTelemetry, Prometheus, and Grafana.
- Fluency in English, both written and spoken.
Benefits
- The opportunity to build production-grade real-time data products within the financial markets industry.
- End-to-end ownership across streaming pipelines, APIs, and production operations.
- Collaboration with platform engineers, product owners, and business stakeholders.
- Scope to influence technical decisions, improve engineering practices, and mentor other engineers.
- Hybrid working model in Porto.
- ...globally. Our Digital & AI team helps clients modernize their data estates, optimize data platforms, and deliver scalable... ...business growth and transformation. We are looking for a Senior Data Engineer to join our growing Digital & AI practice in Portugal (Porto...
- ...Unleash the Power of Data — Shape the Future of Financial Innovation! Lisbon, Porto-based opportunity with hybrid work model. As a Senior Data Engineer, you will be working for our client, a leading banking group dedicated to pioneering innovative data solutions...
- A Noesis procura um(a) Senior Data Engineer com experiência em arquitetura de dados ou liderança técnica para integrar uma equipa de Data Engineering... ...e processamento de grandes volumes de dados em batch e/ou streaming; * Conhecimento sólido de boas práticas de engenharia,...
- ...At Nimber, we're looking for a Senior Data Engineer to join an international banking project, contributing to the development and optimisation of data solutions within a Business Intelligence (BI) team. You'll be part of a collaborative environment focused on building...
- ...experience driven by an experienced and senior team that helps clients make the... ...to join WIRE IT. Role: Data Engineer Tech Lead Location: Remote, Portugal... ...experience leading the delivery of real-time data products and streaming solutions in production...
- ...Transform complex data into decisive insight — engineer scalable pipelines and analytics that power the future of banking! Lisbon or Porto-based opportunity... ..., including up to 2 remote days per week. As a Senior Data Analyst & ETL Engineer , you will be working for...
- ...people are the ones who can change the world: one code line at a time. We have several projects waiting for you all over Portugal... ...take your career to the next level. Are you a savvy Data Engineer seeking a new challenge in a dynamic team of analytics experts...
- ...services in Information Technology and Engineering services. As part of the Netherlands-based... ...most ambitious projects, at the right time. Our success comes from our investments... ...Overview: We are looking for a Data Engineer to integrate our teams and contribute...
- ...oportunidades na área de IT? Temos novidades para ti! Este pode ser o desafio perfeito, se tiveres: ~+5 anos de experiência como Data Engineer ~ Experiência sólida com Python, PySpark e SQL ~ Experiência com Azure Databricks e Azure Synapse ~ Conhecimentos de Azure...
- ...responsabilidades Definir a arquitetura e roadmap de uma solução Data Lakehouse. Desenvolver pipelines de dados com Databricks,... ...que procuramos Mais de 5 anos de experiência sólida em Data Engineering e/ou Data Platform Architecture. Experiência sólida com...
- ...constante mudança. A Randstad Digital está a recrutar um(a) Data Engineer Lead para integração direta numa multinacional, com... ...multifuncionais envolvidas em projetos de dados. Reportar à liderança sénior o progresso, o desempenho e o impacto das iniciativas de...
- ...Estamos a reforçar a nossa equipa na Integer com um Data Engineer para integrar um projeto em regime híbrido no Porto. Se tens experiência em cloud (especialmente AWS), ferramentas IaC e ecosistemas BigData esta pode ser a oportunidade certa para o teu próximo desafio...
- ...services in Information Technology and Engineering services. As part of the Netherlands-... ...ambitious projects, at the right time. Our success comes from our investments... ...Overview: We are looking for a Data Visualization Engineer to integrate our teams and support the...
- ...Fyld is hiring: Data Engineer At Fyld, we believe the future is built with people, technology, and strong values. We are a Portuguese... ...s growth. Here, every project is an opportunity to build real, lasting, and scalable solutions. Our philosophy? Code for...
- ...At Celfocus, we make data actionable through Next... ...We are looking for a Senior Data Scientist with strong... ...machine-learning models for real-world business problems... ...technical excellence, timely delivery, and alignment... ...in Computer Science, Engineering, Mathematics,...
- ...Experiência na criação de arquiteturas baseadas em dados, de preferência em plataformas de nuvem pública; Experiência com Big Data e modelagem de dados; Familiaridade com ferramentas do ecossistema Big Data (como Hadoop, Cassandra, Apache Hive, Apache Spark,...
- ...medida. Descrição do perfil: - Licenciatura em Engenharia Informática ou similar; - Experiência de 5+ anos em funções de Data Science; - Experiência com a linguagem Python; - Conhecimentos de bibliotecas Pyhton (Pandas e/ou TensorFlow e/ou PyTorch,…);...
- ...: 5397 | Work Model : Full-Time | Contract Type : Permanent... ...develop and maintain scaleable data pipelines Implement data... ...specialists, data scientists and cloud engineers Qualifications... ...collaborative work environment ~ Real opportunities for career...
- ...opportunity to create technology with impact. SENIOR DATA ANALYST What We Are Looking For We... ...Run and monitor Python-based analytical engines on a regular basis. Collect, analyze,... ..., innovation, and proximity to create real impact for organizations and society....
- ...consultants, Security experts, Engineers, Developers and other... ...leaders on cloud, data and cyber security. Let’s... ...experienced and dedicated GCP Data Engineer to join our team. You... .... Experience with streaming data technologies and real-time processing within GCP....
- ...ABOUT THE ROLE We are looking for a Senior Data Analyst to develop governed HR metrics,... ...agentic workflows. - Work with Data Engineers to independently vet the accuracy of... ...out unclear requirements, and deliver on time. MUST HAVES - 4+ years of experience...
- ...consultants, Security experts, Engineers, Developers and other... ...leaders on cloud, data and cyber security.... ...looking for a Data Engineer with expertise in AWS... ...understanding for Kafka streaming; Familiarity with cloud... ...learning initiatives, real-time data analytics, and...
- ...days on-site Contract: Full-time Salary: €50,000–€65,000... ...the Role We are looking for a Senior Database Developer / Data Platform Engineer to design and evolve the data... ...scalable database structures for real-time and analytical use cases Optimize...
- ...! Descrição da vaga We are looking for an experienced Senior Data Analyst to join our team and play a key role in transforming... ...and maintain Python-based analytical models and data processing engines. Collect, analyze, and interpret data from multiple...
- ...Information Technology and Engineering services. As part of the Netherlands... ...projects, at the right time. Our success comes from our... ...We are looking for a Data Engineer (AWS)to integrate one of our... ...Sqoop, Flume, Impala, Kafka Streams and Connect, Druid, etc.;...
- ...Information Technology and Engineering services. As part of the... ...ambitious projects, at the right time. Our success comes from... ...We are looking for Senior Digital Workplace Engineer to integrate our teams in... ...operational devices), ensuring data protection and application...
- ...driven by an experienced and senior team that helps clients make the... ...IT. Role: Senior Data Architect Location: Hybrid... ...4 years of experience in Data Engineering, Data Modelling or Data Architecture... ...offer: ~ No-term full-time contract; ~ Health Insurance...
- ...position are welcome! We are looking for an Amazing: Data Engineer Seniority: Mid-level (5+ years) Type of position: Hybrid model... ...Apache Spark. Experience with Apache Kafka or other event-streaming technologies. Why should you become part of our...
- ...on the development of innovative solutions and support for all operations related to the business. We are looking for a Data Engineer (Informatica PowerCenter) to work in this project in Porto or Lisbon (Hybrid). Required skills and experience: - 6+...
- ...Luxclusif has pioneered the global luxury resale market, with advanced data-driven solutions to facilitate the buying and selling of high-... ...and machine learning techniques. Working closely with our Engineers and Analysts in highly impactful and complex challenges. Design...
Deseja receber mais vagas?
Assine e receba vagas semelhantes a Senior Data Engineer | Real-Time & Streaming. Seja o primeiro a se candidatar!



