Data Engineer ID89384
AgileEngine
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
ABOUT THE ROLE
We are looking for a Data Engineer with strong Databricks and GCP experience to develop scalable ETL/ELT pipelines and productionize agentic workflows for data engineering automation.
MUST HAVES
- 5+ years of strong hands-on experience with Databricks and PySpark.
- Advanced SQL and data-processing skills.
- Hands-on experience with GCP, particularly BigQuery .
- Experience with Delta Lake and modern data lake/lakehouse architectures .
- Strong understanding of ETL/ELT, data pipeline design, performance optimization, and data quality.
- Experience building reliable, scalable, production-grade data solutions.
- Strong analytical and troubleshooting skills.
- Understanding of software engineering practices, including testing, version control, deployment, monitoring, and production support.
- Upper-intermediate English level.
NICE TO HAVES
- Experience developing or integrating AI/agentic workflows, AI agents, or workflow automation solutions.
- Experience applying AI to automate data engineering, validation, troubleshooting, or operational processes.
- Familiarity with orchestration and automation frameworks.
- Experience developing reusable data engineering frameworks and platform components.
- Exposure to productionizing AI-enabled solutions with appropriate validation, monitoring, and human oversight.
WHAT YOU WILL DO
- Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, and SQL.
- Build and operationalize agentic workflows to automate data engineering and operational processes such as data validation, issue identification, troubleshooting, and workflow execution.
- Integrate agentic capabilities with existing Databricks, GCP, BigQuery, and Delta Lake environments.
- Develop data pipelines and processing solutions to support new business requirements and datasets.
- Build reusable frameworks and components that can be leveraged across multiple data engineering and business use cases.
- Implement data quality checks, monitoring, validation, exception handling, and production controls.
- Optimize PySpark and SQL workloads for performance, reliability, and scalability.
- Support testing, deployment, productionization, and ongoing enhancement of data and agentic solutions.
- Troubleshoot complex data and production issues and implement sustainable solutions.
- Collaborate with business, data engineering, and platform teams to identify further automation opportunities.
PERKS AND BENEFITS
- Professional growth : Mentorship, TechTalks, and personalized growth roadmaps.
- Competitive compensation : USD-based pay with education, fitness, and team activity budgets.
- Exciting projects : Modern solutions with Fortune 500 and top product companies.
- Flextime : Flexible schedule with remote and office options.
Meet Our Recruitment Process
Application → Coding Challenge → Video Interview → Technical Interview or Hiring Manager Interview
Each step helps us understand your skills and overall fit.
If it’s a match, you’ll receive an offer.
- ...oportunidades na área de IT? Temos novidades para ti! Este pode ser o desafio perfeito, se tiveres: ~+5 anos de experiência como Data Engineer ~ Experiência sólida com Python, PySpark e SQL ~ Experiência com Azure Databricks e Azure Synapse ~ Conhecimentos de Azure...
Integer Consulting
Aveiro8 dias atrás - ...place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Airflow workflows. MUST HAVES -...
- ...customer needs. You will work on projects about Cloud Adoption, Data Integration and Cloud Native Services, in a multicultural team with... ...in Portugal and Germany. We are looking for a Cloud Engineer to work in this project in Aveiro . Requirements: - BSc...
Dellent
Aveiro15 dias atrás - ...market leader in sports tech. We provide the most trusted sports data to some of the world's biggest organizations, across sports,... ...are only half of the package. We need great people to fuel the engine. We succeeded thanks to a team of amazing people. They spend...
Stats Perform
Aveiro2 meses atrás - ...market leader in sports tech. We provide the most trusted sports data to some of the world's biggest organizations, across sports,... ...are only half of the package. We need great people to fuel the engine. We succeeded thanks to a team of amazing people. They spend...
Stats Perform
Aveiro2 meses atrás - ...you! ABOUT THE ROLE We are looking for a Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind an event-... ...Kafka Streams, MirrorMaker, or managed Kafka services. - Change-data-capture patterns and tooling. - Infrastructure supporting...
- ...THE ROLE We are looking for a Python Application Security Engineer to automate security controls and improve vulnerability management... ..., DAST, SCA) seamlessly into the CI/CD pipeline. - Security Data Triage: Continuously tune and configure existing security...
- ...ABOUT THE ROLE We are looking for a Senior Agentic AI Engineer to design and build agentic workflows and AI-powered products for... ...Design and build agentic workflows that coordinate tools, services, data, and human approvals. - Develop reusable patterns for agent...
- A Stats Perform está a recrutar um/a Data Collection Analyst para integrar a equipa de Operations, em Aveiro. A função integra a área de Fast Data Support e tem como foco assegurar a qualidade dos dados desportivos recolhidos por Scouts em todo o mundo, atuando como...
Stats Perform
Aveiro2 meses atrás - ..., focused on innovation, sustainability and collaboration, Bosch Aveiro joins together experts in diverse areas, from mechanical engineering to connectivity and software solutions, as well as industrialization and quality. At Bosch, we shape the future by inventing high...
- ...Aveiro joins together experts in diverse areas, from mechanical engineering to connectivity and software solutions, as well as... ...contribution to something big: As a Process & Industrialization Engineer , you will play a key role in driving continuous improvement,...
- ...Aveiro joins together experts in diverse areas, from mechanical engineering to connectivity and software solutions, as well as... ...Description Your contribution to something big: As a Development Engineer – Reliability Responsible, you will play a key role in ensuring...
Bosch
Aveiro20 dias atrás - ..., focused on innovation, sustainability and collaboration, Bosch Aveiro joins together experts in diverse areas, from mechanical engineering to connectivity and software solutions, as well as industrialization and quality. At Bosch, we shape the future by inventing high...
- ..., and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Python Application Security Engineer to automate application security controls and integrate secure coding practices into software development and cloud workflows....
- ...make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Site Reliability Engineer to operate and improve a Kubernetes-based API platform across public and private cloud environments, including automation,...
- ...leaders in the creation and distribution of fixed and mobile television, internet, voice and data solutions in Portugal. We are looking for a Workplace Services Engineer L2 – EUC / Endpoint Management . This is a fully remote opportunity, open to candidates based...
Dellent
Aveiro29 dias atrás - ...Company description Terry Soot Management Group (TSMG) is a field data collection company founded in 2017 in Europe. We collect data where automation is not possible. We count features, take pictures, make videos, record speech, and scan areas for every detail you...
- ...Aveiro joins together experts in diverse areas, from mechanical engineering to connectivity and software solutions, as well as... ...Artificial Intelligence tools to automate reporting activities, improve data validation processes, and strengthen decisions through the "four...
- ...these roles go live. We are looking for a Senior InRiver PIM Engineer to maintain system integrations and customize InRiver PIM... ...working alongside senior experts in a remote-first environment where data integrity and integration optimization are at the forefront....
- ...A Adecco Recruitment está a recrutar um Automation Engineer para integrar uma empresa multinacional de referência no setor industrial, em Santa Maria da Feira . Se tem experiência em automação industrial, programação de PLCs e procura um desafio internacional com forte...
- ...Field Sales Engineer _ Zona Centro A Adecco Permanent Recruitment encontra-se a recrutar um Field Sales Engineer para integrar uma multinacional de referência no setor industrial. Esta função integra a área de soluções de ar comprimido de baixa pressão e terá como principal...
- ...A Elevus encontra-se a recrutar um(a) DevOps Engineer para integrar uma empresa tecnológica inovadora, com foco no desenvolvimento de soluções IoT para Smart Cities, Indústria e Healthcare. Procuramos um profissional com forte experiência em infraestrutura, automação...
- ...experts in diverse areas, from mechanical engineering to connectivity and software solutions,... .... As a Lab Testing Technologies Engineer , you will contribute to the development... ...development and maintenance of a centralized test data database accessible to relevant...
Bosch Group
Aveiro2 meses atrás - ...Aveiro joins together experts in diverse areas, from mechanical engineering to connectivity and software solutions, as well as... ...unleash our full potential. Job Description As Firmware Engineer you are involved in the entire software development process, from...
- ..., developing, and maintaining high-performance eCommerce solutions for innovative brands, working alongside a community of senior engineers in a remote-first environment. You will drive deep code analysis, platform architecture, and eCommerce roadmap strategy while providing...
- ...At Mindera, we are continuously developing a fantastic team, and we would love for you to join us. As a Staff Frontend Software Engineer, you will be responsible for building fluid and responsive user interfaces for multiple platforms and devices. We are looking for...
€29,000 a €35,000 por año
...e empregou aproximadamente 4.000 pessoas em mais de 40 países. ## Job Description **Your responsibilities as Mechanical Process Engineer will be:** - Mechanical Engineer; - Machine Building Experience; - CAD/ProE/CREO developer; - Knowledge of pneumatics systems; -...- ..., focused on innovation, sustainability and collaboration, Bosch Aveiro joins together experts in diverse areas, from mechanical engineering to connectivity and software solutions, as well as industrialization and quality. At Bosch, we shape the future by inventing high...
- ...functional programming, memory management, async/concurrency, and data structures). - API & Microservices: Proven track record of... .... - Mentorship & Collaboration: Collaborate with frontend engineers, product managers, and DevOps teams; mentor junior and mid-...
- ...developer-focused content). - Deep familiarity with prompt engineering and ability to design effective prompts, configure AI tools,... ...APIs, event streaming, batch processing, system architecture, and data models . Ability to understand complex concepts and write...
Deseja receber mais vagas?
Assine e receba vagas semelhantes a Data Engineer ID89384. Seja o primeiro a se candidatar!
