Receber novas ofertas de emprego por e-mail
- ...powering Analytics and AI solutions that put decision making on the next level; Working in the latest technologies such as Spark, Delta Lake, Airflow, Python, etc.; Use of Databricks to work in a Lakehouse concept. What are we looking for? A developer...
- ...Strong expertise in distributed storage technologies, particularly Azure Data Lake Storage, and data formats such as Parquet and Delta Lake. Experience across the full data solution lifecycle (ingestion, transformation, modeling, and data delivery). Proven ability...
KCS IT
Lisboa13 horas atrás - ...experience • A developer capable of creating state-of-the-art data applications using Python and SQL • Understanding of Spark, Delta lake and its internals • Knowledge of cloud platforms, data modeling, batch & streaming ETL, and databases • Experience with software...
- ...Strong expertise in distributed storage technologies, particularly Azure Data Lake Storage, and data formats such as Parquet and Delta Lake. Experience across the full data solution lifecycle (ingestion, transformation, modeling, and data delivery). Proven ability...
- ...Experience with data warehousing in tools such as Redshift, BigQuery or Snowflake. Experience with open format tables such as Iceberg or Delta is a plus. Experience with orchestration tools like Airflow. Building and maintaining DAGs is a plus. Experience with Apache...
- ...Cloud) with comparable tools. Hands-on experience with data warehousing and data lake solutions (e.g., BigQuery, Azure Data Lake, Delta Lake, Amazon Redshift). Proficiency in programming languages such as Python (with data-related libraries: e.g. Pandas, Boto3),...
- ...including development monitoring and performance tuning. Build and orchestrate data pipelines using tools such as Azure Data Factory Delta Lake and Databricks workflows . Apply strong security configuration practices including the use of Azure Key Vault RBAC...
- ...other cloud platforms such as AWS or Google Cloud; Hands-on experience with Data Warehouses and Data Lakes (e.g., Azure Data Lake, Delta Lake, BigQuery, Amazon Redshift); Solid proficiency in Python, SQL, and/or Spark applied to data-related contexts;...
- ...development, monitoring, and performance tuning; Build and orchestrate data pipelines using tools such as Azure Data Factory , Delta Lake , and Databricks workflows; Apply strong security configuration practices using Azure Key Vault , RBAC , private...
- ...MLflow; * Knowledge of CI/CD (GitHub Actions, GitLab CI, Jenkins, ...), IaC (Terraform) and Data Platforms (Databricks, Unity Catalog, Delta Lake) * Pragmatism and business-orientation. If you meet these conditions and would like to join an innovative organization that...
Noesis
PortoUm mês atrás - ...Spark Databricks Azure Synapse Kafka MS Fabric). Expertise in distributed storage (S3 Blob ADLS) and file formats (Parquet Avro Delta). Advanced programming skills in Python and SQL. Familiarity with cloud Big Data services (Azure AWS GCP). Experience as team...
€10.2 por dia
...Responsibilities: Architecture & Platform Design Design end-to-end Lakehouse architectures (Bronze/Silver/Gold) using Databricks and Delta Lake. Define reference architectures for batch, streaming, and near-real-time workloads. Select and standardize patterns for...- ...you need to have: Demonstrated proficiency with Python and PySpark. Hands-on experience with data lake formats (e.g., Iceberg, Delta Lake, or Hudi). Solid understanding of Kafka and event-driven architectures. Experience in building and orchestrating data...Trabalho remoto
- ...Data Factory, Azure Synapse Analytics and Azure Storage (Blob, Data Lake, etc.); - Experience with Databricks, including: PySpark, Delta Lake and Collaborative Notebooks; - Familiarity with Microsoft Fabric, including: Power BI, Lakehouse architecture and Data...
KWAN
Lisboa2 meses atrás - ...configuring Linux environments networking security and automation. Strong knowledge of Big Data technologies such as Hadoop Hive Kafka Delta Lake etc. Experience working with cloud platforms (AWS Azure or GCP). Strong analytical and problem-solving skills with a...
- ...warehouses, etc.). Databricks Ecosystem Expertise: Utilize the full capabilities of the Databricks platform, including Databricks SQL, Delta Lake, Databricks Runtime, and Databricks Workflows, to orchestrate complex data workflows and ensure data quality and pipeline...
- ...Factory, Synapse), or equivalent tools in AWS or GCP. Experience with Data Warehouses and Data Lakes (e.g. BigQuery, Azure Data Lake, Delta Lake, Redshift). Proficiency in Python, SQL, and/or Spark. Experience with relational and/or NoSQL databases. Familiarity...
- ...Data Architect Big Data Architect ApacheSpark PySpark Spark SQL Apache Airflow DAGs Big Data Distributed SystemsHadoop Hive Kafka Delta Lake Data Pipelines Batch Processing StreamingCloud Computing AWS Azure GCP Linux Kubernetes CI/CD Data GovernanceLisbon CI - PROC25739...
- ...appear in theCV) Big Data Architect Apache Spark PySparkSpark SQL Apache Airflow DAGs Big Data Distributed Systems Hadoop HiveKafka Delta Lake Data Pipelines Batch Processing Streaming CloudComputing AWS Azure GCP Kubernetes Linux CI/CD Microservices BankingFinancial...
- ...Design implement and maintain scalable data pipelines using Databricks Lakehouse Platform with a strong focus on Apache Spark Delta Lake and Unity Catalog . Lead the development of batch and streaming data workflows that power analytics machine learning and...
- ...Practical data programming skills in Python and SQL. Hands-on skills or a keen interest in such technologies as Apache Spark Delta Lake Airflow Kafka Kubernetes Terraform FastAPI and programming languages (Scala R Java Typescript ). Hands-on experience with both...
- ...internet era. Our flagship product, USDe, is a synthetic dollar backed by digital assets, and takes the novel approach of using a delta-neutral hedged basis strategy to maintain its peg. This product scaled from zero to $15b in 18 months. Expanding on this, iUSDe...
- ...Will Work With Microsoft Azure Azure Synapse Analytics Microsoft Fabric Azure Cosmos DB Databricks Apache Spark Delta Lake OpenAI Why Join Us? State-of-the-Art Technologies → Work with Azure, Databricks, and leading cloud technologies on...
- ...the account overtime. Systematic and faster onboarding of associates: mandatory trainings documentation Enable continuous delta KTs on new topics and refresher sessions. Technical Skills: Technical expertise in SAP Basis area with minimum of 4+ years...
- ...Management: Design and implement database schemas, tables, and views. Optimize storage formats for querying, such as Parquet or Delta Lake. Enforce data quality checks and data lineage documentation. Implement partitioning, bucketing, and indexing strategies...
Damia
Porto2 meses atrás - ...Must-Have Technical Mastery (The Full Stack Fabric Expert): Core Compute: Deep expertise in Synapse Data Engineering (PySpark Delta Lake optimization) and Synapse Data Warehouse (T-SQL performance tuning). Integration: Mastery of Data Factory pipelines and the...
- ...event ingestion (FastAPI) and real-time analytics (ClickHouse, Cube). Manages data storage in appropriate formats (S3, ClickHouse, Delta). Facilitates data processing using technologies such as Python, Spark/Databricks, ClickHouse, AWS Lambda, and Kinesis....Trabalho remoto
- ...using SQL and with proven experience - Fluency in both Portuguese and English Nice to have: - Experience with Data Bricks and Delta Lakes - Experience with Data Factory - Experience with ETL processes and orchestration - Experience using Machine Learning...
- ...Competencies Strong hands-on experience with Microsoft Azure especially: Azure Databricks (cluster configuration notebooks jobs Delta Lake); Azure Data Factory / Synapse pipelines: Azure Storage / Data Lake Azure SQL Database. Solid experience with Apache...
- ...landscape. Our flagship product, USDe , is a synthetic dollar backed by digital assets, and takes the novel approach of using a delta-neutral hedging strategy to maintain its peg. This provides a truly scalable and censorship-resistant digital dollar. Building...Lisboa2 dias atrás
