Job Description
A leading global market research organisation is seeking a Senior Data Engineer to join their Data & Platform Engineering team in Metro Manila.
What You'll Do
Design and evolve schemas for both OLTP and OLAP workloads using Azure SQL, Synapse, and Delta Lake, implementing partitioning, indexing, and row-level security for multi-tenant isolation.
Establish comprehensive data contracts and versioning protocols while governing schema evolution and implementing change data capture (CDC) and slowly changing dimension (SCD) patterns.
Optimise database performance through query tuning, resource class management, caching strategies, and cost guardrails to ensure efficient operations.
Architect reliable ELT/ETL pipelines across batch and streaming environments using Azure Data Factory, Synapse, Databricks, Event Hubs, Service Bus, Functions, and Container Apps/AKS.
Build observable data pipelines that are idempotent, retryable, lineage-aware, with well-defined SLAs/SLOs and ru...
What You'll Do
Design and evolve schemas for both OLTP and OLAP workloads using Azure SQL, Synapse, and Delta Lake, implementing partitioning, indexing, and row-level security for multi-tenant isolation.
Establish comprehensive data contracts and versioning protocols while governing schema evolution and implementing change data capture (CDC) and slowly changing dimension (SCD) patterns.
Optimise database performance through query tuning, resource class management, caching strategies, and cost guardrails to ensure efficient operations.
Architect reliable ELT/ETL pipelines across batch and streaming environments using Azure Data Factory, Synapse, Databricks, Event Hubs, Service Bus, Functions, and Container Apps/AKS.
Build observable data pipelines that are idempotent, retryable, lineage-aware, with well-defined SLAs/SLOs and ru...