Sr. Engineer - Azure Data Bricks
Antal International
📍 Gurugram, Haryana, India
Job Description
Roles & Responsibilities
Work on Azure Databricks pipelines—enhance, modify, and optimize existing pipelines and develop new ones when required.
Handle data migration from SAP/SQL Server and enterprise databases into Azure cloud environments (Lakehouse, Delta, Synapse).
Configure, manage, and optimize Databricks clusters, compute, workspaces, and resources for performance and cost efficiency.
Build scalable ETL/ELT processes using PySpark, SQL, Delta Lake, and medallion architecture across Bronze–Silver–Gold layers.
Work extensively on Azure Data Factory, orchestration pipelines, triggers, monitoring, and integration with Databricks.
Design and maintain data warehouse & dimensional models (Facts, Dimensions, SCD, Star/Snowflake schema).
Ensure strong data quality, validation, governance, and security—including Unity Catalog, RBAC, and ...