Job Description
Key Responsibilities:
Architect and build scalable data platforms using Azure (ADF, Databricks, Data Lake, Synapse) Design and optimize ETL/ELT pipelines for large-scale data processing Develop distributed data solutions using Py Spark and Python Ensure performance, cost optimization, data quality, and security Define data architecture standards, governance, and best practices Implement CI/CD and Dev Ops for data workflows Lead troubleshooting, performance tuning, and cloud migration initiatives Collaborate with stakeholders and mentor junior engineersRequired Skills:
Strong experience in Azure data services (ADF, Databricks, Synapse, Data Lake, Azure SQL) Expertise in Py Spark, Python, and advanced SQL Solid understanding of ETL/ELT, data warehousing, and lakehouse architecture Experience with Dev Ops, CI/CD, and Git Knowledge of data security, governance, and performance optimization