Job Description
For Reputed IT Organization In India -PAN India Job Overview Job Title: L2 Data Engineer (Azure / Databricks) Level: L2 – Senior Individual Contributor / Technical Specialist in Data Engineering Experience: 10+ years of overall IT experience, including 6–8 years in dedicated cloud data engineering roles. Key Responsibilities - Pipeline Development: Design, build, and maintain scalable, secure ETL/ELT pipelines on Azure using services such as Azure Data Factory, Azure Databricks, Synapse, and Data Lake.
- Data Processing: Develop robust transformation logic using PySpark, Spark SQL, and Python in Databricks notebooks and jobs.
- Lakehouse Architecture: Implement medallion architecture and Delta Lake best practices, including partitioning, optimization, and data quality controls.
- Data Modeling: Design and optimize dimensional, star/snowflake, and wide-table models for analytics, BI, and data science use cases.
- Governance and Quality: Ensure data quality, linea...
- Data Processing: Develop robust transformation logic using PySpark, Spark SQL, and Python in Databricks notebooks and jobs.
- Lakehouse Architecture: Implement medallion architecture and Delta Lake best practices, including partitioning, optimization, and data quality controls.
- Data Modeling: Design and optimize dimensional, star/snowflake, and wide-table models for analytics, BI, and data science use cases.
- Governance and Quality: Ensure data quality, linea...